2023-11-28T19:51:31.704 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T19:51:31.704 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} --archive /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605 --owner scheduled_vshankar@teuthology --verbose --name vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi -- /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605/orig.config.yaml 2023-11-28T19:51:31.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T19:51:31.829 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605 branch: wip-vshankar-testing-20231127.102914 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} email: vshankar@redhat.com first_in_suite: false job_id: '7469605' kernel: flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20231127.102914 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231127.102914 sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 owner: scheduled_vshankar@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8377 sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 sleep_before_teardown: 0 subset: 462/1024 suite: fs suite_branch: wip-vshankar-testing-20231127.102914 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNG5hiQFnJ4gtpvfs7YXc46kQcnXOasbcwzL+wbhtoHrXbIkph1cnZ8n9wZNaM1J7rCf1aJw/Yfr/13xFrRbPzs= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOIS6rIumPiJ6Sp4OTvaRqO4GCUWKCqb9GBqTbweN5XA4BCdPLi56uUaPt7GsXPZSWi3EZMim5joCl2RIgM2J7A= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5ae09a5cc7064ca2bf994df19f3006b79794789a timestamp: 2023-11-28_06:29:14 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-28T19:51:31.829 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa; will attempt to use it 2023-11-28T19:51:31.830 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks 2023-11-28T19:51:31.831 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-28T19:51:31.833 INFO:teuthology.task.internal:Checking packages... 2023-11-28T19:51:31.864 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '43dd94c190073cf16cff1e711dd7f5a7b1cbc883' 2023-11-28T19:51:31.864 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-28T19:51:31.864 INFO:teuthology.packaging:ref: None 2023-11-28T19:51:31.864 INFO:teuthology.packaging:tag: None 2023-11-28T19:51:31.864 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231127.102914 2023-11-28T19:51:31.865 INFO:teuthology.packaging:sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T19:51:31.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20231127.102914 2023-11-28T19:51:32.082 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:51:32.083 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-28T19:51:32.089 INFO:teuthology.task.internal:no buildpackages task found 2023-11-28T19:51:32.090 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-28T19:51:32.134 INFO:teuthology.task.internal:Saving configuration 2023-11-28T19:51:32.151 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-28T19:51:32.167 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T19:51:32.191 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 19:46:11.234155', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOVqq7a/7g1pLvmBYQRLZj0MwPKez0clPwbjbTm2HJxu'} 2023-11-28T19:51:32.214 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 19:46:11.236001', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHJgg6qG/ZK0Tq+NtbWEm+b4MZxxMmU+wWdosymCNyhe'} 2023-11-28T19:51:32.214 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-28T19:51:32.221 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-28T19:51:32.222 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-28T19:51:32.222 INFO:teuthology.run_tasks:Running task console_log... 2023-11-28T19:51:32.317 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9256487040>, signals=[15]) 2023-11-28T19:51:32.318 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-28T19:51:32.324 INFO:teuthology.task.internal:Opening connections... 2023-11-28T19:51:32.324 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T19:51:32.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:51:32.407 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T19:51:32.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:51:32.483 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-28T19:51:32.490 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2023-11-28T19:51:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2023-11-28T19:51:32.495 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-11-28T19:51:32.546 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T19:51:32.546 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Ubuntu" 2023-11-28T19:51:32.546 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="22.04" 2023-11-28T19:51:32.546 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T19:51:32.546 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_CODENAME=jammy 2023-11-28T19:51:32.546 INFO:teuthology.orchestra.run.smithi177.stdout:ID=ubuntu 2023-11-28T19:51:32.546 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE=debian 2023-11-28T19:51:32.547 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T19:51:32.547 INFO:teuthology.orchestra.run.smithi177.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T19:51:32.547 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T19:51:32.547 INFO:teuthology.orchestra.run.smithi177.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T19:51:32.547 INFO:teuthology.orchestra.run.smithi177.stdout:UBUNTU_CODENAME=jammy 2023-11-28T19:51:32.547 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-11-28T19:51:32.578 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-11-28T19:51:32.583 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-11-28T19:51:32.583 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-11-28T19:51:32.631 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T19:51:32.631 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu" 2023-11-28T19:51:32.632 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="22.04" 2023-11-28T19:51:32.632 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T19:51:32.632 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=jammy 2023-11-28T19:51:32.632 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu 2023-11-28T19:51:32.632 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian 2023-11-28T19:51:32.632 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T19:51:32.632 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T19:51:32.632 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T19:51:32.632 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T19:51:32.632 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=jammy 2023-11-28T19:51:32.633 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-11-28T19:51:32.652 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-28T19:51:32.662 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-28T19:51:32.684 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-28T19:51:32.684 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2023-11-28T19:51:32.687 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2023-11-28T19:51:32.691 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-28T19:51:32.709 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-28T19:51:32.709 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2023-11-28T19:51:32.736 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2023-11-28T19:51:32.917 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-28T19:51:32.968 INFO:teuthology.run_tasks:Running task kernel... 2023-11-28T19:51:32.984 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-28T19:51:32.984 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, timeout 300 2023-11-28T19:51:32.984 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T19:51:32.985 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T19:51:32.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:51:32.989 DEBUG:teuthology.task.kernel:sha1 for mon.a is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:51:32.989 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T19:51:32.990 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2023-11-28T19:51:32.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:51:32.991 DEBUG:teuthology.task.kernel:sha1 for mon.b is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:51:32.991 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T19:51:32.991 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2023-11-28T19:51:33.036 INFO:teuthology.orchestra.run.smithi195.stdout:5.15.0-56-generic 2023-11-28T19:51:33.037 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:51:33.037 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T19:51:33.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:51:33.041 INFO:teuthology.orchestra.run.smithi177.stdout:5.15.0-56-generic 2023-11-28T19:51:33.041 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:51:33.041 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T19:51:33.042 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:51:33.185 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-11-28T19:51:33.186 DEBUG:teuthology.orchestra.run.smithi177:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T19:51:33.200 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-28T19:51:33.256 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-11-28T19:51:33.257 DEBUG:teuthology.orchestra.run.smithi195:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T19:51:33.273 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-28T19:51:33.343 INFO:teuthology.orchestra.run.smithi177.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-28T19:51:33.343 INFO:teuthology.orchestra.run.smithi177.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-28T19:51:33.344 INFO:teuthology.orchestra.run.smithi177.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-28T19:51:33.344 INFO:teuthology.orchestra.run.smithi177.stderr:hint: 2023-11-28T19:51:33.344 INFO:teuthology.orchestra.run.smithi177.stderr:hint: git config --global init.defaultBranch 2023-11-28T19:51:33.344 INFO:teuthology.orchestra.run.smithi177.stderr:hint: 2023-11-28T19:51:33.344 INFO:teuthology.orchestra.run.smithi177.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-28T19:51:33.344 INFO:teuthology.orchestra.run.smithi177.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-28T19:51:33.344 INFO:teuthology.orchestra.run.smithi177.stderr:hint: 2023-11-28T19:51:33.344 INFO:teuthology.orchestra.run.smithi177.stderr:hint: git branch -m 2023-11-28T19:51:33.345 INFO:teuthology.orchestra.run.smithi177.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T19:51:33.347 DEBUG:teuthology.orchestra.run.smithi177:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T19:51:33.403 INFO:teuthology.orchestra.run.smithi195.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-28T19:51:33.403 INFO:teuthology.orchestra.run.smithi195.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-28T19:51:33.403 INFO:teuthology.orchestra.run.smithi195.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-28T19:51:33.403 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 2023-11-28T19:51:33.404 INFO:teuthology.orchestra.run.smithi195.stderr:hint: git config --global init.defaultBranch 2023-11-28T19:51:33.404 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 2023-11-28T19:51:33.404 INFO:teuthology.orchestra.run.smithi195.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-28T19:51:33.404 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-28T19:51:33.404 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 2023-11-28T19:51:33.404 INFO:teuthology.orchestra.run.smithi195.stderr:hint: git branch -m 2023-11-28T19:51:33.405 INFO:teuthology.orchestra.run.smithi195.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T19:51:33.407 DEBUG:teuthology.orchestra.run.smithi195:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T19:51:33.416 DEBUG:teuthology.orchestra.run.smithi177:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T19:51:33.471 DEBUG:teuthology.orchestra.run.smithi177:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T19:51:33.473 DEBUG:teuthology.orchestra.run.smithi195:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T19:51:33.530 DEBUG:teuthology.orchestra.run.smithi195:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T19:52:20.182 INFO:teuthology.orchestra.run.smithi177.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T19:52:20.182 INFO:teuthology.orchestra.run.smithi177.stderr: * [new branch] main -> origin/main 2023-11-28T19:52:20.206 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T19:52:20.206 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T19:52:20.206 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T19:52:20.207 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T19:52:20.207 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T19:52:20.207 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T19:52:20.207 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T19:52:20.207 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T19:52:20.207 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T19:52:20.210 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T19:52:20.210 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T19:52:20.210 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T19:52:20.210 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T19:52:20.211 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T19:52:20.211 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T19:52:20.211 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T19:52:20.211 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T19:52:20.211 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T19:52:20.211 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T19:52:20.211 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T19:52:20.211 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T19:52:20.211 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T19:52:20.211 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T19:52:20.211 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T19:52:20.212 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T19:52:20.212 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T19:52:20.212 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T19:52:20.212 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T19:52:20.212 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T19:52:20.212 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T19:52:20.212 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T19:52:20.212 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T19:52:20.212 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T19:52:20.212 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T19:52:20.212 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T19:52:20.212 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T19:52:20.213 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T19:52:20.214 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T19:52:20.214 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T19:52:20.214 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T19:52:20.214 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T19:52:20.214 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T19:52:20.214 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T19:52:20.214 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T19:52:20.215 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T19:52:20.215 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T19:52:20.215 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T19:52:20.215 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T19:52:20.215 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T19:52:24.191 INFO:teuthology.orchestra.run.smithi177.stderr:Updating files: 51% (1669/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 64% (2080/3250) Updating files: 65% (2113/3250) Updating files: 65% (2115/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 81% (2650/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T19:52:24.196 INFO:teuthology.orchestra.run.smithi177.stdout:HEAD is now at aae60524 Merge branch 'make-opts' into 'main' 2023-11-28T19:52:24.217 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.a... 2023-11-28T19:52:24.218 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:52:24.481 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T19:52:24.482 DEBUG:teuthology.orchestra.run.smithi177:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T19:52:24.484 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi177.front.sepia.ceph.com to complete... 2023-11-28T19:52:25.163 INFO:teuthology.orchestra.run.smithi195.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T19:52:25.163 INFO:teuthology.orchestra.run.smithi195.stderr: * [new branch] main -> origin/main 2023-11-28T19:52:25.187 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T19:52:25.187 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T19:52:25.187 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T19:52:25.187 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T19:52:25.187 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T19:52:25.187 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T19:52:25.187 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T19:52:25.187 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T19:52:25.189 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T19:52:25.189 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T19:52:25.189 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T19:52:25.189 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T19:52:25.189 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T19:52:25.190 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T19:52:25.190 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T19:52:25.190 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T19:52:25.190 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T19:52:25.190 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T19:52:25.190 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T19:52:25.190 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T19:52:25.190 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T19:52:25.190 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T19:52:25.190 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T19:52:25.190 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T19:52:25.193 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T19:52:25.193 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T19:52:25.193 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T19:52:25.193 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T19:52:25.193 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T19:52:25.193 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T19:52:25.193 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T19:52:25.193 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T19:52:25.193 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T19:52:25.193 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T19:52:25.193 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T19:52:25.194 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T19:52:25.194 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T19:52:25.194 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T19:52:25.194 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T19:52:25.194 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T19:52:25.194 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T19:52:25.194 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T19:52:25.194 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T19:52:25.194 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T19:52:25.194 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T19:52:25.194 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T19:52:25.194 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T19:52:25.195 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T19:52:25.195 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T19:52:26.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28 19:52:25 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-28T19:52:26.107 INFO:teuthology.orchestra.run.smithi177.stderr:FINISHED --2023-11-28 19:52:25-- 2023-11-28T19:52:26.108 INFO:teuthology.orchestra.run.smithi177.stderr:Total wall clock time: 1.5s 2023-11-28T19:52:26.108 INFO:teuthology.orchestra.run.smithi177.stderr:Downloaded: 1 files, 37M in 1.4s (27.0 MB/s) 2023-11-28T19:52:26.110 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.a... 2023-11-28T19:52:26.111 DEBUG:teuthology.orchestra.run.smithi177:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T19:52:26.355 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T19:52:28.362 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-28T19:52:28.370 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T19:52:28.461 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T19:52:29.171 INFO:teuthology.orchestra.run.smithi195.stderr:Updating files: 51% (1669/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 64% (2080/3250) Updating files: 65% (2113/3250) Updating files: 65% (2115/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 81% (2650/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T19:52:29.175 INFO:teuthology.orchestra.run.smithi195.stdout:HEAD is now at aae60524 Merge branch 'make-opts' into 'main' 2023-11-28T19:52:29.197 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.b... 2023-11-28T19:52:29.197 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:52:29.344 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T19:52:29.345 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T19:52:29.349 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi195.front.sepia.ceph.com to complete... 2023-11-28T19:52:31.946 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T19:52:32.050 INFO:teuthology.orchestra.run.smithi177.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:52:32.727 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28 19:52:32 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-28T19:52:32.728 INFO:teuthology.orchestra.run.smithi195.stderr:FINISHED --2023-11-28 19:52:32-- 2023-11-28T19:52:32.728 INFO:teuthology.orchestra.run.smithi195.stderr:Total wall clock time: 3.3s 2023-11-28T19:52:32.728 INFO:teuthology.orchestra.run.smithi195.stderr:Downloaded: 1 files, 37M in 3.0s (12.4 MB/s) 2023-11-28T19:52:32.731 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.b... 2023-11-28T19:52:32.731 DEBUG:teuthology.orchestra.run.smithi195:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T19:52:33.052 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T19:52:35.052 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-28T19:52:35.056 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T19:52:35.169 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T19:52:38.436 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T19:52:38.548 INFO:teuthology.orchestra.run.smithi195.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:52:52.656 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub' 2023-11-28T19:52:52.671 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T19:52:52.695 INFO:teuthology.orchestra.run.smithi177.stderr:Generating grub configuration file ... 2023-11-28T19:52:53.040 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T19:52:53.062 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:52:53.346 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T19:52:53.354 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T19:52:53.422 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T19:52:53.428 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T19:52:53.582 INFO:teuthology.orchestra.run.smithi177.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T19:52:53.583 INFO:teuthology.orchestra.run.smithi177.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T19:52:53.583 INFO:teuthology.orchestra.run.smithi177.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T19:52:53.615 INFO:teuthology.orchestra.run.smithi177.stderr:done 2023-11-28T19:52:53.793 DEBUG:teuthology.orchestra.run.smithi177:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T19:52:53.800 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-28T19:52:53.800 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-28T19:52:53.800 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T19:52:53.812 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T19:52:53.813 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T19:52:53.834 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-28T19:52:53.834 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-28T19:52:53.834 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-28T19:52:53.835 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-28T19:52:53.835 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-28T19:52:53.835 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-28T19:52:53.835 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-28T19:52:53.835 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-28T19:52:53.835 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T19:52:53.835 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T19:52:53.835 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T19:52:53.835 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T19:52:53.835 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T19:52:53.835 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T19:52:53.835 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T19:52:53.836 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T19:52:53.836 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T19:52:53.836 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T19:52:53.836 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T19:52:53.836 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T19:52:53.836 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T19:52:53.836 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T19:52:53.836 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T19:52:53.836 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T19:52:53.836 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T19:52:53.836 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T19:52:53.836 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T19:52:53.837 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T19:52:53.837 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T19:52:53.837 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T19:52:53.837 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T19:52:53.837 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T19:52:53.837 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T19:52:53.837 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T19:52:53.837 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T19:52:53.837 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T19:52:53.837 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T19:52:53.837 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T19:52:53.838 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T19:52:53.838 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T19:52:53.838 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T19:52:53.838 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T19:52:53.838 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T19:52:53.914 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T19:52:53.914 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T19:52:53.914 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T19:52:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T19:52:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T19:52:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T19:52:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T19:52:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T19:52:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T19:52:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T19:52:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T19:52:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T19:52:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T19:52:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T19:52:53.916 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T19:52:53.916 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T19:52:53.916 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T19:52:53.916 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T19:52:53.916 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T19:52:53.916 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T19:52:53.916 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T19:52:53.917 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T19:52:53.917 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T19:52:53.917 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T19:52:53.917 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T19:52:53.917 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T19:52:53.917 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T19:52:53.917 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T19:52:53.917 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T19:52:53.917 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T19:52:53.917 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T19:52:53.917 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T19:52:53.917 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T19:52:53.918 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T19:52:53.918 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T19:52:53.918 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T19:52:53.918 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T19:52:53.918 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T19:52:53.918 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T19:52:53.918 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T19:52:53.918 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T19:52:53.918 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T19:52:53.918 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T19:52:53.919 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T19:52:53.919 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T19:52:53.919 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T19:52:53.919 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T19:52:53.919 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T19:52:53.919 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T19:52:53.919 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T19:52:53.919 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T19:52:53.919 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T19:52:53.919 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T19:52:53.919 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T19:52:53.919 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T19:52:53.919 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T19:52:53.920 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T19:52:53.920 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T19:52:53.920 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T19:52:53.920 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T19:52:53.920 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T19:52:53.920 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T19:52:53.920 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T19:52:53.920 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T19:52:53.920 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T19:52:53.920 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T19:52:53.920 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T19:52:53.920 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T19:52:53.920 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T19:52:53.921 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T19:52:53.921 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T19:52:53.921 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T19:52:53.921 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T19:52:53.921 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T19:52:53.921 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T19:52:53.921 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T19:52:53.921 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T19:52:53.921 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T19:52:53.921 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T19:52:53.921 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T19:52:53.921 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T19:52:53.922 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T19:52:53.922 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T19:52:53.922 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T19:52:53.922 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T19:52:53.922 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T19:52:53.922 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T19:52:53.922 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T19:52:53.922 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T19:52:53.922 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T19:52:53.922 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T19:52:53.922 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T19:52:53.923 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T19:52:53.923 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T19:52:53.923 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T19:52:53.923 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T19:52:53.923 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T19:52:53.923 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T19:52:53.923 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T19:52:53.923 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T19:52:53.923 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T19:52:53.923 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T19:52:53.923 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T19:52:53.924 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T19:52:53.924 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T19:52:53.924 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T19:52:53.924 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T19:52:53.924 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T19:52:53.924 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T19:52:53.924 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T19:52:53.924 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T19:52:53.924 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T19:52:53.924 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T19:52:53.924 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T19:52:53.924 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T19:52:53.925 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T19:52:53.925 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T19:52:53.925 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T19:52:53.925 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T19:52:53.925 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T19:52:53.925 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T19:52:53.925 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T19:52:53.925 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T19:52:53.925 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T19:52:53.925 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T19:52:53.925 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T19:52:53.925 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T19:52:53.926 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T19:52:53.926 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T19:52:53.926 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T19:52:53.926 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T19:52:53.926 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T19:52:53.926 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T19:52:53.926 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T19:52:53.927 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T19:52:53.927 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T19:52:53.927 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T19:52:53.927 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T19:52:53.927 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T19:52:53.927 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T19:52:53.927 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T19:52:53.927 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T19:52:53.927 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T19:52:53.927 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T19:52:53.927 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T19:52:53.927 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T19:52:53.929 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T19:52:53.930 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T19:52:53.930 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T19:52:53.930 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T19:52:53.930 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T19:52:53.930 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T19:52:53.930 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T19:52:53.930 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T19:52:53.930 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T19:52:53.931 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T19:52:53.931 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T19:52:53.931 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T19:52:53.931 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T19:52:53.931 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T19:52:53.931 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T19:52:53.931 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T19:52:53.931 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T19:52:53.931 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T19:52:53.931 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T19:52:53.931 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T19:52:53.931 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T19:52:53.932 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T19:52:53.932 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T19:52:53.932 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T19:52:53.932 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T19:52:53.932 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T19:52:53.932 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T19:52:53.932 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T19:52:53.932 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T19:52:53.932 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T19:52:53.932 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T19:52:53.932 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T19:52:53.932 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T19:52:53.933 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T19:52:53.933 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T19:52:53.933 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T19:52:53.933 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T19:52:53.933 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T19:52:53.933 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T19:52:53.933 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T19:52:53.933 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T19:52:53.933 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T19:52:53.933 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T19:52:53.933 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T19:52:53.933 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T19:52:53.934 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T19:52:53.934 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T19:52:53.934 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T19:52:53.934 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T19:52:53.934 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T19:52:53.934 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T19:52:53.934 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T19:52:53.934 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T19:52:53.934 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T19:52:53.934 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T19:52:53.934 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T19:52:53.934 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T19:52:53.935 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T19:52:53.935 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T19:52:53.935 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T19:52:53.935 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T19:52:53.935 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T19:52:53.935 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T19:52:53.935 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T19:52:53.935 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T19:52:53.935 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T19:52:53.935 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T19:52:53.935 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T19:52:53.935 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T19:52:53.936 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T19:52:53.936 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T19:52:53.936 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T19:52:53.936 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T19:52:53.936 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T19:52:53.936 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T19:52:53.936 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T19:52:53.936 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T19:52:53.936 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T19:52:53.936 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T19:52:53.936 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T19:52:53.937 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T19:52:53.937 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T19:52:53.937 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T19:52:53.937 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T19:52:53.937 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T19:52:53.937 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T19:52:53.937 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T19:52:53.937 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T19:52:53.938 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T19:52:53.938 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T19:52:53.938 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T19:52:53.938 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T19:52:53.938 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T19:52:53.938 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T19:52:53.938 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T19:52:53.938 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T19:52:53.938 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T19:52:53.938 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T19:52:53.939 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T19:52:53.939 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T19:52:53.939 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T19:52:53.939 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T19:52:53.939 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T19:52:53.939 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T19:52:53.939 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T19:52:53.939 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T19:52:53.939 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T19:52:53.939 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T19:52:53.939 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T19:52:53.940 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T19:52:53.940 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T19:52:53.940 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T19:52:53.940 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T19:52:53.940 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T19:52:53.940 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T19:52:53.940 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T19:52:53.940 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T19:52:53.940 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T19:52:53.940 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T19:52:53.940 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T19:52:53.940 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T19:52:53.941 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T19:52:53.941 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T19:52:53.941 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T19:52:53.941 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T19:52:53.941 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T19:52:53.941 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T19:52:53.941 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T19:52:53.942 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T19:52:53.942 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T19:52:53.942 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T19:52:53.942 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T19:52:53.942 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T19:52:53.942 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T19:52:53.942 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T19:52:53.943 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T19:52:53.943 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T19:52:53.943 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T19:52:53.943 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T19:52:53.943 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T19:52:53.943 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T19:52:53.943 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T19:52:53.944 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T19:52:53.944 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T19:52:53.944 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T19:52:53.944 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T19:52:53.944 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T19:52:53.944 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T19:52:53.944 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T19:52:53.944 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T19:52:53.945 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T19:52:53.945 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T19:52:53.945 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T19:52:53.945 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T19:52:53.945 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T19:52:53.945 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T19:52:53.945 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T19:52:53.946 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T19:52:53.946 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T19:52:53.946 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T19:52:53.946 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T19:52:53.946 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T19:52:53.946 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T19:52:53.947 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T19:52:53.947 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T19:52:53.947 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T19:52:53.947 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T19:52:53.947 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T19:52:53.947 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T19:52:53.947 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T19:52:53.947 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T19:52:53.947 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T19:52:53.948 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T19:52:53.948 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T19:52:53.948 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T19:52:53.948 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T19:52:53.948 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T19:52:53.948 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T19:52:53.948 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T19:52:53.948 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T19:52:53.948 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T19:52:53.948 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T19:52:53.948 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T19:52:53.948 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T19:52:53.948 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T19:52:53.949 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T19:52:53.949 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T19:52:53.949 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T19:52:53.949 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T19:52:53.949 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T19:52:53.949 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T19:52:53.949 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T19:52:53.949 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T19:52:53.949 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T19:52:53.949 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T19:52:53.949 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T19:52:53.949 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T19:52:53.949 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T19:52:53.949 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T19:52:53.950 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T19:52:53.950 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T19:52:53.950 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T19:52:53.950 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T19:52:53.950 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T19:52:53.950 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T19:52:53.950 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T19:52:53.950 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T19:52:53.950 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T19:52:53.951 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T19:52:53.951 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T19:52:53.951 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T19:52:53.951 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T19:52:53.951 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T19:52:53.951 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T19:52:53.951 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T19:52:53.951 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T19:52:53.951 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T19:52:53.951 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T19:52:53.952 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T19:52:53.952 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T19:52:53.952 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T19:52:53.952 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T19:52:53.952 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T19:52:53.952 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T19:52:53.952 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T19:52:53.952 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T19:52:53.952 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T19:52:53.952 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T19:52:53.952 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T19:52:53.952 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T19:52:53.953 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T19:52:53.953 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T19:52:53.953 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T19:52:53.953 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T19:52:53.953 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T19:52:53.953 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T19:52:53.953 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T19:52:53.953 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T19:52:53.953 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T19:52:53.954 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T19:52:53.954 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T19:52:53.954 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T19:52:53.954 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T19:52:53.954 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T19:52:53.954 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T19:52:53.954 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T19:52:53.954 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T19:52:53.954 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T19:52:53.954 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T19:52:53.954 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T19:52:53.955 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T19:52:53.955 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T19:52:53.955 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T19:52:53.955 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T19:52:53.955 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T19:52:53.955 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T19:52:53.955 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T19:52:53.955 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T19:52:53.955 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T19:52:53.955 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T19:52:53.955 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T19:52:53.955 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T19:52:53.956 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T19:52:53.956 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T19:52:53.956 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T19:52:53.956 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T19:52:53.956 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T19:52:53.956 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T19:52:53.956 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T19:52:53.956 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T19:52:53.956 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T19:52:53.956 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T19:52:53.956 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T19:52:53.956 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T19:52:53.956 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T19:52:53.957 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T19:52:53.957 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T19:52:53.957 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T19:52:53.957 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T19:52:53.957 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T19:52:53.957 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T19:52:53.957 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T19:52:53.957 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T19:52:53.957 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T19:52:53.957 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T19:52:53.957 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T19:52:53.958 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T19:52:53.958 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T19:52:53.958 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T19:52:53.958 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T19:52:53.958 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T19:52:53.958 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T19:52:53.958 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T19:52:53.958 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T19:52:53.959 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T19:52:53.959 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T19:52:53.959 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T19:52:53.959 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T19:52:53.959 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T19:52:53.959 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T19:52:53.959 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T19:52:53.959 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T19:52:53.959 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T19:52:53.959 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T19:52:53.959 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T19:52:53.959 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T19:52:53.959 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T19:52:53.960 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T19:52:53.960 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T19:52:53.960 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T19:52:53.960 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T19:52:53.960 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T19:52:53.960 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T19:52:53.960 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T19:52:53.960 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T19:52:53.960 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T19:52:53.960 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T19:52:53.960 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T19:52:53.960 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T19:52:53.960 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T19:52:53.961 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T19:52:53.961 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T19:52:53.961 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T19:52:53.961 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T19:52:53.961 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T19:52:53.961 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T19:52:53.961 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T19:52:53.961 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T19:52:53.961 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T19:52:53.962 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T19:52:53.962 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T19:52:53.962 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T19:52:53.962 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T19:52:53.962 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T19:52:53.962 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T19:52:53.962 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T19:52:53.962 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T19:52:53.962 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T19:52:53.963 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T19:52:53.963 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T19:52:53.963 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T19:52:53.963 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T19:52:53.963 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T19:52:53.963 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T19:52:53.963 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T19:52:53.963 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T19:52:53.963 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T19:52:53.963 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T19:52:53.963 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T19:52:53.963 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T19:52:53.964 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T19:52:53.964 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T19:52:53.964 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T19:52:53.964 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T19:52:53.964 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T19:52:53.964 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T19:52:53.964 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T19:52:53.964 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T19:52:53.964 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T19:52:53.964 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T19:52:53.965 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T19:52:53.965 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T19:52:53.965 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T19:52:53.965 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T19:52:53.965 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T19:52:53.965 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T19:52:53.965 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T19:52:53.965 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T19:52:53.965 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T19:52:53.965 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T19:52:53.965 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T19:52:53.965 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T19:52:53.966 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T19:52:53.966 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T19:52:53.966 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T19:52:53.966 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T19:52:53.966 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T19:52:53.966 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T19:52:53.966 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T19:52:53.966 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T19:52:53.966 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T19:52:53.966 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T19:52:53.966 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T19:52:53.966 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T19:52:53.966 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T19:52:53.967 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T19:52:53.967 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T19:52:53.967 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T19:52:53.967 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T19:52:53.967 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T19:52:53.967 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T19:52:53.967 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T19:52:53.967 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T19:52:53.967 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T19:52:53.967 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T19:52:53.967 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T19:52:53.967 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T19:52:53.967 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T19:52:53.968 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T19:52:53.968 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T19:52:53.968 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T19:52:53.968 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T19:52:53.968 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T19:52:53.968 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T19:52:53.968 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T19:52:53.968 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T19:52:53.968 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T19:52:53.968 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T19:52:53.968 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T19:52:53.969 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T19:52:53.969 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T19:52:53.969 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T19:52:53.969 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T19:52:53.969 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T19:52:53.969 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T19:52:53.969 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T19:52:53.969 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T19:52:53.969 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T19:52:53.969 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T19:52:53.969 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T19:52:53.970 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T19:52:53.970 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T19:52:53.970 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T19:52:53.970 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T19:52:53.970 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T19:52:53.970 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T19:52:53.970 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T19:52:53.970 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T19:52:53.970 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T19:52:53.970 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T19:52:53.970 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T19:52:53.971 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T19:52:53.971 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T19:52:53.971 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T19:52:53.971 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T19:52:53.971 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T19:52:53.971 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T19:52:53.971 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T19:52:53.971 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T19:52:53.971 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T19:52:53.971 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T19:52:53.971 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T19:52:53.971 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T19:52:53.971 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T19:52:53.972 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T19:52:53.972 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T19:52:53.972 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T19:52:53.972 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T19:52:53.972 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T19:52:53.972 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T19:52:53.972 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T19:52:53.972 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T19:52:53.972 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T19:52:53.973 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T19:52:53.973 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T19:52:53.973 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T19:52:53.973 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T19:52:53.973 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T19:52:53.973 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T19:52:53.973 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T19:52:53.973 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T19:52:53.973 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T19:52:53.973 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T19:52:53.973 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T19:52:53.973 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T19:52:53.974 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T19:52:53.974 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T19:52:53.974 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T19:52:53.974 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T19:52:53.974 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T19:52:53.974 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T19:52:53.974 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T19:52:53.974 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T19:52:53.974 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T19:52:53.974 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T19:52:53.974 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T19:52:53.974 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T19:52:53.975 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T19:52:53.975 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T19:52:53.975 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T19:52:53.975 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T19:52:53.975 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T19:52:53.975 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T19:52:53.975 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T19:52:53.975 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T19:52:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T19:52:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T19:52:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T19:52:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T19:52:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T19:52:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T19:52:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T19:52:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T19:52:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T19:52:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T19:52:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T19:52:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T19:52:53.976 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T19:52:53.977 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T19:52:53.977 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T19:52:53.977 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T19:52:53.977 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T19:52:53.977 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T19:52:53.977 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T19:52:53.977 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T19:52:53.977 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T19:52:53.977 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T19:52:53.977 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T19:52:53.977 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T19:52:53.977 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T19:52:53.977 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T19:52:53.977 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T19:52:53.978 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T19:52:53.978 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T19:52:53.978 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T19:52:53.978 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T19:52:53.978 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T19:52:53.978 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T19:52:53.978 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T19:52:53.978 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T19:52:53.978 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T19:52:53.978 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T19:52:53.978 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T19:52:53.978 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T19:52:53.979 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T19:52:53.979 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T19:52:53.979 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T19:52:53.979 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T19:52:53.979 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T19:52:53.979 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T19:52:53.979 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T19:52:53.979 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T19:52:53.980 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T19:52:53.980 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T19:52:53.980 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T19:52:53.980 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T19:52:53.980 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T19:52:53.980 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T19:52:53.980 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T19:52:53.980 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T19:52:53.980 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T19:52:53.980 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T19:52:53.980 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T19:52:53.981 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T19:52:53.981 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T19:52:53.981 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T19:52:53.981 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T19:52:53.981 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T19:52:53.981 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T19:52:53.981 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T19:52:53.981 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T19:52:53.981 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T19:52:53.981 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T19:52:53.981 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T19:52:53.981 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T19:52:53.981 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T19:52:53.982 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T19:52:53.982 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T19:52:53.982 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T19:52:53.982 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T19:52:53.982 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T19:52:53.982 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T19:52:53.982 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T19:52:53.982 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T19:52:53.982 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T19:52:53.982 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T19:52:53.982 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T19:52:53.983 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T19:52:53.983 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T19:52:53.983 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T19:52:53.983 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T19:52:53.983 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T19:52:53.983 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T19:52:53.983 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T19:52:53.984 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T19:52:53.984 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T19:52:53.984 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T19:52:53.984 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T19:52:53.984 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T19:52:53.984 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T19:52:53.984 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T19:52:53.984 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T19:52:53.984 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T19:52:53.984 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T19:52:53.984 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T19:52:53.984 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T19:52:53.984 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T19:52:53.984 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T19:52:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T19:52:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T19:52:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T19:52:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T19:52:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T19:52:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T19:52:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T19:52:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T19:52:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T19:52:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T19:52:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T19:52:53.985 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T19:52:53.986 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T19:52:53.986 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T19:52:53.986 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T19:52:53.986 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T19:52:53.986 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T19:52:53.986 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T19:52:53.986 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T19:52:53.986 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T19:52:53.986 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T19:52:53.986 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T19:52:53.986 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T19:52:53.987 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T19:52:53.987 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T19:52:53.987 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T19:52:53.987 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T19:52:53.987 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T19:52:53.987 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T19:52:53.987 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T19:52:53.987 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T19:52:53.987 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T19:52:53.987 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T19:52:53.987 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T19:52:53.987 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T19:52:53.987 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T19:52:53.988 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T19:52:53.988 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T19:52:53.988 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T19:52:53.988 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T19:52:53.988 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T19:52:53.988 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T19:52:53.988 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T19:52:53.988 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T19:52:53.988 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T19:52:53.988 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T19:52:53.988 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T19:52:53.988 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T19:52:53.989 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T19:52:53.989 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T19:52:53.989 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T19:52:53.989 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T19:52:53.989 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T19:52:53.989 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T19:52:53.989 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T19:52:53.989 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T19:52:53.989 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T19:52:53.989 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T19:52:53.989 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T19:52:53.989 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T19:52:53.989 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T19:52:53.990 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T19:52:53.990 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T19:52:53.990 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T19:52:53.990 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T19:52:53.990 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T19:52:53.990 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T19:52:53.991 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T19:52:53.991 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T19:52:53.991 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T19:52:53.991 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T19:52:53.991 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T19:52:53.991 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T19:52:53.992 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T19:52:53.992 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T19:52:53.992 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T19:52:53.992 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T19:52:53.992 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T19:52:53.992 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T19:52:53.992 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T19:52:53.992 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T19:52:53.992 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T19:52:53.992 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T19:52:53.993 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T19:52:53.993 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T19:52:53.993 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T19:52:53.993 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T19:52:53.993 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T19:52:53.993 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T19:52:53.993 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T19:52:53.993 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T19:52:53.993 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T19:52:53.993 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T19:52:53.994 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T19:52:53.994 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T19:52:53.994 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T19:52:53.994 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T19:52:53.994 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T19:52:53.994 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T19:52:53.994 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T19:52:53.994 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T19:52:53.994 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T19:52:53.995 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T19:52:53.995 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T19:52:53.995 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T19:52:53.995 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T19:52:53.995 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T19:52:53.995 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T19:52:53.995 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T19:52:53.995 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T19:52:53.995 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T19:52:53.995 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T19:52:53.995 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T19:52:53.995 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T19:52:53.996 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T19:52:53.996 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T19:52:53.996 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T19:52:53.996 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T19:52:53.996 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T19:52:53.996 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T19:52:53.996 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T19:52:53.996 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T19:52:53.996 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T19:52:53.996 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T19:52:53.996 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T19:52:53.996 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T19:52:53.997 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T19:52:53.997 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T19:52:53.997 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T19:52:53.997 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T19:52:53.997 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T19:52:53.997 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T19:52:53.997 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T19:52:53.997 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T19:52:53.997 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T19:52:53.997 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T19:52:53.997 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T19:52:53.997 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T19:52:53.997 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T19:52:53.998 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T19:52:53.998 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T19:52:53.998 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T19:52:53.998 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T19:52:53.998 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T19:52:53.998 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T19:52:53.998 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T19:52:53.998 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T19:52:53.998 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T19:52:53.998 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T19:52:53.998 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T19:52:53.998 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T19:52:53.999 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T19:52:53.999 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T19:52:53.999 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T19:52:53.999 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T19:52:53.999 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T19:52:53.999 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T19:52:53.999 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T19:52:53.999 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T19:52:53.999 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T19:52:53.999 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T19:52:53.999 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T19:52:53.999 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T19:52:53.999 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T19:52:54.000 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T19:52:54.120 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T19:52:54.120 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T19:52:54.120 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T19:52:54.120 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T19:52:54.120 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T19:52:54.120 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T19:52:54.120 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T19:52:54.121 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T19:52:54.121 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T19:52:54.121 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T19:52:54.121 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T19:52:54.121 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T19:52:54.121 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T19:52:54.121 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T19:52:54.121 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T19:52:54.121 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T19:52:54.121 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T19:52:54.121 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T19:52:54.121 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T19:52:54.121 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T19:52:54.121 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T19:52:54.122 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T19:52:54.122 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T19:52:54.122 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T19:52:54.122 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T19:52:54.122 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T19:52:54.122 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T19:52:54.122 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T19:52:54.122 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T19:52:54.122 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T19:52:54.122 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T19:52:54.122 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T19:52:54.122 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T19:52:54.122 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T19:52:54.123 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T19:52:54.123 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T19:52:54.123 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T19:52:54.123 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T19:52:54.123 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T19:52:54.123 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T19:52:54.123 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T19:52:54.123 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T19:52:54.123 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T19:52:54.123 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T19:52:54.123 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T19:52:54.123 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T19:52:54.124 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T19:52:54.124 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T19:52:54.124 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T19:52:54.124 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T19:52:54.124 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T19:52:54.124 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T19:52:54.124 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T19:52:54.124 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T19:52:54.124 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T19:52:54.124 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T19:52:54.124 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T19:52:54.124 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T19:52:54.124 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T19:52:54.124 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T19:52:54.125 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T19:52:54.125 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T19:52:54.125 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T19:52:54.125 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T19:52:54.125 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T19:52:54.125 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T19:52:54.125 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T19:52:54.125 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T19:52:54.125 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T19:52:54.125 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T19:52:54.125 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T19:52:54.125 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T19:52:54.125 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T19:52:54.126 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T19:52:54.126 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T19:52:54.126 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T19:52:54.126 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T19:52:54.126 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T19:52:54.126 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T19:52:54.126 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T19:52:54.126 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T19:52:54.126 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T19:52:54.126 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T19:52:54.126 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T19:52:54.126 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T19:52:54.126 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T19:52:54.126 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T19:52:54.127 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T19:52:54.127 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T19:52:54.127 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T19:52:54.127 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T19:52:54.127 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T19:52:54.127 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T19:52:54.127 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T19:52:54.127 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T19:52:54.127 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T19:52:54.127 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T19:52:54.127 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T19:52:54.127 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T19:52:54.127 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T19:52:54.127 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T19:52:54.128 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T19:52:54.128 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T19:52:54.128 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T19:52:54.128 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T19:52:54.128 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T19:52:54.128 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T19:52:54.128 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T19:52:54.128 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T19:52:54.128 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T19:52:54.128 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T19:52:54.128 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T19:52:54.128 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T19:52:54.128 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T19:52:54.129 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T19:52:54.129 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T19:52:54.129 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T19:52:54.129 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T19:52:54.129 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T19:52:54.129 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T19:52:54.129 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T19:52:54.129 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T19:52:54.129 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T19:52:54.129 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T19:52:54.129 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T19:52:54.129 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T19:52:54.129 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T19:52:54.129 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T19:52:54.130 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T19:52:54.130 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T19:52:54.130 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T19:52:54.130 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T19:52:54.130 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T19:52:54.130 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T19:52:54.130 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T19:52:54.130 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T19:52:54.130 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T19:52:54.130 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T19:52:54.130 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T19:52:54.130 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T19:52:54.130 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T19:52:54.131 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T19:52:54.131 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T19:52:54.131 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T19:52:54.131 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T19:52:54.131 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T19:52:54.131 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T19:52:54.131 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T19:52:54.131 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T19:52:54.131 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T19:52:54.131 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T19:52:54.131 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T19:52:54.131 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T19:52:54.131 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T19:52:54.131 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T19:52:54.132 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T19:52:54.132 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T19:52:54.132 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T19:52:54.132 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T19:52:54.132 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T19:52:54.132 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T19:52:54.132 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T19:52:54.132 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T19:52:54.132 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T19:52:54.132 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T19:52:54.132 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T19:52:54.132 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T19:52:54.132 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T19:52:54.132 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T19:52:54.133 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T19:52:54.133 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T19:52:54.133 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T19:52:54.133 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T19:52:54.133 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T19:52:54.133 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T19:52:54.133 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T19:52:54.133 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T19:52:54.133 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T19:52:54.133 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T19:52:54.133 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T19:52:54.133 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T19:52:54.133 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T19:52:54.133 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T19:52:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T19:52:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T19:52:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T19:52:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T19:52:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T19:52:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T19:52:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T19:52:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T19:52:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T19:52:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T19:52:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T19:52:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T19:52:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T19:52:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T19:52:54.135 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T19:52:54.135 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T19:52:54.135 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T19:52:54.135 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T19:52:54.135 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T19:52:54.135 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T19:52:54.135 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T19:52:54.135 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T19:52:54.135 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T19:52:54.135 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T19:52:54.135 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T19:52:54.135 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T19:52:54.135 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T19:52:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T19:52:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T19:52:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T19:52:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T19:52:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T19:52:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T19:52:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T19:52:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T19:52:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T19:52:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T19:52:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T19:52:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T19:52:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T19:52:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T19:52:54.137 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T19:52:54.137 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T19:52:54.137 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T19:52:54.137 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T19:52:54.137 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T19:52:54.137 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T19:52:54.137 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T19:52:54.137 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T19:52:54.137 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T19:52:54.137 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T19:52:54.137 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T19:52:54.137 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T19:52:54.137 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T19:52:54.137 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T19:52:54.138 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T19:52:54.138 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T19:52:54.138 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T19:52:54.138 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T19:52:54.138 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T19:52:54.138 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T19:52:54.138 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T19:52:54.138 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T19:52:54.138 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T19:52:54.138 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T19:52:54.138 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T19:52:54.138 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T19:52:54.138 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T19:52:54.138 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T19:52:54.139 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T19:52:54.139 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T19:52:54.139 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T19:52:54.139 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T19:52:54.139 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T19:52:54.139 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T19:52:54.139 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T19:52:54.139 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T19:52:54.139 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T19:52:54.139 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T19:52:54.139 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T19:52:54.139 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T19:52:54.139 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T19:52:54.139 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T19:52:54.140 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T19:52:54.140 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T19:52:54.140 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T19:52:54.140 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T19:52:54.140 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T19:52:54.140 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T19:52:54.140 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T19:52:54.140 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T19:52:54.140 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T19:52:54.140 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T19:52:54.140 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T19:52:54.140 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T19:52:54.140 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T19:52:54.141 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T19:52:54.141 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T19:52:54.141 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T19:52:54.141 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T19:52:54.141 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T19:52:54.141 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T19:52:54.141 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T19:52:54.141 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T19:52:54.141 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T19:52:54.141 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T19:52:54.141 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T19:52:54.141 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T19:52:54.141 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T19:52:54.141 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T19:52:54.142 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T19:52:54.142 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T19:52:54.142 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T19:52:54.142 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T19:52:54.142 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T19:52:54.142 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T19:52:54.142 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T19:52:54.142 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T19:52:54.142 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T19:52:54.142 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T19:52:54.142 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T19:52:54.142 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T19:52:54.142 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T19:52:54.142 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T19:52:54.143 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T19:52:54.143 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T19:52:54.143 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T19:52:54.143 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T19:52:54.143 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T19:52:54.143 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T19:52:54.143 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T19:52:54.143 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T19:52:54.143 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T19:52:54.143 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T19:52:54.143 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T19:52:54.143 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T19:52:54.143 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T19:52:54.143 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T19:52:54.144 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T19:52:54.144 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T19:52:54.144 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T19:52:54.144 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T19:52:54.144 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T19:52:54.144 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T19:52:54.144 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T19:52:54.144 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T19:52:54.144 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T19:52:54.144 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T19:52:54.144 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T19:52:54.144 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T19:52:54.144 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T19:52:54.144 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T19:52:54.145 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T19:52:54.145 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T19:52:54.145 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T19:52:54.145 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T19:52:54.145 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T19:52:54.145 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T19:52:54.145 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T19:52:54.145 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T19:52:54.145 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T19:52:54.145 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T19:52:54.145 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T19:52:54.145 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T19:52:54.145 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T19:52:54.146 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T19:52:54.146 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T19:52:54.146 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T19:52:54.146 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T19:52:54.146 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T19:52:54.146 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T19:52:54.146 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T19:52:54.146 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T19:52:54.146 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T19:52:54.146 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T19:52:54.146 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T19:52:54.146 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T19:52:54.146 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T19:52:54.147 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T19:52:54.147 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T19:52:54.147 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T19:52:54.147 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T19:52:54.147 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T19:52:54.147 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T19:52:54.147 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T19:52:54.147 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T19:52:54.147 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T19:52:54.147 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T19:52:54.147 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T19:52:54.147 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T19:52:54.147 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T19:52:54.148 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T19:52:54.148 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T19:52:54.148 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T19:52:54.148 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T19:52:54.148 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T19:52:54.148 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T19:52:54.148 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T19:52:54.148 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T19:52:54.148 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T19:52:54.148 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T19:52:54.148 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T19:52:54.148 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T19:52:54.148 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T19:52:54.149 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T19:52:54.149 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T19:52:54.149 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T19:52:54.149 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T19:52:54.149 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T19:52:54.149 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T19:52:54.149 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T19:52:54.149 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T19:52:54.149 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T19:52:54.149 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T19:52:54.149 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T19:52:54.149 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T19:52:54.149 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T19:52:54.149 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T19:52:54.150 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T19:52:54.150 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T19:52:54.150 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T19:52:54.150 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T19:52:54.150 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T19:52:54.150 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T19:52:54.150 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T19:52:54.150 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T19:52:54.150 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T19:52:54.150 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T19:52:54.150 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T19:52:54.150 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T19:52:54.150 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T19:52:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T19:52:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T19:52:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T19:52:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T19:52:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T19:52:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T19:52:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T19:52:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T19:52:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T19:52:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T19:52:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T19:52:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T19:52:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T19:52:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T19:52:54.152 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T19:52:54.152 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T19:52:54.152 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T19:52:54.152 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T19:52:54.152 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T19:52:54.152 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T19:52:54.152 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T19:52:54.152 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T19:52:54.152 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T19:52:54.152 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T19:52:54.152 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T19:52:54.152 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T19:52:54.152 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T19:52:54.152 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T19:52:54.153 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T19:52:54.153 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T19:52:54.153 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T19:52:54.153 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T19:52:54.153 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T19:52:54.153 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T19:52:54.153 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T19:52:54.153 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T19:52:54.153 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T19:52:54.153 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T19:52:54.153 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T19:52:54.153 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T19:52:54.153 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T19:52:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T19:52:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T19:52:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T19:52:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T19:52:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T19:52:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T19:52:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T19:52:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T19:52:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T19:52:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T19:52:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T19:52:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T19:52:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T19:52:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T19:52:54.155 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T19:52:54.155 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T19:52:54.155 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T19:52:54.155 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T19:52:54.155 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T19:52:54.155 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T19:52:54.155 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T19:52:54.155 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T19:52:54.155 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T19:52:54.155 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T19:52:54.155 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T19:52:54.155 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T19:52:54.155 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T19:52:54.155 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T19:52:54.156 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T19:52:54.156 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T19:52:54.156 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T19:52:54.156 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T19:52:54.156 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T19:52:54.156 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T19:52:54.156 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T19:52:54.156 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T19:52:54.156 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T19:52:54.156 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T19:52:54.156 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T19:52:54.156 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T19:52:54.156 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T19:52:54.156 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T19:52:54.157 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T19:52:54.157 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T19:52:54.157 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T19:52:54.157 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T19:52:54.157 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T19:52:54.157 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T19:52:54.157 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T19:52:54.157 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T19:52:54.157 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T19:52:54.157 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T19:52:54.157 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T19:52:54.157 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T19:52:54.157 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T19:52:54.158 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T19:52:54.158 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T19:52:54.158 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T19:52:54.158 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T19:52:54.158 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T19:52:54.158 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T19:52:54.158 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T19:52:54.158 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T19:52:54.158 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T19:52:54.158 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T19:52:54.158 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T19:52:54.158 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T19:52:54.158 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T19:52:54.158 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T19:52:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T19:52:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T19:52:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T19:52:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T19:52:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T19:52:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T19:52:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T19:52:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T19:52:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T19:52:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T19:52:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T19:52:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T19:52:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T19:52:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T19:52:54.160 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T19:52:54.160 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T19:52:54.160 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T19:52:54.160 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T19:52:54.160 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T19:52:54.160 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T19:52:54.160 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T19:52:54.160 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T19:52:54.160 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T19:52:54.160 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T19:52:54.160 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T19:52:54.160 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T19:52:54.160 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T19:52:54.161 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T19:52:54.161 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T19:52:54.161 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T19:52:54.161 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T19:52:54.161 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T19:52:54.161 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T19:52:54.161 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T19:52:54.161 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T19:52:54.161 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T19:52:54.161 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T19:52:54.161 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T19:52:54.161 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T19:52:54.161 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T19:52:54.161 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T19:52:54.162 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T19:52:54.162 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T19:52:54.162 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T19:52:54.162 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T19:52:54.162 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T19:52:54.162 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T19:52:54.162 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T19:52:54.162 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T19:52:54.162 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T19:52:54.162 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T19:52:54.162 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T19:52:54.162 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T19:52:54.162 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T19:52:54.162 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T19:52:54.163 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T19:52:54.163 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T19:52:54.163 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T19:52:54.163 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T19:52:54.163 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T19:52:54.163 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T19:52:54.163 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T19:52:54.163 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T19:52:54.163 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T19:52:54.163 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T19:52:54.163 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T19:52:54.163 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T19:52:54.163 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T19:52:54.163 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T19:52:54.164 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T19:52:54.164 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T19:52:54.164 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T19:52:54.164 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T19:52:54.164 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T19:52:54.164 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T19:52:54.164 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T19:52:54.164 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T19:52:54.164 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T19:52:54.164 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T19:52:54.164 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T19:52:54.164 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T19:52:54.164 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T19:52:54.164 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T19:52:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T19:52:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T19:52:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T19:52:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T19:52:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T19:52:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T19:52:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T19:52:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T19:52:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T19:52:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T19:52:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T19:52:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T19:52:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T19:52:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T19:52:54.166 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T19:52:54.166 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T19:52:54.166 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T19:52:54.166 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T19:52:54.166 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T19:52:54.166 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T19:52:54.166 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T19:52:54.166 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T19:52:54.166 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T19:52:54.166 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T19:52:54.166 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T19:52:54.166 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T19:52:54.166 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T19:52:54.167 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T19:52:54.167 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T19:52:54.167 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T19:52:54.167 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T19:52:54.167 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T19:52:54.167 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T19:52:54.167 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T19:52:54.167 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T19:52:54.167 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T19:52:54.167 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T19:52:54.167 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T19:52:54.167 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T19:52:54.167 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T19:52:54.167 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T19:52:54.168 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T19:52:54.168 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T19:52:54.168 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T19:52:54.168 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T19:52:54.168 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T19:52:54.168 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T19:52:54.168 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T19:52:54.168 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T19:52:54.168 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T19:52:54.168 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T19:52:54.168 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T19:52:54.168 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T19:52:54.168 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T19:52:54.168 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T19:52:54.169 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T19:52:54.169 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T19:52:54.169 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T19:52:54.169 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T19:52:54.169 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T19:52:54.169 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T19:52:54.169 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T19:52:54.169 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T19:52:54.169 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T19:52:54.169 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T19:52:54.169 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T19:52:54.169 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T19:52:54.169 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T19:52:54.169 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T19:52:54.170 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T19:52:54.170 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T19:52:54.170 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T19:52:54.170 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T19:52:54.170 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T19:52:54.170 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T19:52:54.170 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T19:52:54.170 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T19:52:54.170 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T19:52:54.170 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T19:52:54.170 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T19:52:54.170 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T19:52:54.170 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T19:52:54.171 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T19:52:54.171 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T19:52:54.190 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T19:52:54.190 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T19:52:54.190 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T19:52:54.190 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T19:52:54.190 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T19:52:54.190 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T19:52:54.190 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T19:52:54.190 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T19:52:54.191 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T19:52:54.191 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T19:52:54.191 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T19:52:54.191 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T19:52:54.191 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T19:52:54.191 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T19:52:54.191 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T19:52:54.191 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T19:52:54.191 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T19:52:54.191 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T19:52:54.191 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T19:52:54.191 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T19:52:54.191 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T19:52:54.192 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T19:52:54.192 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T19:52:54.192 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T19:52:54.192 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T19:52:54.192 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T19:52:54.192 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T19:52:54.192 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T19:52:54.192 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T19:52:54.192 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T19:52:54.192 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T19:52:54.192 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T19:52:54.192 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T19:52:54.192 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T19:52:54.192 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T19:52:54.193 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T19:52:54.193 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T19:52:54.193 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T19:52:54.193 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T19:52:54.193 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T19:52:54.193 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T19:52:54.193 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T19:52:54.193 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T19:52:54.193 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T19:52:54.193 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T19:52:54.193 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T19:52:54.193 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T19:52:54.193 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T19:52:54.194 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T19:52:54.194 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T19:52:54.194 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T19:52:54.194 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T19:52:54.194 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T19:52:54.194 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T19:52:54.194 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T19:52:54.194 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T19:52:54.194 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T19:52:54.194 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T19:52:54.194 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T19:52:54.194 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T19:52:54.194 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T19:52:54.195 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T19:52:54.195 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T19:52:54.195 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T19:52:54.195 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T19:52:54.195 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T19:52:54.195 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T19:52:54.195 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T19:52:54.195 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T19:52:54.195 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T19:52:54.195 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T19:52:54.195 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T19:52:54.195 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T19:52:54.195 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T19:52:54.195 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T19:52:54.196 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T19:52:54.196 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T19:52:54.196 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T19:52:54.196 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T19:52:54.196 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T19:52:54.196 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T19:52:54.196 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T19:52:54.196 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T19:52:54.196 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T19:52:54.196 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T19:52:54.196 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T19:52:54.196 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T19:52:54.196 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T19:52:54.196 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T19:52:54.197 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T19:52:54.197 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T19:52:54.197 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T19:52:54.197 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T19:52:54.197 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T19:52:54.197 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T19:52:54.197 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T19:52:54.197 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T19:52:54.197 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T19:52:54.197 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T19:52:54.197 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T19:52:54.197 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T19:52:54.197 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T19:52:54.197 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T19:52:54.198 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T19:52:54.198 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T19:52:54.198 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T19:52:54.198 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T19:52:54.198 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T19:52:54.198 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T19:52:54.198 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T19:52:54.198 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T19:52:54.198 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T19:52:54.198 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T19:52:54.198 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T19:52:54.198 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T19:52:54.198 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T19:52:54.199 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T19:52:54.199 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T19:52:54.199 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T19:52:54.199 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T19:52:54.199 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T19:52:54.199 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T19:52:54.199 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T19:52:54.199 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T19:52:54.199 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T19:52:54.199 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T19:52:54.200 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T19:52:54.200 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T19:52:54.200 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T19:52:54.200 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T19:52:54.200 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T19:52:54.200 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T19:52:54.200 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T19:52:54.200 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T19:52:54.200 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T19:52:54.200 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T19:52:54.200 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T19:52:54.200 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T19:52:54.200 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T19:52:54.201 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T19:52:54.201 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T19:52:54.201 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T19:52:54.201 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T19:52:54.201 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T19:52:54.201 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T19:52:54.201 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T19:52:54.201 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T19:52:54.201 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T19:52:54.201 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T19:52:54.201 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T19:52:54.201 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T19:52:54.201 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T19:52:54.201 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T19:52:54.202 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T19:52:54.202 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T19:52:54.202 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T19:52:54.202 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T19:52:54.202 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T19:52:54.202 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T19:52:54.202 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T19:52:54.202 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T19:52:54.202 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T19:52:54.202 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T19:52:54.202 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T19:52:54.202 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T19:52:54.202 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T19:52:54.202 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T19:52:54.203 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T19:52:54.203 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T19:52:54.203 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T19:52:54.203 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T19:52:54.203 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T19:52:54.203 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T19:52:54.203 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T19:52:54.203 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T19:52:54.203 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T19:52:54.203 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T19:52:54.203 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T19:52:54.203 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T19:52:54.203 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T19:52:54.203 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T19:52:54.204 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T19:52:54.204 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T19:52:54.204 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T19:52:54.204 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T19:52:54.204 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T19:52:54.204 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T19:52:54.204 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T19:52:54.204 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T19:52:54.204 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T19:52:54.204 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T19:52:54.204 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T19:52:54.204 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T19:52:54.204 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T19:52:54.205 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T19:52:54.205 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T19:52:54.205 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T19:52:54.205 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T19:52:54.205 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T19:52:54.205 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T19:52:54.205 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T19:52:54.205 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T19:52:54.205 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T19:52:54.205 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T19:52:54.205 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T19:52:54.205 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T19:52:54.205 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T19:52:54.205 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T19:52:54.206 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T19:52:54.206 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T19:52:54.206 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T19:52:54.206 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T19:52:54.206 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T19:52:54.206 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T19:52:54.206 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T19:52:54.206 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T19:52:54.206 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T19:52:54.206 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T19:52:54.206 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T19:52:54.206 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T19:52:54.206 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T19:52:54.207 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T19:52:54.207 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T19:52:54.207 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T19:52:54.207 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T19:52:54.207 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T19:52:54.207 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T19:52:54.207 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T19:52:54.207 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T19:52:54.207 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T19:52:54.207 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T19:52:54.207 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T19:52:54.207 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T19:52:54.207 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T19:52:54.207 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T19:52:54.208 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T19:52:54.208 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T19:52:54.208 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T19:52:54.208 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T19:52:54.208 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T19:52:54.208 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T19:52:54.208 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T19:52:54.208 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T19:52:54.208 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T19:52:54.208 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T19:52:54.208 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T19:52:54.208 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T19:52:54.208 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T19:52:54.208 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T19:52:54.209 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T19:52:54.209 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T19:52:54.209 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T19:52:54.209 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T19:52:54.209 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T19:52:54.209 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T19:52:54.209 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T19:52:54.209 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T19:52:54.209 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T19:52:54.209 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T19:52:54.209 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T19:52:54.209 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T19:52:54.209 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T19:52:54.210 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T19:52:54.210 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T19:52:54.210 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T19:52:54.210 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T19:52:54.210 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T19:52:54.210 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T19:52:54.210 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T19:52:54.210 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T19:52:54.210 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T19:52:54.210 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T19:52:54.210 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T19:52:54.210 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T19:52:54.210 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T19:52:54.210 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T19:52:54.211 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T19:52:54.211 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T19:52:54.211 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T19:52:54.211 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T19:52:54.211 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T19:52:54.211 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T19:52:54.211 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T19:52:54.211 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T19:52:54.211 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T19:52:54.211 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T19:52:54.211 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T19:52:54.211 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T19:52:54.211 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T19:52:54.212 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T19:52:54.212 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T19:52:54.212 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T19:52:54.212 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T19:52:54.212 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T19:52:54.212 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T19:52:54.212 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T19:52:54.212 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T19:52:54.212 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T19:52:54.212 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T19:52:54.212 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T19:52:54.212 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T19:52:54.212 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T19:52:54.212 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T19:52:54.213 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T19:52:54.213 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T19:52:54.213 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T19:52:54.213 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T19:52:54.213 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T19:52:54.213 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T19:52:54.213 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T19:52:54.213 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T19:52:54.213 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T19:52:54.213 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T19:52:54.213 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T19:52:54.213 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T19:52:54.213 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T19:52:54.213 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T19:52:54.214 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T19:52:54.214 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T19:52:54.214 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T19:52:54.214 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T19:52:54.214 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T19:52:54.214 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T19:52:54.214 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T19:52:54.214 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T19:52:54.214 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T19:52:54.214 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T19:52:54.214 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T19:52:54.214 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T19:52:54.214 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T19:52:54.215 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T19:52:54.215 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T19:52:54.215 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T19:52:54.215 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T19:52:54.215 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T19:52:54.215 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T19:52:54.215 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T19:52:54.215 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T19:52:54.215 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T19:52:54.215 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T19:52:54.215 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T19:52:54.215 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T19:52:54.215 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T19:52:54.215 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T19:52:54.216 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T19:52:54.216 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T19:52:54.216 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T19:52:54.216 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T19:52:54.216 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T19:52:54.216 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T19:52:54.216 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T19:52:54.216 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T19:52:54.216 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T19:52:54.216 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T19:52:54.216 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T19:52:54.216 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T19:52:54.216 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T19:52:54.216 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T19:52:54.217 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T19:52:54.217 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T19:52:54.217 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T19:52:54.217 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T19:52:54.217 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T19:52:54.217 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T19:52:54.217 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T19:52:54.217 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T19:52:54.217 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T19:52:54.217 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T19:52:54.217 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T19:52:54.217 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T19:52:54.217 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T19:52:54.217 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T19:52:54.218 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T19:52:54.218 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T19:52:54.218 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T19:52:54.218 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T19:52:54.218 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T19:52:54.218 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T19:52:54.218 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T19:52:54.218 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T19:52:54.218 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T19:52:54.218 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T19:52:54.218 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T19:52:54.218 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T19:52:54.218 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T19:52:54.219 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T19:52:54.219 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T19:52:54.219 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T19:52:54.219 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T19:52:54.219 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T19:52:54.219 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T19:52:54.219 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T19:52:54.219 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T19:52:54.219 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T19:52:54.219 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T19:52:54.219 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T19:52:54.219 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T19:52:54.219 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T19:52:54.219 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T19:52:54.220 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T19:52:54.220 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T19:52:54.220 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T19:52:54.220 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T19:52:54.220 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T19:52:54.220 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T19:52:54.220 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T19:52:54.220 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T19:52:54.220 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T19:52:54.220 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T19:52:54.220 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T19:52:54.220 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T19:52:54.220 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T19:52:54.221 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T19:52:54.221 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T19:52:54.221 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T19:52:54.221 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T19:52:54.221 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T19:52:54.221 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T19:52:54.221 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T19:52:54.221 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T19:52:54.221 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T19:52:54.221 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T19:52:54.221 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T19:52:54.221 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T19:52:54.221 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T19:52:54.221 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T19:52:54.222 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T19:52:54.222 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T19:52:54.222 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T19:52:54.222 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T19:52:54.222 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T19:52:54.222 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T19:52:54.222 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T19:52:54.222 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T19:52:54.222 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T19:52:54.222 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T19:52:54.222 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T19:52:54.222 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T19:52:54.222 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T19:52:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T19:52:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T19:52:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T19:52:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T19:52:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T19:52:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T19:52:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T19:52:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T19:52:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T19:52:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T19:52:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T19:52:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T19:52:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T19:52:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T19:52:54.224 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T19:52:54.224 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T19:52:54.224 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T19:52:54.224 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T19:52:54.224 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T19:52:54.224 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T19:52:54.224 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T19:52:54.224 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T19:52:54.224 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T19:52:54.224 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T19:52:54.224 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T19:52:54.224 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T19:52:54.224 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T19:52:54.225 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T19:52:54.225 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T19:52:54.225 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T19:52:54.225 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T19:52:54.225 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T19:52:54.225 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T19:52:54.225 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T19:52:54.225 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T19:52:54.225 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T19:52:54.225 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T19:52:54.225 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T19:52:54.225 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T19:52:54.225 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T19:52:54.225 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T19:52:54.226 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T19:52:54.226 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T19:52:54.226 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T19:52:54.226 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T19:52:54.226 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T19:52:54.226 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T19:52:54.226 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T19:52:54.226 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T19:52:54.226 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T19:52:54.226 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T19:52:54.226 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T19:52:54.226 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T19:52:54.226 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T19:52:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T19:52:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T19:52:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T19:52:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T19:52:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T19:52:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T19:52:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T19:52:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T19:52:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T19:52:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T19:52:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T19:52:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T19:52:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T19:52:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T19:52:54.228 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T19:52:54.228 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T19:52:54.228 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T19:52:54.228 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T19:52:54.228 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T19:52:54.228 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T19:52:54.228 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T19:52:54.228 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T19:52:54.228 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T19:52:54.228 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T19:52:54.228 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T19:52:54.228 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T19:52:54.228 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T19:52:54.229 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T19:52:54.229 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T19:52:54.229 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T19:52:54.229 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T19:52:54.229 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T19:52:54.229 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T19:52:54.229 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T19:52:54.229 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T19:52:54.229 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T19:52:54.229 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T19:52:54.229 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T19:52:54.254 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T19:52:54.254 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T19:52:54.254 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T19:52:54.254 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T19:52:54.255 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T19:52:54.255 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T19:52:54.255 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T19:52:54.255 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T19:52:54.255 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T19:52:54.255 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T19:52:54.255 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T19:52:54.255 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T19:52:54.255 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T19:52:54.255 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T19:52:54.255 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T19:52:54.255 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T19:52:54.255 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T19:52:54.255 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T19:52:54.256 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T19:52:54.256 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T19:52:54.256 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T19:52:54.256 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T19:52:54.256 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T19:52:54.256 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T19:52:54.256 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T19:52:54.256 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T19:52:54.256 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T19:52:54.256 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T19:52:54.256 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T19:52:54.256 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T19:52:54.256 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T19:52:54.257 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T19:52:54.257 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T19:52:54.257 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T19:52:54.257 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T19:52:54.257 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T19:52:54.257 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T19:52:54.257 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T19:52:54.257 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T19:52:54.257 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T19:52:54.257 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T19:52:54.257 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T19:52:54.257 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T19:52:54.257 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T19:52:54.257 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T19:52:54.258 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T19:52:54.258 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T19:52:54.258 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T19:52:54.258 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T19:52:54.258 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T19:52:54.258 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T19:52:54.258 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T19:52:54.258 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T19:52:54.258 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T19:52:54.258 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T19:52:54.258 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T19:52:54.258 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T19:52:54.258 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T19:52:54.259 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T19:52:54.259 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T19:52:54.259 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T19:52:54.259 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T19:52:54.259 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T19:52:54.259 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T19:52:54.259 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T19:52:54.259 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T19:52:54.259 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T19:52:54.259 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T19:52:54.259 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T19:52:54.259 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T19:52:54.259 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T19:52:54.259 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T19:52:54.260 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T19:52:54.260 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T19:52:54.260 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T19:52:54.260 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T19:52:54.260 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T19:52:54.260 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T19:52:54.260 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T19:52:54.260 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T19:52:54.260 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T19:52:54.260 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T19:52:54.260 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T19:52:54.260 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T19:52:54.260 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T19:52:54.260 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T19:52:54.261 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T19:52:54.261 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T19:52:54.261 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T19:52:54.261 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T19:52:54.261 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T19:52:54.261 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T19:52:54.261 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T19:52:54.261 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T19:52:54.261 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T19:52:54.261 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T19:52:54.261 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T19:52:54.261 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T19:52:54.261 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T19:52:54.262 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T19:52:54.262 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T19:52:54.262 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T19:52:54.262 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T19:52:54.262 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T19:52:54.262 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T19:52:54.262 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T19:52:54.262 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T19:52:54.262 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T19:52:54.262 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T19:52:54.262 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T19:52:54.262 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T19:52:54.262 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T19:52:54.263 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T19:52:54.263 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T19:52:54.263 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T19:52:54.263 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T19:52:54.263 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T19:52:54.263 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T19:52:54.263 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T19:52:54.263 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T19:52:54.263 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T19:52:54.263 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T19:52:54.263 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T19:52:54.263 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T19:52:54.263 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T19:52:54.263 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T19:52:54.264 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T19:52:54.264 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T19:52:54.264 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T19:52:54.264 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T19:52:54.264 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T19:52:54.264 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T19:52:54.264 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T19:52:54.264 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T19:52:54.264 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T19:52:54.264 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T19:52:54.264 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T19:52:54.264 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T19:52:54.264 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T19:52:54.264 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T19:52:54.265 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T19:52:54.265 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T19:52:54.265 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T19:52:54.265 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T19:52:54.265 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T19:52:54.265 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T19:52:54.265 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T19:52:54.265 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T19:52:54.265 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T19:52:54.265 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T19:52:54.265 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T19:52:54.265 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T19:52:54.265 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T19:52:54.265 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T19:52:54.266 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T19:52:54.266 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T19:52:54.266 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T19:52:54.266 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T19:52:54.266 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T19:52:54.266 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T19:52:54.266 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T19:52:54.266 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T19:52:54.266 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T19:52:54.266 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T19:52:54.266 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T19:52:54.266 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T19:52:54.266 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T19:52:54.266 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T19:52:54.267 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T19:52:54.267 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T19:52:54.267 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T19:52:54.267 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T19:52:54.267 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T19:52:54.267 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T19:52:54.267 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T19:52:54.267 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T19:52:54.267 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T19:52:54.267 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T19:52:54.267 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T19:52:54.267 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T19:52:54.267 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T19:52:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T19:52:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T19:52:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T19:52:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T19:52:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T19:52:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T19:52:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T19:52:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T19:52:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T19:52:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T19:52:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T19:52:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T19:52:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T19:52:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T19:52:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T19:52:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T19:52:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T19:52:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T19:52:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T19:52:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T19:52:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T19:52:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T19:52:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T19:52:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T19:52:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T19:52:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T19:52:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T19:52:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T19:52:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T19:52:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T19:52:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T19:52:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T19:52:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T19:52:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T19:52:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T19:52:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T19:52:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T19:52:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T19:52:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T19:52:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T19:52:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T19:52:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T19:52:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T19:52:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T19:52:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T19:52:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T19:52:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T19:52:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T19:52:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T19:52:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T19:52:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T19:52:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T19:52:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T19:52:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T19:52:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T19:52:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T19:52:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T19:52:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T19:52:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T19:52:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T19:52:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T19:52:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T19:52:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T19:52:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T19:52:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T19:52:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T19:52:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T19:52:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T19:52:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T19:52:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T19:52:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T19:52:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T19:52:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T19:52:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T19:52:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T19:52:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T19:52:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T19:52:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T19:52:54.274 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T19:52:54.274 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T19:52:54.274 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T19:52:54.274 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T19:52:54.274 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-28T19:52:54.274 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-28T19:52:54.274 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-28T19:52:54.274 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T19:52:54.274 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T19:52:54.274 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T19:52:54.275 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T19:52:54.275 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T19:52:54.275 DEBUG:teuthology.orchestra.run.smithi177:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T19:52:54.282 INFO:teuthology.orchestra.run.smithi177.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T19:52:54.282 INFO:teuthology.orchestra.run.smithi177.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T19:52:54.282 INFO:teuthology.orchestra.run.smithi177.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T19:52:54.283 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T19:52:54.283 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T19:52:54.283 DEBUG:teuthology.orchestra.run.smithi177:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T19:52:54.326 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi177.front.sepia.ceph.com to complete... 2023-11-28T19:52:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub' 2023-11-28T19:52:54.693 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T19:52:54.713 INFO:teuthology.orchestra.run.smithi177.stderr:Generating grub configuration file ... 2023-11-28T19:52:54.912 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T19:52:54.917 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:52:55.116 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T19:52:55.121 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T19:52:55.158 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T19:52:55.162 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T19:52:55.322 INFO:teuthology.orchestra.run.smithi177.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T19:52:55.322 INFO:teuthology.orchestra.run.smithi177.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T19:52:55.322 INFO:teuthology.orchestra.run.smithi177.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T19:52:55.337 INFO:teuthology.orchestra.run.smithi177.stderr:done 2023-11-28T19:52:59.528 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub' 2023-11-28T19:52:59.544 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T19:52:59.558 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2023-11-28T19:52:59.865 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T19:52:59.893 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:53:00.227 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T19:53:00.240 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T19:53:00.309 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T19:53:00.314 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T19:53:00.494 INFO:teuthology.orchestra.run.smithi195.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T19:53:00.494 INFO:teuthology.orchestra.run.smithi195.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T19:53:00.494 INFO:teuthology.orchestra.run.smithi195.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T19:53:00.532 INFO:teuthology.orchestra.run.smithi195.stderr:done 2023-11-28T19:53:00.710 DEBUG:teuthology.orchestra.run.smithi195:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T19:53:00.762 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-28T19:53:00.762 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-28T19:53:00.762 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T19:53:00.774 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T19:53:00.775 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T19:53:00.793 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-28T19:53:00.793 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-28T19:53:00.793 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-28T19:53:00.794 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-28T19:53:00.794 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-28T19:53:00.794 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-28T19:53:00.794 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-28T19:53:00.794 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-28T19:53:00.794 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T19:53:00.794 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T19:53:00.794 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T19:53:00.794 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T19:53:00.794 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T19:53:00.794 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T19:53:00.796 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T19:53:00.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T19:53:00.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T19:53:00.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T19:53:00.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T19:53:00.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T19:53:00.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T19:53:00.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T19:53:00.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T19:53:00.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T19:53:00.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T19:53:00.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T19:53:00.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T19:53:00.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T19:53:00.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T19:53:00.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T19:53:00.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T19:53:00.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T19:53:00.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T19:53:00.798 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T19:53:00.798 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T19:53:00.798 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T19:53:00.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T19:53:00.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T19:53:00.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T19:53:00.799 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T19:53:00.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T19:53:00.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T19:53:00.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T19:53:00.813 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T19:53:00.814 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T19:53:00.814 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T19:53:00.814 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T19:53:00.814 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T19:53:00.814 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T19:53:00.814 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T19:53:00.814 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T19:53:00.814 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T19:53:00.814 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T19:53:00.814 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T19:53:00.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T19:53:00.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T19:53:00.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T19:53:00.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T19:53:00.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T19:53:00.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T19:53:00.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T19:53:00.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T19:53:00.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T19:53:00.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T19:53:00.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T19:53:00.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T19:53:00.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T19:53:00.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T19:53:00.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T19:53:00.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T19:53:00.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T19:53:00.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T19:53:00.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T19:53:00.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T19:53:00.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T19:53:00.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T19:53:00.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T19:53:00.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T19:53:00.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T19:53:00.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T19:53:00.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T19:53:00.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T19:53:00.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T19:53:00.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T19:53:00.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T19:53:00.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T19:53:00.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T19:53:00.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T19:53:00.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T19:53:00.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T19:53:00.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T19:53:00.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T19:53:00.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T19:53:00.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T19:53:00.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T19:53:00.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T19:53:00.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T19:53:00.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T19:53:00.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T19:53:00.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T19:53:00.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T19:53:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T19:53:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T19:53:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T19:53:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T19:53:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T19:53:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T19:53:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T19:53:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T19:53:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T19:53:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T19:53:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T19:53:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T19:53:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T19:53:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T19:53:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T19:53:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T19:53:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T19:53:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T19:53:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T19:53:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T19:53:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T19:53:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T19:53:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T19:53:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T19:53:00.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T19:53:00.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T19:53:00.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T19:53:00.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T19:53:00.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T19:53:00.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T19:53:00.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T19:53:00.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T19:53:00.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T19:53:00.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T19:53:00.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T19:53:00.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T19:53:00.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T19:53:00.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T19:53:00.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T19:53:00.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T19:53:00.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T19:53:00.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T19:53:00.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T19:53:00.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T19:53:00.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T19:53:00.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T19:53:00.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T19:53:00.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T19:53:00.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T19:53:00.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T19:53:00.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T19:53:00.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T19:53:00.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T19:53:00.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T19:53:00.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T19:53:00.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T19:53:00.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T19:53:00.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T19:53:00.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T19:53:00.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T19:53:00.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T19:53:00.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T19:53:00.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T19:53:00.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T19:53:00.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T19:53:00.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T19:53:00.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T19:53:00.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T19:53:00.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T19:53:00.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T19:53:00.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T19:53:00.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T19:53:00.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T19:53:00.825 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T19:53:00.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T19:53:00.825 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T19:53:00.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T19:53:00.825 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T19:53:00.825 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T19:53:00.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T19:53:00.825 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T19:53:00.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T19:53:00.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T19:53:00.826 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T19:53:00.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T19:53:00.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T19:53:00.826 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T19:53:00.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T19:53:00.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T19:53:00.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T19:53:00.826 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T19:53:00.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T19:53:00.827 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T19:53:00.827 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T19:53:00.827 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T19:53:00.827 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T19:53:00.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T19:53:00.880 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T19:53:00.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T19:53:00.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T19:53:00.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T19:53:00.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T19:53:00.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T19:53:00.881 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T19:53:00.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T19:53:00.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T19:53:00.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T19:53:00.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T19:53:00.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T19:53:00.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T19:53:00.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T19:53:00.881 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T19:53:00.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T19:53:00.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T19:53:00.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T19:53:00.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T19:53:00.882 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T19:53:00.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T19:53:00.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T19:53:00.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T19:53:00.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T19:53:00.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T19:53:00.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T19:53:00.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T19:53:00.883 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T19:53:00.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T19:53:00.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T19:53:00.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T19:53:00.883 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T19:53:00.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T19:53:00.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T19:53:00.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T19:53:00.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T19:53:00.883 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T19:53:00.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T19:53:00.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T19:53:00.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T19:53:00.884 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T19:53:00.884 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T19:53:00.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T19:53:00.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T19:53:00.884 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T19:53:00.884 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T19:53:00.884 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T19:53:00.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T19:53:00.884 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T19:53:00.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T19:53:00.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T19:53:00.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T19:53:00.885 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T19:53:00.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T19:53:00.885 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T19:53:00.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T19:53:00.885 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T19:53:00.885 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T19:53:00.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T19:53:00.885 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T19:53:00.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T19:53:00.886 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T19:53:00.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T19:53:00.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T19:53:00.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T19:53:00.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T19:53:00.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T19:53:00.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T19:53:00.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T19:53:00.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T19:53:00.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T19:53:00.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T19:53:00.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T19:53:00.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T19:53:00.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T19:53:00.887 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T19:53:00.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T19:53:00.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T19:53:00.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T19:53:00.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T19:53:00.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T19:53:00.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T19:53:00.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T19:53:00.887 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T19:53:00.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T19:53:00.888 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T19:53:00.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T19:53:00.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T19:53:00.888 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T19:53:00.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T19:53:00.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T19:53:00.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T19:53:00.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T19:53:00.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T19:53:00.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T19:53:00.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T19:53:00.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T19:53:00.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T19:53:00.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T19:53:00.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T19:53:00.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T19:53:00.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T19:53:00.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T19:53:00.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T19:53:00.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T19:53:00.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T19:53:00.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T19:53:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T19:53:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T19:53:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T19:53:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T19:53:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T19:53:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T19:53:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T19:53:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T19:53:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T19:53:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T19:53:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T19:53:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T19:53:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T19:53:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T19:53:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T19:53:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T19:53:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T19:53:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T19:53:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T19:53:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T19:53:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T19:53:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T19:53:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T19:53:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T19:53:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T19:53:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T19:53:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T19:53:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T19:53:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T19:53:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T19:53:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T19:53:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T19:53:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T19:53:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T19:53:00.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T19:53:00.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T19:53:00.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T19:53:00.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T19:53:00.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T19:53:00.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T19:53:00.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T19:53:00.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T19:53:00.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T19:53:00.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T19:53:00.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T19:53:00.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T19:53:00.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T19:53:00.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T19:53:00.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T19:53:00.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T19:53:00.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T19:53:00.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T19:53:00.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T19:53:00.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T19:53:00.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T19:53:00.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T19:53:00.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T19:53:00.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T19:53:00.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T19:53:00.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T19:53:00.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T19:53:00.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T19:53:00.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T19:53:00.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T19:53:00.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T19:53:00.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T19:53:00.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T19:53:00.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T19:53:00.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T19:53:00.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T19:53:00.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T19:53:00.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T19:53:00.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T19:53:00.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T19:53:00.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T19:53:00.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T19:53:00.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T19:53:00.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T19:53:00.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T19:53:00.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T19:53:00.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T19:53:00.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T19:53:00.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T19:53:00.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T19:53:00.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T19:53:00.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T19:53:00.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T19:53:00.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T19:53:00.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T19:53:00.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T19:53:00.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T19:53:00.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T19:53:00.899 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T19:53:00.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T19:53:00.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T19:53:00.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T19:53:00.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T19:53:00.899 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T19:53:00.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T19:53:00.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T19:53:00.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T19:53:00.900 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T19:53:00.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T19:53:00.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T19:53:00.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T19:53:00.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T19:53:00.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T19:53:00.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T19:53:00.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T19:53:00.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T19:53:00.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T19:53:00.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T19:53:00.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T19:53:00.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T19:53:00.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T19:53:00.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T19:53:00.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T19:53:00.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T19:53:00.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T19:53:00.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T19:53:00.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T19:53:00.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T19:53:00.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T19:53:00.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T19:53:00.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T19:53:00.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T19:53:00.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T19:53:00.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T19:53:00.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T19:53:00.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T19:53:00.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T19:53:00.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T19:53:00.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T19:53:00.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T19:53:00.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T19:53:00.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T19:53:00.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T19:53:00.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T19:53:00.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T19:53:00.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T19:53:00.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T19:53:00.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T19:53:00.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T19:53:00.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T19:53:00.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T19:53:00.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T19:53:00.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T19:53:00.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T19:53:00.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T19:53:00.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T19:53:00.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T19:53:00.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T19:53:00.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T19:53:00.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T19:53:00.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T19:53:00.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T19:53:00.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T19:53:00.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T19:53:00.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T19:53:00.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T19:53:00.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T19:53:00.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T19:53:00.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T19:53:00.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T19:53:00.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T19:53:00.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T19:53:00.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T19:53:00.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T19:53:00.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T19:53:00.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T19:53:00.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T19:53:00.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T19:53:00.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T19:53:00.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T19:53:00.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T19:53:00.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T19:53:00.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T19:53:00.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T19:53:00.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T19:53:00.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T19:53:00.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T19:53:00.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T19:53:00.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T19:53:00.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T19:53:00.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T19:53:00.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T19:53:00.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T19:53:00.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T19:53:00.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T19:53:00.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T19:53:00.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T19:53:00.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T19:53:00.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T19:53:00.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T19:53:00.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T19:53:00.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T19:53:00.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T19:53:00.908 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T19:53:00.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T19:53:00.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T19:53:00.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T19:53:00.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T19:53:00.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T19:53:00.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T19:53:00.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T19:53:00.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T19:53:00.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T19:53:00.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T19:53:00.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T19:53:00.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T19:53:00.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T19:53:00.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T19:53:00.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T19:53:00.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T19:53:00.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T19:53:00.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T19:53:00.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T19:53:00.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T19:53:00.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T19:53:00.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T19:53:00.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T19:53:00.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T19:53:00.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T19:53:00.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T19:53:00.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T19:53:00.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T19:53:00.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T19:53:00.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T19:53:00.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T19:53:00.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T19:53:00.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T19:53:00.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T19:53:00.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T19:53:00.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T19:53:00.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T19:53:00.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T19:53:00.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T19:53:00.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T19:53:00.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T19:53:00.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T19:53:00.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T19:53:00.911 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T19:53:00.911 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T19:53:00.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T19:53:00.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T19:53:00.912 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T19:53:00.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T19:53:00.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T19:53:00.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T19:53:00.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T19:53:00.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T19:53:00.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T19:53:00.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T19:53:00.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T19:53:00.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T19:53:00.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T19:53:00.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T19:53:00.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T19:53:00.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T19:53:00.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T19:53:00.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T19:53:00.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T19:53:00.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T19:53:00.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T19:53:00.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T19:53:00.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T19:53:00.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T19:53:00.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T19:53:00.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T19:53:00.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T19:53:00.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T19:53:00.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T19:53:00.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T19:53:00.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T19:53:00.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T19:53:00.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T19:53:00.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T19:53:00.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T19:53:00.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T19:53:00.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T19:53:00.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T19:53:00.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T19:53:00.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T19:53:00.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T19:53:00.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T19:53:00.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T19:53:00.915 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T19:53:00.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T19:53:00.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T19:53:00.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T19:53:00.916 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T19:53:00.916 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T19:53:00.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T19:53:00.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T19:53:00.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T19:53:00.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T19:53:00.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T19:53:00.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T19:53:00.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T19:53:00.916 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T19:53:00.916 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T19:53:00.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T19:53:00.917 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T19:53:00.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T19:53:00.917 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T19:53:00.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T19:53:00.917 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T19:53:00.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T19:53:00.917 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T19:53:00.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T19:53:00.917 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T19:53:00.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T19:53:00.917 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T19:53:00.917 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T19:53:00.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T19:53:00.918 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T19:53:00.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T19:53:00.918 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T19:53:00.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T19:53:00.918 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T19:53:00.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T19:53:00.918 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T19:53:00.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T19:53:00.918 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T19:53:00.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T19:53:00.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T19:53:00.919 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T19:53:00.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T19:53:00.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T19:53:00.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T19:53:00.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T19:53:00.919 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T19:53:00.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T19:53:00.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T19:53:00.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T19:53:00.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T19:53:00.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T19:53:00.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T19:53:00.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T19:53:00.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T19:53:00.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T19:53:00.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T19:53:00.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T19:53:00.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T19:53:00.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T19:53:00.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T19:53:00.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T19:53:00.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T19:53:00.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T19:53:00.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T19:53:00.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T19:53:00.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T19:53:00.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T19:53:00.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T19:53:00.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T19:53:00.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T19:53:00.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T19:53:00.921 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T19:53:00.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T19:53:00.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T19:53:00.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T19:53:00.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T19:53:00.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T19:53:00.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T19:53:00.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T19:53:00.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T19:53:00.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T19:53:00.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T19:53:00.922 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T19:53:00.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T19:53:00.922 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T19:53:00.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T19:53:00.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T19:53:00.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T19:53:00.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T19:53:00.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T19:53:00.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T19:53:00.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T19:53:00.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T19:53:00.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T19:53:00.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T19:53:00.923 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T19:53:00.923 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T19:53:00.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T19:53:00.924 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T19:53:00.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T19:53:00.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T19:53:00.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T19:53:00.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T19:53:00.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T19:53:00.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T19:53:00.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T19:53:00.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T19:53:00.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T19:53:00.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T19:53:00.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T19:53:00.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T19:53:00.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T19:53:00.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T19:53:00.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T19:53:00.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T19:53:00.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T19:53:00.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T19:53:00.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T19:53:00.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T19:53:00.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T19:53:00.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T19:53:00.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T19:53:00.926 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T19:53:00.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T19:53:00.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T19:53:00.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T19:53:00.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T19:53:00.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T19:53:00.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T19:53:00.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T19:53:00.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T19:53:00.926 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T19:53:00.926 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T19:53:00.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T19:53:00.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T19:53:00.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T19:53:00.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T19:53:00.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T19:53:00.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T19:53:00.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T19:53:00.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T19:53:00.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T19:53:00.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T19:53:00.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T19:53:00.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T19:53:00.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T19:53:00.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T19:53:00.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T19:53:00.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T19:53:00.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T19:53:00.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T19:53:00.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T19:53:00.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T19:53:00.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T19:53:00.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T19:53:00.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T19:53:00.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T19:53:00.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T19:53:00.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T19:53:00.929 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T19:53:00.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T19:53:00.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T19:53:00.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T19:53:00.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T19:53:00.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T19:53:00.929 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T19:53:00.929 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T19:53:00.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T19:53:00.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T19:53:00.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T19:53:00.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T19:53:00.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T19:53:00.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T19:53:00.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T19:53:00.930 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T19:53:00.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T19:53:00.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T19:53:00.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T19:53:00.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T19:53:00.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T19:53:00.931 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T19:53:00.931 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T19:53:00.931 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T19:53:00.931 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T19:53:00.931 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T19:53:00.931 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T19:53:00.931 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T19:53:00.931 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T19:53:00.931 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T19:53:00.931 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T19:53:00.931 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T19:53:00.931 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T19:53:00.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T19:53:00.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T19:53:00.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T19:53:00.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T19:53:00.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T19:53:00.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T19:53:00.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T19:53:00.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T19:53:00.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T19:53:00.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T19:53:00.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T19:53:00.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T19:53:00.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T19:53:00.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T19:53:00.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T19:53:00.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T19:53:00.933 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T19:53:00.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T19:53:00.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T19:53:00.933 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T19:53:00.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T19:53:00.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T19:53:00.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T19:53:00.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T19:53:00.934 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T19:53:00.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T19:53:00.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T19:53:00.934 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T19:53:00.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T19:53:00.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T19:53:00.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T19:53:00.934 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T19:53:00.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T19:53:00.934 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T19:53:00.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T19:53:00.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T19:53:00.935 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T19:53:00.935 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T19:53:00.935 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T19:53:00.935 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T19:53:00.935 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T19:53:00.935 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T19:53:00.935 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T19:53:00.935 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T19:53:00.935 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T19:53:00.935 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T19:53:00.935 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T19:53:00.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T19:53:00.936 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T19:53:00.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T19:53:00.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T19:53:00.936 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T19:53:00.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T19:53:00.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T19:53:00.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T19:53:00.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T19:53:00.936 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T19:53:00.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T19:53:00.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T19:53:00.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T19:53:00.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T19:53:00.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T19:53:00.937 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T19:53:00.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T19:53:00.937 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T19:53:00.937 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T19:53:00.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T19:53:00.937 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T19:53:00.937 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T19:53:00.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T19:53:00.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T19:53:00.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T19:53:00.938 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T19:53:00.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T19:53:00.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T19:53:00.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T19:53:00.938 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T19:53:00.938 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T19:53:00.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T19:53:00.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T19:53:00.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T19:53:00.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T19:53:00.938 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T19:53:00.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T19:53:00.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T19:53:00.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T19:53:00.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T19:53:00.939 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T19:53:00.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T19:53:00.939 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T19:53:00.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T19:53:00.939 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T19:53:00.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T19:53:00.939 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T19:53:00.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T19:53:00.940 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T19:53:00.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T19:53:00.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T19:53:00.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T19:53:00.940 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T19:53:00.940 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T19:53:00.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T19:53:00.940 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T19:53:00.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T19:53:00.940 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T19:53:00.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T19:53:00.941 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T19:53:00.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T19:53:00.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T19:53:00.941 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T19:53:00.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T19:53:00.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T19:53:00.941 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T19:53:00.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T19:53:00.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T19:53:00.941 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T19:53:00.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T19:53:00.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T19:53:00.942 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T19:53:00.942 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T19:53:00.942 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T19:53:00.942 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T19:53:00.942 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T19:53:00.942 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T19:53:00.942 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T19:53:00.942 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T19:53:01.008 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T19:53:01.008 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T19:53:01.008 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T19:53:01.008 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T19:53:01.008 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T19:53:01.008 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T19:53:01.008 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T19:53:01.008 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T19:53:01.008 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T19:53:01.009 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T19:53:01.009 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T19:53:01.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T19:53:01.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T19:53:01.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T19:53:01.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T19:53:01.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T19:53:01.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T19:53:01.009 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T19:53:01.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T19:53:01.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T19:53:01.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T19:53:01.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T19:53:01.010 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T19:53:01.010 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T19:53:01.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T19:53:01.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T19:53:01.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T19:53:01.010 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T19:53:01.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T19:53:01.010 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T19:53:01.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T19:53:01.010 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T19:53:01.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T19:53:01.011 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T19:53:01.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T19:53:01.011 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T19:53:01.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T19:53:01.011 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T19:53:01.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T19:53:01.011 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T19:53:01.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T19:53:01.011 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T19:53:01.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T19:53:01.011 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T19:53:01.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T19:53:01.012 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T19:53:01.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T19:53:01.012 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T19:53:01.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T19:53:01.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T19:53:01.012 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T19:53:01.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T19:53:01.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T19:53:01.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T19:53:01.013 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T19:53:01.013 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T19:53:01.013 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T19:53:01.013 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T19:53:01.013 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T19:53:01.013 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T19:53:01.013 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T19:53:01.013 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T19:53:01.013 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T19:53:01.013 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T19:53:01.013 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T19:53:01.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T19:53:01.014 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T19:53:01.014 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T19:53:01.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T19:53:01.014 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T19:53:01.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T19:53:01.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T19:53:01.014 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T19:53:01.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T19:53:01.014 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T19:53:01.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T19:53:01.014 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T19:53:01.015 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T19:53:01.015 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T19:53:01.015 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T19:53:01.015 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T19:53:01.015 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T19:53:01.015 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T19:53:01.015 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T19:53:01.015 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T19:53:01.015 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T19:53:01.015 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T19:53:01.015 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T19:53:01.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T19:53:01.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T19:53:01.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T19:53:01.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T19:53:01.016 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T19:53:01.016 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T19:53:01.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T19:53:01.016 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T19:53:01.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T19:53:01.016 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T19:53:01.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T19:53:01.016 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T19:53:01.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T19:53:01.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T19:53:01.017 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T19:53:01.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T19:53:01.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T19:53:01.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T19:53:01.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T19:53:01.017 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T19:53:01.017 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T19:53:01.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T19:53:01.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T19:53:01.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T19:53:01.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T19:53:01.018 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T19:53:01.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T19:53:01.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T19:53:01.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T19:53:01.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T19:53:01.018 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T19:53:01.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T19:53:01.018 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T19:53:01.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T19:53:01.018 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T19:53:01.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T19:53:01.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T19:53:01.019 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T19:53:01.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T19:53:01.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T19:53:01.019 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T19:53:01.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T19:53:01.019 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T19:53:01.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T19:53:01.019 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T19:53:01.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T19:53:01.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T19:53:01.020 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T19:53:01.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T19:53:01.020 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T19:53:01.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T19:53:01.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T19:53:01.020 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T19:53:01.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T19:53:01.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T19:53:01.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T19:53:01.020 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T19:53:01.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T19:53:01.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T19:53:01.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T19:53:01.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T19:53:01.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T19:53:01.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T19:53:01.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T19:53:01.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T19:53:01.021 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T19:53:01.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T19:53:01.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T19:53:01.021 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T19:53:01.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T19:53:01.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T19:53:01.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T19:53:01.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T19:53:01.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T19:53:01.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T19:53:01.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T19:53:01.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T19:53:01.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T19:53:01.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T19:53:01.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T19:53:01.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T19:53:01.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T19:53:01.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T19:53:01.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T19:53:01.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T19:53:01.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T19:53:01.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T19:53:01.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T19:53:01.023 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T19:53:01.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T19:53:01.023 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T19:53:01.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T19:53:01.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T19:53:01.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T19:53:01.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T19:53:01.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T19:53:01.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T19:53:01.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T19:53:01.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T19:53:01.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T19:53:01.024 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T19:53:01.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T19:53:01.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T19:53:01.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T19:53:01.024 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T19:53:01.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T19:53:01.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T19:53:01.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T19:53:01.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T19:53:01.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T19:53:01.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T19:53:01.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T19:53:01.025 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T19:53:01.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T19:53:01.025 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T19:53:01.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T19:53:01.025 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T19:53:01.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T19:53:01.026 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T19:53:01.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T19:53:01.026 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T19:53:01.026 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T19:53:01.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T19:53:01.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T19:53:01.026 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T19:53:01.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T19:53:01.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T19:53:01.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T19:53:01.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T19:53:01.027 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T19:53:01.027 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T19:53:01.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T19:53:01.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T19:53:01.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T19:53:01.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T19:53:01.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T19:53:01.027 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T19:53:01.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T19:53:01.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T19:53:01.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T19:53:01.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T19:53:01.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T19:53:01.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T19:53:01.028 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T19:53:01.028 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T19:53:01.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T19:53:01.028 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T19:53:01.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T19:53:01.028 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T19:53:01.028 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T19:53:01.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T19:53:01.028 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T19:53:01.029 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T19:53:01.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T19:53:01.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T19:53:01.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T19:53:01.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T19:53:01.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T19:53:01.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T19:53:01.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T19:53:01.029 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T19:53:01.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T19:53:01.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T19:53:01.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T19:53:01.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T19:53:01.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T19:53:01.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T19:53:01.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T19:53:01.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T19:53:01.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T19:53:01.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T19:53:01.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T19:53:01.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T19:53:01.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T19:53:01.030 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T19:53:01.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T19:53:01.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T19:53:01.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T19:53:01.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T19:53:01.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T19:53:01.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T19:53:01.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T19:53:01.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T19:53:01.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T19:53:01.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T19:53:01.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T19:53:01.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T19:53:01.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T19:53:01.032 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T19:53:01.032 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T19:53:01.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T19:53:01.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T19:53:01.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T19:53:01.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T19:53:01.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T19:53:01.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T19:53:01.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T19:53:01.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T19:53:01.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T19:53:01.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T19:53:01.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T19:53:01.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T19:53:01.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T19:53:01.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T19:53:01.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T19:53:01.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T19:53:01.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T19:53:01.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T19:53:01.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T19:53:01.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T19:53:01.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T19:53:01.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T19:53:01.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T19:53:01.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T19:53:01.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T19:53:01.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T19:53:01.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T19:53:01.034 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T19:53:01.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T19:53:01.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T19:53:01.034 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T19:53:01.034 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T19:53:01.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T19:53:01.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T19:53:01.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T19:53:01.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T19:53:01.035 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T19:53:01.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T19:53:01.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T19:53:01.035 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T19:53:01.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T19:53:01.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T19:53:01.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T19:53:01.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T19:53:01.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T19:53:01.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T19:53:01.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T19:53:01.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T19:53:01.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T19:53:01.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T19:53:01.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T19:53:01.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T19:53:01.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T19:53:01.249 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T19:53:01.249 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T19:53:01.249 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T19:53:01.249 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T19:53:01.249 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T19:53:01.249 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T19:53:01.249 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T19:53:01.249 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T19:53:01.250 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T19:53:01.250 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T19:53:01.250 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T19:53:01.250 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T19:53:01.250 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T19:53:01.250 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T19:53:01.250 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T19:53:01.250 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T19:53:01.250 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T19:53:01.250 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T19:53:01.250 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T19:53:01.250 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T19:53:01.251 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T19:53:01.251 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T19:53:01.251 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T19:53:01.251 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T19:53:01.251 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T19:53:01.251 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T19:53:01.251 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T19:53:01.251 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T19:53:01.251 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T19:53:01.251 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T19:53:01.251 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T19:53:01.251 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T19:53:01.252 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T19:53:01.252 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T19:53:01.252 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T19:53:01.252 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T19:53:01.252 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T19:53:01.252 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T19:53:01.252 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T19:53:01.252 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T19:53:01.252 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T19:53:01.252 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T19:53:01.252 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T19:53:01.252 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T19:53:01.253 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T19:53:01.253 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T19:53:01.253 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T19:53:01.253 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T19:53:01.253 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T19:53:01.253 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T19:53:01.253 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T19:53:01.253 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T19:53:01.253 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T19:53:01.253 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T19:53:01.253 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T19:53:01.253 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T19:53:01.253 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T19:53:01.254 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T19:53:01.254 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T19:53:01.254 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T19:53:01.254 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T19:53:01.254 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T19:53:01.254 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T19:53:01.254 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T19:53:01.254 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T19:53:01.254 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T19:53:01.254 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T19:53:01.254 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T19:53:01.254 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T19:53:01.255 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T19:53:01.255 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T19:53:01.255 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T19:53:01.255 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T19:53:01.255 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T19:53:01.255 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T19:53:01.255 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T19:53:01.255 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T19:53:01.255 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T19:53:01.255 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T19:53:01.255 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T19:53:01.256 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T19:53:01.256 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T19:53:01.256 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T19:53:01.256 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T19:53:01.256 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T19:53:01.256 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T19:53:01.256 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T19:53:01.256 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T19:53:01.256 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T19:53:01.256 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T19:53:01.256 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T19:53:01.256 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T19:53:01.256 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T19:53:01.257 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T19:53:01.257 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T19:53:01.257 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T19:53:01.257 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T19:53:01.257 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T19:53:01.257 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T19:53:01.257 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T19:53:01.257 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T19:53:01.257 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T19:53:01.257 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T19:53:01.257 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T19:53:01.257 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T19:53:01.258 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T19:53:01.258 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T19:53:01.258 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T19:53:01.258 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T19:53:01.258 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T19:53:01.258 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T19:53:01.258 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T19:53:01.258 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T19:53:01.258 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T19:53:01.258 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T19:53:01.258 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T19:53:01.258 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T19:53:01.259 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T19:53:01.259 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T19:53:01.259 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T19:53:01.259 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T19:53:01.259 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T19:53:01.259 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T19:53:01.259 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T19:53:01.259 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T19:53:01.259 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T19:53:01.259 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T19:53:01.259 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T19:53:01.259 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T19:53:01.259 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T19:53:01.260 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T19:53:01.260 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T19:53:01.260 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T19:53:01.260 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T19:53:01.260 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T19:53:01.260 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T19:53:01.260 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T19:53:01.260 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T19:53:01.260 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T19:53:01.260 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T19:53:01.260 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T19:53:01.260 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T19:53:01.261 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T19:53:01.261 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T19:53:01.261 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T19:53:01.261 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T19:53:01.261 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T19:53:01.261 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T19:53:01.261 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T19:53:01.261 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T19:53:01.261 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T19:53:01.261 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T19:53:01.261 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T19:53:01.261 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T19:53:01.262 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T19:53:01.262 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T19:53:01.262 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T19:53:01.262 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T19:53:01.262 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T19:53:01.262 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T19:53:01.262 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T19:53:01.262 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T19:53:01.262 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T19:53:01.262 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T19:53:01.262 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T19:53:01.262 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T19:53:01.263 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T19:53:01.263 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T19:53:01.263 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T19:53:01.263 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T19:53:01.263 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T19:53:01.263 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T19:53:01.263 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T19:53:01.263 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T19:53:01.263 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T19:53:01.263 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T19:53:01.263 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T19:53:01.263 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T19:53:01.263 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T19:53:01.264 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T19:53:01.264 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T19:53:01.264 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T19:53:01.264 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T19:53:01.264 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T19:53:01.264 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T19:53:01.264 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T19:53:01.264 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T19:53:01.264 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T19:53:01.264 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T19:53:01.264 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T19:53:01.264 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T19:53:01.265 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T19:53:01.265 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T19:53:01.265 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T19:53:01.265 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T19:53:01.265 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T19:53:01.265 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T19:53:01.265 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T19:53:01.265 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T19:53:01.265 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T19:53:01.265 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T19:53:01.265 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T19:53:01.265 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T19:53:01.266 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T19:53:01.266 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T19:53:01.266 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T19:53:01.266 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T19:53:01.266 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T19:53:01.266 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T19:53:01.266 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T19:53:01.266 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T19:53:01.266 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T19:53:01.266 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T19:53:01.266 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T19:53:01.267 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T19:53:01.267 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T19:53:01.267 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T19:53:01.267 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T19:53:01.267 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T19:53:01.267 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T19:53:01.267 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T19:53:01.267 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T19:53:01.267 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T19:53:01.267 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T19:53:01.267 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T19:53:01.267 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T19:53:01.268 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T19:53:01.268 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T19:53:01.268 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T19:53:01.268 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T19:53:01.268 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T19:53:01.268 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T19:53:01.268 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T19:53:01.268 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T19:53:01.268 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T19:53:01.268 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T19:53:01.268 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T19:53:01.268 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T19:53:01.269 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T19:53:01.269 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T19:53:01.269 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T19:53:01.269 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T19:53:01.269 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T19:53:01.269 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T19:53:01.269 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T19:53:01.269 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T19:53:01.269 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T19:53:01.269 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T19:53:01.269 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T19:53:01.269 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T19:53:01.270 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T19:53:01.270 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T19:53:01.270 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T19:53:01.270 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T19:53:01.270 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T19:53:01.270 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T19:53:01.270 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T19:53:01.270 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T19:53:01.270 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T19:53:01.270 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T19:53:01.270 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T19:53:01.271 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T19:53:01.271 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T19:53:01.271 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T19:53:01.271 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T19:53:01.271 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T19:53:01.271 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T19:53:01.271 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T19:53:01.271 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T19:53:01.271 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T19:53:01.271 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T19:53:01.271 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T19:53:01.271 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T19:53:01.272 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T19:53:01.272 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T19:53:01.272 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T19:53:01.272 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T19:53:01.272 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T19:53:01.272 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T19:53:01.272 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T19:53:01.272 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T19:53:01.272 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T19:53:01.272 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T19:53:01.272 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T19:53:01.272 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T19:53:01.273 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T19:53:01.273 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T19:53:01.273 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T19:53:01.273 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T19:53:01.273 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T19:53:01.273 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T19:53:01.273 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T19:53:01.273 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T19:53:01.273 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T19:53:01.273 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T19:53:01.273 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T19:53:01.273 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T19:53:01.274 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T19:53:01.274 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T19:53:01.274 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T19:53:01.274 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T19:53:01.274 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T19:53:01.274 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T19:53:01.274 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T19:53:01.274 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T19:53:01.274 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T19:53:01.274 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T19:53:01.274 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T19:53:01.274 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T19:53:01.275 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T19:53:01.275 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T19:53:01.275 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T19:53:01.275 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T19:53:01.275 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T19:53:01.275 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T19:53:01.275 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T19:53:01.275 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T19:53:01.275 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T19:53:01.275 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T19:53:01.275 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T19:53:01.275 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T19:53:01.276 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T19:53:01.276 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T19:53:01.276 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T19:53:01.276 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T19:53:01.276 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T19:53:01.276 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T19:53:01.276 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T19:53:01.276 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T19:53:01.276 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T19:53:01.276 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T19:53:01.276 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T19:53:01.276 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T19:53:01.277 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T19:53:01.277 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T19:53:01.277 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T19:53:01.277 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T19:53:01.277 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T19:53:01.277 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T19:53:01.277 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T19:53:01.277 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T19:53:01.277 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T19:53:01.277 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T19:53:01.277 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T19:53:01.277 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T19:53:01.277 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T19:53:01.278 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T19:53:01.278 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T19:53:01.278 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T19:53:01.278 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T19:53:01.278 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T19:53:01.278 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T19:53:01.278 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T19:53:01.278 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T19:53:01.279 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T19:53:01.279 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T19:53:01.279 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T19:53:01.279 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T19:53:01.279 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T19:53:01.279 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T19:53:01.279 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T19:53:01.279 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T19:53:01.279 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T19:53:01.279 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T19:53:01.279 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T19:53:01.279 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T19:53:01.280 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T19:53:01.280 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T19:53:01.280 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T19:53:01.280 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T19:53:01.280 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T19:53:01.280 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T19:53:01.280 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T19:53:01.280 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T19:53:01.280 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T19:53:01.280 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T19:53:01.280 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T19:53:01.280 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T19:53:01.280 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T19:53:01.281 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T19:53:01.281 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T19:53:01.281 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T19:53:01.281 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T19:53:01.281 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T19:53:01.281 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T19:53:01.281 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T19:53:01.281 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T19:53:01.281 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T19:53:01.281 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T19:53:01.281 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T19:53:01.281 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T19:53:01.282 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T19:53:01.282 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T19:53:01.282 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T19:53:01.282 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T19:53:01.282 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T19:53:01.282 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T19:53:01.282 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T19:53:01.282 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T19:53:01.282 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T19:53:01.282 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T19:53:01.282 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T19:53:01.282 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T19:53:01.283 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T19:53:01.283 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T19:53:01.283 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T19:53:01.283 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T19:53:01.283 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T19:53:01.283 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T19:53:01.283 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T19:53:01.283 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T19:53:01.283 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T19:53:01.283 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T19:53:01.283 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T19:53:01.283 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T19:53:01.284 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T19:53:01.284 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T19:53:01.284 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T19:53:01.284 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T19:53:01.284 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T19:53:01.284 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T19:53:01.284 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T19:53:01.284 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T19:53:01.284 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T19:53:01.284 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T19:53:01.284 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T19:53:01.284 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T19:53:01.285 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T19:53:01.285 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T19:53:01.285 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T19:53:01.285 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T19:53:01.285 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T19:53:01.285 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T19:53:01.285 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T19:53:01.285 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T19:53:01.285 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T19:53:01.285 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T19:53:01.285 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T19:53:01.285 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T19:53:01.286 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T19:53:01.286 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T19:53:01.286 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T19:53:01.286 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T19:53:01.286 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T19:53:01.286 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T19:53:01.286 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T19:53:01.286 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T19:53:01.286 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T19:53:01.286 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T19:53:01.286 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T19:53:01.286 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T19:53:01.287 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T19:53:01.287 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T19:53:01.287 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T19:53:01.287 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T19:53:01.287 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T19:53:01.287 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T19:53:01.287 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T19:53:01.287 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T19:53:01.287 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T19:53:01.287 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T19:53:01.287 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T19:53:01.287 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T19:53:01.288 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T19:53:01.288 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T19:53:01.288 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T19:53:01.288 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T19:53:01.288 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T19:53:01.288 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T19:53:01.288 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T19:53:01.288 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T19:53:01.288 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T19:53:01.288 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T19:53:01.288 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T19:53:01.288 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T19:53:01.289 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T19:53:01.289 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T19:53:01.289 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T19:53:01.289 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T19:53:01.289 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T19:53:01.289 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T19:53:01.289 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T19:53:01.289 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T19:53:01.289 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T19:53:01.289 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T19:53:01.289 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T19:53:01.289 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T19:53:01.290 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T19:53:01.290 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T19:53:01.290 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T19:53:01.290 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T19:53:01.290 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T19:53:01.290 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T19:53:01.290 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T19:53:01.290 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T19:53:01.290 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T19:53:01.290 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T19:53:01.291 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T19:53:01.291 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T19:53:01.291 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T19:53:01.291 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T19:53:01.291 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T19:53:01.291 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T19:53:01.291 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T19:53:01.291 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T19:53:01.291 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T19:53:01.291 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T19:53:01.291 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T19:53:01.291 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T19:53:01.292 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T19:53:01.292 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T19:53:01.292 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T19:53:01.292 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T19:53:01.292 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T19:53:01.292 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T19:53:01.292 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T19:53:01.292 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T19:53:01.292 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T19:53:01.292 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T19:53:01.292 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T19:53:01.292 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T19:53:01.293 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T19:53:01.293 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T19:53:01.293 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T19:53:01.293 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T19:53:01.293 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T19:53:01.293 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T19:53:01.293 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T19:53:01.293 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T19:53:01.293 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T19:53:01.293 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T19:53:01.293 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T19:53:01.293 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T19:53:01.293 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T19:53:01.294 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T19:53:01.294 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T19:53:01.294 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T19:53:01.294 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T19:53:01.294 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T19:53:01.294 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T19:53:01.294 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T19:53:01.294 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T19:53:01.294 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T19:53:01.294 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T19:53:01.294 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T19:53:01.295 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T19:53:01.295 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T19:53:01.295 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T19:53:01.295 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T19:53:01.295 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T19:53:01.295 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T19:53:01.295 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T19:53:01.295 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T19:53:01.295 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T19:53:01.295 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T19:53:01.295 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T19:53:01.295 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T19:53:01.296 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T19:53:01.296 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T19:53:01.296 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T19:53:01.296 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T19:53:01.296 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T19:53:01.296 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T19:53:01.296 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T19:53:01.296 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T19:53:01.296 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T19:53:01.296 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T19:53:01.296 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T19:53:01.296 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T19:53:01.297 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T19:53:01.297 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T19:53:01.297 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T19:53:01.297 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T19:53:01.297 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T19:53:01.297 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T19:53:01.297 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T19:53:01.297 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T19:53:01.297 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T19:53:01.297 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T19:53:01.297 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T19:53:01.297 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T19:53:01.298 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T19:53:01.298 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T19:53:01.298 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T19:53:01.298 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T19:53:01.298 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T19:53:01.298 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T19:53:01.298 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T19:53:01.298 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T19:53:01.298 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T19:53:01.298 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T19:53:01.340 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T19:53:01.340 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T19:53:01.340 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T19:53:01.340 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T19:53:01.340 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T19:53:01.340 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T19:53:01.340 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T19:53:01.340 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T19:53:01.340 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T19:53:01.340 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T19:53:01.341 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T19:53:01.341 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T19:53:01.341 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T19:53:01.341 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T19:53:01.341 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T19:53:01.341 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T19:53:01.341 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T19:53:01.341 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T19:53:01.341 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T19:53:01.341 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T19:53:01.341 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T19:53:01.341 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T19:53:01.342 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T19:53:01.342 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T19:53:01.342 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T19:53:01.342 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T19:53:01.342 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T19:53:01.342 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T19:53:01.342 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T19:53:01.342 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T19:53:01.342 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T19:53:01.342 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T19:53:01.342 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T19:53:01.342 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T19:53:01.343 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T19:53:01.343 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T19:53:01.343 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T19:53:01.343 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T19:53:01.343 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T19:53:01.343 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T19:53:01.343 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T19:53:01.343 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T19:53:01.343 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T19:53:01.343 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T19:53:01.343 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T19:53:01.343 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T19:53:01.344 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T19:53:01.344 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T19:53:01.344 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T19:53:01.344 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T19:53:01.344 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T19:53:01.344 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T19:53:01.344 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T19:53:01.344 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T19:53:01.344 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T19:53:01.344 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T19:53:01.344 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T19:53:01.344 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T19:53:01.345 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T19:53:01.345 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T19:53:01.345 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T19:53:01.345 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T19:53:01.345 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T19:53:01.345 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T19:53:01.345 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T19:53:01.345 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T19:53:01.345 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T19:53:01.345 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T19:53:01.345 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T19:53:01.345 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T19:53:01.345 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T19:53:01.346 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T19:53:01.346 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T19:53:01.346 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T19:53:01.346 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T19:53:01.346 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T19:53:01.346 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T19:53:01.346 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T19:53:01.346 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T19:53:01.346 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T19:53:01.346 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T19:53:01.346 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T19:53:01.346 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T19:53:01.347 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T19:53:01.347 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T19:53:01.347 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T19:53:01.347 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T19:53:01.347 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T19:53:01.347 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T19:53:01.347 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T19:53:01.347 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T19:53:01.347 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T19:53:01.347 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T19:53:01.347 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T19:53:01.347 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T19:53:01.347 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T19:53:01.348 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T19:53:01.348 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T19:53:01.348 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T19:53:01.348 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T19:53:01.348 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T19:53:01.348 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T19:53:01.348 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T19:53:01.348 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T19:53:01.348 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T19:53:01.348 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T19:53:01.348 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T19:53:01.348 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T19:53:01.349 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T19:53:01.349 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T19:53:01.349 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T19:53:01.349 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T19:53:01.349 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T19:53:01.349 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T19:53:01.349 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T19:53:01.349 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T19:53:01.349 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T19:53:01.349 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T19:53:01.349 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T19:53:01.349 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T19:53:01.349 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T19:53:01.350 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T19:53:01.350 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T19:53:01.350 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T19:53:01.350 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T19:53:01.350 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T19:53:01.350 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T19:53:01.350 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T19:53:01.350 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T19:53:01.350 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T19:53:01.350 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T19:53:01.350 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T19:53:01.350 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T19:53:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T19:53:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T19:53:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T19:53:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T19:53:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T19:53:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T19:53:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T19:53:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T19:53:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T19:53:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T19:53:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T19:53:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T19:53:01.352 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T19:53:01.352 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T19:53:01.352 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T19:53:01.352 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T19:53:01.352 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T19:53:01.352 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T19:53:01.352 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T19:53:01.352 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T19:53:01.352 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T19:53:01.352 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T19:53:01.352 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T19:53:01.352 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T19:53:01.353 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T19:53:01.353 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T19:53:01.353 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T19:53:01.353 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T19:53:01.353 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T19:53:01.353 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T19:53:01.353 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T19:53:01.353 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T19:53:01.353 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T19:53:01.353 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T19:53:01.353 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T19:53:01.353 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T19:53:01.354 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T19:53:01.354 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T19:53:01.354 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T19:53:01.354 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T19:53:01.354 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T19:53:01.354 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T19:53:01.354 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T19:53:01.354 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T19:53:01.354 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T19:53:01.354 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T19:53:01.354 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T19:53:01.354 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T19:53:01.355 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T19:53:01.355 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T19:53:01.355 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T19:53:01.355 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T19:53:01.355 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T19:53:01.355 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T19:53:01.355 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T19:53:01.355 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T19:53:01.355 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T19:53:01.355 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T19:53:01.355 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T19:53:01.355 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T19:53:01.356 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T19:53:01.356 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T19:53:01.356 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T19:53:01.356 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T19:53:01.356 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T19:53:01.356 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T19:53:01.356 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T19:53:01.356 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T19:53:01.356 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T19:53:01.356 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T19:53:01.356 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T19:53:01.356 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T19:53:01.356 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T19:53:01.357 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T19:53:01.357 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T19:53:01.357 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T19:53:01.357 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T19:53:01.357 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T19:53:01.357 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T19:53:01.357 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T19:53:01.357 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T19:53:01.357 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T19:53:01.357 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T19:53:01.357 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T19:53:01.357 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T19:53:01.358 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T19:53:01.358 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T19:53:01.358 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T19:53:01.358 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T19:53:01.358 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T19:53:01.358 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T19:53:01.358 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T19:53:01.358 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T19:53:01.358 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T19:53:01.358 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T19:53:01.358 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T19:53:01.358 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T19:53:01.359 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T19:53:01.359 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T19:53:01.359 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T19:53:01.359 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T19:53:01.359 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T19:53:01.359 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T19:53:01.359 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T19:53:01.359 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T19:53:01.359 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T19:53:01.359 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T19:53:01.359 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T19:53:01.359 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T19:53:01.360 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T19:53:01.360 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T19:53:01.360 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T19:53:01.360 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T19:53:01.360 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T19:53:01.360 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T19:53:01.360 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T19:53:01.360 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T19:53:01.360 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T19:53:01.360 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T19:53:01.360 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T19:53:01.360 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T19:53:01.361 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T19:53:01.361 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T19:53:01.361 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T19:53:01.361 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T19:53:01.361 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T19:53:01.361 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T19:53:01.361 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T19:53:01.361 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T19:53:01.361 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T19:53:01.361 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T19:53:01.361 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T19:53:01.361 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T19:53:01.362 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T19:53:01.362 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T19:53:01.362 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T19:53:01.362 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T19:53:01.362 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T19:53:01.362 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T19:53:01.362 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T19:53:01.362 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T19:53:01.362 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T19:53:01.362 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T19:53:01.362 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T19:53:01.362 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T19:53:01.363 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T19:53:01.363 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T19:53:01.363 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T19:53:01.363 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T19:53:01.363 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T19:53:01.363 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T19:53:01.363 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T19:53:01.363 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T19:53:01.363 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T19:53:01.363 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T19:53:01.363 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T19:53:01.363 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T19:53:01.363 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T19:53:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T19:53:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T19:53:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T19:53:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T19:53:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T19:53:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T19:53:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T19:53:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T19:53:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T19:53:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T19:53:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T19:53:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T19:53:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T19:53:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T19:53:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T19:53:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T19:53:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T19:53:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T19:53:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T19:53:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T19:53:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T19:53:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T19:53:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T19:53:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T19:53:01.366 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T19:53:01.366 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T19:53:01.366 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T19:53:01.366 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T19:53:01.366 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T19:53:01.366 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T19:53:01.366 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T19:53:01.366 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T19:53:01.366 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T19:53:01.366 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T19:53:01.366 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T19:53:01.366 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T19:53:01.367 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T19:53:01.367 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T19:53:01.367 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T19:53:01.367 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T19:53:01.367 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T19:53:01.367 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T19:53:01.367 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T19:53:01.367 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T19:53:01.367 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T19:53:01.367 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T19:53:01.367 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T19:53:01.367 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T19:53:01.368 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T19:53:01.368 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T19:53:01.368 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T19:53:01.368 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T19:53:01.368 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T19:53:01.368 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T19:53:01.368 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T19:53:01.368 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T19:53:01.368 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T19:53:01.368 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T19:53:01.368 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T19:53:01.368 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T19:53:01.368 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T19:53:01.369 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T19:53:01.369 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T19:53:01.369 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T19:53:01.369 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T19:53:01.369 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T19:53:01.369 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T19:53:01.369 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T19:53:01.369 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T19:53:01.369 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T19:53:01.369 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T19:53:01.369 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T19:53:01.369 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T19:53:01.370 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T19:53:01.370 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T19:53:01.370 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T19:53:01.370 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T19:53:01.370 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T19:53:01.370 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T19:53:01.370 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T19:53:01.370 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T19:53:01.370 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T19:53:01.370 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T19:53:01.371 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T19:53:01.371 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T19:53:01.371 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T19:53:01.371 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T19:53:01.371 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T19:53:01.371 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T19:53:01.371 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T19:53:01.371 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T19:53:01.371 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T19:53:01.371 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T19:53:01.371 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T19:53:01.371 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T19:53:01.372 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T19:53:01.372 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T19:53:01.372 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T19:53:01.372 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T19:53:01.372 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T19:53:01.372 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T19:53:01.372 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T19:53:01.372 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T19:53:01.372 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T19:53:01.372 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T19:53:01.372 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T19:53:01.372 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T19:53:01.372 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T19:53:01.373 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T19:53:01.373 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T19:53:01.373 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T19:53:01.373 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T19:53:01.373 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T19:53:01.373 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T19:53:01.373 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T19:53:01.373 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T19:53:01.373 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T19:53:01.373 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T19:53:01.373 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T19:53:01.373 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T19:53:01.374 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T19:53:01.374 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T19:53:01.374 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T19:53:01.374 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T19:53:01.374 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T19:53:01.374 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T19:53:01.374 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T19:53:01.374 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T19:53:01.374 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T19:53:01.374 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T19:53:01.374 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T19:53:01.374 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T19:53:01.375 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T19:53:01.375 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T19:53:01.375 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T19:53:01.375 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T19:53:01.375 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T19:53:01.375 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T19:53:01.375 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T19:53:01.375 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T19:53:01.375 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T19:53:01.375 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T19:53:01.375 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T19:53:01.375 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T19:53:01.376 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T19:53:01.376 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T19:53:01.376 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T19:53:01.376 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T19:53:01.376 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T19:53:01.376 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T19:53:01.376 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T19:53:01.376 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T19:53:01.376 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T19:53:01.376 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T19:53:01.376 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T19:53:01.376 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T19:53:01.377 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T19:53:01.377 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T19:53:01.377 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T19:53:01.377 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T19:53:01.377 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T19:53:01.377 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T19:53:01.377 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T19:53:01.377 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T19:53:01.377 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T19:53:01.377 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T19:53:01.377 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T19:53:01.377 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T19:53:01.378 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T19:53:01.378 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T19:53:01.378 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T19:53:01.378 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T19:53:01.378 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T19:53:01.378 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T19:53:01.378 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T19:53:01.378 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T19:53:01.378 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T19:53:01.378 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T19:53:01.378 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T19:53:01.378 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T19:53:01.379 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T19:53:01.379 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T19:53:01.379 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T19:53:01.379 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T19:53:01.379 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T19:53:01.379 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T19:53:01.379 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T19:53:01.379 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T19:53:01.379 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T19:53:01.379 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T19:53:01.379 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T19:53:01.379 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T19:53:01.379 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T19:53:01.380 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T19:53:01.380 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T19:53:01.380 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T19:53:01.380 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T19:53:01.380 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T19:53:01.380 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T19:53:01.380 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T19:53:01.380 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T19:53:01.380 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T19:53:01.380 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T19:53:01.380 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T19:53:01.380 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T19:53:01.381 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T19:53:01.381 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T19:53:01.381 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T19:53:01.381 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T19:53:01.381 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T19:53:01.381 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T19:53:01.381 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T19:53:01.381 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T19:53:01.381 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T19:53:01.381 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T19:53:01.381 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T19:53:01.381 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T19:53:01.382 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T19:53:01.382 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T19:53:01.382 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T19:53:01.382 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T19:53:01.382 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T19:53:01.382 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T19:53:01.382 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T19:53:01.382 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T19:53:01.382 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T19:53:01.382 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T19:53:01.382 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T19:53:01.382 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T19:53:01.383 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T19:53:01.383 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T19:53:01.383 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T19:53:01.383 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T19:53:01.383 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T19:53:01.383 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T19:53:01.383 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T19:53:01.383 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T19:53:01.383 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T19:53:01.383 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T19:53:01.383 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T19:53:01.383 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T19:53:01.383 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T19:53:01.384 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T19:53:01.384 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T19:53:01.384 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T19:53:01.384 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T19:53:01.384 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T19:53:01.384 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T19:53:01.384 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T19:53:01.384 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T19:53:01.384 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T19:53:01.384 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T19:53:01.384 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T19:53:01.384 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T19:53:01.385 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T19:53:01.385 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T19:53:01.385 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T19:53:01.385 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T19:53:01.385 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T19:53:01.385 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T19:53:01.385 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T19:53:01.385 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T19:53:01.385 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T19:53:01.385 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T19:53:01.385 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T19:53:01.385 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T19:53:01.386 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T19:53:01.386 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T19:53:01.386 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T19:53:01.386 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T19:53:01.386 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T19:53:01.386 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T19:53:01.386 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T19:53:01.386 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T19:53:01.386 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T19:53:01.386 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T19:53:01.386 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T19:53:01.386 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T19:53:01.387 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T19:53:01.387 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T19:53:01.387 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T19:53:01.387 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T19:53:01.387 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T19:53:01.387 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T19:53:01.387 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T19:53:01.387 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T19:53:01.387 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T19:53:01.387 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T19:53:01.387 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T19:53:01.387 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T19:53:01.388 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T19:53:01.388 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T19:53:01.388 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T19:53:01.388 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T19:53:01.388 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T19:53:01.388 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T19:53:01.388 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T19:53:01.388 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T19:53:01.388 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T19:53:01.388 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T19:53:01.388 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T19:53:01.388 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T19:53:01.388 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T19:53:01.389 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T19:53:01.389 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T19:53:01.389 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-28T19:53:01.389 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-28T19:53:01.389 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-28T19:53:01.389 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T19:53:01.389 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T19:53:01.389 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T19:53:01.390 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T19:53:01.390 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T19:53:01.390 DEBUG:teuthology.orchestra.run.smithi195:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T19:53:01.398 INFO:teuthology.orchestra.run.smithi195.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T19:53:01.398 INFO:teuthology.orchestra.run.smithi195.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T19:53:01.398 INFO:teuthology.orchestra.run.smithi195.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T19:53:01.398 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T19:53:01.399 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T19:53:01.399 DEBUG:teuthology.orchestra.run.smithi195:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T19:53:01.440 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi195.front.sepia.ceph.com to complete... 2023-11-28T19:53:01.871 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub' 2023-11-28T19:53:01.872 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T19:53:01.891 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2023-11-28T19:53:02.089 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T19:53:02.097 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:53:02.324 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T19:53:02.330 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T19:53:02.373 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T19:53:02.379 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T19:53:02.503 INFO:teuthology.orchestra.run.smithi195.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T19:53:02.503 INFO:teuthology.orchestra.run.smithi195.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T19:53:02.503 INFO:teuthology.orchestra.run.smithi195.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T19:53:02.524 INFO:teuthology.orchestra.run.smithi195.stderr:done 2023-11-28T19:53:26.450 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-28T19:53:26.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-11-28T19:53:26.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:53:33.662 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-28T19:53:33.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-11-28T19:53:33.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:53:44.802 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-28T19:53:52.226 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-11-28T19:53:53.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-11-28T19:53:53.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:53:56.866 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-28T19:54:01.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-11-28T19:54:01.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:54:04.290 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-11-28T19:54:08.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-11-28T19:54:08.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:54:16.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-11-28T19:54:16.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:54:27.302 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-28T19:54:47.992 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-11-28T19:54:48.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-11-28T19:54:48.633 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-g8247bbb5b470"... 2023-11-28T19:54:48.633 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2023-11-28T19:54:48.641 INFO:teuthology.orchestra.run.smithi195.stdout:6.6.0-g8247bbb5b470 2023-11-28T19:54:48.642 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T19:54:48.642 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T19:54:48.642 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T19:54:49.643 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-28T19:54:49.643 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-28T19:54:49.745 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2023-11-28T19:54:49.795 DEBUG:teuthology.parallel:result is None 2023-11-28T19:54:50.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-11-28T19:54:50.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:54:50.361 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-11-28T19:54:51.075 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-11-28T19:54:51.075 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-g8247bbb5b470"... 2023-11-28T19:54:51.075 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2023-11-28T19:54:51.126 INFO:teuthology.orchestra.run.smithi177.stdout:6.6.0-g8247bbb5b470 2023-11-28T19:54:51.127 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T19:54:51.127 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T19:54:51.127 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T19:54:52.128 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-28T19:54:52.128 DEBUG:teuthology.orchestra.run.smithi177:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-28T19:54:52.211 INFO:teuthology.orchestra.run.smithi177.stdout:ttyS1 2023-11-28T19:54:52.266 DEBUG:teuthology.parallel:result is None 2023-11-28T19:54:52.266 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-28T19:54:52.275 INFO:teuthology.task.internal:Creating test directory... 2023-11-28T19:54:52.275 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T19:54:52.279 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T19:54:52.288 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-28T19:54:52.297 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-28T19:54:52.328 INFO:teuthology.task.internal:Creating archive directory... 2023-11-28T19:54:52.329 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T19:54:52.333 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T19:54:52.357 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-28T19:54:52.366 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-28T19:54:52.366 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T19:54:52.394 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T19:54:52.418 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T19:54:52.421 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T19:54:52.432 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T19:54:52.435 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T19:54:52.438 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-28T19:54:52.448 INFO:teuthology.task.internal:Configuring sudo... 2023-11-28T19:54:52.449 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T19:54:52.482 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T19:54:52.505 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-28T19:54:52.516 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-28T19:54:52.516 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T19:54:52.545 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T19:54:52.556 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T19:54:52.607 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T19:54:52.659 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T19:54:52.659 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T19:54:52.740 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T19:54:52.749 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T19:54:52.805 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T19:54:52.805 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T19:54:52.883 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2023-11-28T19:54:52.886 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2023-11-28T19:54:52.998 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-28T19:54:53.005 INFO:teuthology.task.internal:Starting timer... 2023-11-28T19:54:53.005 INFO:teuthology.run_tasks:Running task pcp... 2023-11-28T19:54:53.031 INFO:teuthology.run_tasks:Running task selinux... 2023-11-28T19:54:53.062 DEBUG:teuthology.task.selinux:Excluding smithi177: OS 'ubuntu' does not support SELinux 2023-11-28T19:54:53.062 DEBUG:teuthology.task.selinux:Excluding smithi195: OS 'ubuntu' does not support SELinux 2023-11-28T19:54:53.063 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-28T19:54:53.063 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-28T19:54:53.063 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-28T19:54:53.063 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-28T19:54:53.097 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-28T19:54:53.097 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-28T19:54:53.115 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-28T19:54:53.116 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi177.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-28T20:03:33.404 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi177.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2023-11-28T20:03:33.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-11-28T20:03:33.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:03:33.485 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-11-28T20:03:33.609 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-11-28T20:03:33.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-11-28T20:03:33.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:03:33.692 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-11-28T20:03:33.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-11-28T20:03:33.805 INFO:teuthology.run_tasks:Running task clock... 2023-11-28T20:03:33.815 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-28T20:03:33.816 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T20:03:33.816 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T20:03:33.820 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T20:03:33.820 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T20:03:33.855 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T20:03:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: Command line: ntpd -gq 2023-11-28T20:03:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: ---------------------------------------------------- 2023-11-28T20:03:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T20:03:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T20:03:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: corporation. Support and training for ntp-4 are 2023-11-28T20:03:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: available at https://www.nwtime.org/support 2023-11-28T20:03:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: ---------------------------------------------------- 2023-11-28T20:03:33.858 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: proto: precision = 0.040 usec (-24) 2023-11-28T20:03:33.858 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: basedate set to 2022-02-04 2023-11-28T20:03:33.859 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: gps base set to 2022-02-06 (week 2196) 2023-11-28T20:03:33.859 INFO:teuthology.orchestra.run.smithi177.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T20:03:33.860 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T20:03:33.860 INFO:teuthology.orchestra.run.smithi177.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T20:03:33.862 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T20:03:33.862 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T20:03:33.862 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T20:03:33.862 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T20:03:33.862 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: Listen normally on 3 enp3s0f1 172.21.15.177:123 2023-11-28T20:03:33.862 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: Listen normally on 4 lo [::1]:123 2023-11-28T20:03:33.863 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feea:b04b%5]:123 2023-11-28T20:03:33.863 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:33 ntpd[28020]: Listening on routing socket on fd #22 for interface updates 2023-11-28T20:03:33.892 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T20:03:33.892 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: Command line: ntpd -gq 2023-11-28T20:03:33.892 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: ---------------------------------------------------- 2023-11-28T20:03:33.892 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T20:03:33.892 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T20:03:33.893 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: corporation. Support and training for ntp-4 are 2023-11-28T20:03:33.893 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: available at https://www.nwtime.org/support 2023-11-28T20:03:33.893 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: ---------------------------------------------------- 2023-11-28T20:03:33.893 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: proto: precision = 0.041 usec (-24) 2023-11-28T20:03:33.893 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: basedate set to 2022-02-04 2023-11-28T20:03:33.894 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: gps base set to 2022-02-06 (week 2196) 2023-11-28T20:03:33.894 INFO:teuthology.orchestra.run.smithi195.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T20:03:33.894 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T20:03:33.894 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T20:03:33.895 INFO:teuthology.orchestra.run.smithi195.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T20:03:33.896 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T20:03:33.896 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T20:03:33.896 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T20:03:33.896 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: Listen normally on 3 enp3s0f1 172.21.15.195:123 2023-11-28T20:03:33.896 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: Listen normally on 4 lo [::1]:123 2023-11-28T20:03:33.896 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8081%5]:123 2023-11-28T20:03:33.897 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:33 ntpd[27970]: Listening on routing socket on fd #22 for interface updates 2023-11-28T20:03:34.857 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:34.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:34.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:34.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:34.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:34.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:34.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:34.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:34.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:34.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:34.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:34.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:34.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:34.859 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:34.859 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:34.859 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:34.859 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:34.859 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:34 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:34.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:34 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:34.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:34 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:34.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:34 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:34.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:34 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:34.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:34 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:34.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:34 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:35.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:35 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:35.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:35 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:35.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:35 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:35.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:35 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:35.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:35 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:35.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:35 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:35.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:35 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:35.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:35 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:36.857 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:36.857 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:36.857 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:36.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:36.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:36.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:36.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:36.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:36.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:36.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:36.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:36.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:36.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:36.859 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:36.859 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:36.859 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:36.859 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:36.859 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:36 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:36.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:36 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:36.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:36 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:36.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:36 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:36.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:36 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:36.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:36 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:36.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:36 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:37.856 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:37 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:37.856 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:37 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:37.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:37 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:37.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:37 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:37.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:37 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:37.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:37 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:37.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:37 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:37.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:37 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:37.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:37 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:37.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:37 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:37.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:37 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:37.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:37 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:37.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:37 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:37.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:37 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:38.864 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:38.864 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:38.864 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:38.864 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:38.864 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:38.864 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:38.864 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:38.865 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:38.865 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:38.865 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:38.865 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:38.865 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:38.865 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:38.865 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:38.865 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:38.865 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:38.865 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:38.865 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:38 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:38.892 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:38 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:38.892 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:38 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:38.892 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:38 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:38.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:38 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:38.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:38 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:38.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:38 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:39.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:39 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:39.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:39 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:39.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:39 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:39.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:39 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:39.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:39 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:39.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:39 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:39.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:39 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:39.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:39 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:39.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:39 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:39.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:39 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:39.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:39 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:39.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:39 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:40.856 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:40 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:40.857 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:40 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:40.857 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:40 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:40.857 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:40 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:40.857 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:40 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:40.857 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:40 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:40.857 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:40 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:40.857 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:40 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:40.857 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:40 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:40.857 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:40 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:40.858 INFO:teuthology.orchestra.run.smithi177.stdout:28 Nov 20:03:40 ntpd[28020]: ntpd: time slew -0.003117 s 2023-11-28T20:03:40.858 INFO:teuthology.orchestra.run.smithi177.stdout:ntpd: time slew -0.003117s 2023-11-28T20:03:40.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:40 ntpd[28020]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T20:03:40.858 INFO:teuthology.orchestra.run.smithi177.stderr:28 Nov 20:03:40 ntpd[28020]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T20:03:40.892 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:40 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:40.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:40 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:40.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:40 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:03:40.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:40 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:03:40.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:40 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:03:40.893 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:40 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:03:40.893 INFO:teuthology.orchestra.run.smithi195.stdout:28 Nov 20:03:40 ntpd[27970]: ntpd: time slew -0.001290 s 2023-11-28T20:03:40.894 INFO:teuthology.orchestra.run.smithi195.stdout:ntpd: time slew -0.001290s 2023-11-28T20:03:40.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:40 ntpd[27970]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T20:03:40.894 INFO:teuthology.orchestra.run.smithi195.stderr:28 Nov 20:03:40 ntpd[27970]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T20:03:40.955 INFO:teuthology.orchestra.run.smithi177.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T20:03:40.955 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================== 2023-11-28T20:03:40.955 INFO:teuthology.orchestra.run.smithi177.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:03:40.955 INFO:teuthology.orchestra.run.smithi177.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:03:40.955 INFO:teuthology.orchestra.run.smithi177.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:03:40.955 INFO:teuthology.orchestra.run.smithi177.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:03:40.995 INFO:teuthology.orchestra.run.smithi195.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T20:03:40.995 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================== 2023-11-28T20:03:40.996 INFO:teuthology.orchestra.run.smithi195.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:03:40.996 INFO:teuthology.orchestra.run.smithi195.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:03:40.996 INFO:teuthology.orchestra.run.smithi195.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:03:40.996 INFO:teuthology.orchestra.run.smithi195.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:03:40.997 INFO:teuthology.run_tasks:Running task install... 2023-11-28T20:03:41.007 DEBUG:teuthology.task.install:project ceph 2023-11-28T20:03:41.007 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}} 2023-11-28T20:03:41.007 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'} 2023-11-28T20:03:41.007 INFO:teuthology.task.install:Using flavor: default 2023-11-28T20:03:41.013 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-28T20:03:41.013 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-28T20:03:41.014 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-key list | grep Ceph 2023-11-28T20:03:41.014 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-key list | grep Ceph 2023-11-28T20:03:41.120 INFO:teuthology.orchestra.run.smithi177.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T20:03:41.149 INFO:teuthology.orchestra.run.smithi195.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T20:03:41.196 INFO:teuthology.orchestra.run.smithi177.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T20:03:41.196 INFO:teuthology.orchestra.run.smithi177.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T20:03:41.197 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T20:03:41.197 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T20:03:41.197 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T20:03:41.202 INFO:teuthology.orchestra.run.smithi195.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T20:03:41.202 INFO:teuthology.orchestra.run.smithi195.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T20:03:41.203 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T20:03:41.204 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T20:03:41.204 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T20:03:41.361 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default/ 2023-11-28T20:03:41.362 INFO:teuthology.task.install.deb:Package version is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:03:41.420 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default/ 2023-11-28T20:03:41.421 INFO:teuthology.task.install.deb:Package version is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:03:41.473 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:03:41.473 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T20:03:41.494 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-get update 2023-11-28T20:03:41.529 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:03:41.529 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T20:03:41.549 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-get update 2023-11-28T20:03:41.693 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T20:03:41.703 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T20:03:41.723 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T20:03:41.723 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T20:03:41.732 INFO:teuthology.orchestra.run.smithi195.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T20:03:41.753 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-28T20:03:41.775 INFO:teuthology.orchestra.run.smithi195.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T20:03:41.796 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-11-28T20:03:41.830 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T20:03:41.870 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T20:03:41.870 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T20:03:41.870 INFO:teuthology.orchestra.run.smithi177.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T20:03:41.934 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-28T20:03:41.940 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T20:03:42.010 INFO:teuthology.orchestra.run.smithi177.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T20:03:42.021 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T20:03:42.094 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T20:03:42.291 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-11-28T20:03:42.297 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 27.9 kB in 1s (48.4 kB/s) 2023-11-28T20:03:42.475 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 27.9 kB in 1s (39.9 kB/s) 2023-11-28T20:03:43.216 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2023-11-28T20:03:43.231 DEBUG:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7520-g43dd94c1-1jammy cephadm=18.0.0-7520-g43dd94c1-1jammy ceph-mds=18.0.0-7520-g43dd94c1-1jammy ceph-mgr=18.0.0-7520-g43dd94c1-1jammy ceph-common=18.0.0-7520-g43dd94c1-1jammy ceph-fuse=18.0.0-7520-g43dd94c1-1jammy ceph-test=18.0.0-7520-g43dd94c1-1jammy ceph-volume=18.0.0-7520-g43dd94c1-1jammy radosgw=18.0.0-7520-g43dd94c1-1jammy python3-rados=18.0.0-7520-g43dd94c1-1jammy python3-rgw=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy python3-rbd=18.0.0-7520-g43dd94c1-1jammy libcephfs2=18.0.0-7520-g43dd94c1-1jammy libcephfs-dev=18.0.0-7520-g43dd94c1-1jammy librados2=18.0.0-7520-g43dd94c1-1jammy librbd1=18.0.0-7520-g43dd94c1-1jammy rbd-fuse=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy cephfs-shell=18.0.0-7520-g43dd94c1-1jammy cephfs-top=18.0.0-7520-g43dd94c1-1jammy cephfs-mirror=18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:03:43.306 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2023-11-28T20:03:43.392 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2023-11-28T20:03:43.407 DEBUG:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7520-g43dd94c1-1jammy cephadm=18.0.0-7520-g43dd94c1-1jammy ceph-mds=18.0.0-7520-g43dd94c1-1jammy ceph-mgr=18.0.0-7520-g43dd94c1-1jammy ceph-common=18.0.0-7520-g43dd94c1-1jammy ceph-fuse=18.0.0-7520-g43dd94c1-1jammy ceph-test=18.0.0-7520-g43dd94c1-1jammy ceph-volume=18.0.0-7520-g43dd94c1-1jammy radosgw=18.0.0-7520-g43dd94c1-1jammy python3-rados=18.0.0-7520-g43dd94c1-1jammy python3-rgw=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy python3-rbd=18.0.0-7520-g43dd94c1-1jammy libcephfs2=18.0.0-7520-g43dd94c1-1jammy libcephfs-dev=18.0.0-7520-g43dd94c1-1jammy librados2=18.0.0-7520-g43dd94c1-1jammy librbd1=18.0.0-7520-g43dd94c1-1jammy rbd-fuse=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy cephfs-shell=18.0.0-7520-g43dd94c1-1jammy cephfs-top=18.0.0-7520-g43dd94c1-1jammy cephfs-mirror=18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:03:43.471 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2023-11-28T20:03:43.472 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2023-11-28T20:03:43.480 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2023-11-28T20:03:43.625 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T20:03:43.626 INFO:teuthology.orchestra.run.smithi195.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T20:03:43.626 INFO:teuthology.orchestra.run.smithi195.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T20:03:43.626 INFO:teuthology.orchestra.run.smithi195.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T20:03:43.626 INFO:teuthology.orchestra.run.smithi195.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T20:03:43.626 INFO:teuthology.orchestra.run.smithi195.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T20:03:43.626 INFO:teuthology.orchestra.run.smithi195.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T20:03:43.628 INFO:teuthology.orchestra.run.smithi195.stdout:The following additional packages will be installed: 2023-11-28T20:03:43.628 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T20:03:43.628 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T20:03:43.629 INFO:teuthology.orchestra.run.smithi195.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T20:03:43.629 INFO:teuthology.orchestra.run.smithi195.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T20:03:43.629 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T20:03:43.629 INFO:teuthology.orchestra.run.smithi195.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T20:03:43.629 INFO:teuthology.orchestra.run.smithi195.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T20:03:43.629 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T20:03:43.629 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T20:03:43.629 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T20:03:43.629 INFO:teuthology.orchestra.run.smithi195.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T20:03:43.629 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T20:03:43.629 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T20:03:43.629 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T20:03:43.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T20:03:43.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T20:03:43.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T20:03:43.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T20:03:43.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T20:03:43.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T20:03:43.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T20:03:43.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T20:03:43.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T20:03:43.630 INFO:teuthology.orchestra.run.smithi195.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T20:03:43.630 INFO:teuthology.orchestra.run.smithi195.stdout:Suggested packages: 2023-11-28T20:03:43.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T20:03:43.631 INFO:teuthology.orchestra.run.smithi195.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T20:03:43.631 INFO:teuthology.orchestra.run.smithi195.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T20:03:43.631 INFO:teuthology.orchestra.run.smithi195.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T20:03:43.631 INFO:teuthology.orchestra.run.smithi195.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T20:03:43.631 INFO:teuthology.orchestra.run.smithi195.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T20:03:43.631 INFO:teuthology.orchestra.run.smithi195.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T20:03:43.631 INFO:teuthology.orchestra.run.smithi195.stdout:Recommended packages: 2023-11-28T20:03:43.631 INFO:teuthology.orchestra.run.smithi195.stdout: btrfs-tools 2023-11-28T20:03:43.646 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2023-11-28T20:03:43.646 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2023-11-28T20:03:43.776 INFO:teuthology.orchestra.run.smithi195.stdout:The following NEW packages will be installed: 2023-11-28T20:03:43.776 INFO:teuthology.orchestra.run.smithi195.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T20:03:43.776 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T20:03:43.776 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T20:03:43.776 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T20:03:43.776 INFO:teuthology.orchestra.run.smithi195.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T20:03:43.776 INFO:teuthology.orchestra.run.smithi195.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T20:03:43.776 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T20:03:43.777 INFO:teuthology.orchestra.run.smithi195.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T20:03:43.777 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T20:03:43.777 INFO:teuthology.orchestra.run.smithi195.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T20:03:43.777 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T20:03:43.777 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T20:03:43.777 INFO:teuthology.orchestra.run.smithi195.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T20:03:43.777 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T20:03:43.777 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T20:03:43.777 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T20:03:43.777 INFO:teuthology.orchestra.run.smithi195.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T20:03:43.777 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T20:03:43.778 INFO:teuthology.orchestra.run.smithi195.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T20:03:43.778 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T20:03:43.778 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T20:03:43.778 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T20:03:43.778 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T20:03:43.778 INFO:teuthology.orchestra.run.smithi195.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T20:03:43.778 INFO:teuthology.orchestra.run.smithi195.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T20:03:43.778 INFO:teuthology.orchestra.run.smithi195.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T20:03:43.778 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T20:03:43.778 INFO:teuthology.orchestra.run.smithi195.stdout: socat unzip xmlstarlet zip 2023-11-28T20:03:43.798 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T20:03:43.799 INFO:teuthology.orchestra.run.smithi177.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T20:03:43.799 INFO:teuthology.orchestra.run.smithi177.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T20:03:43.799 INFO:teuthology.orchestra.run.smithi177.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T20:03:43.799 INFO:teuthology.orchestra.run.smithi177.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T20:03:43.800 INFO:teuthology.orchestra.run.smithi177.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T20:03:43.800 INFO:teuthology.orchestra.run.smithi177.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T20:03:43.800 INFO:teuthology.orchestra.run.smithi177.stdout:The following additional packages will be installed: 2023-11-28T20:03:43.800 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T20:03:43.800 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T20:03:43.800 INFO:teuthology.orchestra.run.smithi177.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T20:03:43.800 INFO:teuthology.orchestra.run.smithi177.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T20:03:43.800 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T20:03:43.802 INFO:teuthology.orchestra.run.smithi177.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T20:03:43.802 INFO:teuthology.orchestra.run.smithi177.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T20:03:43.802 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T20:03:43.802 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T20:03:43.802 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T20:03:43.802 INFO:teuthology.orchestra.run.smithi177.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T20:03:43.802 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T20:03:43.802 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T20:03:43.803 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T20:03:43.803 INFO:teuthology.orchestra.run.smithi177.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T20:03:43.803 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T20:03:43.803 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T20:03:43.803 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T20:03:43.803 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T20:03:43.803 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T20:03:43.803 INFO:teuthology.orchestra.run.smithi177.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T20:03:43.803 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T20:03:43.803 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T20:03:43.803 INFO:teuthology.orchestra.run.smithi177.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T20:03:43.803 INFO:teuthology.orchestra.run.smithi177.stdout:Suggested packages: 2023-11-28T20:03:43.804 INFO:teuthology.orchestra.run.smithi177.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T20:03:43.804 INFO:teuthology.orchestra.run.smithi177.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T20:03:43.804 INFO:teuthology.orchestra.run.smithi177.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T20:03:43.804 INFO:teuthology.orchestra.run.smithi177.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T20:03:43.804 INFO:teuthology.orchestra.run.smithi177.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T20:03:43.804 INFO:teuthology.orchestra.run.smithi177.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T20:03:43.804 INFO:teuthology.orchestra.run.smithi177.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T20:03:43.804 INFO:teuthology.orchestra.run.smithi177.stdout:Recommended packages: 2023-11-28T20:03:43.804 INFO:teuthology.orchestra.run.smithi177.stdout: btrfs-tools 2023-11-28T20:03:43.847 INFO:teuthology.orchestra.run.smithi195.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T20:03:43.848 INFO:teuthology.orchestra.run.smithi195.stdout:Need to get 187 MB of archives. 2023-11-28T20:03:43.848 INFO:teuthology.orchestra.run.smithi195.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T20:03:43.848 INFO:teuthology.orchestra.run.smithi195.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T20:03:43.865 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T20:03:43.875 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T20:03:43.917 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T20:03:43.937 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T20:03:43.940 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T20:03:43.950 INFO:teuthology.orchestra.run.smithi177.stdout:The following NEW packages will be installed: 2023-11-28T20:03:43.950 INFO:teuthology.orchestra.run.smithi177.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T20:03:43.951 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T20:03:43.951 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T20:03:43.951 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T20:03:43.951 INFO:teuthology.orchestra.run.smithi177.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T20:03:43.951 INFO:teuthology.orchestra.run.smithi177.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T20:03:43.952 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T20:03:43.952 INFO:teuthology.orchestra.run.smithi177.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T20:03:43.952 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T20:03:43.952 INFO:teuthology.orchestra.run.smithi177.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T20:03:43.952 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T20:03:43.952 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T20:03:43.952 INFO:teuthology.orchestra.run.smithi177.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T20:03:43.952 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T20:03:43.953 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T20:03:43.953 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T20:03:43.953 INFO:teuthology.orchestra.run.smithi177.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T20:03:43.953 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T20:03:43.953 INFO:teuthology.orchestra.run.smithi177.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T20:03:43.953 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T20:03:43.953 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T20:03:43.953 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T20:03:43.953 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T20:03:43.953 INFO:teuthology.orchestra.run.smithi177.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T20:03:43.953 INFO:teuthology.orchestra.run.smithi177.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T20:03:43.954 INFO:teuthology.orchestra.run.smithi177.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T20:03:43.954 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T20:03:43.954 INFO:teuthology.orchestra.run.smithi177.stdout: socat unzip xmlstarlet zip 2023-11-28T20:03:43.954 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T20:03:43.989 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T20:03:43.991 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T20:03:43.999 INFO:teuthology.orchestra.run.smithi195.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T20:03:44.002 INFO:teuthology.orchestra.run.smithi195.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T20:03:44.003 INFO:teuthology.orchestra.run.smithi195.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T20:03:44.009 INFO:teuthology.orchestra.run.smithi195.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T20:03:44.011 INFO:teuthology.orchestra.run.smithi195.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T20:03:44.012 INFO:teuthology.orchestra.run.smithi195.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T20:03:44.013 INFO:teuthology.orchestra.run.smithi195.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T20:03:44.014 INFO:teuthology.orchestra.run.smithi195.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T20:03:44.016 INFO:teuthology.orchestra.run.smithi177.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T20:03:44.017 INFO:teuthology.orchestra.run.smithi177.stdout:Need to get 187 MB of archives. 2023-11-28T20:03:44.017 INFO:teuthology.orchestra.run.smithi177.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T20:03:44.017 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T20:03:44.024 INFO:teuthology.orchestra.run.smithi195.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T20:03:44.026 INFO:teuthology.orchestra.run.smithi195.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T20:03:44.028 INFO:teuthology.orchestra.run.smithi195.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T20:03:44.029 INFO:teuthology.orchestra.run.smithi195.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T20:03:44.035 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T20:03:44.041 INFO:teuthology.orchestra.run.smithi195.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T20:03:44.042 INFO:teuthology.orchestra.run.smithi195.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T20:03:44.042 INFO:teuthology.orchestra.run.smithi195.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T20:03:44.043 INFO:teuthology.orchestra.run.smithi195.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T20:03:44.043 INFO:teuthology.orchestra.run.smithi195.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T20:03:44.044 INFO:teuthology.orchestra.run.smithi195.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T20:03:44.044 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T20:03:44.058 INFO:teuthology.orchestra.run.smithi195.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T20:03:44.058 INFO:teuthology.orchestra.run.smithi195.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T20:03:44.060 INFO:teuthology.orchestra.run.smithi195.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T20:03:44.061 INFO:teuthology.orchestra.run.smithi195.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T20:03:44.075 INFO:teuthology.orchestra.run.smithi195.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T20:03:44.075 INFO:teuthology.orchestra.run.smithi195.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T20:03:44.076 INFO:teuthology.orchestra.run.smithi195.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T20:03:44.076 INFO:teuthology.orchestra.run.smithi195.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T20:03:44.077 INFO:teuthology.orchestra.run.smithi195.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T20:03:44.078 INFO:teuthology.orchestra.run.smithi195.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T20:03:44.086 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T20:03:44.091 INFO:teuthology.orchestra.run.smithi195.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T20:03:44.092 INFO:teuthology.orchestra.run.smithi195.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T20:03:44.096 INFO:teuthology.orchestra.run.smithi195.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T20:03:44.096 INFO:teuthology.orchestra.run.smithi195.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T20:03:44.107 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T20:03:44.108 INFO:teuthology.orchestra.run.smithi195.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T20:03:44.109 INFO:teuthology.orchestra.run.smithi195.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T20:03:44.110 INFO:teuthology.orchestra.run.smithi195.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T20:03:44.110 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T20:03:44.111 INFO:teuthology.orchestra.run.smithi195.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T20:03:44.112 INFO:teuthology.orchestra.run.smithi195.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T20:03:44.113 INFO:teuthology.orchestra.run.smithi195.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T20:03:44.121 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T20:03:44.125 INFO:teuthology.orchestra.run.smithi195.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T20:03:44.127 INFO:teuthology.orchestra.run.smithi195.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T20:03:44.128 INFO:teuthology.orchestra.run.smithi195.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T20:03:44.128 INFO:teuthology.orchestra.run.smithi195.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T20:03:44.142 INFO:teuthology.orchestra.run.smithi195.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T20:03:44.157 INFO:teuthology.orchestra.run.smithi195.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7520-g43dd94c1-1jammy [3,469 kB] 2023-11-28T20:03:44.161 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T20:03:44.163 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T20:03:44.170 INFO:teuthology.orchestra.run.smithi177.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T20:03:44.173 INFO:teuthology.orchestra.run.smithi177.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T20:03:44.173 INFO:teuthology.orchestra.run.smithi177.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T20:03:44.179 INFO:teuthology.orchestra.run.smithi177.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T20:03:44.181 INFO:teuthology.orchestra.run.smithi177.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T20:03:44.183 INFO:teuthology.orchestra.run.smithi177.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T20:03:44.184 INFO:teuthology.orchestra.run.smithi177.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T20:03:44.185 INFO:teuthology.orchestra.run.smithi177.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T20:03:44.190 INFO:teuthology.orchestra.run.smithi195.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T20:03:44.190 INFO:teuthology.orchestra.run.smithi195.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T20:03:44.192 INFO:teuthology.orchestra.run.smithi195.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T20:03:44.193 INFO:teuthology.orchestra.run.smithi195.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T20:03:44.194 INFO:teuthology.orchestra.run.smithi195.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T20:03:44.197 INFO:teuthology.orchestra.run.smithi177.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T20:03:44.199 INFO:teuthology.orchestra.run.smithi177.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T20:03:44.200 INFO:teuthology.orchestra.run.smithi177.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T20:03:44.201 INFO:teuthology.orchestra.run.smithi177.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T20:03:44.214 INFO:teuthology.orchestra.run.smithi195.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T20:03:44.214 INFO:teuthology.orchestra.run.smithi177.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T20:03:44.215 INFO:teuthology.orchestra.run.smithi177.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T20:03:44.215 INFO:teuthology.orchestra.run.smithi177.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T20:03:44.215 INFO:teuthology.orchestra.run.smithi177.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T20:03:44.216 INFO:teuthology.orchestra.run.smithi195.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T20:03:44.216 INFO:teuthology.orchestra.run.smithi177.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T20:03:44.217 INFO:teuthology.orchestra.run.smithi195.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T20:03:44.217 INFO:teuthology.orchestra.run.smithi177.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T20:03:44.231 INFO:teuthology.orchestra.run.smithi177.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T20:03:44.231 INFO:teuthology.orchestra.run.smithi177.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T20:03:44.233 INFO:teuthology.orchestra.run.smithi177.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T20:03:44.234 INFO:teuthology.orchestra.run.smithi195.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T20:03:44.234 INFO:teuthology.orchestra.run.smithi177.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T20:03:44.234 INFO:teuthology.orchestra.run.smithi195.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T20:03:44.235 INFO:teuthology.orchestra.run.smithi195.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T20:03:44.235 INFO:teuthology.orchestra.run.smithi195.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T20:03:44.236 INFO:teuthology.orchestra.run.smithi195.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T20:03:44.237 INFO:teuthology.orchestra.run.smithi195.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T20:03:44.244 INFO:teuthology.orchestra.run.smithi195.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T20:03:44.244 INFO:teuthology.orchestra.run.smithi195.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T20:03:44.248 INFO:teuthology.orchestra.run.smithi177.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T20:03:44.248 INFO:teuthology.orchestra.run.smithi195.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T20:03:44.248 INFO:teuthology.orchestra.run.smithi177.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T20:03:44.249 INFO:teuthology.orchestra.run.smithi177.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T20:03:44.249 INFO:teuthology.orchestra.run.smithi177.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T20:03:44.249 INFO:teuthology.orchestra.run.smithi177.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T20:03:44.251 INFO:teuthology.orchestra.run.smithi177.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T20:03:44.261 INFO:teuthology.orchestra.run.smithi195.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T20:03:44.263 INFO:teuthology.orchestra.run.smithi195.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T20:03:44.263 INFO:teuthology.orchestra.run.smithi195.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T20:03:44.265 INFO:teuthology.orchestra.run.smithi177.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T20:03:44.265 INFO:teuthology.orchestra.run.smithi177.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T20:03:44.267 INFO:teuthology.orchestra.run.smithi195.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T20:03:44.270 INFO:teuthology.orchestra.run.smithi177.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T20:03:44.270 INFO:teuthology.orchestra.run.smithi177.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T20:03:44.270 INFO:teuthology.orchestra.run.smithi195.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T20:03:44.270 INFO:teuthology.orchestra.run.smithi195.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T20:03:44.271 INFO:teuthology.orchestra.run.smithi195.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T20:03:44.278 INFO:teuthology.orchestra.run.smithi195.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T20:03:44.283 INFO:teuthology.orchestra.run.smithi177.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T20:03:44.283 INFO:teuthology.orchestra.run.smithi177.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T20:03:44.283 INFO:teuthology.orchestra.run.smithi195.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T20:03:44.283 INFO:teuthology.orchestra.run.smithi195.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T20:03:44.284 INFO:teuthology.orchestra.run.smithi177.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T20:03:44.285 INFO:teuthology.orchestra.run.smithi177.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T20:03:44.286 INFO:teuthology.orchestra.run.smithi177.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T20:03:44.287 INFO:teuthology.orchestra.run.smithi177.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T20:03:44.294 INFO:teuthology.orchestra.run.smithi195.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T20:03:44.295 INFO:teuthology.orchestra.run.smithi195.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T20:03:44.296 INFO:teuthology.orchestra.run.smithi195.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T20:03:44.296 INFO:teuthology.orchestra.run.smithi195.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T20:03:44.298 INFO:teuthology.orchestra.run.smithi195.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T20:03:44.300 INFO:teuthology.orchestra.run.smithi195.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T20:03:44.300 INFO:teuthology.orchestra.run.smithi177.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T20:03:44.301 INFO:teuthology.orchestra.run.smithi177.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T20:03:44.302 INFO:teuthology.orchestra.run.smithi177.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T20:03:44.302 INFO:teuthology.orchestra.run.smithi177.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T20:03:44.305 INFO:teuthology.orchestra.run.smithi195.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T20:03:44.311 INFO:teuthology.orchestra.run.smithi195.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T20:03:44.312 INFO:teuthology.orchestra.run.smithi195.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T20:03:44.314 INFO:teuthology.orchestra.run.smithi195.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T20:03:44.316 INFO:teuthology.orchestra.run.smithi177.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T20:03:44.328 INFO:teuthology.orchestra.run.smithi195.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T20:03:44.361 INFO:teuthology.orchestra.run.smithi177.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T20:03:44.362 INFO:teuthology.orchestra.run.smithi177.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T20:03:44.363 INFO:teuthology.orchestra.run.smithi177.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T20:03:44.364 INFO:teuthology.orchestra.run.smithi177.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T20:03:44.365 INFO:teuthology.orchestra.run.smithi177.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T20:03:44.383 INFO:teuthology.orchestra.run.smithi177.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T20:03:44.386 INFO:teuthology.orchestra.run.smithi177.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T20:03:44.386 INFO:teuthology.orchestra.run.smithi177.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T20:03:44.405 INFO:teuthology.orchestra.run.smithi177.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T20:03:44.406 INFO:teuthology.orchestra.run.smithi177.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T20:03:44.406 INFO:teuthology.orchestra.run.smithi177.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T20:03:44.406 INFO:teuthology.orchestra.run.smithi177.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T20:03:44.406 INFO:teuthology.orchestra.run.smithi177.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T20:03:44.407 INFO:teuthology.orchestra.run.smithi177.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T20:03:44.413 INFO:teuthology.orchestra.run.smithi177.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T20:03:44.414 INFO:teuthology.orchestra.run.smithi177.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T20:03:44.417 INFO:teuthology.orchestra.run.smithi177.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T20:03:44.430 INFO:teuthology.orchestra.run.smithi177.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T20:03:44.432 INFO:teuthology.orchestra.run.smithi177.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T20:03:44.432 INFO:teuthology.orchestra.run.smithi177.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T20:03:44.436 INFO:teuthology.orchestra.run.smithi177.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T20:03:44.439 INFO:teuthology.orchestra.run.smithi177.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T20:03:44.439 INFO:teuthology.orchestra.run.smithi177.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T20:03:44.440 INFO:teuthology.orchestra.run.smithi177.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T20:03:44.447 INFO:teuthology.orchestra.run.smithi177.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T20:03:44.452 INFO:teuthology.orchestra.run.smithi177.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T20:03:44.452 INFO:teuthology.orchestra.run.smithi177.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T20:03:44.464 INFO:teuthology.orchestra.run.smithi177.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T20:03:44.465 INFO:teuthology.orchestra.run.smithi177.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T20:03:44.465 INFO:teuthology.orchestra.run.smithi177.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T20:03:44.466 INFO:teuthology.orchestra.run.smithi177.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T20:03:44.468 INFO:teuthology.orchestra.run.smithi177.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T20:03:44.468 INFO:teuthology.orchestra.run.smithi177.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T20:03:44.475 INFO:teuthology.orchestra.run.smithi177.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T20:03:44.480 INFO:teuthology.orchestra.run.smithi177.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7520-g43dd94c1-1jammy [3,469 kB] 2023-11-28T20:03:44.482 INFO:teuthology.orchestra.run.smithi177.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T20:03:44.482 INFO:teuthology.orchestra.run.smithi177.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T20:03:44.484 INFO:teuthology.orchestra.run.smithi177.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T20:03:44.498 INFO:teuthology.orchestra.run.smithi177.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T20:03:45.012 INFO:teuthology.orchestra.run.smithi177.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7520-g43dd94c1-1jammy [3,111 kB] 2023-11-28T20:03:45.202 INFO:teuthology.orchestra.run.smithi177.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7520-g43dd94c1-1jammy [691 kB] 2023-11-28T20:03:45.310 INFO:teuthology.orchestra.run.smithi177.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7520-g43dd94c1-1jammy [356 kB] 2023-11-28T20:03:45.313 INFO:teuthology.orchestra.run.smithi177.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7520-g43dd94c1-1jammy [32.8 kB] 2023-11-28T20:03:45.314 INFO:teuthology.orchestra.run.smithi177.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7520-g43dd94c1-1jammy [180 kB] 2023-11-28T20:03:45.316 INFO:teuthology.orchestra.run.smithi177.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7520-g43dd94c1-1jammy [63.5 kB] 2023-11-28T20:03:45.317 INFO:teuthology.orchestra.run.smithi177.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7520-g43dd94c1-1jammy [330 kB] 2023-11-28T20:03:45.320 INFO:teuthology.orchestra.run.smithi177.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7520-g43dd94c1-1jammy [6,233 kB] 2023-11-28T20:03:45.866 INFO:teuthology.orchestra.run.smithi177.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7520-g43dd94c1-1jammy [112 kB] 2023-11-28T20:03:45.889 INFO:teuthology.orchestra.run.smithi177.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7520-g43dd94c1-1jammy [439 kB] 2023-11-28T20:03:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7520-g43dd94c1-1jammy [3,111 kB] 2023-11-28T20:03:45.953 INFO:teuthology.orchestra.run.smithi177.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7520-g43dd94c1-1jammy [22.6 MB] 2023-11-28T20:03:47.710 INFO:teuthology.orchestra.run.smithi195.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7520-g43dd94c1-1jammy [691 kB] 2023-11-28T20:03:48.314 INFO:teuthology.orchestra.run.smithi195.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7520-g43dd94c1-1jammy [356 kB] 2023-11-28T20:03:48.628 INFO:teuthology.orchestra.run.smithi195.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7520-g43dd94c1-1jammy [32.8 kB] 2023-11-28T20:03:48.667 INFO:teuthology.orchestra.run.smithi195.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7520-g43dd94c1-1jammy [180 kB] 2023-11-28T20:03:48.829 INFO:teuthology.orchestra.run.smithi195.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7520-g43dd94c1-1jammy [63.5 kB] 2023-11-28T20:03:48.883 INFO:teuthology.orchestra.run.smithi195.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7520-g43dd94c1-1jammy [330 kB] 2023-11-28T20:03:49.136 INFO:teuthology.orchestra.run.smithi195.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7520-g43dd94c1-1jammy [6,233 kB] 2023-11-28T20:03:54.933 INFO:teuthology.orchestra.run.smithi177.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7520-g43dd94c1-1jammy [6,900 kB] 2023-11-28T20:03:55.215 INFO:teuthology.orchestra.run.smithi195.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7520-g43dd94c1-1jammy [112 kB] 2023-11-28T20:03:55.323 INFO:teuthology.orchestra.run.smithi195.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7520-g43dd94c1-1jammy [439 kB] 2023-11-28T20:03:55.692 INFO:teuthology.orchestra.run.smithi195.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7520-g43dd94c1-1jammy [22.6 MB] 2023-11-28T20:03:58.431 INFO:teuthology.orchestra.run.smithi177.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7520-g43dd94c1-1jammy [238 kB] 2023-11-28T20:03:58.508 INFO:teuthology.orchestra.run.smithi177.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7520-g43dd94c1-1jammy [124 kB] 2023-11-28T20:03:58.544 INFO:teuthology.orchestra.run.smithi177.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7520-g43dd94c1-1jammy [1,496 kB] 2023-11-28T20:03:59.002 INFO:teuthology.orchestra.run.smithi177.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7520-g43dd94c1-1jammy [9,956 kB] 2023-11-28T20:04:01.414 INFO:teuthology.orchestra.run.smithi177.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7520-g43dd94c1-1jammy [31.9 MB] 2023-11-28T20:04:03.028 INFO:teuthology.orchestra.run.smithi195.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7520-g43dd94c1-1jammy [6,900 kB] 2023-11-28T20:04:03.994 INFO:teuthology.orchestra.run.smithi195.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7520-g43dd94c1-1jammy [238 kB] 2023-11-28T20:04:04.017 INFO:teuthology.orchestra.run.smithi195.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7520-g43dd94c1-1jammy [124 kB] 2023-11-28T20:04:04.031 INFO:teuthology.orchestra.run.smithi195.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7520-g43dd94c1-1jammy [1,496 kB] 2023-11-28T20:04:04.205 INFO:teuthology.orchestra.run.smithi195.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7520-g43dd94c1-1jammy [9,956 kB] 2023-11-28T20:04:05.136 INFO:teuthology.orchestra.run.smithi195.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7520-g43dd94c1-1jammy [31.9 MB] 2023-11-28T20:04:05.598 INFO:teuthology.orchestra.run.smithi177.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7520-g43dd94c1-1jammy [14.1 kB] 2023-11-28T20:04:05.599 INFO:teuthology.orchestra.run.smithi177.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [839 kB] 2023-11-28T20:04:05.655 INFO:teuthology.orchestra.run.smithi177.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7520-g43dd94c1-1jammy [2,148 kB] 2023-11-28T20:04:05.815 INFO:teuthology.orchestra.run.smithi177.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7520-g43dd94c1-1jammy [801 kB] 2023-11-28T20:04:05.855 INFO:teuthology.orchestra.run.smithi177.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7520-g43dd94c1-1jammy [139 kB] 2023-11-28T20:04:05.874 INFO:teuthology.orchestra.run.smithi177.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7520-g43dd94c1-1jammy [1,900 kB] 2023-11-28T20:04:06.003 INFO:teuthology.orchestra.run.smithi177.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7520-g43dd94c1-1jammy [8,625 kB] 2023-11-28T20:04:06.594 INFO:teuthology.orchestra.run.smithi177.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7520-g43dd94c1-1jammy [14.2 kB] 2023-11-28T20:04:06.594 INFO:teuthology.orchestra.run.smithi177.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7520-g43dd94c1-1jammy [48.7 MB] 2023-11-28T20:04:07.278 INFO:teuthology.orchestra.run.smithi195.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7520-g43dd94c1-1jammy [14.1 kB] 2023-11-28T20:04:07.279 INFO:teuthology.orchestra.run.smithi195.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [839 kB] 2023-11-28T20:04:07.321 INFO:teuthology.orchestra.run.smithi195.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7520-g43dd94c1-1jammy [2,148 kB] 2023-11-28T20:04:07.448 INFO:teuthology.orchestra.run.smithi195.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7520-g43dd94c1-1jammy [801 kB] 2023-11-28T20:04:07.500 INFO:teuthology.orchestra.run.smithi195.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7520-g43dd94c1-1jammy [139 kB] 2023-11-28T20:04:07.504 INFO:teuthology.orchestra.run.smithi195.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7520-g43dd94c1-1jammy [1,900 kB] 2023-11-28T20:04:07.640 INFO:teuthology.orchestra.run.smithi195.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7520-g43dd94c1-1jammy [8,625 kB] 2023-11-28T20:04:08.247 INFO:teuthology.orchestra.run.smithi195.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7520-g43dd94c1-1jammy [14.2 kB] 2023-11-28T20:04:08.248 INFO:teuthology.orchestra.run.smithi195.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7520-g43dd94c1-1jammy [48.7 MB] 2023-11-28T20:04:10.290 INFO:teuthology.orchestra.run.smithi177.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7520-g43dd94c1-1jammy [121 kB] 2023-11-28T20:04:10.291 INFO:teuthology.orchestra.run.smithi177.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7520-g43dd94c1-1jammy [225 kB] 2023-11-28T20:04:10.295 INFO:teuthology.orchestra.run.smithi177.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7520-g43dd94c1-1jammy [34.0 kB] 2023-11-28T20:04:10.305 INFO:teuthology.orchestra.run.smithi177.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7520-g43dd94c1-1jammy [23.4 kB] 2023-11-28T20:04:10.306 INFO:teuthology.orchestra.run.smithi177.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7520-g43dd94c1-1jammy [38.4 kB] 2023-11-28T20:04:10.326 INFO:teuthology.orchestra.run.smithi177.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7520-g43dd94c1-1jammy [12.3 MB] 2023-11-28T20:04:11.330 INFO:teuthology.orchestra.run.smithi177.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [91.2 kB] 2023-11-28T20:04:11.701 INFO:teuthology.orchestra.run.smithi195.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7520-g43dd94c1-1jammy [121 kB] 2023-11-28T20:04:11.702 INFO:teuthology.orchestra.run.smithi195.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7520-g43dd94c1-1jammy [225 kB] 2023-11-28T20:04:11.715 INFO:teuthology.orchestra.run.smithi195.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7520-g43dd94c1-1jammy [34.0 kB] 2023-11-28T20:04:11.716 INFO:teuthology.orchestra.run.smithi195.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7520-g43dd94c1-1jammy [23.4 kB] 2023-11-28T20:04:11.716 INFO:teuthology.orchestra.run.smithi195.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7520-g43dd94c1-1jammy [38.4 kB] 2023-11-28T20:04:11.717 INFO:teuthology.orchestra.run.smithi195.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7520-g43dd94c1-1jammy [12.3 MB] 2023-11-28T20:04:11.963 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 187 MB in 27s (6,834 kB/s) 2023-11-28T20:04:12.106 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T20:04:12.176 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-28T20:04:12.179 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T20:04:12.222 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T20:04:12.279 INFO:teuthology.orchestra.run.smithi195.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [91.2 kB] 2023-11-28T20:04:12.524 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T20:04:12.538 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T20:04:12.583 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T20:04:12.902 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T20:04:12.916 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T20:04:12.917 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 187 MB in 28s (6,564 kB/s) 2023-11-28T20:04:12.960 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T20:04:13.072 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T20:04:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-28T20:04:13.143 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T20:04:13.188 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T20:04:13.313 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T20:04:13.327 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T20:04:13.397 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T20:04:13.490 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T20:04:13.504 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T20:04:13.549 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T20:04:13.675 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T20:04:13.689 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T20:04:13.733 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T20:04:13.851 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T20:04:13.865 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T20:04:13.901 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T20:04:14.078 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T20:04:14.093 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T20:04:14.136 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T20:04:14.255 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T20:04:14.268 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T20:04:14.354 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T20:04:14.573 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T20:04:14.588 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T20:04:14.631 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:04:14.691 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T20:04:14.705 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T20:04:14.750 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T20:04:15.026 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T20:04:15.036 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T20:04:15.041 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T20:04:15.050 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T20:04:15.084 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:04:15.094 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T20:04:15.421 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T20:04:15.435 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T20:04:15.479 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:04:15.573 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T20:04:15.587 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T20:04:15.639 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:04:15.815 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T20:04:15.830 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T20:04:15.873 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T20:04:16.043 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T20:04:16.056 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T20:04:16.101 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:04:16.202 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librados2. 2023-11-28T20:04:16.216 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../010-librados2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:16.259 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:16.588 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T20:04:16.602 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T20:04:16.637 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:04:17.152 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librbd1. 2023-11-28T20:04:17.167 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../011-librbd1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:17.598 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:17.649 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T20:04:17.665 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T20:04:17.707 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T20:04:17.965 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T20:04:17.979 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:18.015 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:18.044 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librados2. 2023-11-28T20:04:18.058 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../010-librados2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:18.110 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:18.309 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rados. 2023-11-28T20:04:18.324 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:18.367 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:18.588 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librbd1. 2023-11-28T20:04:18.603 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../011-librbd1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:18.655 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:18.736 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T20:04:18.751 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:18.803 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:19.082 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T20:04:19.097 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:19.114 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T20:04:19.129 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:19.141 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:19.181 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:19.402 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rados. 2023-11-28T20:04:19.416 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:19.460 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:19.575 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T20:04:19.590 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:19.641 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:19.754 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T20:04:19.769 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:19.804 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:20.028 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T20:04:20.042 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T20:04:20.057 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T20:04:20.071 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:20.094 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T20:04:20.115 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:20.380 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T20:04:20.395 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:20.418 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T20:04:20.432 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:20.438 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:20.476 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T20:04:20.810 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T20:04:20.854 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T20:04:20.866 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T20:04:20.881 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T20:04:20.933 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T20:04:21.157 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T20:04:21.171 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:21.215 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:21.235 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T20:04:21.250 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T20:04:21.302 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T20:04:21.509 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T20:04:21.524 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T20:04:21.568 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T20:04:21.646 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T20:04:21.661 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T20:04:21.721 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T20:04:21.845 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T20:04:21.860 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T20:04:21.906 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T20:04:22.111 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package lua5.1. 2023-11-28T20:04:22.123 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T20:04:22.166 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T20:04:22.231 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T20:04:22.246 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T20:04:22.289 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T20:04:22.510 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package lua-any. 2023-11-28T20:04:22.525 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T20:04:22.577 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T20:04:22.585 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package lua5.1. 2023-11-28T20:04:22.600 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T20:04:22.634 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T20:04:22.913 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package zip. 2023-11-28T20:04:22.928 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T20:04:22.929 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package lua-any. 2023-11-28T20:04:22.944 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T20:04:22.980 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T20:04:22.987 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T20:04:23.240 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package zip. 2023-11-28T20:04:23.255 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T20:04:23.315 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T20:04:23.350 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package unzip. 2023-11-28T20:04:23.364 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T20:04:23.416 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T20:04:23.626 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package unzip. 2023-11-28T20:04:23.641 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T20:04:23.676 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T20:04:23.853 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package luarocks. 2023-11-28T20:04:23.868 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T20:04:23.919 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T20:04:24.005 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package luarocks. 2023-11-28T20:04:24.020 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T20:04:24.055 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T20:04:24.336 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librgw2. 2023-11-28T20:04:24.350 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../027-librgw2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:24.394 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:24.462 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librgw2. 2023-11-28T20:04:24.476 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../027-librgw2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:24.521 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:24.854 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T20:04:24.869 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:24.904 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:24.982 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T20:04:24.995 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:25.040 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:25.232 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T20:04:25.247 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T20:04:25.291 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T20:04:25.351 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T20:04:25.366 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T20:04:25.401 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T20:04:25.601 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T20:04:25.616 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:25.660 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:25.737 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T20:04:25.752 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:25.795 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:26.047 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-common. 2023-11-28T20:04:26.061 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:26.096 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:26.216 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-common. 2023-11-28T20:04:26.230 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:26.282 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:27.085 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-base. 2023-11-28T20:04:27.099 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:27.152 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:27.446 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-base. 2023-11-28T20:04:27.461 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:27.513 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:27.955 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T20:04:27.970 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T20:04:28.022 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T20:04:28.192 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T20:04:28.205 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T20:04:28.250 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T20:04:28.333 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T20:04:28.348 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T20:04:28.391 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T20:04:28.552 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T20:04:28.566 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T20:04:28.611 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T20:04:28.686 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T20:04:28.701 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T20:04:28.736 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T20:04:28.931 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T20:04:28.944 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T20:04:28.997 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T20:04:29.005 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T20:04:29.022 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T20:04:29.055 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T20:04:29.325 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T20:04:29.339 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T20:04:29.358 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T20:04:29.373 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T20:04:29.383 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T20:04:29.416 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T20:04:29.645 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T20:04:29.659 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T20:04:29.703 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T20:04:29.719 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T20:04:29.734 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T20:04:29.777 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T20:04:30.006 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T20:04:30.021 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T20:04:30.055 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-portend. 2023-11-28T20:04:30.070 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T20:04:30.097 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T20:04:30.105 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T20:04:30.391 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T20:04:30.392 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-portend. 2023-11-28T20:04:30.407 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T20:04:30.407 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T20:04:30.449 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T20:04:30.450 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T20:04:30.745 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T20:04:30.752 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T20:04:30.760 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T20:04:30.767 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T20:04:30.794 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T20:04:30.810 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T20:04:31.098 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T20:04:31.112 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T20:04:31.156 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T20:04:31.197 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T20:04:31.212 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T20:04:31.255 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T20:04:31.518 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T20:04:31.532 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T20:04:31.542 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T20:04:31.557 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T20:04:31.576 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T20:04:31.592 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T20:04:31.819 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T20:04:31.834 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T20:04:31.886 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T20:04:31.887 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T20:04:31.902 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T20:04:31.945 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T20:04:32.222 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-mako. 2023-11-28T20:04:32.237 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T20:04:32.248 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T20:04:32.263 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T20:04:32.280 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T20:04:32.307 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T20:04:32.600 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T20:04:32.601 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-mako. 2023-11-28T20:04:32.616 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T20:04:32.616 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T20:04:32.651 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T20:04:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T20:04:32.944 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T20:04:32.960 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T20:04:32.979 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T20:04:32.994 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T20:04:33.036 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T20:04:33.037 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T20:04:33.331 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-webob. 2023-11-28T20:04:33.346 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T20:04:33.383 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T20:04:33.389 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T20:04:33.398 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T20:04:33.441 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T20:04:33.692 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T20:04:33.706 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T20:04:33.752 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T20:04:33.769 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-webob. 2023-11-28T20:04:33.784 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T20:04:33.827 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T20:04:34.086 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T20:04:34.101 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T20:04:34.144 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T20:04:34.147 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T20:04:34.162 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T20:04:34.199 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T20:04:34.456 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-paste. 2023-11-28T20:04:34.471 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T20:04:34.483 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T20:04:34.498 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T20:04:34.514 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T20:04:34.541 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T20:04:34.817 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T20:04:34.831 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T20:04:34.866 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T20:04:34.878 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-paste. 2023-11-28T20:04:34.893 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T20:04:34.935 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T20:04:35.169 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T20:04:35.184 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T20:04:35.227 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T20:04:35.256 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T20:04:35.270 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T20:04:35.313 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T20:04:35.539 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T20:04:35.554 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T20:04:35.597 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T20:04:35.608 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T20:04:35.624 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T20:04:35.666 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T20:04:35.908 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T20:04:35.923 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T20:04:35.966 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T20:04:35.969 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T20:04:35.985 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T20:04:36.019 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T20:04:36.313 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T20:04:36.313 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T20:04:36.328 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T20:04:36.328 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T20:04:36.362 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T20:04:36.372 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T20:04:36.674 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-idna. 2023-11-28T20:04:36.689 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T20:04:36.732 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T20:04:36.735 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T20:04:36.750 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T20:04:36.793 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T20:04:37.043 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T20:04:37.058 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T20:04:37.101 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T20:04:37.171 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-idna. 2023-11-28T20:04:37.186 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T20:04:37.230 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T20:04:37.446 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-requests. 2023-11-28T20:04:37.461 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T20:04:37.504 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T20:04:37.699 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T20:04:37.715 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T20:04:37.757 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T20:04:37.815 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T20:04:37.831 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T20:04:37.874 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T20:04:38.114 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-requests. 2023-11-28T20:04:38.125 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T20:04:38.169 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T20:04:38.480 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T20:04:38.496 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T20:04:38.518 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T20:04:38.533 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:38.538 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T20:04:38.576 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:38.841 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T20:04:38.856 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:38.899 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:38.964 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T20:04:38.979 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:39.022 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:39.267 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T20:04:39.279 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T20:04:39.282 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T20:04:39.294 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:39.329 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:39.340 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T20:04:39.624 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T20:04:39.638 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T20:04:39.644 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T20:04:39.659 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T20:04:39.682 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T20:04:39.702 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T20:04:39.985 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T20:04:40.000 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T20:04:40.033 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T20:04:40.043 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T20:04:40.048 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:40.082 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:40.371 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T20:04:40.387 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:40.421 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:40.477 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T20:04:40.492 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:40.535 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:40.774 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T20:04:40.790 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:40.832 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:41.297 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T20:04:41.312 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:41.355 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:41.646 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T20:04:41.661 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:41.704 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:42.533 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph. 2023-11-28T20:04:42.548 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../068-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:42.583 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:42.844 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T20:04:42.859 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:42.902 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:42.907 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph. 2023-11-28T20:04:42.923 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../068-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:42.966 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:43.255 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T20:04:43.268 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T20:04:43.270 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:43.283 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:43.322 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:43.327 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:43.708 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephadm. 2023-11-28T20:04:43.713 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T20:04:43.723 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../071-cephadm_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:43.728 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:43.766 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:43.771 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:44.061 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T20:04:44.076 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T20:04:44.110 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T20:04:44.124 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephadm. 2023-11-28T20:04:44.139 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../071-cephadm_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:44.174 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:44.413 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T20:04:44.428 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T20:04:44.443 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T20:04:44.458 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T20:04:44.488 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T20:04:44.501 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T20:04:44.829 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T20:04:44.844 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T20:04:44.881 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T20:04:45.491 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-babel. 2023-11-28T20:04:45.505 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T20:04:45.551 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T20:04:45.842 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-babel. 2023-11-28T20:04:45.853 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T20:04:45.856 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T20:04:45.867 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T20:04:45.912 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T20:04:45.936 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T20:04:46.273 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T20:04:46.278 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T20:04:46.287 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:46.292 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T20:04:46.331 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:46.336 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T20:04:46.656 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T20:04:46.671 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:46.684 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T20:04:46.699 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T20:04:46.714 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:46.742 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T20:04:47.029 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-routes. 2023-11-28T20:04:47.045 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T20:04:47.076 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T20:04:47.087 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T20:04:47.091 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T20:04:47.134 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T20:04:47.412 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-routes. 2023-11-28T20:04:47.427 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T20:04:47.440 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T20:04:47.455 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:47.461 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T20:04:47.498 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:47.932 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T20:04:47.934 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T20:04:47.947 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:47.949 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T20:04:47.981 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:47.993 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T20:04:48.434 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T20:04:48.450 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T20:04:48.493 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T20:04:48.697 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T20:04:48.724 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T20:04:48.761 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T20:04:48.988 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T20:04:49.003 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T20:04:49.047 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T20:04:49.099 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T20:04:49.114 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T20:04:49.226 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T20:04:49.424 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T20:04:49.439 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T20:04:49.512 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T20:04:49.527 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T20:04:49.560 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T20:04:49.570 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T20:04:49.838 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T20:04:49.853 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T20:04:49.896 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T20:04:50.254 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T20:04:50.268 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:50.304 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:50.580 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T20:04:50.594 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:50.638 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:51.299 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T20:04:51.314 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T20:04:51.357 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T20:04:51.575 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T20:04:51.590 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T20:04:51.633 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T20:04:51.660 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T20:04:51.675 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T20:04:51.718 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T20:04:51.911 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T20:04:51.927 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T20:04:51.969 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T20:04:52.088 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T20:04:52.103 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T20:04:52.146 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T20:04:52.256 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T20:04:52.273 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T20:04:52.306 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T20:04:52.440 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T20:04:52.456 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T20:04:52.507 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T20:04:52.634 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T20:04:52.649 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T20:04:52.717 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T20:04:52.786 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T20:04:52.801 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T20:04:52.835 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T20:04:53.046 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T20:04:53.062 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T20:04:53.104 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T20:04:53.155 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T20:04:53.170 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T20:04:53.205 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T20:04:53.390 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T20:04:53.406 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T20:04:53.440 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T20:04:53.466 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T20:04:53.481 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T20:04:53.524 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T20:04:53.727 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T20:04:53.742 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T20:04:53.785 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T20:04:53.837 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T20:04:53.852 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T20:04:53.919 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T20:04:54.122 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T20:04:54.138 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T20:04:54.180 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T20:04:54.516 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T20:04:54.531 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:54.566 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:54.885 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T20:04:54.886 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T20:04:54.899 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:54.900 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T20:04:54.977 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:54.977 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T20:04:55.296 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T20:04:55.312 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T20:04:55.313 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T20:04:55.327 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T20:04:55.354 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T20:04:55.371 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T20:04:55.607 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package jq. 2023-11-28T20:04:55.622 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T20:04:55.657 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T20:04:55.658 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T20:04:55.673 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T20:04:55.707 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T20:04:55.885 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package socat. 2023-11-28T20:04:55.899 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T20:04:55.943 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T20:04:55.943 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package jq. 2023-11-28T20:04:55.958 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T20:04:56.002 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T20:04:56.263 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T20:04:56.277 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T20:04:56.288 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package socat. 2023-11-28T20:04:56.303 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T20:04:56.321 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T20:04:56.346 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T20:04:56.632 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T20:04:56.648 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T20:04:56.667 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-test. 2023-11-28T20:04:56.681 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:56.682 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T20:04:56.725 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:57.028 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-test. 2023-11-28T20:04:57.042 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:57.086 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:58.571 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T20:04:58.586 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:58.629 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:59.065 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T20:04:59.081 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:59.115 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:59.249 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T20:04:59.265 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:59.307 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:59.502 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T20:04:59.517 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:04:59.552 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:04:59.594 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T20:04:59.610 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T20:04:59.643 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T20:04:59.847 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T20:04:59.862 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T20:04:59.896 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T20:04:59.905 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T20:04:59.911 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:04:59.954 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:00.166 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T20:05:00.180 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:05:00.190 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T20:05:00.205 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:05:00.224 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:00.248 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:00.493 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T20:05:00.508 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:05:00.526 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T20:05:00.541 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:05:00.578 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:00.583 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:00.829 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T20:05:00.844 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:05:00.870 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T20:05:00.885 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T20:05:00.887 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:00.919 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T20:05:01.165 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T20:05:01.180 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T20:05:01.182 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T20:05:01.198 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T20:05:01.214 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T20:05:01.232 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T20:05:01.544 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T20:05:01.559 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T20:05:01.602 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T20:05:01.628 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T20:05:01.643 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T20:05:01.686 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T20:05:02.082 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package pkg-config. 2023-11-28T20:05:02.097 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T20:05:02.114 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T20:05:02.130 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T20:05:02.149 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T20:05:02.173 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T20:05:02.402 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T20:05:02.417 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T20:05:02.477 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T20:05:02.578 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package pkg-config. 2023-11-28T20:05:02.593 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T20:05:02.636 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T20:05:02.888 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T20:05:02.897 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T20:05:02.903 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T20:05:02.913 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T20:05:02.946 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T20:05:02.972 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T20:05:03.190 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T20:05:03.206 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T20:05:03.240 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T20:05:03.375 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T20:05:03.390 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T20:05:03.433 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T20:05:03.577 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T20:05:03.592 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T20:05:03.626 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T20:05:03.719 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T20:05:03.735 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T20:05:03.777 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T20:05:03.904 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T20:05:03.920 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T20:05:03.963 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T20:05:04.156 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T20:05:04.172 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T20:05:04.214 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T20:05:04.299 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-py. 2023-11-28T20:05:04.314 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T20:05:04.357 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T20:05:04.525 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T20:05:04.541 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T20:05:04.583 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T20:05:04.711 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T20:05:04.728 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T20:05:04.768 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T20:05:04.911 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-py. 2023-11-28T20:05:04.930 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T20:05:04.978 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T20:05:05.155 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T20:05:05.171 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T20:05:05.205 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T20:05:05.298 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T20:05:05.314 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T20:05:05.356 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T20:05:05.533 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-toml. 2023-11-28T20:05:05.549 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T20:05:05.591 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T20:05:05.768 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T20:05:05.783 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T20:05:05.826 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T20:05:05.894 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T20:05:05.910 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T20:05:05.954 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T20:05:06.129 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-toml. 2023-11-28T20:05:06.144 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T20:05:06.212 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T20:05:06.297 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T20:05:06.313 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T20:05:06.355 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T20:05:06.507 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T20:05:06.521 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T20:05:06.557 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T20:05:06.642 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T20:05:06.657 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T20:05:06.699 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T20:05:06.893 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T20:05:06.908 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T20:05:06.951 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T20:05:07.229 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T20:05:07.244 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T20:05:07.321 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T20:05:07.428 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package radosgw. 2023-11-28T20:05:07.443 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../122-radosgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:05:07.486 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:08.072 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T20:05:08.075 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package radosgw. 2023-11-28T20:05:08.087 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:05:08.089 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../122-radosgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:05:08.124 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:08.130 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:08.424 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T20:05:08.694 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T20:05:08.719 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T20:05:08.733 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:05:08.777 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:08.803 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T20:05:09.037 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T20:05:09.053 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T20:05:09.307 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T20:05:09.427 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T20:05:09.433 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T20:05:09.680 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T20:05:10.057 INFO:teuthology.orchestra.run.smithi177.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T20:05:10.086 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T20:05:10.120 INFO:teuthology.orchestra.run.smithi177.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-28T20:05:10.163 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:10.732 INFO:teuthology.orchestra.run.smithi195.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T20:05:10.742 INFO:teuthology.orchestra.run.smithi177.stdout:Adding system user cephadm....done 2023-11-28T20:05:10.747 INFO:teuthology.orchestra.run.smithi195.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-28T20:05:10.785 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:10.910 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T20:05:11.186 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T20:05:11.314 INFO:teuthology.orchestra.run.smithi195.stdout:Adding system user cephadm....done 2023-11-28T20:05:11.429 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T20:05:11.475 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T20:05:11.547 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T20:05:11.759 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T20:05:11.807 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T20:05:12.044 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T20:05:12.074 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T20:05:12.178 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T20:05:12.200 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T20:05:12.439 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T20:05:12.518 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T20:05:12.730 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T20:05:12.848 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T20:05:12.878 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T20:05:13.121 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T20:05:13.150 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T20:05:13.381 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T20:05:13.518 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T20:05:13.674 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T20:05:13.836 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T20:05:13.925 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T20:05:14.138 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T20:05:14.185 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T20:05:14.431 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T20:05:14.452 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T20:05:14.695 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:14.715 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T20:05:14.967 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T20:05:14.988 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T20:05:15.097 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T20:05:15.223 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T20:05:15.251 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T20:05:15.508 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T20:05:15.518 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:15.634 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T20:05:15.786 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T20:05:15.901 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T20:05:15.912 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T20:05:16.038 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T20:05:16.285 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T20:05:16.306 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T20:05:16.307 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T20:05:16.362 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T20:05:16.449 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T20:05:16.463 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T20:05:16.700 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T20:05:16.840 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T20:05:16.974 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T20:05:17.171 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T20:05:17.205 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T20:05:17.250 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T20:05:17.262 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T20:05:17.387 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T20:05:17.535 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T20:05:17.764 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T20:05:17.877 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T20:05:17.889 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T20:05:18.029 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T20:05:18.157 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T20:05:18.442 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T20:05:18.747 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T20:05:18.751 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T20:05:18.877 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T20:05:19.031 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T20:05:19.141 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T20:05:19.250 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T20:05:19.551 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T20:05:19.572 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T20:05:19.847 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T20:05:19.952 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T20:05:19.973 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T20:05:20.101 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T20:05:20.195 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T20:05:20.400 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T20:05:20.572 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T20:05:20.810 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T20:05:20.873 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T20:05:21.103 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T20:05:21.232 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T20:05:21.504 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T20:05:21.584 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T20:05:21.805 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T20:05:21.843 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T20:05:22.002 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:22.123 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T20:05:22.303 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T20:05:22.475 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T20:05:22.638 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T20:05:22.734 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T20:05:22.860 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:23.170 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T20:05:23.512 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T20:05:23.869 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T20:05:24.136 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:05:24.271 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T20:05:24.564 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T20:05:24.689 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T20:05:24.735 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T20:05:24.818 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T20:05:24.997 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:05:25.111 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T20:05:25.131 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T20:05:25.379 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T20:05:25.425 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T20:05:25.549 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T20:05:25.629 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:05:25.675 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T20:05:25.755 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T20:05:25.977 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T20:05:26.098 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T20:05:26.253 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T20:05:26.358 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T20:05:26.529 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:05:26.626 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T20:05:26.664 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T20:05:26.885 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T20:05:26.974 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T20:05:27.144 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T20:05:27.233 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T20:05:27.404 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T20:05:27.500 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T20:05:27.530 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T20:05:27.768 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T20:05:27.814 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T20:05:27.940 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T20:05:28.028 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T20:05:28.233 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T20:05:28.303 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T20:05:28.438 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T20:05:28.534 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T20:05:28.747 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T20:05:28.785 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T20:05:28.874 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T20:05:28.911 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T20:05:29.037 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T20:05:29.151 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T20:05:29.176 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T20:05:29.389 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T20:05:29.476 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T20:05:29.516 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T20:05:29.735 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T20:05:29.886 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T20:05:29.983 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T20:05:30.014 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T20:05:30.102 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T20:05:30.259 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T20:05:30.342 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T20:05:30.385 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T20:05:30.465 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T20:05:30.653 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:05:30.778 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T20:05:30.867 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T20:05:31.104 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T20:05:31.135 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T20:05:31.260 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T20:05:31.439 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T20:05:31.536 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:05:31.662 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T20:05:31.716 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T20:05:31.918 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T20:05:31.981 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T20:05:32.169 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T20:05:32.290 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T20:05:32.445 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T20:05:32.565 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T20:05:32.705 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T20:05:32.902 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T20:05:33.090 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T20:05:33.178 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T20:05:33.375 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T20:05:33.471 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T20:05:33.723 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T20:05:33.729 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T20:05:33.829 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:33.929 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:34.055 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T20:05:34.416 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:34.457 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T20:05:34.542 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:34.668 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T20:05:34.751 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T20:05:34.945 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:35.071 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:35.103 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T20:05:35.196 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:35.229 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:35.330 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:35.434 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T20:05:35.434 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T20:05:35.456 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T20:05:35.817 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:35.944 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:36.047 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:36.070 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T20:05:36.156 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:36.266 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:36.363 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:36.417 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:36.480 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:36.543 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T20:05:36.631 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:36.842 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T20:05:36.842 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T20:05:37.491 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:37.617 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:37.768 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:37.821 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:37.894 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:37.947 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T20:05:38.065 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:38.174 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:38.292 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:38.451 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:38.988 INFO:teuthology.orchestra.run.smithi177.stdout:Adding group ceph....done 2023-11-28T20:05:39.299 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:39.388 INFO:teuthology.orchestra.run.smithi177.stdout:Adding system user ceph....done 2023-11-28T20:05:39.426 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:39.550 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:39.567 INFO:teuthology.orchestra.run.smithi177.stdout:Setting system user ceph properties....done 2023-11-28T20:05:39.583 INFO:teuthology.orchestra.run.smithi177.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T20:05:39.676 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:39.724 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T20:05:39.803 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:39.937 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:40.121 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T20:05:40.499 INFO:teuthology.orchestra.run.smithi195.stdout:Adding group ceph....done 2023-11-28T20:05:40.810 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:40.841 INFO:teuthology.orchestra.run.smithi195.stdout:Adding system user ceph....done 2023-11-28T20:05:41.022 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T20:05:41.023 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T20:05:41.028 INFO:teuthology.orchestra.run.smithi195.stdout:Setting system user ceph properties....done 2023-11-28T20:05:41.048 INFO:teuthology.orchestra.run.smithi195.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T20:05:41.188 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T20:05:41.601 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T20:05:41.722 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:41.966 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:42.288 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:42.481 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T20:05:42.481 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T20:05:42.589 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T20:05:42.589 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T20:05:43.089 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:43.199 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:43.247 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:43.607 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T20:05:43.741 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T20:05:43.741 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T20:05:44.274 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:44.343 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:44.515 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T20:05:44.515 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T20:05:44.725 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T20:05:45.201 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:45.353 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:45.585 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T20:05:45.585 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T20:05:45.880 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T20:05:45.880 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T20:05:46.196 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:46.401 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T20:05:46.402 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T20:05:46.532 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:46.850 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T20:05:46.850 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T20:05:47.006 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:47.420 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T20:05:47.420 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T20:05:47.434 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:47.559 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:47.702 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:47.910 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T20:05:47.910 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T20:05:48.049 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:48.175 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:48.318 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:48.527 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T20:05:48.527 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T20:05:48.545 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:48.688 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:48.813 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:48.990 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:49.177 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:49.320 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:49.334 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T20:05:49.443 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T20:05:49.543 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:49.595 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T20:05:49.666 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:05:50.046 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T20:05:50.151 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T20:05:50.287 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T20:05:50.395 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T20:05:51.264 INFO:teuthology.orchestra.run.smithi177.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T20:05:51.269 DEBUG:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T20:05:51.349 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2023-11-28T20:05:51.437 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T20:05:51.514 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2023-11-28T20:05:51.515 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2023-11-28T20:05:51.664 INFO:teuthology.orchestra.run.smithi177.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T20:05:51.664 INFO:teuthology.orchestra.run.smithi177.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T20:05:51.664 INFO:teuthology.orchestra.run.smithi177.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T20:05:51.664 INFO:teuthology.orchestra.run.smithi177.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T20:05:51.664 INFO:teuthology.orchestra.run.smithi177.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T20:05:51.665 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T20:05:51.665 INFO:teuthology.orchestra.run.smithi177.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T20:05:51.665 INFO:teuthology.orchestra.run.smithi177.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T20:05:51.665 INFO:teuthology.orchestra.run.smithi177.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T20:05:51.665 INFO:teuthology.orchestra.run.smithi177.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T20:05:51.666 INFO:teuthology.orchestra.run.smithi177.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T20:05:51.666 INFO:teuthology.orchestra.run.smithi177.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T20:05:51.666 INFO:teuthology.orchestra.run.smithi177.stdout:The following additional packages will be installed: 2023-11-28T20:05:51.666 INFO:teuthology.orchestra.run.smithi177.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T20:05:51.666 INFO:teuthology.orchestra.run.smithi177.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T20:05:51.667 INFO:teuthology.orchestra.run.smithi177.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T20:05:51.667 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T20:05:51.667 INFO:teuthology.orchestra.run.smithi177.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T20:05:51.667 INFO:teuthology.orchestra.run.smithi177.stdout:Suggested packages: 2023-11-28T20:05:51.667 INFO:teuthology.orchestra.run.smithi177.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T20:05:51.667 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T20:05:51.667 INFO:teuthology.orchestra.run.smithi177.stdout: libengine-pkcs11-openssl 2023-11-28T20:05:51.716 INFO:teuthology.orchestra.run.smithi177.stdout:The following NEW packages will be installed: 2023-11-28T20:05:51.717 INFO:teuthology.orchestra.run.smithi177.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T20:05:51.717 INFO:teuthology.orchestra.run.smithi177.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T20:05:51.718 INFO:teuthology.orchestra.run.smithi177.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T20:05:51.718 INFO:teuthology.orchestra.run.smithi177.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T20:05:51.718 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T20:05:51.718 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T20:05:51.718 INFO:teuthology.orchestra.run.smithi177.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T20:05:51.719 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages will be upgraded: 2023-11-28T20:05:51.720 INFO:teuthology.orchestra.run.smithi177.stdout: libssl3 2023-11-28T20:05:51.904 INFO:teuthology.orchestra.run.smithi177.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T20:05:51.905 INFO:teuthology.orchestra.run.smithi177.stdout:Need to get 54.6 MB of archives. 2023-11-28T20:05:51.905 INFO:teuthology.orchestra.run.smithi177.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T20:05:51.905 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T20:05:52.096 INFO:teuthology.orchestra.run.smithi195.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T20:05:52.101 DEBUG:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T20:05:52.176 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2023-11-28T20:05:52.343 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2023-11-28T20:05:52.343 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2023-11-28T20:05:52.400 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T20:05:52.495 INFO:teuthology.orchestra.run.smithi195.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T20:05:52.495 INFO:teuthology.orchestra.run.smithi195.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T20:05:52.495 INFO:teuthology.orchestra.run.smithi195.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T20:05:52.495 INFO:teuthology.orchestra.run.smithi195.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T20:05:52.495 INFO:teuthology.orchestra.run.smithi195.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T20:05:52.495 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T20:05:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T20:05:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T20:05:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T20:05:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T20:05:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T20:05:52.497 INFO:teuthology.orchestra.run.smithi195.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T20:05:52.497 INFO:teuthology.orchestra.run.smithi195.stdout:The following additional packages will be installed: 2023-11-28T20:05:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T20:05:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T20:05:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T20:05:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T20:05:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T20:05:52.498 INFO:teuthology.orchestra.run.smithi195.stdout:Suggested packages: 2023-11-28T20:05:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T20:05:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T20:05:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: libengine-pkcs11-openssl 2023-11-28T20:05:52.548 INFO:teuthology.orchestra.run.smithi195.stdout:The following NEW packages will be installed: 2023-11-28T20:05:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T20:05:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T20:05:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T20:05:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T20:05:52.549 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T20:05:52.549 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T20:05:52.549 INFO:teuthology.orchestra.run.smithi195.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T20:05:52.550 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages will be upgraded: 2023-11-28T20:05:52.550 INFO:teuthology.orchestra.run.smithi195.stdout: libssl3 2023-11-28T20:05:52.610 INFO:teuthology.orchestra.run.smithi195.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T20:05:52.610 INFO:teuthology.orchestra.run.smithi195.stdout:Need to get 54.6 MB of archives. 2023-11-28T20:05:52.610 INFO:teuthology.orchestra.run.smithi195.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T20:05:52.610 INFO:teuthology.orchestra.run.smithi195.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T20:05:52.658 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T20:05:52.691 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T20:05:52.693 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T20:05:52.698 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T20:05:52.701 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T20:05:52.703 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T20:05:52.706 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T20:05:52.708 INFO:teuthology.orchestra.run.smithi177.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T20:05:52.728 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T20:05:52.791 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T20:05:52.805 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T20:05:52.805 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T20:05:52.806 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T20:05:52.806 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T20:05:52.807 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T20:05:52.808 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T20:05:52.809 INFO:teuthology.orchestra.run.smithi195.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T20:05:52.810 INFO:teuthology.orchestra.run.smithi195.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T20:05:52.813 INFO:teuthology.orchestra.run.smithi195.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T20:05:52.829 INFO:teuthology.orchestra.run.smithi195.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T20:05:52.873 INFO:teuthology.orchestra.run.smithi177.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T20:05:52.873 INFO:teuthology.orchestra.run.smithi177.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T20:05:53.124 INFO:teuthology.orchestra.run.smithi177.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T20:05:53.140 INFO:teuthology.orchestra.run.smithi195.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T20:05:53.140 INFO:teuthology.orchestra.run.smithi195.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T20:05:53.141 INFO:teuthology.orchestra.run.smithi195.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T20:05:53.144 INFO:teuthology.orchestra.run.smithi195.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T20:05:53.144 INFO:teuthology.orchestra.run.smithi195.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T20:05:53.148 INFO:teuthology.orchestra.run.smithi195.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T20:05:53.150 INFO:teuthology.orchestra.run.smithi195.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T20:05:53.157 INFO:teuthology.orchestra.run.smithi195.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T20:05:53.158 INFO:teuthology.orchestra.run.smithi195.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T20:05:53.180 INFO:teuthology.orchestra.run.smithi195.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T20:05:53.180 INFO:teuthology.orchestra.run.smithi195.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T20:05:53.203 INFO:teuthology.orchestra.run.smithi195.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T20:05:53.255 INFO:teuthology.orchestra.run.smithi195.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T20:05:53.258 INFO:teuthology.orchestra.run.smithi195.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T20:05:53.259 INFO:teuthology.orchestra.run.smithi195.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T20:05:53.259 INFO:teuthology.orchestra.run.smithi195.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T20:05:53.260 INFO:teuthology.orchestra.run.smithi195.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T20:05:53.271 INFO:teuthology.orchestra.run.smithi195.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T20:05:53.273 INFO:teuthology.orchestra.run.smithi195.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T20:05:53.451 INFO:teuthology.orchestra.run.smithi195.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T20:05:53.452 INFO:teuthology.orchestra.run.smithi195.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T20:05:53.452 INFO:teuthology.orchestra.run.smithi195.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T20:05:53.452 INFO:teuthology.orchestra.run.smithi195.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T20:05:53.452 INFO:teuthology.orchestra.run.smithi195.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T20:05:53.452 INFO:teuthology.orchestra.run.smithi195.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T20:05:53.466 INFO:teuthology.orchestra.run.smithi195.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T20:05:53.467 INFO:teuthology.orchestra.run.smithi195.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T20:05:53.845 INFO:teuthology.orchestra.run.smithi195.stdout:Preconfiguring packages ... 2023-11-28T20:05:53.986 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 54.6 MB in 1s (60.0 MB/s) 2023-11-28T20:05:54.127 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package flex. 2023-11-28T20:05:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T20:05:54.135 INFO:teuthology.orchestra.run.smithi177.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T20:05:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T20:05:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T20:05:54.160 INFO:teuthology.orchestra.run.smithi177.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T20:05:54.163 INFO:teuthology.orchestra.run.smithi177.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T20:05:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T20:05:54.196 INFO:teuthology.orchestra.run.smithi177.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T20:05:54.198 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140565 files and directories currently installed.) 2023-11-28T20:05:54.202 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T20:05:54.242 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T20:05:54.360 INFO:teuthology.orchestra.run.smithi177.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T20:05:54.947 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T20:05:55.097 INFO:teuthology.orchestra.run.smithi177.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T20:05:55.097 INFO:teuthology.orchestra.run.smithi177.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T20:05:55.124 INFO:teuthology.orchestra.run.smithi177.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T20:05:55.125 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T20:05:55.201 INFO:teuthology.orchestra.run.smithi177.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T20:05:55.209 INFO:teuthology.orchestra.run.smithi177.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T20:05:55.209 INFO:teuthology.orchestra.run.smithi177.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T20:05:55.210 INFO:teuthology.orchestra.run.smithi177.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T20:05:55.211 INFO:teuthology.orchestra.run.smithi177.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T20:05:55.239 INFO:teuthology.orchestra.run.smithi177.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T20:05:55.243 INFO:teuthology.orchestra.run.smithi177.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T20:05:55.523 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T20:05:55.868 INFO:teuthology.orchestra.run.smithi177.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T20:05:55.951 INFO:teuthology.orchestra.run.smithi177.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T20:05:55.951 INFO:teuthology.orchestra.run.smithi177.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T20:05:55.954 INFO:teuthology.orchestra.run.smithi177.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T20:05:56.042 INFO:teuthology.orchestra.run.smithi177.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T20:05:56.051 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package bison. 2023-11-28T20:05:56.055 INFO:teuthology.orchestra.run.smithi177.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T20:05:56.124 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140638 files and directories currently installed.) 2023-11-28T20:05:56.127 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T20:05:56.178 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T20:05:56.513 INFO:teuthology.orchestra.run.smithi177.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T20:05:56.515 INFO:teuthology.orchestra.run.smithi177.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T20:05:56.545 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T20:05:56.560 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T20:05:56.604 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T20:05:56.900 INFO:teuthology.orchestra.run.smithi177.stdout:Preconfiguring packages ... 2023-11-28T20:05:56.982 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package dump. 2023-11-28T20:05:56.997 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T20:05:57.040 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T20:05:57.044 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 54.6 MB in 5s (11.4 MB/s) 2023-11-28T20:05:57.195 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package flex. 2023-11-28T20:05:57.267 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140565 files and directories currently installed.) 2023-11-28T20:05:57.271 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T20:05:57.318 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T20:05:57.319 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package indent. 2023-11-28T20:05:57.333 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:05:57.369 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T20:05:57.588 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T20:05:57.604 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T20:05:57.638 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T20:05:57.845 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T20:05:57.992 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T20:05:58.007 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T20:05:58.015 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T20:05:58.050 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T20:05:58.311 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T20:05:58.327 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T20:05:58.369 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T20:05:58.431 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T20:05:58.714 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T20:05:58.730 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T20:05:58.764 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T20:05:58.974 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package bison. 2023-11-28T20:05:58.983 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T20:05:58.999 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T20:05:59.041 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T20:05:59.047 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140638 files and directories currently installed.) 2023-11-28T20:05:59.051 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T20:05:59.093 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T20:05:59.311 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T20:05:59.326 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T20:05:59.369 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T20:05:59.527 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T20:05:59.541 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T20:05:59.585 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T20:05:59.723 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T20:05:59.739 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T20:05:59.781 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T20:05:59.904 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package dump. 2023-11-28T20:05:59.919 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T20:05:59.954 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T20:06:00.233 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package indent. 2023-11-28T20:06:00.248 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:06:00.300 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T20:06:00.569 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T20:06:00.584 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T20:06:00.627 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T20:06:01.100 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T20:06:01.116 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T20:06:01.151 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:06:01.267 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T20:06:01.272 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T20:06:01.323 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T20:06:01.419 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T20:06:01.435 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T20:06:01.478 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:06:01.566 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T20:06:01.582 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T20:06:01.616 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T20:06:01.805 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T20:06:01.821 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T20:06:01.864 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:06:01.927 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T20:06:01.943 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T20:06:01.986 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T20:06:02.183 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T20:06:02.199 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T20:06:02.238 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T20:06:02.241 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T20:06:02.254 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T20:06:02.321 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T20:06:02.577 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T20:06:02.582 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T20:06:02.593 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T20:06:02.598 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T20:06:02.627 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T20:06:02.632 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T20:06:02.885 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T20:06:02.901 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T20:06:02.943 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T20:06:02.964 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T20:06:02.979 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:06:03.022 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:06:03.375 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T20:06:03.391 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:06:03.433 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:06:03.735 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T20:06:03.750 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:06:03.785 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:06:04.013 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T20:06:04.028 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T20:06:04.071 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T20:06:04.254 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T20:06:04.270 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T20:06:04.312 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:06:04.525 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T20:06:04.539 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T20:06:04.583 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T20:06:04.606 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T20:06:04.622 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T20:06:04.665 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:06:04.934 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T20:06:04.950 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T20:06:04.984 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:06:05.303 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T20:06:05.319 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T20:06:05.361 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T20:06:05.379 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package modemmanager. 2023-11-28T20:06:05.395 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T20:06:05.438 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:06:05.714 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T20:06:05.730 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T20:06:05.773 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T20:06:06.092 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T20:06:06.108 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:06:06.127 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package network-manager. 2023-11-28T20:06:06.143 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T20:06:06.151 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:06:06.194 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T20:06:06.503 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T20:06:06.523 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:06:06.562 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:06:06.818 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ppp. 2023-11-28T20:06:06.834 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T20:06:06.848 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T20:06:06.864 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:06:06.905 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:06:07.158 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T20:06:07.174 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T20:06:07.180 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T20:06:07.219 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T20:06:07.514 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T20:06:07.528 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T20:06:07.572 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T20:06:07.769 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T20:06:07.785 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T20:06:07.800 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T20:06:07.814 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T20:06:07.829 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T20:06:07.850 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T20:06:08.178 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T20:06:08.180 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package modemmanager. 2023-11-28T20:06:08.192 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T20:06:08.196 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T20:06:08.239 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T20:06:08.240 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:06:08.523 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T20:06:08.537 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:06:08.581 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:06:08.894 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package network-manager. 2023-11-28T20:06:08.910 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T20:06:08.961 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T20:06:09.111 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T20:06:09.126 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T20:06:09.187 INFO:teuthology.orchestra.run.smithi195.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T20:06:09.219 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-common (238) ... 2023-11-28T20:06:09.576 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ppp. 2023-11-28T20:06:09.592 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T20:06:09.635 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T20:06:09.650 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:06:09.688 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:06:09.951 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T20:06:10.280 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T20:06:10.295 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T20:06:10.339 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T20:06:10.703 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T20:06:10.715 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T20:06:10.750 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T20:06:11.006 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql. 2023-11-28T20:06:11.011 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T20:06:11.021 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T20:06:11.027 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T20:06:11.056 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql (14+238) ... 2023-11-28T20:06:11.070 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T20:06:11.283 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T20:06:11.297 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T20:06:11.342 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T20:06:11.373 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T20:06:11.388 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:06:11.422 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:06:11.585 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T20:06:11.600 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T20:06:11.644 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T20:06:11.979 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T20:06:11.994 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T20:06:12.036 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T20:06:12.037 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T20:06:12.051 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T20:06:12.112 INFO:teuthology.orchestra.run.smithi177.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T20:06:12.139 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-common (238) ... 2023-11-28T20:06:12.316 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package tcl. 2023-11-28T20:06:12.331 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T20:06:12.370 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T20:06:12.626 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T20:06:12.641 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:06:12.685 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T20:06:12.687 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:06:12.701 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T20:06:12.743 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T20:06:13.108 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T20:06:13.124 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T20:06:13.158 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T20:06:13.486 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T20:06:13.502 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T20:06:13.553 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T20:06:13.754 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql. 2023-11-28T20:06:13.769 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T20:06:13.812 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql (14+238) ... 2023-11-28T20:06:13.839 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T20:06:14.047 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T20:06:14.062 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T20:06:14.097 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T20:06:14.100 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T20:06:14.226 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T20:06:14.307 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T20:06:14.322 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T20:06:14.353 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:06:14.374 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T20:06:14.478 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T20:06:14.579 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T20:06:14.702 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T20:06:14.705 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:06:14.718 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T20:06:14.760 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T20:06:15.045 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package tcl. 2023-11-28T20:06:15.061 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T20:06:15.109 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T20:06:15.431 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T20:06:15.448 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T20:06:15.490 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T20:06:15.708 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T20:06:15.811 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T20:06:15.863 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T20:06:15.879 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T20:06:15.921 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T20:06:16.165 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T20:06:16.165 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T20:06:16.299 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T20:06:16.315 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T20:06:16.366 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T20:06:16.643 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T20:06:16.863 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T20:06:16.879 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T20:06:16.989 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T20:06:16.997 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T20:06:17.106 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:06:17.115 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T20:06:17.233 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T20:06:17.250 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T20:06:17.358 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T20:06:17.401 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T20:06:17.484 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:06:17.510 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T20:06:17.620 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T20:06:18.383 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T20:06:18.502 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T20:06:18.534 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T20:06:18.605 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T20:06:18.630 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T20:06:18.686 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:06:18.804 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T20:06:18.930 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T20:06:18.986 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T20:06:18.986 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T20:06:19.056 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T20:06:19.182 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T20:06:19.271 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T20:06:19.350 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T20:06:19.476 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T20:06:19.661 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T20:06:19.674 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T20:06:19.762 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:06:19.783 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T20:06:19.888 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T20:06:19.935 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T20:06:20.044 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T20:06:20.055 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T20:06:20.170 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T20:06:20.182 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T20:06:20.296 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T20:06:20.422 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T20:06:20.807 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:20.807 INFO:teuthology.orchestra.run.smithi195.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T20:06:20.807 INFO:teuthology.orchestra.run.smithi195.stdout:which means they are currently configured by ifupdown: 2023-11-28T20:06:20.807 INFO:teuthology.orchestra.run.smithi195.stdout:- enp3s0f1 2023-11-28T20:06:20.807 INFO:teuthology.orchestra.run.smithi195.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T20:06:20.807 INFO:teuthology.orchestra.run.smithi195.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T20:06:20.807 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:20.941 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T20:06:21.135 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T20:06:21.253 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T20:06:21.334 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T20:06:21.348 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T20:06:21.404 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:06:21.530 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T20:06:21.731 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T20:06:21.974 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T20:06:22.124 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T20:06:22.242 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T20:06:22.315 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T20:06:22.377 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T20:06:22.401 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:06:22.486 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T20:06:22.528 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T20:06:22.637 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T20:06:22.663 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T20:06:22.763 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-common (238) ... 2023-11-28T20:06:22.788 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:06:22.914 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T20:06:23.107 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T20:06:23.233 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T20:06:23.744 INFO:teuthology.orchestra.run.smithi195.stdout:Adding user postgres to group ssl-cert 2023-11-28T20:06:23.778 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:23.778 INFO:teuthology.orchestra.run.smithi177.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T20:06:23.779 INFO:teuthology.orchestra.run.smithi177.stdout:which means they are currently configured by ifupdown: 2023-11-28T20:06:23.779 INFO:teuthology.orchestra.run.smithi177.stdout:- enp3s0f1 2023-11-28T20:06:23.779 INFO:teuthology.orchestra.run.smithi177.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T20:06:23.779 INFO:teuthology.orchestra.run.smithi177.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T20:06:23.779 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:23.911 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T20:06:24.038 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:24.039 INFO:teuthology.orchestra.run.smithi195.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T20:06:24.309 INFO:teuthology.orchestra.run.smithi195.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T20:06:24.309 INFO:teuthology.orchestra.run.smithi195.stdout:Removing obsolete dictionary files: 2023-11-28T20:06:24.315 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T20:06:24.740 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T20:06:25.045 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T20:06:25.461 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:06:25.531 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:06:25.612 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T20:06:25.738 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T20:06:25.864 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-common (238) ... 2023-11-28T20:06:25.877 INFO:teuthology.orchestra.run.smithi195.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T20:06:25.894 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T20:06:25.947 INFO:teuthology.orchestra.run.smithi195.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T20:06:25.947 INFO:teuthology.orchestra.run.smithi195.stdout:This user must also own the server process. 2023-11-28T20:06:25.947 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:25.947 INFO:teuthology.orchestra.run.smithi195.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T20:06:25.947 INFO:teuthology.orchestra.run.smithi195.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T20:06:25.947 INFO:teuthology.orchestra.run.smithi195.stdout:The default text search configuration will be set to "english". 2023-11-28T20:06:25.948 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:25.948 INFO:teuthology.orchestra.run.smithi195.stdout:Data page checksums are disabled. 2023-11-28T20:06:25.948 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:25.948 INFO:teuthology.orchestra.run.smithi195.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T20:06:25.948 INFO:teuthology.orchestra.run.smithi195.stdout:creating subdirectories ... ok 2023-11-28T20:06:25.948 INFO:teuthology.orchestra.run.smithi195.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T20:06:25.973 INFO:teuthology.orchestra.run.smithi195.stdout:selecting default max_connections ... 100 2023-11-28T20:06:26.008 INFO:teuthology.orchestra.run.smithi195.stdout:selecting default shared_buffers ... 128MB 2023-11-28T20:06:26.022 INFO:teuthology.orchestra.run.smithi195.stdout:selecting default time zone ... Etc/UTC 2023-11-28T20:06:26.023 INFO:teuthology.orchestra.run.smithi195.stdout:creating configuration files ... ok 2023-11-28T20:06:26.190 INFO:teuthology.orchestra.run.smithi195.stdout:running bootstrap script ... ok 2023-11-28T20:06:26.744 INFO:teuthology.orchestra.run.smithi177.stdout:Adding user postgres to group ssl-cert 2023-11-28T20:06:26.831 INFO:teuthology.orchestra.run.smithi195.stdout:performing post-bootstrap initialization ... ok 2023-11-28T20:06:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:26.995 INFO:teuthology.orchestra.run.smithi177.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T20:06:27.266 INFO:teuthology.orchestra.run.smithi177.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T20:06:27.266 INFO:teuthology.orchestra.run.smithi177.stdout:Removing obsolete dictionary files: 2023-11-28T20:06:27.395 INFO:teuthology.orchestra.run.smithi195.stdout:syncing data to disk ... ok 2023-11-28T20:06:27.932 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T20:06:27.987 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T20:06:28.449 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:06:28.791 INFO:teuthology.orchestra.run.smithi177.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T20:06:28.813 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T20:06:28.875 INFO:teuthology.orchestra.run.smithi177.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T20:06:28.875 INFO:teuthology.orchestra.run.smithi177.stdout:This user must also own the server process. 2023-11-28T20:06:28.875 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:28.875 INFO:teuthology.orchestra.run.smithi177.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T20:06:28.875 INFO:teuthology.orchestra.run.smithi177.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T20:06:28.875 INFO:teuthology.orchestra.run.smithi177.stdout:The default text search configuration will be set to "english". 2023-11-28T20:06:28.875 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:28.876 INFO:teuthology.orchestra.run.smithi177.stdout:Data page checksums are disabled. 2023-11-28T20:06:28.876 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:28.876 INFO:teuthology.orchestra.run.smithi177.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T20:06:28.876 INFO:teuthology.orchestra.run.smithi177.stdout:creating subdirectories ... ok 2023-11-28T20:06:28.877 INFO:teuthology.orchestra.run.smithi177.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T20:06:28.901 INFO:teuthology.orchestra.run.smithi177.stdout:selecting default max_connections ... 100 2023-11-28T20:06:28.936 INFO:teuthology.orchestra.run.smithi177.stdout:selecting default shared_buffers ... 128MB 2023-11-28T20:06:28.949 INFO:teuthology.orchestra.run.smithi177.stdout:selecting default time zone ... Etc/UTC 2023-11-28T20:06:28.951 INFO:teuthology.orchestra.run.smithi177.stdout:creating configuration files ... ok 2023-11-28T20:06:29.118 INFO:teuthology.orchestra.run.smithi177.stdout:running bootstrap script ... ok 2023-11-28T20:06:29.740 INFO:teuthology.orchestra.run.smithi177.stdout:performing post-bootstrap initialization ... ok 2023-11-28T20:06:30.297 INFO:teuthology.orchestra.run.smithi177.stdout:syncing data to disk ... ok 2023-11-28T20:06:30.823 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T20:06:31.305 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:06:31.448 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T20:06:31.583 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql (14+238) ... 2023-11-28T20:06:31.709 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:06:31.834 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:06:32.079 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T20:06:32.079 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T20:06:32.803 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T20:06:33.156 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T20:06:33.307 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T20:06:34.282 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:06:34.408 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T20:06:34.526 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql (14+238) ... 2023-11-28T20:06:34.626 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:06:34.761 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:06:34.910 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T20:06:35.010 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T20:06:35.023 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T20:06:35.023 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T20:06:35.539 INFO:teuthology.orchestra.run.smithi195.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T20:06:35.544 DEBUG:teuthology.parallel:result is None 2023-11-28T20:06:35.797 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T20:06:36.090 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T20:06:36.241 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T20:06:37.652 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T20:06:37.764 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T20:06:38.305 INFO:teuthology.orchestra.run.smithi177.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T20:06:38.310 DEBUG:teuthology.parallel:result is None 2023-11-28T20:06:38.310 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T20:06:38.540 DEBUG:teuthology.orchestra.run.smithi177:> dpkg-query -W -f '${Version}' ceph 2023-11-28T20:06:38.563 INFO:teuthology.orchestra.run.smithi177.stdout:18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:06:38.563 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:06:38.564 INFO:teuthology.task.install:The correct ceph version 18.0.0-7520-g43dd94c1-1jammy is installed. 2023-11-28T20:06:38.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T20:06:38.704 DEBUG:teuthology.orchestra.run.smithi195:> dpkg-query -W -f '${Version}' ceph 2023-11-28T20:06:38.728 INFO:teuthology.orchestra.run.smithi195.stdout:18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:06:38.728 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:06:38.729 INFO:teuthology.task.install:The correct ceph version 18.0.0-7520-g43dd94c1-1jammy is installed. 2023-11-28T20:06:38.729 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-28T20:06:38.729 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:06:38.729 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T20:06:38.749 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:06:38.750 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T20:06:38.794 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-28T20:06:38.795 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:06:38.795 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T20:06:38.816 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T20:06:38.875 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:06:38.875 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T20:06:38.897 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T20:06:38.961 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-28T20:06:38.962 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:06:38.962 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T20:06:38.981 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T20:06:39.047 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:06:39.047 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T20:06:39.069 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T20:06:39.137 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-28T20:06:39.137 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:06:39.137 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T20:06:39.157 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T20:06:39.219 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:06:39.219 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T20:06:39.241 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T20:06:39.309 INFO:teuthology.run_tasks:Running task ceph... 2023-11-28T20:06:39.378 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-28T20:06:39.378 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /var/log/ceph 2023-11-28T20:06:39.381 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /var/log/ceph 2023-11-28T20:06:39.402 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-28T20:06:39.403 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T20:06:39.447 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T20:06:39.469 INFO:tasks.ceph:Creating extra log directories... 2023-11-28T20:06:39.469 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T20:06:39.511 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T20:06:39.540 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-28T20:06:39.540 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-28T20:06:39.541 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-28T20:06:39.541 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:06:39.541 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T20:06:39.576 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T20:06:39.666 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:06:39.666 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T20:06:39.675 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T20:06:39.772 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-28T20:06:39.772 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-28T20:06:39.772 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605', 'branch': 'wip-vshankar-testing-20231127.102914', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7469605', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231127.102914'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231127.102914', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8377, 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883', 'sleep_before_teardown': 0, 'subset': '462/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231127.102914', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi177.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNG5hiQFnJ4gtpvfs7YXc46kQcnXOasbcwzL+wbhtoHrXbIkph1cnZ8n9wZNaM1J7rCf1aJw/Yfr/13xFrRbPzs=', 'smithi195.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOIS6rIumPiJ6Sp4OTvaRqO4GCUWKCqb9GBqTbweN5XA4BCdPLi56uUaPt7GsXPZSWi3EZMim5joCl2RIgM2J7A='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '5ae09a5cc7064ca2bf994df19f3006b79794789a', 'timestamp': '2023-11-28_06:29:14', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-28T20:06:39.773 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T20:06:39.777 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T20:06:39.786 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T20:06:39.827 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T20:06:39.853 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:06:39.853 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T20:06:39.896 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T20:06:39.896 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2023-11-28T20:06:39.948 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T20:06:39.949 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:06:39.949 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 890 Links: 1 2023-11-28T20:06:39.949 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:06:39.949 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-11-28 19:59:58.650307096 +0000 2023-11-28T20:06:39.949 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-11-28 19:59:58.274310454 +0000 2023-11-28T20:06:39.949 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-11-28 19:59:58.274310454 +0000 2023-11-28T20:06:39.949 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2023-11-28 19:59:58.274310454 +0000 2023-11-28T20:06:39.949 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T20:06:40.010 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-11-28T20:06:40.010 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-11-28T20:06:40.010 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000354897 s, 1.4 MB/s 2023-11-28T20:06:40.011 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T20:06:40.062 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2023-11-28T20:06:40.112 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T20:06:40.113 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:06:40.113 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 906 Links: 1 2023-11-28T20:06:40.113 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:06:40.113 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-11-28 19:59:59.302301272 +0000 2023-11-28T20:06:40.113 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-11-28 19:59:58.898304881 +0000 2023-11-28T20:06:40.113 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-11-28 19:59:58.898304881 +0000 2023-11-28T20:06:40.113 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2023-11-28 19:59:58.898304881 +0000 2023-11-28T20:06:40.113 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T20:06:40.178 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-11-28T20:06:40.178 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-11-28T20:06:40.178 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000352512 s, 1.5 MB/s 2023-11-28T20:06:40.179 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T20:06:40.230 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2023-11-28T20:06:40.284 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T20:06:40.285 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:06:40.285 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 923 Links: 1 2023-11-28T20:06:40.285 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:06:40.285 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-11-28 19:59:59.986295163 +0000 2023-11-28T20:06:40.285 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-11-28 19:59:59.590298700 +0000 2023-11-28T20:06:40.285 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-11-28 19:59:59.590298700 +0000 2023-11-28T20:06:40.285 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2023-11-28 19:59:59.590298700 +0000 2023-11-28T20:06:40.285 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T20:06:40.345 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-11-28T20:06:40.346 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-11-28T20:06:40.346 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000348625 s, 1.5 MB/s 2023-11-28T20:06:40.347 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T20:06:40.402 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2023-11-28T20:06:40.456 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T20:06:40.456 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:06:40.457 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 941 Links: 1 2023-11-28T20:06:40.457 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:06:40.457 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-11-28 20:00:00.678288982 +0000 2023-11-28T20:06:40.457 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-11-28 20:00:00.290292447 +0000 2023-11-28T20:06:40.457 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-11-28 20:00:00.290292447 +0000 2023-11-28T20:06:40.457 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2023-11-28 20:00:00.290292447 +0000 2023-11-28T20:06:40.458 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T20:06:40.521 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-11-28T20:06:40.522 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-11-28T20:06:40.522 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.00036007 s, 1.4 MB/s 2023-11-28T20:06:40.523 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T20:06:40.578 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T20:06:40.578 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:06:40.578 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T20:06:40.588 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T20:06:40.588 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2023-11-28T20:06:40.641 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T20:06:40.641 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:06:40.641 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 890 Links: 1 2023-11-28T20:06:40.641 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:06:40.642 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-11-28 19:59:59.623496066 +0000 2023-11-28T20:06:40.642 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-11-28 19:59:59.231499567 +0000 2023-11-28T20:06:40.642 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-11-28 19:59:59.231499567 +0000 2023-11-28T20:06:40.642 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-11-28 19:59:59.231499567 +0000 2023-11-28T20:06:40.642 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T20:06:40.703 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-11-28T20:06:40.704 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-11-28T20:06:40.704 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000281937 s, 1.8 MB/s 2023-11-28T20:06:40.705 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T20:06:40.759 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2023-11-28T20:06:40.809 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T20:06:40.809 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:06:40.809 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 909 Links: 1 2023-11-28T20:06:40.810 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:06:40.810 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-11-28 20:00:00.247490491 +0000 2023-11-28T20:06:40.810 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-11-28 19:59:59.859493958 +0000 2023-11-28T20:06:40.810 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-11-28 19:59:59.859493958 +0000 2023-11-28T20:06:40.810 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-11-28 19:59:59.859493958 +0000 2023-11-28T20:06:40.810 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T20:06:40.871 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-11-28T20:06:40.872 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-11-28T20:06:40.872 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.00027534 s, 1.9 MB/s 2023-11-28T20:06:40.873 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T20:06:40.927 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2023-11-28T20:06:40.981 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T20:06:40.981 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:06:40.981 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 923 Links: 1 2023-11-28T20:06:40.981 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:06:40.982 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-11-28 20:00:00.931484382 +0000 2023-11-28T20:06:40.982 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-11-28 20:00:00.499488241 +0000 2023-11-28T20:06:40.982 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-11-28 20:00:00.499488241 +0000 2023-11-28T20:06:40.982 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-11-28 20:00:00.499488241 +0000 2023-11-28T20:06:40.982 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T20:06:41.043 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-11-28T20:06:41.044 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-11-28T20:06:41.044 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000276359 s, 1.9 MB/s 2023-11-28T20:06:41.045 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T20:06:41.099 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2023-11-28T20:06:41.153 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T20:06:41.153 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:06:41.153 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 943 Links: 1 2023-11-28T20:06:41.153 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:06:41.154 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-11-28 20:00:01.211481881 +0000 2023-11-28T20:06:41.154 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-11-28 20:00:01.207481917 +0000 2023-11-28T20:06:41.154 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-11-28 20:00:01.207481917 +0000 2023-11-28T20:06:41.154 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-11-28 20:00:01.207481917 +0000 2023-11-28T20:06:41.154 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T20:06:41.215 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-11-28T20:06:41.215 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-11-28T20:06:41.215 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000273759 s, 1.9 MB/s 2023-11-28T20:06:41.217 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T20:06:41.271 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T20:06:41.271 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T20:06:41.272 INFO:tasks.ceph:Generating config... 2023-11-28T20:06:41.273 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-28T20:06:41.273 INFO:tasks.ceph:[client] debug client = 20 2023-11-28T20:06:41.274 INFO:tasks.ceph:[client] debug ms = 1 2023-11-28T20:06:41.274 INFO:tasks.ceph:[client] pid file = 2023-11-28T20:06:41.274 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-28T20:06:41.274 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-28T20:06:41.274 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-28T20:06:41.274 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-28T20:06:41.274 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-28T20:06:41.275 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-28T20:06:41.275 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-28T20:06:41.275 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-28T20:06:41.275 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-28T20:06:41.275 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-28T20:06:41.275 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-28T20:06:41.276 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-28T20:06:41.276 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-28T20:06:41.276 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-28T20:06:41.276 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-28T20:06:41.276 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-28T20:06:41.276 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-28T20:06:41.276 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-28T20:06:41.276 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-28T20:06:41.276 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-28T20:06:41.276 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-28T20:06:41.276 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-28T20:06:41.277 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-28T20:06:41.277 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-28T20:06:41.277 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-28T20:06:41.277 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-28T20:06:41.277 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-28T20:06:41.277 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-28T20:06:41.277 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-28T20:06:41.277 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-28T20:06:41.277 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-28T20:06:41.277 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-28T20:06:41.277 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-28T20:06:41.278 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-28T20:06:41.278 INFO:tasks.ceph:Setting up mon.a... 2023-11-28T20:06:41.278 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-28T20:06:41.325 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.keyring 2023-11-28T20:06:41.339 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-28T20:06:41.387 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T20:06:41.408 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.177'), ('mon.b', '172.21.15.195'), ('mon.c', '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]')] 2023-11-28T20:06:41.409 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.177,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-28T20:06:41.410 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:06:41.410 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T20:06:41.465 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.177 --add b 172.21.15.195 --addv c '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:06:41.556 INFO:teuthology.orchestra.run.smithi177.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:06:41.556 INFO:teuthology.orchestra.run.smithi177.stdout:monmaptool: generated fsid 281097bd-2f79-488c-a8b5-264c5bd230f4 2023-11-28T20:06:41.556 INFO:teuthology.orchestra.run.smithi177.stdout:setting min_mon_release = pacific 2023-11-28T20:06:41.556 INFO:teuthology.orchestra.run.smithi177.stdout:epoch 0 2023-11-28T20:06:41.556 INFO:teuthology.orchestra.run.smithi177.stdout:fsid 281097bd-2f79-488c-a8b5-264c5bd230f4 2023-11-28T20:06:41.556 INFO:teuthology.orchestra.run.smithi177.stdout:last_changed 2023-11-28T20:06:41.558136+0000 2023-11-28T20:06:41.556 INFO:teuthology.orchestra.run.smithi177.stdout:created 2023-11-28T20:06:41.558136+0000 2023-11-28T20:06:41.556 INFO:teuthology.orchestra.run.smithi177.stdout:min_mon_release 16 (pacific) 2023-11-28T20:06:41.557 INFO:teuthology.orchestra.run.smithi177.stdout:election_strategy: 1 2023-11-28T20:06:41.557 INFO:teuthology.orchestra.run.smithi177.stdout:0: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.a 2023-11-28T20:06:41.557 INFO:teuthology.orchestra.run.smithi177.stdout:1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.b 2023-11-28T20:06:41.557 INFO:teuthology.orchestra.run.smithi177.stdout:2: [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] mon.c 2023-11-28T20:06:41.557 INFO:teuthology.orchestra.run.smithi177.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-28T20:06:41.559 DEBUG:teuthology.orchestra.run.smithi177:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T20:06:41.567 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 281097bd-2f79-488c-a8b5-264c5bd230f4... 2023-11-28T20:06:41.568 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T20:06:41.611 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T20:06:41.651 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2023-11-28T20:06:41.652 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2023-11-28T20:06:41.652 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T20:06:41.652 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2023-11-28T20:06:41.652 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.652 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2023-11-28T20:06:41.652 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.652 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2023-11-28T20:06:41.652 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.652 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2023-11-28T20:06:41.652 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2023-11-28T20:06:41.653 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.653 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2023-11-28T20:06:41.653 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2023-11-28T20:06:41.653 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.653 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T20:06:41.653 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2023-11-28T20:06:41.653 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.653 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T20:06:41.653 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T20:06:41.653 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.653 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2023-11-28T20:06:41.654 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.654 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2023-11-28T20:06:41.654 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2023-11-28T20:06:41.654 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2023-11-28T20:06:41.654 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2023-11-28T20:06:41.654 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2023-11-28T20:06:41.654 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2023-11-28T20:06:41.654 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2023-11-28T20:06:41.654 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T20:06:41.654 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T20:06:41.654 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2023-11-28T20:06:41.654 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.655 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T20:06:41.655 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.655 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2023-11-28T20:06:41.655 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.655 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2023-11-28T20:06:41.655 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.655 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2023-11-28T20:06:41.655 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2023-11-28T20:06:41.655 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2023-11-28T20:06:41.655 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "172.21.15.177,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2023-11-28T20:06:41.655 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = 281097bd-2f79-488c-a8b5-264c5bd230f4 2023-11-28T20:06:41.656 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.656 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2023-11-28T20:06:41.656 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2023-11-28T20:06:41.656 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.656 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2023-11-28T20:06:41.656 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2023-11-28T20:06:41.656 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2023-11-28T20:06:41.656 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.656 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2023-11-28T20:06:41.656 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2023-11-28T20:06:41.656 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.657 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2023-11-28T20:06:41.657 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2023-11-28T20:06:41.657 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2023-11-28T20:06:41.657 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug trim objects = true 2023-11-28T20:06:41.657 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.657 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2023-11-28T20:06:41.657 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2023-11-28T20:06:41.657 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.657 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2023-11-28T20:06:41.657 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.657 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2023-11-28T20:06:41.658 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.658 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2023-11-28T20:06:41.658 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.658 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2023-11-28T20:06:41.658 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2023-11-28T20:06:41.658 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.658 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2023-11-28T20:06:41.658 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2023-11-28T20:06:41.658 INFO:teuthology.orchestra.run.smithi177.stdout: bdev async discard = True 2023-11-28T20:06:41.658 INFO:teuthology.orchestra.run.smithi177.stdout: bdev enable discard = True 2023-11-28T20:06:41.658 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore allocator = bitmap 2023-11-28T20:06:41.659 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2023-11-28T20:06:41.659 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2023-11-28T20:06:41.659 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 1/20 2023-11-28T20:06:41.659 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 1/20 2023-11-28T20:06:41.659 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-11-28T20:06:41.659 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2023-11-28T20:06:41.659 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 4/10 2023-11-28T20:06:41.659 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T20:06:41.659 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2023-11-28T20:06:41.659 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2023-11-28T20:06:41.659 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2023-11-28T20:06:41.660 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2023-11-28T20:06:41.660 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2023-11-28T20:06:41.660 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.660 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2023-11-28T20:06:41.660 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-11-28T20:06:41.660 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2023-11-28T20:06:41.660 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2023-11-28T20:06:41.660 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2023-11-28T20:06:41.660 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2023-11-28T20:06:41.660 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2023-11-28T20:06:41.660 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2023-11-28T20:06:41.660 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.661 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2023-11-28T20:06:41.661 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-11-28T20:06:41.661 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2023-11-28T20:06:41.661 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2023-11-28T20:06:41.661 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2023-11-28T20:06:41.661 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2023-11-28T20:06:41.661 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2023-11-28T20:06:41.661 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2023-11-28T20:06:41.661 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2023-11-28T20:06:41.661 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2023-11-28T20:06:41.661 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2023-11-28T20:06:41.662 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.662 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T20:06:41.662 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T20:06:41.662 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T20:06:41.662 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.662 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T20:06:41.662 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T20:06:41.662 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T20:06:41.662 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.662 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2023-11-28T20:06:41.662 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2023-11-28T20:06:41.663 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.663 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2023-11-28T20:06:41.663 INFO:teuthology.orchestra.run.smithi177.stdout: mon op complaint time = 120 2023-11-28T20:06:41.663 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:06:41.663 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2023-11-28T20:06:41.663 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2023-11-28T20:06:41.663 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2023-11-28T20:06:41.663 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2023-11-28T20:06:41.663 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T20:06:41.663 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T20:06:41.663 INFO:teuthology.orchestra.run.smithi177.stdout: client mount timeout = 600 2023-11-28T20:06:41.663 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2023-11-28T20:06:41.663 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-11-28T20:06:41.664 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = "" 2023-11-28T20:06:41.664 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2023-11-28T20:06:41.664 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2023-11-28T20:06:41.664 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2023-11-28T20:06:41.664 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2023-11-28T20:06:41.664 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2023-11-28T20:06:41.664 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2023-11-28T20:06:41.664 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2023-11-28T20:06:41.664 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2023-11-28T20:06:41.664 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2023-11-28T20:06:41.664 INFO:teuthology.orchestra.run.smithi177.stdout:[mds] 2023-11-28T20:06:41.664 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds = 20 2023-11-28T20:06:41.665 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds balancer = 20 2023-11-28T20:06:41.665 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-11-28T20:06:41.665 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug frag = True 2023-11-28T20:06:41.665 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug scatterstat = True 2023-11-28T20:06:41.665 INFO:teuthology.orchestra.run.smithi177.stdout: mds op complaint time = 180 2023-11-28T20:06:41.665 INFO:teuthology.orchestra.run.smithi177.stdout: mds verify scatter = True 2023-11-28T20:06:41.665 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2023-11-28T20:06:41.665 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2023-11-28T20:06:41.665 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2023-11-28T20:06:41.666 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2023-11-28T20:06:41.666 INFO:teuthology.orchestra.run.smithi195.stdout: chdir = "" 2023-11-28T20:06:41.666 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T20:06:41.666 INFO:teuthology.orchestra.run.smithi195.stdout: auth supported = cephx 2023-11-28T20:06:41.666 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.666 INFO:teuthology.orchestra.run.smithi195.stdout: filestore xattr use omap = true 2023-11-28T20:06:41.666 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.666 INFO:teuthology.orchestra.run.smithi195.stdout: mon clock drift allowed = 1.000 2023-11-28T20:06:41.666 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.667 INFO:teuthology.orchestra.run.smithi195.stdout: osd crush chooseleaf type = 0 2023-11-28T20:06:41.667 INFO:teuthology.orchestra.run.smithi195.stdout: auth debug = true 2023-11-28T20:06:41.667 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.667 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on old message = true 2023-11-28T20:06:41.667 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on bug = true 2023-11-28T20:06:41.667 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.667 INFO:teuthology.orchestra.run.smithi195.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T20:06:41.667 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn max object skew = 0 2023-11-28T20:06:41.667 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.667 INFO:teuthology.orchestra.run.smithi195.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T20:06:41.667 INFO:teuthology.orchestra.run.smithi195.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T20:06:41.667 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.668 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default size = 2 2023-11-28T20:06:41.668 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.668 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow primary affinity = true 2023-11-28T20:06:41.668 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow pg remap = true 2023-11-28T20:06:41.668 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on legacy crush tunables = false 2023-11-28T20:06:41.668 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on crush straw calc version zero = false 2023-11-28T20:06:41.668 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on no sortbitwise = false 2023-11-28T20:06:41.668 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on osd down out interval zero = false 2023-11-28T20:06:41.668 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on too few osds = false 2023-11-28T20:06:41.668 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T20:06:41.668 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T20:06:41.668 INFO:teuthology.orchestra.run.smithi195.stdout: mon_allow_pool_size_one = true 2023-11-28T20:06:41.668 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.669 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T20:06:41.669 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.669 INFO:teuthology.orchestra.run.smithi195.stdout: osd default data pool replay window = 5 2023-11-28T20:06:41.669 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.669 INFO:teuthology.orchestra.run.smithi195.stdout: mon allow pool delete = true 2023-11-28T20:06:41.669 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.669 INFO:teuthology.orchestra.run.smithi195.stdout: mon cluster log file level = debug 2023-11-28T20:06:41.669 INFO:teuthology.orchestra.run.smithi195.stdout: debug asserts on shutdown = true 2023-11-28T20:06:41.669 INFO:teuthology.orchestra.run.smithi195.stdout: mon health detail to clog = false 2023-11-28T20:06:41.669 INFO:teuthology.orchestra.run.smithi195.stdout: mon host = "172.21.15.177,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2023-11-28T20:06:41.669 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = 281097bd-2f79-488c-a8b5-264c5bd230f4 2023-11-28T20:06:41.670 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.670 INFO:teuthology.orchestra.run.smithi195.stdout:[osd] 2023-11-28T20:06:41.670 INFO:teuthology.orchestra.run.smithi195.stdout: osd journal size = 100 2023-11-28T20:06:41.670 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.670 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub load threshold = 5.0 2023-11-28T20:06:41.670 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub max interval = 600 2023-11-28T20:06:41.670 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock profile = high_recovery_ops 2023-11-28T20:06:41.670 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.670 INFO:teuthology.orchestra.run.smithi195.stdout: osd recover clone overlap = true 2023-11-28T20:06:41.670 INFO:teuthology.orchestra.run.smithi195.stdout: osd recovery max chunk = 1048576 2023-11-28T20:06:41.670 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.670 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug shutdown = true 2023-11-28T20:06:41.670 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug op order = true 2023-11-28T20:06:41.671 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify stray on activate = true 2023-11-28T20:06:41.671 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug trim objects = true 2023-11-28T20:06:41.671 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.672 INFO:teuthology.orchestra.run.smithi195.stdout: osd open classes on start = true 2023-11-28T20:06:41.672 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug pg log writeout = true 2023-11-28T20:06:41.672 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.672 INFO:teuthology.orchestra.run.smithi195.stdout: osd deep scrub update digest min age = 30 2023-11-28T20:06:41.672 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.672 INFO:teuthology.orchestra.run.smithi195.stdout: osd map max advance = 10 2023-11-28T20:06:41.672 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.672 INFO:teuthology.orchestra.run.smithi195.stdout: journal zero on create = true 2023-11-28T20:06:41.672 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.672 INFO:teuthology.orchestra.run.smithi195.stdout: filestore ondisk finisher threads = 3 2023-11-28T20:06:41.672 INFO:teuthology.orchestra.run.smithi195.stdout: filestore apply finisher threads = 3 2023-11-28T20:06:41.672 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.673 INFO:teuthology.orchestra.run.smithi195.stdout: bdev debug aio = true 2023-11-28T20:06:41.673 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug misdirected ops = true 2023-11-28T20:06:41.673 INFO:teuthology.orchestra.run.smithi195.stdout: bdev async discard = True 2023-11-28T20:06:41.673 INFO:teuthology.orchestra.run.smithi195.stdout: bdev enable discard = True 2023-11-28T20:06:41.673 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore allocator = bitmap 2023-11-28T20:06:41.673 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore block size = 96636764160 2023-11-28T20:06:41.673 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore fsck on mount = True 2023-11-28T20:06:41.673 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluefs = 1/20 2023-11-28T20:06:41.673 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluestore = 1/20 2023-11-28T20:06:41.673 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2023-11-28T20:06:41.673 INFO:teuthology.orchestra.run.smithi195.stdout: debug osd = 20 2023-11-28T20:06:41.673 INFO:teuthology.orchestra.run.smithi195.stdout: debug rocksdb = 4/10 2023-11-28T20:06:41.673 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T20:06:41.674 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd full ratio = 0.9 2023-11-28T20:06:41.674 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd nearfull ratio = 0.8 2023-11-28T20:06:41.674 INFO:teuthology.orchestra.run.smithi195.stdout: osd failsafe full ratio = 0.95 2023-11-28T20:06:41.674 INFO:teuthology.orchestra.run.smithi195.stdout: osd objectstore = bluestore 2023-11-28T20:06:41.674 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2023-11-28T20:06:41.674 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.674 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr] 2023-11-28T20:06:41.674 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2023-11-28T20:06:41.674 INFO:teuthology.orchestra.run.smithi195.stdout: debug mgr = 20 2023-11-28T20:06:41.674 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2023-11-28T20:06:41.674 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2023-11-28T20:06:41.674 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2023-11-28T20:06:41.675 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2023-11-28T20:06:41.675 INFO:teuthology.orchestra.run.smithi195.stdout: mgr/telemetry/nag = false 2023-11-28T20:06:41.675 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.675 INFO:teuthology.orchestra.run.smithi195.stdout:[mon] 2023-11-28T20:06:41.675 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2023-11-28T20:06:41.675 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2023-11-28T20:06:41.675 INFO:teuthology.orchestra.run.smithi195.stdout: debug paxos = 20 2023-11-28T20:06:41.675 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2023-11-28T20:06:41.675 INFO:teuthology.orchestra.run.smithi195.stdout: mon data avail warn = 5 2023-11-28T20:06:41.675 INFO:teuthology.orchestra.run.smithi195.stdout: mon mgr mkfs grace = 240 2023-11-28T20:06:41.675 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2023-11-28T20:06:41.676 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd reporter subtree level = osd 2023-11-28T20:06:41.676 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd prime pg temp = true 2023-11-28T20:06:41.676 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2023-11-28T20:06:41.676 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.676 INFO:teuthology.orchestra.run.smithi195.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T20:06:41.676 INFO:teuthology.orchestra.run.smithi195.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T20:06:41.676 INFO:teuthology.orchestra.run.smithi195.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T20:06:41.676 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.676 INFO:teuthology.orchestra.run.smithi195.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T20:06:41.676 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T20:06:41.676 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T20:06:41.676 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.677 INFO:teuthology.orchestra.run.smithi195.stdout: # 1m isn't quite enough 2023-11-28T20:06:41.677 INFO:teuthology.orchestra.run.smithi195.stdout: mon_down_mkfs_grace = 2m 2023-11-28T20:06:41.677 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.677 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_filestore_osds = false 2023-11-28T20:06:41.677 INFO:teuthology.orchestra.run.smithi195.stdout: mon op complaint time = 120 2023-11-28T20:06:41.677 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-11-28T20:06:41.677 INFO:teuthology.orchestra.run.smithi195.stdout:[client] 2023-11-28T20:06:41.677 INFO:teuthology.orchestra.run.smithi195.stdout: rgw cache enabled = true 2023-11-28T20:06:41.677 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable ops log = true 2023-11-28T20:06:41.677 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable usage log = true 2023-11-28T20:06:41.677 INFO:teuthology.orchestra.run.smithi195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T20:06:41.677 INFO:teuthology.orchestra.run.smithi195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T20:06:41.677 INFO:teuthology.orchestra.run.smithi195.stdout: client mount timeout = 600 2023-11-28T20:06:41.678 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2023-11-28T20:06:41.678 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2023-11-28T20:06:41.678 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = "" 2023-11-28T20:06:41.678 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2023-11-28T20:06:41.678 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2023-11-28T20:06:41.678 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.a] 2023-11-28T20:06:41.678 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.b] 2023-11-28T20:06:41.678 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.c] 2023-11-28T20:06:41.678 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2023-11-28T20:06:41.678 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2023-11-28T20:06:41.678 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2023-11-28T20:06:41.678 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2023-11-28T20:06:41.679 INFO:teuthology.orchestra.run.smithi195.stdout:[mds] 2023-11-28T20:06:41.679 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds = 20 2023-11-28T20:06:41.679 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds balancer = 20 2023-11-28T20:06:41.679 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2023-11-28T20:06:41.679 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug frag = True 2023-11-28T20:06:41.679 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug scatterstat = True 2023-11-28T20:06:41.679 INFO:teuthology.orchestra.run.smithi195.stdout: mds op complaint time = 180 2023-11-28T20:06:41.679 INFO:teuthology.orchestra.run.smithi195.stdout: mds verify scatter = True 2023-11-28T20:06:41.679 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2023-11-28T20:06:41.679 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2023-11-28T20:06:41.679 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2023-11-28T20:06:41.683 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-28T20:06:41.683 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-28T20:06:41.780 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-28T20:06:41.781 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:06:41.781 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-28T20:06:41.790 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:06:41.790 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-28T20:06:41.844 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:06:41.844 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:06:41.844 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T20:06:41.844 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T20:06:41.924 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:06:41.924 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:06:41.976 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:06:41.976 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:06:41.977 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T20:06:41.977 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T20:06:42.013 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:06:42.013 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:06:42.069 INFO:tasks.ceph:Setting up mon nodes... 2023-11-28T20:06:42.069 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-28T20:06:42.069 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T20:06:42.125 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T20:06:42.130 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T20:06:42.191 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T20:06:42.271 INFO:tasks.ceph:Setting up mds nodes... 2023-11-28T20:06:42.271 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T20:06:42.327 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T20:06:42.332 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-28T20:06:42.352 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T20:06:42.451 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T20:06:42.456 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-28T20:06:42.476 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T20:06:42.534 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T20:06:42.539 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-28T20:06:42.559 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T20:06:42.659 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T20:06:42.663 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-28T20:06:42.684 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-28T20:06:42.684 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-28T20:06:42.727 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-28T20:06:42.744 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-28T20:06:42.830 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-28T20:06:42.847 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-28T20:06:42.890 INFO:teuthology.orchestra.run.smithi195.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-28T20:06:42.907 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-28T20:06:42.995 INFO:teuthology.orchestra.run.smithi195.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-28T20:06:43.012 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-28T20:06:43.012 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T20:06:43.012 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-28T20:06:43.033 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T20:06:43.033 INFO:tasks.ceph:role: osd.0 2023-11-28T20:06:43.033 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:06:43.034 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T20:06:43.107 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:06:43.108 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:06:43.108 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:06:43.108 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:06:43.108 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:06:43.108 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:06:43.108 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:06:43.108 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:06:43.108 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:06:43.108 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:06:43.582 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-11-28T20:06:43.584 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-11-28T20:06:43.585 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-28T20:06:43.693 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-28T20:06:43.710 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:06:43.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:06:43.711 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-28T20:06:43.773 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T20:06:43.773 INFO:tasks.ceph:role: osd.1 2023-11-28T20:06:43.774 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:06:43.775 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T20:06:43.844 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:06:43.844 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:06:43.845 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:06:43.845 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:06:43.845 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:06:43.845 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:06:43.845 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:06:43.845 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:06:43.846 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:06:43.846 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:06:44.325 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-11-28T20:06:44.328 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-11-28T20:06:44.328 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-28T20:06:44.471 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-28T20:06:44.488 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:06:44.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:06:44.489 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-28T20:06:44.555 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T20:06:44.556 INFO:tasks.ceph:role: osd.2 2023-11-28T20:06:44.556 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:06:44.556 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T20:06:44.623 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:06:44.623 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:06:44.623 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:06:44.624 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:06:44.624 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:06:44.624 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:06:44.624 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:06:44.624 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:06:44.624 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:06:44.624 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:06:45.071 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-11-28T20:06:45.074 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-11-28T20:06:45.074 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-28T20:06:45.222 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-28T20:06:45.238 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:06:45.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:06:45.239 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-28T20:06:45.304 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T20:06:45.304 INFO:tasks.ceph:role: osd.3 2023-11-28T20:06:45.304 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:06:45.304 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T20:06:45.376 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:06:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:06:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:06:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:06:45.376 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:06:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:06:45.376 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:06:45.376 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:06:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:06:45.377 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:06:45.825 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-11-28T20:06:45.828 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-11-28T20:06:45.828 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-28T20:06:45.934 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-28T20:06:45.952 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:06:45.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:06:45.953 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:06:46.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:46.091+0000 7f5d71513640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-28T20:06:46.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:46.095+0000 7f5d71513640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-28T20:06:46.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:46.095+0000 7f5d71513640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T20:06:46.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:46.095+0000 7f5d71513640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T20:06:46.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:46.095+0000 7f5d71513640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T20:06:46.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:46.099+0000 7f5d71513640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-28T20:06:49.088 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-28T20:06:49.109 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:06:49.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:49.203+0000 7fa6d8a2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-28T20:06:49.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:49.203+0000 7fa6d8a2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-28T20:06:49.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:49.203+0000 7fa6d8a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T20:06:49.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:49.203+0000 7fa6d8a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T20:06:49.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:49.203+0000 7fa6d8a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T20:06:49.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:49.203+0000 7fa6d8a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-28T20:06:52.208 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-28T20:06:53.568 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:06:53.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:53.667+0000 7febcaea7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-28T20:06:53.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:53.667+0000 7febcaea7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-28T20:06:53.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:53.667+0000 7febcaea7640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T20:06:53.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:53.667+0000 7febcaea7640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T20:06:53.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:53.667+0000 7febcaea7640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T20:06:53.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:53.671+0000 7febcaea7640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-28T20:06:56.692 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-28T20:06:56.713 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:06:56.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:56.807+0000 7f86c28e8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-28T20:06:56.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:56.807+0000 7f86c28e8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-28T20:06:56.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:56.807+0000 7f86c28e8640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T20:06:56.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:56.807+0000 7f86c28e8640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T20:06:56.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:56.807+0000 7f86c28e8640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T20:06:56.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:06:56.807+0000 7f86c28e8640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-28T20:06:59.807 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-28T20:06:59.828 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-28T20:06:59.851 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T20:06:59.851 INFO:tasks.ceph:role: osd.4 2023-11-28T20:06:59.851 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:06:59.852 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T20:06:59.913 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:06:59.913 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:06:59.913 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:06:59.914 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:06:59.914 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:06:59.914 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:06:59.914 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:06:59.914 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:06:59.914 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:06:59.914 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:06:59.938 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2023-11-28T20:06:59.941 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2023-11-28T20:06:59.942 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-28T20:07:00.018 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-28T20:07:00.079 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:07:00.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:07:00.081 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-28T20:07:00.144 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T20:07:00.144 INFO:tasks.ceph:role: osd.5 2023-11-28T20:07:00.144 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:07:00.144 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T20:07:00.203 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:07:00.204 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:07:00.204 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:07:00.204 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:07:00.204 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:07:00.204 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:07:00.204 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:07:00.205 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:07:00.205 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:07:00.205 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:07:00.228 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2023-11-28T20:07:00.231 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2023-11-28T20:07:00.231 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-28T20:07:00.297 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-28T20:07:00.355 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:07:00.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:07:00.356 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-28T20:07:00.419 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T20:07:00.420 INFO:tasks.ceph:role: osd.6 2023-11-28T20:07:00.420 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:07:00.420 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T20:07:00.480 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:07:00.480 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:07:00.480 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:07:00.480 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:07:00.481 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:07:00.481 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:07:00.481 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:07:00.481 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:07:00.481 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:07:00.481 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:07:00.504 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2023-11-28T20:07:00.507 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2023-11-28T20:07:00.507 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-28T20:07:00.577 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-28T20:07:00.635 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:07:00.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:07:00.637 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-28T20:07:00.700 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T20:07:00.700 INFO:tasks.ceph:role: osd.7 2023-11-28T20:07:00.700 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:07:00.700 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T20:07:00.767 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:07:00.767 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:07:00.767 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:07:00.768 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:07:00.768 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:07:00.768 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:07:00.768 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:07:00.768 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:07:00.768 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:07:00.768 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:07:00.791 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2023-11-28T20:07:00.794 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2023-11-28T20:07:00.795 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-28T20:07:00.864 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-28T20:07:00.923 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:07:00.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:07:00.925 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:07:01.052 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:01.048+0000 7f4fd9ec7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-28T20:07:01.052 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:01.048+0000 7f4fd9ec7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-28T20:07:01.052 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:01.048+0000 7f4fd9ec7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T20:07:01.052 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:01.048+0000 7f4fd9ec7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T20:07:01.053 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:01.048+0000 7f4fd9ec7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T20:07:01.054 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:01.052+0000 7f4fd9ec7640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-28T20:07:04.046 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-28T20:07:04.067 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:07:04.162 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:04.160+0000 7f7f9e2ed640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-28T20:07:04.163 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:04.160+0000 7f7f9e2ed640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-28T20:07:04.163 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:04.160+0000 7f7f9e2ed640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T20:07:04.163 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:04.160+0000 7f7f9e2ed640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T20:07:04.163 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:04.160+0000 7f7f9e2ed640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T20:07:04.164 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:04.160+0000 7f7f9e2ed640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-28T20:07:07.152 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-28T20:07:07.173 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:07:07.274 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:07.271+0000 7f6fcfe9e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-28T20:07:07.274 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:07.271+0000 7f6fcfe9e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-28T20:07:07.274 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:07.271+0000 7f6fcfe9e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T20:07:07.274 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:07.271+0000 7f6fcfe9e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T20:07:07.274 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:07.271+0000 7f6fcfe9e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T20:07:07.275 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:07.271+0000 7f6fcfe9e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-28T20:07:09.774 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:07:09.781 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:07:10.263 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-28T20:07:10.284 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:07:10.385 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:10.379+0000 7fa215538640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-28T20:07:10.385 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:10.383+0000 7fa215538640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-28T20:07:10.385 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:10.383+0000 7fa215538640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T20:07:10.386 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:10.383+0000 7fa215538640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T20:07:10.386 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:10.383+0000 7fa215538640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T20:07:10.386 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:10.383+0000 7fa215538640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-28T20:07:13.371 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-28T20:07:13.392 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-28T20:07:13.392 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:07:13.392 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-28T20:07:13.415 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:07:13.416 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-28T20:07:13.482 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:07:13.482 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-28T20:07:13.550 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:07:13.550 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-28T20:07:13.618 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:07:13.618 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-28T20:07:13.682 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:07:13.682 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-28T20:07:13.745 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:07:13.745 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-28T20:07:13.809 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:07:13.809 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-28T20:07:13.830 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:07:13.831 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-28T20:07:13.893 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:07:13.893 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-28T20:07:13.957 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:07:13.957 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-28T20:07:14.021 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:07:14.021 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-28T20:07:14.085 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:07:14.085 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-28T20:07:14.154 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:07:14.154 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-28T20:07:14.221 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:07:14.221 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-28T20:07:14.231 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:07:14.231 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-28T20:07:14.285 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:07:14.286 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-28T20:07:14.295 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:07:14.295 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-28T20:07:14.345 INFO:tasks.ceph:Adding keys to all mons... 2023-11-28T20:07:14.345 DEBUG:teuthology.orchestra.run.smithi177:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T20:07:14.349 DEBUG:teuthology.orchestra.run.smithi195:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T20:07:14.393 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.y] 2023-11-28T20:07:14.393 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZlR0mhBxAAvFcVR6gwEEezMfUCJfsFwg== 2023-11-28T20:07:14.393 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2023-11-28T20:07:14.393 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZlT2itExAAiboY3RykwKkdHHvSX89FMg== 2023-11-28T20:07:14.393 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2023-11-28T20:07:14.393 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZllwEQGxAAIZbBHVfQ7S698b34X58EoQ== 2023-11-28T20:07:14.393 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.0] 2023-11-28T20:07:14.393 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBWSGZl6J/iBRAAaHtCcQTA4eByPVZs3gabUA== 2023-11-28T20:07:14.393 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.1] 2023-11-28T20:07:14.393 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBZSGZlsadjDBAAzMr5eUjea1EK53hskbXjnA== 2023-11-28T20:07:14.394 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.2] 2023-11-28T20:07:14.394 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBdSGZloPsrKBAAGjlzPhk/tJwOSjuWQkePaA== 2023-11-28T20:07:14.394 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.3] 2023-11-28T20:07:14.394 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBgSGZlm8hhMBAAlJNZgd37p89WH4x/64TEmg== 2023-11-28T20:07:14.394 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.x] 2023-11-28T20:07:14.394 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZlx9l8CxAAZ3ZNX9zYEgw8kzA5dLPB5A== 2023-11-28T20:07:14.394 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2023-11-28T20:07:14.394 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZlXOfvHxAAxtE7/5YjkCT81r/R33CimA== 2023-11-28T20:07:14.394 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2023-11-28T20:07:14.394 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZlQ3phJxAAO3C3l75cY24gpt5A4fkNzw== 2023-11-28T20:07:14.394 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.4] 2023-11-28T20:07:14.394 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBlSGZlFVMqAxAAT/EhE4C6jEDYQewJ//aUyg== 2023-11-28T20:07:14.395 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.5] 2023-11-28T20:07:14.395 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBoSGZlwv67CRAArT/ZRS25JQ6UrtviY01mqA== 2023-11-28T20:07:14.395 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.6] 2023-11-28T20:07:14.395 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBrSGZlKNlhEBAAV+M35LEhu8Gam1Rf0rekxQ== 2023-11-28T20:07:14.395 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.7] 2023-11-28T20:07:14.395 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBuSGZl5kj9FhAA3+3ARqIw80zr9Tkv+hQMNA== 2023-11-28T20:07:14.395 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-11-28T20:07:14.395 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZl+2t5KxAAc/J7x+fjSQR4IkIQJ/X8sw== 2023-11-28T20:07:14.395 INFO:teuthology.orchestra.run.smithi177.stdout:[client.2] 2023-11-28T20:07:14.395 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZlkxWhMRAAWgwPbTkk7I2652ytEyZhMQ== 2023-11-28T20:07:14.395 INFO:teuthology.orchestra.run.smithi177.stdout:[client.1] 2023-11-28T20:07:14.395 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZlOyYqNRAAPICNuyLDmazDLHBbbNJH2w== 2023-11-28T20:07:14.395 INFO:teuthology.orchestra.run.smithi177.stdout:[client.3] 2023-11-28T20:07:14.396 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZlcbtmOxAA/IaYtuh4NdUQ+WVwAGmD+w== 2023-11-28T20:07:14.407 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.y] 2023-11-28T20:07:14.407 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBSSGZlR0mhBxAAvFcVR6gwEEezMfUCJfsFwg== 2023-11-28T20:07:14.407 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2023-11-28T20:07:14.407 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBSSGZlT2itExAAiboY3RykwKkdHHvSX89FMg== 2023-11-28T20:07:14.407 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2023-11-28T20:07:14.407 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBSSGZllwEQGxAAIZbBHVfQ7S698b34X58EoQ== 2023-11-28T20:07:14.408 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.0] 2023-11-28T20:07:14.408 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBWSGZl6J/iBRAAaHtCcQTA4eByPVZs3gabUA== 2023-11-28T20:07:14.408 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.1] 2023-11-28T20:07:14.408 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBZSGZlsadjDBAAzMr5eUjea1EK53hskbXjnA== 2023-11-28T20:07:14.408 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.2] 2023-11-28T20:07:14.408 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBdSGZloPsrKBAAGjlzPhk/tJwOSjuWQkePaA== 2023-11-28T20:07:14.408 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.3] 2023-11-28T20:07:14.408 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBgSGZlm8hhMBAAlJNZgd37p89WH4x/64TEmg== 2023-11-28T20:07:14.408 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.x] 2023-11-28T20:07:14.408 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBSSGZlx9l8CxAAZ3ZNX9zYEgw8kzA5dLPB5A== 2023-11-28T20:07:14.408 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2023-11-28T20:07:14.409 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBSSGZlXOfvHxAAxtE7/5YjkCT81r/R33CimA== 2023-11-28T20:07:14.409 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2023-11-28T20:07:14.409 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBSSGZlQ3phJxAAO3C3l75cY24gpt5A4fkNzw== 2023-11-28T20:07:14.409 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.4] 2023-11-28T20:07:14.409 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBlSGZlFVMqAxAAT/EhE4C6jEDYQewJ//aUyg== 2023-11-28T20:07:14.409 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.5] 2023-11-28T20:07:14.409 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBoSGZlwv67CRAArT/ZRS25JQ6UrtviY01mqA== 2023-11-28T20:07:14.409 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.6] 2023-11-28T20:07:14.409 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBrSGZlKNlhEBAAV+M35LEhu8Gam1Rf0rekxQ== 2023-11-28T20:07:14.409 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.7] 2023-11-28T20:07:14.409 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBuSGZl5kj9FhAA3+3ARqIw80zr9Tkv+hQMNA== 2023-11-28T20:07:14.409 INFO:teuthology.orchestra.run.smithi195.stdout:[client.0] 2023-11-28T20:07:14.410 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBSSGZl+2t5KxAAc/J7x+fjSQR4IkIQJ/X8sw== 2023-11-28T20:07:14.410 INFO:teuthology.orchestra.run.smithi195.stdout:[client.2] 2023-11-28T20:07:14.410 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBSSGZlkxWhMRAAWgwPbTkk7I2652ytEyZhMQ== 2023-11-28T20:07:14.410 INFO:teuthology.orchestra.run.smithi195.stdout:[client.1] 2023-11-28T20:07:14.410 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBSSGZlOyYqNRAAPICNuyLDmazDLHBbbNJH2w== 2023-11-28T20:07:14.410 INFO:teuthology.orchestra.run.smithi195.stdout:[client.3] 2023-11-28T20:07:14.410 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBSSGZlcbtmOxAA/IaYtuh4NdUQ+WVwAGmD+w== 2023-11-28T20:07:14.411 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T20:07:14.444 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T20:07:14.514 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:07:14.518 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:07:14.577 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:07:14.580 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:07:14.637 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:14.641 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:14.694 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:14.698 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:14.752 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:14.756 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:14.810 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:14.814 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:14.868 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T20:07:14.871 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T20:07:14.925 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:07:14.929 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:07:14.985 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:07:14.989 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:07:15.045 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:15.049 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:15.103 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:15.106 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:15.160 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:15.164 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:15.218 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:15.222 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:07:15.275 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T20:07:15.279 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T20:07:15.336 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T20:07:15.340 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T20:07:15.397 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T20:07:15.401 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T20:07:15.458 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T20:07:15.461 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T20:07:15.518 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-28T20:07:15.519 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-28T20:07:15.541 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T20:07:15.669 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-28T20:07:15.689 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-28T20:07:15.710 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T20:07:15.824 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-28T20:07:15.844 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-28T20:07:15.904 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T20:07:16.015 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-28T20:07:16.036 DEBUG:teuthology.orchestra.run.smithi177:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:07:16.039 DEBUG:teuthology.orchestra.run.smithi195:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:07:16.085 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-28T20:07:16.085 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T20:07:16.085 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T20:07:16.092 INFO:tasks.ceph.mon.a:Started 2023-11-28T20:07:16.092 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T20:07:16.093 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T20:07:16.136 INFO:tasks.ceph.mon.b:Started 2023-11-28T20:07:16.136 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T20:07:16.136 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T20:07:16.139 INFO:tasks.ceph.mon.c:Started 2023-11-28T20:07:16.139 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-28T20:07:16.140 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-28T20:07:16.140 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-28T20:07:16.143 INFO:tasks.ceph.mgr.y:Started 2023-11-28T20:07:16.143 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-28T20:07:16.143 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-28T20:07:16.147 INFO:tasks.ceph.mgr.x:Started 2023-11-28T20:07:16.147 INFO:tasks.ceph:Setting crush tunables to default 2023-11-28T20:07:16.147 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd crush tunables default 2023-11-28T20:07:16.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41fb57640 1 Processor -- start 2023-11-28T20:07:16.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41fb57640 1 -- start start 2023-11-28T20:07:16.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41fb57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41814abe0 0x7fb418165a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:16.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41fb57640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb41814b1e0 0x7fb4180b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:16.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41fb57640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4180b1fc0 con 0x7fb4180b4350 2023-11-28T20:07:16.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41fb57640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4180b47e0 con 0x7fb41814b1e0 2023-11-28T20:07:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41fb57640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180b2260 con 0x7fb41814abe0 2023-11-28T20:07:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41d8f3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41814abe0 0x7fb418165a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41d8f3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41814abe0 0x7fb418165a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:36778/0 (socket says 172.21.15.177:36778) 2023-11-28T20:07:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41d8f3640 1 -- 172.21.15.177:0/2825974304 learned_addr learned my addr 172.21.15.177:0/2825974304 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41d8f3640 1 -- 172.21.15.177:0/2825974304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41814abe0 msgr2=0x7fb418165a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:07:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41d8f3640 1 -- 172.21.15.177:0/2825974304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41814abe0 msgr2=0x7fb418165a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:07:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41d8f3640 1 --2- 172.21.15.177:0/2825974304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41814abe0 0x7fb418165a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:07:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41d8f3640 1 --2- 172.21.15.177:0/2825974304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41814abe0 0x7fb418165a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:07:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41d0f2640 1 --2- 172.21.15.177:0/2825974304 >> v2:172.21.15.177:3300/0 conn(0x7fb41814b1e0 0x7fb4180b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41d0f2640 1 -- 172.21.15.177:0/2825974304 >> v2:172.21.15.177:3300/0 conn(0x7fb41814b1e0 msgr2=0x7fb4180b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:07:16.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41d0f2640 1 -- 172.21.15.177:0/2825974304 >> v2:172.21.15.177:3300/0 conn(0x7fb41814b1e0 msgr2=0x7fb4180b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:07:16.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41d0f2640 1 --2- 172.21.15.177:0/2825974304 >> v2:172.21.15.177:3300/0 conn(0x7fb41814b1e0 0x7fb4180b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:07:16.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.286+0000 7fb41d0f2640 1 --2- 172.21.15.177:0/2825974304 >> v2:172.21.15.177:3300/0 conn(0x7fb41814b1e0 0x7fb4180b3e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:07:16.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.450+0000 7fb41c8f1640 1 -- 172.21.15.177:0/2825974304 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268656947 0 0) 0x7fb4180b1fc0 con 0x7fb4180b4350 2023-11-28T20:07:16.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.450+0000 7fb41c8f1640 1 -- 172.21.15.177:0/2825974304 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb404003530 con 0x7fb4180b4350 2023-11-28T20:07:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41c8f1640 1 -- 172.21.15.177:0/2825974304 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 655571952 0 0) 0x7fb404003530 con 0x7fb4180b4350 2023-11-28T20:07:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41c8f1640 1 -- 172.21.15.177:0/2825974304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41814abe0 msgr2=0x7fb418165a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:07:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41c8f1640 1 --2- 172.21.15.177:0/2825974304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41814abe0 0x7fb418165a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41c8f1640 1 -- 172.21.15.177:0/2825974304 >> v2:172.21.15.177:3300/0 conn(0x7fb41814b1e0 msgr2=0x7fb4180b3e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:07:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41c8f1640 1 --2- 172.21.15.177:0/2825974304 >> v2:172.21.15.177:3300/0 conn(0x7fb41814b1e0 0x7fb4180b3e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:16.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41c8f1640 1 -- 172.21.15.177:0/2825974304 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180b2540 con 0x7fb4180b4350 2023-11-28T20:07:16.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41c8f1640 1 -- 172.21.15.177:0/2825974304 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7fb410001a00 con 0x7fb4180b4350 2023-11-28T20:07:16.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41c8f1640 1 -- 172.21.15.177:0/2825974304 >> v1:172.21.15.195:6789/0 conn(0x7fb4180b4350 legacy=0x7fb418161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:16.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41c8f1640 1 --2- 172.21.15.177:0/2825974304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb404003980 0x7fb404003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:16.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41c8f1640 1 --2- 172.21.15.177:0/2825974304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41814abe0 0x7fb4040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:16.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41c8f1640 1 --2- 172.21.15.177:0/2825974304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb404004d10 0x7fb404005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:16.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41c8f1640 1 -- 172.21.15.177:0/2825974304 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180b47e0 con 0x7fb404004d10 2023-11-28T20:07:16.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41c8f1640 1 -- 172.21.15.177:0/2825974304 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180b2260 con 0x7fb404003980 2023-11-28T20:07:16.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41c8f1640 1 -- 172.21.15.177:0/2825974304 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40400bac0 con 0x7fb41814abe0 2023-11-28T20:07:16.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41d8f3640 1 --2- 172.21.15.177:0/2825974304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb404003980 0x7fb404003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:16.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41d0f2640 1 --2- 172.21.15.177:0/2825974304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41814abe0 0x7fb4040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:16.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41e0f4640 1 --2- 172.21.15.177:0/2825974304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb404004d10 0x7fb404005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:16.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41d8f3640 1 -- 172.21.15.177:0/2825974304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41814abe0 msgr2=0x7fb4040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:16.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41d8f3640 1 --2- 172.21.15.177:0/2825974304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41814abe0 0x7fb4040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:16.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41d8f3640 1 -- 172.21.15.177:0/2825974304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb404004d10 msgr2=0x7fb404005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:16.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41d8f3640 1 --2- 172.21.15.177:0/2825974304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb404004d10 0x7fb404005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:16.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41d8f3640 1 -- 172.21.15.177:0/2825974304 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb404003530 con 0x7fb404003980 2023-11-28T20:07:16.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.454+0000 7fb41e0f4640 1 --2- 172.21.15.177:0/2825974304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb404004d10 0x7fb404005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:16.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.458+0000 7fb41d8f3640 1 --2- 172.21.15.177:0/2825974304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb404003980 0x7fb404003da0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb414009890 tx=0x7fb41401c5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fced6a7b1a21cfc7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:16.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.458+0000 7fb41c8f1640 1 -- 172.21.15.177:0/2825974304 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4140a8640 con 0x7fb404003980 2023-11-28T20:07:16.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.458+0000 7fb41c8f1640 1 -- 172.21.15.177:0/2825974304 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4140a87a0 con 0x7fb404003980 2023-11-28T20:07:16.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.458+0000 7fb41c8f1640 1 -- 172.21.15.177:0/2825974304 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4140a8b50 con 0x7fb404003980 2023-11-28T20:07:16.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.458+0000 7fb41fb57640 1 -- 172.21.15.177:0/2825974304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb404003980 msgr2=0x7fb404003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:16.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.458+0000 7fb41fb57640 1 --2- 172.21.15.177:0/2825974304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb404003980 0x7fb404003da0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb414009890 tx=0x7fb41401c5d0 comp rx=0 tx=0).stop 2023-11-28T20:07:16.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.458+0000 7fb41e0f4640 1 -- 172.21.15.177:0/2825974304 reap_dead start 2023-11-28T20:07:16.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.462+0000 7fb41fb57640 1 -- 172.21.15.177:0/2825974304 shutdown_connections 2023-11-28T20:07:16.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.462+0000 7fb41fb57640 1 -- 172.21.15.177:0/2825974304 >> 172.21.15.177:0/2825974304 conn(0x7fb4180b0cc0 msgr2=0x7fb4180b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:16.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.462+0000 7fb41fb57640 1 -- 172.21.15.177:0/2825974304 shutdown_connections 2023-11-28T20:07:16.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.462+0000 7fb41fb57640 1 -- 172.21.15.177:0/2825974304 wait complete. 2023-11-28T20:07:16.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.462+0000 7fb41fb57640 1 Processor -- start 2023-11-28T20:07:16.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.462+0000 7fb41fb57640 1 -- start start 2023-11-28T20:07:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41fb57640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb404003980 0x7fb418148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41fb57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41813ba20 0x7fb418137bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41fb57640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb418139670 0x7fb418139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41fb57640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb418139250 con 0x7fb404003980 2023-11-28T20:07:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41fb57640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41813bea0 con 0x7fb418139670 2023-11-28T20:07:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41fb57640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4181385d0 con 0x7fb41813ba20 2023-11-28T20:07:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41d8f3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb404003980 0x7fb418148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41d8f3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb404003980 0x7fb418148600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40686/0 (socket says 172.21.15.177:40686) 2023-11-28T20:07:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41d8f3640 1 -- 172.21.15.177:0/4102403022 learned_addr learned my addr 172.21.15.177:0/4102403022 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41d0f2640 1 --2- 172.21.15.177:0/4102403022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41813ba20 0x7fb418137bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41e0f4640 1 --2- 172.21.15.177:0/4102403022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb418139670 0x7fb418139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41d8f3640 1 -- 172.21.15.177:0/4102403022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41813ba20 msgr2=0x7fb418137bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41d8f3640 1 --2- 172.21.15.177:0/4102403022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41813ba20 0x7fb418137bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41d8f3640 1 -- 172.21.15.177:0/4102403022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb418139670 msgr2=0x7fb418139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41d8f3640 1 --2- 172.21.15.177:0/4102403022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb418139670 0x7fb418139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41d8f3640 1 -- 172.21.15.177:0/4102403022 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4181388b0 con 0x7fb404003980 2023-11-28T20:07:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41d8f3640 1 --2- 172.21.15.177:0/4102403022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb404003980 0x7fb418148600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb41401c610 tx=0x7fb404005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb40e7fc640 1 -- 172.21.15.177:0/4102403022 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4140b0600 con 0x7fb404003980 2023-11-28T20:07:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb40e7fc640 1 -- 172.21.15.177:0/4102403022 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4140b0760 con 0x7fb404003980 2023-11-28T20:07:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb40e7fc640 1 -- 172.21.15.177:0/4102403022 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4140b0af0 con 0x7fb404003980 2023-11-28T20:07:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41fb57640 1 -- 172.21.15.177:0/4102403022 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb418138b90 con 0x7fb404003980 2023-11-28T20:07:16.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41fb57640 1 -- 172.21.15.177:0/4102403022 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb418138110 con 0x7fb404003980 2023-11-28T20:07:16.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb40e7fc640 1 -- 172.21.15.177:0/4102403022 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb4140b93f0 con 0x7fb404003980 2023-11-28T20:07:16.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb40e7fc640 1 -- 172.21.15.177:0/4102403022 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb4140a6720 con 0x7fb404003980 2023-11-28T20:07:16.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.466+0000 7fb41fb57640 1 -- 172.21.15.177:0/4102403022 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4180693d0 con 0x7fb404003980 2023-11-28T20:07:16.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.482+0000 7fb40e7fc640 1 -- 172.21.15.177:0/4102403022 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb4140bf060 con 0x7fb404003980 2023-11-28T20:07:16.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.558+0000 7fb41fb57640 1 -- 172.21.15.177:0/4102403022 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb4180cb5b0 con 0x7fb404003980 2023-11-28T20:07:16.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.562+0000 7fb40e7fc640 1 -- 172.21.15.177:0/4102403022 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb41400f040 con 0x7fb404003980 2023-11-28T20:07:16.562 INFO:teuthology.orchestra.run.smithi177.stderr:adjusted tunables profile to default 2023-11-28T20:07:16.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.562+0000 7fb41fb57640 1 -- 172.21.15.177:0/4102403022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb404003980 msgr2=0x7fb418148600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:16.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.562+0000 7fb41fb57640 1 --2- 172.21.15.177:0/4102403022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb404003980 0x7fb418148600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb41401c610 tx=0x7fb404005800 comp rx=0 tx=0).stop 2023-11-28T20:07:16.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.562+0000 7fb41fb57640 1 -- 172.21.15.177:0/4102403022 shutdown_connections 2023-11-28T20:07:16.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.562+0000 7fb41fb57640 1 --2- 172.21.15.177:0/4102403022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb418139670 0x7fb418139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:16.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.562+0000 7fb41fb57640 1 --2- 172.21.15.177:0/4102403022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb41813ba20 0x7fb418137bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:16.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.562+0000 7fb41fb57640 1 --2- 172.21.15.177:0/4102403022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb404003980 0x7fb418148600 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:16.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.562+0000 7fb41fb57640 1 -- 172.21.15.177:0/4102403022 >> 172.21.15.177:0/4102403022 conn(0x7fb4180b0cc0 msgr2=0x7fb418148cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:16.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.562+0000 7fb41fb57640 1 -- 172.21.15.177:0/4102403022 shutdown_connections 2023-11-28T20:07:16.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:16.562+0000 7fb41fb57640 1 -- 172.21.15.177:0/4102403022 wait complete. 2023-11-28T20:07:16.582 INFO:tasks.ceph:check_enable_crimson: False 2023-11-28T20:07:16.582 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-28T20:07:16.582 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:07:16.583 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-28T20:07:16.604 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:07:16.604 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-28T20:07:16.657 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:16.655+0000 7fd2d2dcd180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T20:07:16.666 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:07:16.666 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-28T20:07:16.709 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:16.706+0000 7f8cf25f8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T20:07:16.729 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:07:16.729 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-28T20:07:16.793 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:07:16.793 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-28T20:07:16.814 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:07:16.815 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-28T20:07:16.876 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:07:16.877 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-28T20:07:16.940 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:07:16.941 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-28T20:07:17.004 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 9b7ec4c2-697e-4a04-a68a-db84cf62856a 0 2023-11-28T20:07:17.185 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.179+0000 7f34797e6640 1 Processor -- start 2023-11-28T20:07:17.185 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.179+0000 7f34797e6640 1 -- start start 2023-11-28T20:07:17.186 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.183+0000 7f34797e6640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f347415d2a0 0x7f34740b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.187 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.183+0000 7f34797e6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f34740b5240 0x7f34740b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.187 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.183+0000 7f34797e6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34740b75f0 con 0x7f34740b61c0 2023-11-28T20:07:17.187 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.183+0000 7f34797e6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34740b5c10 con 0x7f34740b5240 2023-11-28T20:07:17.187 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.183+0000 7f34797e6640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34740b91a0 con 0x7f347415d2a0 2023-11-28T20:07:17.187 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.183+0000 7f3472ffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f347415d2a0 0x7f34740b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.187 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.183+0000 7f3472ffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f347415d2a0 0x7f34740b8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:34454/0 (socket says 172.21.15.195:34454) 2023-11-28T20:07:17.187 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.183+0000 7f3472ffd640 1 -- 172.21.15.195:0/1166287560 learned_addr learned my addr 172.21.15.195:0/1166287560 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:17.187 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.183+0000 7f34737fe640 1 --2- 172.21.15.195:0/1166287560 >> v2:172.21.15.177:3300/0 conn(0x7f34740b5240 0x7f34740b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.187 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.183+0000 7f3472ffd640 1 -- 172.21.15.195:0/1166287560 >> v2:172.21.15.177:3300/0 conn(0x7f34740b5240 msgr2=0x7f34740b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:17.187 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.183+0000 7f3472ffd640 1 --2- 172.21.15.195:0/1166287560 >> v2:172.21.15.177:3300/0 conn(0x7f34740b5240 0x7f34740b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.188 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.183+0000 7f3472ffd640 1 -- 172.21.15.195:0/1166287560 >> v1:172.21.15.177:6789/0 conn(0x7f34740b61c0 legacy=0x7f34740d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.188 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.183+0000 7f3472ffd640 1 -- 172.21.15.195:0/1166287560 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34740b69e0 con 0x7f347415d2a0 2023-11-28T20:07:17.189 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.187+0000 7f3472ffd640 1 --2- 172.21.15.195:0/1166287560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f347415d2a0 0x7f34740b8c60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f347406c5a0 tx=0x7f346401ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4aa0577b1f1e8db3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:17.190 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.187+0000 7f3471ffb640 1 -- 172.21.15.195:0/1166287560 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34640a89f0 con 0x7f347415d2a0 2023-11-28T20:07:17.190 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.187+0000 7f3471ffb640 1 -- 172.21.15.195:0/1166287560 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34640a8b50 con 0x7f347415d2a0 2023-11-28T20:07:17.190 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.187+0000 7f3471ffb640 1 -- 172.21.15.195:0/1166287560 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34640b0440 con 0x7f347415d2a0 2023-11-28T20:07:17.191 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.187+0000 7f34797e6640 1 -- 172.21.15.195:0/1166287560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f347415d2a0 msgr2=0x7f34740b8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.191 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.187+0000 7f34797e6640 1 --2- 172.21.15.195:0/1166287560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f347415d2a0 0x7f34740b8c60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f347406c5a0 tx=0x7f346401ecf0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.191 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.187+0000 7f34797e6640 1 -- 172.21.15.195:0/1166287560 shutdown_connections 2023-11-28T20:07:17.191 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.187+0000 7f34797e6640 1 --2- 172.21.15.195:0/1166287560 >> v2:172.21.15.177:3300/0 conn(0x7f34740b5240 0x7f34740b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.191 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.187+0000 7f34797e6640 1 --2- 172.21.15.195:0/1166287560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f347415d2a0 0x7f34740b8c60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.191 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.187+0000 7f34797e6640 1 -- 172.21.15.195:0/1166287560 >> 172.21.15.195:0/1166287560 conn(0x7f3474072060 msgr2=0x7f3474072470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:17.191 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.187+0000 7f34797e6640 1 -- 172.21.15.195:0/1166287560 shutdown_connections 2023-11-28T20:07:17.191 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.187+0000 7f34797e6640 1 -- 172.21.15.195:0/1166287560 wait complete. 2023-11-28T20:07:17.192 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:17.187+0000 7fd2d2dcd180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T20:07:17.192 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.187+0000 7f34797e6640 1 Processor -- start 2023-11-28T20:07:17.192 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.187+0000 7f34797e6640 1 -- start start 2023-11-28T20:07:17.195 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f34797e6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34740b5240 0x7f347414b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.195 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f34797e6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34740b61c0 0x7f347415d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.195 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f34797e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f347415d2a0 0x7f347414c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.195 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f34797e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347414bbe0 con 0x7f347415d2a0 2023-11-28T20:07:17.195 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f34797e6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347415e0c0 con 0x7f34740b5240 2023-11-28T20:07:17.195 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f34797e6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347415e3a0 con 0x7f34740b61c0 2023-11-28T20:07:17.195 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f3472ffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34740b5240 0x7f347414b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.195 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f3472ffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34740b5240 0x7f347414b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:34466/0 (socket says 172.21.15.195:34466) 2023-11-28T20:07:17.196 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f3472ffd640 1 -- 172.21.15.195:0/2221890742 learned_addr learned my addr 172.21.15.195:0/2221890742 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:17.196 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f34727fc640 1 --2- 172.21.15.195:0/2221890742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34740b61c0 0x7f347415d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.196 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f34737fe640 1 --2- 172.21.15.195:0/2221890742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f347415d2a0 0x7f347414c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.196 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f3472ffd640 1 -- 172.21.15.195:0/2221890742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34740b61c0 msgr2=0x7f347415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.196 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f3472ffd640 1 --2- 172.21.15.195:0/2221890742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34740b61c0 0x7f347415d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.196 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f3472ffd640 1 -- 172.21.15.195:0/2221890742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f347415d2a0 msgr2=0x7f347414c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.196 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f3472ffd640 1 --2- 172.21.15.195:0/2221890742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f347415d2a0 0x7f347414c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.196 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f3472ffd640 1 -- 172.21.15.195:0/2221890742 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34640094d0 con 0x7f34740b5240 2023-11-28T20:07:17.196 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f3472ffd640 1 --2- 172.21.15.195:0/2221890742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34740b5240 0x7f347414b6a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f346401b900 tx=0x7f346401ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:17.196 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f345b7fe640 1 -- 172.21.15.195:0/2221890742 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34640ba600 con 0x7f34740b5240 2023-11-28T20:07:17.196 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f345b7fe640 1 -- 172.21.15.195:0/2221890742 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34640ba760 con 0x7f34740b5240 2023-11-28T20:07:17.197 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f345b7fe640 1 -- 172.21.15.195:0/2221890742 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34640bab10 con 0x7f34740b5240 2023-11-28T20:07:17.197 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f34797e6640 1 -- 172.21.15.195:0/2221890742 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f347415e680 con 0x7f34740b5240 2023-11-28T20:07:17.197 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f34797e6640 1 -- 172.21.15.195:0/2221890742 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347415ec40 con 0x7f34740b5240 2023-11-28T20:07:17.197 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f345b7fe640 1 -- 172.21.15.195:0/2221890742 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f34640c4460 con 0x7f34740b5240 2023-11-28T20:07:17.198 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f345b7fe640 1 -- 172.21.15.195:0/2221890742 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f34640c33c0 con 0x7f34740b5240 2023-11-28T20:07:17.198 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.191+0000 7f34797e6640 1 -- 172.21.15.195:0/2221890742 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34740693d0 con 0x7f34740b5240 2023-11-28T20:07:17.205 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.199+0000 7f345b7fe640 1 -- 172.21.15.195:0/2221890742 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f34640b5070 con 0x7f34740b5240 2023-11-28T20:07:17.263 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:17.261+0000 7f8cf25f8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T20:07:17.270 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.267+0000 7f34797e6640 1 -- 172.21.15.195:0/2221890742 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9b7ec4c2-697e-4a04-a68a-db84cf62856a", "id": 0} v 0) v1 -- 0x7f34740b8d10 con 0x7f34740b5240 2023-11-28T20:07:17.275 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.271+0000 7f345b7fe640 1 -- 172.21.15.195:0/2221890742 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b7ec4c2-697e-4a04-a68a-db84cf62856a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f34640c49e0 con 0x7f34740b5240 2023-11-28T20:07:17.275 INFO:teuthology.orchestra.run.smithi195.stdout:0 2023-11-28T20:07:17.276 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.271+0000 7f34797e6640 1 -- 172.21.15.195:0/2221890742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34740b5240 msgr2=0x7f347414b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.276 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.271+0000 7f34797e6640 1 --2- 172.21.15.195:0/2221890742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34740b5240 0x7f347414b6a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f346401b900 tx=0x7f346401ba90 comp rx=0 tx=0).stop 2023-11-28T20:07:17.276 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.271+0000 7f34797e6640 1 -- 172.21.15.195:0/2221890742 shutdown_connections 2023-11-28T20:07:17.276 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.271+0000 7f34797e6640 1 --2- 172.21.15.195:0/2221890742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f347415d2a0 0x7f347414c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.277 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.271+0000 7f34797e6640 1 --2- 172.21.15.195:0/2221890742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34740b61c0 0x7f347415d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.277 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.271+0000 7f34797e6640 1 --2- 172.21.15.195:0/2221890742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34740b5240 0x7f347414b6a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.277 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.271+0000 7f34797e6640 1 -- 172.21.15.195:0/2221890742 >> 172.21.15.195:0/2221890742 conn(0x7f3474072060 msgr2=0x7f3474072440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:17.277 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.271+0000 7f34797e6640 1 -- 172.21.15.195:0/2221890742 shutdown_connections 2023-11-28T20:07:17.277 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.271+0000 7f34797e6640 1 -- 172.21.15.195:0/2221890742 wait complete. 2023-11-28T20:07:17.294 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 9e60dd25-b21a-4b85-bcd8-440427666cb4 1 2023-11-28T20:07:17.399 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:17.395+0000 7fd2d2dcd180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T20:07:17.434 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.431+0000 7f8cdb916640 1 Processor -- start 2023-11-28T20:07:17.434 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.431+0000 7f8cdb916640 1 -- start start 2023-11-28T20:07:17.436 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.431+0000 7f8cdb916640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd414abe0 0x7f8cd4165a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.436 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.431+0000 7f8cdb916640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8cd40b4520 0x7f8cd40703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.436 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.431+0000 7f8cdb916640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd40b1fc0 con 0x7f8cd414b1e0 2023-11-28T20:07:17.436 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.431+0000 7f8cdb916640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd40b2260 con 0x7f8cd40b4520 2023-11-28T20:07:17.436 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.431+0000 7f8cdb916640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd40b2540 con 0x7f8cd414abe0 2023-11-28T20:07:17.437 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.431+0000 7f8cd9eb3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8cd40b4520 0x7f8cd40703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.437 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.431+0000 7f8cd9eb3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8cd40b4520 0x7f8cd40703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:34470/0 (socket says 172.21.15.195:34470) 2023-11-28T20:07:17.437 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.431+0000 7f8cd9eb3640 1 -- 172.21.15.195:0/1335047799 learned_addr learned my addr 172.21.15.195:0/1335047799 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:17.438 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.431+0000 7f8cd96b2640 1 --2- 172.21.15.195:0/1335047799 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd414abe0 0x7f8cd4165a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.438 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.431+0000 7f8cd9eb3640 1 -- 172.21.15.195:0/1335047799 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd414abe0 msgr2=0x7f8cd4165a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:17.438 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.431+0000 7f8cd9eb3640 1 --2- 172.21.15.195:0/1335047799 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd414abe0 0x7f8cd4165a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.438 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.431+0000 7f8cd9eb3640 1 -- 172.21.15.195:0/1335047799 >> v1:172.21.15.177:6789/0 conn(0x7f8cd414b1e0 legacy=0x7f8cd40b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:17.438 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.431+0000 7f8cd9eb3640 1 -- 172.21.15.195:0/1335047799 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd40b2820 con 0x7f8cd40b4520 2023-11-28T20:07:17.439 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.435+0000 7f8cd9eb3640 1 --2- 172.21.15.195:0/1335047799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b4520 0x7f8cd40703f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009870 tx=0x7f8ccc01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc489715924fc347 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:17.439 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.435+0000 7f8ccbfff640 1 -- 172.21.15.195:0/1335047799 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0aa5f0 con 0x7f8cd40b4520 2023-11-28T20:07:17.439 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.435+0000 7f8ccbfff640 1 -- 172.21.15.195:0/1335047799 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc0aa750 con 0x7f8cd40b4520 2023-11-28T20:07:17.439 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.435+0000 7f8ccbfff640 1 -- 172.21.15.195:0/1335047799 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0aaae0 con 0x7f8cd40b4520 2023-11-28T20:07:17.440 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.435+0000 7f8cdb916640 1 -- 172.21.15.195:0/1335047799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b4520 msgr2=0x7f8cd40703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.440 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.435+0000 7f8cdb916640 1 --2- 172.21.15.195:0/1335047799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b4520 0x7f8cd40703f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009870 tx=0x7f8ccc01c4d0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.440 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.435+0000 7f8cdb916640 1 -- 172.21.15.195:0/1335047799 shutdown_connections 2023-11-28T20:07:17.440 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.435+0000 7f8cdb916640 1 --2- 172.21.15.195:0/1335047799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b4520 0x7f8cd40703f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.441 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.435+0000 7f8cdb916640 1 --2- 172.21.15.195:0/1335047799 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd414abe0 0x7f8cd4165a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.441 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.435+0000 7f8cdb916640 1 -- 172.21.15.195:0/1335047799 >> 172.21.15.195:0/1335047799 conn(0x7f8cd40b0cc0 msgr2=0x7f8cd40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:17.441 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.435+0000 7f8cdb916640 1 -- 172.21.15.195:0/1335047799 shutdown_connections 2023-11-28T20:07:17.441 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.435+0000 7f8cdb916640 1 -- 172.21.15.195:0/1335047799 wait complete. 2023-11-28T20:07:17.442 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cdb916640 1 Processor -- start 2023-11-28T20:07:17.442 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cdb916640 1 -- start start 2023-11-28T20:07:17.444 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cdb916640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b4520 0x7f8cd4166b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.444 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cdb916640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd414abe0 0x7f8cd41610b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.444 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cdb916640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd4145940 0x7f8cd40af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.444 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cdb916640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd4167f50 con 0x7f8cd4145940 2023-11-28T20:07:17.444 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cdb916640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd4169440 con 0x7f8cd40b4520 2023-11-28T20:07:17.444 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cdb916640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd41673d0 con 0x7f8cd414abe0 2023-11-28T20:07:17.444 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cd96b2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b4520 0x7f8cd4166b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.444 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cd8eb1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd414abe0 0x7f8cd41610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cd96b2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b4520 0x7f8cd4166b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:34482/0 (socket says 172.21.15.195:34482) 2023-11-28T20:07:17.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cd96b2640 1 -- 172.21.15.195:0/3812928141 learned_addr learned my addr 172.21.15.195:0/3812928141 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:17.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cd9eb3640 1 --2- 172.21.15.195:0/3812928141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd4145940 0x7f8cd40af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cd96b2640 1 -- 172.21.15.195:0/3812928141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd414abe0 msgr2=0x7f8cd41610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cd96b2640 1 --2- 172.21.15.195:0/3812928141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd414abe0 0x7f8cd41610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cd96b2640 1 -- 172.21.15.195:0/3812928141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd4145940 msgr2=0x7f8cd40af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.446 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cd96b2640 1 --2- 172.21.15.195:0/3812928141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd4145940 0x7f8cd40af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.446 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cd96b2640 1 -- 172.21.15.195:0/3812928141 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0094d0 con 0x7f8cd40b4520 2023-11-28T20:07:17.447 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cd96b2640 1 --2- 172.21.15.195:0/3812928141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b4520 0x7f8cd4166b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000efc0 tx=0x7f8cd000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:17.447 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cc9ffb640 1 -- 172.21.15.195:0/3812928141 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0014480 con 0x7f8cd40b4520 2023-11-28T20:07:17.447 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cc9ffb640 1 -- 172.21.15.195:0/3812928141 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd000f040 con 0x7f8cd40b4520 2023-11-28T20:07:17.447 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cdb916640 1 -- 172.21.15.195:0/3812928141 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd41676b0 con 0x7f8cd40b4520 2023-11-28T20:07:17.448 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.439+0000 7f8cc9ffb640 1 -- 172.21.15.195:0/3812928141 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0014800 con 0x7f8cd40b4520 2023-11-28T20:07:17.448 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.443+0000 7f8cdb916640 1 -- 172.21.15.195:0/3812928141 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd4167c70 con 0x7f8cd40b4520 2023-11-28T20:07:17.448 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.443+0000 7f8cc9ffb640 1 -- 172.21.15.195:0/3812928141 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8cd0014c60 con 0x7f8cd40b4520 2023-11-28T20:07:17.448 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.443+0000 7f8cc9ffb640 1 -- 172.21.15.195:0/3812928141 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f8cd0013790 con 0x7f8cd40b4520 2023-11-28T20:07:17.448 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.443+0000 7f8cdb916640 1 -- 172.21.15.195:0/3812928141 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd40693d0 con 0x7f8cd40b4520 2023-11-28T20:07:17.450 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.447+0000 7f8cc9ffb640 1 -- 172.21.15.195:0/3812928141 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8cd0018020 con 0x7f8cd40b4520 2023-11-28T20:07:17.466 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:17.465+0000 7f8cf25f8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T20:07:17.519 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.515+0000 7f8cdb916640 1 -- 172.21.15.195:0/3812928141 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9e60dd25-b21a-4b85-bcd8-440427666cb4", "id": 1} v 0) v1 -- 0x7f8cd416c2d0 con 0x7f8cd40b4520 2023-11-28T20:07:17.525 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.523+0000 7f8cc9ffb640 1 -- 172.21.15.195:0/3812928141 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9e60dd25-b21a-4b85-bcd8-440427666cb4", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8cd001d530 con 0x7f8cd40b4520 2023-11-28T20:07:17.526 INFO:teuthology.orchestra.run.smithi195.stdout:1 2023-11-28T20:07:17.527 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.523+0000 7f8cdb916640 1 -- 172.21.15.195:0/3812928141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b4520 msgr2=0x7f8cd4166b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.527 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.523+0000 7f8cdb916640 1 --2- 172.21.15.195:0/3812928141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b4520 0x7f8cd4166b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000efc0 tx=0x7f8cd000c490 comp rx=0 tx=0).stop 2023-11-28T20:07:17.527 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.523+0000 7f8cdb916640 1 -- 172.21.15.195:0/3812928141 shutdown_connections 2023-11-28T20:07:17.527 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.523+0000 7f8cdb916640 1 --2- 172.21.15.195:0/3812928141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd4145940 0x7f8cd40af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.527 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.523+0000 7f8cdb916640 1 --2- 172.21.15.195:0/3812928141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd414abe0 0x7f8cd41610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.527 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.523+0000 7f8cdb916640 1 --2- 172.21.15.195:0/3812928141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b4520 0x7f8cd4166b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.528 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.523+0000 7f8cdb916640 1 -- 172.21.15.195:0/3812928141 >> 172.21.15.195:0/3812928141 conn(0x7f8cd40b0cc0 msgr2=0x7f8cd40b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:17.528 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.523+0000 7f8cdb916640 1 -- 172.21.15.195:0/3812928141 shutdown_connections 2023-11-28T20:07:17.528 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.523+0000 7f8cdb916640 1 -- 172.21.15.195:0/3812928141 wait complete. 2023-11-28T20:07:17.545 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1 2 2023-11-28T20:07:17.681 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.675+0000 7efe0a3d1640 1 Processor -- start 2023-11-28T20:07:17.681 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.675+0000 7efe0a3d1640 1 -- start start 2023-11-28T20:07:17.683 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe0a3d1640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efe0415d2b0 0x7efe040d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.683 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe0a3d1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efe040d1cf0 0x7efe040cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.683 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe0a3d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe0415d690 0x7efe040d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.683 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe0a3d1640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe040aff30 con 0x7efe0415d2b0 2023-11-28T20:07:17.683 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe0a3d1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe040b01d0 con 0x7efe040d1cf0 2023-11-28T20:07:17.683 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe0a3d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe040b04b0 con 0x7efe0415d690 2023-11-28T20:07:17.683 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe037fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efe040d1cf0 0x7efe040cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.683 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe0896e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe0415d690 0x7efe040d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.683 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe037fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efe040d1cf0 0x7efe040cfbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:34484/0 (socket says 172.21.15.195:34484) 2023-11-28T20:07:17.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe037fe640 1 -- 172.21.15.195:0/2129324623 learned_addr learned my addr 172.21.15.195:0/2129324623 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:17.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe03fff640 1 --2- 172.21.15.195:0/2129324623 >> v2:172.21.15.177:3300/0 conn(0x7efe0415d2b0 0x7efe040d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe037fe640 1 -- 172.21.15.195:0/2129324623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe0415d690 msgr2=0x7efe040d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:17.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe037fe640 1 --2- 172.21.15.195:0/2129324623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe0415d690 0x7efe040d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe037fe640 1 -- 172.21.15.195:0/2129324623 >> v2:172.21.15.177:3300/0 conn(0x7efe0415d2b0 msgr2=0x7efe040d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:17.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe037fe640 1 --2- 172.21.15.195:0/2129324623 >> v2:172.21.15.177:3300/0 conn(0x7efe0415d2b0 0x7efe040d17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe037fe640 1 -- 172.21.15.195:0/2129324623 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe040b0790 con 0x7efe040d1cf0 2023-11-28T20:07:17.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.679+0000 7efe0896e640 1 --2- 172.21.15.195:0/2129324623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe0415d690 0x7efe040d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:07:17.685 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.683+0000 7efe037fe640 1 --2- 172.21.15.195:0/2129324623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe040d1cf0 0x7efe040cfbe0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efe040b5d60 tx=0x7efdf801c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de8960dd204acd49 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:17.686 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.683+0000 7efe02ffd640 1 -- 172.21.15.195:0/2129324623 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf80ad660 con 0x7efe040d1cf0 2023-11-28T20:07:17.686 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.683+0000 7efe02ffd640 1 -- 172.21.15.195:0/2129324623 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf80ad7c0 con 0x7efe040d1cf0 2023-11-28T20:07:17.686 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.683+0000 7efe02ffd640 1 -- 172.21.15.195:0/2129324623 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf80adb50 con 0x7efe040d1cf0 2023-11-28T20:07:17.687 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.683+0000 7efe0a3d1640 1 -- 172.21.15.195:0/2129324623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe040d1cf0 msgr2=0x7efe040cfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.687 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.683+0000 7efe0a3d1640 1 --2- 172.21.15.195:0/2129324623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe040d1cf0 0x7efe040cfbe0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efe040b5d60 tx=0x7efdf801c500 comp rx=0 tx=0).stop 2023-11-28T20:07:17.687 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.683+0000 7efe0a3d1640 1 -- 172.21.15.195:0/2129324623 shutdown_connections 2023-11-28T20:07:17.687 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.683+0000 7efe0a3d1640 1 --2- 172.21.15.195:0/2129324623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe0415d690 0x7efe040d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.688 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.683+0000 7efe0a3d1640 1 --2- 172.21.15.195:0/2129324623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe040d1cf0 0x7efe040cfbe0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.688 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.683+0000 7efe0a3d1640 1 --2- 172.21.15.195:0/2129324623 >> v2:172.21.15.177:3300/0 conn(0x7efe0415d2b0 0x7efe040d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.688 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.683+0000 7efe0a3d1640 1 -- 172.21.15.195:0/2129324623 >> 172.21.15.195:0/2129324623 conn(0x7efe0409c510 msgr2=0x7efe040d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:17.688 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.683+0000 7efe0a3d1640 1 -- 172.21.15.195:0/2129324623 shutdown_connections 2023-11-28T20:07:17.688 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.683+0000 7efe0a3d1640 1 -- 172.21.15.195:0/2129324623 wait complete. 2023-11-28T20:07:17.688 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.683+0000 7efe0a3d1640 1 Processor -- start 2023-11-28T20:07:17.689 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.683+0000 7efe0a3d1640 1 -- start start 2023-11-28T20:07:17.690 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe0a3d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe040d1cf0 0x7efe0415a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.691 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe0a3d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe0415d2b0 0x7efe040ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.691 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe0a3d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe0415d690 0x7efe040caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.691 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe0a3d1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0414a1d0 con 0x7efe0415d690 2023-11-28T20:07:17.691 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe0a3d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0414a490 con 0x7efe0415d2b0 2023-11-28T20:07:17.691 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe0a3d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0414a770 con 0x7efe040d1cf0 2023-11-28T20:07:17.691 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe03fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe040d1cf0 0x7efe0415a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.691 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe037fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe0415d2b0 0x7efe040ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.691 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe03fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe040d1cf0 0x7efe0415a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:49390/0 (socket says 172.21.15.195:49390) 2023-11-28T20:07:17.691 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe03fff640 1 -- 172.21.15.195:0/2810029640 learned_addr learned my addr 172.21.15.195:0/2810029640 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:17.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe0896e640 1 --2- 172.21.15.195:0/2810029640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe0415d690 0x7efe040caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe037fe640 1 -- 172.21.15.195:0/2810029640 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe040d1cf0 msgr2=0x7efe0415a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe037fe640 1 --2- 172.21.15.195:0/2810029640 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe040d1cf0 0x7efe0415a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe037fe640 1 -- 172.21.15.195:0/2810029640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe0415d690 msgr2=0x7efe040caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe037fe640 1 --2- 172.21.15.195:0/2810029640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe0415d690 0x7efe040caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe037fe640 1 -- 172.21.15.195:0/2810029640 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc009a70 con 0x7efe0415d2b0 2023-11-28T20:07:17.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe037fe640 1 --2- 172.21.15.195:0/2810029640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe0415d2b0 0x7efe040ca540 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efdf80ac000 tx=0x7efdf80192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:17.693 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe00ff9640 1 -- 172.21.15.195:0/2810029640 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf80ba070 con 0x7efe0415d2b0 2023-11-28T20:07:17.693 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe00ff9640 1 -- 172.21.15.195:0/2810029640 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf80b6460 con 0x7efe0415d2b0 2023-11-28T20:07:17.693 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe00ff9640 1 -- 172.21.15.195:0/2810029640 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf80b6810 con 0x7efe0415d2b0 2023-11-28T20:07:17.693 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe0a3d1640 1 -- 172.21.15.195:0/2810029640 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf80094d0 con 0x7efe0415d2b0 2023-11-28T20:07:17.694 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe0a3d1640 1 -- 172.21.15.195:0/2810029640 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0414ad30 con 0x7efe0415d2b0 2023-11-28T20:07:17.694 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe00ff9640 1 -- 172.21.15.195:0/2810029640 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efdf80b4070 con 0x7efe0415d2b0 2023-11-28T20:07:17.694 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe00ff9640 1 -- 172.21.15.195:0/2810029640 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7efdf80bf410 con 0x7efe0415d2b0 2023-11-28T20:07:17.694 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.687+0000 7efe0a3d1640 1 -- 172.21.15.195:0/2810029640 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe040679f0 con 0x7efe0415d2b0 2023-11-28T20:07:17.694 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.691+0000 7efe00ff9640 1 -- 172.21.15.195:0/2810029640 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7efdf80b2070 con 0x7efe0415d2b0 2023-11-28T20:07:17.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.755+0000 7efe0a3d1640 1 -- 172.21.15.195:0/2810029640 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1", "id": 2} v 0) v1 -- 0x7efe040693d0 con 0x7efe0415d2b0 2023-11-28T20:07:17.766 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.763+0000 7efe00ff9640 1 -- 172.21.15.195:0/2810029640 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7efdf80b6c70 con 0x7efe0415d2b0 2023-11-28T20:07:17.769 INFO:teuthology.orchestra.run.smithi195.stdout:2 2023-11-28T20:07:17.770 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.763+0000 7efe0a3d1640 1 -- 172.21.15.195:0/2810029640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe0415d2b0 msgr2=0x7efe040ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.770 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.763+0000 7efe0a3d1640 1 --2- 172.21.15.195:0/2810029640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe0415d2b0 0x7efe040ca540 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efdf80ac000 tx=0x7efdf80192a0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.770 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.763+0000 7efe0a3d1640 1 -- 172.21.15.195:0/2810029640 shutdown_connections 2023-11-28T20:07:17.770 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.763+0000 7efe0a3d1640 1 --2- 172.21.15.195:0/2810029640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe0415d690 0x7efe040caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.770 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.763+0000 7efe0a3d1640 1 --2- 172.21.15.195:0/2810029640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe0415d2b0 0x7efe040ca540 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.770 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.763+0000 7efe0a3d1640 1 --2- 172.21.15.195:0/2810029640 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe040d1cf0 0x7efe0415a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.770 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.763+0000 7efe0a3d1640 1 -- 172.21.15.195:0/2810029640 >> 172.21.15.195:0/2810029640 conn(0x7efe0409c510 msgr2=0x7efe040b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:17.770 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.763+0000 7efe0a3d1640 1 -- 172.21.15.195:0/2810029640 shutdown_connections 2023-11-28T20:07:17.771 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.763+0000 7efe0a3d1640 1 -- 172.21.15.195:0/2810029640 wait complete. 2023-11-28T20:07:17.786 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 3bdda87a-725c-444f-b8cb-cfda18babf9f 3 2023-11-28T20:07:17.922 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.919+0000 7f626f49c640 1 Processor -- start 2023-11-28T20:07:17.923 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.919+0000 7f626f49c640 1 -- start start 2023-11-28T20:07:17.924 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.919+0000 7f626f49c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f626815d2b0 0x7f62680d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.924 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.919+0000 7f626f49c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f62680d02f0 0x7f62680b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.919+0000 7f626f49c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62680aff30 con 0x7f62680d1cf0 2023-11-28T20:07:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.919+0000 7f626f49c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62680b01d0 con 0x7f62680d02f0 2023-11-28T20:07:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.919+0000 7f626f49c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62680b04b0 con 0x7f626815d2b0 2023-11-28T20:07:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.919+0000 7f626d238640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f626815d2b0 0x7f62680d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.919+0000 7f626d238640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f626815d2b0 0x7f62680d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:34510/0 (socket says 172.21.15.195:34510) 2023-11-28T20:07:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.919+0000 7f626d238640 1 -- 172.21.15.195:0/1910598613 learned_addr learned my addr 172.21.15.195:0/1910598613 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:17.926 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.919+0000 7f626da39640 1 --2- 172.21.15.195:0/1910598613 >> v2:172.21.15.177:3300/0 conn(0x7f62680d02f0 0x7f62680b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.926 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.919+0000 7f626d238640 1 -- 172.21.15.195:0/1910598613 >> v2:172.21.15.177:3300/0 conn(0x7f62680d02f0 msgr2=0x7f62680b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:17.926 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.919+0000 7f626d238640 1 --2- 172.21.15.195:0/1910598613 >> v2:172.21.15.177:3300/0 conn(0x7f62680d02f0 0x7f62680b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.926 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.919+0000 7f626d238640 1 -- 172.21.15.195:0/1910598613 >> v1:172.21.15.195:6789/0 conn(0x7f62680d1cf0 legacy=0x7f62680cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.926 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.919+0000 7f626d238640 1 -- 172.21.15.195:0/1910598613 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62680b0790 con 0x7f626815d2b0 2023-11-28T20:07:17.927 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.923+0000 7f626d238640 1 --2- 172.21.15.195:0/1910598613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f626815d2b0 0x7f62680d17b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f626808bcb0 tx=0x7f626401c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83c52b117c0aba44 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:17.928 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.923+0000 7f625ffff640 1 -- 172.21.15.195:0/1910598613 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640a6040 con 0x7f626815d2b0 2023-11-28T20:07:17.928 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.923+0000 7f625ffff640 1 -- 172.21.15.195:0/1910598613 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62640aa600 con 0x7f626815d2b0 2023-11-28T20:07:17.928 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.923+0000 7f625ffff640 1 -- 172.21.15.195:0/1910598613 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640aa990 con 0x7f626815d2b0 2023-11-28T20:07:17.929 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.923+0000 7f626f49c640 1 -- 172.21.15.195:0/1910598613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f626815d2b0 msgr2=0x7f62680d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.929 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.923+0000 7f626f49c640 1 --2- 172.21.15.195:0/1910598613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f626815d2b0 0x7f62680d17b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f626808bcb0 tx=0x7f626401c500 comp rx=0 tx=0).stop 2023-11-28T20:07:17.930 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.923+0000 7f626f49c640 1 -- 172.21.15.195:0/1910598613 shutdown_connections 2023-11-28T20:07:17.930 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.923+0000 7f626f49c640 1 --2- 172.21.15.195:0/1910598613 >> v2:172.21.15.177:3300/0 conn(0x7f62680d02f0 0x7f62680b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.930 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.923+0000 7f626f49c640 1 --2- 172.21.15.195:0/1910598613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f626815d2b0 0x7f62680d17b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.930 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.923+0000 7f626f49c640 1 -- 172.21.15.195:0/1910598613 >> 172.21.15.195:0/1910598613 conn(0x7f626809c510 msgr2=0x7f62680d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:17.931 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.923+0000 7f626f49c640 1 -- 172.21.15.195:0/1910598613 shutdown_connections 2023-11-28T20:07:17.931 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.923+0000 7f626f49c640 1 -- 172.21.15.195:0/1910598613 wait complete. 2023-11-28T20:07:17.933 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626f49c640 1 Processor -- start 2023-11-28T20:07:17.933 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626f49c640 1 -- start start 2023-11-28T20:07:17.933 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626f49c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62680d02f0 0x7f62680ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.933 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626f49c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62680d1cf0 0x7f6268155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.933 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626f49c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f626815d2b0 0x7f6268158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:17.933 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626f49c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62681556c0 con 0x7f62680d1cf0 2023-11-28T20:07:17.934 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626f49c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6268154cf0 con 0x7f62680d02f0 2023-11-28T20:07:17.934 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626f49c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62680ca8f0 con 0x7f626815d2b0 2023-11-28T20:07:17.934 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626d238640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62680d02f0 0x7f62680ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.934 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626da39640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f626815d2b0 0x7f6268158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.934 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626d238640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62680d02f0 0x7f62680ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:34518/0 (socket says 172.21.15.195:34518) 2023-11-28T20:07:17.934 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626d238640 1 -- 172.21.15.195:0/487841221 learned_addr learned my addr 172.21.15.195:0/487841221 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:17.934 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626ca37640 1 --2- 172.21.15.195:0/487841221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62680d1cf0 0x7f6268155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:17.934 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626d238640 1 -- 172.21.15.195:0/487841221 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f626815d2b0 msgr2=0x7f6268158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.934 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626d238640 1 --2- 172.21.15.195:0/487841221 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f626815d2b0 0x7f6268158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.934 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626d238640 1 -- 172.21.15.195:0/487841221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62680d1cf0 msgr2=0x7f6268155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:17.934 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626d238640 1 --2- 172.21.15.195:0/487841221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62680d1cf0 0x7f6268155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:17.935 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626d238640 1 -- 172.21.15.195:0/487841221 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62640094d0 con 0x7f62680d02f0 2023-11-28T20:07:17.935 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626d238640 1 --2- 172.21.15.195:0/487841221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62680d02f0 0x7f62680ca2a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6264019110 tx=0x7f626401ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:17.935 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f625dffb640 1 -- 172.21.15.195:0/487841221 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640b3600 con 0x7f62680d02f0 2023-11-28T20:07:17.935 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f625dffb640 1 -- 172.21.15.195:0/487841221 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62640b3760 con 0x7f62680d02f0 2023-11-28T20:07:17.935 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f625dffb640 1 -- 172.21.15.195:0/487841221 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640b3ad0 con 0x7f62680d02f0 2023-11-28T20:07:17.935 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.927+0000 7f626f49c640 1 -- 172.21.15.195:0/487841221 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6268154400 con 0x7f62680d02f0 2023-11-28T20:07:17.935 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.931+0000 7f625dffb640 1 -- 172.21.15.195:0/487841221 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f62640bd3f0 con 0x7f62680d02f0 2023-11-28T20:07:17.935 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.931+0000 7f626f49c640 1 -- 172.21.15.195:0/487841221 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6268154980 con 0x7f62680d02f0 2023-11-28T20:07:17.936 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.931+0000 7f625dffb640 1 -- 172.21.15.195:0/487841221 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f62640bdbf0 con 0x7f62680d02f0 2023-11-28T20:07:17.936 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.931+0000 7f626f49c640 1 -- 172.21.15.195:0/487841221 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62680679f0 con 0x7f62680d02f0 2023-11-28T20:07:17.938 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.935+0000 7f625dffb640 1 -- 172.21.15.195:0/487841221 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f62640bddb0 con 0x7f62680d02f0 2023-11-28T20:07:18.004 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:17.999+0000 7f626f49c640 1 -- 172.21.15.195:0/487841221 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3bdda87a-725c-444f-b8cb-cfda18babf9f", "id": 3} v 0) v1 -- 0x7f62680693d0 con 0x7f62680d02f0 2023-11-28T20:07:18.011 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.007+0000 7f625dffb640 1 -- 172.21.15.195:0/487841221 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3bdda87a-725c-444f-b8cb-cfda18babf9f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f62640bd830 con 0x7f62680d02f0 2023-11-28T20:07:18.011 INFO:teuthology.orchestra.run.smithi195.stdout:3 2023-11-28T20:07:18.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.007+0000 7f626f49c640 1 -- 172.21.15.195:0/487841221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62680d02f0 msgr2=0x7f62680ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.007+0000 7f626f49c640 1 --2- 172.21.15.195:0/487841221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62680d02f0 0x7f62680ca2a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6264019110 tx=0x7f626401ad40 comp rx=0 tx=0).stop 2023-11-28T20:07:18.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.007+0000 7f626f49c640 1 -- 172.21.15.195:0/487841221 shutdown_connections 2023-11-28T20:07:18.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.007+0000 7f626f49c640 1 --2- 172.21.15.195:0/487841221 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f626815d2b0 0x7f6268158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.013 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.007+0000 7f626f49c640 1 --2- 172.21.15.195:0/487841221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62680d1cf0 0x7f6268155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.013 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.007+0000 7f626f49c640 1 --2- 172.21.15.195:0/487841221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62680d02f0 0x7f62680ca2a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.013 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.007+0000 7f626f49c640 1 -- 172.21.15.195:0/487841221 >> 172.21.15.195:0/487841221 conn(0x7f626809c510 msgr2=0x7f62680b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:18.013 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.007+0000 7f626f49c640 1 -- 172.21.15.195:0/487841221 shutdown_connections 2023-11-28T20:07:18.013 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.007+0000 7f626f49c640 1 -- 172.21.15.195:0/487841221 wait complete. 2023-11-28T20:07:18.030 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 09b28205-53f0-4c2d-9964-721c79ea40f3 4 2023-11-28T20:07:18.063 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:18.059+0000 7fd2d2dcd180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T20:07:18.121 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:18.117+0000 7f8cf25f8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T20:07:18.126 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:18.123+0000 7fd2d2dcd180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T20:07:18.167 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.163+0000 7fb07aa6b640 1 Processor -- start 2023-11-28T20:07:18.167 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.163+0000 7fb07aa6b640 1 -- start start 2023-11-28T20:07:18.169 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.163+0000 7fb07aa6b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb07415d2b0 0x7fb0740d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.169 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.163+0000 7fb07aa6b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb0740d1cf0 0x7fb0740cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.169 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.163+0000 7fb07aa6b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0740aff30 con 0x7fb07415d690 2023-11-28T20:07:18.169 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.163+0000 7fb07aa6b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0740b01d0 con 0x7fb07415d2b0 2023-11-28T20:07:18.169 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.163+0000 7fb07aa6b640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0740b04b0 con 0x7fb0740d1cf0 2023-11-28T20:07:18.169 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.163+0000 7fb073fff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb0740d1cf0 0x7fb0740cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.170 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.163+0000 7fb073fff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb0740d1cf0 0x7fb0740cfbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:34520/0 (socket says 172.21.15.195:34520) 2023-11-28T20:07:18.170 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.163+0000 7fb073fff640 1 -- 172.21.15.195:0/1543430864 learned_addr learned my addr 172.21.15.195:0/1543430864 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:18.170 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.163+0000 7fb078807640 1 --2- 172.21.15.195:0/1543430864 >> v2:172.21.15.177:3300/0 conn(0x7fb07415d2b0 0x7fb0740d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.170 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.167+0000 7fb073fff640 1 -- 172.21.15.195:0/1543430864 >> v2:172.21.15.177:3300/0 conn(0x7fb07415d2b0 msgr2=0x7fb0740d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:18.170 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.167+0000 7fb073fff640 1 --2- 172.21.15.195:0/1543430864 >> v2:172.21.15.177:3300/0 conn(0x7fb07415d2b0 0x7fb0740d17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.170 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.167+0000 7fb073fff640 1 -- 172.21.15.195:0/1543430864 >> v1:172.21.15.177:6789/0 conn(0x7fb07415d690 legacy=0x7fb0740cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.170 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.167+0000 7fb073fff640 1 -- 172.21.15.195:0/1543430864 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0740b0790 con 0x7fb0740d1cf0 2023-11-28T20:07:18.172 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.167+0000 7fb073fff640 1 --2- 172.21.15.195:0/1543430864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0740d1cf0 0x7fb0740cfbe0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb0740b5d60 tx=0x7fb06001c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87f7a38f864a0cfe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:18.172 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.167+0000 7fb0737fe640 1 -- 172.21.15.195:0/1543430864 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0600a6040 con 0x7fb0740d1cf0 2023-11-28T20:07:18.172 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.167+0000 7fb0737fe640 1 -- 172.21.15.195:0/1543430864 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0600aa600 con 0x7fb0740d1cf0 2023-11-28T20:07:18.172 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.167+0000 7fb0737fe640 1 -- 172.21.15.195:0/1543430864 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0600aa990 con 0x7fb0740d1cf0 2023-11-28T20:07:18.173 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 -- 172.21.15.195:0/1543430864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0740d1cf0 msgr2=0x7fb0740cfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.173 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 --2- 172.21.15.195:0/1543430864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0740d1cf0 0x7fb0740cfbe0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb0740b5d60 tx=0x7fb06001c500 comp rx=0 tx=0).stop 2023-11-28T20:07:18.173 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 -- 172.21.15.195:0/1543430864 shutdown_connections 2023-11-28T20:07:18.174 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 --2- 172.21.15.195:0/1543430864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0740d1cf0 0x7fb0740cfbe0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.174 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 --2- 172.21.15.195:0/1543430864 >> v2:172.21.15.177:3300/0 conn(0x7fb07415d2b0 0x7fb0740d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.174 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 -- 172.21.15.195:0/1543430864 >> 172.21.15.195:0/1543430864 conn(0x7fb07409c510 msgr2=0x7fb0740d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:18.174 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 -- 172.21.15.195:0/1543430864 shutdown_connections 2023-11-28T20:07:18.174 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 -- 172.21.15.195:0/1543430864 wait complete. 2023-11-28T20:07:18.174 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 Processor -- start 2023-11-28T20:07:18.175 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 -- start start 2023-11-28T20:07:18.179 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0740d1cf0 0x7fb0741536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.179 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb07415d2b0 0x7fb0740b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.179 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb07415d690 0x7fb074151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.180 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0740b7440 con 0x7fb0740d1cf0 2023-11-28T20:07:18.180 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0740b67c0 con 0x7fb07415d2b0 2023-11-28T20:07:18.180 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb07aa6b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0740b6aa0 con 0x7fb07415d690 2023-11-28T20:07:18.180 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb078807640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0740d1cf0 0x7fb0741536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.180 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb073fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb07415d2b0 0x7fb0740b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.180 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb079008640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb07415d690 0x7fb074151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.180 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb078807640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0740d1cf0 0x7fb0741536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.195:34998/0 (socket says 172.21.15.195:34998) 2023-11-28T20:07:18.180 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb078807640 1 -- 172.21.15.195:0/2172528780 learned_addr learned my addr 172.21.15.195:0/2172528780 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:18.180 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb078807640 1 -- 172.21.15.195:0/2172528780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb07415d690 msgr2=0x7fb074151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.180 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb078807640 1 --2- 172.21.15.195:0/2172528780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb07415d690 0x7fb074151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.180 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb078807640 1 -- 172.21.15.195:0/2172528780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb07415d2b0 msgr2=0x7fb0740b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.181 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb078807640 1 --2- 172.21.15.195:0/2172528780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb07415d2b0 0x7fb0740b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.181 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.171+0000 7fb078807640 1 -- 172.21.15.195:0/2172528780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0600094d0 con 0x7fb0740d1cf0 2023-11-28T20:07:18.181 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.175+0000 7fb078807640 1 --2- 172.21.15.195:0/2172528780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0740d1cf0 0x7fb0741536a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb06800e930 tx=0x7fb06800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:18.181 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.175+0000 7fb0717fa640 1 -- 172.21.15.195:0/2172528780 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb068009690 con 0x7fb0740d1cf0 2023-11-28T20:07:18.181 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.175+0000 7fb0717fa640 1 -- 172.21.15.195:0/2172528780 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06800ca00 con 0x7fb0740d1cf0 2023-11-28T20:07:18.181 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.175+0000 7fb07aa6b640 1 -- 172.21.15.195:0/2172528780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0740b6d80 con 0x7fb0740d1cf0 2023-11-28T20:07:18.181 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.175+0000 7fb0717fa640 1 -- 172.21.15.195:0/2172528780 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06800cd70 con 0x7fb0740d1cf0 2023-11-28T20:07:18.181 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.175+0000 7fb07aa6b640 1 -- 172.21.15.195:0/2172528780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0740b64b0 con 0x7fb0740d1cf0 2023-11-28T20:07:18.181 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.175+0000 7fb0717fa640 1 -- 172.21.15.195:0/2172528780 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb068005ca0 con 0x7fb0740d1cf0 2023-11-28T20:07:18.181 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.175+0000 7fb0717fa640 1 -- 172.21.15.195:0/2172528780 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fb068006530 con 0x7fb0740d1cf0 2023-11-28T20:07:18.181 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.175+0000 7fb07aa6b640 1 -- 172.21.15.195:0/2172528780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0740b76b0 con 0x7fb0740d1cf0 2023-11-28T20:07:18.182 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.179+0000 7fb0717fa640 1 -- 172.21.15.195:0/2172528780 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb068021060 con 0x7fb0740d1cf0 2023-11-28T20:07:18.183 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:18.181+0000 7f8cf25f8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T20:07:18.197 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:18.191+0000 7fd2d2dcd180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T20:07:18.244 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:18.241+0000 7f8cf25f8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T20:07:18.269 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.263+0000 7fb07aa6b640 1 -- 172.21.15.195:0/2172528780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "09b28205-53f0-4c2d-9964-721c79ea40f3", "id": 4} v 0) v1 -- 0x7fb0740679f0 con 0x7fb0740d1cf0 2023-11-28T20:07:18.273 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.271+0000 7fb0717fa640 1 -- 172.21.15.195:0/2172528780 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "09b28205-53f0-4c2d-9964-721c79ea40f3", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb068029020 con 0x7fb0740d1cf0 2023-11-28T20:07:18.273 INFO:teuthology.orchestra.run.smithi195.stdout:4 2023-11-28T20:07:18.274 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.271+0000 7fb07aa6b640 1 -- 172.21.15.195:0/2172528780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0740d1cf0 msgr2=0x7fb0741536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.274 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.271+0000 7fb07aa6b640 1 --2- 172.21.15.195:0/2172528780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0740d1cf0 0x7fb0741536a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb06800e930 tx=0x7fb06800edf0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.275 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.271+0000 7fb07aa6b640 1 -- 172.21.15.195:0/2172528780 shutdown_connections 2023-11-28T20:07:18.275 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.271+0000 7fb07aa6b640 1 --2- 172.21.15.195:0/2172528780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb07415d690 0x7fb074151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.276 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.271+0000 7fb07aa6b640 1 --2- 172.21.15.195:0/2172528780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb07415d2b0 0x7fb0740b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.276 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.271+0000 7fb07aa6b640 1 --2- 172.21.15.195:0/2172528780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0740d1cf0 0x7fb0741536a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.276 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.271+0000 7fb07aa6b640 1 -- 172.21.15.195:0/2172528780 >> 172.21.15.195:0/2172528780 conn(0x7fb07409c510 msgr2=0x7fb074159860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:18.276 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.271+0000 7fb07aa6b640 1 -- 172.21.15.195:0/2172528780 shutdown_connections 2023-11-28T20:07:18.276 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.271+0000 7fb07aa6b640 1 -- 172.21.15.195:0/2172528780 wait complete. 2023-11-28T20:07:18.293 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new fa56bb04-67bf-460d-94d3-c466bcc4de0c 5 2023-11-28T20:07:18.299 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:18.295+0000 7fd2d2dcd180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T20:07:18.333 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:18.329+0000 7f8cf25f8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T20:07:18.361 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:18.355+0000 7fd2d2dcd180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T20:07:18.393 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:18.389+0000 7f8cf25f8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T20:07:18.435 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.431+0000 7f180fa5f640 1 Processor -- start 2023-11-28T20:07:18.435 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.431+0000 7f180fa5f640 1 -- start start 2023-11-28T20:07:18.437 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.431+0000 7f180fa5f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f180815d690 0x7f18080cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.437 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.431+0000 7f180fa5f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18080d0120 0x7f18080b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.437 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.431+0000 7f180fa5f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18080d0540 con 0x7f180815d2b0 2023-11-28T20:07:18.437 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.431+0000 7f180fa5f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18080aff30 con 0x7f180815d690 2023-11-28T20:07:18.438 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.431+0000 7f180fa5f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18080d1ec0 con 0x7f18080d0120 2023-11-28T20:07:18.438 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.431+0000 7f180dffc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18080d0120 0x7f18080b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.438 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.431+0000 7f180dffc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18080d0120 0x7f18080b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:49422/0 (socket says 172.21.15.195:49422) 2023-11-28T20:07:18.438 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.431+0000 7f180dffc640 1 -- 172.21.15.195:0/3141133715 learned_addr learned my addr 172.21.15.195:0/3141133715 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:18.439 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.431+0000 7f180cffa640 1 --2- 172.21.15.195:0/3141133715 >> v2:172.21.15.177:3300/0 conn(0x7f180815d690 0x7f18080cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.439 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.435+0000 7f180cffa640 1 -- 172.21.15.195:0/3141133715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18080d0120 msgr2=0x7f18080b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:18.440 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.435+0000 7f180cffa640 1 --2- 172.21.15.195:0/3141133715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18080d0120 0x7f18080b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.440 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.435+0000 7f180cffa640 1 -- 172.21.15.195:0/3141133715 >> v1:172.21.15.177:6789/0 conn(0x7f180815d2b0 legacy=0x7f18080d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.440 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.435+0000 7f180cffa640 1 -- 172.21.15.195:0/3141133715 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18080b01d0 con 0x7f180815d690 2023-11-28T20:07:18.441 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.435+0000 7f180cffa640 1 --2- 172.21.15.195:0/3141133715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f180815d690 0x7f18080cfbe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f17f80097c0 tx=0x7f17f801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d28e5fafbb6ed8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:18.441 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.435+0000 7f17fffff640 1 -- 172.21.15.195:0/3141133715 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80ab650 con 0x7f180815d690 2023-11-28T20:07:18.441 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.435+0000 7f17fffff640 1 -- 172.21.15.195:0/3141133715 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f80ab7b0 con 0x7f180815d690 2023-11-28T20:07:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.435+0000 7f17fffff640 1 -- 172.21.15.195:0/3141133715 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80abb40 con 0x7f180815d690 2023-11-28T20:07:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 -- 172.21.15.195:0/3141133715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f180815d690 msgr2=0x7f18080cfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 --2- 172.21.15.195:0/3141133715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f180815d690 0x7f18080cfbe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f17f80097c0 tx=0x7f17f801c450 comp rx=0 tx=0).stop 2023-11-28T20:07:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 -- 172.21.15.195:0/3141133715 shutdown_connections 2023-11-28T20:07:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 --2- 172.21.15.195:0/3141133715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f180815d690 0x7f18080cfbe0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 --2- 172.21.15.195:0/3141133715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18080d0120 0x7f18080b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 -- 172.21.15.195:0/3141133715 >> 172.21.15.195:0/3141133715 conn(0x7f180809c510 msgr2=0x7f18080d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 -- 172.21.15.195:0/3141133715 shutdown_connections 2023-11-28T20:07:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 -- 172.21.15.195:0/3141133715 wait complete. 2023-11-28T20:07:18.443 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 Processor -- start 2023-11-28T20:07:18.443 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 -- start start 2023-11-28T20:07:18.444 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18080d0120 0x7f1808156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.444 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f180815d2b0 0x7f1808158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f180815d690 0x7f18080c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18080c6d00 con 0x7f180815d690 2023-11-28T20:07:18.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180806d0a0 con 0x7f18080d0120 2023-11-28T20:07:18.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180fa5f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1808156980 con 0x7f180815d2b0 2023-11-28T20:07:18.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180d7fb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18080d0120 0x7f1808156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180cffa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f180815d2b0 0x7f1808158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180d7fb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18080d0120 0x7f1808156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:34528/0 (socket says 172.21.15.195:34528) 2023-11-28T20:07:18.446 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180d7fb640 1 -- 172.21.15.195:0/1054456177 learned_addr learned my addr 172.21.15.195:0/1054456177 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:18.446 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180dffc640 1 --2- 172.21.15.195:0/1054456177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f180815d690 0x7f18080c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.449 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180d7fb640 1 -- 172.21.15.195:0/1054456177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f180815d2b0 msgr2=0x7f1808158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.449 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.439+0000 7f180d7fb640 1 --2- 172.21.15.195:0/1054456177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f180815d2b0 0x7f1808158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.450 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.443+0000 7f180d7fb640 1 -- 172.21.15.195:0/1054456177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f180815d690 msgr2=0x7f18080c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.450 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.443+0000 7f180d7fb640 1 --2- 172.21.15.195:0/1054456177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f180815d690 0x7f18080c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.450 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.443+0000 7f180d7fb640 1 -- 172.21.15.195:0/1054456177 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f8009420 con 0x7f18080d0120 2023-11-28T20:07:18.450 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.443+0000 7f180d7fb640 1 --2- 172.21.15.195:0/1054456177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18080d0120 0x7f1808156310 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f180400c500 tx=0x7f180400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:18.450 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.443+0000 7f17fdffb640 1 -- 172.21.15.195:0/1054456177 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804005220 con 0x7f18080d0120 2023-11-28T20:07:18.450 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.443+0000 7f17fdffb640 1 -- 172.21.15.195:0/1054456177 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1804005380 con 0x7f18080d0120 2023-11-28T20:07:18.450 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.443+0000 7f17fdffb640 1 -- 172.21.15.195:0/1054456177 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804007270 con 0x7f18080d0120 2023-11-28T20:07:18.450 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.443+0000 7f180fa5f640 1 -- 172.21.15.195:0/1054456177 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1808160180 con 0x7f18080d0120 2023-11-28T20:07:18.451 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.443+0000 7f17fdffb640 1 -- 172.21.15.195:0/1054456177 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f18040067e0 con 0x7f18080d0120 2023-11-28T20:07:18.451 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.443+0000 7f180fa5f640 1 -- 172.21.15.195:0/1054456177 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1808160740 con 0x7f18080d0120 2023-11-28T20:07:18.451 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.443+0000 7f17fdffb640 1 -- 172.21.15.195:0/1054456177 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f1804006cc0 con 0x7f18080d0120 2023-11-28T20:07:18.451 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.443+0000 7f180fa5f640 1 -- 172.21.15.195:0/1054456177 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18080679f0 con 0x7f18080d0120 2023-11-28T20:07:18.451 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.447+0000 7f17fdffb640 1 -- 172.21.15.195:0/1054456177 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1804016020 con 0x7f18080d0120 2023-11-28T20:07:18.454 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:18.451+0000 7fd2d2dcd180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T20:07:18.483 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:18.481+0000 7f8cf25f8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T20:07:18.517 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:18.511+0000 7fd2d2dcd180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T20:07:18.518 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.515+0000 7f180fa5f640 1 -- 172.21.15.195:0/1054456177 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fa56bb04-67bf-460d-94d3-c466bcc4de0c", "id": 5} v 0) v1 -- 0x7f18080c6e70 con 0x7f18080d0120 2023-11-28T20:07:18.523 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.519+0000 7f17fdffb640 1 -- 172.21.15.195:0/1054456177 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa56bb04-67bf-460d-94d3-c466bcc4de0c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f180402a0b0 con 0x7f18080d0120 2023-11-28T20:07:18.523 INFO:teuthology.orchestra.run.smithi195.stdout:5 2023-11-28T20:07:18.524 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.519+0000 7f180fa5f640 1 -- 172.21.15.195:0/1054456177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18080d0120 msgr2=0x7f1808156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.524 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.519+0000 7f180fa5f640 1 --2- 172.21.15.195:0/1054456177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18080d0120 0x7f1808156310 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f180400c500 tx=0x7f180400c9c0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.525 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.519+0000 7f180fa5f640 1 -- 172.21.15.195:0/1054456177 shutdown_connections 2023-11-28T20:07:18.525 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.519+0000 7f180fa5f640 1 --2- 172.21.15.195:0/1054456177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f180815d690 0x7f18080c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.525 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.519+0000 7f180fa5f640 1 --2- 172.21.15.195:0/1054456177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f180815d2b0 0x7f1808158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.525 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.519+0000 7f180fa5f640 1 --2- 172.21.15.195:0/1054456177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18080d0120 0x7f1808156310 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.525 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.519+0000 7f180fa5f640 1 -- 172.21.15.195:0/1054456177 >> 172.21.15.195:0/1054456177 conn(0x7f180809c510 msgr2=0x7f18080d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:18.526 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.519+0000 7f180fa5f640 1 -- 172.21.15.195:0/1054456177 shutdown_connections 2023-11-28T20:07:18.526 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.519+0000 7f180fa5f640 1 -- 172.21.15.195:0/1054456177 wait complete. 2023-11-28T20:07:18.543 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new b88434bd-9fc8-40be-aa7e-1f88288d661c 6 2023-11-28T20:07:18.544 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:18.541+0000 7f8cf25f8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T20:07:18.679 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:18.675+0000 7fd2d2dcd180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T20:07:18.681 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e8432640 1 Processor -- start 2023-11-28T20:07:18.681 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e8432640 1 -- start start 2023-11-28T20:07:18.683 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e8432640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f86e015d2b0 0x7f86e00d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e8432640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f86e00d02f0 0x7f86e00b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e8432640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e00aff30 con 0x7f86e00d1cf0 2023-11-28T20:07:18.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e8432640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e00b01d0 con 0x7f86e00d02f0 2023-11-28T20:07:18.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e8432640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e00b04b0 con 0x7f86e015d2b0 2023-11-28T20:07:18.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e61ce640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f86e015d2b0 0x7f86e00d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e61ce640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f86e015d2b0 0x7f86e00d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:34540/0 (socket says 172.21.15.195:34540) 2023-11-28T20:07:18.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e61ce640 1 -- 172.21.15.195:0/2696904918 learned_addr learned my addr 172.21.15.195:0/2696904918 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:18.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e69cf640 1 --2- 172.21.15.195:0/2696904918 >> v2:172.21.15.177:3300/0 conn(0x7f86e00d02f0 0x7f86e00b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e61ce640 1 -- 172.21.15.195:0/2696904918 >> v2:172.21.15.177:3300/0 conn(0x7f86e00d02f0 msgr2=0x7f86e00b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:18.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e61ce640 1 --2- 172.21.15.195:0/2696904918 >> v2:172.21.15.177:3300/0 conn(0x7f86e00d02f0 0x7f86e00b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.684 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e61ce640 1 -- 172.21.15.195:0/2696904918 >> v1:172.21.15.177:6789/0 conn(0x7f86e00d1cf0 legacy=0x7f86e00cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.685 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e61ce640 1 -- 172.21.15.195:0/2696904918 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e00b0790 con 0x7f86e015d2b0 2023-11-28T20:07:18.685 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.679+0000 7f86e69cf640 1 --2- 172.21.15.195:0/2696904918 >> v2:172.21.15.177:3300/0 conn(0x7f86e00d02f0 0x7f86e00b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:18.686 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.683+0000 7f86e61ce640 1 --2- 172.21.15.195:0/2696904918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e015d2b0 0x7f86e00d17b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f86e008bcb0 tx=0x7f86dc01c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9ed95b1524aec4f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:18.686 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.683+0000 7f86e51cc640 1 -- 172.21.15.195:0/2696904918 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0a6040 con 0x7f86e015d2b0 2023-11-28T20:07:18.686 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.683+0000 7f86e51cc640 1 -- 172.21.15.195:0/2696904918 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc0aa600 con 0x7f86e015d2b0 2023-11-28T20:07:18.687 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.683+0000 7f86e51cc640 1 -- 172.21.15.195:0/2696904918 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0aa990 con 0x7f86e015d2b0 2023-11-28T20:07:18.687 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.683+0000 7f86e8432640 1 -- 172.21.15.195:0/2696904918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e015d2b0 msgr2=0x7f86e00d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.688 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.683+0000 7f86e8432640 1 --2- 172.21.15.195:0/2696904918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e015d2b0 0x7f86e00d17b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f86e008bcb0 tx=0x7f86dc01c500 comp rx=0 tx=0).stop 2023-11-28T20:07:18.688 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.683+0000 7f86e8432640 1 -- 172.21.15.195:0/2696904918 shutdown_connections 2023-11-28T20:07:18.688 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.683+0000 7f86e8432640 1 --2- 172.21.15.195:0/2696904918 >> v2:172.21.15.177:3300/0 conn(0x7f86e00d02f0 0x7f86e00b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.688 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.683+0000 7f86e8432640 1 --2- 172.21.15.195:0/2696904918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e015d2b0 0x7f86e00d17b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.688 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.683+0000 7f86e8432640 1 -- 172.21.15.195:0/2696904918 >> 172.21.15.195:0/2696904918 conn(0x7f86e009c510 msgr2=0x7f86e00d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:18.689 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.683+0000 7f86e8432640 1 -- 172.21.15.195:0/2696904918 shutdown_connections 2023-11-28T20:07:18.689 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.683+0000 7f86e8432640 1 -- 172.21.15.195:0/2696904918 wait complete. 2023-11-28T20:07:18.690 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e8432640 1 Processor -- start 2023-11-28T20:07:18.690 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e8432640 1 -- start start 2023-11-28T20:07:18.691 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e8432640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e00d02f0 0x7f86e00b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.691 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e8432640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e00d1cf0 0x7f86e0142330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.691 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e8432640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86e015d2b0 0x7f86e0142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e8432640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00b8ee0 con 0x7f86e00d02f0 2023-11-28T20:07:18.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e8432640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00b8620 con 0x7f86e00d1cf0 2023-11-28T20:07:18.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e8432640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00b8890 con 0x7f86e015d2b0 2023-11-28T20:07:18.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e61ce640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e00d02f0 0x7f86e00b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e69cf640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86e015d2b0 0x7f86e0142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e61ce640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e00d02f0 0x7f86e00b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.195:35042/0 (socket says 172.21.15.195:35042) 2023-11-28T20:07:18.693 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e61ce640 1 -- 172.21.15.195:0/3566150626 learned_addr learned my addr 172.21.15.195:0/3566150626 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:18.693 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e59cd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e00d1cf0 0x7f86e0142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.694 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e59cd640 1 -- 172.21.15.195:0/3566150626 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86e015d2b0 msgr2=0x7f86e0142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.695 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e59cd640 1 --2- 172.21.15.195:0/3566150626 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86e015d2b0 0x7f86e0142870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.695 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e59cd640 1 -- 172.21.15.195:0/3566150626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e00d02f0 msgr2=0x7f86e00b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.695 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e59cd640 1 --2- 172.21.15.195:0/3566150626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e00d02f0 0x7f86e00b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.695 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e59cd640 1 -- 172.21.15.195:0/3566150626 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc0094d0 con 0x7f86e00d1cf0 2023-11-28T20:07:18.695 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e61ce640 1 --2- 172.21.15.195:0/3566150626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e00d02f0 0x7f86e00b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:07:18.696 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e59cd640 1 --2- 172.21.15.195:0/3566150626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e00d1cf0 0x7f86e0142330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86d0000f70 tx=0x7f86d000c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:18.696 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86d6ffd640 1 -- 172.21.15.195:0/3566150626 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d00052d0 con 0x7f86e00d1cf0 2023-11-28T20:07:18.696 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86d6ffd640 1 -- 172.21.15.195:0/3566150626 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d0005430 con 0x7f86e00d1cf0 2023-11-28T20:07:18.696 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86d6ffd640 1 -- 172.21.15.195:0/3566150626 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0003840 con 0x7f86e00d1cf0 2023-11-28T20:07:18.696 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e8432640 1 -- 172.21.15.195:0/3566150626 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e00b8b70 con 0x7f86e00d1cf0 2023-11-28T20:07:18.696 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e8432640 1 -- 172.21.15.195:0/3566150626 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e00ccdd0 con 0x7f86e00d1cf0 2023-11-28T20:07:18.696 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86d6ffd640 1 -- 172.21.15.195:0/3566150626 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f86d0003ca0 con 0x7f86e00d1cf0 2023-11-28T20:07:18.696 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86d6ffd640 1 -- 172.21.15.195:0/3566150626 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f86d0012a10 con 0x7f86e00d1cf0 2023-11-28T20:07:18.696 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.687+0000 7f86e8432640 1 -- 172.21.15.195:0/3566150626 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e00679f0 con 0x7f86e00d1cf0 2023-11-28T20:07:18.696 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.691+0000 7f86d6ffd640 1 -- 172.21.15.195:0/3566150626 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f86d0017070 con 0x7f86e00d1cf0 2023-11-28T20:07:18.699 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:18.697+0000 7f8cf25f8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T20:07:18.751 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:18.747+0000 7fd2d2dcd180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T20:07:18.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.755+0000 7f86e8432640 1 -- 172.21.15.195:0/3566150626 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b88434bd-9fc8-40be-aa7e-1f88288d661c", "id": 6} v 0) v1 -- 0x7f86e015a660 con 0x7f86e00d1cf0 2023-11-28T20:07:18.765 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.763+0000 7f86d6ffd640 1 -- 172.21.15.195:0/3566150626 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b88434bd-9fc8-40be-aa7e-1f88288d661c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f86d0011680 con 0x7f86e00d1cf0 2023-11-28T20:07:18.765 INFO:teuthology.orchestra.run.smithi195.stdout:6 2023-11-28T20:07:18.766 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.763+0000 7f86e8432640 1 -- 172.21.15.195:0/3566150626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e00d1cf0 msgr2=0x7f86e0142330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.766 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.763+0000 7f86e8432640 1 --2- 172.21.15.195:0/3566150626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e00d1cf0 0x7f86e0142330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86d0000f70 tx=0x7f86d000c890 comp rx=0 tx=0).stop 2023-11-28T20:07:18.767 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.763+0000 7f86e8432640 1 -- 172.21.15.195:0/3566150626 shutdown_connections 2023-11-28T20:07:18.767 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.763+0000 7f86e8432640 1 --2- 172.21.15.195:0/3566150626 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86e015d2b0 0x7f86e0142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.767 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.763+0000 7f86e8432640 1 --2- 172.21.15.195:0/3566150626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e00d1cf0 0x7f86e0142330 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.767 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.763+0000 7f86e8432640 1 --2- 172.21.15.195:0/3566150626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e00d02f0 0x7f86e00b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.767 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.763+0000 7f86e8432640 1 -- 172.21.15.195:0/3566150626 >> 172.21.15.195:0/3566150626 conn(0x7f86e009c510 msgr2=0x7f86e00b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:18.767 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.763+0000 7f86e8432640 1 -- 172.21.15.195:0/3566150626 shutdown_connections 2023-11-28T20:07:18.768 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.763+0000 7f86e8432640 1 -- 172.21.15.195:0/3566150626 wait complete. 2023-11-28T20:07:18.768 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:18.765+0000 7f8cf25f8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T20:07:18.786 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 8e53b777-ef71-4d71-9d5c-f7f7067218b7 7 2023-11-28T20:07:18.924 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.919+0000 7f192b05f640 1 Processor -- start 2023-11-28T20:07:18.925 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.919+0000 7f192b05f640 1 -- start start 2023-11-28T20:07:18.926 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.923+0000 7f192b05f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f192415d2b0 0x7f19240d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.927 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.923+0000 7f192b05f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19240d1cf0 0x7f19240cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.927 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.923+0000 7f192b05f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19240aff30 con 0x7f192415d690 2023-11-28T20:07:18.927 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.923+0000 7f192b05f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240b01d0 con 0x7f192415d2b0 2023-11-28T20:07:18.927 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.923+0000 7f192b05f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19240b04b0 con 0x7f19240d1cf0 2023-11-28T20:07:18.928 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.923+0000 7f1928dfb640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f192415d2b0 0x7f19240d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.928 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.923+0000 7f1923fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19240d1cf0 0x7f19240cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.928 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.923+0000 7f1928dfb640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f192415d2b0 0x7f19240d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:34558/0 (socket says 172.21.15.195:34558) 2023-11-28T20:07:18.928 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.923+0000 7f1928dfb640 1 -- 172.21.15.195:0/1637806418 learned_addr learned my addr 172.21.15.195:0/1637806418 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:18.928 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.923+0000 7f1928dfb640 1 -- 172.21.15.195:0/1637806418 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19240d1cf0 msgr2=0x7f19240cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:18.928 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.923+0000 7f1928dfb640 1 --2- 172.21.15.195:0/1637806418 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19240d1cf0 0x7f19240cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.929 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.923+0000 7f1928dfb640 1 -- 172.21.15.195:0/1637806418 >> v1:172.21.15.177:6789/0 conn(0x7f192415d690 legacy=0x7f19240cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:18.929 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.923+0000 7f1928dfb640 1 -- 172.21.15.195:0/1637806418 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19240b0790 con 0x7f192415d2b0 2023-11-28T20:07:18.929 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.927+0000 7f1928dfb640 1 --2- 172.21.15.195:0/1637806418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f192415d2b0 0x7f19240d17b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1918009870 tx=0x7f191801c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82810f1ac40b3e91 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:18.931 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.927+0000 7f19237fe640 1 -- 172.21.15.195:0/1637806418 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19180ab660 con 0x7f192415d2b0 2023-11-28T20:07:18.931 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.927+0000 7f19237fe640 1 -- 172.21.15.195:0/1637806418 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19180ab7c0 con 0x7f192415d2b0 2023-11-28T20:07:18.931 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.927+0000 7f19237fe640 1 -- 172.21.15.195:0/1637806418 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19180abb50 con 0x7f192415d2b0 2023-11-28T20:07:18.932 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.927+0000 7f192b05f640 1 -- 172.21.15.195:0/1637806418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f192415d2b0 msgr2=0x7f19240d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.932 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.927+0000 7f192b05f640 1 --2- 172.21.15.195:0/1637806418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f192415d2b0 0x7f19240d17b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1918009870 tx=0x7f191801c500 comp rx=0 tx=0).stop 2023-11-28T20:07:18.932 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.927+0000 7f192b05f640 1 -- 172.21.15.195:0/1637806418 shutdown_connections 2023-11-28T20:07:18.932 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.927+0000 7f192b05f640 1 --2- 172.21.15.195:0/1637806418 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19240d1cf0 0x7f19240cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.933 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.927+0000 7f192b05f640 1 --2- 172.21.15.195:0/1637806418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f192415d2b0 0x7f19240d17b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.933 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.927+0000 7f192b05f640 1 -- 172.21.15.195:0/1637806418 >> 172.21.15.195:0/1637806418 conn(0x7f192409c510 msgr2=0x7f19240d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:18.933 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.927+0000 7f192b05f640 1 -- 172.21.15.195:0/1637806418 shutdown_connections 2023-11-28T20:07:18.933 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.927+0000 7f192b05f640 1 -- 172.21.15.195:0/1637806418 wait complete. 2023-11-28T20:07:18.936 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.927+0000 7f192b05f640 1 Processor -- start 2023-11-28T20:07:18.936 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.927+0000 7f192b05f640 1 -- start start 2023-11-28T20:07:18.937 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f192b05f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19240d1cf0 0x7f1924151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.937 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f192b05f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f192415d2b0 0x7f19240c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.937 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f192b05f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f192415d690 0x7f192415f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:18.937 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f192b05f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19240ca740 con 0x7f192415d2b0 2023-11-28T20:07:18.937 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f192b05f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19241522b0 con 0x7f19240d1cf0 2023-11-28T20:07:18.938 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f192b05f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19240c8210 con 0x7f192415d690 2023-11-28T20:07:18.938 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f1928dfb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19240d1cf0 0x7f1924151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.938 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f1928dfb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19240d1cf0 0x7f1924151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:34566/0 (socket says 172.21.15.195:34566) 2023-11-28T20:07:18.939 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f1928dfb640 1 -- 172.21.15.195:0/1406113503 learned_addr learned my addr 172.21.15.195:0/1406113503 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-11-28T20:07:18.939 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f19295fc640 1 --2- 172.21.15.195:0/1406113503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f192415d690 0x7f192415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.939 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f1923fff640 1 --2- 172.21.15.195:0/1406113503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f192415d2b0 0x7f19240c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:18.939 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f1928dfb640 1 -- 172.21.15.195:0/1406113503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f192415d690 msgr2=0x7f192415f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.939 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f1928dfb640 1 --2- 172.21.15.195:0/1406113503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f192415d690 0x7f192415f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.939 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f1928dfb640 1 -- 172.21.15.195:0/1406113503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f192415d2b0 msgr2=0x7f19240c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:18.940 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f1928dfb640 1 --2- 172.21.15.195:0/1406113503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f192415d2b0 0x7f19240c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:18.940 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f1928dfb640 1 -- 172.21.15.195:0/1406113503 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19180094d0 con 0x7f19240d1cf0 2023-11-28T20:07:18.940 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f1928dfb640 1 --2- 172.21.15.195:0/1406113503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19240d1cf0 0x7f1924151d70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f19180ad040 tx=0x7f191801ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:18.940 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f19217fa640 1 -- 172.21.15.195:0/1406113503 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19180b4800 con 0x7f19240d1cf0 2023-11-28T20:07:18.940 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f19217fa640 1 -- 172.21.15.195:0/1406113503 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19180b4980 con 0x7f19240d1cf0 2023-11-28T20:07:18.940 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f192b05f640 1 -- 172.21.15.195:0/1406113503 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19240c84f0 con 0x7f19240d1cf0 2023-11-28T20:07:18.940 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f19217fa640 1 -- 172.21.15.195:0/1406113503 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19180b4d30 con 0x7f19240d1cf0 2023-11-28T20:07:18.940 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f192b05f640 1 -- 172.21.15.195:0/1406113503 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19240c8ab0 con 0x7f19240d1cf0 2023-11-28T20:07:18.941 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f19217fa640 1 -- 172.21.15.195:0/1406113503 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f19180a9070 con 0x7f19240d1cf0 2023-11-28T20:07:18.941 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f19217fa640 1 -- 172.21.15.195:0/1406113503 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f19180ab5e0 con 0x7f19240d1cf0 2023-11-28T20:07:18.941 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.931+0000 7f192b05f640 1 -- 172.21.15.195:0/1406113503 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19240679f0 con 0x7f19240d1cf0 2023-11-28T20:07:18.941 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.935+0000 7f19217fa640 1 -- 172.21.15.195:0/1406113503 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f19180c4060 con 0x7f19240d1cf0 2023-11-28T20:07:19.004 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:18.999+0000 7f192b05f640 1 -- 172.21.15.195:0/1406113503 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8e53b777-ef71-4d71-9d5c-f7f7067218b7", "id": 7} v 0) v1 -- 0x7f19240693d0 con 0x7f19240d1cf0 2023-11-28T20:07:19.009 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:19.003+0000 7f19217fa640 1 -- 172.21.15.195:0/1406113503 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e53b777-ef71-4d71-9d5c-f7f7067218b7", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f19180cd0b0 con 0x7f19240d1cf0 2023-11-28T20:07:19.009 INFO:teuthology.orchestra.run.smithi195.stdout:7 2023-11-28T20:07:19.010 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:19.007+0000 7f192b05f640 1 -- 172.21.15.195:0/1406113503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19240d1cf0 msgr2=0x7f1924151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:19.010 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:19.007+0000 7f192b05f640 1 --2- 172.21.15.195:0/1406113503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19240d1cf0 0x7f1924151d70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f19180ad040 tx=0x7f191801ad40 comp rx=0 tx=0).stop 2023-11-28T20:07:19.010 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:19.007+0000 7f192b05f640 1 -- 172.21.15.195:0/1406113503 shutdown_connections 2023-11-28T20:07:19.010 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:19.007+0000 7f192b05f640 1 --2- 172.21.15.195:0/1406113503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f192415d690 0x7f192415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:19.011 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:19.007+0000 7f192b05f640 1 --2- 172.21.15.195:0/1406113503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f192415d2b0 0x7f19240c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:19.011 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:19.007+0000 7f192b05f640 1 --2- 172.21.15.195:0/1406113503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19240d1cf0 0x7f1924151d70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:19.011 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:19.007+0000 7f192b05f640 1 -- 172.21.15.195:0/1406113503 >> 172.21.15.195:0/1406113503 conn(0x7f192409c510 msgr2=0x7f19240d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:19.011 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:19.007+0000 7f192b05f640 1 -- 172.21.15.195:0/1406113503 shutdown_connections 2023-11-28T20:07:19.011 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:07:19.007+0000 7f192b05f640 1 -- 172.21.15.195:0/1406113503 wait complete. 2023-11-28T20:07:19.028 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-28T20:07:19.028 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-28T20:07:19.032 INFO:tasks.ceph.osd.0:Started 2023-11-28T20:07:19.032 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-28T20:07:19.032 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-28T20:07:19.036 INFO:tasks.ceph.osd.1:Started 2023-11-28T20:07:19.036 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-28T20:07:19.036 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-28T20:07:19.039 INFO:tasks.ceph.osd.2:Started 2023-11-28T20:07:19.040 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-28T20:07:19.040 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-28T20:07:19.043 INFO:tasks.ceph.osd.3:Started 2023-11-28T20:07:19.043 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-28T20:07:19.043 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-28T20:07:19.047 INFO:tasks.ceph.osd.4:Started 2023-11-28T20:07:19.047 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-28T20:07:19.047 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-28T20:07:19.050 INFO:tasks.ceph.osd.5:Started 2023-11-28T20:07:19.050 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-28T20:07:19.051 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-28T20:07:19.054 INFO:tasks.ceph.osd.6:Started 2023-11-28T20:07:19.055 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-28T20:07:19.056 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-28T20:07:19.059 INFO:tasks.ceph.osd.7:Started 2023-11-28T20:07:19.060 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:07:19.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.257+0000 7f04a11d1640 1 Processor -- start 2023-11-28T20:07:19.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.257+0000 7f04a11d1640 1 -- start start 2023-11-28T20:07:19.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.261+0000 7f04a11d1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f049c0b35b0 0x7f049c0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:19.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.261+0000 7f04a11d1640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f049c0b3c70 0x7f049c15f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:19.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.261+0000 7f04a11d1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c0d3880 con 0x7f049c0cf780 2023-11-28T20:07:19.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.261+0000 7f04a11d1640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c0d4090 con 0x7f049c0b3c70 2023-11-28T20:07:19.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.261+0000 7f04a11d1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c0cdc80 con 0x7f049c0b35b0 2023-11-28T20:07:19.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.261+0000 7f049a59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f049c0b3c70 0x7f049c15f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:19.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.261+0000 7f049a59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f049c0b3c70 0x7f049c15f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49712/0 (socket says 172.21.15.177:49712) 2023-11-28T20:07:19.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.261+0000 7f049a59c640 1 -- 172.21.15.177:0/3044356534 learned_addr learned my addr 172.21.15.177:0/3044356534 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:19.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.261+0000 7f049ad9d640 1 --2- 172.21.15.177:0/3044356534 >> v2:172.21.15.195:3300/0 conn(0x7f049c0b35b0 0x7f049c0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:19.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.261+0000 7f049a59c640 1 -- 172.21.15.177:0/3044356534 >> v2:172.21.15.195:3300/0 conn(0x7f049c0b35b0 msgr2=0x7f049c0d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:19.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.261+0000 7f049a59c640 1 --2- 172.21.15.177:0/3044356534 >> v2:172.21.15.195:3300/0 conn(0x7f049c0b35b0 0x7f049c0d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:19.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.261+0000 7f049a59c640 1 -- 172.21.15.177:0/3044356534 >> v1:172.21.15.195:6789/0 conn(0x7f049c0cf780 legacy=0x7f049c0ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:19.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.261+0000 7f049a59c640 1 -- 172.21.15.177:0/3044356534 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c0d3ad0 con 0x7f049c0b3c70 2023-11-28T20:07:19.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.265+0000 7f049a59c640 1 --2- 172.21.15.177:0/3044356534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f049c0b3c70 0x7f049c15f060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f049c08c9e0 tx=0x7f049001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8e9d8125d65019 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:19.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.265+0000 7f0499d9b640 1 -- 172.21.15.177:0/3044356534 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04900aa660 con 0x7f049c0b3c70 2023-11-28T20:07:19.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.265+0000 7f0499d9b640 1 -- 172.21.15.177:0/3044356534 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04900aa7c0 con 0x7f049c0b3c70 2023-11-28T20:07:19.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.265+0000 7f0499d9b640 1 -- 172.21.15.177:0/3044356534 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04900aab50 con 0x7f049c0b3c70 2023-11-28T20:07:19.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.265+0000 7f04a11d1640 1 -- 172.21.15.177:0/3044356534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f049c0b3c70 msgr2=0x7f049c15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:19.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.265+0000 7f04a11d1640 1 --2- 172.21.15.177:0/3044356534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f049c0b3c70 0x7f049c15f060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f049c08c9e0 tx=0x7f049001c500 comp rx=0 tx=0).stop 2023-11-28T20:07:19.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.265+0000 7f04a11d1640 1 -- 172.21.15.177:0/3044356534 shutdown_connections 2023-11-28T20:07:19.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.265+0000 7f04a11d1640 1 --2- 172.21.15.177:0/3044356534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f049c0b3c70 0x7f049c15f060 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:19.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.265+0000 7f04a11d1640 1 --2- 172.21.15.177:0/3044356534 >> v2:172.21.15.195:3300/0 conn(0x7f049c0b35b0 0x7f049c0d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:19.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.265+0000 7f04a11d1640 1 -- 172.21.15.177:0/3044356534 >> 172.21.15.177:0/3044356534 conn(0x7f049c09c4b0 msgr2=0x7f049c0d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:19.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.265+0000 7f04a11d1640 1 -- 172.21.15.177:0/3044356534 shutdown_connections 2023-11-28T20:07:19.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.265+0000 7f04a11d1640 1 -- 172.21.15.177:0/3044356534 wait complete. 2023-11-28T20:07:19.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.265+0000 7f04a11d1640 1 Processor -- start 2023-11-28T20:07:19.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.265+0000 7f04a11d1640 1 -- start start 2023-11-28T20:07:19.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f04a11d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f049c0b35b0 0x7f049c1f9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:19.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f04a11d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f049c0b3c70 0x7f049c15af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:19.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f04a11d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f049c0cf780 0x7f049c15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:19.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f04a11d1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0b6300 con 0x7f049c0cf780 2023-11-28T20:07:19.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f04a11d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c157720 con 0x7f049c0b35b0 2023-11-28T20:07:19.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f04a11d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c157a00 con 0x7f049c0b3c70 2023-11-28T20:07:19.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f049b59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f049c0cf780 0x7f049c15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:19.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f049b59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f049c0cf780 0x7f049c15b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49720/0 (socket says 172.21.15.177:49720) 2023-11-28T20:07:19.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f049b59e640 1 -- 172.21.15.177:0/3709140936 learned_addr learned my addr 172.21.15.177:0/3709140936 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:19.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f049ad9d640 1 --2- 172.21.15.177:0/3709140936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f049c0b35b0 0x7f049c1f9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:19.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f049a59c640 1 --2- 172.21.15.177:0/3709140936 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f049c0b3c70 0x7f049c15af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:19.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f049b59e640 1 -- 172.21.15.177:0/3709140936 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f049c0b3c70 msgr2=0x7f049c15af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:19.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f049b59e640 1 --2- 172.21.15.177:0/3709140936 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f049c0b3c70 0x7f049c15af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:19.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f049b59e640 1 -- 172.21.15.177:0/3709140936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f049c0b35b0 msgr2=0x7f049c1f9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:19.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f049b59e640 1 --2- 172.21.15.177:0/3709140936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f049c0b35b0 0x7f049c1f9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:19.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f049b59e640 1 -- 172.21.15.177:0/3709140936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04900094d0 con 0x7f049c0cf780 2023-11-28T20:07:19.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f049b59e640 1 --2- 172.21.15.177:0/3709140936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f049c0cf780 0x7f049c15b470 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f049400c730 tx=0x7f049400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:19.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f04837fe640 1 -- 172.21.15.177:0/3709140936 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494003b80 con 0x7f049c0cf780 2023-11-28T20:07:19.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f04837fe640 1 -- 172.21.15.177:0/3709140936 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0494003ce0 con 0x7f049c0cf780 2023-11-28T20:07:19.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f04a11d1640 1 -- 172.21.15.177:0/3709140936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049c0d0120 con 0x7f049c0cf780 2023-11-28T20:07:19.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f04837fe640 1 -- 172.21.15.177:0/3709140936 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494005310 con 0x7f049c0cf780 2023-11-28T20:07:19.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f04a11d1640 1 -- 172.21.15.177:0/3709140936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049c1f9740 con 0x7f049c0cf780 2023-11-28T20:07:19.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f04837fe640 1 -- 172.21.15.177:0/3709140936 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f049400a640 con 0x7f049c0cf780 2023-11-28T20:07:19.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f04837fe640 1 -- 172.21.15.177:0/3709140936 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0494012560 con 0x7f049c0cf780 2023-11-28T20:07:19.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.269+0000 7f04a11d1640 1 -- 172.21.15.177:0/3709140936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049c0b6440 con 0x7f049c0cf780 2023-11-28T20:07:19.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.273+0000 7f04837fe640 1 -- 172.21.15.177:0/3709140936 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f049c0b6440 con 0x7f049c0cf780 2023-11-28T20:07:19.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.329+0000 7f04a11d1640 1 -- 172.21.15.177:0/3709140936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f049c069440 con 0x7f049c0cf780 2023-11-28T20:07:19.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.329+0000 7f04837fe640 1 -- 172.21.15.177:0/3709140936 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f049400a8f0 con 0x7f049c0cf780 2023-11-28T20:07:19.332 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:19.333 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":10,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:19.006585+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:07:19.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.329+0000 7f04a11d1640 1 -- 172.21.15.177:0/3709140936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f049c0cf780 msgr2=0x7f049c15b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:19.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.329+0000 7f04a11d1640 1 --2- 172.21.15.177:0/3709140936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f049c0cf780 0x7f049c15b470 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f049400c730 tx=0x7f049400cbf0 comp rx=0 tx=0).stop 2023-11-28T20:07:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.329+0000 7f04a11d1640 1 -- 172.21.15.177:0/3709140936 shutdown_connections 2023-11-28T20:07:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.329+0000 7f04a11d1640 1 --2- 172.21.15.177:0/3709140936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f049c0cf780 0x7f049c15b470 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.329+0000 7f04a11d1640 1 --2- 172.21.15.177:0/3709140936 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f049c0b3c70 0x7f049c15af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.329+0000 7f04a11d1640 1 --2- 172.21.15.177:0/3709140936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f049c0b35b0 0x7f049c1f9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.329+0000 7f04a11d1640 1 -- 172.21.15.177:0/3709140936 >> 172.21.15.177:0/3709140936 conn(0x7f049c09c4b0 msgr2=0x7f049c06cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:19.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.329+0000 7f04a11d1640 1 -- 172.21.15.177:0/3709140936 shutdown_connections 2023-11-28T20:07:19.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:19.329+0000 7f04a11d1640 1 -- 172.21.15.177:0/3709140936 wait complete. 2023-11-28T20:07:19.352 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-28T20:07:19.352 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-28T20:07:19.385 INFO:tasks.ceph.mgr.y.smithi177.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T20:07:19.386 INFO:tasks.ceph.mgr.y.smithi177.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T20:07:19.386 INFO:tasks.ceph.mgr.y.smithi177.stderr: from numpy import show_config as show_numpy_config 2023-11-28T20:07:19.422 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:19.421+0000 7f8cf25f8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T20:07:19.439 INFO:tasks.ceph.mgr.x.smithi195.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T20:07:19.440 INFO:tasks.ceph.mgr.x.smithi195.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T20:07:19.440 INFO:tasks.ceph.mgr.x.smithi195.stderr: from numpy import show_config as show_numpy_config 2023-11-28T20:07:19.482 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:19.479+0000 7fd2d2dcd180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T20:07:19.560 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:19.557+0000 7f8cf25f8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T20:07:19.617 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:19.611+0000 7fd2d2dcd180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T20:07:19.726 INFO:tasks.ceph.osd.5.smithi195.stderr:2023-11-28T20:07:19.723+0000 7fd0520f3640 -1 Falling back to public interface 2023-11-28T20:07:19.729 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:19.725+0000 7f8cf25f8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T20:07:19.730 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-28T20:07:19.729+0000 7f8320446640 -1 Falling back to public interface 2023-11-28T20:07:19.734 INFO:tasks.ceph.osd.4.smithi195.stderr:2023-11-28T20:07:19.731+0000 7f62cfc2b640 -1 Falling back to public interface 2023-11-28T20:07:19.735 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-28T20:07:19.733+0000 7f8a1c55c640 -1 Falling back to public interface 2023-11-28T20:07:19.751 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-28T20:07:19.749+0000 7fd801531640 -1 Falling back to public interface 2023-11-28T20:07:19.759 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-28T20:07:19.757+0000 7f63f5192640 -1 Falling back to public interface 2023-11-28T20:07:19.766 INFO:tasks.ceph.osd.6.smithi195.stderr:2023-11-28T20:07:19.763+0000 7fbb3dd09640 -1 Falling back to public interface 2023-11-28T20:07:19.782 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:19.779+0000 7fd2d2dcd180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T20:07:19.803 INFO:tasks.ceph.osd.7.smithi195.stderr:2023-11-28T20:07:19.799+0000 7f03d6880640 -1 Falling back to public interface 2023-11-28T20:07:19.809 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:19.805+0000 7f8cf25f8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T20:07:19.861 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:19.855+0000 7fd2d2dcd180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T20:07:19.951 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:19.949+0000 7f8cf25f8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T20:07:20.003 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:19.999+0000 7fd2d2dcd180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T20:07:20.157 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T20:07:20.284 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.281+0000 7f8561491640 1 Processor -- start 2023-11-28T20:07:20.284 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.281+0000 7f8561491640 1 -- start start 2023-11-28T20:07:20.286 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.285+0000 7f8561491640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f855c15c4c0 0x7f855c165f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:20.286 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.285+0000 7f8561491640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855c072160 con 0x7f855c071d00 2023-11-28T20:07:20.286 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.285+0000 7f8561491640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855c0705e0 con 0x7f855c0b41d0 2023-11-28T20:07:20.286 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.285+0000 7f8561491640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c071680 con 0x7f855c15c4c0 2023-11-28T20:07:20.286 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.285+0000 7f855a7fc640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f855c071d00 0x7f855c15f5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:43466/0 (socket says 172.21.15.177:43466) 2023-11-28T20:07:20.286 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.285+0000 7f855a7fc640 1 -- 172.21.15.177:0/313437962 learned_addr learned my addr 172.21.15.177:0/313437962 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:20.287 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.285+0000 7f855b7fe640 1 --2- 172.21.15.177:0/313437962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f855c15c4c0 0x7f855c165f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:20.287 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.285+0000 7f8559ffb640 1 -- 172.21.15.177:0/313437962 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701828195 0 0) 0x7f855c072160 con 0x7f855c071d00 2023-11-28T20:07:20.287 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.285+0000 7f8559ffb640 1 -- 172.21.15.177:0/313437962 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8544003530 con 0x7f855c071d00 2023-11-28T20:07:20.287 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.285+0000 7f855b7fe640 1 -- 172.21.15.177:0/313437962 >> v1:172.21.15.195:6789/0 conn(0x7f855c0b41d0 legacy=0x7f855c0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:20.287 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.285+0000 7f855b7fe640 1 -- 172.21.15.177:0/313437962 >> v1:172.21.15.177:6789/0 conn(0x7f855c071d00 legacy=0x7f855c15f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:20.288 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.285+0000 7f8559ffb640 1 -- 172.21.15.177:0/313437962 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3449279980 0 0) 0x7f8544003530 con 0x7f855c071d00 2023-11-28T20:07:20.288 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.285+0000 7f855b7fe640 1 -- 172.21.15.177:0/313437962 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c0708c0 con 0x7f855c15c4c0 2023-11-28T20:07:20.289 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.285+0000 7f855b7fe640 1 --2- 172.21.15.177:0/313437962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f855c15c4c0 0x7f855c165f70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8554009dc0 tx=0x7f855401c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60986ac0eab10878 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:20.290 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.289+0000 7f8559ffb640 1 -- 172.21.15.177:0/313437962 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8550001680 con 0x7f855c15c4c0 2023-11-28T20:07:20.290 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.289+0000 7f8559ffb640 1 -- 172.21.15.177:0/313437962 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85540a56a0 con 0x7f855c15c4c0 2023-11-28T20:07:20.290 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.289+0000 7f8559ffb640 1 -- 172.21.15.177:0/313437962 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85540a5a30 con 0x7f855c15c4c0 2023-11-28T20:07:20.291 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.289+0000 7f8561491640 1 -- 172.21.15.177:0/313437962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f855c15c4c0 msgr2=0x7f855c165f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:20.291 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.289+0000 7f8561491640 1 --2- 172.21.15.177:0/313437962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f855c15c4c0 0x7f855c165f70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8554009dc0 tx=0x7f855401c860 comp rx=0 tx=0).stop 2023-11-28T20:07:20.291 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.289+0000 7f8561491640 1 -- 172.21.15.177:0/313437962 shutdown_connections 2023-11-28T20:07:20.291 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.289+0000 7f8561491640 1 --2- 172.21.15.177:0/313437962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f855c15c4c0 0x7f855c165f70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:20.291 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.289+0000 7f8561491640 1 -- 172.21.15.177:0/313437962 >> 172.21.15.177:0/313437962 conn(0x7f855c06c5e0 msgr2=0x7f855c06c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:20.291 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.289+0000 7f8561491640 1 -- 172.21.15.177:0/313437962 shutdown_connections 2023-11-28T20:07:20.291 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.289+0000 7f8561491640 1 -- 172.21.15.177:0/313437962 wait complete. 2023-11-28T20:07:20.292 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.289+0000 7f8561491640 1 Processor -- start 2023-11-28T20:07:20.292 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.289+0000 7f8561491640 1 -- start start 2023-11-28T20:07:20.295 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f8561491640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f855c071d00 0x7f855c14bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:20.296 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f8561491640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f855c0b41d0 0x7f855c0b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:20.296 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f8561491640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f855c15c4c0 0x7f855c15dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:20.296 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f8561491640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c15d840 con 0x7f855c15c4c0 2023-11-28T20:07:20.296 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f8561491640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c14c660 con 0x7f855c071d00 2023-11-28T20:07:20.296 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f8561491640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c14c940 con 0x7f855c0b41d0 2023-11-28T20:07:20.296 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f855b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f855c15c4c0 0x7f855c15dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:20.296 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f855b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f855c15c4c0 0x7f855c15dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49730/0 (socket says 172.21.15.177:49730) 2023-11-28T20:07:20.296 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f855b7fe640 1 -- 172.21.15.177:0/3622139348 learned_addr learned my addr 172.21.15.177:0/3622139348 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:20.296 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f855affd640 1 --2- 172.21.15.177:0/3622139348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f855c071d00 0x7f855c14bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:20.296 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f855a7fc640 1 --2- 172.21.15.177:0/3622139348 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f855c0b41d0 0x7f855c0b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:20.297 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f855b7fe640 1 -- 172.21.15.177:0/3622139348 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f855c0b41d0 msgr2=0x7f855c0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:20.297 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f855b7fe640 1 --2- 172.21.15.177:0/3622139348 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f855c0b41d0 0x7f855c0b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:20.298 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f855b7fe640 1 -- 172.21.15.177:0/3622139348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f855c071d00 msgr2=0x7f855c14bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:20.298 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f855b7fe640 1 --2- 172.21.15.177:0/3622139348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f855c071d00 0x7f855c14bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:20.298 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f855b7fe640 1 -- 172.21.15.177:0/3622139348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8554009a70 con 0x7f855c15c4c0 2023-11-28T20:07:20.298 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f855affd640 1 --2- 172.21.15.177:0/3622139348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f855c071d00 0x7f855c14bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:07:20.298 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f855b7fe640 1 --2- 172.21.15.177:0/3622139348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f855c15c4c0 0x7f855c15dc60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f85540b0040 tx=0x7f8554019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:20.298 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f85437fe640 1 -- 172.21.15.177:0/3622139348 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85540b9860 con 0x7f855c15c4c0 2023-11-28T20:07:20.298 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f85437fe640 1 -- 172.21.15.177:0/3622139348 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85540b99c0 con 0x7f855c15c4c0 2023-11-28T20:07:20.298 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f85437fe640 1 -- 172.21.15.177:0/3622139348 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85540b9d70 con 0x7f855c15c4c0 2023-11-28T20:07:20.299 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f8561491640 1 -- 172.21.15.177:0/3622139348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c15d460 con 0x7f855c15c4c0 2023-11-28T20:07:20.299 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f8561491640 1 -- 172.21.15.177:0/3622139348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c14cc20 con 0x7f855c15c4c0 2023-11-28T20:07:20.299 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f85437fe640 1 -- 172.21.15.177:0/3622139348 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f85540ad740 con 0x7f855c15c4c0 2023-11-28T20:07:20.300 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f85437fe640 1 -- 172.21.15.177:0/3622139348 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f85540c2b70 con 0x7f855c15c4c0 2023-11-28T20:07:20.300 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.293+0000 7f8561491640 1 -- 172.21.15.177:0/3622139348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c066c50 con 0x7f855c15c4c0 2023-11-28T20:07:20.300 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.297+0000 7f85437fe640 1 -- 172.21.15.177:0/3622139348 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f855c066c50 con 0x7f855c15c4c0 2023-11-28T20:07:20.354 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.353+0000 7f8561491640 1 -- 172.21.15.177:0/3622139348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f855c15d980 con 0x7f855c15c4c0 2023-11-28T20:07:20.355 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.353+0000 7f85437fe640 1 -- 172.21.15.177:0/3622139348 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f855c15d980 con 0x7f855c15c4c0 2023-11-28T20:07:20.355 INFO:teuthology.misc.health.smithi177.stdout: 2023-11-28T20:07:20.355 INFO:teuthology.misc.health.smithi177.stdout:{"epoch":10,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:19.006585+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:07:20.356 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.353+0000 7f8561491640 1 -- 172.21.15.177:0/3622139348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f855c15c4c0 msgr2=0x7f855c15dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:20.356 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.353+0000 7f8561491640 1 --2- 172.21.15.177:0/3622139348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f855c15c4c0 0x7f855c15dc60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f85540b0040 tx=0x7f8554019600 comp rx=0 tx=0).stop 2023-11-28T20:07:20.356 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.353+0000 7f8561491640 1 -- 172.21.15.177:0/3622139348 shutdown_connections 2023-11-28T20:07:20.356 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.353+0000 7f8561491640 1 --2- 172.21.15.177:0/3622139348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f855c15c4c0 0x7f855c15dc60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:20.357 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.353+0000 7f8561491640 1 --2- 172.21.15.177:0/3622139348 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f855c0b41d0 0x7f855c0b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:20.357 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.353+0000 7f8561491640 1 --2- 172.21.15.177:0/3622139348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f855c071d00 0x7f855c14bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:20.357 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.353+0000 7f8561491640 1 -- 172.21.15.177:0/3622139348 >> 172.21.15.177:0/3622139348 conn(0x7f855c06c5e0 msgr2=0x7f855c0cc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:20.357 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.353+0000 7f8561491640 1 -- 172.21.15.177:0/3622139348 shutdown_connections 2023-11-28T20:07:20.357 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:20.353+0000 7f8561491640 1 -- 172.21.15.177:0/3622139348 wait complete. 2023-11-28T20:07:20.374 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T20:07:20.639 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:20.637+0000 7f8cf25f8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T20:07:20.674 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:20.671+0000 7fd2d2dcd180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T20:07:20.727 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:20.725+0000 7f8cf25f8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T20:07:20.761 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:20.755+0000 7fd2d2dcd180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T20:07:20.917 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:20.913+0000 7f8cf25f8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T20:07:20.950 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:20.947+0000 7fd2d2dcd180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T20:07:21.003 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:21.001+0000 7f8cf25f8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T20:07:21.035 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:21.031+0000 7fd2d2dcd180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T20:07:21.332 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:21.329+0000 7f8cf25f8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T20:07:21.360 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:21.355+0000 7fd2d2dcd180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T20:07:21.401 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:21.397+0000 7f8cf25f8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T20:07:21.430 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-11-28T20:07:21.427+0000 7fd2d2dcd180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T20:07:22.422 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:22.421+0000 7f8c99c77640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-28T20:07:22.423 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-28T20:07:22.421+0000 7f8c99c77640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-28T20:07:23.568 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-28T20:07:23.565+0000 7f8320446640 -1 osd.0 0 log_to_monitors true 2023-11-28T20:07:23.650 INFO:tasks.ceph.osd.5.smithi195.stderr:2023-11-28T20:07:23.647+0000 7fd0520f3640 -1 osd.5 0 log_to_monitors true 2023-11-28T20:07:23.689 INFO:tasks.ceph.osd.4.smithi195.stderr:2023-11-28T20:07:23.683+0000 7f62cfc2b640 -1 osd.4 0 log_to_monitors true 2023-11-28T20:07:23.690 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-28T20:07:23.689+0000 7f8a1c55c640 -1 osd.3 0 log_to_monitors true 2023-11-28T20:07:23.700 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-28T20:07:23.697+0000 7f63f5192640 -1 osd.1 0 log_to_monitors true 2023-11-28T20:07:23.722 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-28T20:07:23.721+0000 7fd801531640 -1 osd.2 0 log_to_monitors true 2023-11-28T20:07:23.776 INFO:tasks.ceph.osd.7.smithi195.stderr:2023-11-28T20:07:23.771+0000 7f03d6880640 -1 osd.7 0 log_to_monitors true 2023-11-28T20:07:23.815 INFO:tasks.ceph.osd.6.smithi195.stderr:2023-11-28T20:07:23.811+0000 7fbb3dd09640 -1 osd.6 0 log_to_monitors true 2023-11-28T20:07:27.165 INFO:tasks.ceph.osd.4.smithi195.stderr:2023-11-28T20:07:27.159+0000 7f62ca96d640 -1 osd.4 0 waiting for initial osdmap 2023-11-28T20:07:27.169 INFO:tasks.ceph.osd.7.smithi195.stderr:2023-11-28T20:07:27.167+0000 7f03d2008640 -1 osd.7 0 waiting for initial osdmap 2023-11-28T20:07:27.180 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T20:07:27.195 INFO:tasks.ceph.osd.4.smithi195.stderr:2023-11-28T20:07:27.191+0000 7f62c2fba640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:07:27.211 INFO:tasks.ceph.osd.7.smithi195.stderr:2023-11-28T20:07:27.207+0000 7f03ca655640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:07:27.227 INFO:tasks.ceph.osd.6.smithi195.stderr:2023-11-28T20:07:27.223+0000 7fbb3948f640 -1 osd.6 0 waiting for initial osdmap 2023-11-28T20:07:27.238 INFO:tasks.ceph.osd.5.smithi195.stderr:2023-11-28T20:07:27.235+0000 7fd04d879640 -1 osd.5 0 waiting for initial osdmap 2023-11-28T20:07:27.259 INFO:tasks.ceph.osd.6.smithi195.stderr:2023-11-28T20:07:27.255+0000 7fbb31adc640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:07:27.266 INFO:tasks.ceph.osd.5.smithi195.stderr:2023-11-28T20:07:27.263+0000 7fd045ec6640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:07:27.401 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.397+0000 7f6c0f59e640 1 Processor -- start 2023-11-28T20:07:27.402 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.397+0000 7f6c0f59e640 1 -- start start 2023-11-28T20:07:27.406 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.401+0000 7f6c0f59e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6c080e0ff0 0x7f6c08039dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:27.406 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.401+0000 7f6c0f59e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c08050470 con 0x7f6c08033990 2023-11-28T20:07:27.406 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.401+0000 7f6c0f59e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c08050de0 con 0x7f6c0804bb70 2023-11-28T20:07:27.407 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.401+0000 7f6c0f59e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c080e13d0 con 0x7f6c080e0ff0 2023-11-28T20:07:27.407 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.401+0000 7f6c0e59c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6c080e0ff0 0x7f6c08039dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:27.407 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.401+0000 7f6c0e59c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6c080e0ff0 0x7f6c08039dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:38332/0 (socket says 172.21.15.177:38332) 2023-11-28T20:07:27.407 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.401+0000 7f6c0e59c640 1 -- 172.21.15.177:0/1963947701 learned_addr learned my addr 172.21.15.177:0/1963947701 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:27.407 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.401+0000 7f6c0e59c640 1 -- 172.21.15.177:0/1963947701 >> v1:172.21.15.195:6789/0 conn(0x7f6c0804bb70 legacy=0x7f6c0804f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:27.409 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.401+0000 7f6c0e59c640 1 -- 172.21.15.177:0/1963947701 >> v1:172.21.15.177:6789/0 conn(0x7f6c08033990 legacy=0x7f6c0804fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:27.409 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.401+0000 7f6c0e59c640 1 -- 172.21.15.177:0/1963947701 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c080510c0 con 0x7f6c080e0ff0 2023-11-28T20:07:27.410 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.405+0000 7f6c0e59c640 1 --2- 172.21.15.177:0/1963947701 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c080e0ff0 0x7f6c08039dc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009870 tx=0x7f6c0001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bbc42a4ba87cbed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:27.410 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.409+0000 7f6c0d59a640 1 -- 172.21.15.177:0/1963947701 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000aa430 con 0x7f6c080e0ff0 2023-11-28T20:07:27.411 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.409+0000 7f6c0d59a640 1 -- 172.21.15.177:0/1963947701 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c000aa590 con 0x7f6c080e0ff0 2023-11-28T20:07:27.411 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.409+0000 7f6c0d59a640 1 -- 172.21.15.177:0/1963947701 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000aa920 con 0x7f6c080e0ff0 2023-11-28T20:07:27.411 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.409+0000 7f6c0f59e640 1 -- 172.21.15.177:0/1963947701 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c080e0ff0 msgr2=0x7f6c08039dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:27.412 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.409+0000 7f6c0f59e640 1 --2- 172.21.15.177:0/1963947701 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c080e0ff0 0x7f6c08039dc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009870 tx=0x7f6c0001c4d0 comp rx=0 tx=0).stop 2023-11-28T20:07:27.412 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.409+0000 7f6c0f59e640 1 -- 172.21.15.177:0/1963947701 shutdown_connections 2023-11-28T20:07:27.413 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.409+0000 7f6c0f59e640 1 --2- 172.21.15.177:0/1963947701 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c080e0ff0 0x7f6c08039dc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:27.413 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.409+0000 7f6c0f59e640 1 -- 172.21.15.177:0/1963947701 >> 172.21.15.177:0/1963947701 conn(0x7f6c08009f90 msgr2=0x7f6c0800a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:27.413 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.409+0000 7f6c0f59e640 1 -- 172.21.15.177:0/1963947701 shutdown_connections 2023-11-28T20:07:27.416 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.409+0000 7f6c0f59e640 1 -- 172.21.15.177:0/1963947701 wait complete. 2023-11-28T20:07:27.416 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.413+0000 7f6c0f59e640 1 Processor -- start 2023-11-28T20:07:27.416 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.413+0000 7f6c0f59e640 1 -- start start 2023-11-28T20:07:27.419 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.417+0000 7f6c0f59e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08033990 0x7f6c080cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:27.419 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.417+0000 7f6c0f59e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c0804bb70 0x7f6c080d4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:27.420 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.417+0000 7f6c0f59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c080e0ff0 0x7f6c080d5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:27.420 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.417+0000 7f6c0e59c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08033990 0x7f6c080cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:27.420 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.417+0000 7f6c0e59c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08033990 0x7f6c080cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:59712/0 (socket says 172.21.15.177:59712) 2023-11-28T20:07:27.420 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.417+0000 7f6c0dd9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c0804bb70 0x7f6c080d4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:27.420 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.417+0000 7f6c0dd9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c0804bb70 0x7f6c080d4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:38348/0 (socket says 172.21.15.177:38348) 2023-11-28T20:07:27.421 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.417+0000 7f6c0ed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c080e0ff0 0x7f6c080d5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:27.421 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.417+0000 7f6c0ed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c080e0ff0 0x7f6c080d5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49848/0 (socket says 172.21.15.177:49848) 2023-11-28T20:07:27.421 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.417+0000 7f6c0e59c640 1 -- 172.21.15.177:0/3458035310 learned_addr learned my addr 172.21.15.177:0/3458035310 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:27.421 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.417+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3458035310 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c080d3c00 con 0x7f6c080e0ff0 2023-11-28T20:07:27.421 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.417+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3458035310 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c080d5e60 con 0x7f6c0804bb70 2023-11-28T20:07:27.421 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.417+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3458035310 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c080d5b80 con 0x7f6c08033990 2023-11-28T20:07:27.424 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.421+0000 7f6c0ed9d640 1 -- 172.21.15.177:0/3458035310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08033990 msgr2=0x7f6c080cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:27.424 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.421+0000 7f6c0ed9d640 1 --2- 172.21.15.177:0/3458035310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08033990 0x7f6c080cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:27.424 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.421+0000 7f6c0ed9d640 1 -- 172.21.15.177:0/3458035310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c0804bb70 msgr2=0x7f6c080d4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:27.424 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.421+0000 7f6c0ed9d640 1 --2- 172.21.15.177:0/3458035310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c0804bb70 0x7f6c080d4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:27.424 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.421+0000 7f6c0ed9d640 1 -- 172.21.15.177:0/3458035310 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c000094d0 con 0x7f6c080e0ff0 2023-11-28T20:07:27.424 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.421+0000 7f6c0ed9d640 1 --2- 172.21.15.177:0/3458035310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c080e0ff0 0x7f6c080d5500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6c100642f0 tx=0x7f6c100678a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:27.424 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.421+0000 7f6bfeffd640 1 -- 172.21.15.177:0/3458035310 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1006bc90 con 0x7f6c080e0ff0 2023-11-28T20:07:27.424 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.421+0000 7f6bfeffd640 1 -- 172.21.15.177:0/3458035310 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1006be50 con 0x7f6c080e0ff0 2023-11-28T20:07:27.424 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.421+0000 7f6bfeffd640 1 -- 172.21.15.177:0/3458035310 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10072390 con 0x7f6c080e0ff0 2023-11-28T20:07:27.427 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.421+0000 7f6c0dd9b640 1 --2- 172.21.15.177:0/3458035310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c0804bb70 0x7f6c080d4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:27.427 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.421+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3458035310 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c08049420 con 0x7f6c080e0ff0 2023-11-28T20:07:27.427 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.421+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3458035310 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c080499e0 con 0x7f6c080e0ff0 2023-11-28T20:07:27.427 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.425+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3458035310 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c08049c00 con 0x7f6c080e0ff0 2023-11-28T20:07:27.427 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.425+0000 7f6c0e59c640 1 --2- 172.21.15.177:0/3458035310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08033990 0x7f6c080cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:27.435 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.433+0000 7f6bfeffd640 1 -- 172.21.15.177:0/3458035310 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f6c10090020 con 0x7f6c080e0ff0 2023-11-28T20:07:27.435 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.433+0000 7f6bfeffd640 1 --2- 172.21.15.177:0/3458035310 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bf00663e0 0x7f6bf00688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:27.435 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.433+0000 7f6bfeffd640 1 -- 172.21.15.177:0/3458035310 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f6c100fd2d0 con 0x7f6c080e0ff0 2023-11-28T20:07:27.437 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.433+0000 7f6c0e59c640 1 --2- 172.21.15.177:0/3458035310 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bf00663e0 0x7f6bf00688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:27.438 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.437+0000 7f6c0e59c640 1 --2- 172.21.15.177:0/3458035310 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bf00663e0 0x7f6bf00688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6c0001c510 tx=0x7f6c00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:27.453 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.449+0000 7f6bfeffd640 1 -- 172.21.15.177:0/3458035310 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c100cb630 con 0x7f6c080e0ff0 2023-11-28T20:07:27.781 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.777+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3458035310 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c080089b0 con 0x7f6c080e0ff0 2023-11-28T20:07:27.783 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.781+0000 7f6bfeffd640 1 -- 172.21.15.177:0/3458035310 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6c100cec50 con 0x7f6c080e0ff0 2023-11-28T20:07:27.783 INFO:teuthology.misc.health.smithi177.stdout: 2023-11-28T20:07:27.784 INFO:teuthology.misc.health.smithi177.stdout:{"epoch":12,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:25.430001+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:07:27.786 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.785+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3458035310 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bf00663e0 msgr2=0x7f6bf00688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:27.786 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.785+0000 7f6c0f59e640 1 --2- 172.21.15.177:0/3458035310 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bf00663e0 0x7f6bf00688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6c0001c510 tx=0x7f6c00008040 comp rx=0 tx=0).stop 2023-11-28T20:07:27.787 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.785+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3458035310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c080e0ff0 msgr2=0x7f6c080d5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:27.787 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.785+0000 7f6c0f59e640 1 --2- 172.21.15.177:0/3458035310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c080e0ff0 0x7f6c080d5500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6c100642f0 tx=0x7f6c100678a0 comp rx=0 tx=0).stop 2023-11-28T20:07:27.787 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.785+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3458035310 shutdown_connections 2023-11-28T20:07:27.787 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.785+0000 7f6c0f59e640 1 --2- 172.21.15.177:0/3458035310 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bf00663e0 0x7f6bf00688a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:27.787 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.785+0000 7f6c0f59e640 1 --2- 172.21.15.177:0/3458035310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c080e0ff0 0x7f6c080d5500 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:27.787 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.785+0000 7f6c0f59e640 1 --2- 172.21.15.177:0/3458035310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c0804bb70 0x7f6c080d4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:27.788 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.785+0000 7f6c0f59e640 1 --2- 172.21.15.177:0/3458035310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08033990 0x7f6c080cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:27.788 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.785+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3458035310 >> 172.21.15.177:0/3458035310 conn(0x7f6c08009f90 msgr2=0x7f6c080dc720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:27.788 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.785+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3458035310 shutdown_connections 2023-11-28T20:07:27.788 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:27.785+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3458035310 wait complete. 2023-11-28T20:07:27.819 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T20:07:27.894 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-28T20:07:27.893+0000 7fd7fccb7640 -1 osd.2 0 waiting for initial osdmap 2023-11-28T20:07:27.896 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-28T20:07:27.893+0000 7f63f0918640 -1 osd.1 0 waiting for initial osdmap 2023-11-28T20:07:27.904 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-28T20:07:27.901+0000 7f8a19518640 -1 osd.3 0 waiting for initial osdmap 2023-11-28T20:07:27.923 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-28T20:07:27.921+0000 7f63e8f65640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:07:27.939 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-28T20:07:27.937+0000 7fd7f5304640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:07:27.945 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-28T20:07:27.941+0000 7f831bbcc640 -1 osd.0 0 waiting for initial osdmap 2023-11-28T20:07:27.959 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-28T20:07:27.957+0000 7f8a1032f640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:07:27.971 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-28T20:07:27.969+0000 7f8314219640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:07:34.625 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T20:07:34.761 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.757+0000 7fbf50157640 1 Processor -- start 2023-11-28T20:07:34.761 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.757+0000 7fbf50157640 1 -- start start 2023-11-28T20:07:34.763 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.761+0000 7fbf50157640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbf4813f910 0x7fbf480717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:34.763 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.761+0000 7fbf50157640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbf481429d0 0x7fbf480b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:34.764 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.761+0000 7fbf50157640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf480ccf60 con 0x7fbf480b4b90 2023-11-28T20:07:34.764 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.761+0000 7fbf50157640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf48072710 con 0x7fbf481429d0 2023-11-28T20:07:34.764 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.761+0000 7fbf50157640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf480b4fe0 con 0x7fbf4813f910 2023-11-28T20:07:34.764 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.761+0000 7fbf4d6f2640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbf481429d0 0x7fbf480b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:34.764 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.761+0000 7fbf4d6f2640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbf481429d0 0x7fbf480b4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51182/0 (socket says 172.21.15.177:51182) 2023-11-28T20:07:34.764 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.761+0000 7fbf4d6f2640 1 -- 172.21.15.177:0/3906903826 learned_addr learned my addr 172.21.15.177:0/3906903826 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:34.764 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.761+0000 7fbf4def3640 1 --2- 172.21.15.177:0/3906903826 >> v2:172.21.15.195:3300/0 conn(0x7fbf4813f910 0x7fbf480717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:34.764 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.761+0000 7fbf4d6f2640 1 -- 172.21.15.177:0/3906903826 >> v2:172.21.15.195:3300/0 conn(0x7fbf4813f910 msgr2=0x7fbf480717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:34.764 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.761+0000 7fbf4d6f2640 1 --2- 172.21.15.177:0/3906903826 >> v2:172.21.15.195:3300/0 conn(0x7fbf4813f910 0x7fbf480717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:34.764 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.761+0000 7fbf4d6f2640 1 -- 172.21.15.177:0/3906903826 >> v1:172.21.15.195:6789/0 conn(0x7fbf480b4b90 legacy=0x7fbf4815d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:34.764 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.761+0000 7fbf4d6f2640 1 -- 172.21.15.177:0/3906903826 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf48071e70 con 0x7fbf481429d0 2023-11-28T20:07:34.765 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.761+0000 7fbf4def3640 1 --2- 172.21.15.177:0/3906903826 >> v2:172.21.15.195:3300/0 conn(0x7fbf4813f910 0x7fbf480717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:34.769 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.765+0000 7fbf4d6f2640 1 --2- 172.21.15.177:0/3906903826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf481429d0 0x7fbf480b4650 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbf480729b0 tx=0x7fbf3801e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894f38f73b0f34c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:34.773 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.765+0000 7fbf4cef1640 1 -- 172.21.15.177:0/3906903826 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38004230 con 0x7fbf481429d0 2023-11-28T20:07:34.773 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.765+0000 7fbf4cef1640 1 -- 172.21.15.177:0/3906903826 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf380ab070 con 0x7fbf481429d0 2023-11-28T20:07:34.773 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.765+0000 7fbf4cef1640 1 -- 172.21.15.177:0/3906903826 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf380a7790 con 0x7fbf481429d0 2023-11-28T20:07:34.773 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.765+0000 7fbf50157640 1 -- 172.21.15.177:0/3906903826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf481429d0 msgr2=0x7fbf480b4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:34.773 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.765+0000 7fbf50157640 1 --2- 172.21.15.177:0/3906903826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf481429d0 0x7fbf480b4650 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbf480729b0 tx=0x7fbf3801e940 comp rx=0 tx=0).stop 2023-11-28T20:07:34.773 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.765+0000 7fbf50157640 1 -- 172.21.15.177:0/3906903826 shutdown_connections 2023-11-28T20:07:34.773 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.765+0000 7fbf50157640 1 --2- 172.21.15.177:0/3906903826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf481429d0 0x7fbf480b4650 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:34.773 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.765+0000 7fbf50157640 1 --2- 172.21.15.177:0/3906903826 >> v2:172.21.15.195:3300/0 conn(0x7fbf4813f910 0x7fbf480717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:34.773 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.765+0000 7fbf50157640 1 -- 172.21.15.177:0/3906903826 >> 172.21.15.177:0/3906903826 conn(0x7fbf4806c5e0 msgr2=0x7fbf4806c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:34.774 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.765+0000 7fbf50157640 1 -- 172.21.15.177:0/3906903826 shutdown_connections 2023-11-28T20:07:34.774 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.765+0000 7fbf50157640 1 -- 172.21.15.177:0/3906903826 wait complete. 2023-11-28T20:07:34.774 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.765+0000 7fbf50157640 1 Processor -- start 2023-11-28T20:07:34.774 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.765+0000 7fbf50157640 1 -- start start 2023-11-28T20:07:34.774 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf50157640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf480b4b90 0x7fbf480b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:34.774 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf50157640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf4813f910 0x7fbf48162c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:34.774 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf50157640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf481429d0 0x7fbf480b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:34.774 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf50157640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480b0ed0 con 0x7fbf481429d0 2023-11-28T20:07:34.774 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf50157640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480b2a30 con 0x7fbf4813f910 2023-11-28T20:07:34.774 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf50157640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480b2750 con 0x7fbf480b4b90 2023-11-28T20:07:34.774 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf4e6f4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf481429d0 0x7fbf480b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:34.774 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf4e6f4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf481429d0 0x7fbf480b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51188/0 (socket says 172.21.15.177:51188) 2023-11-28T20:07:34.775 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf4e6f4640 1 -- 172.21.15.177:0/4167193699 learned_addr learned my addr 172.21.15.177:0/4167193699 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:34.775 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf4d6f2640 1 --2- 172.21.15.177:0/4167193699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf4813f910 0x7fbf48162c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:34.775 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf4def3640 1 --2- 172.21.15.177:0/4167193699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf480b4b90 0x7fbf480b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:34.775 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf4e6f4640 1 -- 172.21.15.177:0/4167193699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf480b4b90 msgr2=0x7fbf480b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:34.775 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf4e6f4640 1 --2- 172.21.15.177:0/4167193699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf480b4b90 0x7fbf480b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:34.775 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf4e6f4640 1 -- 172.21.15.177:0/4167193699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf4813f910 msgr2=0x7fbf48162c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:34.775 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf4e6f4640 1 --2- 172.21.15.177:0/4167193699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf4813f910 0x7fbf48162c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:34.775 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf4e6f4640 1 -- 172.21.15.177:0/4167193699 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3800b780 con 0x7fbf481429d0 2023-11-28T20:07:34.775 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf4e6f4640 1 --2- 172.21.15.177:0/4167193699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf481429d0 0x7fbf480b12f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000c7b0 tx=0x7fbf4000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:34.775 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf3e7fc640 1 -- 172.21.15.177:0/4167193699 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40004b70 con 0x7fbf481429d0 2023-11-28T20:07:34.775 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf3e7fc640 1 -- 172.21.15.177:0/4167193699 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf40004cd0 con 0x7fbf481429d0 2023-11-28T20:07:34.775 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf50157640 1 -- 172.21.15.177:0/4167193699 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf480b0810 con 0x7fbf481429d0 2023-11-28T20:07:34.776 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf3e7fc640 1 -- 172.21.15.177:0/4167193699 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000aa90 con 0x7fbf481429d0 2023-11-28T20:07:34.776 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf50157640 1 -- 172.21.15.177:0/4167193699 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf480b2440 con 0x7fbf481429d0 2023-11-28T20:07:34.776 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.769+0000 7fbf50157640 1 -- 172.21.15.177:0/4167193699 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf480b1010 con 0x7fbf481429d0 2023-11-28T20:07:34.776 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.773+0000 7fbf3e7fc640 1 -- 172.21.15.177:0/4167193699 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbf4000abf0 con 0x7fbf481429d0 2023-11-28T20:07:34.777 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.773+0000 7fbf3e7fc640 1 --2- 172.21.15.177:0/4167193699 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbf2c066470 0x7fbf2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:34.777 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.773+0000 7fbf3e7fc640 1 -- 172.21.15.177:0/4167193699 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbf40083c40 con 0x7fbf481429d0 2023-11-28T20:07:34.777 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.773+0000 7fbf4def3640 1 --2- 172.21.15.177:0/4167193699 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbf2c066470 0x7fbf2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:34.777 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.773+0000 7fbf4def3640 1 --2- 172.21.15.177:0/4167193699 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbf2c066470 0x7fbf2c068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400a9a0 tx=0x7fbf44008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:34.779 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.777+0000 7fbf3e7fc640 1 -- 172.21.15.177:0/4167193699 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbf480b1010 con 0x7fbf481429d0 2023-11-28T20:07:34.928 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.925+0000 7fbf50157640 1 -- 172.21.15.177:0/4167193699 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf480b1010 con 0x7fbf481429d0 2023-11-28T20:07:34.929 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.925+0000 7fbf3e7fc640 1 -- 172.21.15.177:0/4167193699 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12910 (secure 0 0 0) 0x7fbf480b1010 con 0x7fbf481429d0 2023-11-28T20:07:34.930 INFO:teuthology.misc.health.smithi177.stdout: 2023-11-28T20:07:34.930 INFO:teuthology.misc.health.smithi177.stdout:{"epoch":16,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:31.561227+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:07:34.932 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.929+0000 7fbf50157640 1 -- 172.21.15.177:0/4167193699 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbf2c066470 msgr2=0x7fbf2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:34.932 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.929+0000 7fbf50157640 1 --2- 172.21.15.177:0/4167193699 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbf2c066470 0x7fbf2c068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400a9a0 tx=0x7fbf44008040 comp rx=0 tx=0).stop 2023-11-28T20:07:34.932 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.929+0000 7fbf50157640 1 -- 172.21.15.177:0/4167193699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf481429d0 msgr2=0x7fbf480b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:34.932 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.929+0000 7fbf50157640 1 --2- 172.21.15.177:0/4167193699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf481429d0 0x7fbf480b12f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000c7b0 tx=0x7fbf4000cc70 comp rx=0 tx=0).stop 2023-11-28T20:07:34.932 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.929+0000 7fbf50157640 1 -- 172.21.15.177:0/4167193699 shutdown_connections 2023-11-28T20:07:34.932 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.929+0000 7fbf50157640 1 --2- 172.21.15.177:0/4167193699 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbf2c066470 0x7fbf2c068930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:34.933 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.929+0000 7fbf50157640 1 --2- 172.21.15.177:0/4167193699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf481429d0 0x7fbf480b12f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:34.933 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.929+0000 7fbf50157640 1 --2- 172.21.15.177:0/4167193699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf4813f910 0x7fbf48162c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:34.933 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.929+0000 7fbf50157640 1 --2- 172.21.15.177:0/4167193699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf480b4b90 0x7fbf480b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:34.933 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.929+0000 7fbf50157640 1 -- 172.21.15.177:0/4167193699 >> 172.21.15.177:0/4167193699 conn(0x7fbf4806c5e0 msgr2=0x7fbf481558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:34.933 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.929+0000 7fbf50157640 1 -- 172.21.15.177:0/4167193699 shutdown_connections 2023-11-28T20:07:34.933 INFO:teuthology.misc.health.smithi177.stderr:2023-11-28T20:07:34.929+0000 7fbf50157640 1 -- 172.21.15.177:0/4167193699 wait complete. 2023-11-28T20:07:34.948 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-28T20:07:34.949 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-28T20:07:34.949 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T20:07:34.949 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T20:07:34.952 INFO:tasks.ceph.mds.a:Started 2023-11-28T20:07:34.953 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T20:07:34.953 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T20:07:34.956 INFO:tasks.ceph.mds.c:Started 2023-11-28T20:07:34.956 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T20:07:34.956 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T20:07:34.960 INFO:tasks.ceph.mds.b:Started 2023-11-28T20:07:34.960 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T20:07:34.960 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T20:07:34.963 INFO:tasks.ceph.mds.d:Started 2023-11-28T20:07:34.964 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-28T20:07:34.964 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:07:35.053 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-11-28T20:07:35.054 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-11-28T20:07:35.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.109+0000 7f5c1478d640 1 Processor -- start 2023-11-28T20:07:35.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.109+0000 7f5c1478d640 1 -- start start 2023-11-28T20:07:35.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.109+0000 7f5c1478d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c0c13cf30 0x7f5c0c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.109+0000 7f5c1478d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5c0c15ad40 0x7f5c0c0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.109+0000 7f5c1478d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c0c15b3a0 con 0x7f5c0c06c800 2023-11-28T20:07:35.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.109+0000 7f5c1478d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0c13d310 con 0x7f5c0c15ad40 2023-11-28T20:07:35.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.109+0000 7f5c1478d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c15b1b0 con 0x7f5c0c13cf30 2023-11-28T20:07:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.113+0000 7f5c12529640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c0c13cf30 0x7f5c0c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.113+0000 7f5c12d2a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5c0c15ad40 0x7f5c0c0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.113+0000 7f5c11d28640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f5c0c06c800 0x7f5c0c15a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:41550/0 (socket says 172.21.15.177:41550) 2023-11-28T20:07:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.113+0000 7f5c11d28640 1 -- 172.21.15.177:0/3876842143 learned_addr learned my addr 172.21.15.177:0/3876842143 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.113+0000 7f5c12d2a640 1 -- 172.21.15.177:0/3876842143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c0c13cf30 msgr2=0x7f5c0c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.113+0000 7f5c12d2a640 1 --2- 172.21.15.177:0/3876842143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c0c13cf30 0x7f5c0c06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.113+0000 7f5c12d2a640 1 -- 172.21.15.177:0/3876842143 >> v1:172.21.15.195:6789/0 conn(0x7f5c0c06c800 legacy=0x7f5c0c15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.113+0000 7f5c12d2a640 1 -- 172.21.15.177:0/3876842143 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c06cc40 con 0x7f5c0c15ad40 2023-11-28T20:07:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.113+0000 7f5c11527640 1 -- 172.21.15.177:0/3876842143 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115521105 0 0) 0x7f5c0c15b3a0 con 0x7f5c0c06c800 2023-11-28T20:07:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.113+0000 7f5c12d2a640 1 --2- 172.21.15.177:0/3876842143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c0c15ad40 0x7f5c0c0cd880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009d90 tx=0x7f5c0401c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=562c8611317b148d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.113+0000 7f5c11527640 1 -- 172.21.15.177:0/3876842143 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c040a5870 con 0x7f5c0c15ad40 2023-11-28T20:07:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.113+0000 7f5c11527640 1 -- 172.21.15.177:0/3876842143 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c040a59d0 con 0x7f5c0c15ad40 2023-11-28T20:07:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.113+0000 7f5c11527640 1 -- 172.21.15.177:0/3876842143 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c040a5d60 con 0x7f5c0c15ad40 2023-11-28T20:07:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 -- 172.21.15.177:0/3876842143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c0c15ad40 msgr2=0x7f5c0c0cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 --2- 172.21.15.177:0/3876842143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c0c15ad40 0x7f5c0c0cd880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009d90 tx=0x7f5c0401c8c0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 -- 172.21.15.177:0/3876842143 shutdown_connections 2023-11-28T20:07:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 --2- 172.21.15.177:0/3876842143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c0c15ad40 0x7f5c0c0cd880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 --2- 172.21.15.177:0/3876842143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c0c13cf30 0x7f5c0c06c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 -- 172.21.15.177:0/3876842143 >> 172.21.15.177:0/3876842143 conn(0x7f5c0c06a530 msgr2=0x7f5c0c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 -- 172.21.15.177:0/3876842143 shutdown_connections 2023-11-28T20:07:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 -- 172.21.15.177:0/3876842143 wait complete. 2023-11-28T20:07:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 Processor -- start 2023-11-28T20:07:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 -- start start 2023-11-28T20:07:35.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c0c06c800 0x7f5c0c158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c0c13cf30 0x7f5c0c070750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c0c15ad40 0x7f5c0c148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c159bb0 con 0x7f5c0c06c800 2023-11-28T20:07:35.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c1552a0 con 0x7f5c0c15ad40 2023-11-28T20:07:35.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c1478d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c154fc0 con 0x7f5c0c13cf30 2023-11-28T20:07:35.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c12529640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c0c06c800 0x7f5c0c158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c12529640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c0c06c800 0x7f5c0c158750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51244/0 (socket says 172.21.15.177:51244) 2023-11-28T20:07:35.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c12529640 1 -- 172.21.15.177:0/3255489663 learned_addr learned my addr 172.21.15.177:0/3255489663 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:35.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c12d2a640 1 --2- 172.21.15.177:0/3255489663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c0c15ad40 0x7f5c0c148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.117+0000 7f5c11d28640 1 --2- 172.21.15.177:0/3255489663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c0c13cf30 0x7f5c0c070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c12529640 1 -- 172.21.15.177:0/3255489663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c0c13cf30 msgr2=0x7f5c0c070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c12529640 1 --2- 172.21.15.177:0/3255489663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c0c13cf30 0x7f5c0c070750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c12529640 1 -- 172.21.15.177:0/3255489663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c0c15ad40 msgr2=0x7f5c0c148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c12529640 1 --2- 172.21.15.177:0/3255489663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c0c15ad40 0x7f5c0c148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c12529640 1 -- 172.21.15.177:0/3255489663 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c04009a70 con 0x7f5c0c06c800 2023-11-28T20:07:35.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c12d2a640 1 --2- 172.21.15.177:0/3255489663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c0c15ad40 0x7f5c0c148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:35.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c12529640 1 --2- 172.21.15.177:0/3255489663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c0c06c800 0x7f5c0c158750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800e930 tx=0x7f5c0800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:35.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c02ffd640 1 -- 172.21.15.177:0/3255489663 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08009690 con 0x7f5c0c06c800 2023-11-28T20:07:35.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c02ffd640 1 -- 172.21.15.177:0/3255489663 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0800ca00 con 0x7f5c0c06c800 2023-11-28T20:07:35.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c1478d640 1 -- 172.21.15.177:0/3255489663 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0c1594f0 con 0x7f5c0c06c800 2023-11-28T20:07:35.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c02ffd640 1 -- 172.21.15.177:0/3255489663 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0800cd70 con 0x7f5c0c06c800 2023-11-28T20:07:35.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c1478d640 1 -- 172.21.15.177:0/3255489663 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0c158c90 con 0x7f5c0c06c800 2023-11-28T20:07:35.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c1478d640 1 -- 172.21.15.177:0/3255489663 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0c069440 con 0x7f5c0c06c800 2023-11-28T20:07:35.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c02ffd640 1 -- 172.21.15.177:0/3255489663 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5c08013470 con 0x7f5c0c06c800 2023-11-28T20:07:35.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c02ffd640 1 --2- 172.21.15.177:0/3255489663 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5bf0066470 0x7f5bf0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c02ffd640 1 -- 172.21.15.177:0/3255489663 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5c08083cd0 con 0x7f5c0c06c800 2023-11-28T20:07:35.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.121+0000 7f5c11d28640 1 --2- 172.21.15.177:0/3255489663 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5bf0066470 0x7f5bf0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.125+0000 7f5c11d28640 1 --2- 172.21.15.177:0/3255489663 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5bf0066470 0x7f5bf0068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c15d6b0 tx=0x7f5bfc007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:35.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.125+0000 7f5c02ffd640 1 -- 172.21.15.177:0/3255489663 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5c080515f0 con 0x7f5c0c06c800 2023-11-28T20:07:35.278 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2023-11-28T20:07:35.278 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2023-11-28T20:07:35.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.277+0000 7f5c1478d640 1 -- 172.21.15.177:0/3255489663 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c0c06d1e0 con 0x7f5c0c06c800 2023-11-28T20:07:35.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.277+0000 7f5c02ffd640 1 -- 172.21.15.177:0/3255489663 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12910 (secure 0 0 0) 0x7f5c08017090 con 0x7f5c0c06c800 2023-11-28T20:07:35.282 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:35.282 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":16,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:31.561227+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:07:35.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.281+0000 7f5c1478d640 1 -- 172.21.15.177:0/3255489663 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5bf0066470 msgr2=0x7f5bf0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.281+0000 7f5c1478d640 1 --2- 172.21.15.177:0/3255489663 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5bf0066470 0x7f5bf0068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c15d6b0 tx=0x7f5bfc007b60 comp rx=0 tx=0).stop 2023-11-28T20:07:35.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.281+0000 7f5c1478d640 1 -- 172.21.15.177:0/3255489663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c0c06c800 msgr2=0x7f5c0c158750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.281+0000 7f5c1478d640 1 --2- 172.21.15.177:0/3255489663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c0c06c800 0x7f5c0c158750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800e930 tx=0x7f5c0800edf0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.281+0000 7f5c1478d640 1 -- 172.21.15.177:0/3255489663 shutdown_connections 2023-11-28T20:07:35.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.281+0000 7f5c1478d640 1 --2- 172.21.15.177:0/3255489663 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5bf0066470 0x7f5bf0068930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.281+0000 7f5c1478d640 1 --2- 172.21.15.177:0/3255489663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c0c15ad40 0x7f5c0c148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.281+0000 7f5c1478d640 1 --2- 172.21.15.177:0/3255489663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c0c13cf30 0x7f5c0c070750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.281+0000 7f5c1478d640 1 --2- 172.21.15.177:0/3255489663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c0c06c800 0x7f5c0c158750 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.281+0000 7f5c1478d640 1 -- 172.21.15.177:0/3255489663 >> 172.21.15.177:0/3255489663 conn(0x7f5c0c06a530 msgr2=0x7f5c0c15c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:35.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.281+0000 7f5c1478d640 1 -- 172.21.15.177:0/3255489663 shutdown_connections 2023-11-28T20:07:35.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.281+0000 7f5c1478d640 1 -- 172.21.15.177:0/3255489663 wait complete. 2023-11-28T20:07:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:07:35.303 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:07:35.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad86b72640 1 Processor -- start 2023-11-28T20:07:35.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad86b72640 1 -- start start 2023-11-28T20:07:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad86b72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8015d2b0 0x7fad800d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad86b72640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fad800d1cf0 0x7fad800cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad86b72640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad800aff30 con 0x7fad8015d690 2023-11-28T20:07:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad86b72640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad800b01d0 con 0x7fad800d1cf0 2023-11-28T20:07:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad86b72640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad800b04b0 con 0x7fad8015d2b0 2023-11-28T20:07:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad8510f640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fad8015d690 0x7fad800cdd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:50378/0 (socket says 172.21.15.177:50378) 2023-11-28T20:07:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad8510f640 1 -- 172.21.15.177:0/2206117371 learned_addr learned my addr 172.21.15.177:0/2206117371 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad7ffff640 1 --2- 172.21.15.177:0/2206117371 >> v2:172.21.15.195:3300/0 conn(0x7fad800d1cf0 0x7fad800cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad8490e640 1 --2- 172.21.15.177:0/2206117371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8015d2b0 0x7fad800d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad7f7fe640 1 -- 172.21.15.177:0/2206117371 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382085135 0 0) 0x7fad800aff30 con 0x7fad8015d690 2023-11-28T20:07:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad7f7fe640 1 -- 172.21.15.177:0/2206117371 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad70003530 con 0x7fad8015d690 2023-11-28T20:07:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad8490e640 1 -- 172.21.15.177:0/2206117371 >> v2:172.21.15.195:3300/0 conn(0x7fad800d1cf0 msgr2=0x7fad800cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad8490e640 1 --2- 172.21.15.177:0/2206117371 >> v2:172.21.15.195:3300/0 conn(0x7fad800d1cf0 0x7fad800cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad8490e640 1 -- 172.21.15.177:0/2206117371 >> v1:172.21.15.177:6789/0 conn(0x7fad8015d690 legacy=0x7fad800cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad8490e640 1 -- 172.21.15.177:0/2206117371 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad800b0790 con 0x7fad8015d2b0 2023-11-28T20:07:35.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.441+0000 7fad7ffff640 1 --2- 172.21.15.177:0/2206117371 >> v2:172.21.15.195:3300/0 conn(0x7fad800d1cf0 0x7fad800cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:07:35.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.445+0000 7fad8490e640 1 --2- 172.21.15.177:0/2206117371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8015d2b0 0x7fad800d17b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fad740097c0 tx=0x7fad7401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51f3867c4e37f026 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:35.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.445+0000 7fad7f7fe640 1 -- 172.21.15.177:0/2206117371 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740ab620 con 0x7fad8015d2b0 2023-11-28T20:07:35.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.445+0000 7fad7f7fe640 1 -- 172.21.15.177:0/2206117371 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad740ab780 con 0x7fad8015d2b0 2023-11-28T20:07:35.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.445+0000 7fad7f7fe640 1 -- 172.21.15.177:0/2206117371 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740abb10 con 0x7fad8015d2b0 2023-11-28T20:07:35.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.445+0000 7fad86b72640 1 -- 172.21.15.177:0/2206117371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8015d2b0 msgr2=0x7fad800d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.445+0000 7fad86b72640 1 --2- 172.21.15.177:0/2206117371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8015d2b0 0x7fad800d17b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fad740097c0 tx=0x7fad7401c480 comp rx=0 tx=0).stop 2023-11-28T20:07:35.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.445+0000 7fad86b72640 1 -- 172.21.15.177:0/2206117371 shutdown_connections 2023-11-28T20:07:35.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.445+0000 7fad86b72640 1 --2- 172.21.15.177:0/2206117371 >> v2:172.21.15.195:3300/0 conn(0x7fad800d1cf0 0x7fad800cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.445+0000 7fad86b72640 1 --2- 172.21.15.177:0/2206117371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8015d2b0 0x7fad800d17b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.445+0000 7fad86b72640 1 -- 172.21.15.177:0/2206117371 >> 172.21.15.177:0/2206117371 conn(0x7fad8009c510 msgr2=0x7fad800d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:35.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.445+0000 7fad86b72640 1 -- 172.21.15.177:0/2206117371 shutdown_connections 2023-11-28T20:07:35.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.445+0000 7fad86b72640 1 -- 172.21.15.177:0/2206117371 wait complete. 2023-11-28T20:07:35.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad86b72640 1 Processor -- start 2023-11-28T20:07:35.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad86b72640 1 -- start start 2023-11-28T20:07:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad86b72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad800d1cf0 0x7fad80152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad86b72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8015d2b0 0x7fad80153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad86b72640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8015d690 0x7fad8015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad86b72640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad80153c90 con 0x7fad800d1cf0 2023-11-28T20:07:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad86b72640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad800b5df0 con 0x7fad8015d690 2023-11-28T20:07:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad86b72640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad800b60d0 con 0x7fad8015d2b0 2023-11-28T20:07:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad8490e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad800d1cf0 0x7fad80152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad8490e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad800d1cf0 0x7fad80152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51258/0 (socket says 172.21.15.177:51258) 2023-11-28T20:07:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad8490e640 1 -- 172.21.15.177:0/2869124371 learned_addr learned my addr 172.21.15.177:0/2869124371 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad7ffff640 1 --2- 172.21.15.177:0/2869124371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8015d2b0 0x7fad80153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad8510f640 1 --2- 172.21.15.177:0/2869124371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8015d690 0x7fad8015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad8490e640 1 -- 172.21.15.177:0/2869124371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8015d2b0 msgr2=0x7fad80153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad8490e640 1 --2- 172.21.15.177:0/2869124371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8015d2b0 0x7fad80153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad8490e640 1 -- 172.21.15.177:0/2869124371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8015d690 msgr2=0x7fad8015eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad8490e640 1 --2- 172.21.15.177:0/2869124371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8015d690 0x7fad8015eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad8490e640 1 -- 172.21.15.177:0/2869124371 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c009420 con 0x7fad800d1cf0 2023-11-28T20:07:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.449+0000 7fad8490e640 1 --2- 172.21.15.177:0/2869124371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad800d1cf0 0x7fad80152420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad740ad040 tx=0x7fad7401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.453+0000 7fad7d7fa640 1 -- 172.21.15.177:0/2869124371 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740abe40 con 0x7fad800d1cf0 2023-11-28T20:07:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.453+0000 7fad7d7fa640 1 -- 172.21.15.177:0/2869124371 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad740bf410 con 0x7fad800d1cf0 2023-11-28T20:07:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.453+0000 7fad86b72640 1 -- 172.21.15.177:0/2869124371 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad74009420 con 0x7fad800d1cf0 2023-11-28T20:07:35.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.453+0000 7fad7d7fa640 1 -- 172.21.15.177:0/2869124371 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740bf7c0 con 0x7fad800d1cf0 2023-11-28T20:07:35.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.453+0000 7fad86b72640 1 -- 172.21.15.177:0/2869124371 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad800b6690 con 0x7fad800d1cf0 2023-11-28T20:07:35.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.453+0000 7fad86b72640 1 -- 172.21.15.177:0/2869124371 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad800679f0 con 0x7fad800d1cf0 2023-11-28T20:07:35.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.453+0000 7fad7d7fa640 1 -- 172.21.15.177:0/2869124371 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fad740bf920 con 0x7fad800d1cf0 2023-11-28T20:07:35.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.453+0000 7fad7d7fa640 1 --2- 172.21.15.177:0/2869124371 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad64066470 0x7fad64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.453+0000 7fad7d7fa640 1 -- 172.21.15.177:0/2869124371 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad7411e1b0 con 0x7fad800d1cf0 2023-11-28T20:07:35.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.453+0000 7fad7ffff640 1 --2- 172.21.15.177:0/2869124371 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad64066470 0x7fad64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.453+0000 7fad7ffff640 1 --2- 172.21.15.177:0/2869124371 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad64066470 0x7fad64068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fad801f9ec0 tx=0x7fad6c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:35.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.457+0000 7fad7d7fa640 1 -- 172.21.15.177:0/2869124371 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad740ebab0 con 0x7fad800d1cf0 2023-11-28T20:07:35.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.604+0000 7fad86b72640 1 -- 172.21.15.177:0/2869124371 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad800b6210 con 0x7fad800d1cf0 2023-11-28T20:07:35.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.608+0000 7fad7d7fa640 1 -- 172.21.15.177:0/2869124371 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad800b6210 con 0x7fad800d1cf0 2023-11-28T20:07:35.610 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:07:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.608+0000 7fad86b72640 1 -- 172.21.15.177:0/2869124371 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad64066470 msgr2=0x7fad64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.608+0000 7fad86b72640 1 --2- 172.21.15.177:0/2869124371 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad64066470 0x7fad64068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fad801f9ec0 tx=0x7fad6c009190 comp rx=0 tx=0).stop 2023-11-28T20:07:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.608+0000 7fad86b72640 1 -- 172.21.15.177:0/2869124371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad800d1cf0 msgr2=0x7fad80152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.608+0000 7fad86b72640 1 --2- 172.21.15.177:0/2869124371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad800d1cf0 0x7fad80152420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad740ad040 tx=0x7fad7401acc0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.608+0000 7fad86b72640 1 -- 172.21.15.177:0/2869124371 shutdown_connections 2023-11-28T20:07:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.608+0000 7fad86b72640 1 --2- 172.21.15.177:0/2869124371 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad64066470 0x7fad64068930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.608+0000 7fad86b72640 1 --2- 172.21.15.177:0/2869124371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8015d690 0x7fad8015eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.608+0000 7fad86b72640 1 --2- 172.21.15.177:0/2869124371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8015d2b0 0x7fad80153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.608+0000 7fad86b72640 1 --2- 172.21.15.177:0/2869124371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad800d1cf0 0x7fad80152420 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.608+0000 7fad86b72640 1 -- 172.21.15.177:0/2869124371 >> 172.21.15.177:0/2869124371 conn(0x7fad8009c510 msgr2=0x7fad800b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.608+0000 7fad86b72640 1 -- 172.21.15.177:0/2869124371 shutdown_connections 2023-11-28T20:07:35.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.608+0000 7fad86b72640 1 -- 172.21.15.177:0/2869124371 wait complete. 2023-11-28T20:07:35.632 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:07:35.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.764+0000 7f42565d1640 1 Processor -- start 2023-11-28T20:07:35.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.764+0000 7f42565d1640 1 -- start start 2023-11-28T20:07:35.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f42565d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f425006c9d0 0x7f425015a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f42565d1640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425015b3a0 con 0x7f425013cf30 2023-11-28T20:07:35.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f42565d1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425013f720 con 0x7f425015ab70 2023-11-28T20:07:35.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f42565d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425013d310 con 0x7f425006c9d0 2023-11-28T20:07:35.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424ffff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f425013cf30 0x7f425006c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:50388/0 (socket says 172.21.15.177:50388) 2023-11-28T20:07:35.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424ffff640 1 -- 172.21.15.177:0/3959956817 learned_addr learned my addr 172.21.15.177:0/3959956817 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:35.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424f7fe640 1 --2- 172.21.15.177:0/3959956817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f425006c9d0 0x7f425015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424effd640 1 -- 172.21.15.177:0/3959956817 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186701625 0 0) 0x7f425015b3a0 con 0x7f425013cf30 2023-11-28T20:07:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424effd640 1 -- 172.21.15.177:0/3959956817 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4238003530 con 0x7f425013cf30 2023-11-28T20:07:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424effd640 1 -- 172.21.15.177:0/3959956817 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1765083332 0 0) 0x7f4238003530 con 0x7f425013cf30 2023-11-28T20:07:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424effd640 1 -- 172.21.15.177:0/3959956817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f425006c9d0 msgr2=0x7f425015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424effd640 1 --2- 172.21.15.177:0/3959956817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f425006c9d0 0x7f425015a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424effd640 1 -- 172.21.15.177:0/3959956817 >> v1:172.21.15.195:6789/0 conn(0x7f425015ab70 legacy=0x7f42500cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424effd640 1 -- 172.21.15.177:0/3959956817 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425013fa00 con 0x7f425013cf30 2023-11-28T20:07:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424effd640 1 -- 172.21.15.177:0/3959956817 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f4240001680 con 0x7f425013cf30 2023-11-28T20:07:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424f7fe640 1 --2- 172.21.15.177:0/3959956817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f425006c9d0 0x7f425015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:07:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424effd640 1 -- 172.21.15.177:0/3959956817 >> v1:172.21.15.177:6789/0 conn(0x7f425013cf30 legacy=0x7f425006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424effd640 1 --2- 172.21.15.177:0/3959956817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42380039b0 0x7f4238003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424effd640 1 --2- 172.21.15.177:0/3959956817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42380047d0 0x7f4238004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424effd640 1 --2- 172.21.15.177:0/3959956817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f425006c9d0 0x7f4238005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424effd640 1 -- 172.21.15.177:0/3959956817 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423800ba60 con 0x7f42380047d0 2023-11-28T20:07:35.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424effd640 1 -- 172.21.15.177:0/3959956817 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423800dde0 con 0x7f42380039b0 2023-11-28T20:07:35.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424effd640 1 -- 172.21.15.177:0/3959956817 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423800dfa0 con 0x7f425006c9d0 2023-11-28T20:07:35.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424f7fe640 1 --2- 172.21.15.177:0/3959956817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42380047d0 0x7f4238004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424ffff640 1 --2- 172.21.15.177:0/3959956817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42380039b0 0x7f4238003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f4254b6e640 1 --2- 172.21.15.177:0/3959956817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f425006c9d0 0x7f4238005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424f7fe640 1 -- 172.21.15.177:0/3959956817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f425006c9d0 msgr2=0x7f4238005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:35.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424f7fe640 1 --2- 172.21.15.177:0/3959956817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f425006c9d0 0x7f4238005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424f7fe640 1 -- 172.21.15.177:0/3959956817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42380039b0 msgr2=0x7f4238003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:35.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424f7fe640 1 --2- 172.21.15.177:0/3959956817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42380039b0 0x7f4238003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.768+0000 7f424f7fe640 1 -- 172.21.15.177:0/3959956817 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4244009420 con 0x7f42380047d0 2023-11-28T20:07:35.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.772+0000 7f424f7fe640 1 --2- 172.21.15.177:0/3959956817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42380047d0 0x7f4238004c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4244009cb0 tx=0x7f424401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39aa07a7ad11ed03 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:35.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.772+0000 7f424effd640 1 -- 172.21.15.177:0/3959956817 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42440a65c0 con 0x7f42380047d0 2023-11-28T20:07:35.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.772+0000 7f424effd640 1 -- 172.21.15.177:0/3959956817 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42440a6720 con 0x7f42380047d0 2023-11-28T20:07:35.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.772+0000 7f424effd640 1 -- 172.21.15.177:0/3959956817 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42440a6ad0 con 0x7f42380047d0 2023-11-28T20:07:35.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.772+0000 7f42565d1640 1 -- 172.21.15.177:0/3959956817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42380047d0 msgr2=0x7f4238004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.772+0000 7f42565d1640 1 --2- 172.21.15.177:0/3959956817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42380047d0 0x7f4238004c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4244009cb0 tx=0x7f424401cbf0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.772+0000 7f4254b6e640 1 -- 172.21.15.177:0/3959956817 reap_dead start 2023-11-28T20:07:35.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.772+0000 7f42565d1640 1 -- 172.21.15.177:0/3959956817 shutdown_connections 2023-11-28T20:07:35.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.772+0000 7f42565d1640 1 -- 172.21.15.177:0/3959956817 >> 172.21.15.177:0/3959956817 conn(0x7f425006a530 msgr2=0x7f425006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:35.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.772+0000 7f42565d1640 1 -- 172.21.15.177:0/3959956817 shutdown_connections 2023-11-28T20:07:35.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.772+0000 7f42565d1640 1 -- 172.21.15.177:0/3959956817 wait complete. 2023-11-28T20:07:35.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.772+0000 7f42565d1640 1 Processor -- start 2023-11-28T20:07:35.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.772+0000 7f42565d1640 1 -- start start 2023-11-28T20:07:35.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f42565d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42380047d0 0x7f42501f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f42565d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42501ec4a0 0x7f4250156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f42565d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4250156760 0x7f425015ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f42565d1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425013d950 con 0x7f42380047d0 2023-11-28T20:07:35.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f42565d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42501ec920 con 0x7f4250156760 2023-11-28T20:07:35.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f42565d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4250156d70 con 0x7f42501ec4a0 2023-11-28T20:07:35.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f424ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42380047d0 0x7f42501f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f424ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42380047d0 0x7f42501f6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51276/0 (socket says 172.21.15.177:51276) 2023-11-28T20:07:35.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f424ffff640 1 -- 172.21.15.177:0/2311750230 learned_addr learned my addr 172.21.15.177:0/2311750230 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:35.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f424ffff640 1 -- 172.21.15.177:0/2311750230 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42501ec4a0 msgr2=0x7f4250156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f424ffff640 1 --2- 172.21.15.177:0/2311750230 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42501ec4a0 0x7f4250156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f4254b6e640 1 --2- 172.21.15.177:0/2311750230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4250156760 0x7f425015ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f424ffff640 1 -- 172.21.15.177:0/2311750230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4250156760 msgr2=0x7f425015ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f424ffff640 1 --2- 172.21.15.177:0/2311750230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4250156760 0x7f425015ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f424ffff640 1 -- 172.21.15.177:0/2311750230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425013dbf0 con 0x7f42380047d0 2023-11-28T20:07:35.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f4254b6e640 1 --2- 172.21.15.177:0/2311750230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4250156760 0x7f425015ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:35.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f424ffff640 1 --2- 172.21.15.177:0/2311750230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42380047d0 0x7f42501f6090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f42400072c0 tx=0x7f4240007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:35.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f424cff9640 1 -- 172.21.15.177:0/2311750230 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424000f940 con 0x7f42380047d0 2023-11-28T20:07:35.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f424cff9640 1 -- 172.21.15.177:0/2311750230 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424000faa0 con 0x7f42380047d0 2023-11-28T20:07:35.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f42565d1640 1 -- 172.21.15.177:0/2311750230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425013ded0 con 0x7f42380047d0 2023-11-28T20:07:35.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f424cff9640 1 -- 172.21.15.177:0/2311750230 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424000fe30 con 0x7f42380047d0 2023-11-28T20:07:35.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f42565d1640 1 -- 172.21.15.177:0/2311750230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4250153690 con 0x7f42380047d0 2023-11-28T20:07:35.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f42565d1640 1 -- 172.21.15.177:0/2311750230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4250070440 con 0x7f42380047d0 2023-11-28T20:07:35.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.776+0000 7f424cff9640 1 -- 172.21.15.177:0/2311750230 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f424001d460 con 0x7f42380047d0 2023-11-28T20:07:35.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.780+0000 7f424cff9640 1 --2- 172.21.15.177:0/2311750230 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f423c0664a0 0x7f423c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:35.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.780+0000 7f424cff9640 1 -- 172.21.15.177:0/2311750230 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4240083d40 con 0x7f42380047d0 2023-11-28T20:07:35.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.780+0000 7f424f7fe640 1 --2- 172.21.15.177:0/2311750230 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f423c0664a0 0x7f423c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:35.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.780+0000 7f424f7fe640 1 --2- 172.21.15.177:0/2311750230 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f423c0664a0 0x7f423c068960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f42440af000 tx=0x7f4244004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:35.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.784+0000 7f424cff9640 1 -- 172.21.15.177:0/2311750230 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4250070440 con 0x7f42380047d0 2023-11-28T20:07:35.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.964+0000 7f42565d1640 1 -- 172.21.15.177:0/2311750230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4250070440 con 0x7f42380047d0 2023-11-28T20:07:35.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.964+0000 7f424cff9640 1 -- 172.21.15.177:0/2311750230 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f4250070440 con 0x7f42380047d0 2023-11-28T20:07:35.967 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:35.968 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2688190991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2688190991},{"type":"v1","addr":"172.21.15.177:6835","nonce":2688190991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-28T20:07:35.968 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 2 2023-11-28T20:07:35.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.964+0000 7f42565d1640 1 -- 172.21.15.177:0/2311750230 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f423c0664a0 msgr2=0x7f423c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.964+0000 7f42565d1640 1 --2- 172.21.15.177:0/2311750230 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f423c0664a0 0x7f423c068960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f42440af000 tx=0x7f4244004740 comp rx=0 tx=0).stop 2023-11-28T20:07:35.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.964+0000 7f42565d1640 1 -- 172.21.15.177:0/2311750230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42380047d0 msgr2=0x7f42501f6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:35.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.964+0000 7f42565d1640 1 --2- 172.21.15.177:0/2311750230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42380047d0 0x7f42501f6090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f42400072c0 tx=0x7f4240007780 comp rx=0 tx=0).stop 2023-11-28T20:07:35.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.964+0000 7f42565d1640 1 -- 172.21.15.177:0/2311750230 shutdown_connections 2023-11-28T20:07:35.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.964+0000 7f42565d1640 1 --2- 172.21.15.177:0/2311750230 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f423c0664a0 0x7f423c068960 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.964+0000 7f42565d1640 1 --2- 172.21.15.177:0/2311750230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4250156760 0x7f425015ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.964+0000 7f42565d1640 1 --2- 172.21.15.177:0/2311750230 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42501ec4a0 0x7f4250156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.964+0000 7f42565d1640 1 --2- 172.21.15.177:0/2311750230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42380047d0 0x7f42501f6090 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:35.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.964+0000 7f42565d1640 1 -- 172.21.15.177:0/2311750230 >> 172.21.15.177:0/2311750230 conn(0x7f425006a530 msgr2=0x7f425015b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:35.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.964+0000 7f42565d1640 1 -- 172.21.15.177:0/2311750230 shutdown_connections 2023-11-28T20:07:35.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:35.964+0000 7f42565d1640 1 -- 172.21.15.177:0/2311750230 wait complete. 2023-11-28T20:07:37.989 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:07:38.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.132+0000 7f5353f1d640 1 Processor -- start 2023-11-28T20:07:38.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.132+0000 7f5353f1d640 1 -- start start 2023-11-28T20:07:38.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f5353f1d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f534c06cdb0 0x7f534c150250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f5353f1d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f534c06d190 0x7f534c150790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f5353f1d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f534c159da0 0x7f534c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f5353f1d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c150cd0 con 0x7f534c159da0 2023-11-28T20:07:38.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f5353f1d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c070460 con 0x7f534c06cdb0 2023-11-28T20:07:38.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f5353f1d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c15ab20 con 0x7f534c06d190 2023-11-28T20:07:38.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f53524ba640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f534c159da0 0x7f534c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f53524ba640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f534c159da0 0x7f534c15a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51280/0 (socket says 172.21.15.177:51280) 2023-11-28T20:07:38.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f53524ba640 1 -- 172.21.15.177:0/784108515 learned_addr learned my addr 172.21.15.177:0/784108515 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:38.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f53514b8640 1 --2- 172.21.15.177:0/784108515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f534c06d190 0x7f534c150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f5351cb9640 1 --2- 172.21.15.177:0/784108515 >> v2:172.21.15.195:3300/0 conn(0x7f534c06cdb0 0x7f534c150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f53524ba640 1 -- 172.21.15.177:0/784108515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f534c06d190 msgr2=0x7f534c150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:38.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f53524ba640 1 --2- 172.21.15.177:0/784108515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f534c06d190 0x7f534c150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f53524ba640 1 -- 172.21.15.177:0/784108515 >> v2:172.21.15.195:3300/0 conn(0x7f534c06cdb0 msgr2=0x7f534c150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:38.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f53524ba640 1 --2- 172.21.15.177:0/784108515 >> v2:172.21.15.195:3300/0 conn(0x7f534c06cdb0 0x7f534c150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.136+0000 7f53524ba640 1 -- 172.21.15.177:0/784108515 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c070690 con 0x7f534c159da0 2023-11-28T20:07:38.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.140+0000 7f53524ba640 1 --2- 172.21.15.177:0/784108515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f534c159da0 0x7f534c15a1f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f534c067390 tx=0x7f534401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe423f0ae56cb11f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:38.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.140+0000 7f5350cb7640 1 -- 172.21.15.177:0/784108515 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440a5630 con 0x7f534c159da0 2023-11-28T20:07:38.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.140+0000 7f5350cb7640 1 -- 172.21.15.177:0/784108515 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53440a5790 con 0x7f534c159da0 2023-11-28T20:07:38.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.140+0000 7f5350cb7640 1 -- 172.21.15.177:0/784108515 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440a5b20 con 0x7f534c159da0 2023-11-28T20:07:38.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.140+0000 7f5353f1d640 1 -- 172.21.15.177:0/784108515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f534c159da0 msgr2=0x7f534c15a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.140+0000 7f5353f1d640 1 --2- 172.21.15.177:0/784108515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f534c159da0 0x7f534c15a1f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f534c067390 tx=0x7f534401c940 comp rx=0 tx=0).stop 2023-11-28T20:07:38.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.140+0000 7f5353f1d640 1 -- 172.21.15.177:0/784108515 shutdown_connections 2023-11-28T20:07:38.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.140+0000 7f5353f1d640 1 --2- 172.21.15.177:0/784108515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f534c159da0 0x7f534c15a1f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.140+0000 7f5353f1d640 1 --2- 172.21.15.177:0/784108515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f534c06d190 0x7f534c150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.140+0000 7f5353f1d640 1 --2- 172.21.15.177:0/784108515 >> v2:172.21.15.195:3300/0 conn(0x7f534c06cdb0 0x7f534c150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.140+0000 7f5353f1d640 1 -- 172.21.15.177:0/784108515 >> 172.21.15.177:0/784108515 conn(0x7f534c06a530 msgr2=0x7f534c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:38.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.140+0000 7f5353f1d640 1 -- 172.21.15.177:0/784108515 shutdown_connections 2023-11-28T20:07:38.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.140+0000 7f5353f1d640 1 -- 172.21.15.177:0/784108515 wait complete. 2023-11-28T20:07:38.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.140+0000 7f5353f1d640 1 Processor -- start 2023-11-28T20:07:38.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.140+0000 7f5353f1d640 1 -- start start 2023-11-28T20:07:38.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f5353f1d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f534c06cdb0 0x7f534c143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f5353f1d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f534c06d190 0x7f534c146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f5353f1d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f534c159da0 0x7f534c1474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f5353f1d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c145290 con 0x7f534c159da0 2023-11-28T20:07:38.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f5353f1d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c1454e0 con 0x7f534c06cdb0 2023-11-28T20:07:38.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f5353f1d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c1457c0 con 0x7f534c06d190 2023-11-28T20:07:38.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f53524ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f534c159da0 0x7f534c1474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f53524ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f534c159da0 0x7f534c1474e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51282/0 (socket says 172.21.15.177:51282) 2023-11-28T20:07:38.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f53524ba640 1 -- 172.21.15.177:0/2817490276 learned_addr learned my addr 172.21.15.177:0/2817490276 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:38.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f5351cb9640 1 --2- 172.21.15.177:0/2817490276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f534c06cdb0 0x7f534c143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f53514b8640 1 --2- 172.21.15.177:0/2817490276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f534c06d190 0x7f534c146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f53524ba640 1 -- 172.21.15.177:0/2817490276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f534c06d190 msgr2=0x7f534c146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f53524ba640 1 --2- 172.21.15.177:0/2817490276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f534c06d190 0x7f534c146fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f53524ba640 1 -- 172.21.15.177:0/2817490276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f534c06cdb0 msgr2=0x7f534c143700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f53524ba640 1 --2- 172.21.15.177:0/2817490276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f534c06cdb0 0x7f534c143700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f53524ba640 1 -- 172.21.15.177:0/2817490276 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5344009b30 con 0x7f534c159da0 2023-11-28T20:07:38.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f53524ba640 1 --2- 172.21.15.177:0/2817490276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f534c159da0 0x7f534c1474e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f53440af040 tx=0x7f53440196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:38.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f53427fc640 1 -- 172.21.15.177:0/2817490276 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440b8670 con 0x7f534c159da0 2023-11-28T20:07:38.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f53427fc640 1 -- 172.21.15.177:0/2817490276 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53440b87f0 con 0x7f534c159da0 2023-11-28T20:07:38.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f5353f1d640 1 -- 172.21.15.177:0/2817490276 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534c145aa0 con 0x7f534c159da0 2023-11-28T20:07:38.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f53427fc640 1 -- 172.21.15.177:0/2817490276 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440b8ba0 con 0x7f534c159da0 2023-11-28T20:07:38.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f5353f1d640 1 -- 172.21.15.177:0/2817490276 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534c146060 con 0x7f534c159da0 2023-11-28T20:07:38.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f5353f1d640 1 -- 172.21.15.177:0/2817490276 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534c146250 con 0x7f534c159da0 2023-11-28T20:07:38.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.144+0000 7f53427fc640 1 -- 172.21.15.177:0/2817490276 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f53440b8d00 con 0x7f534c159da0 2023-11-28T20:07:38.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.148+0000 7f53427fc640 1 --2- 172.21.15.177:0/2817490276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5330066470 0x7f5330068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.148+0000 7f53427fc640 1 -- 172.21.15.177:0/2817490276 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f534411ee70 con 0x7f534c159da0 2023-11-28T20:07:38.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.148+0000 7f5351cb9640 1 --2- 172.21.15.177:0/2817490276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5330066470 0x7f5330068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.148+0000 7f5351cb9640 1 --2- 172.21.15.177:0/2817490276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5330066470 0x7f5330068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f534800bc00 tx=0x7f5348008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:38.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.152+0000 7f53427fc640 1 -- 172.21.15.177:0/2817490276 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53440ec800 con 0x7f534c159da0 2023-11-28T20:07:38.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.328+0000 7f5353f1d640 1 -- 172.21.15.177:0/2817490276 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f534c069440 con 0x7f534c159da0 2023-11-28T20:07:38.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.328+0000 7f53427fc640 1 -- 172.21.15.177:0/2817490276 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f53440bc090 con 0x7f534c159da0 2023-11-28T20:07:38.333 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:38.334 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2688190991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2688190991},{"type":"v1","addr":"172.21.15.177:6835","nonce":2688190991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/17424302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":17424302},{"type":"v1","addr":"172.21.15.177:6837","nonce":17424302}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3833908165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3833908165},{"type":"v1","addr":"172.21.15.195:6834","nonce":3833908165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1726998944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1726998944},{"type":"v1","addr":"172.21.15.195:6835","nonce":1726998944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-28T20:07:38.334 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 3 2023-11-28T20:07:38.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.332+0000 7f5353f1d640 1 -- 172.21.15.177:0/2817490276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5330066470 msgr2=0x7f5330068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.332+0000 7f5353f1d640 1 --2- 172.21.15.177:0/2817490276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5330066470 0x7f5330068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f534800bc00 tx=0x7f5348008040 comp rx=0 tx=0).stop 2023-11-28T20:07:38.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.332+0000 7f5353f1d640 1 -- 172.21.15.177:0/2817490276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f534c159da0 msgr2=0x7f534c1474e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.332+0000 7f5353f1d640 1 --2- 172.21.15.177:0/2817490276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f534c159da0 0x7f534c1474e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f53440af040 tx=0x7f53440196e0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.332+0000 7f5353f1d640 1 -- 172.21.15.177:0/2817490276 shutdown_connections 2023-11-28T20:07:38.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.332+0000 7f5353f1d640 1 --2- 172.21.15.177:0/2817490276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5330066470 0x7f5330068930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.332+0000 7f5353f1d640 1 --2- 172.21.15.177:0/2817490276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f534c159da0 0x7f534c1474e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.332+0000 7f5353f1d640 1 --2- 172.21.15.177:0/2817490276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f534c06d190 0x7f534c146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.332+0000 7f5353f1d640 1 --2- 172.21.15.177:0/2817490276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f534c06cdb0 0x7f534c143700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.332+0000 7f5353f1d640 1 -- 172.21.15.177:0/2817490276 >> 172.21.15.177:0/2817490276 conn(0x7f534c06a530 msgr2=0x7f534c0b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:38.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.332+0000 7f5353f1d640 1 -- 172.21.15.177:0/2817490276 shutdown_connections 2023-11-28T20:07:38.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.332+0000 7f5353f1d640 1 -- 172.21.15.177:0/2817490276 wait complete. 2023-11-28T20:07:38.355 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:07:38.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.488+0000 7fa0b845a640 1 Processor -- start 2023-11-28T20:07:38.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.488+0000 7fa0b845a640 1 -- start start 2023-11-28T20:07:38.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.492+0000 7fa0b845a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa0b013cf30 0x7fa0b006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.492+0000 7fa0b845a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b015ad40 0x7fa0b00cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.492+0000 7fa0b845a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b015b3a0 con 0x7fa0b006c800 2023-11-28T20:07:38.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.492+0000 7fa0b845a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b013d310 con 0x7fa0b013cf30 2023-11-28T20:07:38.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.492+0000 7fa0b845a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b015b1b0 con 0x7fa0b015ad40 2023-11-28T20:07:38.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.492+0000 7fa0b61f6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa0b013cf30 0x7fa0b006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.492+0000 7fa0b61f6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa0b013cf30 0x7fa0b006c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51288/0 (socket says 172.21.15.177:51288) 2023-11-28T20:07:38.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.492+0000 7fa0b61f6640 1 -- 172.21.15.177:0/3534489710 learned_addr learned my addr 172.21.15.177:0/3534489710 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:38.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.492+0000 7fa0b69f7640 1 --2- 172.21.15.177:0/3534489710 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b015ad40 0x7fa0b00cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.492+0000 7fa0b61f6640 1 -- 172.21.15.177:0/3534489710 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b015ad40 msgr2=0x7fa0b00cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:38.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.492+0000 7fa0b61f6640 1 --2- 172.21.15.177:0/3534489710 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b015ad40 0x7fa0b00cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.492+0000 7fa0b61f6640 1 -- 172.21.15.177:0/3534489710 >> v1:172.21.15.195:6789/0 conn(0x7fa0b006c800 legacy=0x7fa0b015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:38.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.492+0000 7fa0b61f6640 1 -- 172.21.15.177:0/3534489710 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b013f720 con 0x7fa0b013cf30 2023-11-28T20:07:38.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.492+0000 7fa0b69f7640 1 --2- 172.21.15.177:0/3534489710 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b015ad40 0x7fa0b00cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:38.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.496+0000 7fa0b61f6640 1 --2- 172.21.15.177:0/3534489710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b013cf30 0x7fa0b006c2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009870 tx=0x7fa0ac01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53bec63854959255 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:38.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.496+0000 7fa0b51f4640 1 -- 172.21.15.177:0/3534489710 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac0ab600 con 0x7fa0b013cf30 2023-11-28T20:07:38.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.496+0000 7fa0b51f4640 1 -- 172.21.15.177:0/3534489710 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac0a7050 con 0x7fa0b013cf30 2023-11-28T20:07:38.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.496+0000 7fa0b51f4640 1 -- 172.21.15.177:0/3534489710 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac0ab980 con 0x7fa0b013cf30 2023-11-28T20:07:38.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.496+0000 7fa0b845a640 1 -- 172.21.15.177:0/3534489710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b013cf30 msgr2=0x7fa0b006c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.496+0000 7fa0b845a640 1 --2- 172.21.15.177:0/3534489710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b013cf30 0x7fa0b006c2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009870 tx=0x7fa0ac01c470 comp rx=0 tx=0).stop 2023-11-28T20:07:38.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.496+0000 7fa0b845a640 1 -- 172.21.15.177:0/3534489710 shutdown_connections 2023-11-28T20:07:38.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.496+0000 7fa0b845a640 1 --2- 172.21.15.177:0/3534489710 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b015ad40 0x7fa0b00cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.496+0000 7fa0b845a640 1 --2- 172.21.15.177:0/3534489710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b013cf30 0x7fa0b006c2c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.496+0000 7fa0b845a640 1 -- 172.21.15.177:0/3534489710 >> 172.21.15.177:0/3534489710 conn(0x7fa0b006a530 msgr2=0x7fa0b006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:38.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.496+0000 7fa0b845a640 1 -- 172.21.15.177:0/3534489710 shutdown_connections 2023-11-28T20:07:38.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.496+0000 7fa0b845a640 1 -- 172.21.15.177:0/3534489710 wait complete. 2023-11-28T20:07:38.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.496+0000 7fa0b845a640 1 Processor -- start 2023-11-28T20:07:38.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.496+0000 7fa0b845a640 1 -- start start 2023-11-28T20:07:38.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b845a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b006c800 0x7fa0b013bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b845a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b013cf30 0x7fa0b0157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b845a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b015ad40 0x7fa0b0159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b845a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b0159060 con 0x7fa0b006c800 2023-11-28T20:07:38.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b845a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b0156d40 con 0x7fa0b015ad40 2023-11-28T20:07:38.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b845a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b013c610 con 0x7fa0b013cf30 2023-11-28T20:07:38.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b61f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b006c800 0x7fa0b013bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b61f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b006c800 0x7fa0b013bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51294/0 (socket says 172.21.15.177:51294) 2023-11-28T20:07:38.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b61f6640 1 -- 172.21.15.177:0/1783146523 learned_addr learned my addr 172.21.15.177:0/1783146523 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:38.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b59f5640 1 --2- 172.21.15.177:0/1783146523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b013cf30 0x7fa0b0157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b69f7640 1 --2- 172.21.15.177:0/1783146523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b015ad40 0x7fa0b0159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b61f6640 1 -- 172.21.15.177:0/1783146523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b013cf30 msgr2=0x7fa0b0157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b61f6640 1 --2- 172.21.15.177:0/1783146523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b013cf30 0x7fa0b0157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b61f6640 1 -- 172.21.15.177:0/1783146523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b015ad40 msgr2=0x7fa0b0159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b61f6640 1 --2- 172.21.15.177:0/1783146523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b015ad40 0x7fa0b0159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b61f6640 1 -- 172.21.15.177:0/1783146523 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac0094d0 con 0x7fa0b006c800 2023-11-28T20:07:38.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b59f5640 1 --2- 172.21.15.177:0/1783146523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b013cf30 0x7fa0b0157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:38.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b61f6640 1 --2- 172.21.15.177:0/1783146523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b006c800 0x7fa0b013bb40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0ae040 tx=0x7fa0ac019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:38.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0a6ffd640 1 -- 172.21.15.177:0/1783146523 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac0b4640 con 0x7fa0b006c800 2023-11-28T20:07:38.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0a6ffd640 1 -- 172.21.15.177:0/1783146523 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac0b47a0 con 0x7fa0b006c800 2023-11-28T20:07:38.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b845a640 1 -- 172.21.15.177:0/1783146523 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b01583e0 con 0x7fa0b006c800 2023-11-28T20:07:38.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0a6ffd640 1 -- 172.21.15.177:0/1783146523 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac0b4b30 con 0x7fa0b006c800 2023-11-28T20:07:38.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b845a640 1 -- 172.21.15.177:0/1783146523 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b01589a0 con 0x7fa0b006c800 2023-11-28T20:07:38.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0b845a640 1 -- 172.21.15.177:0/1783146523 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b0069440 con 0x7fa0b006c800 2023-11-28T20:07:38.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.500+0000 7fa0a6ffd640 1 -- 172.21.15.177:0/1783146523 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa0ac0b2070 con 0x7fa0b006c800 2023-11-28T20:07:38.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.504+0000 7fa0a6ffd640 1 --2- 172.21.15.177:0/1783146523 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa094066470 0x7fa094068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.504+0000 7fa0a6ffd640 1 -- 172.21.15.177:0/1783146523 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa0ac11dc00 con 0x7fa0b006c800 2023-11-28T20:07:38.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.504+0000 7fa0b59f5640 1 --2- 172.21.15.177:0/1783146523 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa094066470 0x7fa094068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.504+0000 7fa0b59f5640 1 --2- 172.21.15.177:0/1783146523 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa094066470 0x7fa094068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0147890 tx=0x7fa0a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:38.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.508+0000 7fa0a6ffd640 1 -- 172.21.15.177:0/1783146523 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0ac0eb330 con 0x7fa0b006c800 2023-11-28T20:07:38.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.656+0000 7fa0b845a640 1 -- 172.21.15.177:0/1783146523 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0b006d1e0 con 0x7fa0b006c800 2023-11-28T20:07:38.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.656+0000 7fa0a6ffd640 1 -- 172.21.15.177:0/1783146523 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12910 (secure 0 0 0) 0x7fa0ac0b0090 con 0x7fa0b006c800 2023-11-28T20:07:38.662 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:38.662 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":16,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:31.561227+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:07:38.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.660+0000 7fa0b845a640 1 -- 172.21.15.177:0/1783146523 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa094066470 msgr2=0x7fa094068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.660+0000 7fa0b845a640 1 --2- 172.21.15.177:0/1783146523 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa094066470 0x7fa094068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0147890 tx=0x7fa0a0008040 comp rx=0 tx=0).stop 2023-11-28T20:07:38.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.660+0000 7fa0b845a640 1 -- 172.21.15.177:0/1783146523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b006c800 msgr2=0x7fa0b013bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.660+0000 7fa0b845a640 1 --2- 172.21.15.177:0/1783146523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b006c800 0x7fa0b013bb40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0ae040 tx=0x7fa0ac019210 comp rx=0 tx=0).stop 2023-11-28T20:07:38.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.660+0000 7fa0b845a640 1 -- 172.21.15.177:0/1783146523 shutdown_connections 2023-11-28T20:07:38.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.660+0000 7fa0b845a640 1 --2- 172.21.15.177:0/1783146523 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa094066470 0x7fa094068930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.660+0000 7fa0b845a640 1 --2- 172.21.15.177:0/1783146523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b015ad40 0x7fa0b0159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.660+0000 7fa0b845a640 1 --2- 172.21.15.177:0/1783146523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b013cf30 0x7fa0b0157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.660+0000 7fa0b845a640 1 --2- 172.21.15.177:0/1783146523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b006c800 0x7fa0b013bb40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.660+0000 7fa0b845a640 1 -- 172.21.15.177:0/1783146523 >> 172.21.15.177:0/1783146523 conn(0x7fa0b006a530 msgr2=0x7fa0b013ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:38.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.660+0000 7fa0b845a640 1 -- 172.21.15.177:0/1783146523 shutdown_connections 2023-11-28T20:07:38.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.660+0000 7fa0b845a640 1 -- 172.21.15.177:0/1783146523 wait complete. 2023-11-28T20:07:38.682 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:07:38.683 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:07:38.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d950f640 1 Processor -- start 2023-11-28T20:07:38.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d950f640 1 -- start start 2023-11-28T20:07:38.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d950f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f90d4146960 0x7f90d406ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d950f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90d40b4030 0x7f90d40b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d950f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d415e900 con 0x7f90d406e8a0 2023-11-28T20:07:38.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d950f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d40b4a00 con 0x7f90d40b4030 2023-11-28T20:07:38.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d950f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d415dcf0 con 0x7f90d4146960 2023-11-28T20:07:38.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d27fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90d40b4030 0x7f90d40b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d27fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90d40b4030 0x7f90d40b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52454/0 (socket says 172.21.15.177:52454) 2023-11-28T20:07:38.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d27fc640 1 -- 172.21.15.177:0/1384004499 learned_addr learned my addr 172.21.15.177:0/1384004499 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:38.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d2ffd640 1 --2- 172.21.15.177:0/1384004499 >> v2:172.21.15.195:3300/0 conn(0x7f90d4146960 0x7f90d406ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d27fc640 1 -- 172.21.15.177:0/1384004499 >> v2:172.21.15.195:3300/0 conn(0x7f90d4146960 msgr2=0x7f90d406ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:38.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d27fc640 1 --2- 172.21.15.177:0/1384004499 >> v2:172.21.15.195:3300/0 conn(0x7f90d4146960 0x7f90d406ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d27fc640 1 -- 172.21.15.177:0/1384004499 >> v1:172.21.15.195:6789/0 conn(0x7f90d406e8a0 legacy=0x7f90d406ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d27fc640 1 -- 172.21.15.177:0/1384004499 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d415dfd0 con 0x7f90d40b4030 2023-11-28T20:07:38.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.820+0000 7f90d2ffd640 1 --2- 172.21.15.177:0/1384004499 >> v2:172.21.15.195:3300/0 conn(0x7f90d4146960 0x7f90d406ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:38.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.824+0000 7f90d27fc640 1 --2- 172.21.15.177:0/1384004499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d40b4030 0x7f90d40b44c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f90d4066dd0 tx=0x7f90c801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad30e8401718463 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:38.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.824+0000 7f90d1ffb640 1 -- 172.21.15.177:0/1384004499 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c80ab5f0 con 0x7f90d40b4030 2023-11-28T20:07:38.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.824+0000 7f90d1ffb640 1 -- 172.21.15.177:0/1384004499 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c80ab750 con 0x7f90d40b4030 2023-11-28T20:07:38.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.824+0000 7f90d1ffb640 1 -- 172.21.15.177:0/1384004499 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c80abae0 con 0x7f90d40b4030 2023-11-28T20:07:38.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.824+0000 7f90d950f640 1 -- 172.21.15.177:0/1384004499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d40b4030 msgr2=0x7f90d40b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.824+0000 7f90d950f640 1 --2- 172.21.15.177:0/1384004499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d40b4030 0x7f90d40b44c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f90d4066dd0 tx=0x7f90c801c500 comp rx=0 tx=0).stop 2023-11-28T20:07:38.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.824+0000 7f90d950f640 1 -- 172.21.15.177:0/1384004499 shutdown_connections 2023-11-28T20:07:38.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.824+0000 7f90d950f640 1 --2- 172.21.15.177:0/1384004499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d40b4030 0x7f90d40b44c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.824+0000 7f90d950f640 1 --2- 172.21.15.177:0/1384004499 >> v2:172.21.15.195:3300/0 conn(0x7f90d4146960 0x7f90d406ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.824+0000 7f90d950f640 1 -- 172.21.15.177:0/1384004499 >> 172.21.15.177:0/1384004499 conn(0x7f90d4070b40 msgr2=0x7f90d4066320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:38.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.824+0000 7f90d950f640 1 -- 172.21.15.177:0/1384004499 shutdown_connections 2023-11-28T20:07:38.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.824+0000 7f90d950f640 1 -- 172.21.15.177:0/1384004499 wait complete. 2023-11-28T20:07:38.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d950f640 1 Processor -- start 2023-11-28T20:07:38.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d950f640 1 -- start start 2023-11-28T20:07:38.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d950f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d406e8a0 0x7f90d413ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d950f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d40b4030 0x7f90d415a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d950f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d4146960 0x7f90d415ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d950f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d413ba70 con 0x7f90d40b4030 2023-11-28T20:07:38.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d950f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d41384f0 con 0x7f90d406e8a0 2023-11-28T20:07:38.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d950f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d4145730 con 0x7f90d4146960 2023-11-28T20:07:38.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d27fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d40b4030 0x7f90d415a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d27fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d40b4030 0x7f90d415a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52458/0 (socket says 172.21.15.177:52458) 2023-11-28T20:07:38.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d27fc640 1 -- 172.21.15.177:0/1088204619 learned_addr learned my addr 172.21.15.177:0/1088204619 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:38.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d27fc640 1 -- 172.21.15.177:0/1088204619 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d4146960 msgr2=0x7f90d415ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d2ffd640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d406e8a0 0x7f90d413ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d37fe640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d4146960 0x7f90d415ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d27fc640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d4146960 0x7f90d415ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d27fc640 1 -- 172.21.15.177:0/1088204619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d406e8a0 msgr2=0x7f90d413ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d27fc640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d406e8a0 0x7f90d413ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d27fc640 1 -- 172.21.15.177:0/1088204619 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c80094d0 con 0x7f90d40b4030 2023-11-28T20:07:38.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d2ffd640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d406e8a0 0x7f90d413ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:38.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d37fe640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d4146960 0x7f90d415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:38.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d27fc640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d40b4030 0x7f90d415a7f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90c8019110 tx=0x7f90c801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:38.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90bb7fe640 1 -- 172.21.15.177:0/1088204619 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c80be5f0 con 0x7f90d40b4030 2023-11-28T20:07:38.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90bb7fe640 1 -- 172.21.15.177:0/1088204619 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c80be750 con 0x7f90d40b4030 2023-11-28T20:07:38.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90bb7fe640 1 -- 172.21.15.177:0/1088204619 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c80beb00 con 0x7f90d40b4030 2023-11-28T20:07:38.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d950f640 1 -- 172.21.15.177:0/1088204619 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d4145a10 con 0x7f90d40b4030 2023-11-28T20:07:38.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d950f640 1 -- 172.21.15.177:0/1088204619 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d4145fd0 con 0x7f90d40b4030 2023-11-28T20:07:38.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.828+0000 7f90d950f640 1 -- 172.21.15.177:0/1088204619 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d41461c0 con 0x7f90d40b4030 2023-11-28T20:07:38.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.832+0000 7f90bb7fe640 1 -- 172.21.15.177:0/1088204619 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f90c80b43f0 con 0x7f90d40b4030 2023-11-28T20:07:38.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.832+0000 7f90bb7fe640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f90c0066470 0x7f90c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:38.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.832+0000 7f90bb7fe640 1 -- 172.21.15.177:0/1088204619 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f90c80a8050 con 0x7f90d40b4030 2023-11-28T20:07:38.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.832+0000 7f90d2ffd640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f90c0066470 0x7f90c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:38.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.832+0000 7f90d2ffd640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f90c0066470 0x7f90c0068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f90c40097a0 tx=0x7f90c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:38.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.836+0000 7f90bb7fe640 1 -- 172.21.15.177:0/1088204619 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90c80ebed0 con 0x7f90d40b4030 2023-11-28T20:07:38.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.988+0000 7f90d950f640 1 -- 172.21.15.177:0/1088204619 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90d40693d0 con 0x7f90d40b4030 2023-11-28T20:07:38.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.988+0000 7f90bb7fe640 1 -- 172.21.15.177:0/1088204619 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90c80ef4f0 con 0x7f90d40b4030 2023-11-28T20:07:38.992 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:07:38.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.988+0000 7f90d950f640 1 -- 172.21.15.177:0/1088204619 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f90c0066470 msgr2=0x7f90c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.988+0000 7f90d950f640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f90c0066470 0x7f90c0068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f90c40097a0 tx=0x7f90c4008040 comp rx=0 tx=0).stop 2023-11-28T20:07:38.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.988+0000 7f90d950f640 1 -- 172.21.15.177:0/1088204619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d40b4030 msgr2=0x7f90d415a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:38.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.988+0000 7f90d950f640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d40b4030 0x7f90d415a7f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90c8019110 tx=0x7f90c801ad40 comp rx=0 tx=0).stop 2023-11-28T20:07:38.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.988+0000 7f90d950f640 1 -- 172.21.15.177:0/1088204619 shutdown_connections 2023-11-28T20:07:38.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.988+0000 7f90d950f640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f90c0066470 0x7f90c0068930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.988+0000 7f90d950f640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d4146960 0x7f90d415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.988+0000 7f90d950f640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d40b4030 0x7f90d415a7f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.988+0000 7f90d950f640 1 --2- 172.21.15.177:0/1088204619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d406e8a0 0x7f90d413ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:38.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.988+0000 7f90d950f640 1 -- 172.21.15.177:0/1088204619 >> 172.21.15.177:0/1088204619 conn(0x7f90d4070b40 msgr2=0x7f90d40b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:38.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.988+0000 7f90d950f640 1 -- 172.21.15.177:0/1088204619 shutdown_connections 2023-11-28T20:07:38.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:38.988+0000 7f90d950f640 1 -- 172.21.15.177:0/1088204619 wait complete. 2023-11-28T20:07:39.012 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T20:07:39.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.148+0000 7f71d50dd640 1 Processor -- start 2023-11-28T20:07:39.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.148+0000 7f71d50dd640 1 -- start start 2023-11-28T20:07:39.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.148+0000 7f71d50dd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f71d00cfe90 0x7f71d00d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:39.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.148+0000 7f71d50dd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d00d3880 con 0x7f71d00b35b0 2023-11-28T20:07:39.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.148+0000 7f71d50dd640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d00cdc80 con 0x7f71d00b3c70 2023-11-28T20:07:39.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.148+0000 7f71d50dd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d00d4090 con 0x7f71d00cfe90 2023-11-28T20:07:39.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.148+0000 7f71ced9d640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f71d00b35b0 0x7f71d00cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:41818/0 (socket says 172.21.15.177:41818) 2023-11-28T20:07:39.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.148+0000 7f71ced9d640 1 -- 172.21.15.177:0/109240088 learned_addr learned my addr 172.21.15.177:0/109240088 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:39.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.148+0000 7f71ce59c640 1 --2- 172.21.15.177:0/109240088 >> v2:172.21.15.177:3300/0 conn(0x7f71d00cfe90 0x7f71d00d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:39.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.148+0000 7f71ce59c640 1 -- 172.21.15.177:0/109240088 >> v1:172.21.15.195:6789/0 conn(0x7f71d00b3c70 legacy=0x7f71d00ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:39.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.148+0000 7f71ce59c640 1 -- 172.21.15.177:0/109240088 >> v1:172.21.15.177:6789/0 conn(0x7f71d00b35b0 legacy=0x7f71d00cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:39.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.148+0000 7f71ce59c640 1 -- 172.21.15.177:0/109240088 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d00d3ad0 con 0x7f71d00cfe90 2023-11-28T20:07:39.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.152+0000 7f71ce59c640 1 --2- 172.21.15.177:0/109240088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d00cfe90 0x7f71d00d0f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f71c40097c0 tx=0x7f71c401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4438657c943e1d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:39.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.152+0000 7f71cdd9b640 1 -- 172.21.15.177:0/109240088 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c40ab650 con 0x7f71d00cfe90 2023-11-28T20:07:39.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.152+0000 7f71cdd9b640 1 -- 172.21.15.177:0/109240088 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c40ab7b0 con 0x7f71d00cfe90 2023-11-28T20:07:39.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.152+0000 7f71cdd9b640 1 -- 172.21.15.177:0/109240088 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c40abb40 con 0x7f71d00cfe90 2023-11-28T20:07:39.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.152+0000 7f71d50dd640 1 -- 172.21.15.177:0/109240088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d00cfe90 msgr2=0x7f71d00d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:39.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.152+0000 7f71d50dd640 1 --2- 172.21.15.177:0/109240088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d00cfe90 0x7f71d00d0f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f71c40097c0 tx=0x7f71c401c450 comp rx=0 tx=0).stop 2023-11-28T20:07:39.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.152+0000 7f71d50dd640 1 -- 172.21.15.177:0/109240088 shutdown_connections 2023-11-28T20:07:39.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.152+0000 7f71d50dd640 1 --2- 172.21.15.177:0/109240088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d00cfe90 0x7f71d00d0f50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:39.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.152+0000 7f71d50dd640 1 -- 172.21.15.177:0/109240088 >> 172.21.15.177:0/109240088 conn(0x7f71d009c4b0 msgr2=0x7f71d00d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:39.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.152+0000 7f71d50dd640 1 -- 172.21.15.177:0/109240088 shutdown_connections 2023-11-28T20:07:39.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.152+0000 7f71d50dd640 1 -- 172.21.15.177:0/109240088 wait complete. 2023-11-28T20:07:39.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71d50dd640 1 Processor -- start 2023-11-28T20:07:39.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71d50dd640 1 -- start start 2023-11-28T20:07:39.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71d50dd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71d00b35b0 0x7f71d0153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:39.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71d50dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d00b3c70 0x7f71d0152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:39.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71d50dd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71d00cfe90 0x7f71d0154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:39.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71d50dd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0153750 con 0x7f71d00b3c70 2023-11-28T20:07:39.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71d50dd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0154590 con 0x7f71d00b35b0 2023-11-28T20:07:39.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71d50dd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d01525a0 con 0x7f71d00cfe90 2023-11-28T20:07:39.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71ce59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d00b3c70 0x7f71d0152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:39.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71ce59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d00b3c70 0x7f71d0152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52474/0 (socket says 172.21.15.177:52474) 2023-11-28T20:07:39.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71ce59c640 1 -- 172.21.15.177:0/143848326 learned_addr learned my addr 172.21.15.177:0/143848326 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:39.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71ced9d640 1 --2- 172.21.15.177:0/143848326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71d00b35b0 0x7f71d0153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:39.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71cf59e640 1 --2- 172.21.15.177:0/143848326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71d00cfe90 0x7f71d0154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:39.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71ce59c640 1 -- 172.21.15.177:0/143848326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71d00cfe90 msgr2=0x7f71d0154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:39.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71ce59c640 1 --2- 172.21.15.177:0/143848326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71d00cfe90 0x7f71d0154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:39.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71ce59c640 1 -- 172.21.15.177:0/143848326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71d00b35b0 msgr2=0x7f71d0153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:39.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71ce59c640 1 --2- 172.21.15.177:0/143848326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71d00b35b0 0x7f71d0153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:39.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71ce59c640 1 -- 172.21.15.177:0/143848326 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4009420 con 0x7f71d00b3c70 2023-11-28T20:07:39.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71ce59c640 1 --2- 172.21.15.177:0/143848326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d00b3c70 0x7f71d0152060 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f71c401ab00 tx=0x7f71c401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:39.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71b77fe640 1 -- 172.21.15.177:0/143848326 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c40b5810 con 0x7f71d00b3c70 2023-11-28T20:07:39.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71b77fe640 1 -- 172.21.15.177:0/143848326 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c40b5970 con 0x7f71d00b3c70 2023-11-28T20:07:39.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71d50dd640 1 -- 172.21.15.177:0/143848326 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d0152ef0 con 0x7f71d00b3c70 2023-11-28T20:07:39.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71b77fe640 1 -- 172.21.15.177:0/143848326 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c40b5d00 con 0x7f71d00b3c70 2023-11-28T20:07:39.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71d50dd640 1 -- 172.21.15.177:0/143848326 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d0153c60 con 0x7f71d00b3c70 2023-11-28T20:07:39.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.156+0000 7f71d50dd640 1 -- 172.21.15.177:0/143848326 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d0069440 con 0x7f71d00b3c70 2023-11-28T20:07:39.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.160+0000 7f71b77fe640 1 -- 172.21.15.177:0/143848326 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f71c40be3b0 con 0x7f71d00b3c70 2023-11-28T20:07:39.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.160+0000 7f71b77fe640 1 --2- 172.21.15.177:0/143848326 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71bc066470 0x7f71bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:39.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.160+0000 7f71b77fe640 1 -- 172.21.15.177:0/143848326 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f71c411e7f0 con 0x7f71d00b3c70 2023-11-28T20:07:39.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.160+0000 7f71ced9d640 1 --2- 172.21.15.177:0/143848326 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71bc066470 0x7f71bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:39.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.160+0000 7f71ced9d640 1 --2- 172.21.15.177:0/143848326 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71bc066470 0x7f71bc068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71c0005890 tx=0x7f71c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:39.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.164+0000 7f71b77fe640 1 -- 172.21.15.177:0/143848326 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71c40ec170 con 0x7f71d00b3c70 2023-11-28T20:07:39.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.316+0000 7f71d50dd640 1 -- 172.21.15.177:0/143848326 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f71d009c9f0 con 0x7f71d00b3c70 2023-11-28T20:07:39.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.316+0000 7f71b77fe640 1 -- 172.21.15.177:0/143848326 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f71c40c4090 con 0x7f71d00b3c70 2023-11-28T20:07:39.320 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:39.320 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-11-28T20:07:39.320 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:07:39.320 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-11-28T20:07:39.320 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-11-28T20:07:39.320 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:07:39.320 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-11-28T20:07:39.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.316+0000 7f71d50dd640 1 -- 172.21.15.177:0/143848326 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71bc066470 msgr2=0x7f71bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:39.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.316+0000 7f71d50dd640 1 --2- 172.21.15.177:0/143848326 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71bc066470 0x7f71bc068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71c0005890 tx=0x7f71c0009040 comp rx=0 tx=0).stop 2023-11-28T20:07:39.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.316+0000 7f71d50dd640 1 -- 172.21.15.177:0/143848326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d00b3c70 msgr2=0x7f71d0152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:39.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.316+0000 7f71d50dd640 1 --2- 172.21.15.177:0/143848326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d00b3c70 0x7f71d0152060 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f71c401ab00 tx=0x7f71c401ac90 comp rx=0 tx=0).stop 2023-11-28T20:07:39.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.316+0000 7f71d50dd640 1 -- 172.21.15.177:0/143848326 shutdown_connections 2023-11-28T20:07:39.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.316+0000 7f71d50dd640 1 --2- 172.21.15.177:0/143848326 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71bc066470 0x7f71bc068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:39.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.316+0000 7f71d50dd640 1 --2- 172.21.15.177:0/143848326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71d00cfe90 0x7f71d0154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:39.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.316+0000 7f71d50dd640 1 --2- 172.21.15.177:0/143848326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d00b3c70 0x7f71d0152060 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:39.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.316+0000 7f71d50dd640 1 --2- 172.21.15.177:0/143848326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71d00b35b0 0x7f71d0153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:39.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.316+0000 7f71d50dd640 1 -- 172.21.15.177:0/143848326 >> 172.21.15.177:0/143848326 conn(0x7f71d009c4b0 msgr2=0x7f71d00d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:39.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.316+0000 7f71d50dd640 1 -- 172.21.15.177:0/143848326 shutdown_connections 2023-11-28T20:07:39.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.316+0000 7f71d50dd640 1 -- 172.21.15.177:0/143848326 wait complete. 2023-11-28T20:07:39.340 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T20:07:39.341 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T20:07:39.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.480+0000 7fa0b1f57640 1 Processor -- start 2023-11-28T20:07:39.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.480+0000 7fa0b1f57640 1 -- start start 2023-11-28T20:07:39.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.480+0000 7fa0b1f57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0ac159ba0 0x7fa0ac0c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:39.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.480+0000 7fa0b1f57640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa0ac0cb0c0 0x7fa0ac070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:39.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.480+0000 7fa0b1f57640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ac159f80 con 0x7fa0ac0cce60 2023-11-28T20:07:39.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.480+0000 7fa0b1f57640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ac0cb520 con 0x7fa0ac0cb0c0 2023-11-28T20:07:39.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.480+0000 7fa0b1f57640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac0ce460 con 0x7fa0ac159ba0 2023-11-28T20:07:39.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.480+0000 7fa0aaffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa0ac0cb0c0 0x7fa0ac070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:39.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.480+0000 7fa0aaffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa0ac0cb0c0 0x7fa0ac070580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52486/0 (socket says 172.21.15.177:52486) 2023-11-28T20:07:39.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.480+0000 7fa0aaffd640 1 -- 172.21.15.177:0/986800938 learned_addr learned my addr 172.21.15.177:0/986800938 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:39.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.480+0000 7fa0ab7fe640 1 --2- 172.21.15.177:0/986800938 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0ac159ba0 0x7fa0ac0c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:39.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.480+0000 7fa0aaffd640 1 -- 172.21.15.177:0/986800938 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0ac159ba0 msgr2=0x7fa0ac0c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:39.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.480+0000 7fa0aaffd640 1 --2- 172.21.15.177:0/986800938 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0ac159ba0 0x7fa0ac0c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:39.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.480+0000 7fa0aaffd640 1 -- 172.21.15.177:0/986800938 >> v1:172.21.15.195:6789/0 conn(0x7fa0ac0cce60 legacy=0x7fa0ac06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:39.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.480+0000 7fa0aaffd640 1 -- 172.21.15.177:0/986800938 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac0cda30 con 0x7fa0ac0cb0c0 2023-11-28T20:07:39.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.484+0000 7fa0aaffd640 1 --2- 172.21.15.177:0/986800938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0ac0cb0c0 0x7fa0ac070580 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000aa10 tx=0x7fa0a001d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c79e4b5fb56bb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:39.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.484+0000 7fa0aa7fc640 1 -- 172.21.15.177:0/986800938 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00a68d0 con 0x7fa0ac0cb0c0 2023-11-28T20:07:39.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.484+0000 7fa0aa7fc640 1 -- 172.21.15.177:0/986800938 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a00a6a30 con 0x7fa0ac0cb0c0 2023-11-28T20:07:39.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.484+0000 7fa0aa7fc640 1 -- 172.21.15.177:0/986800938 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00a6dc0 con 0x7fa0ac0cb0c0 2023-11-28T20:07:39.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.484+0000 7fa0b1f57640 1 -- 172.21.15.177:0/986800938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0ac0cb0c0 msgr2=0x7fa0ac070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:39.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.484+0000 7fa0b1f57640 1 --2- 172.21.15.177:0/986800938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0ac0cb0c0 0x7fa0ac070580 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000aa10 tx=0x7fa0a001d8e0 comp rx=0 tx=0).stop 2023-11-28T20:07:39.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.484+0000 7fa0b1f57640 1 -- 172.21.15.177:0/986800938 shutdown_connections 2023-11-28T20:07:39.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.484+0000 7fa0b1f57640 1 --2- 172.21.15.177:0/986800938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0ac0cb0c0 0x7fa0ac070580 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:39.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.484+0000 7fa0b1f57640 1 --2- 172.21.15.177:0/986800938 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0ac159ba0 0x7fa0ac0c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:39.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.484+0000 7fa0b1f57640 1 -- 172.21.15.177:0/986800938 >> 172.21.15.177:0/986800938 conn(0x7fa0ac0b0c50 msgr2=0x7fa0ac0b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:39.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.484+0000 7fa0b1f57640 1 -- 172.21.15.177:0/986800938 shutdown_connections 2023-11-28T20:07:39.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.484+0000 7fa0b1f57640 1 -- 172.21.15.177:0/986800938 wait complete. 2023-11-28T20:07:39.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.484+0000 7fa0b1f57640 1 Processor -- start 2023-11-28T20:07:39.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0b1f57640 1 -- start start 2023-11-28T20:07:39.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0b1f57640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0ac0cb0c0 0x7fa0ac144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:39.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0b1f57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0ac0cce60 0x7fa0ac0999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:39.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0b1f57640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0ac159ba0 0x7fa0ac144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:39.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0b1f57640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac144880 con 0x7fa0ac159ba0 2023-11-28T20:07:39.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0b1f57640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac0abf30 con 0x7fa0ac0cb0c0 2023-11-28T20:07:39.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0b1f57640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac0ac1d0 con 0x7fa0ac0cce60 2023-11-28T20:07:39.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0abfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0ac159ba0 0x7fa0ac144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:39.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0abfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0ac159ba0 0x7fa0ac144b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52490/0 (socket says 172.21.15.177:52490) 2023-11-28T20:07:39.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0abfff640 1 -- 172.21.15.177:0/2408137700 learned_addr learned my addr 172.21.15.177:0/2408137700 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:39.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0ab7fe640 1 --2- 172.21.15.177:0/2408137700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0ac0cb0c0 0x7fa0ac144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:39.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0aaffd640 1 --2- 172.21.15.177:0/2408137700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0ac0cce60 0x7fa0ac0999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:39.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0abfff640 1 -- 172.21.15.177:0/2408137700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0ac0cce60 msgr2=0x7fa0ac0999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:39.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0abfff640 1 --2- 172.21.15.177:0/2408137700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0ac0cce60 0x7fa0ac0999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:39.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0abfff640 1 -- 172.21.15.177:0/2408137700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0ac0cb0c0 msgr2=0x7fa0ac144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:39.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0abfff640 1 --2- 172.21.15.177:0/2408137700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0ac0cb0c0 0x7fa0ac144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:39.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0abfff640 1 -- 172.21.15.177:0/2408137700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a000a670 con 0x7fa0ac159ba0 2023-11-28T20:07:39.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0abfff640 1 --2- 172.21.15.177:0/2408137700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0ac159ba0 0x7fa0ac144b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400c6c0 tx=0x7fa0a400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:39.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa093fff640 1 -- 172.21.15.177:0/2408137700 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4003b80 con 0x7fa0ac159ba0 2023-11-28T20:07:39.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa093fff640 1 -- 172.21.15.177:0/2408137700 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a4003ce0 con 0x7fa0ac159ba0 2023-11-28T20:07:39.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa093fff640 1 -- 172.21.15.177:0/2408137700 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a40052f0 con 0x7fa0ac159ba0 2023-11-28T20:07:39.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0b1f57640 1 -- 172.21.15.177:0/2408137700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ac0ac4b0 con 0x7fa0ac159ba0 2023-11-28T20:07:39.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0b1f57640 1 -- 172.21.15.177:0/2408137700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ac0aca70 con 0x7fa0ac159ba0 2023-11-28T20:07:39.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.488+0000 7fa0b1f57640 1 -- 172.21.15.177:0/2408137700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ac04e850 con 0x7fa0ac159ba0 2023-11-28T20:07:39.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.492+0000 7fa093fff640 1 -- 172.21.15.177:0/2408137700 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa0a4005450 con 0x7fa0ac159ba0 2023-11-28T20:07:39.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.492+0000 7fa093fff640 1 --2- 172.21.15.177:0/2408137700 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa098066470 0x7fa098068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:39.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.492+0000 7fa093fff640 1 -- 172.21.15.177:0/2408137700 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa0a4083970 con 0x7fa0ac159ba0 2023-11-28T20:07:39.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.492+0000 7fa0ab7fe640 1 --2- 172.21.15.177:0/2408137700 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa098066470 0x7fa098068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:39.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.492+0000 7fa0ab7fe640 1 --2- 172.21.15.177:0/2408137700 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa098066470 0x7fa098068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00b9d0 tx=0x7fa09c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:39.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.496+0000 7fa093fff640 1 -- 172.21.15.177:0/2408137700 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0a40510b0 con 0x7fa0ac159ba0 2023-11-28T20:07:39.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:39.648+0000 7fa0b1f57640 1 -- 172.21.15.177:0/2408137700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa0ac0693d0 con 0x7fa0ac159ba0 2023-11-28T20:07:39.872 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:07:39.876 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:07:40.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.084+0000 7fa093fff640 1 -- 172.21.15.177:0/2408137700 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa0a40546d0 con 0x7fa0ac159ba0 2023-11-28T20:07:40.087 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-11-28T20:07:40.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.088+0000 7fa0b1f57640 1 -- 172.21.15.177:0/2408137700 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa098066470 msgr2=0x7fa098068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:40.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.088+0000 7fa0b1f57640 1 --2- 172.21.15.177:0/2408137700 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa098066470 0x7fa098068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00b9d0 tx=0x7fa09c008040 comp rx=0 tx=0).stop 2023-11-28T20:07:40.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.088+0000 7fa0b1f57640 1 -- 172.21.15.177:0/2408137700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0ac159ba0 msgr2=0x7fa0ac144b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:40.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.088+0000 7fa0b1f57640 1 --2- 172.21.15.177:0/2408137700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0ac159ba0 0x7fa0ac144b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400c6c0 tx=0x7fa0a400cb80 comp rx=0 tx=0).stop 2023-11-28T20:07:40.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.088+0000 7fa0b1f57640 1 -- 172.21.15.177:0/2408137700 shutdown_connections 2023-11-28T20:07:40.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.088+0000 7fa0b1f57640 1 --2- 172.21.15.177:0/2408137700 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa098066470 0x7fa098068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:40.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.088+0000 7fa0b1f57640 1 --2- 172.21.15.177:0/2408137700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0ac159ba0 0x7fa0ac144b10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:40.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.088+0000 7fa0b1f57640 1 --2- 172.21.15.177:0/2408137700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0ac0cce60 0x7fa0ac0999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:40.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.088+0000 7fa0b1f57640 1 --2- 172.21.15.177:0/2408137700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0ac0cb0c0 0x7fa0ac144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:40.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.088+0000 7fa0b1f57640 1 -- 172.21.15.177:0/2408137700 >> 172.21.15.177:0/2408137700 conn(0x7fa0ac0b0c50 msgr2=0x7fa0ac0aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:40.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.088+0000 7fa0b1f57640 1 -- 172.21.15.177:0/2408137700 shutdown_connections 2023-11-28T20:07:40.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.088+0000 7fa0b1f57640 1 -- 172.21.15.177:0/2408137700 wait complete. 2023-11-28T20:07:40.117 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T20:07:40.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.256+0000 7febfb4bb640 1 Processor -- start 2023-11-28T20:07:40.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.256+0000 7febfb4bb640 1 -- start start 2023-11-28T20:07:40.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.260+0000 7febfb4bb640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7febf40b2660 0x7febf4160c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:40.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.260+0000 7febfb4bb640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7febf415e150 0x7febf40c6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:40.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.260+0000 7febfb4bb640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf40cf260 con 0x7febf40c69c0 2023-11-28T20:07:40.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.260+0000 7febfb4bb640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf40c6df0 con 0x7febf415e150 2023-11-28T20:07:40.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.260+0000 7febfb4bb640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf4161290 con 0x7febf40b2660 2023-11-28T20:07:40.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.260+0000 7febf9cb8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7febf415e150 0x7febf40c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:40.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.260+0000 7febf9cb8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7febf415e150 0x7febf40c6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52504/0 (socket says 172.21.15.177:52504) 2023-11-28T20:07:40.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.260+0000 7febf9cb8640 1 -- 172.21.15.177:0/1021835040 learned_addr learned my addr 172.21.15.177:0/1021835040 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:40.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.260+0000 7febfa4b9640 1 --2- 172.21.15.177:0/1021835040 >> v2:172.21.15.195:3300/0 conn(0x7febf40b2660 0x7febf4160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:40.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.260+0000 7febf9cb8640 1 -- 172.21.15.177:0/1021835040 >> v2:172.21.15.195:3300/0 conn(0x7febf40b2660 msgr2=0x7febf4160c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:40.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.260+0000 7febf9cb8640 1 --2- 172.21.15.177:0/1021835040 >> v2:172.21.15.195:3300/0 conn(0x7febf40b2660 0x7febf4160c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:40.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.260+0000 7febf9cb8640 1 -- 172.21.15.177:0/1021835040 >> v1:172.21.15.177:6789/0 conn(0x7febf40c69c0 legacy=0x7febf40999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:40.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.260+0000 7febf9cb8640 1 -- 172.21.15.177:0/1021835040 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf4161570 con 0x7febf415e150 2023-11-28T20:07:40.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.260+0000 7febfa4b9640 1 --2- 172.21.15.177:0/1021835040 >> v2:172.21.15.195:3300/0 conn(0x7febf40b2660 0x7febf4160c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:40.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febf9cb8640 1 --2- 172.21.15.177:0/1021835040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf415e150 0x7febf40c6480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7febf4071c50 tx=0x7febe401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4128909797b89bba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:40.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febf94b7640 1 -- 172.21.15.177:0/1021835040 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe40ab600 con 0x7febf415e150 2023-11-28T20:07:40.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febf94b7640 1 -- 172.21.15.177:0/1021835040 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe40a7050 con 0x7febf415e150 2023-11-28T20:07:40.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febf94b7640 1 -- 172.21.15.177:0/1021835040 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe40ab980 con 0x7febf415e150 2023-11-28T20:07:40.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 -- 172.21.15.177:0/1021835040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf415e150 msgr2=0x7febf40c6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:40.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 --2- 172.21.15.177:0/1021835040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf415e150 0x7febf40c6480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7febf4071c50 tx=0x7febe401c440 comp rx=0 tx=0).stop 2023-11-28T20:07:40.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 -- 172.21.15.177:0/1021835040 shutdown_connections 2023-11-28T20:07:40.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 --2- 172.21.15.177:0/1021835040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf415e150 0x7febf40c6480 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:40.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 --2- 172.21.15.177:0/1021835040 >> v2:172.21.15.195:3300/0 conn(0x7febf40b2660 0x7febf4160c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:40.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 -- 172.21.15.177:0/1021835040 >> 172.21.15.177:0/1021835040 conn(0x7febf40d0ea0 msgr2=0x7febf40d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:40.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 -- 172.21.15.177:0/1021835040 shutdown_connections 2023-11-28T20:07:40.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 -- 172.21.15.177:0/1021835040 wait complete. 2023-11-28T20:07:40.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 Processor -- start 2023-11-28T20:07:40.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 -- start start 2023-11-28T20:07:40.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febf40b2660 0x7febf40b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:40.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf40c69c0 0x7febf40b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:40.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf415e150 0x7febf41f9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:40.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf41558a0 con 0x7febf40c69c0 2023-11-28T20:07:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf415aac0 con 0x7febf415e150 2023-11-28T20:07:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.264+0000 7febfb4bb640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf415a490 con 0x7febf40b2660 2023-11-28T20:07:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febf9cb8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf40c69c0 0x7febf40b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febf9cb8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf40c69c0 0x7febf40b4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52510/0 (socket says 172.21.15.177:52510) 2023-11-28T20:07:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febf9cb8640 1 -- 172.21.15.177:0/1780106688 learned_addr learned my addr 172.21.15.177:0/1780106688 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febfa4b9640 1 --2- 172.21.15.177:0/1780106688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febf40b2660 0x7febf40b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febfacba640 1 --2- 172.21.15.177:0/1780106688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf415e150 0x7febf41f9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febf9cb8640 1 -- 172.21.15.177:0/1780106688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febf40b2660 msgr2=0x7febf40b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febf9cb8640 1 --2- 172.21.15.177:0/1780106688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febf40b2660 0x7febf40b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febf9cb8640 1 -- 172.21.15.177:0/1780106688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf415e150 msgr2=0x7febf41f9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febf9cb8640 1 --2- 172.21.15.177:0/1780106688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf415e150 0x7febf41f9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febf9cb8640 1 -- 172.21.15.177:0/1780106688 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe40094d0 con 0x7febf40c69c0 2023-11-28T20:07:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febf9cb8640 1 --2- 172.21.15.177:0/1780106688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf40c69c0 0x7febf40b4340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7febe4019050 tx=0x7febe40191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febeaffd640 1 -- 172.21.15.177:0/1780106688 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe40b4840 con 0x7febf40c69c0 2023-11-28T20:07:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febeaffd640 1 -- 172.21.15.177:0/1780106688 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe40b49a0 con 0x7febf40c69c0 2023-11-28T20:07:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febeaffd640 1 -- 172.21.15.177:0/1780106688 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe40b4d30 con 0x7febf40c69c0 2023-11-28T20:07:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febfb4bb640 1 -- 172.21.15.177:0/1780106688 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf4155a80 con 0x7febf40c69c0 2023-11-28T20:07:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febfb4bb640 1 -- 172.21.15.177:0/1780106688 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf40b4880 con 0x7febf40c69c0 2023-11-28T20:07:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febfb4bb640 1 -- 172.21.15.177:0/1780106688 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf40693d0 con 0x7febf40c69c0 2023-11-28T20:07:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.268+0000 7febeaffd640 1 -- 172.21.15.177:0/1780106688 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7febe40b2040 con 0x7febf40c69c0 2023-11-28T20:07:40.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.272+0000 7febeaffd640 1 --2- 172.21.15.177:0/1780106688 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7febd8066470 0x7febd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:40.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.272+0000 7febeaffd640 1 -- 172.21.15.177:0/1780106688 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7febe411e920 con 0x7febf40c69c0 2023-11-28T20:07:40.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.272+0000 7febfa4b9640 1 --2- 172.21.15.177:0/1780106688 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7febd8066470 0x7febd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.272+0000 7febfa4b9640 1 --2- 172.21.15.177:0/1780106688 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7febd8066470 0x7febd8068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7febf000ab60 tx=0x7febf0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.272+0000 7febeaffd640 1 -- 172.21.15.177:0/1780106688 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7febe40ec1a0 con 0x7febf40c69c0 2023-11-28T20:07:40.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:40.424+0000 7febfb4bb640 1 -- 172.21.15.177:0/1780106688 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7febf406b1d0 con 0x7febf40c69c0 2023-11-28T20:07:41.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.092+0000 7febeaffd640 1 -- 172.21.15.177:0/1780106688 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7febe40ef7c0 con 0x7febf40c69c0 2023-11-28T20:07:41.095 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-11-28T20:07:41.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.096+0000 7febfb4bb640 1 -- 172.21.15.177:0/1780106688 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7febd8066470 msgr2=0x7febd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:41.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.096+0000 7febfb4bb640 1 --2- 172.21.15.177:0/1780106688 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7febd8066470 0x7febd8068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7febf000ab60 tx=0x7febf0008040 comp rx=0 tx=0).stop 2023-11-28T20:07:41.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.096+0000 7febfb4bb640 1 -- 172.21.15.177:0/1780106688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf40c69c0 msgr2=0x7febf40b4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:41.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.096+0000 7febfb4bb640 1 --2- 172.21.15.177:0/1780106688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf40c69c0 0x7febf40b4340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7febe4019050 tx=0x7febe40191e0 comp rx=0 tx=0).stop 2023-11-28T20:07:41.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.096+0000 7febfb4bb640 1 -- 172.21.15.177:0/1780106688 shutdown_connections 2023-11-28T20:07:41.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.096+0000 7febfb4bb640 1 --2- 172.21.15.177:0/1780106688 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7febd8066470 0x7febd8068930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:41.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.096+0000 7febfb4bb640 1 --2- 172.21.15.177:0/1780106688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf415e150 0x7febf41f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:41.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.096+0000 7febfb4bb640 1 --2- 172.21.15.177:0/1780106688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf40c69c0 0x7febf40b4340 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:41.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.096+0000 7febfb4bb640 1 --2- 172.21.15.177:0/1780106688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febf40b2660 0x7febf40b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:41.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.096+0000 7febfb4bb640 1 -- 172.21.15.177:0/1780106688 >> 172.21.15.177:0/1780106688 conn(0x7febf40d0ea0 msgr2=0x7febf406bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:41.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.096+0000 7febfb4bb640 1 -- 172.21.15.177:0/1780106688 shutdown_connections 2023-11-28T20:07:41.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.096+0000 7febfb4bb640 1 -- 172.21.15.177:0/1780106688 wait complete. 2023-11-28T20:07:41.136 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T20:07:41.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.272+0000 7f5309cfe640 1 Processor -- start 2023-11-28T20:07:41.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.276+0000 7f5309cfe640 1 -- start start 2023-11-28T20:07:41.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.276+0000 7f5309cfe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f530415adb0 0x7f530413d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:41.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.276+0000 7f5309cfe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f530413f5f0 0x7f53040ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:41.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.276+0000 7f5309cfe640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530413d2b0 con 0x7f5304071d90 2023-11-28T20:07:41.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.276+0000 7f5309cfe640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5304140520 con 0x7f530413f5f0 2023-11-28T20:07:41.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.276+0000 7f5309cfe640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53040cd7f0 con 0x7f530415adb0 2023-11-28T20:07:41.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.276+0000 7f5303fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f530413f5f0 0x7f53040ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:41.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.276+0000 7f5303fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f530413f5f0 0x7f53040ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52526/0 (socket says 172.21.15.177:52526) 2023-11-28T20:07:41.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.276+0000 7f5303fff640 1 -- 172.21.15.177:0/2494142238 learned_addr learned my addr 172.21.15.177:0/2494142238 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:41.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.276+0000 7f52fbfff640 1 --2- 172.21.15.177:0/2494142238 >> v2:172.21.15.195:3300/0 conn(0x7f530415adb0 0x7f530413d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:41.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.276+0000 7f5303fff640 1 -- 172.21.15.177:0/2494142238 >> v2:172.21.15.195:3300/0 conn(0x7f530415adb0 msgr2=0x7f530413d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:41.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.276+0000 7f5303fff640 1 --2- 172.21.15.177:0/2494142238 >> v2:172.21.15.195:3300/0 conn(0x7f530415adb0 0x7f530413d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:41.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.276+0000 7f5303fff640 1 -- 172.21.15.177:0/2494142238 >> v1:172.21.15.195:6789/0 conn(0x7f5304071d90 legacy=0x7f5304072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:41.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.276+0000 7f5303fff640 1 -- 172.21.15.177:0/2494142238 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53040cdd70 con 0x7f530413f5f0 2023-11-28T20:07:41.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.280+0000 7f5303fff640 1 --2- 172.21.15.177:0/2494142238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f530413f5f0 0x7f53040ce200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53040744d0 tx=0x7f52fc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d772b6d9fc2d93 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:41.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.280+0000 7f5302ffd640 1 -- 172.21.15.177:0/2494142238 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc0a5860 con 0x7f530413f5f0 2023-11-28T20:07:41.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.280+0000 7f5302ffd640 1 -- 172.21.15.177:0/2494142238 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc0a59c0 con 0x7f530413f5f0 2023-11-28T20:07:41.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.280+0000 7f5302ffd640 1 -- 172.21.15.177:0/2494142238 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc0a5d50 con 0x7f530413f5f0 2023-11-28T20:07:41.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.280+0000 7f5309cfe640 1 -- 172.21.15.177:0/2494142238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f530413f5f0 msgr2=0x7f53040ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:41.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.280+0000 7f5309cfe640 1 --2- 172.21.15.177:0/2494142238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f530413f5f0 0x7f53040ce200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53040744d0 tx=0x7f52fc01c9a0 comp rx=0 tx=0).stop 2023-11-28T20:07:41.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.280+0000 7f5309cfe640 1 -- 172.21.15.177:0/2494142238 shutdown_connections 2023-11-28T20:07:41.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.280+0000 7f5309cfe640 1 --2- 172.21.15.177:0/2494142238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f530413f5f0 0x7f53040ce200 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:41.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.280+0000 7f5309cfe640 1 --2- 172.21.15.177:0/2494142238 >> v2:172.21.15.195:3300/0 conn(0x7f530415adb0 0x7f530413d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:41.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.280+0000 7f5309cfe640 1 -- 172.21.15.177:0/2494142238 >> 172.21.15.177:0/2494142238 conn(0x7f53040b0cc0 msgr2=0x7f53040b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:41.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.280+0000 7f5309cfe640 1 -- 172.21.15.177:0/2494142238 shutdown_connections 2023-11-28T20:07:41.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.280+0000 7f5309cfe640 1 -- 172.21.15.177:0/2494142238 wait complete. 2023-11-28T20:07:41.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.280+0000 7f5309cfe640 1 Processor -- start 2023-11-28T20:07:41.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.280+0000 7f5309cfe640 1 -- start start 2023-11-28T20:07:41.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f5309cfe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5304071d90 0x7f53040a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:41.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f5309cfe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f530413f5f0 0x7f53041421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:41.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f5309cfe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f530415adb0 0x7f53041367b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:41.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f5309cfe640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53040a9700 con 0x7f5304071d90 2023-11-28T20:07:41.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f5309cfe640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53041426f0 con 0x7f530415adb0 2023-11-28T20:07:41.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f5309cfe640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5304136cf0 con 0x7f530413f5f0 2023-11-28T20:07:41.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f53037fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5304071d90 0x7f53040a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:41.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f53037fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5304071d90 0x7f53040a8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52538/0 (socket says 172.21.15.177:52538) 2023-11-28T20:07:41.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f53037fe640 1 -- 172.21.15.177:0/1788898133 learned_addr learned my addr 172.21.15.177:0/1788898133 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:41.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f5303fff640 1 --2- 172.21.15.177:0/1788898133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f530415adb0 0x7f53041367b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:41.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f52fbfff640 1 --2- 172.21.15.177:0/1788898133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f530413f5f0 0x7f53041421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:41.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f53037fe640 1 -- 172.21.15.177:0/1788898133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f530413f5f0 msgr2=0x7f53041421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:41.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f53037fe640 1 --2- 172.21.15.177:0/1788898133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f530413f5f0 0x7f53041421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:41.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f53037fe640 1 -- 172.21.15.177:0/1788898133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f530415adb0 msgr2=0x7f53041367b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:41.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f53037fe640 1 --2- 172.21.15.177:0/1788898133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f530415adb0 0x7f53041367b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:41.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f53037fe640 1 -- 172.21.15.177:0/1788898133 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc009b30 con 0x7f5304071d90 2023-11-28T20:07:41.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f53037fe640 1 --2- 172.21.15.177:0/1788898133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5304071d90 0x7f53040a8430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f52f400c500 tx=0x7f52f400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:41.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f5300ff9640 1 -- 172.21.15.177:0/1788898133 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f4005220 con 0x7f5304071d90 2023-11-28T20:07:41.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f5300ff9640 1 -- 172.21.15.177:0/1788898133 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f4005380 con 0x7f5304071d90 2023-11-28T20:07:41.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f5309cfe640 1 -- 172.21.15.177:0/1788898133 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53040a8a80 con 0x7f5304071d90 2023-11-28T20:07:41.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f5300ff9640 1 -- 172.21.15.177:0/1788898133 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f4007270 con 0x7f5304071d90 2023-11-28T20:07:41.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f5309cfe640 1 -- 172.21.15.177:0/1788898133 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53040a9040 con 0x7f5304071d90 2023-11-28T20:07:41.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.284+0000 7f5309cfe640 1 -- 172.21.15.177:0/1788898133 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53040693d0 con 0x7f5304071d90 2023-11-28T20:07:41.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.288+0000 7f5300ff9640 1 -- 172.21.15.177:0/1788898133 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52f40073d0 con 0x7f5304071d90 2023-11-28T20:07:41.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.288+0000 7f5300ff9640 1 --2- 172.21.15.177:0/1788898133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f52e4066470 0x7f52e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:41.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.288+0000 7f5300ff9640 1 -- 172.21.15.177:0/1788898133 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f52f4084470 con 0x7f5304071d90 2023-11-28T20:07:41.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.288+0000 7f52fbfff640 1 --2- 172.21.15.177:0/1788898133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f52e4066470 0x7f52e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:41.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.288+0000 7f52fbfff640 1 --2- 172.21.15.177:0/1788898133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f52e4066470 0x7f52e4068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f530415a150 tx=0x7f52ec009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:41.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.292+0000 7f5300ff9640 1 -- 172.21.15.177:0/1788898133 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52f40519f0 con 0x7f5304071d90 2023-11-28T20:07:41.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:41.472+0000 7f5309cfe640 1 -- 172.21.15.177:0/1788898133 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5304071960 con 0x7f5304071d90 2023-11-28T20:07:42.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.232+0000 7f5300ff9640 1 -- 172.21.15.177:0/1788898133 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f52f4055010 con 0x7f5304071d90 2023-11-28T20:07:42.236 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 2 and data pool 3 2023-11-28T20:07:42.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.236+0000 7f5309cfe640 1 -- 172.21.15.177:0/1788898133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f52e4066470 msgr2=0x7f52e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:42.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.236+0000 7f5309cfe640 1 --2- 172.21.15.177:0/1788898133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f52e4066470 0x7f52e4068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f530415a150 tx=0x7f52ec009190 comp rx=0 tx=0).stop 2023-11-28T20:07:42.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.236+0000 7f5309cfe640 1 -- 172.21.15.177:0/1788898133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5304071d90 msgr2=0x7f53040a8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:42.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.236+0000 7f5309cfe640 1 --2- 172.21.15.177:0/1788898133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5304071d90 0x7f53040a8430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f52f400c500 tx=0x7f52f400c9c0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.236+0000 7f5309cfe640 1 -- 172.21.15.177:0/1788898133 shutdown_connections 2023-11-28T20:07:42.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.236+0000 7f5309cfe640 1 --2- 172.21.15.177:0/1788898133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f52e4066470 0x7f52e4068930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.236+0000 7f5309cfe640 1 --2- 172.21.15.177:0/1788898133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f530415adb0 0x7f53041367b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.236+0000 7f5309cfe640 1 --2- 172.21.15.177:0/1788898133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f530413f5f0 0x7f53041421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.236+0000 7f5309cfe640 1 --2- 172.21.15.177:0/1788898133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5304071d90 0x7f53040a8430 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.236+0000 7f5309cfe640 1 -- 172.21.15.177:0/1788898133 >> 172.21.15.177:0/1788898133 conn(0x7f53040b0cc0 msgr2=0x7f53040b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:42.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.236+0000 7f5309cfe640 1 -- 172.21.15.177:0/1788898133 shutdown_connections 2023-11-28T20:07:42.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.236+0000 7f5309cfe640 1 -- 172.21.15.177:0/1788898133 wait complete. 2023-11-28T20:07:42.269 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:07:42.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.404+0000 7fa116bdf640 1 Processor -- start 2023-11-28T20:07:42.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.404+0000 7fa116bdf640 1 -- start start 2023-11-28T20:07:42.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.404+0000 7fa116bdf640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa110144840 0x7fa11006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:42.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.404+0000 7fa116bdf640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa110072180 0x7fa11006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:42.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.404+0000 7fa116bdf640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1100710e0 con 0x7fa110070460 2023-11-28T20:07:42.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.404+0000 7fa116bdf640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa11015f010 con 0x7fa110072180 2023-11-28T20:07:42.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.404+0000 7fa116bdf640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100713c0 con 0x7fa110144840 2023-11-28T20:07:42.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.408+0000 7fa107fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa110072180 0x7fa11006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:42.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.408+0000 7fa107fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa110072180 0x7fa11006c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52546/0 (socket says 172.21.15.177:52546) 2023-11-28T20:07:42.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.408+0000 7fa107fff640 1 -- 172.21.15.177:0/3633098630 learned_addr learned my addr 172.21.15.177:0/3633098630 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:42.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.408+0000 7fa11497b640 1 --2- 172.21.15.177:0/3633098630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa110144840 0x7fa11006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:42.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.408+0000 7fa107fff640 1 -- 172.21.15.177:0/3633098630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa110144840 msgr2=0x7fa11006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:42.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.408+0000 7fa107fff640 1 --2- 172.21.15.177:0/3633098630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa110144840 0x7fa11006c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.408+0000 7fa107fff640 1 -- 172.21.15.177:0/3633098630 >> v1:172.21.15.195:6789/0 conn(0x7fa110070460 legacy=0x7fa1100708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:42.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.408+0000 7fa107fff640 1 -- 172.21.15.177:0/3633098630 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1100716a0 con 0x7fa110072180 2023-11-28T20:07:42.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.408+0000 7fa1077fe640 1 -- 172.21.15.177:0/3633098630 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657301701 0 0) 0x7fa1100710e0 con 0x7fa110070460 2023-11-28T20:07:42.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.408+0000 7fa107fff640 1 --2- 172.21.15.177:0/3633098630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa110072180 0x7fa11006c800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa100009870 tx=0x7fa10001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9cfda759316e5e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:42.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa1077fe640 1 -- 172.21.15.177:0/3633098630 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1000aa670 con 0x7fa110072180 2023-11-28T20:07:42.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa1077fe640 1 -- 172.21.15.177:0/3633098630 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1000aa7d0 con 0x7fa110072180 2023-11-28T20:07:42.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa1077fe640 1 -- 172.21.15.177:0/3633098630 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1000aab60 con 0x7fa110072180 2023-11-28T20:07:42.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 -- 172.21.15.177:0/3633098630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa110072180 msgr2=0x7fa11006c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:42.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 --2- 172.21.15.177:0/3633098630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa110072180 0x7fa11006c800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa100009870 tx=0x7fa10001c510 comp rx=0 tx=0).stop 2023-11-28T20:07:42.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 -- 172.21.15.177:0/3633098630 shutdown_connections 2023-11-28T20:07:42.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 --2- 172.21.15.177:0/3633098630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa110072180 0x7fa11006c800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 --2- 172.21.15.177:0/3633098630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa110144840 0x7fa11006c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 -- 172.21.15.177:0/3633098630 >> 172.21.15.177:0/3633098630 conn(0x7fa11006a530 msgr2=0x7fa11006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:42.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 -- 172.21.15.177:0/3633098630 shutdown_connections 2023-11-28T20:07:42.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 -- 172.21.15.177:0/3633098630 wait complete. 2023-11-28T20:07:42.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 Processor -- start 2023-11-28T20:07:42.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 -- start start 2023-11-28T20:07:42.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa110070460 0x7fa11013a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:42.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa110072180 0x7fa1101599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:42.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa110144840 0x7fa11013d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:42.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11013add0 con 0x7fa110144840 2023-11-28T20:07:42.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa110139620 con 0x7fa110070460 2023-11-28T20:07:42.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa116bdf640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11013a400 con 0x7fa110072180 2023-11-28T20:07:42.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa11517c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa110144840 0x7fa11013d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:42.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa107fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa110072180 0x7fa1101599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:42.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa11497b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa110070460 0x7fa11013a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:42.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.412+0000 7fa11517c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa110144840 0x7fa11013d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52548/0 (socket says 172.21.15.177:52548) 2023-11-28T20:07:42.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa11517c640 1 -- 172.21.15.177:0/1761408932 learned_addr learned my addr 172.21.15.177:0/1761408932 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:42.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa11517c640 1 -- 172.21.15.177:0/1761408932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa110072180 msgr2=0x7fa1101599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:42.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa11517c640 1 --2- 172.21.15.177:0/1761408932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa110072180 0x7fa1101599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa11517c640 1 -- 172.21.15.177:0/1761408932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa110070460 msgr2=0x7fa11013a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:42.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa11517c640 1 --2- 172.21.15.177:0/1761408932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa110070460 0x7fa11013a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa11517c640 1 -- 172.21.15.177:0/1761408932 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1000094d0 con 0x7fa110144840 2023-11-28T20:07:42.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa11517c640 1 --2- 172.21.15.177:0/1761408932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa110144840 0x7fa11013d520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa108001570 tx=0x7fa10800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:42.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa1057fa640 1 -- 172.21.15.177:0/1761408932 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108003db0 con 0x7fa110144840 2023-11-28T20:07:42.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa1057fa640 1 -- 172.21.15.177:0/1761408932 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa108005070 con 0x7fa110144840 2023-11-28T20:07:42.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa1057fa640 1 -- 172.21.15.177:0/1761408932 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108005420 con 0x7fa110144840 2023-11-28T20:07:42.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa116bdf640 1 -- 172.21.15.177:0/1761408932 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa110159ef0 con 0x7fa110144840 2023-11-28T20:07:42.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa116bdf640 1 -- 172.21.15.177:0/1761408932 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11013da60 con 0x7fa110144840 2023-11-28T20:07:42.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa116bdf640 1 -- 172.21.15.177:0/1761408932 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11013a590 con 0x7fa110144840 2023-11-28T20:07:42.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa1057fa640 1 -- 172.21.15.177:0/1761408932 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa108005580 con 0x7fa110144840 2023-11-28T20:07:42.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa1057fa640 1 --2- 172.21.15.177:0/1761408932 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa0fc066470 0x7fa0fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:42.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.416+0000 7fa1057fa640 1 -- 172.21.15.177:0/1761408932 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa108083740 con 0x7fa110144840 2023-11-28T20:07:42.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.420+0000 7fa11497b640 1 --2- 172.21.15.177:0/1761408932 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa0fc066470 0x7fa0fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:42.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.420+0000 7fa11497b640 1 --2- 172.21.15.177:0/1761408932 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa0fc066470 0x7fa0fc068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009ac0 tx=0x7fa10c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:42.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.424+0000 7fa1057fa640 1 -- 172.21.15.177:0/1761408932 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa108050bd0 con 0x7fa110144840 2023-11-28T20:07:42.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.572+0000 7fa116bdf640 1 -- 172.21.15.177:0/1761408932 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa110069440 con 0x7fa110144840 2023-11-28T20:07:42.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.572+0000 7fa1057fa640 1 -- 172.21.15.177:0/1761408932 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16578 (secure 0 0 0) 0x7fa108017020 con 0x7fa110144840 2023-11-28T20:07:42.578 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:42.578 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":19,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:41.477554+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:07:42.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.576+0000 7fa116bdf640 1 -- 172.21.15.177:0/1761408932 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa0fc066470 msgr2=0x7fa0fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:42.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.576+0000 7fa116bdf640 1 --2- 172.21.15.177:0/1761408932 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa0fc066470 0x7fa0fc068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009ac0 tx=0x7fa10c009190 comp rx=0 tx=0).stop 2023-11-28T20:07:42.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.576+0000 7fa116bdf640 1 -- 172.21.15.177:0/1761408932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa110144840 msgr2=0x7fa11013d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:42.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.576+0000 7fa116bdf640 1 --2- 172.21.15.177:0/1761408932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa110144840 0x7fa11013d520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa108001570 tx=0x7fa10800cd20 comp rx=0 tx=0).stop 2023-11-28T20:07:42.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.576+0000 7fa116bdf640 1 -- 172.21.15.177:0/1761408932 shutdown_connections 2023-11-28T20:07:42.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.576+0000 7fa116bdf640 1 --2- 172.21.15.177:0/1761408932 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa0fc066470 0x7fa0fc068930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.576+0000 7fa116bdf640 1 --2- 172.21.15.177:0/1761408932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa110144840 0x7fa11013d520 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.576+0000 7fa116bdf640 1 --2- 172.21.15.177:0/1761408932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa110072180 0x7fa1101599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.576+0000 7fa116bdf640 1 --2- 172.21.15.177:0/1761408932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa110070460 0x7fa11013a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.576+0000 7fa116bdf640 1 -- 172.21.15.177:0/1761408932 >> 172.21.15.177:0/1761408932 conn(0x7fa11006a530 msgr2=0x7fa1100b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:42.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.576+0000 7fa116bdf640 1 -- 172.21.15.177:0/1761408932 shutdown_connections 2023-11-28T20:07:42.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.576+0000 7fa116bdf640 1 -- 172.21.15.177:0/1761408932 wait complete. 2023-11-28T20:07:42.599 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:07:42.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.732+0000 7f5b1a8aa640 1 Processor -- start 2023-11-28T20:07:42.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.732+0000 7f5b1a8aa640 1 -- start start 2023-11-28T20:07:42.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.732+0000 7f5b1a8aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b1406c9d0 0x7f5b1415a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:42.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.732+0000 7f5b1a8aa640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1415b3a0 con 0x7f5b1413cf30 2023-11-28T20:07:42.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.732+0000 7f5b1a8aa640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1413f720 con 0x7f5b1415ab70 2023-11-28T20:07:42.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.732+0000 7f5b1a8aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1413d310 con 0x7f5b1406c9d0 2023-11-28T20:07:42.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.736+0000 7f5b13fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5b1413cf30 0x7f5b1406c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:41834/0 (socket says 172.21.15.177:41834) 2023-11-28T20:07:42.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.736+0000 7f5b13fff640 1 -- 172.21.15.177:0/173660518 learned_addr learned my addr 172.21.15.177:0/173660518 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:42.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.736+0000 7f5b137fe640 1 --2- 172.21.15.177:0/173660518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b1406c9d0 0x7f5b1415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:42.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.736+0000 7f5b137fe640 1 -- 172.21.15.177:0/173660518 >> v1:172.21.15.195:6789/0 conn(0x7f5b1415ab70 legacy=0x7f5b140cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:42.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.736+0000 7f5b137fe640 1 -- 172.21.15.177:0/173660518 >> v1:172.21.15.177:6789/0 conn(0x7f5b1413cf30 legacy=0x7f5b1406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:42.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.736+0000 7f5b12ffd640 1 -- 172.21.15.177:0/173660518 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341122008 0 0) 0x7f5b1413f720 con 0x7f5b1415ab70 2023-11-28T20:07:42.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.736+0000 7f5b137fe640 1 -- 172.21.15.177:0/173660518 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1413fa00 con 0x7f5b1406c9d0 2023-11-28T20:07:42.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.736+0000 7f5b137fe640 1 --2- 172.21.15.177:0/173660518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b1406c9d0 0x7f5b1415a630 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5b080097f0 tx=0x7f5b0801c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ed5b61ce5f82eb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:42.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.736+0000 7f5b12ffd640 1 -- 172.21.15.177:0/173660518 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b080ab600 con 0x7f5b1406c9d0 2023-11-28T20:07:42.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.736+0000 7f5b12ffd640 1 -- 172.21.15.177:0/173660518 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b080a7050 con 0x7f5b1406c9d0 2023-11-28T20:07:42.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.736+0000 7f5b12ffd640 1 -- 172.21.15.177:0/173660518 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b080ab980 con 0x7f5b1406c9d0 2023-11-28T20:07:42.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b1a8aa640 1 -- 172.21.15.177:0/173660518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b1406c9d0 msgr2=0x7f5b1415a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:42.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b1a8aa640 1 --2- 172.21.15.177:0/173660518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b1406c9d0 0x7f5b1415a630 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5b080097f0 tx=0x7f5b0801c2c0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b1a8aa640 1 -- 172.21.15.177:0/173660518 shutdown_connections 2023-11-28T20:07:42.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b1a8aa640 1 --2- 172.21.15.177:0/173660518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b1406c9d0 0x7f5b1415a630 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b1a8aa640 1 -- 172.21.15.177:0/173660518 >> 172.21.15.177:0/173660518 conn(0x7f5b1406a530 msgr2=0x7f5b1406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:42.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b1a8aa640 1 -- 172.21.15.177:0/173660518 shutdown_connections 2023-11-28T20:07:42.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b1a8aa640 1 -- 172.21.15.177:0/173660518 wait complete. 2023-11-28T20:07:42.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b1a8aa640 1 Processor -- start 2023-11-28T20:07:42.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b1a8aa640 1 -- start start 2023-11-28T20:07:42.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b1a8aa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b1406c9d0 0x7f5b141366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:42.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b1a8aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b1413cf30 0x7f5b1414aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:42.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b1a8aa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1415ab70 0x7f5b1414a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:42.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b1a8aa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b14136c10 con 0x7f5b1415ab70 2023-11-28T20:07:42.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b1a8aa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b14148f90 con 0x7f5b1406c9d0 2023-11-28T20:07:42.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b1a8aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b14149270 con 0x7f5b1413cf30 2023-11-28T20:07:42.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b18e47640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1415ab70 0x7f5b1414a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:42.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b18e47640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1415ab70 0x7f5b1414a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52558/0 (socket says 172.21.15.177:52558) 2023-11-28T20:07:42.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b18e47640 1 -- 172.21.15.177:0/166369550 learned_addr learned my addr 172.21.15.177:0/166369550 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:42.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b13fff640 1 --2- 172.21.15.177:0/166369550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b1406c9d0 0x7f5b141366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:42.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b137fe640 1 --2- 172.21.15.177:0/166369550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b1413cf30 0x7f5b1414aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:42.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b18e47640 1 -- 172.21.15.177:0/166369550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b1413cf30 msgr2=0x7f5b1414aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:42.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b18e47640 1 --2- 172.21.15.177:0/166369550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b1413cf30 0x7f5b1414aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b18e47640 1 -- 172.21.15.177:0/166369550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b1406c9d0 msgr2=0x7f5b141366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:42.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b18e47640 1 --2- 172.21.15.177:0/166369550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b1406c9d0 0x7f5b141366d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.740+0000 7f5b18e47640 1 -- 172.21.15.177:0/166369550 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b08009420 con 0x7f5b1415ab70 2023-11-28T20:07:42.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.744+0000 7f5b18e47640 1 --2- 172.21.15.177:0/166369550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1415ab70 0x7f5b1414a030 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00c760 tx=0x7f5b0c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:42.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.744+0000 7f5b10ff9640 1 -- 172.21.15.177:0/166369550 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c003db0 con 0x7f5b1415ab70 2023-11-28T20:07:42.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.744+0000 7f5b10ff9640 1 -- 172.21.15.177:0/166369550 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c00ce70 con 0x7f5b1415ab70 2023-11-28T20:07:42.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.744+0000 7f5b10ff9640 1 -- 172.21.15.177:0/166369550 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c005290 con 0x7f5b1415ab70 2023-11-28T20:07:42.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.744+0000 7f5b1a8aa640 1 -- 172.21.15.177:0/166369550 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b14149550 con 0x7f5b1415ab70 2023-11-28T20:07:42.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.744+0000 7f5b1a8aa640 1 -- 172.21.15.177:0/166369550 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b14149b10 con 0x7f5b1415ab70 2023-11-28T20:07:42.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.744+0000 7f5b1a8aa640 1 -- 172.21.15.177:0/166369550 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b14149d00 con 0x7f5b1415ab70 2023-11-28T20:07:42.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.744+0000 7f5b10ff9640 1 -- 172.21.15.177:0/166369550 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5b0c0053f0 con 0x7f5b1415ab70 2023-11-28T20:07:42.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.744+0000 7f5b10ff9640 1 --2- 172.21.15.177:0/166369550 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5b00066470 0x7f5b00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:42.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.744+0000 7f5b10ff9640 1 -- 172.21.15.177:0/166369550 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b0c083c20 con 0x7f5b1415ab70 2023-11-28T20:07:42.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.744+0000 7f5b13fff640 1 --2- 172.21.15.177:0/166369550 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5b00066470 0x7f5b00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:42.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.748+0000 7f5b13fff640 1 --2- 172.21.15.177:0/166369550 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5b00066470 0x7f5b00068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5b04000f70 tx=0x7f5b04007e10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:42.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.748+0000 7f5b10ff9640 1 -- 172.21.15.177:0/166369550 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5b0c0510b0 con 0x7f5b1415ab70 2023-11-28T20:07:42.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.900+0000 7f5b1a8aa640 1 -- 172.21.15.177:0/166369550 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b14069440 con 0x7f5b1415ab70 2023-11-28T20:07:42.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.900+0000 7f5b10ff9640 1 -- 172.21.15.177:0/166369550 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16578 (secure 0 0 0) 0x7f5b0c0546d0 con 0x7f5b1415ab70 2023-11-28T20:07:42.905 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:42.905 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":19,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:41.477554+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:07:42.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.904+0000 7f5b1a8aa640 1 -- 172.21.15.177:0/166369550 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5b00066470 msgr2=0x7f5b00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:42.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.904+0000 7f5b1a8aa640 1 --2- 172.21.15.177:0/166369550 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5b00066470 0x7f5b00068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5b04000f70 tx=0x7f5b04007e10 comp rx=0 tx=0).stop 2023-11-28T20:07:42.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.904+0000 7f5b1a8aa640 1 -- 172.21.15.177:0/166369550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1415ab70 msgr2=0x7f5b1414a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:42.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.904+0000 7f5b1a8aa640 1 --2- 172.21.15.177:0/166369550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1415ab70 0x7f5b1414a030 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00c760 tx=0x7f5b0c00cc20 comp rx=0 tx=0).stop 2023-11-28T20:07:42.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.904+0000 7f5b1a8aa640 1 -- 172.21.15.177:0/166369550 shutdown_connections 2023-11-28T20:07:42.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.904+0000 7f5b1a8aa640 1 --2- 172.21.15.177:0/166369550 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5b00066470 0x7f5b00068930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.904+0000 7f5b1a8aa640 1 --2- 172.21.15.177:0/166369550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1415ab70 0x7f5b1414a030 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.904+0000 7f5b1a8aa640 1 --2- 172.21.15.177:0/166369550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b1413cf30 0x7f5b1414aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.904+0000 7f5b1a8aa640 1 --2- 172.21.15.177:0/166369550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b1406c9d0 0x7f5b141366d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:42.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.904+0000 7f5b1a8aa640 1 -- 172.21.15.177:0/166369550 >> 172.21.15.177:0/166369550 conn(0x7f5b1406a530 msgr2=0x7f5b140cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:42.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.904+0000 7f5b1a8aa640 1 -- 172.21.15.177:0/166369550 shutdown_connections 2023-11-28T20:07:42.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:42.904+0000 7f5b1a8aa640 1 -- 172.21.15.177:0/166369550 wait complete. 2023-11-28T20:07:42.926 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T20:07:43.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.064+0000 7f86e992a640 1 Processor -- start 2023-11-28T20:07:43.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.064+0000 7f86e992a640 1 -- start start 2023-11-28T20:07:43.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.064+0000 7f86e992a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f86e4158ca0 0x7f86e415eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:43.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.064+0000 7f86e992a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f86e40b42d0 0x7f86e40b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:43.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.064+0000 7f86e992a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e40b4c60 con 0x7f86e40cba10 2023-11-28T20:07:43.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.064+0000 7f86e992a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e415b670 con 0x7f86e4158ca0 2023-11-28T20:07:43.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.064+0000 7f86e992a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e415c510 con 0x7f86e40b42d0 2023-11-28T20:07:43.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.064+0000 7f86e2ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f86e4158ca0 0x7f86e415eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:43.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.064+0000 7f86e2ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f86e4158ca0 0x7f86e415eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52574/0 (socket says 172.21.15.177:52574) 2023-11-28T20:07:43.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.064+0000 7f86e2ffd640 1 -- 172.21.15.177:0/1843977828 learned_addr learned my addr 172.21.15.177:0/1843977828 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:43.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.064+0000 7f86e37fe640 1 --2- 172.21.15.177:0/1843977828 >> v2:172.21.15.195:3300/0 conn(0x7f86e40b42d0 0x7f86e40b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:43.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.064+0000 7f86e2ffd640 1 -- 172.21.15.177:0/1843977828 >> v2:172.21.15.195:3300/0 conn(0x7f86e40b42d0 msgr2=0x7f86e40b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:43.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.064+0000 7f86e2ffd640 1 --2- 172.21.15.177:0/1843977828 >> v2:172.21.15.195:3300/0 conn(0x7f86e40b42d0 0x7f86e40b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:43.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.064+0000 7f86e2ffd640 1 -- 172.21.15.177:0/1843977828 >> v1:172.21.15.177:6789/0 conn(0x7f86e40cba10 legacy=0x7f86e415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:43.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.064+0000 7f86e2ffd640 1 -- 172.21.15.177:0/1843977828 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e415f410 con 0x7f86e4158ca0 2023-11-28T20:07:43.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.068+0000 7f86e2ffd640 1 --2- 172.21.15.177:0/1843977828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e4158ca0 0x7f86e415eb50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f86e40cb970 tx=0x7f86d401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c10ab5bc4a4ebb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:43.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.068+0000 7f86e1ffb640 1 -- 172.21.15.177:0/1843977828 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d40aa430 con 0x7f86e4158ca0 2023-11-28T20:07:43.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.068+0000 7f86e1ffb640 1 -- 172.21.15.177:0/1843977828 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d40aa590 con 0x7f86e4158ca0 2023-11-28T20:07:43.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.068+0000 7f86e1ffb640 1 -- 172.21.15.177:0/1843977828 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d40aa920 con 0x7f86e4158ca0 2023-11-28T20:07:43.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.068+0000 7f86e992a640 1 -- 172.21.15.177:0/1843977828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e4158ca0 msgr2=0x7f86e415eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:43.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.068+0000 7f86e992a640 1 --2- 172.21.15.177:0/1843977828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e4158ca0 0x7f86e415eb50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f86e40cb970 tx=0x7f86d401c4d0 comp rx=0 tx=0).stop 2023-11-28T20:07:43.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.068+0000 7f86e992a640 1 -- 172.21.15.177:0/1843977828 shutdown_connections 2023-11-28T20:07:43.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.068+0000 7f86e992a640 1 --2- 172.21.15.177:0/1843977828 >> v2:172.21.15.195:3300/0 conn(0x7f86e40b42d0 0x7f86e40b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:43.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.068+0000 7f86e992a640 1 --2- 172.21.15.177:0/1843977828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e4158ca0 0x7f86e415eb50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:43.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.068+0000 7f86e992a640 1 -- 172.21.15.177:0/1843977828 >> 172.21.15.177:0/1843977828 conn(0x7f86e40b0cc0 msgr2=0x7f86e40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:43.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.068+0000 7f86e992a640 1 -- 172.21.15.177:0/1843977828 shutdown_connections 2023-11-28T20:07:43.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.068+0000 7f86e992a640 1 -- 172.21.15.177:0/1843977828 wait complete. 2023-11-28T20:07:43.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.068+0000 7f86e992a640 1 Processor -- start 2023-11-28T20:07:43.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e992a640 1 -- start start 2023-11-28T20:07:43.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e992a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e40b42d0 0x7f86e41448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:43.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e992a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86e40cba10 0x7f86e414ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:43.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e992a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e4158ca0 0x7f86e414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:43.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e992a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e415ca50 con 0x7f86e40b42d0 2023-11-28T20:07:43.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e992a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e415ec90 con 0x7f86e4158ca0 2023-11-28T20:07:43.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e992a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4144df0 con 0x7f86e40cba10 2023-11-28T20:07:43.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e40b42d0 0x7f86e41448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:43.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e40b42d0 0x7f86e41448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52576/0 (socket says 172.21.15.177:52576) 2023-11-28T20:07:43.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e2ffd640 1 -- 172.21.15.177:0/1148429199 learned_addr learned my addr 172.21.15.177:0/1148429199 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:43.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e2ffd640 1 -- 172.21.15.177:0/1148429199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86e40cba10 msgr2=0x7f86e414ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:43.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e27fc640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86e40cba10 0x7f86e414ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:43.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e37fe640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e4158ca0 0x7f86e414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:43.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e2ffd640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86e40cba10 0x7f86e414ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:43.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e2ffd640 1 -- 172.21.15.177:0/1148429199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e4158ca0 msgr2=0x7f86e414d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:43.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e2ffd640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e4158ca0 0x7f86e414d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:43.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e2ffd640 1 -- 172.21.15.177:0/1148429199 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d40094d0 con 0x7f86e40b42d0 2023-11-28T20:07:43.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e27fc640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86e40cba10 0x7f86e414ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:43.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e37fe640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e4158ca0 0x7f86e414d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:43.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e2ffd640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e40b42d0 0x7f86e41448b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f86d40190e0 tx=0x7f86d401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:43.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86cbfff640 1 -- 172.21.15.177:0/1148429199 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d40aa430 con 0x7f86e40b42d0 2023-11-28T20:07:43.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86cbfff640 1 -- 172.21.15.177:0/1148429199 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d40b3820 con 0x7f86e40b42d0 2023-11-28T20:07:43.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e992a640 1 -- 172.21.15.177:0/1148429199 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e4157880 con 0x7f86e40b42d0 2023-11-28T20:07:43.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86cbfff640 1 -- 172.21.15.177:0/1148429199 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d40b3bd0 con 0x7f86e40b42d0 2023-11-28T20:07:43.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e992a640 1 -- 172.21.15.177:0/1148429199 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e4157e40 con 0x7f86e40b42d0 2023-11-28T20:07:43.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.072+0000 7f86e992a640 1 -- 172.21.15.177:0/1148429199 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e40693d0 con 0x7f86e40b42d0 2023-11-28T20:07:43.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.076+0000 7f86cbfff640 1 -- 172.21.15.177:0/1148429199 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f86d40b3d30 con 0x7f86e40b42d0 2023-11-28T20:07:43.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.076+0000 7f86cbfff640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f86d0066470 0x7f86d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:43.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.076+0000 7f86cbfff640 1 -- 172.21.15.177:0/1148429199 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86d411e2f0 con 0x7f86e40b42d0 2023-11-28T20:07:43.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.076+0000 7f86e27fc640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f86d0066470 0x7f86d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:43.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.076+0000 7f86e27fc640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f86d0066470 0x7f86d0068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f86e414dda0 tx=0x7f86d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:43.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.080+0000 7f86cbfff640 1 -- 172.21.15.177:0/1148429199 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86d40eb800 con 0x7f86e40b42d0 2023-11-28T20:07:43.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:43.268+0000 7f86e992a640 1 -- 172.21.15.177:0/1148429199 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f86e40726b0 con 0x7f86e40b42d0 2023-11-28T20:07:44.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.248+0000 7f86cbfff640 1 -- 172.21.15.177:0/1148429199 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f86d40eee20 con 0x7f86e40b42d0 2023-11-28T20:07:44.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.248+0000 7f86e992a640 1 -- 172.21.15.177:0/1148429199 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f86d0066470 msgr2=0x7f86d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:44.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.248+0000 7f86e992a640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f86d0066470 0x7f86d0068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f86e414dda0 tx=0x7f86d8009040 comp rx=0 tx=0).stop 2023-11-28T20:07:44.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.248+0000 7f86e992a640 1 -- 172.21.15.177:0/1148429199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e40b42d0 msgr2=0x7f86e41448b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:44.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.248+0000 7f86e992a640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e40b42d0 0x7f86e41448b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f86d40190e0 tx=0x7f86d401ad10 comp rx=0 tx=0).stop 2023-11-28T20:07:44.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.252+0000 7f86e992a640 1 -- 172.21.15.177:0/1148429199 shutdown_connections 2023-11-28T20:07:44.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.252+0000 7f86e992a640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f86d0066470 0x7f86d0068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:44.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.252+0000 7f86e992a640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e4158ca0 0x7f86e414d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:44.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.252+0000 7f86e992a640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86e40cba10 0x7f86e414ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:44.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.252+0000 7f86e992a640 1 --2- 172.21.15.177:0/1148429199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e40b42d0 0x7f86e41448b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:44.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.252+0000 7f86e992a640 1 -- 172.21.15.177:0/1148429199 >> 172.21.15.177:0/1148429199 conn(0x7f86e40b0cc0 msgr2=0x7f86e4159110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:44.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.252+0000 7f86e992a640 1 -- 172.21.15.177:0/1148429199 shutdown_connections 2023-11-28T20:07:44.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.252+0000 7f86e992a640 1 -- 172.21.15.177:0/1148429199 wait complete. 2023-11-28T20:07:44.274 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T20:07:44.274 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T20:07:44.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.412+0000 7f10d8996640 1 Processor -- start 2023-11-28T20:07:44.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.412+0000 7f10d8996640 1 -- start start 2023-11-28T20:07:44.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.412+0000 7f10d8996640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f10d415adb0 0x7f10d413d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:44.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.412+0000 7f10d8996640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d413f5f0 0x7f10d40ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:44.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.412+0000 7f10d8996640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d413d2b0 con 0x7f10d4071d90 2023-11-28T20:07:44.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.412+0000 7f10d8996640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d4140520 con 0x7f10d415adb0 2023-11-28T20:07:44.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.412+0000 7f10d8996640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d40cd7f0 con 0x7f10d413f5f0 2023-11-28T20:07:44.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.412+0000 7f10d259c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f10d4071d90 0x7f10d4072170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:41846/0 (socket says 172.21.15.177:41846) 2023-11-28T20:07:44.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.412+0000 7f10d259c640 1 -- 172.21.15.177:0/454283075 learned_addr learned my addr 172.21.15.177:0/454283075 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:44.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.412+0000 7f10c9d9b640 1 --2- 172.21.15.177:0/454283075 >> v2:172.21.15.177:3300/0 conn(0x7f10d415adb0 0x7f10d413d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:44.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.416+0000 7f10d2d9d640 1 --2- 172.21.15.177:0/454283075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d413f5f0 0x7f10d40ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:44.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.416+0000 7f10c9d9b640 1 -- 172.21.15.177:0/454283075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d413f5f0 msgr2=0x7f10d40ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:44.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.416+0000 7f10c9d9b640 1 --2- 172.21.15.177:0/454283075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d413f5f0 0x7f10d40ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:44.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.416+0000 7f10c9d9b640 1 -- 172.21.15.177:0/454283075 >> v1:172.21.15.177:6789/0 conn(0x7f10d4071d90 legacy=0x7f10d4072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:44.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.416+0000 7f10c9d9b640 1 -- 172.21.15.177:0/454283075 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d40cdd70 con 0x7f10d415adb0 2023-11-28T20:07:44.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.416+0000 7f10d2d9d640 1 --2- 172.21.15.177:0/454283075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d413f5f0 0x7f10d40ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:44.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.416+0000 7f10c9d9b640 1 --2- 172.21.15.177:0/454283075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d415adb0 0x7f10d413d560 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0097c0 tx=0x7f10bc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb5f5ae1f53bb35 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:44.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.416+0000 7f10d1d9b640 1 -- 172.21.15.177:0/454283075 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc0ab650 con 0x7f10d415adb0 2023-11-28T20:07:44.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.416+0000 7f10d1d9b640 1 -- 172.21.15.177:0/454283075 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc0ab7b0 con 0x7f10d415adb0 2023-11-28T20:07:44.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.416+0000 7f10d1d9b640 1 -- 172.21.15.177:0/454283075 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc0abb40 con 0x7f10d415adb0 2023-11-28T20:07:44.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.416+0000 7f10d8996640 1 -- 172.21.15.177:0/454283075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d415adb0 msgr2=0x7f10d413d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:44.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.416+0000 7f10d8996640 1 --2- 172.21.15.177:0/454283075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d415adb0 0x7f10d413d560 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0097c0 tx=0x7f10bc01c450 comp rx=0 tx=0).stop 2023-11-28T20:07:44.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d8996640 1 -- 172.21.15.177:0/454283075 shutdown_connections 2023-11-28T20:07:44.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d8996640 1 --2- 172.21.15.177:0/454283075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d415adb0 0x7f10d413d560 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:44.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d8996640 1 --2- 172.21.15.177:0/454283075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d413f5f0 0x7f10d40ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:44.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d8996640 1 -- 172.21.15.177:0/454283075 >> 172.21.15.177:0/454283075 conn(0x7f10d40b0cc0 msgr2=0x7f10d40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:44.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d8996640 1 -- 172.21.15.177:0/454283075 shutdown_connections 2023-11-28T20:07:44.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d8996640 1 -- 172.21.15.177:0/454283075 wait complete. 2023-11-28T20:07:44.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d8996640 1 Processor -- start 2023-11-28T20:07:44.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d8996640 1 -- start start 2023-11-28T20:07:44.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d8996640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4071d90 0x7f10d413ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:44.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d8996640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d413f5f0 0x7f10d4166f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:44.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d8996640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d415adb0 0x7f10d413c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:44.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d8996640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d40b3b00 con 0x7f10d4071d90 2023-11-28T20:07:44.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d8996640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d4141700 con 0x7f10d413f5f0 2023-11-28T20:07:44.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d8996640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d40b3d50 con 0x7f10d415adb0 2023-11-28T20:07:44.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4071d90 0x7f10d413ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:44.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4071d90 0x7f10d413ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52586/0 (socket says 172.21.15.177:52586) 2023-11-28T20:07:44.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d259c640 1 -- 172.21.15.177:0/1973635432 learned_addr learned my addr 172.21.15.177:0/1973635432 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:44.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10c9d9b640 1 --2- 172.21.15.177:0/1973635432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d413f5f0 0x7f10d4166f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:44.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.420+0000 7f10d2d9d640 1 --2- 172.21.15.177:0/1973635432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d415adb0 0x7f10d413c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:44.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10d259c640 1 -- 172.21.15.177:0/1973635432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d415adb0 msgr2=0x7f10d413c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:44.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10d259c640 1 --2- 172.21.15.177:0/1973635432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d415adb0 0x7f10d413c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:44.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10d259c640 1 -- 172.21.15.177:0/1973635432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d413f5f0 msgr2=0x7f10d4166f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:44.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10d259c640 1 --2- 172.21.15.177:0/1973635432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d413f5f0 0x7f10d4166f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:44.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10d259c640 1 -- 172.21.15.177:0/1973635432 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc009420 con 0x7f10d4071d90 2023-11-28T20:07:44.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10d2d9d640 1 --2- 172.21.15.177:0/1973635432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d415adb0 0x7f10d413c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:44.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10d259c640 1 --2- 172.21.15.177:0/1973635432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4071d90 0x7f10d413ab50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c530 tx=0x7f10c400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:44.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10cb7fe640 1 -- 172.21.15.177:0/1973635432 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4005cf0 con 0x7f10d4071d90 2023-11-28T20:07:44.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10cb7fe640 1 -- 172.21.15.177:0/1973635432 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4005e50 con 0x7f10d4071d90 2023-11-28T20:07:44.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10cb7fe640 1 -- 172.21.15.177:0/1973635432 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4007270 con 0x7f10d4071d90 2023-11-28T20:07:44.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10d8996640 1 -- 172.21.15.177:0/1973635432 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d40b4030 con 0x7f10d4071d90 2023-11-28T20:07:44.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10d8996640 1 -- 172.21.15.177:0/1973635432 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d40b45f0 con 0x7f10d4071d90 2023-11-28T20:07:44.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10d8996640 1 -- 172.21.15.177:0/1973635432 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d40693d0 con 0x7f10d4071d90 2023-11-28T20:07:44.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10cb7fe640 1 -- 172.21.15.177:0/1973635432 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f10c40073d0 con 0x7f10d4071d90 2023-11-28T20:07:44.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10cb7fe640 1 --2- 172.21.15.177:0/1973635432 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10b40664a0 0x7f10b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:44.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10cb7fe640 1 -- 172.21.15.177:0/1973635432 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10c4083320 con 0x7f10d4071d90 2023-11-28T20:07:44.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.424+0000 7f10c9d9b640 1 --2- 172.21.15.177:0/1973635432 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10b40664a0 0x7f10b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:44.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.428+0000 7f10c9d9b640 1 --2- 172.21.15.177:0/1973635432 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10b40664a0 0x7f10b4068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0af000 tx=0x7f10bc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:44.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.428+0000 7f10cb7fe640 1 -- 172.21.15.177:0/1973635432 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10c40507b0 con 0x7f10d4071d90 2023-11-28T20:07:44.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:44.612+0000 7f10d8996640 1 -- 172.21.15.177:0/1973635432 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f10d406e710 con 0x7f10d4071d90 2023-11-28T20:07:45.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.248+0000 7f10cb7fe640 1 -- 172.21.15.177:0/1973635432 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f10c4053dd0 con 0x7f10d4071d90 2023-11-28T20:07:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.252+0000 7f10d8996640 1 -- 172.21.15.177:0/1973635432 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10b40664a0 msgr2=0x7f10b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.252+0000 7f10d8996640 1 --2- 172.21.15.177:0/1973635432 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10b40664a0 0x7f10b4068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0af000 tx=0x7f10bc0a7000 comp rx=0 tx=0).stop 2023-11-28T20:07:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.252+0000 7f10d8996640 1 -- 172.21.15.177:0/1973635432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4071d90 msgr2=0x7f10d413ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.252+0000 7f10d8996640 1 --2- 172.21.15.177:0/1973635432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4071d90 0x7f10d413ab50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c530 tx=0x7f10c400c9f0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.252+0000 7f10d8996640 1 -- 172.21.15.177:0/1973635432 shutdown_connections 2023-11-28T20:07:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.252+0000 7f10d8996640 1 --2- 172.21.15.177:0/1973635432 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10b40664a0 0x7f10b4068960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.252+0000 7f10d8996640 1 --2- 172.21.15.177:0/1973635432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d415adb0 0x7f10d413c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.252+0000 7f10d8996640 1 --2- 172.21.15.177:0/1973635432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d413f5f0 0x7f10d4166f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.252+0000 7f10d8996640 1 --2- 172.21.15.177:0/1973635432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4071d90 0x7f10d413ab50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.252+0000 7f10d8996640 1 -- 172.21.15.177:0/1973635432 >> 172.21.15.177:0/1973635432 conn(0x7f10d40b0cc0 msgr2=0x7f10d413e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.252+0000 7f10d8996640 1 -- 172.21.15.177:0/1973635432 shutdown_connections 2023-11-28T20:07:45.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.252+0000 7f10d8996640 1 -- 172.21.15.177:0/1973635432 wait complete. 2023-11-28T20:07:45.278 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T20:07:45.278 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:07:45.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.416+0000 7fccc56ea640 1 Processor -- start 2023-11-28T20:07:45.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.416+0000 7fccc56ea640 1 -- start start 2023-11-28T20:07:45.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.416+0000 7fccc56ea640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fccc013cf30 0x7fccc006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:45.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.416+0000 7fccc56ea640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc015b170 con 0x7fccc006c800 2023-11-28T20:07:45.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.416+0000 7fccc56ea640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc015b3a0 con 0x7fccc015ad40 2023-11-28T20:07:45.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.416+0000 7fccc56ea640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc013d310 con 0x7fccc013cf30 2023-11-28T20:07:45.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.416+0000 7fccbeffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fccc013cf30 0x7fccc006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:45.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.416+0000 7fccbeffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fccc013cf30 0x7fccc006c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52592/0 (socket says 172.21.15.177:52592) 2023-11-28T20:07:45.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.416+0000 7fccbeffd640 1 -- 172.21.15.177:0/1375483256 learned_addr learned my addr 172.21.15.177:0/1375483256 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:45.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.416+0000 7fccbeffd640 1 -- 172.21.15.177:0/1375483256 >> v1:172.21.15.195:6789/0 conn(0x7fccc015ad40 legacy=0x7fccc00cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:45.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.416+0000 7fccbeffd640 1 -- 172.21.15.177:0/1375483256 >> v1:172.21.15.177:6789/0 conn(0x7fccc006c800 legacy=0x7fccc015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:45.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.416+0000 7fccbeffd640 1 -- 172.21.15.177:0/1375483256 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc013f720 con 0x7fccc013cf30 2023-11-28T20:07:45.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.420+0000 7fccbeffd640 1 --2- 172.21.15.177:0/1375483256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccc013cf30 0x7fccc006c2c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009870 tx=0x7fccb001e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fefe326149464c61 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:45.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.420+0000 7fccbdffb640 1 -- 172.21.15.177:0/1375483256 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb00ac5f0 con 0x7fccc013cf30 2023-11-28T20:07:45.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.420+0000 7fccbdffb640 1 -- 172.21.15.177:0/1375483256 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb00ac750 con 0x7fccc013cf30 2023-11-28T20:07:45.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.420+0000 7fccbdffb640 1 -- 172.21.15.177:0/1375483256 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb00acae0 con 0x7fccc013cf30 2023-11-28T20:07:45.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.420+0000 7fccc56ea640 1 -- 172.21.15.177:0/1375483256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccc013cf30 msgr2=0x7fccc006c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:45.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.420+0000 7fccc56ea640 1 --2- 172.21.15.177:0/1375483256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccc013cf30 0x7fccc006c2c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009870 tx=0x7fccb001e680 comp rx=0 tx=0).stop 2023-11-28T20:07:45.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.420+0000 7fccc56ea640 1 -- 172.21.15.177:0/1375483256 shutdown_connections 2023-11-28T20:07:45.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.420+0000 7fccc56ea640 1 --2- 172.21.15.177:0/1375483256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccc013cf30 0x7fccc006c2c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.420+0000 7fccc56ea640 1 -- 172.21.15.177:0/1375483256 >> 172.21.15.177:0/1375483256 conn(0x7fccc006a530 msgr2=0x7fccc006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:45.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.420+0000 7fccc56ea640 1 -- 172.21.15.177:0/1375483256 shutdown_connections 2023-11-28T20:07:45.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.420+0000 7fccc56ea640 1 -- 172.21.15.177:0/1375483256 wait complete. 2023-11-28T20:07:45.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccc56ea640 1 Processor -- start 2023-11-28T20:07:45.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccc56ea640 1 -- start start 2023-11-28T20:07:45.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccc56ea640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccc006c800 0x7fccc014de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:45.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccc56ea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccc013cf30 0x7fccc0070990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:45.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccc56ea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccc015ad40 0x7fccc0070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:45.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccc56ea640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc014ff60 con 0x7fccc013cf30 2023-11-28T20:07:45.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccc56ea640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc0154b30 con 0x7fccc006c800 2023-11-28T20:07:45.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccc56ea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc0154e10 con 0x7fccc015ad40 2023-11-28T20:07:45.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccbe7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccc013cf30 0x7fccc0070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:45.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccbe7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccc013cf30 0x7fccc0070990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52600/0 (socket says 172.21.15.177:52600) 2023-11-28T20:07:45.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccbe7fc640 1 -- 172.21.15.177:0/623031044 learned_addr learned my addr 172.21.15.177:0/623031044 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:45.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccbeffd640 1 --2- 172.21.15.177:0/623031044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccc006c800 0x7fccc014de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:45.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccbf7fe640 1 --2- 172.21.15.177:0/623031044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccc015ad40 0x7fccc0070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:45.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccbe7fc640 1 -- 172.21.15.177:0/623031044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccc015ad40 msgr2=0x7fccc0070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:45.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccbe7fc640 1 --2- 172.21.15.177:0/623031044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccc015ad40 0x7fccc0070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccbe7fc640 1 -- 172.21.15.177:0/623031044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccc006c800 msgr2=0x7fccc014de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:45.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccbe7fc640 1 --2- 172.21.15.177:0/623031044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccc006c800 0x7fccc014de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccbe7fc640 1 -- 172.21.15.177:0/623031044 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb00094d0 con 0x7fccc013cf30 2023-11-28T20:07:45.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccbf7fe640 1 --2- 172.21.15.177:0/623031044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccc015ad40 0x7fccc0070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:45.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccbe7fc640 1 --2- 172.21.15.177:0/623031044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccc013cf30 0x7fccc0070990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fccb400c500 tx=0x7fccb400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:45.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fcca77fe640 1 -- 172.21.15.177:0/623031044 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb4005220 con 0x7fccc013cf30 2023-11-28T20:07:45.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fcca77fe640 1 -- 172.21.15.177:0/623031044 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb4005380 con 0x7fccc013cf30 2023-11-28T20:07:45.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccc56ea640 1 -- 172.21.15.177:0/623031044 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc01550f0 con 0x7fccc013cf30 2023-11-28T20:07:45.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fcca77fe640 1 -- 172.21.15.177:0/623031044 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb4007270 con 0x7fccc013cf30 2023-11-28T20:07:45.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccc56ea640 1 -- 172.21.15.177:0/623031044 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc01558f0 con 0x7fccc013cf30 2023-11-28T20:07:45.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.424+0000 7fccc56ea640 1 -- 172.21.15.177:0/623031044 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc0070440 con 0x7fccc013cf30 2023-11-28T20:07:45.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.428+0000 7fcca77fe640 1 -- 172.21.15.177:0/623031044 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fccb40073d0 con 0x7fccc013cf30 2023-11-28T20:07:45.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.428+0000 7fcca77fe640 1 --2- 172.21.15.177:0/623031044 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fccac066470 0x7fccac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:45.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.428+0000 7fcca77fe640 1 -- 172.21.15.177:0/623031044 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fccb4083780 con 0x7fccc013cf30 2023-11-28T20:07:45.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.428+0000 7fccbeffd640 1 --2- 172.21.15.177:0/623031044 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fccac066470 0x7fccac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:45.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.428+0000 7fccbeffd640 1 --2- 172.21.15.177:0/623031044 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fccac066470 0x7fccac068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fccb00b0000 tx=0x7fccb00a9000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:45.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.432+0000 7fcca77fe640 1 -- 172.21.15.177:0/623031044 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fccc0070440 con 0x7fccc013cf30 2023-11-28T20:07:45.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.612+0000 7fccc56ea640 1 -- 172.21.15.177:0/623031044 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fccc0070440 con 0x7fccc013cf30 2023-11-28T20:07:45.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.612+0000 7fcca77fe640 1 -- 172.21.15.177:0/623031044 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fccc0070440 con 0x7fccc013cf30 2023-11-28T20:07:45.619 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:45.619 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2688190991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2688190991},{"type":"v1","addr":"172.21.15.177:6835","nonce":2688190991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/17424302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":17424302},{"type":"v1","addr":"172.21.15.177:6837","nonce":17424302}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3833908165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3833908165},{"type":"v1","addr":"172.21.15.195:6834","nonce":3833908165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:07:41.477909+0000","modified":"2023-11-28T20:07:44.615409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6835/1726998944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1726998944},{"type":"v1","addr":"172.21.15.195:6835","nonce":1726998944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T20:07:45.620 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-28T20:07:45.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.616+0000 7fccc56ea640 1 -- 172.21.15.177:0/623031044 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fccac066470 msgr2=0x7fccac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:45.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.616+0000 7fccc56ea640 1 --2- 172.21.15.177:0/623031044 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fccac066470 0x7fccac068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fccb00b0000 tx=0x7fccb00a9000 comp rx=0 tx=0).stop 2023-11-28T20:07:45.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.616+0000 7fccc56ea640 1 -- 172.21.15.177:0/623031044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccc013cf30 msgr2=0x7fccc0070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:45.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.616+0000 7fccc56ea640 1 --2- 172.21.15.177:0/623031044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccc013cf30 0x7fccc0070990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fccb400c500 tx=0x7fccb400c9c0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.616+0000 7fccc56ea640 1 -- 172.21.15.177:0/623031044 shutdown_connections 2023-11-28T20:07:45.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.616+0000 7fccc56ea640 1 --2- 172.21.15.177:0/623031044 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fccac066470 0x7fccac068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.616+0000 7fccc56ea640 1 --2- 172.21.15.177:0/623031044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccc015ad40 0x7fccc0070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.616+0000 7fccc56ea640 1 --2- 172.21.15.177:0/623031044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccc013cf30 0x7fccc0070990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.616+0000 7fccc56ea640 1 --2- 172.21.15.177:0/623031044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccc006c800 0x7fccc014de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.616+0000 7fccc56ea640 1 -- 172.21.15.177:0/623031044 >> 172.21.15.177:0/623031044 conn(0x7fccc006a530 msgr2=0x7fccc013d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:45.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.616+0000 7fccc56ea640 1 -- 172.21.15.177:0/623031044 shutdown_connections 2023-11-28T20:07:45.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.616+0000 7fccc56ea640 1 -- 172.21.15.177:0/623031044 wait complete. 2023-11-28T20:07:45.638 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:07:45.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f36a030f640 1 Processor -- start 2023-11-28T20:07:45.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f36a030f640 1 -- start start 2023-11-28T20:07:45.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f36a030f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f369813cf30 0x7f369806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:45.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f36a030f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369815b170 con 0x7f369806c800 2023-11-28T20:07:45.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f36a030f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369815b3a0 con 0x7f369815ad40 2023-11-28T20:07:45.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f36a030f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f369813d310 con 0x7f369813cf30 2023-11-28T20:07:45.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d8aa640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f369806c800 0x7f369815a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:41866/0 (socket says 172.21.15.177:41866) 2023-11-28T20:07:45.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d8aa640 1 -- 172.21.15.177:0/1053100514 learned_addr learned my addr 172.21.15.177:0/1053100514 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:45.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369e0ab640 1 --2- 172.21.15.177:0/1053100514 >> v2:172.21.15.195:3300/0 conn(0x7f369813cf30 0x7f369806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:45.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625339817 0 0) 0x7f369815b170 con 0x7f369806c800 2023-11-28T20:07:45.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3684003530 con 0x7f369806c800 2023-11-28T20:07:45.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242152844 0 0) 0x7f369815b3a0 con 0x7f369815ad40 2023-11-28T20:07:45.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f369815b170 con 0x7f369815ad40 2023-11-28T20:07:45.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1243877566 0 0) 0x7f3684003530 con 0x7f369806c800 2023-11-28T20:07:45.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 >> v2:172.21.15.195:3300/0 conn(0x7f369813cf30 msgr2=0x7f369806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:45.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 --2- 172.21.15.177:0/1053100514 >> v2:172.21.15.195:3300/0 conn(0x7f369813cf30 0x7f369806c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 >> v1:172.21.15.195:6789/0 conn(0x7f369815ad40 legacy=0x7f36980cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:45.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369813f720 con 0x7f369806c800 2023-11-28T20:07:45.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f3688001680 con 0x7f369806c800 2023-11-28T20:07:45.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369e0ab640 1 --2- 172.21.15.177:0/1053100514 >> v2:172.21.15.195:3300/0 conn(0x7f369813cf30 0x7f369806c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:07:45.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 >> v1:172.21.15.177:6789/0 conn(0x7f369806c800 legacy=0x7f369815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:45.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 --2- 172.21.15.177:0/1053100514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3684003b60 0x7f3684003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:45.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 --2- 172.21.15.177:0/1053100514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36840047d0 0x7f3684004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:45.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 --2- 172.21.15.177:0/1053100514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36840051e0 0x7f368400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:45.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368400c0e0 con 0x7f36840047d0 2023-11-28T20:07:45.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368400c250 con 0x7f3684003b60 2023-11-28T20:07:45.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368400c410 con 0x7f36840051e0 2023-11-28T20:07:45.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.772+0000 7f369d8aa640 1 --2- 172.21.15.177:0/1053100514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36840047d0 0x7f3684004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:45.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.776+0000 7f369e0ab640 1 --2- 172.21.15.177:0/1053100514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3684003b60 0x7f3684003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:45.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.776+0000 7f369e8ac640 1 --2- 172.21.15.177:0/1053100514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36840051e0 0x7f368400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:45.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.776+0000 7f369d8aa640 1 -- 172.21.15.177:0/1053100514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36840051e0 msgr2=0x7f368400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:45.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.776+0000 7f369d8aa640 1 --2- 172.21.15.177:0/1053100514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36840051e0 0x7f368400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.776+0000 7f369d8aa640 1 -- 172.21.15.177:0/1053100514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3684003b60 msgr2=0x7f3684003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:45.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.776+0000 7f369d8aa640 1 --2- 172.21.15.177:0/1053100514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3684003b60 0x7f3684003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.776+0000 7f369d8aa640 1 -- 172.21.15.177:0/1053100514 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3684003530 con 0x7f36840047d0 2023-11-28T20:07:45.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.776+0000 7f369e8ac640 1 -- 172.21.15.177:0/1053100514 reap_dead start 2023-11-28T20:07:45.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.776+0000 7f369d8aa640 1 --2- 172.21.15.177:0/1053100514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36840047d0 0x7f3684004c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3688007fa0 tx=0x7f368801cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df72d38a5979dde server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:45.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.776+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688005ae0 con 0x7f36840047d0 2023-11-28T20:07:45.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.776+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3688005c40 con 0x7f36840047d0 2023-11-28T20:07:45.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.776+0000 7f369d0a9640 1 -- 172.21.15.177:0/1053100514 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688007290 con 0x7f36840047d0 2023-11-28T20:07:45.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.776+0000 7f36a030f640 1 -- 172.21.15.177:0/1053100514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36840047d0 msgr2=0x7f3684004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:45.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.776+0000 7f36a030f640 1 --2- 172.21.15.177:0/1053100514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36840047d0 0x7f3684004c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3688007fa0 tx=0x7f368801cae0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f36a030f640 1 -- 172.21.15.177:0/1053100514 shutdown_connections 2023-11-28T20:07:45.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f36a030f640 1 --2- 172.21.15.177:0/1053100514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36840047d0 0x7f3684004c50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f36a030f640 1 -- 172.21.15.177:0/1053100514 >> 172.21.15.177:0/1053100514 conn(0x7f369806a530 msgr2=0x7f369806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:45.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f36a030f640 1 -- 172.21.15.177:0/1053100514 shutdown_connections 2023-11-28T20:07:45.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f36a030f640 1 -- 172.21.15.177:0/1053100514 wait complete. 2023-11-28T20:07:45.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f36a030f640 1 Processor -- start 2023-11-28T20:07:45.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f36a030f640 1 -- start start 2023-11-28T20:07:45.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f36a030f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36840047d0 0x7f36980b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:45.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f36a030f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3698138d90 0x7f36981f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:45.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f36a030f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36981f57a0 0x7f369812df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:45.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f36a030f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36981f5c20 con 0x7f36981f57a0 2023-11-28T20:07:45.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f36a030f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3698139500 con 0x7f3698138d90 2023-11-28T20:07:45.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f36a030f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36981397e0 con 0x7f36840047d0 2023-11-28T20:07:45.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f369e8ac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36981f57a0 0x7f369812df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:45.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f369e8ac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36981f57a0 0x7f369812df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52614/0 (socket says 172.21.15.177:52614) 2023-11-28T20:07:45.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f369e8ac640 1 -- 172.21.15.177:0/4118678503 learned_addr learned my addr 172.21.15.177:0/4118678503 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:45.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f369e0ab640 1 --2- 172.21.15.177:0/4118678503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36840047d0 0x7f36980b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:45.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f369d8aa640 1 --2- 172.21.15.177:0/4118678503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3698138d90 0x7f36981f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:45.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f369e8ac640 1 -- 172.21.15.177:0/4118678503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36840047d0 msgr2=0x7f36980b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:45.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f369e8ac640 1 --2- 172.21.15.177:0/4118678503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36840047d0 0x7f36980b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f369e8ac640 1 -- 172.21.15.177:0/4118678503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3698138d90 msgr2=0x7f36981f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:45.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f369e8ac640 1 --2- 172.21.15.177:0/4118678503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3698138d90 0x7f36981f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f369e8ac640 1 -- 172.21.15.177:0/4118678503 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3698139ac0 con 0x7f36981f57a0 2023-11-28T20:07:45.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.780+0000 7f369e8ac640 1 --2- 172.21.15.177:0/4118678503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36981f57a0 0x7f369812df00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f369806cf10 tx=0x7f369000ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:45.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.784+0000 7f368effd640 1 -- 172.21.15.177:0/4118678503 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690003d90 con 0x7f36981f57a0 2023-11-28T20:07:45.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.784+0000 7f368effd640 1 -- 172.21.15.177:0/4118678503 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369000d050 con 0x7f36981f57a0 2023-11-28T20:07:45.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.784+0000 7f368effd640 1 -- 172.21.15.177:0/4118678503 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900109d0 con 0x7f36981f57a0 2023-11-28T20:07:45.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.784+0000 7f36a030f640 1 -- 172.21.15.177:0/4118678503 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3698139da0 con 0x7f36981f57a0 2023-11-28T20:07:45.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.784+0000 7f36a030f640 1 -- 172.21.15.177:0/4118678503 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3698139210 con 0x7f36981f57a0 2023-11-28T20:07:45.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.784+0000 7f36a030f640 1 -- 172.21.15.177:0/4118678503 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3698069440 con 0x7f36981f57a0 2023-11-28T20:07:45.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.784+0000 7f368effd640 1 -- 172.21.15.177:0/4118678503 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3690010b30 con 0x7f36981f57a0 2023-11-28T20:07:45.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.784+0000 7f368effd640 1 --2- 172.21.15.177:0/4118678503 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f367c0664a0 0x7f367c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:45.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.784+0000 7f368effd640 1 -- 172.21.15.177:0/4118678503 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3690085f90 con 0x7f36981f57a0 2023-11-28T20:07:45.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.784+0000 7f369e0ab640 1 --2- 172.21.15.177:0/4118678503 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f367c0664a0 0x7f367c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:45.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.784+0000 7f369e0ab640 1 --2- 172.21.15.177:0/4118678503 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f367c0664a0 0x7f367c068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3698050190 tx=0x7f3694009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:45.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.788+0000 7f368effd640 1 -- 172.21.15.177:0/4118678503 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3690053420 con 0x7f36981f57a0 2023-11-28T20:07:45.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.940+0000 7f36a030f640 1 -- 172.21.15.177:0/4118678503 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3698069440 con 0x7f36981f57a0 2023-11-28T20:07:45.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.940+0000 7f368effd640 1 -- 172.21.15.177:0/4118678503 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f3690056a40 con 0x7f36981f57a0 2023-11-28T20:07:45.946 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:45.946 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:07:45.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.944+0000 7f36a030f640 1 -- 172.21.15.177:0/4118678503 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f367c0664a0 msgr2=0x7f367c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:45.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.944+0000 7f36a030f640 1 --2- 172.21.15.177:0/4118678503 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f367c0664a0 0x7f367c068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3698050190 tx=0x7f3694009190 comp rx=0 tx=0).stop 2023-11-28T20:07:45.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.944+0000 7f36a030f640 1 -- 172.21.15.177:0/4118678503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36981f57a0 msgr2=0x7f369812df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:45.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.944+0000 7f36a030f640 1 --2- 172.21.15.177:0/4118678503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36981f57a0 0x7f369812df00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f369806cf10 tx=0x7f369000ac80 comp rx=0 tx=0).stop 2023-11-28T20:07:45.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.944+0000 7f36a030f640 1 -- 172.21.15.177:0/4118678503 shutdown_connections 2023-11-28T20:07:45.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.944+0000 7f36a030f640 1 --2- 172.21.15.177:0/4118678503 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f367c0664a0 0x7f367c068960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.944+0000 7f36a030f640 1 --2- 172.21.15.177:0/4118678503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36981f57a0 0x7f369812df00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.944+0000 7f36a030f640 1 --2- 172.21.15.177:0/4118678503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3698138d90 0x7f36981f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.944+0000 7f36a030f640 1 --2- 172.21.15.177:0/4118678503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36840047d0 0x7f36980b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:45.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.944+0000 7f36a030f640 1 -- 172.21.15.177:0/4118678503 >> 172.21.15.177:0/4118678503 conn(0x7f369806a530 msgr2=0x7f369813e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:45.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.944+0000 7f36a030f640 1 -- 172.21.15.177:0/4118678503 shutdown_connections 2023-11-28T20:07:45.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:45.944+0000 7f36a030f640 1 -- 172.21.15.177:0/4118678503 wait complete. 2023-11-28T20:07:45.967 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T20:07:45.968 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:07:46.080 INFO:tasks.ceph.mds.d.smithi195.stderr:2023-11-28T20:07:46.074+0000 7f0a1e67e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:07:46.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.100+0000 7f2bc598d640 1 Processor -- start 2023-11-28T20:07:46.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.100+0000 7f2bc598d640 1 -- start start 2023-11-28T20:07:46.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.104+0000 7f2bc598d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2bc015d200 0x7f2bc00d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.104+0000 7f2bc598d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2bc00d15a0 0x7f2bc00b6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.104+0000 7f2bc598d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc00b29f0 con 0x7f2bc00d1160 2023-11-28T20:07:46.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.104+0000 7f2bc598d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc00d1b00 con 0x7f2bc015d200 2023-11-28T20:07:46.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.104+0000 7f2bc598d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc00d1de0 con 0x7f2bc00d15a0 2023-11-28T20:07:46.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.104+0000 7f2bbeffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2bc015d200 0x7f2bc00d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:46.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.104+0000 7f2bbeffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2bc015d200 0x7f2bc00d2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52628/0 (socket says 172.21.15.177:52628) 2023-11-28T20:07:46.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.104+0000 7f2bbeffd640 1 -- 172.21.15.177:0/3061404413 learned_addr learned my addr 172.21.15.177:0/3061404413 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:46.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.104+0000 7f2bbf7fe640 1 --2- 172.21.15.177:0/3061404413 >> v2:172.21.15.195:3300/0 conn(0x7f2bc00d15a0 0x7f2bc00b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:46.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.104+0000 7f2bbeffd640 1 -- 172.21.15.177:0/3061404413 >> v2:172.21.15.195:3300/0 conn(0x7f2bc00d15a0 msgr2=0x7f2bc00b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:46.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.104+0000 7f2bbeffd640 1 --2- 172.21.15.177:0/3061404413 >> v2:172.21.15.195:3300/0 conn(0x7f2bc00d15a0 0x7f2bc00b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.104+0000 7f2bbeffd640 1 -- 172.21.15.177:0/3061404413 >> v1:172.21.15.195:6789/0 conn(0x7f2bc00d1160 legacy=0x7f2bc00cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:46.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.104+0000 7f2bbeffd640 1 -- 172.21.15.177:0/3061404413 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc00d20c0 con 0x7f2bc015d200 2023-11-28T20:07:46.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.108+0000 7f2bbeffd640 1 --2- 172.21.15.177:0/3061404413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc015d200 0x7f2bc00d2ba0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00cf400 tx=0x7f2ba801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bd4090b4c24ab3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:46.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.108+0000 7f2bbe7fc640 1 -- 172.21.15.177:0/3061404413 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80a89f0 con 0x7f2bc015d200 2023-11-28T20:07:46.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.108+0000 7f2bbe7fc640 1 -- 172.21.15.177:0/3061404413 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba80a8b50 con 0x7f2bc015d200 2023-11-28T20:07:46.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.108+0000 7f2bbe7fc640 1 -- 172.21.15.177:0/3061404413 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80b0440 con 0x7f2bc015d200 2023-11-28T20:07:46.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.108+0000 7f2bc598d640 1 -- 172.21.15.177:0/3061404413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc015d200 msgr2=0x7f2bc00d2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:46.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.108+0000 7f2bc598d640 1 --2- 172.21.15.177:0/3061404413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc015d200 0x7f2bc00d2ba0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00cf400 tx=0x7f2ba801ecf0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.108+0000 7f2bc598d640 1 -- 172.21.15.177:0/3061404413 shutdown_connections 2023-11-28T20:07:46.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.108+0000 7f2bc598d640 1 --2- 172.21.15.177:0/3061404413 >> v2:172.21.15.195:3300/0 conn(0x7f2bc00d15a0 0x7f2bc00b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.108+0000 7f2bc598d640 1 --2- 172.21.15.177:0/3061404413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc015d200 0x7f2bc00d2ba0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.108+0000 7f2bc598d640 1 -- 172.21.15.177:0/3061404413 >> 172.21.15.177:0/3061404413 conn(0x7f2bc0072260 msgr2=0x7f2bc00cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:46.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.108+0000 7f2bc598d640 1 -- 172.21.15.177:0/3061404413 shutdown_connections 2023-11-28T20:07:46.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.108+0000 7f2bc598d640 1 -- 172.21.15.177:0/3061404413 wait complete. 2023-11-28T20:07:46.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.108+0000 7f2bc598d640 1 Processor -- start 2023-11-28T20:07:46.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.108+0000 7f2bc598d640 1 -- start start 2023-11-28T20:07:46.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bc598d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc00d1160 0x7f2bc01600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bc598d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc00d15a0 0x7f2bc00cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bc598d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bc015d200 0x7f2bc015d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bc598d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc00cc910 con 0x7f2bc00d1160 2023-11-28T20:07:46.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bc598d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc00cbc90 con 0x7f2bc00d15a0 2023-11-28T20:07:46.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bc598d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc00cbf70 con 0x7f2bc015d200 2023-11-28T20:07:46.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bbeffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc00d1160 0x7f2bc01600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:46.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bbeffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc00d1160 0x7f2bc01600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52630/0 (socket says 172.21.15.177:52630) 2023-11-28T20:07:46.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bbeffd640 1 -- 172.21.15.177:0/1213165739 learned_addr learned my addr 172.21.15.177:0/1213165739 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:46.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bbeffd640 1 -- 172.21.15.177:0/1213165739 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bc015d200 msgr2=0x7f2bc015d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:46.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bbeffd640 1 --2- 172.21.15.177:0/1213165739 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bc015d200 0x7f2bc015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bbeffd640 1 -- 172.21.15.177:0/1213165739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc00d15a0 msgr2=0x7f2bc00cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:46.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bbeffd640 1 --2- 172.21.15.177:0/1213165739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc00d15a0 0x7f2bc00cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bbeffd640 1 -- 172.21.15.177:0/1213165739 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba80094d0 con 0x7f2bc00d1160 2023-11-28T20:07:46.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bbeffd640 1 --2- 172.21.15.177:0/1213165739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc00d1160 0x7f2bc01600a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2ba801b900 tx=0x7f2ba801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:46.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bbcff9640 1 -- 172.21.15.177:0/1213165739 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80ba600 con 0x7f2bc00d1160 2023-11-28T20:07:46.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bbcff9640 1 -- 172.21.15.177:0/1213165739 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba80ba760 con 0x7f2bc00d1160 2023-11-28T20:07:46.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bc598d640 1 -- 172.21.15.177:0/1213165739 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc00cc250 con 0x7f2bc00d1160 2023-11-28T20:07:46.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bbcff9640 1 -- 172.21.15.177:0/1213165739 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80bab10 con 0x7f2bc00d1160 2023-11-28T20:07:46.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bc598d640 1 -- 172.21.15.177:0/1213165739 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc01605e0 con 0x7f2bc00d1160 2023-11-28T20:07:46.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.112+0000 7f2bc598d640 1 -- 172.21.15.177:0/1213165739 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc00b26d0 con 0x7f2bc00d1160 2023-11-28T20:07:46.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.116+0000 7f2bbcff9640 1 -- 172.21.15.177:0/1213165739 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ba80bac70 con 0x7f2bc00d1160 2023-11-28T20:07:46.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.116+0000 7f2bbcff9640 1 --2- 172.21.15.177:0/1213165739 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2ba0066470 0x7f2ba0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.116+0000 7f2bbcff9640 1 -- 172.21.15.177:0/1213165739 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ba81222f0 con 0x7f2bc00d1160 2023-11-28T20:07:46.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.116+0000 7f2bb67fc640 1 --2- 172.21.15.177:0/1213165739 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2ba0066470 0x7f2ba0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:46.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.116+0000 7f2bb67fc640 1 --2- 172.21.15.177:0/1213165739 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2ba0066470 0x7f2ba0068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0000f70 tx=0x7f2bb00079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:46.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.120+0000 7f2bbcff9640 1 -- 172.21.15.177:0/1213165739 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ba80ef920 con 0x7f2bc00d1160 2023-11-28T20:07:46.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.268+0000 7f2bc598d640 1 -- 172.21.15.177:0/1213165739 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2bc015d5e0 con 0x7f2ba0066470 2023-11-28T20:07:46.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.276+0000 7f2bbcff9640 1 -- 172.21.15.177:0/1213165739 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264599 (secure 0 0 0) 0x7f2bb0005080 con 0x7f2ba0066470 2023-11-28T20:07:46.283 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:46.285 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:07:46.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.280+0000 7f2bc598d640 1 -- 172.21.15.177:0/1213165739 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2ba0066470 msgr2=0x7f2ba0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:46.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.280+0000 7f2bc598d640 1 --2- 172.21.15.177:0/1213165739 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2ba0066470 0x7f2ba0068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0000f70 tx=0x7f2bb00079c0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.280+0000 7f2bc598d640 1 -- 172.21.15.177:0/1213165739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc00d1160 msgr2=0x7f2bc01600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:46.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.280+0000 7f2bc598d640 1 --2- 172.21.15.177:0/1213165739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc00d1160 0x7f2bc01600a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2ba801b900 tx=0x7f2ba801ba90 comp rx=0 tx=0).stop 2023-11-28T20:07:46.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.280+0000 7f2bc598d640 1 -- 172.21.15.177:0/1213165739 shutdown_connections 2023-11-28T20:07:46.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.280+0000 7f2bc598d640 1 --2- 172.21.15.177:0/1213165739 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2ba0066470 0x7f2ba0068930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.280+0000 7f2bc598d640 1 --2- 172.21.15.177:0/1213165739 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bc015d200 0x7f2bc015d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.280+0000 7f2bc598d640 1 --2- 172.21.15.177:0/1213165739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc00d15a0 0x7f2bc00cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.280+0000 7f2bc598d640 1 --2- 172.21.15.177:0/1213165739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc00d1160 0x7f2bc01600a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.280+0000 7f2bc598d640 1 -- 172.21.15.177:0/1213165739 >> 172.21.15.177:0/1213165739 conn(0x7f2bc0072260 msgr2=0x7f2bc00b7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:46.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.280+0000 7f2bc598d640 1 -- 172.21.15.177:0/1213165739 shutdown_connections 2023-11-28T20:07:46.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.280+0000 7f2bc598d640 1 -- 172.21.15.177:0/1213165739 wait complete. 2023-11-28T20:07:46.301 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-28T20:07:45.418919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231384,"kb_used_data":2728,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743336,"statfs":{"total":773094113280,"available":772857176064,"internally_reserved":0,"allocated":2793472,"data_stored":1702436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.330430"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137351+0000","last_change":"2023-11-28T20:07:42.131471+0000","last_active":"2023-11-28T20:07:42.137351+0000","last_peered":"2023-11-28T20:07:42.137351+0000","last_clean":"2023-11-28T20:07:42.137351+0000","last_became_active":"2023-11-28T20:07:42.131182+0000","last_became_peered":"2023-11-28T20:07:42.131182+0000","last_unstale":"2023-11-28T20:07:42.137351+0000","last_undegraded":"2023-11-28T20:07:42.137351+0000","last_fullsized":"2023-11-28T20:07:42.137351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108961+0000","last_change":"2023-11-28T20:07:42.125245+0000","last_active":"2023-11-28T20:07:43.108961+0000","last_peered":"2023-11-28T20:07:43.108961+0000","last_clean":"2023-11-28T20:07:43.108961+0000","last_became_active":"2023-11-28T20:07:42.124182+0000","last_became_peered":"2023-11-28T20:07:42.124182+0000","last_unstale":"2023-11-28T20:07:43.108961+0000","last_undegraded":"2023-11-28T20:07:43.108961+0000","last_fullsized":"2023-11-28T20:07:43.108961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108178+0000","last_change":"2023-11-28T20:07:42.116843+0000","last_active":"2023-11-28T20:07:43.108178+0000","last_peered":"2023-11-28T20:07:43.108178+0000","last_clean":"2023-11-28T20:07:43.108178+0000","last_became_active":"2023-11-28T20:07:42.116310+0000","last_became_peered":"2023-11-28T20:07:42.116310+0000","last_unstale":"2023-11-28T20:07:43.108178+0000","last_undegraded":"2023-11-28T20:07:43.108178+0000","last_fullsized":"2023-11-28T20:07:43.108178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137725+0000","last_change":"2023-11-28T20:07:42.128042+0000","last_active":"2023-11-28T20:07:42.137725+0000","last_peered":"2023-11-28T20:07:42.137725+0000","last_clean":"2023-11-28T20:07:42.137725+0000","last_became_active":"2023-11-28T20:07:42.127792+0000","last_became_peered":"2023-11-28T20:07:42.127792+0000","last_unstale":"2023-11-28T20:07:42.137725+0000","last_undegraded":"2023-11-28T20:07:42.137725+0000","last_fullsized":"2023-11-28T20:07:42.137725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:15:26.123496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.131481+0000","last_change":"2023-11-28T20:07:42.128904+0000","last_active":"2023-11-28T20:07:42.131481+0000","last_peered":"2023-11-28T20:07:42.131481+0000","last_clean":"2023-11-28T20:07:42.131481+0000","last_became_active":"2023-11-28T20:07:42.128610+0000","last_became_peered":"2023-11-28T20:07:42.128610+0000","last_unstale":"2023-11-28T20:07:42.131481+0000","last_undegraded":"2023-11-28T20:07:42.131481+0000","last_fullsized":"2023-11-28T20:07:42.131481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:23.122677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137829+0000","last_change":"2023-11-28T20:07:42.131901+0000","last_active":"2023-11-28T20:07:42.137829+0000","last_peered":"2023-11-28T20:07:42.137829+0000","last_clean":"2023-11-28T20:07:42.137829+0000","last_became_active":"2023-11-28T20:07:42.125991+0000","last_became_peered":"2023-11-28T20:07:42.125991+0000","last_unstale":"2023-11-28T20:07:42.137829+0000","last_undegraded":"2023-11-28T20:07:42.137829+0000","last_fullsized":"2023-11-28T20:07:42.137829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:47.116523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.130802+0000","last_change":"2023-11-28T20:07:42.125304+0000","last_active":"2023-11-28T20:07:42.130802+0000","last_peered":"2023-11-28T20:07:42.130802+0000","last_clean":"2023-11-28T20:07:42.130802+0000","last_became_active":"2023-11-28T20:07:42.124956+0000","last_became_peered":"2023-11-28T20:07:42.124956+0000","last_unstale":"2023-11-28T20:07:42.130802+0000","last_undegraded":"2023-11-28T20:07:42.130802+0000","last_fullsized":"2023-11-28T20:07:42.130802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:11.982291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108891+0000","last_change":"2023-11-28T20:07:42.112403+0000","last_active":"2023-11-28T20:07:43.108891+0000","last_peered":"2023-11-28T20:07:43.108891+0000","last_clean":"2023-11-28T20:07:43.108891+0000","last_became_active":"2023-11-28T20:07:42.112073+0000","last_became_peered":"2023-11-28T20:07:42.112073+0000","last_unstale":"2023-11-28T20:07:43.108891+0000","last_undegraded":"2023-11-28T20:07:43.108891+0000","last_fullsized":"2023-11-28T20:07:43.108891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.139585+0000","last_change":"2023-11-28T20:07:42.137462+0000","last_active":"2023-11-28T20:07:42.139585+0000","last_peered":"2023-11-28T20:07:42.139585+0000","last_clean":"2023-11-28T20:07:42.139585+0000","last_became_active":"2023-11-28T20:07:42.137147+0000","last_became_peered":"2023-11-28T20:07:42.137147+0000","last_unstale":"2023-11-28T20:07:42.139585+0000","last_undegraded":"2023-11-28T20:07:42.139585+0000","last_fullsized":"2023-11-28T20:07:42.139585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124481+0000","last_change":"2023-11-28T20:07:42.137727+0000","last_active":"2023-11-28T20:07:43.124481+0000","last_peered":"2023-11-28T20:07:43.124481+0000","last_clean":"2023-11-28T20:07:43.124481+0000","last_became_active":"2023-11-28T20:07:42.137387+0000","last_became_peered":"2023-11-28T20:07:42.137387+0000","last_unstale":"2023-11-28T20:07:43.124481+0000","last_undegraded":"2023-11-28T20:07:43.124481+0000","last_fullsized":"2023-11-28T20:07:43.124481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124350+0000","last_change":"2023-11-28T20:07:42.129540+0000","last_active":"2023-11-28T20:07:43.124350+0000","last_peered":"2023-11-28T20:07:43.124350+0000","last_clean":"2023-11-28T20:07:43.124350+0000","last_became_active":"2023-11-28T20:07:42.129269+0000","last_became_peered":"2023-11-28T20:07:42.129269+0000","last_unstale":"2023-11-28T20:07:43.124350+0000","last_undegraded":"2023-11-28T20:07:43.124350+0000","last_fullsized":"2023-11-28T20:07:43.124350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.121980+0000","last_change":"2023-11-28T20:07:42.118180+0000","last_active":"2023-11-28T20:07:42.121980+0000","last_peered":"2023-11-28T20:07:42.121980+0000","last_clean":"2023-11-28T20:07:42.121980+0000","last_became_active":"2023-11-28T20:07:42.117845+0000","last_became_peered":"2023-11-28T20:07:42.117845+0000","last_unstale":"2023-11-28T20:07:42.121980+0000","last_undegraded":"2023-11-28T20:07:42.121980+0000","last_fullsized":"2023-11-28T20:07:42.121980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:58.747474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108471+0000","last_change":"2023-11-28T20:07:42.118653+0000","last_active":"2023-11-28T20:07:43.108471+0000","last_peered":"2023-11-28T20:07:43.108471+0000","last_clean":"2023-11-28T20:07:43.108471+0000","last_became_active":"2023-11-28T20:07:42.118336+0000","last_became_peered":"2023-11-28T20:07:42.118336+0000","last_unstale":"2023-11-28T20:07:43.108471+0000","last_undegraded":"2023-11-28T20:07:43.108471+0000","last_fullsized":"2023-11-28T20:07:43.108471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:15.872240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107844+0000","last_change":"2023-11-28T20:07:42.121476+0000","last_active":"2023-11-28T20:07:43.107844+0000","last_peered":"2023-11-28T20:07:43.107844+0000","last_clean":"2023-11-28T20:07:43.107844+0000","last_became_active":"2023-11-28T20:07:42.121182+0000","last_became_peered":"2023-11-28T20:07:42.121182+0000","last_unstale":"2023-11-28T20:07:43.107844+0000","last_undegraded":"2023-11-28T20:07:43.107844+0000","last_fullsized":"2023-11-28T20:07:43.107844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:23.122677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108322+0000","last_change":"2023-11-28T20:07:42.126484+0000","last_active":"2023-11-28T20:07:43.108322+0000","last_peered":"2023-11-28T20:07:43.108322+0000","last_clean":"2023-11-28T20:07:43.108322+0000","last_became_active":"2023-11-28T20:07:42.126162+0000","last_became_peered":"2023-11-28T20:07:42.126162+0000","last_unstale":"2023-11-28T20:07:43.108322+0000","last_undegraded":"2023-11-28T20:07:43.108322+0000","last_fullsized":"2023-11-28T20:07:43.108322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137774+0000","last_change":"2023-11-28T20:07:42.129046+0000","last_active":"2023-11-28T20:07:42.137774+0000","last_peered":"2023-11-28T20:07:42.137774+0000","last_clean":"2023-11-28T20:07:42.137774+0000","last_became_active":"2023-11-28T20:07:42.125815+0000","last_became_peered":"2023-11-28T20:07:42.125815+0000","last_unstale":"2023-11-28T20:07:42.137774+0000","last_undegraded":"2023-11-28T20:07:42.137774+0000","last_fullsized":"2023-11-28T20:07:42.137774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:40.287122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.138746+0000","last_change":"2023-11-28T20:07:42.134089+0000","last_active":"2023-11-28T20:07:42.138746+0000","last_peered":"2023-11-28T20:07:42.138746+0000","last_clean":"2023-11-28T20:07:42.138746+0000","last_became_active":"2023-11-28T20:07:42.133736+0000","last_became_peered":"2023-11-28T20:07:42.133736+0000","last_unstale":"2023-11-28T20:07:42.138746+0000","last_undegraded":"2023-11-28T20:07:42.138746+0000","last_fullsized":"2023-11-28T20:07:42.138746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:15.872240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.122558+0000","last_change":"2023-11-28T20:07:42.118484+0000","last_active":"2023-11-28T20:07:42.122558+0000","last_peered":"2023-11-28T20:07:42.122558+0000","last_clean":"2023-11-28T20:07:42.122558+0000","last_became_active":"2023-11-28T20:07:42.118184+0000","last_became_peered":"2023-11-28T20:07:42.118184+0000","last_unstale":"2023-11-28T20:07:42.122558+0000","last_undegraded":"2023-11-28T20:07:42.122558+0000","last_fullsized":"2023-11-28T20:07:42.122558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:28.709922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.130315+0000","last_change":"2023-11-28T20:07:42.127821+0000","last_active":"2023-11-28T20:07:42.130315+0000","last_peered":"2023-11-28T20:07:42.130315+0000","last_clean":"2023-11-28T20:07:42.130315+0000","last_became_active":"2023-11-28T20:07:42.127530+0000","last_became_peered":"2023-11-28T20:07:42.127530+0000","last_unstale":"2023-11-28T20:07:42.130315+0000","last_undegraded":"2023-11-28T20:07:42.130315+0000","last_fullsized":"2023-11-28T20:07:42.130315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:28.240493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124333+0000","last_change":"2023-11-28T20:07:42.117709+0000","last_active":"2023-11-28T20:07:43.124333+0000","last_peered":"2023-11-28T20:07:43.124333+0000","last_clean":"2023-11-28T20:07:43.124333+0000","last_became_active":"2023-11-28T20:07:42.117344+0000","last_became_peered":"2023-11-28T20:07:42.117344+0000","last_unstale":"2023-11-28T20:07:43.124333+0000","last_undegraded":"2023-11-28T20:07:43.124333+0000","last_fullsized":"2023-11-28T20:07:43.124333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108064+0000","last_change":"2023-11-28T20:07:42.124921+0000","last_active":"2023-11-28T20:07:43.108064+0000","last_peered":"2023-11-28T20:07:43.108064+0000","last_clean":"2023-11-28T20:07:43.108064+0000","last_became_active":"2023-11-28T20:07:42.123003+0000","last_became_peered":"2023-11-28T20:07:42.123003+0000","last_unstale":"2023-11-28T20:07:43.108064+0000","last_undegraded":"2023-11-28T20:07:43.108064+0000","last_fullsized":"2023-11-28T20:07:43.108064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137809+0000","last_change":"2023-11-28T20:07:42.131215+0000","last_active":"2023-11-28T20:07:42.137809+0000","last_peered":"2023-11-28T20:07:42.137809+0000","last_clean":"2023-11-28T20:07:42.137809+0000","last_became_active":"2023-11-28T20:07:42.130873+0000","last_became_peered":"2023-11-28T20:07:42.130873+0000","last_unstale":"2023-11-28T20:07:42.137809+0000","last_undegraded":"2023-11-28T20:07:42.137809+0000","last_fullsized":"2023-11-28T20:07:42.137809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:01.763338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109188+0000","last_change":"2023-11-28T20:07:42.115955+0000","last_active":"2023-11-28T20:07:43.109188+0000","last_peered":"2023-11-28T20:07:43.109188+0000","last_clean":"2023-11-28T20:07:43.109188+0000","last_became_active":"2023-11-28T20:07:42.113021+0000","last_became_peered":"2023-11-28T20:07:42.113021+0000","last_unstale":"2023-11-28T20:07:43.109188+0000","last_undegraded":"2023-11-28T20:07:43.109188+0000","last_fullsized":"2023-11-28T20:07:43.109188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.135588+0000","last_change":"2023-11-28T20:07:42.122012+0000","last_active":"2023-11-28T20:07:42.135588+0000","last_peered":"2023-11-28T20:07:42.135588+0000","last_clean":"2023-11-28T20:07:42.135588+0000","last_became_active":"2023-11-28T20:07:42.121735+0000","last_became_peered":"2023-11-28T20:07:42.121735+0000","last_unstale":"2023-11-28T20:07:42.135588+0000","last_undegraded":"2023-11-28T20:07:42.135588+0000","last_fullsized":"2023-11-28T20:07:42.135588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:51:27.160600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109731+0000","last_change":"2023-11-28T20:07:42.120931+0000","last_active":"2023-11-28T20:07:43.109731+0000","last_peered":"2023-11-28T20:07:43.109731+0000","last_clean":"2023-11-28T20:07:43.109731+0000","last_became_active":"2023-11-28T20:07:42.120627+0000","last_became_peered":"2023-11-28T20:07:42.120627+0000","last_unstale":"2023-11-28T20:07:43.109731+0000","last_undegraded":"2023-11-28T20:07:43.109731+0000","last_fullsized":"2023-11-28T20:07:43.109731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:21.947376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124556+0000","last_change":"2023-11-28T20:07:42.123201+0000","last_active":"2023-11-28T20:07:43.124556+0000","last_peered":"2023-11-28T20:07:43.124556+0000","last_clean":"2023-11-28T20:07:43.124556+0000","last_became_active":"2023-11-28T20:07:42.122875+0000","last_became_peered":"2023-11-28T20:07:42.122875+0000","last_unstale":"2023-11-28T20:07:43.124556+0000","last_undegraded":"2023-11-28T20:07:43.124556+0000","last_fullsized":"2023-11-28T20:07:43.124556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108521+0000","last_change":"2023-11-28T20:07:42.127975+0000","last_active":"2023-11-28T20:07:43.108521+0000","last_peered":"2023-11-28T20:07:43.108521+0000","last_clean":"2023-11-28T20:07:43.108521+0000","last_became_active":"2023-11-28T20:07:42.127673+0000","last_became_peered":"2023-11-28T20:07:42.127673+0000","last_unstale":"2023-11-28T20:07:43.108521+0000","last_undegraded":"2023-11-28T20:07:43.108521+0000","last_fullsized":"2023-11-28T20:07:43.108521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109700+0000","last_change":"2023-11-28T20:07:42.121532+0000","last_active":"2023-11-28T20:07:43.109700+0000","last_peered":"2023-11-28T20:07:43.109700+0000","last_clean":"2023-11-28T20:07:43.109700+0000","last_became_active":"2023-11-28T20:07:42.121244+0000","last_became_peered":"2023-11-28T20:07:42.121244+0000","last_unstale":"2023-11-28T20:07:43.109700+0000","last_undegraded":"2023-11-28T20:07:43.109700+0000","last_fullsized":"2023-11-28T20:07:43.109700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108193+0000","last_change":"2023-11-28T20:07:42.128684+0000","last_active":"2023-11-28T20:07:43.108193+0000","last_peered":"2023-11-28T20:07:43.108193+0000","last_clean":"2023-11-28T20:07:43.108193+0000","last_became_active":"2023-11-28T20:07:42.128383+0000","last_became_peered":"2023-11-28T20:07:42.128383+0000","last_unstale":"2023-11-28T20:07:43.108193+0000","last_undegraded":"2023-11-28T20:07:43.108193+0000","last_fullsized":"2023-11-28T20:07:43.108193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.136746+0000","last_change":"2023-11-28T20:07:42.125543+0000","last_active":"2023-11-28T20:07:42.136746+0000","last_peered":"2023-11-28T20:07:42.136746+0000","last_clean":"2023-11-28T20:07:42.136746+0000","last_became_active":"2023-11-28T20:07:42.125249+0000","last_became_peered":"2023-11-28T20:07:42.125249+0000","last_unstale":"2023-11-28T20:07:42.136746+0000","last_undegraded":"2023-11-28T20:07:42.136746+0000","last_fullsized":"2023-11-28T20:07:42.136746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:28.709922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.136299+0000","last_change":"2023-11-28T20:07:42.134967+0000","last_active":"2023-11-28T20:07:42.136299+0000","last_peered":"2023-11-28T20:07:42.136299+0000","last_clean":"2023-11-28T20:07:42.136299+0000","last_became_active":"2023-11-28T20:07:42.134643+0000","last_became_peered":"2023-11-28T20:07:42.134643+0000","last_unstale":"2023-11-28T20:07:42.136299+0000","last_undegraded":"2023-11-28T20:07:42.136299+0000","last_fullsized":"2023-11-28T20:07:42.136299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:40.287122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124176+0000","last_change":"2023-11-28T20:07:42.128770+0000","last_active":"2023-11-28T20:07:43.124176+0000","last_peered":"2023-11-28T20:07:43.124176+0000","last_clean":"2023-11-28T20:07:43.124176+0000","last_became_active":"2023-11-28T20:07:42.128009+0000","last_became_peered":"2023-11-28T20:07:42.128009+0000","last_unstale":"2023-11-28T20:07:43.124176+0000","last_undegraded":"2023-11-28T20:07:43.124176+0000","last_fullsized":"2023-11-28T20:07:43.124176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.127235+0000","last_change":"2023-11-28T20:07:42.118468+0000","last_active":"2023-11-28T20:07:42.127235+0000","last_peered":"2023-11-28T20:07:42.127235+0000","last_clean":"2023-11-28T20:07:42.127235+0000","last_became_active":"2023-11-28T20:07:42.118171+0000","last_became_peered":"2023-11-28T20:07:42.118171+0000","last_unstale":"2023-11-28T20:07:42.127235+0000","last_undegraded":"2023-11-28T20:07:42.127235+0000","last_fullsized":"2023-11-28T20:07:42.127235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:08.481810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109448+0000","last_change":"2023-11-28T20:07:41.124073+0000","last_active":"2023-11-28T20:07:43.109448+0000","last_peered":"2023-11-28T20:07:43.109448+0000","last_clean":"2023-11-28T20:07:43.109448+0000","last_became_active":"2023-11-28T20:07:41.123753+0000","last_became_peered":"2023-11-28T20:07:41.123753+0000","last_unstale":"2023-11-28T20:07:43.109448+0000","last_undegraded":"2023-11-28T20:07:43.109448+0000","last_fullsized":"2023-11-28T20:07:43.109448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108309+0000","last_change":"2023-11-28T20:07:42.115734+0000","last_active":"2023-11-28T20:07:43.108309+0000","last_peered":"2023-11-28T20:07:43.108309+0000","last_clean":"2023-11-28T20:07:43.108309+0000","last_became_active":"2023-11-28T20:07:42.115363+0000","last_became_peered":"2023-11-28T20:07:42.115363+0000","last_unstale":"2023-11-28T20:07:43.108309+0000","last_undegraded":"2023-11-28T20:07:43.108309+0000","last_fullsized":"2023-11-28T20:07:43.108309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124235+0000","last_change":"2023-11-28T20:07:41.120709+0000","last_active":"2023-11-28T20:07:43.124235+0000","last_peered":"2023-11-28T20:07:43.124235+0000","last_clean":"2023-11-28T20:07:43.124235+0000","last_became_active":"2023-11-28T20:07:41.120386+0000","last_became_peered":"2023-11-28T20:07:41.120386+0000","last_unstale":"2023-11-28T20:07:43.124235+0000","last_undegraded":"2023-11-28T20:07:43.124235+0000","last_fullsized":"2023-11-28T20:07:43.124235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109227+0000","last_change":"2023-11-28T20:07:41.122847+0000","last_active":"2023-11-28T20:07:43.109227+0000","last_peered":"2023-11-28T20:07:43.109227+0000","last_clean":"2023-11-28T20:07:43.109227+0000","last_became_active":"2023-11-28T20:07:41.122369+0000","last_became_peered":"2023-11-28T20:07:41.122369+0000","last_unstale":"2023-11-28T20:07:43.109227+0000","last_undegraded":"2023-11-28T20:07:43.109227+0000","last_fullsized":"2023-11-28T20:07:43.109227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108986+0000","last_change":"2023-11-28T20:07:42.126772+0000","last_active":"2023-11-28T20:07:43.108986+0000","last_peered":"2023-11-28T20:07:43.108986+0000","last_clean":"2023-11-28T20:07:43.108986+0000","last_became_active":"2023-11-28T20:07:42.126502+0000","last_became_peered":"2023-11-28T20:07:42.126502+0000","last_unstale":"2023-11-28T20:07:43.108986+0000","last_undegraded":"2023-11-28T20:07:43.108986+0000","last_fullsized":"2023-11-28T20:07:43.108986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.108857+0000","last_change":"2023-11-28T20:07:41.126627+0000","last_active":"2023-11-28T20:07:42.108857+0000","last_peered":"2023-11-28T20:07:42.108857+0000","last_clean":"2023-11-28T20:07:42.108857+0000","last_became_active":"2023-11-28T20:07:41.126337+0000","last_became_peered":"2023-11-28T20:07:41.126337+0000","last_unstale":"2023-11-28T20:07:42.108857+0000","last_undegraded":"2023-11-28T20:07:42.108857+0000","last_fullsized":"2023-11-28T20:07:42.108857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:20.140866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108155+0000","last_change":"2023-11-28T20:07:42.126728+0000","last_active":"2023-11-28T20:07:43.108155+0000","last_peered":"2023-11-28T20:07:43.108155+0000","last_clean":"2023-11-28T20:07:43.108155+0000","last_became_active":"2023-11-28T20:07:42.125306+0000","last_became_peered":"2023-11-28T20:07:42.125306+0000","last_unstale":"2023-11-28T20:07:43.108155+0000","last_undegraded":"2023-11-28T20:07:43.108155+0000","last_fullsized":"2023-11-28T20:07:43.108155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124525+0000","last_change":"2023-11-28T20:07:41.134083+0000","last_active":"2023-11-28T20:07:43.124525+0000","last_peered":"2023-11-28T20:07:43.124525+0000","last_clean":"2023-11-28T20:07:43.124525+0000","last_became_active":"2023-11-28T20:07:41.130145+0000","last_became_peered":"2023-11-28T20:07:41.130145+0000","last_unstale":"2023-11-28T20:07:43.124525+0000","last_undegraded":"2023-11-28T20:07:43.124525+0000","last_fullsized":"2023-11-28T20:07:43.124525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.139598+0000","last_change":"2023-11-28T20:07:42.136612+0000","last_active":"2023-11-28T20:07:42.139598+0000","last_peered":"2023-11-28T20:07:42.139598+0000","last_clean":"2023-11-28T20:07:42.139598+0000","last_became_active":"2023-11-28T20:07:42.134753+0000","last_became_peered":"2023-11-28T20:07:42.134753+0000","last_unstale":"2023-11-28T20:07:42.139598+0000","last_undegraded":"2023-11-28T20:07:42.139598+0000","last_fullsized":"2023-11-28T20:07:42.139598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:26.394647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.119762+0000","last_change":"2023-11-28T20:07:41.134996+0000","last_active":"2023-11-28T20:07:42.119762+0000","last_peered":"2023-11-28T20:07:42.119762+0000","last_clean":"2023-11-28T20:07:42.119762+0000","last_became_active":"2023-11-28T20:07:41.134337+0000","last_became_peered":"2023-11-28T20:07:41.134337+0000","last_unstale":"2023-11-28T20:07:42.119762+0000","last_undegraded":"2023-11-28T20:07:42.119762+0000","last_fullsized":"2023-11-28T20:07:42.119762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:27.669172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108614+0000","last_change":"2023-11-28T20:07:42.135162+0000","last_active":"2023-11-28T20:07:43.108614+0000","last_peered":"2023-11-28T20:07:43.108614+0000","last_clean":"2023-11-28T20:07:43.108614+0000","last_became_active":"2023-11-28T20:07:42.134808+0000","last_became_peered":"2023-11-28T20:07:42.134808+0000","last_unstale":"2023-11-28T20:07:43.108614+0000","last_undegraded":"2023-11-28T20:07:43.108614+0000","last_fullsized":"2023-11-28T20:07:43.108614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:48.514241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108605+0000","last_change":"2023-11-28T20:07:41.130473+0000","last_active":"2023-11-28T20:07:43.108605+0000","last_peered":"2023-11-28T20:07:43.108605+0000","last_clean":"2023-11-28T20:07:43.108605+0000","last_became_active":"2023-11-28T20:07:41.130187+0000","last_became_peered":"2023-11-28T20:07:41.130187+0000","last_unstale":"2023-11-28T20:07:43.108605+0000","last_undegraded":"2023-11-28T20:07:43.108605+0000","last_fullsized":"2023-11-28T20:07:43.108605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:14.865470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.132056+0000","last_change":"2023-11-28T20:07:42.125322+0000","last_active":"2023-11-28T20:07:42.132056+0000","last_peered":"2023-11-28T20:07:42.132056+0000","last_clean":"2023-11-28T20:07:42.132056+0000","last_became_active":"2023-11-28T20:07:42.125046+0000","last_became_peered":"2023-11-28T20:07:42.125046+0000","last_unstale":"2023-11-28T20:07:42.132056+0000","last_undegraded":"2023-11-28T20:07:42.132056+0000","last_fullsized":"2023-11-28T20:07:42.132056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:56:27.732726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124339+0000","last_change":"2023-11-28T20:07:41.124966+0000","last_active":"2023-11-28T20:07:43.124339+0000","last_peered":"2023-11-28T20:07:43.124339+0000","last_clean":"2023-11-28T20:07:43.124339+0000","last_became_active":"2023-11-28T20:07:41.124663+0000","last_became_peered":"2023-11-28T20:07:41.124663+0000","last_unstale":"2023-11-28T20:07:43.124339+0000","last_undegraded":"2023-11-28T20:07:43.124339+0000","last_fullsized":"2023-11-28T20:07:43.124339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.136112+0000","last_change":"2023-11-28T20:07:42.130688+0000","last_active":"2023-11-28T20:07:42.136112+0000","last_peered":"2023-11-28T20:07:42.136112+0000","last_clean":"2023-11-28T20:07:42.136112+0000","last_became_active":"2023-11-28T20:07:42.130327+0000","last_became_peered":"2023-11-28T20:07:42.130327+0000","last_unstale":"2023-11-28T20:07:42.136112+0000","last_undegraded":"2023-11-28T20:07:42.136112+0000","last_fullsized":"2023-11-28T20:07:42.136112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:21.147636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108743+0000","last_change":"2023-11-28T20:07:41.125301+0000","last_active":"2023-11-28T20:07:43.108743+0000","last_peered":"2023-11-28T20:07:43.108743+0000","last_clean":"2023-11-28T20:07:43.108743+0000","last_became_active":"2023-11-28T20:07:41.123720+0000","last_became_peered":"2023-11-28T20:07:41.123720+0000","last_unstale":"2023-11-28T20:07:43.108743+0000","last_undegraded":"2023-11-28T20:07:43.108743+0000","last_fullsized":"2023-11-28T20:07:43.108743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107964+0000","last_change":"2023-11-28T20:07:42.130256+0000","last_active":"2023-11-28T20:07:43.107964+0000","last_peered":"2023-11-28T20:07:43.107964+0000","last_clean":"2023-11-28T20:07:43.107964+0000","last_became_active":"2023-11-28T20:07:42.129938+0000","last_became_peered":"2023-11-28T20:07:42.129938+0000","last_unstale":"2023-11-28T20:07:43.107964+0000","last_undegraded":"2023-11-28T20:07:43.107964+0000","last_fullsized":"2023-11-28T20:07:43.107964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.115234+0000","last_change":"2023-11-28T20:07:41.127173+0000","last_active":"2023-11-28T20:07:42.115234+0000","last_peered":"2023-11-28T20:07:42.115234+0000","last_clean":"2023-11-28T20:07:42.115234+0000","last_became_active":"2023-11-28T20:07:41.126888+0000","last_became_peered":"2023-11-28T20:07:41.126888+0000","last_unstale":"2023-11-28T20:07:42.115234+0000","last_undegraded":"2023-11-28T20:07:42.115234+0000","last_fullsized":"2023-11-28T20:07:42.115234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:22.115906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137103+0000","last_change":"2023-11-28T20:07:42.133429+0000","last_active":"2023-11-28T20:07:42.137103+0000","last_peered":"2023-11-28T20:07:42.137103+0000","last_clean":"2023-11-28T20:07:42.137103+0000","last_became_active":"2023-11-28T20:07:42.132944+0000","last_became_peered":"2023-11-28T20:07:42.132944+0000","last_unstale":"2023-11-28T20:07:42.137103+0000","last_undegraded":"2023-11-28T20:07:42.137103+0000","last_fullsized":"2023-11-28T20:07:42.137103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124121+0000","last_change":"2023-11-28T20:07:41.127166+0000","last_active":"2023-11-28T20:07:43.124121+0000","last_peered":"2023-11-28T20:07:43.124121+0000","last_clean":"2023-11-28T20:07:43.124121+0000","last_became_active":"2023-11-28T20:07:41.122806+0000","last_became_peered":"2023-11-28T20:07:41.122806+0000","last_unstale":"2023-11-28T20:07:43.124121+0000","last_undegraded":"2023-11-28T20:07:43.124121+0000","last_fullsized":"2023-11-28T20:07:43.124121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124201+0000","last_change":"2023-11-28T20:07:42.129018+0000","last_active":"2023-11-28T20:07:43.124201+0000","last_peered":"2023-11-28T20:07:43.124201+0000","last_clean":"2023-11-28T20:07:43.124201+0000","last_became_active":"2023-11-28T20:07:42.128392+0000","last_became_peered":"2023-11-28T20:07:42.128392+0000","last_unstale":"2023-11-28T20:07:43.124201+0000","last_undegraded":"2023-11-28T20:07:43.124201+0000","last_fullsized":"2023-11-28T20:07:43.124201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.253157+0000","last_change":"2023-11-28T20:07:41.113833+0000","last_active":"2023-11-28T20:07:42.253157+0000","last_peered":"2023-11-28T20:07:42.253157+0000","last_clean":"2023-11-28T20:07:42.253157+0000","last_became_active":"2023-11-28T20:07:41.113488+0000","last_became_peered":"2023-11-28T20:07:41.113488+0000","last_unstale":"2023-11-28T20:07:42.253157+0000","last_undegraded":"2023-11-28T20:07:42.253157+0000","last_fullsized":"2023-11-28T20:07:42.253157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:00.756568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.139209+0000","last_change":"2023-11-28T20:07:42.135006+0000","last_active":"2023-11-28T20:07:42.139209+0000","last_peered":"2023-11-28T20:07:42.139209+0000","last_clean":"2023-11-28T20:07:42.139209+0000","last_became_active":"2023-11-28T20:07:42.134503+0000","last_became_peered":"2023-11-28T20:07:42.134503+0000","last_unstale":"2023-11-28T20:07:42.139209+0000","last_undegraded":"2023-11-28T20:07:42.139209+0000","last_fullsized":"2023-11-28T20:07:42.139209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:47.116523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.249771+0000","last_change":"2023-11-28T20:07:41.118939+0000","last_active":"2023-11-28T20:07:42.249771+0000","last_peered":"2023-11-28T20:07:42.249771+0000","last_clean":"2023-11-28T20:07:42.249771+0000","last_became_active":"2023-11-28T20:07:41.117672+0000","last_became_peered":"2023-11-28T20:07:41.117672+0000","last_unstale":"2023-11-28T20:07:42.249771+0000","last_undegraded":"2023-11-28T20:07:42.249771+0000","last_fullsized":"2023-11-28T20:07:42.249771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:39.280352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.131510+0000","last_change":"2023-11-28T20:07:42.130339+0000","last_active":"2023-11-28T20:07:42.131510+0000","last_peered":"2023-11-28T20:07:42.131510+0000","last_clean":"2023-11-28T20:07:42.131510+0000","last_became_active":"2023-11-28T20:07:42.129788+0000","last_became_peered":"2023-11-28T20:07:42.129788+0000","last_unstale":"2023-11-28T20:07:42.131510+0000","last_undegraded":"2023-11-28T20:07:42.131510+0000","last_fullsized":"2023-11-28T20:07:42.131510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:15.872240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.249601+0000","last_change":"2023-11-28T20:07:41.114418+0000","last_active":"2023-11-28T20:07:42.249601+0000","last_peered":"2023-11-28T20:07:42.249601+0000","last_clean":"2023-11-28T20:07:42.249601+0000","last_became_active":"2023-11-28T20:07:41.114147+0000","last_became_peered":"2023-11-28T20:07:41.114147+0000","last_unstale":"2023-11-28T20:07:42.249601+0000","last_undegraded":"2023-11-28T20:07:42.249601+0000","last_fullsized":"2023-11-28T20:07:42.249601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:20.140866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137628+0000","last_change":"2023-11-28T20:07:42.133323+0000","last_active":"2023-11-28T20:07:42.137628+0000","last_peered":"2023-11-28T20:07:42.137628+0000","last_clean":"2023-11-28T20:07:42.137628+0000","last_became_active":"2023-11-28T20:07:42.132957+0000","last_became_peered":"2023-11-28T20:07:42.132957+0000","last_unstale":"2023-11-28T20:07:42.137628+0000","last_undegraded":"2023-11-28T20:07:42.137628+0000","last_fullsized":"2023-11-28T20:07:42.137628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108689+0000","last_change":"2023-11-28T20:07:41.123577+0000","last_active":"2023-11-28T20:07:43.108689+0000","last_peered":"2023-11-28T20:07:43.108689+0000","last_clean":"2023-11-28T20:07:43.108689+0000","last_became_active":"2023-11-28T20:07:41.123238+0000","last_became_peered":"2023-11-28T20:07:41.123238+0000","last_unstale":"2023-11-28T20:07:43.108689+0000","last_undegraded":"2023-11-28T20:07:43.108689+0000","last_fullsized":"2023-11-28T20:07:43.108689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:22.115906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.136484+0000","last_change":"2023-11-28T20:07:42.123412+0000","last_active":"2023-11-28T20:07:42.136484+0000","last_peered":"2023-11-28T20:07:42.136484+0000","last_clean":"2023-11-28T20:07:42.136484+0000","last_became_active":"2023-11-28T20:07:42.123097+0000","last_became_peered":"2023-11-28T20:07:42.123097+0000","last_unstale":"2023-11-28T20:07:42.136484+0000","last_undegraded":"2023-11-28T20:07:42.136484+0000","last_fullsized":"2023-11-28T20:07:42.136484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:11.982291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.108719+0000","last_change":"2023-11-28T20:07:41.128647+0000","last_active":"2023-11-28T20:07:42.108719+0000","last_peered":"2023-11-28T20:07:42.108719+0000","last_clean":"2023-11-28T20:07:42.108719+0000","last_became_active":"2023-11-28T20:07:41.128419+0000","last_became_peered":"2023-11-28T20:07:41.128419+0000","last_unstale":"2023-11-28T20:07:42.108719+0000","last_undegraded":"2023-11-28T20:07:42.108719+0000","last_fullsized":"2023-11-28T20:07:42.108719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:46.109752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.138907+0000","last_change":"2023-11-28T20:07:42.134474+0000","last_active":"2023-11-28T20:07:42.138907+0000","last_peered":"2023-11-28T20:07:42.138907+0000","last_clean":"2023-11-28T20:07:42.138907+0000","last_became_active":"2023-11-28T20:07:42.134196+0000","last_became_peered":"2023-11-28T20:07:42.134196+0000","last_unstale":"2023-11-28T20:07:42.138907+0000","last_undegraded":"2023-11-28T20:07:42.138907+0000","last_fullsized":"2023-11-28T20:07:42.138907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:15:26.123496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-28T20:07:41.112096+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:07:41.112096+0000","last_peered":"2023-11-28T20:07:41.112096+0000","last_clean":"2023-11-28T20:07:41.112096+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:07:41.112096+0000","last_undegraded":"2023-11-28T20:07:41.112096+0000","last_fullsized":"2023-11-28T20:07:41.112096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.119462+0000","last_change":"2023-11-28T20:07:41.125548+0000","last_active":"2023-11-28T20:07:42.119462+0000","last_peered":"2023-11-28T20:07:42.119462+0000","last_clean":"2023-11-28T20:07:42.119462+0000","last_became_active":"2023-11-28T20:07:41.124741+0000","last_became_peered":"2023-11-28T20:07:41.124741+0000","last_unstale":"2023-11-28T20:07:42.119462+0000","last_undegraded":"2023-11-28T20:07:42.119462+0000","last_fullsized":"2023-11-28T20:07:42.119462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:33.969503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108686+0000","last_change":"2023-11-28T20:07:42.120751+0000","last_active":"2023-11-28T20:07:43.108686+0000","last_peered":"2023-11-28T20:07:43.108686+0000","last_clean":"2023-11-28T20:07:43.108686+0000","last_became_active":"2023-11-28T20:07:42.120442+0000","last_became_peered":"2023-11-28T20:07:42.120442+0000","last_unstale":"2023-11-28T20:07:43.108686+0000","last_undegraded":"2023-11-28T20:07:43.108686+0000","last_fullsized":"2023-11-28T20:07:43.108686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:23.122677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.117768+0000","last_change":"2023-11-28T20:07:41.123778+0000","last_active":"2023-11-28T20:07:42.117768+0000","last_peered":"2023-11-28T20:07:42.117768+0000","last_clean":"2023-11-28T20:07:42.117768+0000","last_became_active":"2023-11-28T20:07:41.122816+0000","last_became_peered":"2023-11-28T20:07:41.122816+0000","last_unstale":"2023-11-28T20:07:42.117768+0000","last_undegraded":"2023-11-28T20:07:42.117768+0000","last_fullsized":"2023-11-28T20:07:42.117768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:14.653540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107769+0000","last_change":"2023-11-28T20:07:42.107177+0000","last_active":"2023-11-28T20:07:43.107769+0000","last_peered":"2023-11-28T20:07:43.107769+0000","last_clean":"2023-11-28T20:07:43.107769+0000","last_became_active":"2023-11-28T20:07:42.106858+0000","last_became_peered":"2023-11-28T20:07:42.106858+0000","last_unstale":"2023-11-28T20:07:43.107769+0000","last_undegraded":"2023-11-28T20:07:43.107769+0000","last_fullsized":"2023-11-28T20:07:43.107769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:15.872240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.108468+0000","last_change":"2023-11-28T20:07:41.114571+0000","last_active":"2023-11-28T20:07:42.108468+0000","last_peered":"2023-11-28T20:07:42.108468+0000","last_clean":"2023-11-28T20:07:42.108468+0000","last_became_active":"2023-11-28T20:07:41.114262+0000","last_became_peered":"2023-11-28T20:07:41.114262+0000","last_unstale":"2023-11-28T20:07:42.108468+0000","last_undegraded":"2023-11-28T20:07:42.108468+0000","last_fullsized":"2023-11-28T20:07:42.108468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:10.975521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107548+0000","last_change":"2023-11-28T20:07:42.120451+0000","last_active":"2023-11-28T20:07:43.107548+0000","last_peered":"2023-11-28T20:07:43.107548+0000","last_clean":"2023-11-28T20:07:43.107548+0000","last_became_active":"2023-11-28T20:07:42.120142+0000","last_became_peered":"2023-11-28T20:07:42.120142+0000","last_unstale":"2023-11-28T20:07:43.107548+0000","last_undegraded":"2023-11-28T20:07:43.107548+0000","last_fullsized":"2023-11-28T20:07:43.107548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.115367+0000","last_change":"2023-11-28T20:07:41.127173+0000","last_active":"2023-11-28T20:07:42.115367+0000","last_peered":"2023-11-28T20:07:42.115367+0000","last_clean":"2023-11-28T20:07:42.115367+0000","last_became_active":"2023-11-28T20:07:41.126918+0000","last_became_peered":"2023-11-28T20:07:41.126918+0000","last_unstale":"2023-11-28T20:07:42.115367+0000","last_undegraded":"2023-11-28T20:07:42.115367+0000","last_fullsized":"2023-11-28T20:07:42.115367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:07.033166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.122756+0000","last_change":"2023-11-28T20:07:42.116610+0000","last_active":"2023-11-28T20:07:42.122756+0000","last_peered":"2023-11-28T20:07:42.122756+0000","last_clean":"2023-11-28T20:07:42.122756+0000","last_became_active":"2023-11-28T20:07:42.116325+0000","last_became_peered":"2023-11-28T20:07:42.116325+0000","last_unstale":"2023-11-28T20:07:42.122756+0000","last_undegraded":"2023-11-28T20:07:42.122756+0000","last_fullsized":"2023-11-28T20:07:42.122756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:57.709621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108792+0000","last_change":"2023-11-28T20:07:41.122092+0000","last_active":"2023-11-28T20:07:43.108792+0000","last_peered":"2023-11-28T20:07:43.108792+0000","last_clean":"2023-11-28T20:07:43.108792+0000","last_became_active":"2023-11-28T20:07:41.121742+0000","last_became_peered":"2023-11-28T20:07:41.121742+0000","last_unstale":"2023-11-28T20:07:43.108792+0000","last_undegraded":"2023-11-28T20:07:43.108792+0000","last_fullsized":"2023-11-28T20:07:43.108792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137702+0000","last_change":"2023-11-28T20:07:42.127953+0000","last_active":"2023-11-28T20:07:42.137702+0000","last_peered":"2023-11-28T20:07:42.137702+0000","last_clean":"2023-11-28T20:07:42.137702+0000","last_became_active":"2023-11-28T20:07:42.127517+0000","last_became_peered":"2023-11-28T20:07:42.127517+0000","last_unstale":"2023-11-28T20:07:42.137702+0000","last_undegraded":"2023-11-28T20:07:42.137702+0000","last_fullsized":"2023-11-28T20:07:42.137702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:09.986989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.115676+0000","last_change":"2023-11-28T20:07:41.121831+0000","last_active":"2023-11-28T20:07:42.115676+0000","last_peered":"2023-11-28T20:07:42.115676+0000","last_clean":"2023-11-28T20:07:42.115676+0000","last_became_active":"2023-11-28T20:07:41.121524+0000","last_became_peered":"2023-11-28T20:07:41.121524+0000","last_unstale":"2023-11-28T20:07:42.115676+0000","last_undegraded":"2023-11-28T20:07:42.115676+0000","last_fullsized":"2023-11-28T20:07:42.115676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107980+0000","last_change":"2023-11-28T20:07:42.115989+0000","last_active":"2023-11-28T20:07:43.107980+0000","last_peered":"2023-11-28T20:07:43.107980+0000","last_clean":"2023-11-28T20:07:43.107980+0000","last_became_active":"2023-11-28T20:07:42.114912+0000","last_became_peered":"2023-11-28T20:07:42.114912+0000","last_unstale":"2023-11-28T20:07:43.107980+0000","last_undegraded":"2023-11-28T20:07:43.107980+0000","last_fullsized":"2023-11-28T20:07:43.107980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108925+0000","last_change":"2023-11-28T20:07:41.125968+0000","last_active":"2023-11-28T20:07:43.108925+0000","last_peered":"2023-11-28T20:07:43.108925+0000","last_clean":"2023-11-28T20:07:43.108925+0000","last_became_active":"2023-11-28T20:07:41.125651+0000","last_became_peered":"2023-11-28T20:07:41.125651+0000","last_unstale":"2023-11-28T20:07:43.108925+0000","last_undegraded":"2023-11-28T20:07:43.108925+0000","last_fullsized":"2023-11-28T20:07:43.108925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109706+0000","last_change":"2023-11-28T20:07:42.125891+0000","last_active":"2023-11-28T20:07:43.109706+0000","last_peered":"2023-11-28T20:07:43.109706+0000","last_clean":"2023-11-28T20:07:43.109706+0000","last_became_active":"2023-11-28T20:07:42.123728+0000","last_became_peered":"2023-11-28T20:07:42.123728+0000","last_unstale":"2023-11-28T20:07:43.109706+0000","last_undegraded":"2023-11-28T20:07:43.109706+0000","last_fullsized":"2023-11-28T20:07:43.109706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:48.514241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124593+0000","last_change":"2023-11-28T20:07:41.133929+0000","last_active":"2023-11-28T20:07:43.124593+0000","last_peered":"2023-11-28T20:07:43.124593+0000","last_clean":"2023-11-28T20:07:43.124593+0000","last_became_active":"2023-11-28T20:07:41.129799+0000","last_became_peered":"2023-11-28T20:07:41.129799+0000","last_unstale":"2023-11-28T20:07:43.124593+0000","last_undegraded":"2023-11-28T20:07:43.124593+0000","last_fullsized":"2023-11-28T20:07:43.124593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:14.865470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108570+0000","last_change":"2023-11-28T20:07:42.122167+0000","last_active":"2023-11-28T20:07:43.108570+0000","last_peered":"2023-11-28T20:07:43.108570+0000","last_clean":"2023-11-28T20:07:43.108570+0000","last_became_active":"2023-11-28T20:07:42.120118+0000","last_became_peered":"2023-11-28T20:07:42.120118+0000","last_unstale":"2023-11-28T20:07:43.108570+0000","last_undegraded":"2023-11-28T20:07:43.108570+0000","last_fullsized":"2023-11-28T20:07:43.108570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.117637+0000","last_change":"2023-11-28T20:07:41.125281+0000","last_active":"2023-11-28T20:07:42.117637+0000","last_peered":"2023-11-28T20:07:42.117637+0000","last_clean":"2023-11-28T20:07:42.117637+0000","last_became_active":"2023-11-28T20:07:41.124978+0000","last_became_peered":"2023-11-28T20:07:41.124978+0000","last_unstale":"2023-11-28T20:07:42.117637+0000","last_undegraded":"2023-11-28T20:07:42.117637+0000","last_fullsized":"2023-11-28T20:07:42.117637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:27.669172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.122877+0000","last_change":"2023-11-28T20:07:42.115882+0000","last_active":"2023-11-28T20:07:42.122877+0000","last_peered":"2023-11-28T20:07:42.122877+0000","last_clean":"2023-11-28T20:07:42.122877+0000","last_became_active":"2023-11-28T20:07:42.114781+0000","last_became_peered":"2023-11-28T20:07:42.114781+0000","last_unstale":"2023-11-28T20:07:42.122877+0000","last_undegraded":"2023-11-28T20:07:42.122877+0000","last_fullsized":"2023-11-28T20:07:42.122877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:51:27.160600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108238+0000","last_change":"2023-11-28T20:07:41.121428+0000","last_active":"2023-11-28T20:07:43.108238+0000","last_peered":"2023-11-28T20:07:43.108238+0000","last_clean":"2023-11-28T20:07:43.108238+0000","last_became_active":"2023-11-28T20:07:41.121074+0000","last_became_peered":"2023-11-28T20:07:41.121074+0000","last_unstale":"2023-11-28T20:07:43.108238+0000","last_undegraded":"2023-11-28T20:07:43.108238+0000","last_fullsized":"2023-11-28T20:07:43.108238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109046+0000","last_change":"2023-11-28T20:07:42.122531+0000","last_active":"2023-11-28T20:07:43.109046+0000","last_peered":"2023-11-28T20:07:43.109046+0000","last_clean":"2023-11-28T20:07:43.109046+0000","last_became_active":"2023-11-28T20:07:42.122224+0000","last_became_peered":"2023-11-28T20:07:42.122224+0000","last_unstale":"2023-11-28T20:07:43.109046+0000","last_undegraded":"2023-11-28T20:07:43.109046+0000","last_fullsized":"2023-11-28T20:07:43.109046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108278+0000","last_change":"2023-11-28T20:07:41.118482+0000","last_active":"2023-11-28T20:07:43.108278+0000","last_peered":"2023-11-28T20:07:43.108278+0000","last_clean":"2023-11-28T20:07:43.108278+0000","last_became_active":"2023-11-28T20:07:41.117962+0000","last_became_peered":"2023-11-28T20:07:41.117962+0000","last_unstale":"2023-11-28T20:07:43.108278+0000","last_undegraded":"2023-11-28T20:07:43.108278+0000","last_fullsized":"2023-11-28T20:07:43.108278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109519+0000","last_change":"2023-11-28T20:07:42.123985+0000","last_active":"2023-11-28T20:07:43.109519+0000","last_peered":"2023-11-28T20:07:43.109519+0000","last_clean":"2023-11-28T20:07:43.109519+0000","last_became_active":"2023-11-28T20:07:42.122314+0000","last_became_peered":"2023-11-28T20:07:42.122314+0000","last_unstale":"2023-11-28T20:07:43.109519+0000","last_undegraded":"2023-11-28T20:07:43.109519+0000","last_fullsized":"2023-11-28T20:07:43.109519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.248020+0000","last_change":"2023-11-28T20:07:41.127916+0000","last_active":"2023-11-28T20:07:42.248020+0000","last_peered":"2023-11-28T20:07:42.248020+0000","last_clean":"2023-11-28T20:07:42.248020+0000","last_became_active":"2023-11-28T20:07:41.125354+0000","last_became_peered":"2023-11-28T20:07:41.125354+0000","last_unstale":"2023-11-28T20:07:42.248020+0000","last_undegraded":"2023-11-28T20:07:42.248020+0000","last_fullsized":"2023-11-28T20:07:42.248020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:33.969503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124333+0000","last_change":"2023-11-28T20:07:42.123629+0000","last_active":"2023-11-28T20:07:43.124333+0000","last_peered":"2023-11-28T20:07:43.124333+0000","last_clean":"2023-11-28T20:07:43.124333+0000","last_became_active":"2023-11-28T20:07:42.123350+0000","last_became_peered":"2023-11-28T20:07:42.123350+0000","last_unstale":"2023-11-28T20:07:43.124333+0000","last_undegraded":"2023-11-28T20:07:43.124333+0000","last_fullsized":"2023-11-28T20:07:43.124333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.136860+0000","last_change":"2023-11-28T20:07:42.127778+0000","last_active":"2023-11-28T20:07:42.136860+0000","last_peered":"2023-11-28T20:07:42.136860+0000","last_clean":"2023-11-28T20:07:42.136860+0000","last_became_active":"2023-11-28T20:07:42.127127+0000","last_became_peered":"2023-11-28T20:07:42.127127+0000","last_unstale":"2023-11-28T20:07:42.136860+0000","last_undegraded":"2023-11-28T20:07:42.136860+0000","last_fullsized":"2023-11-28T20:07:42.136860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:28.240493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.249177+0000","last_change":"2023-11-28T20:07:41.132264+0000","last_active":"2023-11-28T20:07:42.249177+0000","last_peered":"2023-11-28T20:07:42.249177+0000","last_clean":"2023-11-28T20:07:42.249177+0000","last_became_active":"2023-11-28T20:07:41.131858+0000","last_became_peered":"2023-11-28T20:07:41.131858+0000","last_unstale":"2023-11-28T20:07:42.249177+0000","last_undegraded":"2023-11-28T20:07:42.249177+0000","last_fullsized":"2023-11-28T20:07:42.249177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.136756+0000","last_change":"2023-11-28T20:07:42.125457+0000","last_active":"2023-11-28T20:07:42.136756+0000","last_peered":"2023-11-28T20:07:42.136756+0000","last_clean":"2023-11-28T20:07:42.136756+0000","last_became_active":"2023-11-28T20:07:42.125082+0000","last_became_peered":"2023-11-28T20:07:42.125082+0000","last_unstale":"2023-11-28T20:07:42.136756+0000","last_undegraded":"2023-11-28T20:07:42.136756+0000","last_fullsized":"2023-11-28T20:07:42.136756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:18.500544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.248624+0000","last_change":"2023-11-28T20:07:41.126423+0000","last_active":"2023-11-28T20:07:42.248624+0000","last_peered":"2023-11-28T20:07:42.248624+0000","last_clean":"2023-11-28T20:07:42.248624+0000","last_became_active":"2023-11-28T20:07:41.126053+0000","last_became_peered":"2023-11-28T20:07:41.126053+0000","last_unstale":"2023-11-28T20:07:42.248624+0000","last_undegraded":"2023-11-28T20:07:42.248624+0000","last_fullsized":"2023-11-28T20:07:42.248624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108551+0000","last_change":"2023-11-28T20:07:42.137656+0000","last_active":"2023-11-28T20:07:43.108551+0000","last_peered":"2023-11-28T20:07:43.108551+0000","last_clean":"2023-11-28T20:07:43.108551+0000","last_became_active":"2023-11-28T20:07:42.137370+0000","last_became_peered":"2023-11-28T20:07:42.137370+0000","last_unstale":"2023-11-28T20:07:43.108551+0000","last_undegraded":"2023-11-28T20:07:43.108551+0000","last_fullsized":"2023-11-28T20:07:43.108551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109645+0000","last_change":"2023-11-28T20:07:41.120883+0000","last_active":"2023-11-28T20:07:43.109645+0000","last_peered":"2023-11-28T20:07:43.109645+0000","last_clean":"2023-11-28T20:07:43.109645+0000","last_became_active":"2023-11-28T20:07:41.120623+0000","last_became_peered":"2023-11-28T20:07:41.120623+0000","last_unstale":"2023-11-28T20:07:43.109645+0000","last_undegraded":"2023-11-28T20:07:43.109645+0000","last_fullsized":"2023-11-28T20:07:43.109645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109672+0000","last_change":"2023-11-28T20:07:42.120123+0000","last_active":"2023-11-28T20:07:43.109672+0000","last_peered":"2023-11-28T20:07:43.109672+0000","last_clean":"2023-11-28T20:07:43.109672+0000","last_became_active":"2023-11-28T20:07:42.119516+0000","last_became_peered":"2023-11-28T20:07:42.119516+0000","last_unstale":"2023-11-28T20:07:43.109672+0000","last_undegraded":"2023-11-28T20:07:43.109672+0000","last_fullsized":"2023-11-28T20:07:43.109672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108702+0000","last_change":"2023-11-28T20:07:41.121501+0000","last_active":"2023-11-28T20:07:43.108702+0000","last_peered":"2023-11-28T20:07:43.108702+0000","last_clean":"2023-11-28T20:07:43.108702+0000","last_became_active":"2023-11-28T20:07:41.121213+0000","last_became_peered":"2023-11-28T20:07:41.121213+0000","last_unstale":"2023-11-28T20:07:43.108702+0000","last_undegraded":"2023-11-28T20:07:43.108702+0000","last_fullsized":"2023-11-28T20:07:43.108702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":64736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":64770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:07:46.306 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:07:46.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.480+0000 7f3f5d6c9640 1 Processor -- start 2023-11-28T20:07:46.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.480+0000 7f3f5d6c9640 1 -- start start 2023-11-28T20:07:46.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.480+0000 7f3f5d6c9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3f580d2ba0 0x7f3f580cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.480+0000 7f3f5d6c9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f580b29f0 con 0x7f3f5815d200 2023-11-28T20:07:46.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.480+0000 7f3f5d6c9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f580d1870 con 0x7f3f580ce330 2023-11-28T20:07:46.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.480+0000 7f3f5d6c9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f580d2fe0 con 0x7f3f580d2ba0 2023-11-28T20:07:46.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.480+0000 7f3f4e7fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3f580d2ba0 0x7f3f580cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:46.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.480+0000 7f3f4e7fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3f580d2ba0 0x7f3f580cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52636/0 (socket says 172.21.15.177:52636) 2023-11-28T20:07:46.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.480+0000 7f3f4e7fc640 1 -- 172.21.15.177:0/1850682061 learned_addr learned my addr 172.21.15.177:0/1850682061 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:46.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.480+0000 7f3f4e7fc640 1 -- 172.21.15.177:0/1850682061 >> v1:172.21.15.195:6789/0 conn(0x7f3f580ce330 legacy=0x7f3f580b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:46.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.480+0000 7f3f4e7fc640 1 -- 172.21.15.177:0/1850682061 >> v1:172.21.15.177:6789/0 conn(0x7f3f5815d200 legacy=0x7f3f580d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:46.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.480+0000 7f3f4e7fc640 1 -- 172.21.15.177:0/1850682061 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580ce7a0 con 0x7f3f580d2ba0 2023-11-28T20:07:46.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.484+0000 7f3f4e7fc640 1 --2- 172.21.15.177:0/1850682061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f580d2ba0 0x7f3f580cddf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009870 tx=0x7f3f4801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a289eaa90ef503c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:46.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.484+0000 7f3f567fc640 1 -- 172.21.15.177:0/1850682061 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480a89f0 con 0x7f3f580d2ba0 2023-11-28T20:07:46.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.484+0000 7f3f567fc640 1 -- 172.21.15.177:0/1850682061 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f480a8b50 con 0x7f3f580d2ba0 2023-11-28T20:07:46.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.484+0000 7f3f567fc640 1 -- 172.21.15.177:0/1850682061 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480b0440 con 0x7f3f580d2ba0 2023-11-28T20:07:46.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.484+0000 7f3f5d6c9640 1 -- 172.21.15.177:0/1850682061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f580d2ba0 msgr2=0x7f3f580cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:46.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.484+0000 7f3f5d6c9640 1 --2- 172.21.15.177:0/1850682061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f580d2ba0 0x7f3f580cddf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009870 tx=0x7f3f4801ecf0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.484+0000 7f3f5d6c9640 1 -- 172.21.15.177:0/1850682061 shutdown_connections 2023-11-28T20:07:46.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.484+0000 7f3f5d6c9640 1 --2- 172.21.15.177:0/1850682061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f580d2ba0 0x7f3f580cddf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.484+0000 7f3f5d6c9640 1 -- 172.21.15.177:0/1850682061 >> 172.21.15.177:0/1850682061 conn(0x7f3f58072260 msgr2=0x7f3f580cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:46.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.484+0000 7f3f5d6c9640 1 -- 172.21.15.177:0/1850682061 shutdown_connections 2023-11-28T20:07:46.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.484+0000 7f3f5d6c9640 1 -- 172.21.15.177:0/1850682061 wait complete. 2023-11-28T20:07:46.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f5d6c9640 1 Processor -- start 2023-11-28T20:07:46.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f5d6c9640 1 -- start start 2023-11-28T20:07:46.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f5d6c9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f580ce330 0x7f3f5815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f5d6c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f580d2ba0 0x7f3f5815b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f5d6c9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f5815d200 0x7f3f58156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f5d6c9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f580cb710 con 0x7f3f580ce330 2023-11-28T20:07:46.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f5d6c9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5815e4d0 con 0x7f3f5815d200 2023-11-28T20:07:46.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f5d6c9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5815e7b0 con 0x7f3f580d2ba0 2023-11-28T20:07:46.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f56ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f580ce330 0x7f3f5815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:46.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f56ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f580ce330 0x7f3f5815d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52638/0 (socket says 172.21.15.177:52638) 2023-11-28T20:07:46.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f56ffd640 1 -- 172.21.15.177:0/3111362799 learned_addr learned my addr 172.21.15.177:0/3111362799 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:46.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f4e7fc640 1 --2- 172.21.15.177:0/3111362799 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f580d2ba0 0x7f3f5815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:46.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f577fe640 1 --2- 172.21.15.177:0/3111362799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f5815d200 0x7f3f58156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:46.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f56ffd640 1 -- 172.21.15.177:0/3111362799 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f580d2ba0 msgr2=0x7f3f5815b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:46.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f56ffd640 1 --2- 172.21.15.177:0/3111362799 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f580d2ba0 0x7f3f5815b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f56ffd640 1 -- 172.21.15.177:0/3111362799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f5815d200 msgr2=0x7f3f58156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:46.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f56ffd640 1 --2- 172.21.15.177:0/3111362799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f5815d200 0x7f3f58156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f56ffd640 1 -- 172.21.15.177:0/3111362799 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f480094d0 con 0x7f3f580ce330 2023-11-28T20:07:46.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f577fe640 1 --2- 172.21.15.177:0/3111362799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f5815d200 0x7f3f58156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:46.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f56ffd640 1 --2- 172.21.15.177:0/3111362799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f580ce330 0x7f3f5815d5e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000c3c0 tx=0x7f3f4000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:46.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f4ffff640 1 -- 172.21.15.177:0/3111362799 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f400052d0 con 0x7f3f580ce330 2023-11-28T20:07:46.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f4ffff640 1 -- 172.21.15.177:0/3111362799 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f40005430 con 0x7f3f580ce330 2023-11-28T20:07:46.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f5d6c9640 1 -- 172.21.15.177:0/3111362799 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5815ea90 con 0x7f3f580ce330 2023-11-28T20:07:46.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f4ffff640 1 -- 172.21.15.177:0/3111362799 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40003840 con 0x7f3f580ce330 2023-11-28T20:07:46.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f5d6c9640 1 -- 172.21.15.177:0/3111362799 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5815e180 con 0x7f3f580ce330 2023-11-28T20:07:46.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.488+0000 7f3f5d6c9640 1 -- 172.21.15.177:0/3111362799 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f58069440 con 0x7f3f580ce330 2023-11-28T20:07:46.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.492+0000 7f3f4ffff640 1 -- 172.21.15.177:0/3111362799 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3f400039a0 con 0x7f3f580ce330 2023-11-28T20:07:46.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.492+0000 7f3f4ffff640 1 --2- 172.21.15.177:0/3111362799 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3f380664a0 0x7f3f38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.492+0000 7f3f4ffff640 1 -- 172.21.15.177:0/3111362799 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f40083380 con 0x7f3f580ce330 2023-11-28T20:07:46.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.492+0000 7f3f4e7fc640 1 --2- 172.21.15.177:0/3111362799 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3f380664a0 0x7f3f38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:46.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.492+0000 7f3f4e7fc640 1 --2- 172.21.15.177:0/3111362799 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3f380664a0 0x7f3f38068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3f480b2000 tx=0x7f3f48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:46.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.496+0000 7f3f4ffff640 1 -- 172.21.15.177:0/3111362799 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3f40050820 con 0x7f3f580ce330 2023-11-28T20:07:46.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.644+0000 7f3f5d6c9640 1 -- 172.21.15.177:0/3111362799 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f5815ef40 con 0x7f3f380664a0 2023-11-28T20:07:46.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.652+0000 7f3f4ffff640 1 -- 172.21.15.177:0/3111362799 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264599 (secure 0 0 0) 0x7f3f5815ef40 con 0x7f3f380664a0 2023-11-28T20:07:46.658 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:46.659 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:07:46.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.656+0000 7f3f5d6c9640 1 -- 172.21.15.177:0/3111362799 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3f380664a0 msgr2=0x7f3f38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:46.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.656+0000 7f3f5d6c9640 1 --2- 172.21.15.177:0/3111362799 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3f380664a0 0x7f3f38068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3f480b2000 tx=0x7f3f48008040 comp rx=0 tx=0).stop 2023-11-28T20:07:46.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.656+0000 7f3f5d6c9640 1 -- 172.21.15.177:0/3111362799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f580ce330 msgr2=0x7f3f5815d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:46.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.656+0000 7f3f5d6c9640 1 --2- 172.21.15.177:0/3111362799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f580ce330 0x7f3f5815d5e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000c3c0 tx=0x7f3f4000c880 comp rx=0 tx=0).stop 2023-11-28T20:07:46.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.656+0000 7f3f5d6c9640 1 -- 172.21.15.177:0/3111362799 shutdown_connections 2023-11-28T20:07:46.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.656+0000 7f3f5d6c9640 1 --2- 172.21.15.177:0/3111362799 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3f380664a0 0x7f3f38068960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.656+0000 7f3f5d6c9640 1 --2- 172.21.15.177:0/3111362799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f5815d200 0x7f3f58156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.656+0000 7f3f5d6c9640 1 --2- 172.21.15.177:0/3111362799 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f580d2ba0 0x7f3f5815b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.656+0000 7f3f5d6c9640 1 --2- 172.21.15.177:0/3111362799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f580ce330 0x7f3f5815d5e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.656+0000 7f3f5d6c9640 1 -- 172.21.15.177:0/3111362799 >> 172.21.15.177:0/3111362799 conn(0x7f3f58072260 msgr2=0x7f3f580b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:46.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.656+0000 7f3f5d6c9640 1 -- 172.21.15.177:0/3111362799 shutdown_connections 2023-11-28T20:07:46.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.656+0000 7f3f5d6c9640 1 -- 172.21.15.177:0/3111362799 wait complete. 2023-11-28T20:07:46.677 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-28T20:07:45.418919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231384,"kb_used_data":2728,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743336,"statfs":{"total":773094113280,"available":772857176064,"internally_reserved":0,"allocated":2793472,"data_stored":1702436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.330430"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137351+0000","last_change":"2023-11-28T20:07:42.131471+0000","last_active":"2023-11-28T20:07:42.137351+0000","last_peered":"2023-11-28T20:07:42.137351+0000","last_clean":"2023-11-28T20:07:42.137351+0000","last_became_active":"2023-11-28T20:07:42.131182+0000","last_became_peered":"2023-11-28T20:07:42.131182+0000","last_unstale":"2023-11-28T20:07:42.137351+0000","last_undegraded":"2023-11-28T20:07:42.137351+0000","last_fullsized":"2023-11-28T20:07:42.137351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108961+0000","last_change":"2023-11-28T20:07:42.125245+0000","last_active":"2023-11-28T20:07:43.108961+0000","last_peered":"2023-11-28T20:07:43.108961+0000","last_clean":"2023-11-28T20:07:43.108961+0000","last_became_active":"2023-11-28T20:07:42.124182+0000","last_became_peered":"2023-11-28T20:07:42.124182+0000","last_unstale":"2023-11-28T20:07:43.108961+0000","last_undegraded":"2023-11-28T20:07:43.108961+0000","last_fullsized":"2023-11-28T20:07:43.108961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108178+0000","last_change":"2023-11-28T20:07:42.116843+0000","last_active":"2023-11-28T20:07:43.108178+0000","last_peered":"2023-11-28T20:07:43.108178+0000","last_clean":"2023-11-28T20:07:43.108178+0000","last_became_active":"2023-11-28T20:07:42.116310+0000","last_became_peered":"2023-11-28T20:07:42.116310+0000","last_unstale":"2023-11-28T20:07:43.108178+0000","last_undegraded":"2023-11-28T20:07:43.108178+0000","last_fullsized":"2023-11-28T20:07:43.108178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137725+0000","last_change":"2023-11-28T20:07:42.128042+0000","last_active":"2023-11-28T20:07:42.137725+0000","last_peered":"2023-11-28T20:07:42.137725+0000","last_clean":"2023-11-28T20:07:42.137725+0000","last_became_active":"2023-11-28T20:07:42.127792+0000","last_became_peered":"2023-11-28T20:07:42.127792+0000","last_unstale":"2023-11-28T20:07:42.137725+0000","last_undegraded":"2023-11-28T20:07:42.137725+0000","last_fullsized":"2023-11-28T20:07:42.137725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:15:26.123496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.131481+0000","last_change":"2023-11-28T20:07:42.128904+0000","last_active":"2023-11-28T20:07:42.131481+0000","last_peered":"2023-11-28T20:07:42.131481+0000","last_clean":"2023-11-28T20:07:42.131481+0000","last_became_active":"2023-11-28T20:07:42.128610+0000","last_became_peered":"2023-11-28T20:07:42.128610+0000","last_unstale":"2023-11-28T20:07:42.131481+0000","last_undegraded":"2023-11-28T20:07:42.131481+0000","last_fullsized":"2023-11-28T20:07:42.131481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:23.122677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137829+0000","last_change":"2023-11-28T20:07:42.131901+0000","last_active":"2023-11-28T20:07:42.137829+0000","last_peered":"2023-11-28T20:07:42.137829+0000","last_clean":"2023-11-28T20:07:42.137829+0000","last_became_active":"2023-11-28T20:07:42.125991+0000","last_became_peered":"2023-11-28T20:07:42.125991+0000","last_unstale":"2023-11-28T20:07:42.137829+0000","last_undegraded":"2023-11-28T20:07:42.137829+0000","last_fullsized":"2023-11-28T20:07:42.137829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:47.116523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.130802+0000","last_change":"2023-11-28T20:07:42.125304+0000","last_active":"2023-11-28T20:07:42.130802+0000","last_peered":"2023-11-28T20:07:42.130802+0000","last_clean":"2023-11-28T20:07:42.130802+0000","last_became_active":"2023-11-28T20:07:42.124956+0000","last_became_peered":"2023-11-28T20:07:42.124956+0000","last_unstale":"2023-11-28T20:07:42.130802+0000","last_undegraded":"2023-11-28T20:07:42.130802+0000","last_fullsized":"2023-11-28T20:07:42.130802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:11.982291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108891+0000","last_change":"2023-11-28T20:07:42.112403+0000","last_active":"2023-11-28T20:07:43.108891+0000","last_peered":"2023-11-28T20:07:43.108891+0000","last_clean":"2023-11-28T20:07:43.108891+0000","last_became_active":"2023-11-28T20:07:42.112073+0000","last_became_peered":"2023-11-28T20:07:42.112073+0000","last_unstale":"2023-11-28T20:07:43.108891+0000","last_undegraded":"2023-11-28T20:07:43.108891+0000","last_fullsized":"2023-11-28T20:07:43.108891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.139585+0000","last_change":"2023-11-28T20:07:42.137462+0000","last_active":"2023-11-28T20:07:42.139585+0000","last_peered":"2023-11-28T20:07:42.139585+0000","last_clean":"2023-11-28T20:07:42.139585+0000","last_became_active":"2023-11-28T20:07:42.137147+0000","last_became_peered":"2023-11-28T20:07:42.137147+0000","last_unstale":"2023-11-28T20:07:42.139585+0000","last_undegraded":"2023-11-28T20:07:42.139585+0000","last_fullsized":"2023-11-28T20:07:42.139585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124481+0000","last_change":"2023-11-28T20:07:42.137727+0000","last_active":"2023-11-28T20:07:43.124481+0000","last_peered":"2023-11-28T20:07:43.124481+0000","last_clean":"2023-11-28T20:07:43.124481+0000","last_became_active":"2023-11-28T20:07:42.137387+0000","last_became_peered":"2023-11-28T20:07:42.137387+0000","last_unstale":"2023-11-28T20:07:43.124481+0000","last_undegraded":"2023-11-28T20:07:43.124481+0000","last_fullsized":"2023-11-28T20:07:43.124481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124350+0000","last_change":"2023-11-28T20:07:42.129540+0000","last_active":"2023-11-28T20:07:43.124350+0000","last_peered":"2023-11-28T20:07:43.124350+0000","last_clean":"2023-11-28T20:07:43.124350+0000","last_became_active":"2023-11-28T20:07:42.129269+0000","last_became_peered":"2023-11-28T20:07:42.129269+0000","last_unstale":"2023-11-28T20:07:43.124350+0000","last_undegraded":"2023-11-28T20:07:43.124350+0000","last_fullsized":"2023-11-28T20:07:43.124350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.121980+0000","last_change":"2023-11-28T20:07:42.118180+0000","last_active":"2023-11-28T20:07:42.121980+0000","last_peered":"2023-11-28T20:07:42.121980+0000","last_clean":"2023-11-28T20:07:42.121980+0000","last_became_active":"2023-11-28T20:07:42.117845+0000","last_became_peered":"2023-11-28T20:07:42.117845+0000","last_unstale":"2023-11-28T20:07:42.121980+0000","last_undegraded":"2023-11-28T20:07:42.121980+0000","last_fullsized":"2023-11-28T20:07:42.121980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:58.747474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108471+0000","last_change":"2023-11-28T20:07:42.118653+0000","last_active":"2023-11-28T20:07:43.108471+0000","last_peered":"2023-11-28T20:07:43.108471+0000","last_clean":"2023-11-28T20:07:43.108471+0000","last_became_active":"2023-11-28T20:07:42.118336+0000","last_became_peered":"2023-11-28T20:07:42.118336+0000","last_unstale":"2023-11-28T20:07:43.108471+0000","last_undegraded":"2023-11-28T20:07:43.108471+0000","last_fullsized":"2023-11-28T20:07:43.108471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:15.872240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107844+0000","last_change":"2023-11-28T20:07:42.121476+0000","last_active":"2023-11-28T20:07:43.107844+0000","last_peered":"2023-11-28T20:07:43.107844+0000","last_clean":"2023-11-28T20:07:43.107844+0000","last_became_active":"2023-11-28T20:07:42.121182+0000","last_became_peered":"2023-11-28T20:07:42.121182+0000","last_unstale":"2023-11-28T20:07:43.107844+0000","last_undegraded":"2023-11-28T20:07:43.107844+0000","last_fullsized":"2023-11-28T20:07:43.107844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:23.122677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108322+0000","last_change":"2023-11-28T20:07:42.126484+0000","last_active":"2023-11-28T20:07:43.108322+0000","last_peered":"2023-11-28T20:07:43.108322+0000","last_clean":"2023-11-28T20:07:43.108322+0000","last_became_active":"2023-11-28T20:07:42.126162+0000","last_became_peered":"2023-11-28T20:07:42.126162+0000","last_unstale":"2023-11-28T20:07:43.108322+0000","last_undegraded":"2023-11-28T20:07:43.108322+0000","last_fullsized":"2023-11-28T20:07:43.108322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137774+0000","last_change":"2023-11-28T20:07:42.129046+0000","last_active":"2023-11-28T20:07:42.137774+0000","last_peered":"2023-11-28T20:07:42.137774+0000","last_clean":"2023-11-28T20:07:42.137774+0000","last_became_active":"2023-11-28T20:07:42.125815+0000","last_became_peered":"2023-11-28T20:07:42.125815+0000","last_unstale":"2023-11-28T20:07:42.137774+0000","last_undegraded":"2023-11-28T20:07:42.137774+0000","last_fullsized":"2023-11-28T20:07:42.137774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:40.287122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.138746+0000","last_change":"2023-11-28T20:07:42.134089+0000","last_active":"2023-11-28T20:07:42.138746+0000","last_peered":"2023-11-28T20:07:42.138746+0000","last_clean":"2023-11-28T20:07:42.138746+0000","last_became_active":"2023-11-28T20:07:42.133736+0000","last_became_peered":"2023-11-28T20:07:42.133736+0000","last_unstale":"2023-11-28T20:07:42.138746+0000","last_undegraded":"2023-11-28T20:07:42.138746+0000","last_fullsized":"2023-11-28T20:07:42.138746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:15.872240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.122558+0000","last_change":"2023-11-28T20:07:42.118484+0000","last_active":"2023-11-28T20:07:42.122558+0000","last_peered":"2023-11-28T20:07:42.122558+0000","last_clean":"2023-11-28T20:07:42.122558+0000","last_became_active":"2023-11-28T20:07:42.118184+0000","last_became_peered":"2023-11-28T20:07:42.118184+0000","last_unstale":"2023-11-28T20:07:42.122558+0000","last_undegraded":"2023-11-28T20:07:42.122558+0000","last_fullsized":"2023-11-28T20:07:42.122558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:28.709922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.130315+0000","last_change":"2023-11-28T20:07:42.127821+0000","last_active":"2023-11-28T20:07:42.130315+0000","last_peered":"2023-11-28T20:07:42.130315+0000","last_clean":"2023-11-28T20:07:42.130315+0000","last_became_active":"2023-11-28T20:07:42.127530+0000","last_became_peered":"2023-11-28T20:07:42.127530+0000","last_unstale":"2023-11-28T20:07:42.130315+0000","last_undegraded":"2023-11-28T20:07:42.130315+0000","last_fullsized":"2023-11-28T20:07:42.130315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:28.240493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124333+0000","last_change":"2023-11-28T20:07:42.117709+0000","last_active":"2023-11-28T20:07:43.124333+0000","last_peered":"2023-11-28T20:07:43.124333+0000","last_clean":"2023-11-28T20:07:43.124333+0000","last_became_active":"2023-11-28T20:07:42.117344+0000","last_became_peered":"2023-11-28T20:07:42.117344+0000","last_unstale":"2023-11-28T20:07:43.124333+0000","last_undegraded":"2023-11-28T20:07:43.124333+0000","last_fullsized":"2023-11-28T20:07:43.124333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108064+0000","last_change":"2023-11-28T20:07:42.124921+0000","last_active":"2023-11-28T20:07:43.108064+0000","last_peered":"2023-11-28T20:07:43.108064+0000","last_clean":"2023-11-28T20:07:43.108064+0000","last_became_active":"2023-11-28T20:07:42.123003+0000","last_became_peered":"2023-11-28T20:07:42.123003+0000","last_unstale":"2023-11-28T20:07:43.108064+0000","last_undegraded":"2023-11-28T20:07:43.108064+0000","last_fullsized":"2023-11-28T20:07:43.108064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137809+0000","last_change":"2023-11-28T20:07:42.131215+0000","last_active":"2023-11-28T20:07:42.137809+0000","last_peered":"2023-11-28T20:07:42.137809+0000","last_clean":"2023-11-28T20:07:42.137809+0000","last_became_active":"2023-11-28T20:07:42.130873+0000","last_became_peered":"2023-11-28T20:07:42.130873+0000","last_unstale":"2023-11-28T20:07:42.137809+0000","last_undegraded":"2023-11-28T20:07:42.137809+0000","last_fullsized":"2023-11-28T20:07:42.137809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:01.763338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109188+0000","last_change":"2023-11-28T20:07:42.115955+0000","last_active":"2023-11-28T20:07:43.109188+0000","last_peered":"2023-11-28T20:07:43.109188+0000","last_clean":"2023-11-28T20:07:43.109188+0000","last_became_active":"2023-11-28T20:07:42.113021+0000","last_became_peered":"2023-11-28T20:07:42.113021+0000","last_unstale":"2023-11-28T20:07:43.109188+0000","last_undegraded":"2023-11-28T20:07:43.109188+0000","last_fullsized":"2023-11-28T20:07:43.109188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.135588+0000","last_change":"2023-11-28T20:07:42.122012+0000","last_active":"2023-11-28T20:07:42.135588+0000","last_peered":"2023-11-28T20:07:42.135588+0000","last_clean":"2023-11-28T20:07:42.135588+0000","last_became_active":"2023-11-28T20:07:42.121735+0000","last_became_peered":"2023-11-28T20:07:42.121735+0000","last_unstale":"2023-11-28T20:07:42.135588+0000","last_undegraded":"2023-11-28T20:07:42.135588+0000","last_fullsized":"2023-11-28T20:07:42.135588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:51:27.160600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109731+0000","last_change":"2023-11-28T20:07:42.120931+0000","last_active":"2023-11-28T20:07:43.109731+0000","last_peered":"2023-11-28T20:07:43.109731+0000","last_clean":"2023-11-28T20:07:43.109731+0000","last_became_active":"2023-11-28T20:07:42.120627+0000","last_became_peered":"2023-11-28T20:07:42.120627+0000","last_unstale":"2023-11-28T20:07:43.109731+0000","last_undegraded":"2023-11-28T20:07:43.109731+0000","last_fullsized":"2023-11-28T20:07:43.109731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:21.947376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124556+0000","last_change":"2023-11-28T20:07:42.123201+0000","last_active":"2023-11-28T20:07:43.124556+0000","last_peered":"2023-11-28T20:07:43.124556+0000","last_clean":"2023-11-28T20:07:43.124556+0000","last_became_active":"2023-11-28T20:07:42.122875+0000","last_became_peered":"2023-11-28T20:07:42.122875+0000","last_unstale":"2023-11-28T20:07:43.124556+0000","last_undegraded":"2023-11-28T20:07:43.124556+0000","last_fullsized":"2023-11-28T20:07:43.124556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108521+0000","last_change":"2023-11-28T20:07:42.127975+0000","last_active":"2023-11-28T20:07:43.108521+0000","last_peered":"2023-11-28T20:07:43.108521+0000","last_clean":"2023-11-28T20:07:43.108521+0000","last_became_active":"2023-11-28T20:07:42.127673+0000","last_became_peered":"2023-11-28T20:07:42.127673+0000","last_unstale":"2023-11-28T20:07:43.108521+0000","last_undegraded":"2023-11-28T20:07:43.108521+0000","last_fullsized":"2023-11-28T20:07:43.108521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109700+0000","last_change":"2023-11-28T20:07:42.121532+0000","last_active":"2023-11-28T20:07:43.109700+0000","last_peered":"2023-11-28T20:07:43.109700+0000","last_clean":"2023-11-28T20:07:43.109700+0000","last_became_active":"2023-11-28T20:07:42.121244+0000","last_became_peered":"2023-11-28T20:07:42.121244+0000","last_unstale":"2023-11-28T20:07:43.109700+0000","last_undegraded":"2023-11-28T20:07:43.109700+0000","last_fullsized":"2023-11-28T20:07:43.109700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108193+0000","last_change":"2023-11-28T20:07:42.128684+0000","last_active":"2023-11-28T20:07:43.108193+0000","last_peered":"2023-11-28T20:07:43.108193+0000","last_clean":"2023-11-28T20:07:43.108193+0000","last_became_active":"2023-11-28T20:07:42.128383+0000","last_became_peered":"2023-11-28T20:07:42.128383+0000","last_unstale":"2023-11-28T20:07:43.108193+0000","last_undegraded":"2023-11-28T20:07:43.108193+0000","last_fullsized":"2023-11-28T20:07:43.108193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.136746+0000","last_change":"2023-11-28T20:07:42.125543+0000","last_active":"2023-11-28T20:07:42.136746+0000","last_peered":"2023-11-28T20:07:42.136746+0000","last_clean":"2023-11-28T20:07:42.136746+0000","last_became_active":"2023-11-28T20:07:42.125249+0000","last_became_peered":"2023-11-28T20:07:42.125249+0000","last_unstale":"2023-11-28T20:07:42.136746+0000","last_undegraded":"2023-11-28T20:07:42.136746+0000","last_fullsized":"2023-11-28T20:07:42.136746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:28.709922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.136299+0000","last_change":"2023-11-28T20:07:42.134967+0000","last_active":"2023-11-28T20:07:42.136299+0000","last_peered":"2023-11-28T20:07:42.136299+0000","last_clean":"2023-11-28T20:07:42.136299+0000","last_became_active":"2023-11-28T20:07:42.134643+0000","last_became_peered":"2023-11-28T20:07:42.134643+0000","last_unstale":"2023-11-28T20:07:42.136299+0000","last_undegraded":"2023-11-28T20:07:42.136299+0000","last_fullsized":"2023-11-28T20:07:42.136299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:40.287122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124176+0000","last_change":"2023-11-28T20:07:42.128770+0000","last_active":"2023-11-28T20:07:43.124176+0000","last_peered":"2023-11-28T20:07:43.124176+0000","last_clean":"2023-11-28T20:07:43.124176+0000","last_became_active":"2023-11-28T20:07:42.128009+0000","last_became_peered":"2023-11-28T20:07:42.128009+0000","last_unstale":"2023-11-28T20:07:43.124176+0000","last_undegraded":"2023-11-28T20:07:43.124176+0000","last_fullsized":"2023-11-28T20:07:43.124176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.127235+0000","last_change":"2023-11-28T20:07:42.118468+0000","last_active":"2023-11-28T20:07:42.127235+0000","last_peered":"2023-11-28T20:07:42.127235+0000","last_clean":"2023-11-28T20:07:42.127235+0000","last_became_active":"2023-11-28T20:07:42.118171+0000","last_became_peered":"2023-11-28T20:07:42.118171+0000","last_unstale":"2023-11-28T20:07:42.127235+0000","last_undegraded":"2023-11-28T20:07:42.127235+0000","last_fullsized":"2023-11-28T20:07:42.127235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:08.481810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109448+0000","last_change":"2023-11-28T20:07:41.124073+0000","last_active":"2023-11-28T20:07:43.109448+0000","last_peered":"2023-11-28T20:07:43.109448+0000","last_clean":"2023-11-28T20:07:43.109448+0000","last_became_active":"2023-11-28T20:07:41.123753+0000","last_became_peered":"2023-11-28T20:07:41.123753+0000","last_unstale":"2023-11-28T20:07:43.109448+0000","last_undegraded":"2023-11-28T20:07:43.109448+0000","last_fullsized":"2023-11-28T20:07:43.109448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108309+0000","last_change":"2023-11-28T20:07:42.115734+0000","last_active":"2023-11-28T20:07:43.108309+0000","last_peered":"2023-11-28T20:07:43.108309+0000","last_clean":"2023-11-28T20:07:43.108309+0000","last_became_active":"2023-11-28T20:07:42.115363+0000","last_became_peered":"2023-11-28T20:07:42.115363+0000","last_unstale":"2023-11-28T20:07:43.108309+0000","last_undegraded":"2023-11-28T20:07:43.108309+0000","last_fullsized":"2023-11-28T20:07:43.108309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124235+0000","last_change":"2023-11-28T20:07:41.120709+0000","last_active":"2023-11-28T20:07:43.124235+0000","last_peered":"2023-11-28T20:07:43.124235+0000","last_clean":"2023-11-28T20:07:43.124235+0000","last_became_active":"2023-11-28T20:07:41.120386+0000","last_became_peered":"2023-11-28T20:07:41.120386+0000","last_unstale":"2023-11-28T20:07:43.124235+0000","last_undegraded":"2023-11-28T20:07:43.124235+0000","last_fullsized":"2023-11-28T20:07:43.124235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109227+0000","last_change":"2023-11-28T20:07:41.122847+0000","last_active":"2023-11-28T20:07:43.109227+0000","last_peered":"2023-11-28T20:07:43.109227+0000","last_clean":"2023-11-28T20:07:43.109227+0000","last_became_active":"2023-11-28T20:07:41.122369+0000","last_became_peered":"2023-11-28T20:07:41.122369+0000","last_unstale":"2023-11-28T20:07:43.109227+0000","last_undegraded":"2023-11-28T20:07:43.109227+0000","last_fullsized":"2023-11-28T20:07:43.109227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108986+0000","last_change":"2023-11-28T20:07:42.126772+0000","last_active":"2023-11-28T20:07:43.108986+0000","last_peered":"2023-11-28T20:07:43.108986+0000","last_clean":"2023-11-28T20:07:43.108986+0000","last_became_active":"2023-11-28T20:07:42.126502+0000","last_became_peered":"2023-11-28T20:07:42.126502+0000","last_unstale":"2023-11-28T20:07:43.108986+0000","last_undegraded":"2023-11-28T20:07:43.108986+0000","last_fullsized":"2023-11-28T20:07:43.108986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.108857+0000","last_change":"2023-11-28T20:07:41.126627+0000","last_active":"2023-11-28T20:07:42.108857+0000","last_peered":"2023-11-28T20:07:42.108857+0000","last_clean":"2023-11-28T20:07:42.108857+0000","last_became_active":"2023-11-28T20:07:41.126337+0000","last_became_peered":"2023-11-28T20:07:41.126337+0000","last_unstale":"2023-11-28T20:07:42.108857+0000","last_undegraded":"2023-11-28T20:07:42.108857+0000","last_fullsized":"2023-11-28T20:07:42.108857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:20.140866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108155+0000","last_change":"2023-11-28T20:07:42.126728+0000","last_active":"2023-11-28T20:07:43.108155+0000","last_peered":"2023-11-28T20:07:43.108155+0000","last_clean":"2023-11-28T20:07:43.108155+0000","last_became_active":"2023-11-28T20:07:42.125306+0000","last_became_peered":"2023-11-28T20:07:42.125306+0000","last_unstale":"2023-11-28T20:07:43.108155+0000","last_undegraded":"2023-11-28T20:07:43.108155+0000","last_fullsized":"2023-11-28T20:07:43.108155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124525+0000","last_change":"2023-11-28T20:07:41.134083+0000","last_active":"2023-11-28T20:07:43.124525+0000","last_peered":"2023-11-28T20:07:43.124525+0000","last_clean":"2023-11-28T20:07:43.124525+0000","last_became_active":"2023-11-28T20:07:41.130145+0000","last_became_peered":"2023-11-28T20:07:41.130145+0000","last_unstale":"2023-11-28T20:07:43.124525+0000","last_undegraded":"2023-11-28T20:07:43.124525+0000","last_fullsized":"2023-11-28T20:07:43.124525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.139598+0000","last_change":"2023-11-28T20:07:42.136612+0000","last_active":"2023-11-28T20:07:42.139598+0000","last_peered":"2023-11-28T20:07:42.139598+0000","last_clean":"2023-11-28T20:07:42.139598+0000","last_became_active":"2023-11-28T20:07:42.134753+0000","last_became_peered":"2023-11-28T20:07:42.134753+0000","last_unstale":"2023-11-28T20:07:42.139598+0000","last_undegraded":"2023-11-28T20:07:42.139598+0000","last_fullsized":"2023-11-28T20:07:42.139598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:26.394647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.119762+0000","last_change":"2023-11-28T20:07:41.134996+0000","last_active":"2023-11-28T20:07:42.119762+0000","last_peered":"2023-11-28T20:07:42.119762+0000","last_clean":"2023-11-28T20:07:42.119762+0000","last_became_active":"2023-11-28T20:07:41.134337+0000","last_became_peered":"2023-11-28T20:07:41.134337+0000","last_unstale":"2023-11-28T20:07:42.119762+0000","last_undegraded":"2023-11-28T20:07:42.119762+0000","last_fullsized":"2023-11-28T20:07:42.119762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:27.669172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108614+0000","last_change":"2023-11-28T20:07:42.135162+0000","last_active":"2023-11-28T20:07:43.108614+0000","last_peered":"2023-11-28T20:07:43.108614+0000","last_clean":"2023-11-28T20:07:43.108614+0000","last_became_active":"2023-11-28T20:07:42.134808+0000","last_became_peered":"2023-11-28T20:07:42.134808+0000","last_unstale":"2023-11-28T20:07:43.108614+0000","last_undegraded":"2023-11-28T20:07:43.108614+0000","last_fullsized":"2023-11-28T20:07:43.108614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:48.514241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108605+0000","last_change":"2023-11-28T20:07:41.130473+0000","last_active":"2023-11-28T20:07:43.108605+0000","last_peered":"2023-11-28T20:07:43.108605+0000","last_clean":"2023-11-28T20:07:43.108605+0000","last_became_active":"2023-11-28T20:07:41.130187+0000","last_became_peered":"2023-11-28T20:07:41.130187+0000","last_unstale":"2023-11-28T20:07:43.108605+0000","last_undegraded":"2023-11-28T20:07:43.108605+0000","last_fullsized":"2023-11-28T20:07:43.108605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:14.865470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.132056+0000","last_change":"2023-11-28T20:07:42.125322+0000","last_active":"2023-11-28T20:07:42.132056+0000","last_peered":"2023-11-28T20:07:42.132056+0000","last_clean":"2023-11-28T20:07:42.132056+0000","last_became_active":"2023-11-28T20:07:42.125046+0000","last_became_peered":"2023-11-28T20:07:42.125046+0000","last_unstale":"2023-11-28T20:07:42.132056+0000","last_undegraded":"2023-11-28T20:07:42.132056+0000","last_fullsized":"2023-11-28T20:07:42.132056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:56:27.732726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124339+0000","last_change":"2023-11-28T20:07:41.124966+0000","last_active":"2023-11-28T20:07:43.124339+0000","last_peered":"2023-11-28T20:07:43.124339+0000","last_clean":"2023-11-28T20:07:43.124339+0000","last_became_active":"2023-11-28T20:07:41.124663+0000","last_became_peered":"2023-11-28T20:07:41.124663+0000","last_unstale":"2023-11-28T20:07:43.124339+0000","last_undegraded":"2023-11-28T20:07:43.124339+0000","last_fullsized":"2023-11-28T20:07:43.124339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.136112+0000","last_change":"2023-11-28T20:07:42.130688+0000","last_active":"2023-11-28T20:07:42.136112+0000","last_peered":"2023-11-28T20:07:42.136112+0000","last_clean":"2023-11-28T20:07:42.136112+0000","last_became_active":"2023-11-28T20:07:42.130327+0000","last_became_peered":"2023-11-28T20:07:42.130327+0000","last_unstale":"2023-11-28T20:07:42.136112+0000","last_undegraded":"2023-11-28T20:07:42.136112+0000","last_fullsized":"2023-11-28T20:07:42.136112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:21.147636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108743+0000","last_change":"2023-11-28T20:07:41.125301+0000","last_active":"2023-11-28T20:07:43.108743+0000","last_peered":"2023-11-28T20:07:43.108743+0000","last_clean":"2023-11-28T20:07:43.108743+0000","last_became_active":"2023-11-28T20:07:41.123720+0000","last_became_peered":"2023-11-28T20:07:41.123720+0000","last_unstale":"2023-11-28T20:07:43.108743+0000","last_undegraded":"2023-11-28T20:07:43.108743+0000","last_fullsized":"2023-11-28T20:07:43.108743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107964+0000","last_change":"2023-11-28T20:07:42.130256+0000","last_active":"2023-11-28T20:07:43.107964+0000","last_peered":"2023-11-28T20:07:43.107964+0000","last_clean":"2023-11-28T20:07:43.107964+0000","last_became_active":"2023-11-28T20:07:42.129938+0000","last_became_peered":"2023-11-28T20:07:42.129938+0000","last_unstale":"2023-11-28T20:07:43.107964+0000","last_undegraded":"2023-11-28T20:07:43.107964+0000","last_fullsized":"2023-11-28T20:07:43.107964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.115234+0000","last_change":"2023-11-28T20:07:41.127173+0000","last_active":"2023-11-28T20:07:42.115234+0000","last_peered":"2023-11-28T20:07:42.115234+0000","last_clean":"2023-11-28T20:07:42.115234+0000","last_became_active":"2023-11-28T20:07:41.126888+0000","last_became_peered":"2023-11-28T20:07:41.126888+0000","last_unstale":"2023-11-28T20:07:42.115234+0000","last_undegraded":"2023-11-28T20:07:42.115234+0000","last_fullsized":"2023-11-28T20:07:42.115234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:22.115906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137103+0000","last_change":"2023-11-28T20:07:42.133429+0000","last_active":"2023-11-28T20:07:42.137103+0000","last_peered":"2023-11-28T20:07:42.137103+0000","last_clean":"2023-11-28T20:07:42.137103+0000","last_became_active":"2023-11-28T20:07:42.132944+0000","last_became_peered":"2023-11-28T20:07:42.132944+0000","last_unstale":"2023-11-28T20:07:42.137103+0000","last_undegraded":"2023-11-28T20:07:42.137103+0000","last_fullsized":"2023-11-28T20:07:42.137103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124121+0000","last_change":"2023-11-28T20:07:41.127166+0000","last_active":"2023-11-28T20:07:43.124121+0000","last_peered":"2023-11-28T20:07:43.124121+0000","last_clean":"2023-11-28T20:07:43.124121+0000","last_became_active":"2023-11-28T20:07:41.122806+0000","last_became_peered":"2023-11-28T20:07:41.122806+0000","last_unstale":"2023-11-28T20:07:43.124121+0000","last_undegraded":"2023-11-28T20:07:43.124121+0000","last_fullsized":"2023-11-28T20:07:43.124121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124201+0000","last_change":"2023-11-28T20:07:42.129018+0000","last_active":"2023-11-28T20:07:43.124201+0000","last_peered":"2023-11-28T20:07:43.124201+0000","last_clean":"2023-11-28T20:07:43.124201+0000","last_became_active":"2023-11-28T20:07:42.128392+0000","last_became_peered":"2023-11-28T20:07:42.128392+0000","last_unstale":"2023-11-28T20:07:43.124201+0000","last_undegraded":"2023-11-28T20:07:43.124201+0000","last_fullsized":"2023-11-28T20:07:43.124201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.253157+0000","last_change":"2023-11-28T20:07:41.113833+0000","last_active":"2023-11-28T20:07:42.253157+0000","last_peered":"2023-11-28T20:07:42.253157+0000","last_clean":"2023-11-28T20:07:42.253157+0000","last_became_active":"2023-11-28T20:07:41.113488+0000","last_became_peered":"2023-11-28T20:07:41.113488+0000","last_unstale":"2023-11-28T20:07:42.253157+0000","last_undegraded":"2023-11-28T20:07:42.253157+0000","last_fullsized":"2023-11-28T20:07:42.253157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:00.756568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.139209+0000","last_change":"2023-11-28T20:07:42.135006+0000","last_active":"2023-11-28T20:07:42.139209+0000","last_peered":"2023-11-28T20:07:42.139209+0000","last_clean":"2023-11-28T20:07:42.139209+0000","last_became_active":"2023-11-28T20:07:42.134503+0000","last_became_peered":"2023-11-28T20:07:42.134503+0000","last_unstale":"2023-11-28T20:07:42.139209+0000","last_undegraded":"2023-11-28T20:07:42.139209+0000","last_fullsized":"2023-11-28T20:07:42.139209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:47.116523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.249771+0000","last_change":"2023-11-28T20:07:41.118939+0000","last_active":"2023-11-28T20:07:42.249771+0000","last_peered":"2023-11-28T20:07:42.249771+0000","last_clean":"2023-11-28T20:07:42.249771+0000","last_became_active":"2023-11-28T20:07:41.117672+0000","last_became_peered":"2023-11-28T20:07:41.117672+0000","last_unstale":"2023-11-28T20:07:42.249771+0000","last_undegraded":"2023-11-28T20:07:42.249771+0000","last_fullsized":"2023-11-28T20:07:42.249771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:39.280352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.131510+0000","last_change":"2023-11-28T20:07:42.130339+0000","last_active":"2023-11-28T20:07:42.131510+0000","last_peered":"2023-11-28T20:07:42.131510+0000","last_clean":"2023-11-28T20:07:42.131510+0000","last_became_active":"2023-11-28T20:07:42.129788+0000","last_became_peered":"2023-11-28T20:07:42.129788+0000","last_unstale":"2023-11-28T20:07:42.131510+0000","last_undegraded":"2023-11-28T20:07:42.131510+0000","last_fullsized":"2023-11-28T20:07:42.131510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:15.872240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.249601+0000","last_change":"2023-11-28T20:07:41.114418+0000","last_active":"2023-11-28T20:07:42.249601+0000","last_peered":"2023-11-28T20:07:42.249601+0000","last_clean":"2023-11-28T20:07:42.249601+0000","last_became_active":"2023-11-28T20:07:41.114147+0000","last_became_peered":"2023-11-28T20:07:41.114147+0000","last_unstale":"2023-11-28T20:07:42.249601+0000","last_undegraded":"2023-11-28T20:07:42.249601+0000","last_fullsized":"2023-11-28T20:07:42.249601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:20.140866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137628+0000","last_change":"2023-11-28T20:07:42.133323+0000","last_active":"2023-11-28T20:07:42.137628+0000","last_peered":"2023-11-28T20:07:42.137628+0000","last_clean":"2023-11-28T20:07:42.137628+0000","last_became_active":"2023-11-28T20:07:42.132957+0000","last_became_peered":"2023-11-28T20:07:42.132957+0000","last_unstale":"2023-11-28T20:07:42.137628+0000","last_undegraded":"2023-11-28T20:07:42.137628+0000","last_fullsized":"2023-11-28T20:07:42.137628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108689+0000","last_change":"2023-11-28T20:07:41.123577+0000","last_active":"2023-11-28T20:07:43.108689+0000","last_peered":"2023-11-28T20:07:43.108689+0000","last_clean":"2023-11-28T20:07:43.108689+0000","last_became_active":"2023-11-28T20:07:41.123238+0000","last_became_peered":"2023-11-28T20:07:41.123238+0000","last_unstale":"2023-11-28T20:07:43.108689+0000","last_undegraded":"2023-11-28T20:07:43.108689+0000","last_fullsized":"2023-11-28T20:07:43.108689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:22.115906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.136484+0000","last_change":"2023-11-28T20:07:42.123412+0000","last_active":"2023-11-28T20:07:42.136484+0000","last_peered":"2023-11-28T20:07:42.136484+0000","last_clean":"2023-11-28T20:07:42.136484+0000","last_became_active":"2023-11-28T20:07:42.123097+0000","last_became_peered":"2023-11-28T20:07:42.123097+0000","last_unstale":"2023-11-28T20:07:42.136484+0000","last_undegraded":"2023-11-28T20:07:42.136484+0000","last_fullsized":"2023-11-28T20:07:42.136484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:11.982291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.108719+0000","last_change":"2023-11-28T20:07:41.128647+0000","last_active":"2023-11-28T20:07:42.108719+0000","last_peered":"2023-11-28T20:07:42.108719+0000","last_clean":"2023-11-28T20:07:42.108719+0000","last_became_active":"2023-11-28T20:07:41.128419+0000","last_became_peered":"2023-11-28T20:07:41.128419+0000","last_unstale":"2023-11-28T20:07:42.108719+0000","last_undegraded":"2023-11-28T20:07:42.108719+0000","last_fullsized":"2023-11-28T20:07:42.108719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:46.109752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.138907+0000","last_change":"2023-11-28T20:07:42.134474+0000","last_active":"2023-11-28T20:07:42.138907+0000","last_peered":"2023-11-28T20:07:42.138907+0000","last_clean":"2023-11-28T20:07:42.138907+0000","last_became_active":"2023-11-28T20:07:42.134196+0000","last_became_peered":"2023-11-28T20:07:42.134196+0000","last_unstale":"2023-11-28T20:07:42.138907+0000","last_undegraded":"2023-11-28T20:07:42.138907+0000","last_fullsized":"2023-11-28T20:07:42.138907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:15:26.123496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-28T20:07:41.112096+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:07:41.112096+0000","last_peered":"2023-11-28T20:07:41.112096+0000","last_clean":"2023-11-28T20:07:41.112096+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:07:41.112096+0000","last_undegraded":"2023-11-28T20:07:41.112096+0000","last_fullsized":"2023-11-28T20:07:41.112096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.119462+0000","last_change":"2023-11-28T20:07:41.125548+0000","last_active":"2023-11-28T20:07:42.119462+0000","last_peered":"2023-11-28T20:07:42.119462+0000","last_clean":"2023-11-28T20:07:42.119462+0000","last_became_active":"2023-11-28T20:07:41.124741+0000","last_became_peered":"2023-11-28T20:07:41.124741+0000","last_unstale":"2023-11-28T20:07:42.119462+0000","last_undegraded":"2023-11-28T20:07:42.119462+0000","last_fullsized":"2023-11-28T20:07:42.119462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:33.969503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108686+0000","last_change":"2023-11-28T20:07:42.120751+0000","last_active":"2023-11-28T20:07:43.108686+0000","last_peered":"2023-11-28T20:07:43.108686+0000","last_clean":"2023-11-28T20:07:43.108686+0000","last_became_active":"2023-11-28T20:07:42.120442+0000","last_became_peered":"2023-11-28T20:07:42.120442+0000","last_unstale":"2023-11-28T20:07:43.108686+0000","last_undegraded":"2023-11-28T20:07:43.108686+0000","last_fullsized":"2023-11-28T20:07:43.108686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:23.122677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.117768+0000","last_change":"2023-11-28T20:07:41.123778+0000","last_active":"2023-11-28T20:07:42.117768+0000","last_peered":"2023-11-28T20:07:42.117768+0000","last_clean":"2023-11-28T20:07:42.117768+0000","last_became_active":"2023-11-28T20:07:41.122816+0000","last_became_peered":"2023-11-28T20:07:41.122816+0000","last_unstale":"2023-11-28T20:07:42.117768+0000","last_undegraded":"2023-11-28T20:07:42.117768+0000","last_fullsized":"2023-11-28T20:07:42.117768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:14.653540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107769+0000","last_change":"2023-11-28T20:07:42.107177+0000","last_active":"2023-11-28T20:07:43.107769+0000","last_peered":"2023-11-28T20:07:43.107769+0000","last_clean":"2023-11-28T20:07:43.107769+0000","last_became_active":"2023-11-28T20:07:42.106858+0000","last_became_peered":"2023-11-28T20:07:42.106858+0000","last_unstale":"2023-11-28T20:07:43.107769+0000","last_undegraded":"2023-11-28T20:07:43.107769+0000","last_fullsized":"2023-11-28T20:07:43.107769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:15.872240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.108468+0000","last_change":"2023-11-28T20:07:41.114571+0000","last_active":"2023-11-28T20:07:42.108468+0000","last_peered":"2023-11-28T20:07:42.108468+0000","last_clean":"2023-11-28T20:07:42.108468+0000","last_became_active":"2023-11-28T20:07:41.114262+0000","last_became_peered":"2023-11-28T20:07:41.114262+0000","last_unstale":"2023-11-28T20:07:42.108468+0000","last_undegraded":"2023-11-28T20:07:42.108468+0000","last_fullsized":"2023-11-28T20:07:42.108468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:10.975521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107548+0000","last_change":"2023-11-28T20:07:42.120451+0000","last_active":"2023-11-28T20:07:43.107548+0000","last_peered":"2023-11-28T20:07:43.107548+0000","last_clean":"2023-11-28T20:07:43.107548+0000","last_became_active":"2023-11-28T20:07:42.120142+0000","last_became_peered":"2023-11-28T20:07:42.120142+0000","last_unstale":"2023-11-28T20:07:43.107548+0000","last_undegraded":"2023-11-28T20:07:43.107548+0000","last_fullsized":"2023-11-28T20:07:43.107548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.115367+0000","last_change":"2023-11-28T20:07:41.127173+0000","last_active":"2023-11-28T20:07:42.115367+0000","last_peered":"2023-11-28T20:07:42.115367+0000","last_clean":"2023-11-28T20:07:42.115367+0000","last_became_active":"2023-11-28T20:07:41.126918+0000","last_became_peered":"2023-11-28T20:07:41.126918+0000","last_unstale":"2023-11-28T20:07:42.115367+0000","last_undegraded":"2023-11-28T20:07:42.115367+0000","last_fullsized":"2023-11-28T20:07:42.115367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:07.033166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.122756+0000","last_change":"2023-11-28T20:07:42.116610+0000","last_active":"2023-11-28T20:07:42.122756+0000","last_peered":"2023-11-28T20:07:42.122756+0000","last_clean":"2023-11-28T20:07:42.122756+0000","last_became_active":"2023-11-28T20:07:42.116325+0000","last_became_peered":"2023-11-28T20:07:42.116325+0000","last_unstale":"2023-11-28T20:07:42.122756+0000","last_undegraded":"2023-11-28T20:07:42.122756+0000","last_fullsized":"2023-11-28T20:07:42.122756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:57.709621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108792+0000","last_change":"2023-11-28T20:07:41.122092+0000","last_active":"2023-11-28T20:07:43.108792+0000","last_peered":"2023-11-28T20:07:43.108792+0000","last_clean":"2023-11-28T20:07:43.108792+0000","last_became_active":"2023-11-28T20:07:41.121742+0000","last_became_peered":"2023-11-28T20:07:41.121742+0000","last_unstale":"2023-11-28T20:07:43.108792+0000","last_undegraded":"2023-11-28T20:07:43.108792+0000","last_fullsized":"2023-11-28T20:07:43.108792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.137702+0000","last_change":"2023-11-28T20:07:42.127953+0000","last_active":"2023-11-28T20:07:42.137702+0000","last_peered":"2023-11-28T20:07:42.137702+0000","last_clean":"2023-11-28T20:07:42.137702+0000","last_became_active":"2023-11-28T20:07:42.127517+0000","last_became_peered":"2023-11-28T20:07:42.127517+0000","last_unstale":"2023-11-28T20:07:42.137702+0000","last_undegraded":"2023-11-28T20:07:42.137702+0000","last_fullsized":"2023-11-28T20:07:42.137702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:09.986989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.115676+0000","last_change":"2023-11-28T20:07:41.121831+0000","last_active":"2023-11-28T20:07:42.115676+0000","last_peered":"2023-11-28T20:07:42.115676+0000","last_clean":"2023-11-28T20:07:42.115676+0000","last_became_active":"2023-11-28T20:07:41.121524+0000","last_became_peered":"2023-11-28T20:07:41.121524+0000","last_unstale":"2023-11-28T20:07:42.115676+0000","last_undegraded":"2023-11-28T20:07:42.115676+0000","last_fullsized":"2023-11-28T20:07:42.115676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107980+0000","last_change":"2023-11-28T20:07:42.115989+0000","last_active":"2023-11-28T20:07:43.107980+0000","last_peered":"2023-11-28T20:07:43.107980+0000","last_clean":"2023-11-28T20:07:43.107980+0000","last_became_active":"2023-11-28T20:07:42.114912+0000","last_became_peered":"2023-11-28T20:07:42.114912+0000","last_unstale":"2023-11-28T20:07:43.107980+0000","last_undegraded":"2023-11-28T20:07:43.107980+0000","last_fullsized":"2023-11-28T20:07:43.107980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108925+0000","last_change":"2023-11-28T20:07:41.125968+0000","last_active":"2023-11-28T20:07:43.108925+0000","last_peered":"2023-11-28T20:07:43.108925+0000","last_clean":"2023-11-28T20:07:43.108925+0000","last_became_active":"2023-11-28T20:07:41.125651+0000","last_became_peered":"2023-11-28T20:07:41.125651+0000","last_unstale":"2023-11-28T20:07:43.108925+0000","last_undegraded":"2023-11-28T20:07:43.108925+0000","last_fullsized":"2023-11-28T20:07:43.108925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109706+0000","last_change":"2023-11-28T20:07:42.125891+0000","last_active":"2023-11-28T20:07:43.109706+0000","last_peered":"2023-11-28T20:07:43.109706+0000","last_clean":"2023-11-28T20:07:43.109706+0000","last_became_active":"2023-11-28T20:07:42.123728+0000","last_became_peered":"2023-11-28T20:07:42.123728+0000","last_unstale":"2023-11-28T20:07:43.109706+0000","last_undegraded":"2023-11-28T20:07:43.109706+0000","last_fullsized":"2023-11-28T20:07:43.109706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:48.514241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124593+0000","last_change":"2023-11-28T20:07:41.133929+0000","last_active":"2023-11-28T20:07:43.124593+0000","last_peered":"2023-11-28T20:07:43.124593+0000","last_clean":"2023-11-28T20:07:43.124593+0000","last_became_active":"2023-11-28T20:07:41.129799+0000","last_became_peered":"2023-11-28T20:07:41.129799+0000","last_unstale":"2023-11-28T20:07:43.124593+0000","last_undegraded":"2023-11-28T20:07:43.124593+0000","last_fullsized":"2023-11-28T20:07:43.124593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:14.865470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108570+0000","last_change":"2023-11-28T20:07:42.122167+0000","last_active":"2023-11-28T20:07:43.108570+0000","last_peered":"2023-11-28T20:07:43.108570+0000","last_clean":"2023-11-28T20:07:43.108570+0000","last_became_active":"2023-11-28T20:07:42.120118+0000","last_became_peered":"2023-11-28T20:07:42.120118+0000","last_unstale":"2023-11-28T20:07:43.108570+0000","last_undegraded":"2023-11-28T20:07:43.108570+0000","last_fullsized":"2023-11-28T20:07:43.108570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.117637+0000","last_change":"2023-11-28T20:07:41.125281+0000","last_active":"2023-11-28T20:07:42.117637+0000","last_peered":"2023-11-28T20:07:42.117637+0000","last_clean":"2023-11-28T20:07:42.117637+0000","last_became_active":"2023-11-28T20:07:41.124978+0000","last_became_peered":"2023-11-28T20:07:41.124978+0000","last_unstale":"2023-11-28T20:07:42.117637+0000","last_undegraded":"2023-11-28T20:07:42.117637+0000","last_fullsized":"2023-11-28T20:07:42.117637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:27.669172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.122877+0000","last_change":"2023-11-28T20:07:42.115882+0000","last_active":"2023-11-28T20:07:42.122877+0000","last_peered":"2023-11-28T20:07:42.122877+0000","last_clean":"2023-11-28T20:07:42.122877+0000","last_became_active":"2023-11-28T20:07:42.114781+0000","last_became_peered":"2023-11-28T20:07:42.114781+0000","last_unstale":"2023-11-28T20:07:42.122877+0000","last_undegraded":"2023-11-28T20:07:42.122877+0000","last_fullsized":"2023-11-28T20:07:42.122877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:51:27.160600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108238+0000","last_change":"2023-11-28T20:07:41.121428+0000","last_active":"2023-11-28T20:07:43.108238+0000","last_peered":"2023-11-28T20:07:43.108238+0000","last_clean":"2023-11-28T20:07:43.108238+0000","last_became_active":"2023-11-28T20:07:41.121074+0000","last_became_peered":"2023-11-28T20:07:41.121074+0000","last_unstale":"2023-11-28T20:07:43.108238+0000","last_undegraded":"2023-11-28T20:07:43.108238+0000","last_fullsized":"2023-11-28T20:07:43.108238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109046+0000","last_change":"2023-11-28T20:07:42.122531+0000","last_active":"2023-11-28T20:07:43.109046+0000","last_peered":"2023-11-28T20:07:43.109046+0000","last_clean":"2023-11-28T20:07:43.109046+0000","last_became_active":"2023-11-28T20:07:42.122224+0000","last_became_peered":"2023-11-28T20:07:42.122224+0000","last_unstale":"2023-11-28T20:07:43.109046+0000","last_undegraded":"2023-11-28T20:07:43.109046+0000","last_fullsized":"2023-11-28T20:07:43.109046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108278+0000","last_change":"2023-11-28T20:07:41.118482+0000","last_active":"2023-11-28T20:07:43.108278+0000","last_peered":"2023-11-28T20:07:43.108278+0000","last_clean":"2023-11-28T20:07:43.108278+0000","last_became_active":"2023-11-28T20:07:41.117962+0000","last_became_peered":"2023-11-28T20:07:41.117962+0000","last_unstale":"2023-11-28T20:07:43.108278+0000","last_undegraded":"2023-11-28T20:07:43.108278+0000","last_fullsized":"2023-11-28T20:07:43.108278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109519+0000","last_change":"2023-11-28T20:07:42.123985+0000","last_active":"2023-11-28T20:07:43.109519+0000","last_peered":"2023-11-28T20:07:43.109519+0000","last_clean":"2023-11-28T20:07:43.109519+0000","last_became_active":"2023-11-28T20:07:42.122314+0000","last_became_peered":"2023-11-28T20:07:42.122314+0000","last_unstale":"2023-11-28T20:07:43.109519+0000","last_undegraded":"2023-11-28T20:07:43.109519+0000","last_fullsized":"2023-11-28T20:07:43.109519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.248020+0000","last_change":"2023-11-28T20:07:41.127916+0000","last_active":"2023-11-28T20:07:42.248020+0000","last_peered":"2023-11-28T20:07:42.248020+0000","last_clean":"2023-11-28T20:07:42.248020+0000","last_became_active":"2023-11-28T20:07:41.125354+0000","last_became_peered":"2023-11-28T20:07:41.125354+0000","last_unstale":"2023-11-28T20:07:42.248020+0000","last_undegraded":"2023-11-28T20:07:42.248020+0000","last_fullsized":"2023-11-28T20:07:42.248020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:33.969503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124333+0000","last_change":"2023-11-28T20:07:42.123629+0000","last_active":"2023-11-28T20:07:43.124333+0000","last_peered":"2023-11-28T20:07:43.124333+0000","last_clean":"2023-11-28T20:07:43.124333+0000","last_became_active":"2023-11-28T20:07:42.123350+0000","last_became_peered":"2023-11-28T20:07:42.123350+0000","last_unstale":"2023-11-28T20:07:43.124333+0000","last_undegraded":"2023-11-28T20:07:43.124333+0000","last_fullsized":"2023-11-28T20:07:43.124333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.136860+0000","last_change":"2023-11-28T20:07:42.127778+0000","last_active":"2023-11-28T20:07:42.136860+0000","last_peered":"2023-11-28T20:07:42.136860+0000","last_clean":"2023-11-28T20:07:42.136860+0000","last_became_active":"2023-11-28T20:07:42.127127+0000","last_became_peered":"2023-11-28T20:07:42.127127+0000","last_unstale":"2023-11-28T20:07:42.136860+0000","last_undegraded":"2023-11-28T20:07:42.136860+0000","last_fullsized":"2023-11-28T20:07:42.136860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:28.240493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.249177+0000","last_change":"2023-11-28T20:07:41.132264+0000","last_active":"2023-11-28T20:07:42.249177+0000","last_peered":"2023-11-28T20:07:42.249177+0000","last_clean":"2023-11-28T20:07:42.249177+0000","last_became_active":"2023-11-28T20:07:41.131858+0000","last_became_peered":"2023-11-28T20:07:41.131858+0000","last_unstale":"2023-11-28T20:07:42.249177+0000","last_undegraded":"2023-11-28T20:07:42.249177+0000","last_fullsized":"2023-11-28T20:07:42.249177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.136756+0000","last_change":"2023-11-28T20:07:42.125457+0000","last_active":"2023-11-28T20:07:42.136756+0000","last_peered":"2023-11-28T20:07:42.136756+0000","last_clean":"2023-11-28T20:07:42.136756+0000","last_became_active":"2023-11-28T20:07:42.125082+0000","last_became_peered":"2023-11-28T20:07:42.125082+0000","last_unstale":"2023-11-28T20:07:42.136756+0000","last_undegraded":"2023-11-28T20:07:42.136756+0000","last_fullsized":"2023-11-28T20:07:42.136756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:18.500544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.248624+0000","last_change":"2023-11-28T20:07:41.126423+0000","last_active":"2023-11-28T20:07:42.248624+0000","last_peered":"2023-11-28T20:07:42.248624+0000","last_clean":"2023-11-28T20:07:42.248624+0000","last_became_active":"2023-11-28T20:07:41.126053+0000","last_became_peered":"2023-11-28T20:07:41.126053+0000","last_unstale":"2023-11-28T20:07:42.248624+0000","last_undegraded":"2023-11-28T20:07:42.248624+0000","last_fullsized":"2023-11-28T20:07:42.248624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108551+0000","last_change":"2023-11-28T20:07:42.137656+0000","last_active":"2023-11-28T20:07:43.108551+0000","last_peered":"2023-11-28T20:07:43.108551+0000","last_clean":"2023-11-28T20:07:43.108551+0000","last_became_active":"2023-11-28T20:07:42.137370+0000","last_became_peered":"2023-11-28T20:07:42.137370+0000","last_unstale":"2023-11-28T20:07:43.108551+0000","last_undegraded":"2023-11-28T20:07:43.108551+0000","last_fullsized":"2023-11-28T20:07:43.108551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109645+0000","last_change":"2023-11-28T20:07:41.120883+0000","last_active":"2023-11-28T20:07:43.109645+0000","last_peered":"2023-11-28T20:07:43.109645+0000","last_clean":"2023-11-28T20:07:43.109645+0000","last_became_active":"2023-11-28T20:07:41.120623+0000","last_became_peered":"2023-11-28T20:07:41.120623+0000","last_unstale":"2023-11-28T20:07:43.109645+0000","last_undegraded":"2023-11-28T20:07:43.109645+0000","last_fullsized":"2023-11-28T20:07:43.109645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109672+0000","last_change":"2023-11-28T20:07:42.120123+0000","last_active":"2023-11-28T20:07:43.109672+0000","last_peered":"2023-11-28T20:07:43.109672+0000","last_clean":"2023-11-28T20:07:43.109672+0000","last_became_active":"2023-11-28T20:07:42.119516+0000","last_became_peered":"2023-11-28T20:07:42.119516+0000","last_unstale":"2023-11-28T20:07:43.109672+0000","last_undegraded":"2023-11-28T20:07:43.109672+0000","last_fullsized":"2023-11-28T20:07:43.109672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108702+0000","last_change":"2023-11-28T20:07:41.121501+0000","last_active":"2023-11-28T20:07:43.108702+0000","last_peered":"2023-11-28T20:07:43.108702+0000","last_clean":"2023-11-28T20:07:43.108702+0000","last_became_active":"2023-11-28T20:07:41.121213+0000","last_became_peered":"2023-11-28T20:07:41.121213+0000","last_unstale":"2023-11-28T20:07:43.108702+0000","last_undegraded":"2023-11-28T20:07:43.108702+0000","last_fullsized":"2023-11-28T20:07:43.108702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":64736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":64770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:07:46.682 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T20:07:46.682 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-28T20:07:46.682 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-28T20:07:46.682 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-28T20:07:46.683 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-28T20:07:46.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97ddcc9640 1 Processor -- start 2023-11-28T20:07:46.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97ddcc9640 1 -- start start 2023-11-28T20:07:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97ddcc9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97d80b35b0 0x7f97d80d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97ddcc9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f97d80b3c70 0x7f97d815f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97ddcc9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f97d80cf780 0x7f97d80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97ddcc9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d80d4090 con 0x7f97d80b3c70 2023-11-28T20:07:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97ddcc9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d80d0130 con 0x7f97d80cf780 2023-11-28T20:07:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97ddcc9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80d3880 con 0x7f97d80b35b0 2023-11-28T20:07:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97d6ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f97d80b3c70 0x7f97d815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97d6ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f97d80b3c70 0x7f97d815f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52650/0 (socket says 172.21.15.177:52650) 2023-11-28T20:07:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97d6ffd640 1 -- 172.21.15.177:0/2093821240 learned_addr learned my addr 172.21.15.177:0/2093821240 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:46.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97d6ffd640 1 -- 172.21.15.177:0/2093821240 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97d80b35b0 msgr2=0x7f97d80d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:46.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97d6ffd640 1 --2- 172.21.15.177:0/2093821240 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97d80b35b0 0x7f97d80d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97d6ffd640 1 -- 172.21.15.177:0/2093821240 >> v2:172.21.15.195:3300/0 conn(0x7f97d80cf780 msgr2=0x7f97d80cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:46.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97d6ffd640 1 --2- 172.21.15.177:0/2093821240 >> v2:172.21.15.195:3300/0 conn(0x7f97d80cf780 0x7f97d80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.856+0000 7f97d6ffd640 1 -- 172.21.15.177:0/2093821240 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d80cdc80 con 0x7f97d80b3c70 2023-11-28T20:07:46.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.860+0000 7f97d6ffd640 1 --2- 172.21.15.177:0/2093821240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97d80b3c70 0x7f97d815f060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f97d808c5e0 tx=0x7f97cc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87f2ec289b469df server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:46.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.860+0000 7f97d67fc640 1 -- 172.21.15.177:0/2093821240 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0aa620 con 0x7f97d80b3c70 2023-11-28T20:07:46.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.860+0000 7f97d67fc640 1 -- 172.21.15.177:0/2093821240 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc0aa780 con 0x7f97d80b3c70 2023-11-28T20:07:46.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.860+0000 7f97d67fc640 1 -- 172.21.15.177:0/2093821240 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0aab10 con 0x7f97d80b3c70 2023-11-28T20:07:46.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.860+0000 7f97ddcc9640 1 -- 172.21.15.177:0/2093821240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97d80b3c70 msgr2=0x7f97d815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:46.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.860+0000 7f97ddcc9640 1 --2- 172.21.15.177:0/2093821240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97d80b3c70 0x7f97d815f060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f97d808c5e0 tx=0x7f97cc01c500 comp rx=0 tx=0).stop 2023-11-28T20:07:46.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.860+0000 7f97ddcc9640 1 -- 172.21.15.177:0/2093821240 shutdown_connections 2023-11-28T20:07:46.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.860+0000 7f97ddcc9640 1 --2- 172.21.15.177:0/2093821240 >> v2:172.21.15.195:3300/0 conn(0x7f97d80cf780 0x7f97d80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.860+0000 7f97ddcc9640 1 --2- 172.21.15.177:0/2093821240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97d80b3c70 0x7f97d815f060 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.860+0000 7f97ddcc9640 1 --2- 172.21.15.177:0/2093821240 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97d80b35b0 0x7f97d80d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.860+0000 7f97ddcc9640 1 -- 172.21.15.177:0/2093821240 >> 172.21.15.177:0/2093821240 conn(0x7f97d809c4b0 msgr2=0x7f97d80d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:46.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.860+0000 7f97ddcc9640 1 -- 172.21.15.177:0/2093821240 shutdown_connections 2023-11-28T20:07:46.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.860+0000 7f97ddcc9640 1 -- 172.21.15.177:0/2093821240 wait complete. 2023-11-28T20:07:46.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.860+0000 7f97ddcc9640 1 Processor -- start 2023-11-28T20:07:46.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97ddcc9640 1 -- start start 2023-11-28T20:07:46.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97ddcc9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97d80b35b0 0x7f97d814ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97ddcc9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97d80b3c70 0x7f97d8157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97ddcc9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97d80cf780 0x7f97d8159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97ddcc9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d815afc0 con 0x7f97d80b3c70 2023-11-28T20:07:46.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97ddcc9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d8156650 con 0x7f97d80b35b0 2023-11-28T20:07:46.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97ddcc9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d815aa00 con 0x7f97d80cf780 2023-11-28T20:07:46.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97d6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97d80b3c70 0x7f97d8157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:46.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97d6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97d80b3c70 0x7f97d8157160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52662/0 (socket says 172.21.15.177:52662) 2023-11-28T20:07:46.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97d6ffd640 1 -- 172.21.15.177:0/3163499236 learned_addr learned my addr 172.21.15.177:0/3163499236 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:46.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97d77fe640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97d80b35b0 0x7f97d814ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:46.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97d6ffd640 1 -- 172.21.15.177:0/3163499236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97d80cf780 msgr2=0x7f97d8159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:46.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97d7fff640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97d80cf780 0x7f97d8159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:46.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97d6ffd640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97d80cf780 0x7f97d8159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97d6ffd640 1 -- 172.21.15.177:0/3163499236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97d80b35b0 msgr2=0x7f97d814ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:46.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97d6ffd640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97d80b35b0 0x7f97d814ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:46.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97d6ffd640 1 -- 172.21.15.177:0/3163499236 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc0094d0 con 0x7f97d80b3c70 2023-11-28T20:07:46.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97d77fe640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97d80b35b0 0x7f97d814ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:46.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97d7fff640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97d80cf780 0x7f97d8159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:46.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97d6ffd640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97d80b3c70 0x7f97d8157160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f97cc0ac040 tx=0x7f97cc01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:46.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97bffff640 1 -- 172.21.15.177:0/3163499236 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0bd5f0 con 0x7f97d80b3c70 2023-11-28T20:07:46.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97bffff640 1 -- 172.21.15.177:0/3163499236 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc0bd770 con 0x7f97d80b3c70 2023-11-28T20:07:46.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97bffff640 1 -- 172.21.15.177:0/3163499236 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0bdb20 con 0x7f97d80b3c70 2023-11-28T20:07:46.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97ddcc9640 1 -- 172.21.15.177:0/3163499236 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d815ace0 con 0x7f97d80b3c70 2023-11-28T20:07:46.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97ddcc9640 1 -- 172.21.15.177:0/3163499236 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d814f200 con 0x7f97d80b3c70 2023-11-28T20:07:46.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.864+0000 7f97ddcc9640 1 -- 172.21.15.177:0/3163499236 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d815ab40 con 0x7f97d80b3c70 2023-11-28T20:07:46.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.868+0000 7f97bffff640 1 -- 172.21.15.177:0/3163499236 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f97cc0b33f0 con 0x7f97d80b3c70 2023-11-28T20:07:46.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.868+0000 7f97bffff640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97c4066470 0x7f97c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:46.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.868+0000 7f97bffff640 1 -- 172.21.15.177:0/3163499236 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97cc11e8f0 con 0x7f97d80b3c70 2023-11-28T20:07:46.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.868+0000 7f97d77fe640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97c4066470 0x7f97c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:46.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.868+0000 7f97d77fe640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97c4066470 0x7f97c4068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97d815a990 tx=0x7f97c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:46.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:46.872+0000 7f97bffff640 1 -- 172.21.15.177:0/3163499236 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97d815ab40 con 0x7f97d80b3c70 2023-11-28T20:07:47.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.056+0000 7f97ddcc9640 1 -- 172.21.15.177:0/3163499236 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f97d815ab40 con 0x7f97d80b3c70 2023-11-28T20:07:47.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.060+0000 7f97bffff640 1 -- 172.21.15.177:0/3163499236 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164439 (secure 0 0 0) 0x7f97d815ab40 con 0x7f97d80b3c70 2023-11-28T20:07:47.066 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:47.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.064+0000 7f97ddcc9640 1 -- 172.21.15.177:0/3163499236 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97c4066470 msgr2=0x7f97c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:47.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.064+0000 7f97ddcc9640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97c4066470 0x7f97c4068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97d815a990 tx=0x7f97c8008040 comp rx=0 tx=0).stop 2023-11-28T20:07:47.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.064+0000 7f97ddcc9640 1 -- 172.21.15.177:0/3163499236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97d80b3c70 msgr2=0x7f97d8157160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:47.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.064+0000 7f97ddcc9640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97d80b3c70 0x7f97d8157160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f97cc0ac040 tx=0x7f97cc01ad40 comp rx=0 tx=0).stop 2023-11-28T20:07:47.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.064+0000 7f97ddcc9640 1 -- 172.21.15.177:0/3163499236 shutdown_connections 2023-11-28T20:07:47.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.064+0000 7f97ddcc9640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97c4066470 0x7f97c4068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.064+0000 7f97ddcc9640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97d80cf780 0x7f97d8159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.064+0000 7f97ddcc9640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97d80b3c70 0x7f97d8157160 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.064+0000 7f97ddcc9640 1 --2- 172.21.15.177:0/3163499236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97d80b35b0 0x7f97d814ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.064+0000 7f97ddcc9640 1 -- 172.21.15.177:0/3163499236 >> 172.21.15.177:0/3163499236 conn(0x7f97d809c4b0 msgr2=0x7f97d80b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:47.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.064+0000 7f97ddcc9640 1 -- 172.21.15.177:0/3163499236 shutdown_connections 2023-11-28T20:07:47.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.064+0000 7f97ddcc9640 1 -- 172.21.15.177:0/3163499236 wait complete. 2023-11-28T20:07:47.086 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":5,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2011209269},{"type":"v1","addr":"172.21.15.177:6833","nonce":2011209269}]},"active_addr":"172.21.15.177:6833/2011209269","active_change":"2023-11-28T20:07:21.404669+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":2210468085}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":1432806104}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":1981623189}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":1692062075}]}]} 2023-11-28T20:07:47.089 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-28T20:07:47.090 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-28T20:07:47.090 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:07:47.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.224+0000 7fd6d9a54640 1 Processor -- start 2023-11-28T20:07:47.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.224+0000 7fd6d9a54640 1 -- start start 2023-11-28T20:07:47.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.224+0000 7fd6d9a54640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6d406c9d0 0x7fd6d415a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.224+0000 7fd6d9a54640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd6d415ab70 0x7fd6d40cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.224+0000 7fd6d9a54640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d415b3a0 con 0x7fd6d413cf30 2023-11-28T20:07:47.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.224+0000 7fd6d9a54640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d413d310 con 0x7fd6d415ab70 2023-11-28T20:07:47.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.224+0000 7fd6d9a54640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d41404e0 con 0x7fd6d406c9d0 2023-11-28T20:07:47.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.224+0000 7fd6d37fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd6d415ab70 0x7fd6d40cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:47.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.224+0000 7fd6d37fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd6d415ab70 0x7fd6d40cd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52678/0 (socket says 172.21.15.177:52678) 2023-11-28T20:07:47.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.224+0000 7fd6d37fe640 1 -- 172.21.15.177:0/3134199477 learned_addr learned my addr 172.21.15.177:0/3134199477 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:47.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.224+0000 7fd6ca7fc640 1 --2- 172.21.15.177:0/3134199477 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6d406c9d0 0x7fd6d415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:47.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.224+0000 7fd6d37fe640 1 -- 172.21.15.177:0/3134199477 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6d406c9d0 msgr2=0x7fd6d415a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:47.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.224+0000 7fd6d37fe640 1 --2- 172.21.15.177:0/3134199477 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6d406c9d0 0x7fd6d415a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.224+0000 7fd6d37fe640 1 -- 172.21.15.177:0/3134199477 >> v1:172.21.15.195:6789/0 conn(0x7fd6d413cf30 legacy=0x7fd6d406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:47.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.224+0000 7fd6d37fe640 1 -- 172.21.15.177:0/3134199477 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d413f720 con 0x7fd6d415ab70 2023-11-28T20:07:47.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.228+0000 7fd6d37fe640 1 --2- 172.21.15.177:0/3134199477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d415ab70 0x7fd6d40cd880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009870 tx=0x7fd6cc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8eea58073b059b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:47.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.228+0000 7fd6d27fc640 1 -- 172.21.15.177:0/3134199477 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0ab680 con 0x7fd6d415ab70 2023-11-28T20:07:47.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.228+0000 7fd6d27fc640 1 -- 172.21.15.177:0/3134199477 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc0ab7e0 con 0x7fd6d415ab70 2023-11-28T20:07:47.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.228+0000 7fd6d27fc640 1 -- 172.21.15.177:0/3134199477 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0abb70 con 0x7fd6d415ab70 2023-11-28T20:07:47.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.228+0000 7fd6d9a54640 1 -- 172.21.15.177:0/3134199477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d415ab70 msgr2=0x7fd6d40cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:47.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.228+0000 7fd6d9a54640 1 --2- 172.21.15.177:0/3134199477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d415ab70 0x7fd6d40cd880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009870 tx=0x7fd6cc01c480 comp rx=0 tx=0).stop 2023-11-28T20:07:47.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.228+0000 7fd6d9a54640 1 -- 172.21.15.177:0/3134199477 shutdown_connections 2023-11-28T20:07:47.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.228+0000 7fd6d9a54640 1 --2- 172.21.15.177:0/3134199477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d415ab70 0x7fd6d40cd880 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.228+0000 7fd6d9a54640 1 --2- 172.21.15.177:0/3134199477 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6d406c9d0 0x7fd6d415a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.228+0000 7fd6d9a54640 1 -- 172.21.15.177:0/3134199477 >> 172.21.15.177:0/3134199477 conn(0x7fd6d406a530 msgr2=0x7fd6d406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:47.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.228+0000 7fd6d9a54640 1 -- 172.21.15.177:0/3134199477 shutdown_connections 2023-11-28T20:07:47.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.228+0000 7fd6d9a54640 1 -- 172.21.15.177:0/3134199477 wait complete. 2023-11-28T20:07:47.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d9a54640 1 Processor -- start 2023-11-28T20:07:47.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d9a54640 1 -- start start 2023-11-28T20:07:47.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d9a54640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d406c9d0 0x7fd6d4157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d9a54640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6d413cf30 0x7fd6d4158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d9a54640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6d415ab70 0x7fd6d4158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d9a54640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4155de0 con 0x7fd6d406c9d0 2023-11-28T20:07:47.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d9a54640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4157840 con 0x7fd6d413cf30 2023-11-28T20:07:47.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d9a54640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4159620 con 0x7fd6d415ab70 2023-11-28T20:07:47.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d406c9d0 0x7fd6d4157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:47.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d406c9d0 0x7fd6d4157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52694/0 (socket says 172.21.15.177:52694) 2023-11-28T20:07:47.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d2ffd640 1 -- 172.21.15.177:0/2808929666 learned_addr learned my addr 172.21.15.177:0/2808929666 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:47.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6ca7fc640 1 --2- 172.21.15.177:0/2808929666 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6d413cf30 0x7fd6d4158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:47.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d37fe640 1 --2- 172.21.15.177:0/2808929666 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6d415ab70 0x7fd6d4158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:47.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d2ffd640 1 -- 172.21.15.177:0/2808929666 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6d415ab70 msgr2=0x7fd6d4158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:47.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d2ffd640 1 --2- 172.21.15.177:0/2808929666 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6d415ab70 0x7fd6d4158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d2ffd640 1 -- 172.21.15.177:0/2808929666 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6d413cf30 msgr2=0x7fd6d4158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:47.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d2ffd640 1 --2- 172.21.15.177:0/2808929666 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6d413cf30 0x7fd6d4158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d2ffd640 1 -- 172.21.15.177:0/2808929666 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc0094d0 con 0x7fd6d406c9d0 2023-11-28T20:07:47.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d2ffd640 1 --2- 172.21.15.177:0/2808929666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d406c9d0 0x7fd6d4157300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400c500 tx=0x7fd6c400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:47.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d0ff9640 1 -- 172.21.15.177:0/2808929666 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4005220 con 0x7fd6d406c9d0 2023-11-28T20:07:47.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d0ff9640 1 -- 172.21.15.177:0/2808929666 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c4005380 con 0x7fd6d406c9d0 2023-11-28T20:07:47.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d0ff9640 1 -- 172.21.15.177:0/2808929666 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4007270 con 0x7fd6d406c9d0 2023-11-28T20:07:47.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d9a54640 1 -- 172.21.15.177:0/2808929666 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d41555e0 con 0x7fd6d406c9d0 2023-11-28T20:07:47.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d9a54640 1 -- 172.21.15.177:0/2808929666 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d4159900 con 0x7fd6d406c9d0 2023-11-28T20:07:47.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.232+0000 7fd6d9a54640 1 -- 172.21.15.177:0/2808929666 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d4069440 con 0x7fd6d406c9d0 2023-11-28T20:07:47.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.236+0000 7fd6d0ff9640 1 -- 172.21.15.177:0/2808929666 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd6c40073d0 con 0x7fd6d406c9d0 2023-11-28T20:07:47.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.236+0000 7fd6d0ff9640 1 --2- 172.21.15.177:0/2808929666 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd6b4066470 0x7fd6b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.236+0000 7fd6d0ff9640 1 -- 172.21.15.177:0/2808929666 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6c4083800 con 0x7fd6d406c9d0 2023-11-28T20:07:47.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.236+0000 7fd6ca7fc640 1 --2- 172.21.15.177:0/2808929666 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd6b4066470 0x7fd6b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:47.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.236+0000 7fd6ca7fc640 1 --2- 172.21.15.177:0/2808929666 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd6b4066470 0x7fd6b4068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4158130 tx=0x7fd6bc00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:47.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.240+0000 7fd6d0ff9640 1 -- 172.21.15.177:0/2808929666 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd6c4050bf0 con 0x7fd6d406c9d0 2023-11-28T20:07:47.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.392+0000 7fd6d9a54640 1 -- 172.21.15.177:0/2808929666 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6d41553d0 con 0x7fd6d406c9d0 2023-11-28T20:07:47.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.392+0000 7fd6d0ff9640 1 -- 172.21.15.177:0/2808929666 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7fd6c4054210 con 0x7fd6d406c9d0 2023-11-28T20:07:47.397 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:47.398 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:07:47.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.396+0000 7fd6d9a54640 1 -- 172.21.15.177:0/2808929666 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd6b4066470 msgr2=0x7fd6b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:47.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.396+0000 7fd6d9a54640 1 --2- 172.21.15.177:0/2808929666 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd6b4066470 0x7fd6b4068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4158130 tx=0x7fd6bc00b040 comp rx=0 tx=0).stop 2023-11-28T20:07:47.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.396+0000 7fd6d9a54640 1 -- 172.21.15.177:0/2808929666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d406c9d0 msgr2=0x7fd6d4157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:47.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.396+0000 7fd6d9a54640 1 --2- 172.21.15.177:0/2808929666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d406c9d0 0x7fd6d4157300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400c500 tx=0x7fd6c400c9c0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.396+0000 7fd6d9a54640 1 -- 172.21.15.177:0/2808929666 shutdown_connections 2023-11-28T20:07:47.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.396+0000 7fd6d9a54640 1 --2- 172.21.15.177:0/2808929666 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd6b4066470 0x7fd6b4068930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.396+0000 7fd6d9a54640 1 --2- 172.21.15.177:0/2808929666 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6d415ab70 0x7fd6d4158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.396+0000 7fd6d9a54640 1 --2- 172.21.15.177:0/2808929666 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6d413cf30 0x7fd6d4158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.396+0000 7fd6d9a54640 1 --2- 172.21.15.177:0/2808929666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d406c9d0 0x7fd6d4157300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.396+0000 7fd6d9a54640 1 -- 172.21.15.177:0/2808929666 >> 172.21.15.177:0/2808929666 conn(0x7fd6d406a530 msgr2=0x7fd6d406c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:47.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.396+0000 7fd6d9a54640 1 -- 172.21.15.177:0/2808929666 shutdown_connections 2023-11-28T20:07:47.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.396+0000 7fd6d9a54640 1 -- 172.21.15.177:0/2808929666 wait complete. 2023-11-28T20:07:47.418 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-28T20:07:47.419 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:07:47.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.552+0000 7f83a16ea640 1 Processor -- start 2023-11-28T20:07:47.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.552+0000 7f83a16ea640 1 -- start start 2023-11-28T20:07:47.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.552+0000 7f83a16ea640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f839c0cdc20 0x7f839c15b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.552+0000 7f83a16ea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f839c0ce000 0x7f839c15f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.552+0000 7f83a16ea640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f839c15f8e0 0x7f839c155050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.552+0000 7f83a16ea640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839c13e380 con 0x7f839c15f8e0 2023-11-28T20:07:47.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.552+0000 7f83a16ea640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839c15be50 con 0x7f839c0cdc20 2023-11-28T20:07:47.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.552+0000 7f83a16ea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839c15c130 con 0x7f839c0ce000 2023-11-28T20:07:47.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.552+0000 7f839b7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f839c15f8e0 0x7f839c155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:47.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.552+0000 7f839b7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f839c15f8e0 0x7f839c155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52702/0 (socket says 172.21.15.177:52702) 2023-11-28T20:07:47.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.552+0000 7f839b7fe640 1 -- 172.21.15.177:0/2926710565 learned_addr learned my addr 172.21.15.177:0/2926710565 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:47.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.556+0000 7f839affd640 1 --2- 172.21.15.177:0/2926710565 >> v2:172.21.15.195:3300/0 conn(0x7f839c0cdc20 0x7f839c15b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:47.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.556+0000 7f8393fff640 1 --2- 172.21.15.177:0/2926710565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f839c0ce000 0x7f839c15f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:47.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.556+0000 7f839b7fe640 1 -- 172.21.15.177:0/2926710565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f839c0ce000 msgr2=0x7f839c15f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:47.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.556+0000 7f839b7fe640 1 --2- 172.21.15.177:0/2926710565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f839c0ce000 0x7f839c15f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.556+0000 7f839b7fe640 1 -- 172.21.15.177:0/2926710565 >> v2:172.21.15.195:3300/0 conn(0x7f839c0cdc20 msgr2=0x7f839c15b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:47.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.556+0000 7f839b7fe640 1 --2- 172.21.15.177:0/2926710565 >> v2:172.21.15.195:3300/0 conn(0x7f839c0cdc20 0x7f839c15b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.556+0000 7f839b7fe640 1 -- 172.21.15.177:0/2926710565 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c15c410 con 0x7f839c15f8e0 2023-11-28T20:07:47.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.556+0000 7f8393fff640 1 --2- 172.21.15.177:0/2926710565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f839c0ce000 0x7f839c15f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:47.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.556+0000 7f839affd640 1 --2- 172.21.15.177:0/2926710565 >> v2:172.21.15.195:3300/0 conn(0x7f839c0cdc20 0x7f839c15b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:47.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.556+0000 7f839b7fe640 1 --2- 172.21.15.177:0/2926710565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f839c15f8e0 0x7f839c155050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f839c0b41e0 tx=0x7f839401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8211379668a3bce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:47.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.556+0000 7f839a7fc640 1 -- 172.21.15.177:0/2926710565 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940a5650 con 0x7f839c15f8e0 2023-11-28T20:07:47.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.556+0000 7f839a7fc640 1 -- 172.21.15.177:0/2926710565 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83940a57b0 con 0x7f839c15f8e0 2023-11-28T20:07:47.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.556+0000 7f839a7fc640 1 -- 172.21.15.177:0/2926710565 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940a5b40 con 0x7f839c15f8e0 2023-11-28T20:07:47.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 -- 172.21.15.177:0/2926710565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f839c15f8e0 msgr2=0x7f839c155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:47.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 --2- 172.21.15.177:0/2926710565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f839c15f8e0 0x7f839c155050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f839c0b41e0 tx=0x7f839401c9d0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 -- 172.21.15.177:0/2926710565 shutdown_connections 2023-11-28T20:07:47.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 --2- 172.21.15.177:0/2926710565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f839c15f8e0 0x7f839c155050 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 --2- 172.21.15.177:0/2926710565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f839c0ce000 0x7f839c15f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 --2- 172.21.15.177:0/2926710565 >> v2:172.21.15.195:3300/0 conn(0x7f839c0cdc20 0x7f839c15b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 -- 172.21.15.177:0/2926710565 >> 172.21.15.177:0/2926710565 conn(0x7f839c06a530 msgr2=0x7f839c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:47.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 -- 172.21.15.177:0/2926710565 shutdown_connections 2023-11-28T20:07:47.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 -- 172.21.15.177:0/2926710565 wait complete. 2023-11-28T20:07:47.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 Processor -- start 2023-11-28T20:07:47.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 -- start start 2023-11-28T20:07:47.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f839c0cdc20 0x7f839c0b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f839c0ce000 0x7f839c166060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f839c15f8e0 0x7f839c13ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c14f260 con 0x7f839c0ce000 2023-11-28T20:07:47.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c164470 con 0x7f839c15f8e0 2023-11-28T20:07:47.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f83a16ea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839c164750 con 0x7f839c0cdc20 2023-11-28T20:07:47.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f8393fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f839c0ce000 0x7f839c166060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:47.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f839affd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f839c0cdc20 0x7f839c0b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:47.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f8393fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f839c0ce000 0x7f839c166060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52716/0 (socket says 172.21.15.177:52716) 2023-11-28T20:07:47.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f8393fff640 1 -- 172.21.15.177:0/1846746237 learned_addr learned my addr 172.21.15.177:0/1846746237 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:47.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f839b7fe640 1 --2- 172.21.15.177:0/1846746237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f839c15f8e0 0x7f839c13ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:47.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f8393fff640 1 -- 172.21.15.177:0/1846746237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f839c0cdc20 msgr2=0x7f839c0b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:47.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f8393fff640 1 --2- 172.21.15.177:0/1846746237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f839c0cdc20 0x7f839c0b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f8393fff640 1 -- 172.21.15.177:0/1846746237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f839c15f8e0 msgr2=0x7f839c13ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:47.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f8393fff640 1 --2- 172.21.15.177:0/1846746237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f839c15f8e0 0x7f839c13ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f8393fff640 1 -- 172.21.15.177:0/1846746237 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8394009b30 con 0x7f839c0ce000 2023-11-28T20:07:47.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.560+0000 7f839b7fe640 1 --2- 172.21.15.177:0/1846746237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f839c15f8e0 0x7f839c13ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:47.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.564+0000 7f8393fff640 1 --2- 172.21.15.177:0/1846746237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f839c0ce000 0x7f839c166060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f838400d800 tx=0x7f838400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:47.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.564+0000 7f83937fe640 1 -- 172.21.15.177:0/1846746237 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838400b6c0 con 0x7f839c0ce000 2023-11-28T20:07:47.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.564+0000 7f83937fe640 1 -- 172.21.15.177:0/1846746237 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838400b820 con 0x7f839c0ce000 2023-11-28T20:07:47.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.564+0000 7f83937fe640 1 -- 172.21.15.177:0/1846746237 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838400bbd0 con 0x7f839c0ce000 2023-11-28T20:07:47.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.564+0000 7f83a16ea640 1 -- 172.21.15.177:0/1846746237 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839c14ec10 con 0x7f839c0ce000 2023-11-28T20:07:47.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.564+0000 7f83a16ea640 1 -- 172.21.15.177:0/1846746237 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839c0b5f30 con 0x7f839c0ce000 2023-11-28T20:07:47.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.564+0000 7f83a16ea640 1 -- 172.21.15.177:0/1846746237 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839c14f3d0 con 0x7f839c0ce000 2023-11-28T20:07:47.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.564+0000 7f83937fe640 1 -- 172.21.15.177:0/1846746237 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f838400bd30 con 0x7f839c0ce000 2023-11-28T20:07:47.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.564+0000 7f83937fe640 1 --2- 172.21.15.177:0/1846746237 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f837c066470 0x7f837c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.564+0000 7f83937fe640 1 -- 172.21.15.177:0/1846746237 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8384084300 con 0x7f839c0ce000 2023-11-28T20:07:47.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.564+0000 7f839affd640 1 --2- 172.21.15.177:0/1846746237 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f837c066470 0x7f837c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:47.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.564+0000 7f839affd640 1 --2- 172.21.15.177:0/1846746237 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f837c066470 0x7f837c068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f839c14e8b0 tx=0x7f838c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:47.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.568+0000 7f83937fe640 1 -- 172.21.15.177:0/1846746237 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f83840516e0 con 0x7f839c0ce000 2023-11-28T20:07:47.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.716+0000 7f83a16ea640 1 -- 172.21.15.177:0/1846746237 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f839c069440 con 0x7f839c0ce000 2023-11-28T20:07:47.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.720+0000 7f83937fe640 1 -- 172.21.15.177:0/1846746237 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f8384054d00 con 0x7f839c0ce000 2023-11-28T20:07:47.723 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:47.724 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:07:47.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.720+0000 7f83a16ea640 1 -- 172.21.15.177:0/1846746237 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f837c066470 msgr2=0x7f837c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:47.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.720+0000 7f83a16ea640 1 --2- 172.21.15.177:0/1846746237 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f837c066470 0x7f837c068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f839c14e8b0 tx=0x7f838c008040 comp rx=0 tx=0).stop 2023-11-28T20:07:47.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.720+0000 7f83a16ea640 1 -- 172.21.15.177:0/1846746237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f839c0ce000 msgr2=0x7f839c166060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:47.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.720+0000 7f83a16ea640 1 --2- 172.21.15.177:0/1846746237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f839c0ce000 0x7f839c166060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f838400d800 tx=0x7f838400dcc0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.720+0000 7f83a16ea640 1 -- 172.21.15.177:0/1846746237 shutdown_connections 2023-11-28T20:07:47.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.720+0000 7f83a16ea640 1 --2- 172.21.15.177:0/1846746237 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f837c066470 0x7f837c068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.720+0000 7f83a16ea640 1 --2- 172.21.15.177:0/1846746237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f839c15f8e0 0x7f839c13ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.720+0000 7f83a16ea640 1 --2- 172.21.15.177:0/1846746237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f839c0ce000 0x7f839c166060 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.720+0000 7f83a16ea640 1 --2- 172.21.15.177:0/1846746237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f839c0cdc20 0x7f839c0b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.720+0000 7f83a16ea640 1 -- 172.21.15.177:0/1846746237 >> 172.21.15.177:0/1846746237 conn(0x7f839c06a530 msgr2=0x7f839c15a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:47.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.720+0000 7f83a16ea640 1 -- 172.21.15.177:0/1846746237 shutdown_connections 2023-11-28T20:07:47.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.720+0000 7f83a16ea640 1 -- 172.21.15.177:0/1846746237 wait complete. 2023-11-28T20:07:47.745 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-28T20:07:47.745 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-28T20:07:47.746 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-28T20:07:47.746 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-28T20:07:47.747 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-28T20:07:47.747 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-28T20:07:47.748 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-28T20:07:47.749 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-28T20:07:47.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.988+0000 7fd52759e640 1 Processor -- start 2023-11-28T20:07:47.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.988+0000 7f56faba7640 1 Processor -- start 2023-11-28T20:07:47.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7fd52759e640 1 -- start start 2023-11-28T20:07:47.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7f56faba7640 1 -- start start 2023-11-28T20:07:47.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7fbdf9965640 1 Processor -- start 2023-11-28T20:07:47.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7fd52759e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5200076e0 0x7fd520038420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7fd52759e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd520006890 0x7fd5200e7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7fd52759e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5200e1f40 con 0x7fd520057ae0 2023-11-28T20:07:47.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7f56faba7640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f56f4158f50 0x7f56f4159330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7fd52759e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd520007ac0 con 0x7fd520006890 2023-11-28T20:07:47.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7fd52759e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd520056a80 con 0x7fd5200076e0 2023-11-28T20:07:47.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7f56faba7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f40b1c20 con 0x7f56f406e210 2023-11-28T20:07:47.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7fd526d9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd520006890 0x7fd5200e7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:47.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7fd526d9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd520006890 0x7fd5200e7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53228/0 (socket says 172.21.15.177:53228) 2023-11-28T20:07:47.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7fd526d9d640 1 -- 172.21.15.177:0/3664278628 learned_addr learned my addr 172.21.15.177:0/3664278628 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:47.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7f56fa3a6640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f56f40b3ca0 0x7f56f415cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:41254/0 (socket says 172.21.15.177:41254) 2023-11-28T20:07:47.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7f56fa3a6640 1 -- 172.21.15.177:0/2636925772 learned_addr learned my addr 172.21.15.177:0/2636925772 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:47.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7fd526d9d640 1 -- 172.21.15.177:0/3664278628 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5200076e0 msgr2=0x7fd520038420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T20:07:47.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7fd526d9d640 1 --2- 172.21.15.177:0/3664278628 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5200076e0 0x7fd520038420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:47.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7fd526d9d640 1 -- 172.21.15.177:0/3664278628 >> v1:172.21.15.195:6789/0 conn(0x7fd520057ae0 legacy=0x7fd520006180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:47.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7fbdf9965640 1 -- start start 2023-11-28T20:07:47.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7fbdf9965640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdf40724a0 0x7fbdf4159490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:47.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7fbdf9965640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf4072940 con 0x7fbdf41590b0 2023-11-28T20:07:48.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7fbdf9965640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf40b3620 con 0x7fbdf40d0b60 2023-11-28T20:07:48.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7fbdf9965640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40b3900 con 0x7fbdf40724a0 2023-11-28T20:07:48.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7f56f9ba5640 1 --2- 172.21.15.177:0/2636925772 >> v2:172.21.15.195:3300/0 conn(0x7f56f4158f50 0x7f56f4159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.992+0000 7f56faba7640 1 -- 172.21.15.177:0/2636925772 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f406eb60 con 0x7f56f40b3ca0 2023-11-28T20:07:48.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7f56faba7640 1 -- 172.21.15.177:0/2636925772 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f4159910 con 0x7f56f4158f50 2023-11-28T20:07:48.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7fbdf2ffd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fbdf41590b0 0x7fbdf40d0450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:41884/0 (socket says 172.21.15.177:41884) 2023-11-28T20:07:48.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7fbdf2ffd640 1 -- 172.21.15.177:0/3617346923 learned_addr learned my addr 172.21.15.177:0/3617346923 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:48.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7f56f8ba3640 1 -- 172.21.15.177:0/2636925772 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903335568 0 0) 0x7f56f406eb60 con 0x7f56f40b3ca0 2023-11-28T20:07:48.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7f56f8ba3640 1 -- 172.21.15.177:0/2636925772 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56e0003530 con 0x7f56f40b3ca0 2023-11-28T20:07:48.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7fbdf27fc640 1 --2- 172.21.15.177:0/3617346923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdf40724a0 0x7fbdf4159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7f56f9ba5640 1 -- 172.21.15.177:0/2636925772 >> v1:172.21.15.195:6789/0 conn(0x7f56f40b3ca0 legacy=0x7f56f415cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7f56f9ba5640 1 -- 172.21.15.177:0/2636925772 >> v1:172.21.15.177:6789/0 conn(0x7f56f406e210 legacy=0x7f56f40b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7f56f9ba5640 1 -- 172.21.15.177:0/2636925772 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f4159bf0 con 0x7f56f4158f50 2023-11-28T20:07:48.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7fbdf1ffb640 1 -- 172.21.15.177:0/3617346923 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703758330 0 0) 0x7fbdf40b3620 con 0x7fbdf40d0b60 2023-11-28T20:07:48.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7fbdf1ffb640 1 -- 172.21.15.177:0/3617346923 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbddc003450 con 0x7fbdf40d0b60 2023-11-28T20:07:48.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7fbdf27fc640 1 -- 172.21.15.177:0/3617346923 >> v1:172.21.15.195:6789/0 conn(0x7fbdf40d0b60 legacy=0x7fbdf415cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7fbdf27fc640 1 -- 172.21.15.177:0/3617346923 >> v1:172.21.15.177:6789/0 conn(0x7fbdf41590b0 legacy=0x7fbdf40d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7fbdf27fc640 1 -- 172.21.15.177:0/3617346923 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf40b3be0 con 0x7fbdf40724a0 2023-11-28T20:07:48.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:47.996+0000 7fd526d9d640 1 -- 172.21.15.177:0/3664278628 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd520055700 con 0x7fd520006890 2023-11-28T20:07:48.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fd526d9d640 1 --2- 172.21.15.177:0/3664278628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd520006890 0x7fd5200e7a20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009870 tx=0x7fd51c01c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6ef3e88ce2af770 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7f0b88b96640 1 Processor -- start 2023-11-28T20:07:48.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fd52559a640 1 -- 172.21.15.177:0/3664278628 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0aa610 con 0x7fd520006890 2023-11-28T20:07:48.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fd52559a640 1 -- 172.21.15.177:0/3664278628 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c0a6040 con 0x7fd520006890 2023-11-28T20:07:48.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fd52559a640 1 -- 172.21.15.177:0/3664278628 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0aa990 con 0x7fd520006890 2023-11-28T20:07:48.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7f56f9ba5640 1 --2- 172.21.15.177:0/2636925772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56f4158f50 0x7f56f4159330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f56f000dbe0 tx=0x7f56f0020690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dff03b3aa9d950c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7f0b88b96640 1 -- start start 2023-11-28T20:07:48.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7f56f8ba3640 1 -- 172.21.15.177:0/2636925772 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f000d2d0 con 0x7f56f4158f50 2023-11-28T20:07:48.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7f56f8ba3640 1 -- 172.21.15.177:0/2636925772 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f00aa4a0 con 0x7f56f4158f50 2023-11-28T20:07:48.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7f56f8ba3640 1 -- 172.21.15.177:0/2636925772 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f000d2d0 con 0x7f56f4158f50 2023-11-28T20:07:48.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fd52759e640 1 -- 172.21.15.177:0/3664278628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd520006890 msgr2=0x7fd5200e7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fd52759e640 1 --2- 172.21.15.177:0/3664278628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd520006890 0x7fd5200e7a20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009870 tx=0x7fd51c01c4f0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fbdf27fc640 1 --2- 172.21.15.177:0/3617346923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdf40724a0 0x7fbdf4159490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009dc0 tx=0x7fbdec01c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74b7b8654078fdcf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fd52759e640 1 -- 172.21.15.177:0/3664278628 shutdown_connections 2023-11-28T20:07:48.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fd52759e640 1 --2- 172.21.15.177:0/3664278628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd520006890 0x7fd5200e7a20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fd52759e640 1 --2- 172.21.15.177:0/3664278628 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5200076e0 0x7fd520038420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fd52759e640 1 -- 172.21.15.177:0/3664278628 >> 172.21.15.177:0/3664278628 conn(0x7fd5200559c0 msgr2=0x7fd520055dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fbdf1ffb640 1 -- 172.21.15.177:0/3617346923 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0a5820 con 0x7fbdf40724a0 2023-11-28T20:07:48.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fbdf1ffb640 1 -- 172.21.15.177:0/3617346923 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec0a5980 con 0x7fbdf40724a0 2023-11-28T20:07:48.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fd52759e640 1 -- 172.21.15.177:0/3664278628 shutdown_connections 2023-11-28T20:07:48.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fd52759e640 1 -- 172.21.15.177:0/3664278628 wait complete. 2023-11-28T20:07:48.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7fbdf1ffb640 1 -- 172.21.15.177:0/3617346923 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0a5d10 con 0x7fbdf40724a0 2023-11-28T20:07:48.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7f56faba7640 1 -- 172.21.15.177:0/2636925772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56f4158f50 msgr2=0x7f56f4159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.000+0000 7f56faba7640 1 --2- 172.21.15.177:0/2636925772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56f4158f50 0x7f56f4159330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f56f000dbe0 tx=0x7f56f0020690 comp rx=0 tx=0).stop 2023-11-28T20:07:48.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f56faba7640 1 -- 172.21.15.177:0/2636925772 shutdown_connections 2023-11-28T20:07:48.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f6a9169e640 1 Processor -- start 2023-11-28T20:07:48.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7fbdf9965640 1 -- 172.21.15.177:0/3617346923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdf40724a0 msgr2=0x7fbdf4159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7fbdf9965640 1 --2- 172.21.15.177:0/3617346923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdf40724a0 0x7fbdf4159490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009dc0 tx=0x7fbdec01c850 comp rx=0 tx=0).stop 2023-11-28T20:07:48.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f56faba7640 1 --2- 172.21.15.177:0/2636925772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56f4158f50 0x7f56f4159330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f56faba7640 1 -- 172.21.15.177:0/2636925772 >> 172.21.15.177:0/2636925772 conn(0x7f56f40b0920 msgr2=0x7f56f40b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f0b88b96640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b8415cdb0 0x7f0b840cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f0b88b96640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0b8415d190 0x7f0b8415d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f0b88b96640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b840ce840 con 0x7f0b84159490 2023-11-28T20:07:48.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f0b88b96640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b840ce560 con 0x7f0b8415d190 2023-11-28T20:07:48.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f0b88b96640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84070f80 con 0x7f0b8415cdb0 2023-11-28T20:07:48.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f6a9169e640 1 -- start start 2023-11-28T20:07:48.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7fbdf9965640 1 -- 172.21.15.177:0/3617346923 shutdown_connections 2023-11-28T20:07:48.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7fbdf9965640 1 --2- 172.21.15.177:0/3617346923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdf40724a0 0x7fbdf4159490 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7fbdf9965640 1 -- 172.21.15.177:0/3617346923 >> 172.21.15.177:0/3617346923 conn(0x7fbdf406dc90 msgr2=0x7fbdf406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f0b82d9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0b8415d190 0x7f0b8415d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7fbdf9965640 1 -- 172.21.15.177:0/3617346923 shutdown_connections 2023-11-28T20:07:48.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f0b82d9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0b8415d190 0x7f0b8415d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52728/0 (socket says 172.21.15.177:52728) 2023-11-28T20:07:48.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f0b82d9d640 1 -- 172.21.15.177:0/3709292115 learned_addr learned my addr 172.21.15.177:0/3709292115 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7fbdf9965640 1 -- 172.21.15.177:0/3617346923 wait complete. 2023-11-28T20:07:48.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f0b8259c640 1 --2- 172.21.15.177:0/3709292115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b8415cdb0 0x7f0b840cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f56faba7640 1 -- 172.21.15.177:0/2636925772 shutdown_connections 2023-11-28T20:07:48.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f56faba7640 1 -- 172.21.15.177:0/2636925772 wait complete. 2023-11-28T20:07:48.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7fd52759e640 1 Processor -- start 2023-11-28T20:07:48.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f6a9169e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6a8c15cdb0 0x7f6a8c0cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f0b82d9d640 1 -- 172.21.15.177:0/3709292115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b8415cdb0 msgr2=0x7f0b840cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f0b82d9d640 1 --2- 172.21.15.177:0/3709292115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b8415cdb0 0x7f0b840cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f0b82d9d640 1 -- 172.21.15.177:0/3709292115 >> v1:172.21.15.177:6789/0 conn(0x7f0b84159490 legacy=0x7f0b840b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f0b82d9d640 1 -- 172.21.15.177:0/3709292115 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b84071260 con 0x7f0b8415d190 2023-11-28T20:07:48.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7fd52759e640 1 -- start start 2023-11-28T20:07:48.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f6a9169e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6a8c06e8a0 0x7f6a8c071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f6a9169e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8c0ce840 con 0x7f6a8c159490 2023-11-28T20:07:48.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f6a9169e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c0ce560 con 0x7f6a8c15cdb0 2023-11-28T20:07:48.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.004+0000 7f6a9169e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c070f80 con 0x7f6a8c06e8a0 2023-11-28T20:07:48.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56faba7640 1 Processor -- start 2023-11-28T20:07:48.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f6a8a7fc640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f6a8c159490 0x7f6a8c0b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:41892/0 (socket says 172.21.15.177:41892) 2023-11-28T20:07:48.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f6a8a7fc640 1 -- 172.21.15.177:0/918565335 learned_addr learned my addr 172.21.15.177:0/918565335 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:48.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f6a8b7fe640 1 --2- 172.21.15.177:0/918565335 >> v2:172.21.15.195:3300/0 conn(0x7f6a8c06e8a0 0x7f6a8c071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd52759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd520006890 0x7fd52004ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd52759e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5200076e0 0x7fd5200da450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd52759e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd520057ae0 0x7fd52003e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd52759e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200da990 con 0x7fd520006890 2023-11-28T20:07:48.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd52759e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52004df60 con 0x7fd520057ae0 2023-11-28T20:07:48.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd52759e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52004e240 con 0x7fd5200076e0 2023-11-28T20:07:48.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f6a8affd640 1 --2- 172.21.15.177:0/918565335 >> v2:172.21.15.177:3300/0 conn(0x7f6a8c15cdb0 0x7f6a8c0cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f6a8b7fe640 1 -- 172.21.15.177:0/918565335 >> v2:172.21.15.177:3300/0 conn(0x7f6a8c15cdb0 msgr2=0x7f6a8c0cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f6a8b7fe640 1 --2- 172.21.15.177:0/918565335 >> v2:172.21.15.177:3300/0 conn(0x7f6a8c15cdb0 0x7f6a8c0cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f6a8b7fe640 1 -- 172.21.15.177:0/918565335 >> v1:172.21.15.177:6789/0 conn(0x7f6a8c159490 legacy=0x7f6a8c0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f6a8b7fe640 1 -- 172.21.15.177:0/918565335 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c071260 con 0x7f6a8c06e8a0 2023-11-28T20:07:48.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd525d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5200076e0 0x7fd5200da450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd525d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5200076e0 0x7fd5200da450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:35524/0 (socket says 172.21.15.177:35524) 2023-11-28T20:07:48.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd525d9b640 1 -- 172.21.15.177:0/3744867450 learned_addr learned my addr 172.21.15.177:0/3744867450 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd52659c640 1 --2- 172.21.15.177:0/3744867450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd520006890 0x7fd52004ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd526d9d640 1 --2- 172.21.15.177:0/3744867450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd520057ae0 0x7fd52003e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56faba7640 1 -- start start 2023-11-28T20:07:48.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56faba7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56f406e210 0x7f56f406daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56faba7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56f40b3ca0 0x7f56f4148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56faba7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56f4158f50 0x7f56f406cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56faba7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f4149db0 con 0x7f56f406e210 2023-11-28T20:07:48.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56faba7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f40ad460 con 0x7f56f40b3ca0 2023-11-28T20:07:48.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56faba7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f406c790 con 0x7f56f4158f50 2023-11-28T20:07:48.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fbdf9965640 1 Processor -- start 2023-11-28T20:07:48.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56fa3a6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56f4158f50 0x7f56f406cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56fa3a6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56f4158f50 0x7f56f406cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:35528/0 (socket says 172.21.15.177:35528) 2023-11-28T20:07:48.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56fa3a6640 1 -- 172.21.15.177:0/2319327327 learned_addr learned my addr 172.21.15.177:0/2319327327 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56f9ba5640 1 --2- 172.21.15.177:0/2319327327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56f406e210 0x7f56f406daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd526d9d640 1 -- 172.21.15.177:0/3744867450 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5200076e0 msgr2=0x7fd5200da450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd526d9d640 1 --2- 172.21.15.177:0/3744867450 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5200076e0 0x7fd5200da450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd526d9d640 1 -- 172.21.15.177:0/3744867450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd520006890 msgr2=0x7fd52004ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd526d9d640 1 --2- 172.21.15.177:0/3744867450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd520006890 0x7fd52004ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fd526d9d640 1 -- 172.21.15.177:0/3744867450 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c0094d0 con 0x7fd520057ae0 2023-11-28T20:07:48.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fb7e55c3640 1 Processor -- start 2023-11-28T20:07:48.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56f93a4640 1 --2- 172.21.15.177:0/2319327327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56f40b3ca0 0x7f56f4148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56fa3a6640 1 -- 172.21.15.177:0/2319327327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56f40b3ca0 msgr2=0x7f56f4148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56fa3a6640 1 --2- 172.21.15.177:0/2319327327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56f40b3ca0 0x7f56f4148600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56fa3a6640 1 -- 172.21.15.177:0/2319327327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56f406e210 msgr2=0x7f56f406daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56fa3a6640 1 --2- 172.21.15.177:0/2319327327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56f406e210 0x7f56f406daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7f56fa3a6640 1 -- 172.21.15.177:0/2319327327 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f000d8c0 con 0x7f56f4158f50 2023-11-28T20:07:48.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fbdf9965640 1 -- start start 2023-11-28T20:07:48.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.008+0000 7fb7e55c3640 1 -- start start 2023-11-28T20:07:48.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f0b82d9d640 1 --2- 172.21.15.177:0/3709292115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b8415d190 0x7f0b8415d5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009e50 tx=0x7f0b7c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8297594732acb1d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f53206fd640 1 Processor -- start 2023-11-28T20:07:48.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fd526d9d640 1 --2- 172.21.15.177:0/3744867450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd520057ae0 0x7fd52003e320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0ab000 tx=0x7fd51c01ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f56fa3a6640 1 --2- 172.21.15.177:0/2319327327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56f4158f50 0x7f56f406cc20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00c7f0 tx=0x7f56ec00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f53206fd640 1 -- start start 2023-11-28T20:07:48.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf9965640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdf40724a0 0x7fbdf4150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf9965640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdf40d0b60 0x7fbdf40b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f56ea7fc640 1 -- 172.21.15.177:0/2319327327 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec00aa50 con 0x7f56f4158f50 2023-11-28T20:07:48.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f56ea7fc640 1 -- 172.21.15.177:0/2319327327 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec00abb0 con 0x7f56f4158f50 2023-11-28T20:07:48.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f56ea7fc640 1 -- 172.21.15.177:0/2319327327 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec012420 con 0x7f56f4158f50 2023-11-28T20:07:48.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf9965640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdf41590b0 0x7fbdf4150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf9965640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf4150950 con 0x7fbdf40724a0 2023-11-28T20:07:48.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf9965640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf4150b80 con 0x7fbdf41590b0 2023-11-28T20:07:48.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf9965640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40b0bc0 con 0x7fbdf40d0b60 2023-11-28T20:07:48.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf27fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdf40d0b60 0x7fbdf40b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf27fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdf40d0b60 0x7fbdf40b2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:35544/0 (socket says 172.21.15.177:35544) 2023-11-28T20:07:48.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf27fc640 1 -- 172.21.15.177:0/2099833319 learned_addr learned my addr 172.21.15.177:0/2099833319 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf3fff640 1 --2- 172.21.15.177:0/2099833319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdf41590b0 0x7fbdf4150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf27fc640 1 -- 172.21.15.177:0/2099833319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdf41590b0 msgr2=0x7fbdf4150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf27fc640 1 --2- 172.21.15.177:0/2099833319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdf41590b0 0x7fbdf4150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf27fc640 1 -- 172.21.15.177:0/2099833319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdf40724a0 msgr2=0x7fbdf4150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf27fc640 1 --2- 172.21.15.177:0/2099833319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdf40724a0 0x7fbdf4150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf27fc640 1 -- 172.21.15.177:0/2099833319 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec009a70 con 0x7fbdf40d0b60 2023-11-28T20:07:48.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f56faba7640 1 -- 172.21.15.177:0/2319327327 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f406c180 con 0x7f56f4158f50 2023-11-28T20:07:48.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fd516ffd640 1 -- 172.21.15.177:0/3744867450 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0bd5f0 con 0x7fd520057ae0 2023-11-28T20:07:48.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fd516ffd640 1 -- 172.21.15.177:0/3744867450 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c0bd790 con 0x7fd520057ae0 2023-11-28T20:07:48.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fd516ffd640 1 -- 172.21.15.177:0/3744867450 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0bdb40 con 0x7fd520057ae0 2023-11-28T20:07:48.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f56faba7640 1 -- 172.21.15.177:0/2319327327 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f40ad180 con 0x7f56f4158f50 2023-11-28T20:07:48.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fb7e55c3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7e015c070 0x7fb7e0145960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fb7e55c3640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e0145fc0 con 0x7fb7e015bc90 2023-11-28T20:07:48.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fb7e55c3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e01462a0 con 0x7fb7e006c9d0 2023-11-28T20:07:48.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fb7e55c3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0146580 con 0x7fb7e015c070 2023-11-28T20:07:48.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fd52759e640 1 -- 172.21.15.177:0/3744867450 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52004e520 con 0x7fd520057ae0 2023-11-28T20:07:48.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f0b81d9b640 1 -- 172.21.15.177:0/3709292115 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c0a5860 con 0x7f0b8415d190 2023-11-28T20:07:48.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f0b81d9b640 1 -- 172.21.15.177:0/3709292115 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7c0a59c0 con 0x7f0b8415d190 2023-11-28T20:07:48.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f0b81d9b640 1 -- 172.21.15.177:0/3709292115 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c0a5d50 con 0x7f0b8415d190 2023-11-28T20:07:48.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf27fc640 1 --2- 172.21.15.177:0/2099833319 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdf40d0b60 0x7fbdf40b2750 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0b0040 tx=0x7fbdec0195f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fd52759e640 1 -- 172.21.15.177:0/3744867450 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52004dbc0 con 0x7fd520057ae0 2023-11-28T20:07:48.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f0b88b96640 1 -- 172.21.15.177:0/3709292115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b8415d190 msgr2=0x7f0b8415d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f0b88b96640 1 --2- 172.21.15.177:0/3709292115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b8415d190 0x7f0b8415d5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009e50 tx=0x7f0b7c01c9c0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fb7d7fff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb7e006c9d0 0x7fb7e0145250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:41262/0 (socket says 172.21.15.177:41262) 2023-11-28T20:07:48.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fb7d7fff640 1 -- 172.21.15.177:0/2387742883 learned_addr learned my addr 172.21.15.177:0/2387742883 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:48.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f6a8b7fe640 1 --2- 172.21.15.177:0/918565335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a8c06e8a0 0x7f6a8c071a60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c06b7d0 tx=0x7f6a8401c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9179a5f44d1876f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f53206fd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f53180cfe90 0x7f53180d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f53206fd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53180d3880 con 0x7f53180b3c70 2023-11-28T20:07:48.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f53206fd640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53180cdc80 con 0x7f53180b35b0 2023-11-28T20:07:48.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f53206fd640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53180d4090 con 0x7f53180cfe90 2023-11-28T20:07:48.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbddbfff640 1 -- 172.21.15.177:0/2099833319 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0b9650 con 0x7fbdf40d0b60 2023-11-28T20:07:48.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f56faba7640 1 -- 172.21.15.177:0/2319327327 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56f415dad0 con 0x7f56f4158f50 2023-11-28T20:07:48.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fb7df7fe640 1 --2- 172.21.15.177:0/2387742883 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7e015c070 0x7fb7e0145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f531dc98640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f53180cfe90 0x7f53180d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f531dc98640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f53180cfe90 0x7f53180d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53270/0 (socket says 172.21.15.177:53270) 2023-11-28T20:07:48.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f531dc98640 1 -- 172.21.15.177:0/2372270331 learned_addr learned my addr 172.21.15.177:0/2372270331 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbddbfff640 1 -- 172.21.15.177:0/2099833319 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec0b97b0 con 0x7fbdf40d0b60 2023-11-28T20:07:48.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbddbfff640 1 -- 172.21.15.177:0/2099833319 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0b9b40 con 0x7fbdf40d0b60 2023-11-28T20:07:48.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf9965640 1 -- 172.21.15.177:0/2099833319 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf40b0290 con 0x7fbdf40d0b60 2023-11-28T20:07:48.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7fbdf9965640 1 -- 172.21.15.177:0/2099833319 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf40b0850 con 0x7fbdf40d0b60 2023-11-28T20:07:48.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.012+0000 7f6a89ffb640 1 -- 172.21.15.177:0/918565335 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840a5960 con 0x7f6a8c06e8a0 2023-11-28T20:07:48.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f6a89ffb640 1 -- 172.21.15.177:0/918565335 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a840a5ac0 con 0x7f6a8c06e8a0 2023-11-28T20:07:48.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f6a89ffb640 1 -- 172.21.15.177:0/918565335 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840a5e50 con 0x7f6a8c06e8a0 2023-11-28T20:07:48.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fbbc80c9640 1 Processor -- start 2023-11-28T20:07:48.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fbbc80c9640 1 -- start start 2023-11-28T20:07:48.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fd514ff9640 1 -- 172.21.15.177:0/3744867450 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd500000fd0 con 0x7fd520057ae0 2023-11-28T20:07:48.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fbdf9965640 1 -- 172.21.15.177:0/2099833319 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbdf415dc00 con 0x7fbdf40d0b60 2023-11-28T20:07:48.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f56ea7fc640 1 -- 172.21.15.177:0/2319327327 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f56ec012580 con 0x7f56f4158f50 2023-11-28T20:07:48.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f0b88b96640 1 -- 172.21.15.177:0/3709292115 shutdown_connections 2023-11-28T20:07:48.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f0b88b96640 1 --2- 172.21.15.177:0/3709292115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b8415d190 0x7f0b8415d5f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f0b88b96640 1 --2- 172.21.15.177:0/3709292115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b8415cdb0 0x7f0b840cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f0b88b96640 1 -- 172.21.15.177:0/3709292115 >> 172.21.15.177:0/3709292115 conn(0x7f0b8406c2c0 msgr2=0x7f0b8406c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fb7de7fc640 1 -- 172.21.15.177:0/2387742883 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320431103 0 0) 0x7fb7e01462a0 con 0x7fb7e006c9d0 2023-11-28T20:07:48.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fb7df7fe640 1 -- 172.21.15.177:0/2387742883 >> v1:172.21.15.195:6789/0 conn(0x7fb7e006c9d0 legacy=0x7fb7e0145250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fb7df7fe640 1 -- 172.21.15.177:0/2387742883 >> v1:172.21.15.177:6789/0 conn(0x7fb7e015bc90 legacy=0x7fb7e006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fb7df7fe640 1 -- 172.21.15.177:0/2387742883 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e0146860 con 0x7fb7e015c070 2023-11-28T20:07:48.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f6a9169e640 1 -- 172.21.15.177:0/918565335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a8c06e8a0 msgr2=0x7f6a8c071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f6a9169e640 1 --2- 172.21.15.177:0/918565335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a8c06e8a0 0x7f6a8c071a60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c06b7d0 tx=0x7f6a8401c880 comp rx=0 tx=0).stop 2023-11-28T20:07:48.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f6a9169e640 1 -- 172.21.15.177:0/918565335 shutdown_connections 2023-11-28T20:07:48.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f6a9169e640 1 --2- 172.21.15.177:0/918565335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a8c06e8a0 0x7f6a8c071a60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f6a9169e640 1 --2- 172.21.15.177:0/918565335 >> v2:172.21.15.177:3300/0 conn(0x7f6a8c15cdb0 0x7f6a8c0cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f6a9169e640 1 -- 172.21.15.177:0/918565335 >> 172.21.15.177:0/918565335 conn(0x7f6a8c06c2c0 msgr2=0x7f6a8c06c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f6a9169e640 1 -- 172.21.15.177:0/918565335 shutdown_connections 2023-11-28T20:07:48.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f531d497640 1 -- 172.21.15.177:0/2372270331 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444755008 0 0) 0x7f53180d3880 con 0x7f53180b3c70 2023-11-28T20:07:48.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f531d497640 1 -- 172.21.15.177:0/2372270331 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5304003530 con 0x7f53180b3c70 2023-11-28T20:07:48.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f531dc98640 1 -- 172.21.15.177:0/2372270331 >> v1:172.21.15.195:6789/0 conn(0x7f53180b35b0 legacy=0x7f53180cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f531dc98640 1 -- 172.21.15.177:0/2372270331 >> v1:172.21.15.177:6789/0 conn(0x7f53180b3c70 legacy=0x7f53180ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f531dc98640 1 -- 172.21.15.177:0/2372270331 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53180d3ad0 con 0x7f53180cfe90 2023-11-28T20:07:48.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fbbc80c9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbbc015bc90 0x7fbbc006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fbbc80c9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbbc015c070 0x7fbbc006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fbbc80c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc0145250 0x7fbbc0145700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fbbc80c9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc0145fc0 con 0x7fbbc015bc90 2023-11-28T20:07:48.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fbbc80c9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc01462a0 con 0x7fbbc015c070 2023-11-28T20:07:48.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fbbc80c9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc0146580 con 0x7fbbc0145250 2023-11-28T20:07:48.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fbbc5664640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbbc015c070 0x7fbbc006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fd516ffd640 1 -- 172.21.15.177:0/3744867450 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd51c0b3600 con 0x7fd520057ae0 2023-11-28T20:07:48.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fbbc5664640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbbc015c070 0x7fbbc006c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53284/0 (socket says 172.21.15.177:53284) 2023-11-28T20:07:48.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fbbc5664640 1 -- 172.21.15.177:0/4063364188 learned_addr learned my addr 172.21.15.177:0/4063364188 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f6a9169e640 1 -- 172.21.15.177:0/918565335 wait complete. 2023-11-28T20:07:48.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f0b88b96640 1 -- 172.21.15.177:0/3709292115 shutdown_connections 2023-11-28T20:07:48.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f0b88b96640 1 -- 172.21.15.177:0/3709292115 wait complete. 2023-11-28T20:07:48.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbbc6666640 1 --2- 172.21.15.177:0/4063364188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc0145250 0x7fbbc0145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbbc5e65640 1 --2- 172.21.15.177:0/4063364188 >> v2:172.21.15.177:3300/0 conn(0x7fbbc015bc90 0x7fbbc006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fd516ffd640 1 --2- 172.21.15.177:0/3744867450 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd5080664f0 0x7fd5080689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fd516ffd640 1 -- 172.21.15.177:0/3744867450 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd51c11ef00 con 0x7fd520057ae0 2023-11-28T20:07:48.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7fbddbfff640 1 -- 172.21.15.177:0/2099833319 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbdec0b9ca0 con 0x7fbdf40d0b60 2023-11-28T20:07:48.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbddbfff640 1 --2- 172.21.15.177:0/2099833319 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbde006a950 0x7fbde006ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbddbfff640 1 -- 172.21.15.177:0/2099833319 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdec11f830 con 0x7fbdf40d0b60 2023-11-28T20:07:48.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbddbfff640 1 --2- 172.21.15.177:0/2099833319 >> [v2:172.21.15.177:6800/3095629541,v1:172.21.15.177:6801/3095629541] conn(0x7fbde0072b70 0x7fbde0074f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbddbfff640 1 -- 172.21.15.177:0/2099833319 --> [v2:172.21.15.177:6800/3095629541,v1:172.21.15.177:6801/3095629541] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbde0075640 con 0x7fbde0072b70 2023-11-28T20:07:48.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fd516ffd640 1 --2- 172.21.15.177:0/3744867450 >> [v2:172.21.15.177:6816/1088546159,v1:172.21.15.177:6817/1088546159] conn(0x7fd50806e710 0x7fd508070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fd516ffd640 1 -- 172.21.15.177:0/3744867450 --> [v2:172.21.15.177:6816/1088546159,v1:172.21.15.177:6817/1088546159] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd5080711e0 con 0x7fd50806e710 2023-11-28T20:07:48.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fd516ffd640 1 -- 172.21.15.177:0/3744867450 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd51c1214e0 con 0x7fd520057ae0 2023-11-28T20:07:48.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbddbfff640 1 -- 172.21.15.177:0/2099833319 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdec11fbe0 con 0x7fbdf40d0b60 2023-11-28T20:07:48.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f56ea7fc640 1 --2- 172.21.15.177:0/2319327327 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f56d80664f0 0x7f56d80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f56ea7fc640 1 -- 172.21.15.177:0/2319327327 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56ec055690 con 0x7f56f4158f50 2023-11-28T20:07:48.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f56ea7fc640 1 --2- 172.21.15.177:0/2319327327 >> [v2:172.21.15.177:6824/1722845469,v1:172.21.15.177:6825/1722845469] conn(0x7f56d806f320 0x7f56d80717c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f56ea7fc640 1 -- 172.21.15.177:0/2319327327 --> [v2:172.21.15.177:6824/1722845469,v1:172.21.15.177:6825/1722845469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56d8071e90 con 0x7f56d806f320 2023-11-28T20:07:48.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.016+0000 7f56ea7fc640 1 -- 172.21.15.177:0/2319327327 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56ec007630 con 0x7f56f4158f50 2023-11-28T20:07:48.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7f56f9ba5640 1 --2- 172.21.15.177:0/2319327327 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f56d80664f0 0x7f56d80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbbc5e65640 1 -- 172.21.15.177:0/4063364188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc0145250 msgr2=0x7fbbc0145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7f6a9169e640 1 Processor -- start 2023-11-28T20:07:48.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbbc5e65640 1 --2- 172.21.15.177:0/4063364188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc0145250 0x7fbbc0145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbbc5e65640 1 -- 172.21.15.177:0/4063364188 >> v2:172.21.15.195:3300/0 conn(0x7fbbc015c070 msgr2=0x7fbbc006c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7f56f93a4640 1 --2- 172.21.15.177:0/2319327327 >> [v2:172.21.15.177:6824/1722845469,v1:172.21.15.177:6825/1722845469] conn(0x7f56d806f320 0x7f56d80717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbbc5e65640 1 --2- 172.21.15.177:0/4063364188 >> v2:172.21.15.195:3300/0 conn(0x7fbbc015c070 0x7fbbc006c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbdf3fff640 1 --2- 172.21.15.177:0/2099833319 >> [v2:172.21.15.177:6800/3095629541,v1:172.21.15.177:6801/3095629541] conn(0x7fbde0072b70 0x7fbde0074f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7f6a9169e640 1 -- start start 2023-11-28T20:07:48.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7f0b88b96640 1 Processor -- start 2023-11-28T20:07:48.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7f0b88b96640 1 -- start start 2023-11-28T20:07:48.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fd52659c640 1 --2- 172.21.15.177:0/3744867450 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd5080664f0 0x7fd5080689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7f56f9ba5640 1 --2- 172.21.15.177:0/2319327327 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f56d80664f0 0x7f56d80689b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f56f00b2000 tx=0x7f56f00ab000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fb7df7fe640 1 --2- 172.21.15.177:0/2387742883 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7e015c070 0x7fb7e0145960 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8009df0 tx=0x7fb7d801c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3417c36bb7df79f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbdf3fff640 1 --2- 172.21.15.177:0/2099833319 >> [v2:172.21.15.177:6800/3095629541,v1:172.21.15.177:6801/3095629541] conn(0x7fbde0072b70 0x7fbde0074f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbdf2ffd640 1 --2- 172.21.15.177:0/2099833319 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbde006a950 0x7fbde006ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbbc5e65640 1 -- 172.21.15.177:0/4063364188 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc0146860 con 0x7fbbc015bc90 2023-11-28T20:07:48.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fbbc5664640 1 --2- 172.21.15.177:0/4063364188 >> v2:172.21.15.195:3300/0 conn(0x7fbbc015c070 0x7fbbc006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:48.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fd52659c640 1 --2- 172.21.15.177:0/3744867450 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd5080664f0 0x7fd5080689b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5280643d0 tx=0x7fd52806d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fb7de7fc640 1 -- 172.21.15.177:0/2387742883 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80a5950 con 0x7fb7e015c070 2023-11-28T20:07:48.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fb7de7fc640 1 -- 172.21.15.177:0/2387742883 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d80a5ab0 con 0x7fb7e015c070 2023-11-28T20:07:48.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7fb7de7fc640 1 -- 172.21.15.177:0/2387742883 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80a5e40 con 0x7fb7e015c070 2023-11-28T20:07:48.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.020+0000 7f56f93a4640 1 --2- 172.21.15.177:0/2319327327 >> [v2:172.21.15.177:6824/1722845469,v1:172.21.15.177:6825/1722845469] conn(0x7f56d806f320 0x7f56d80717c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7fd525d9b640 1 --2- 172.21.15.177:0/3744867450 >> [v2:172.21.15.177:6816/1088546159,v1:172.21.15.177:6817/1088546159] conn(0x7fd50806e710 0x7fd508070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a9169e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a8c06e8a0 0x7f6a8c14d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b88b96640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b84159490 0x7f0b840b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a9169e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a8c159490 0x7f6a8c0b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7fbddbfff640 1 -- 172.21.15.177:0/2099833319 <== osd.0 v2:172.21.15.177:6800/3095629541 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbde0075640 con 0x7fbde0072b70 2023-11-28T20:07:48.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7fbdf2ffd640 1 --2- 172.21.15.177:0/2099833319 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbde006a950 0x7fbde006ce10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbde400b680 tx=0x7fbde4005b10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b88b96640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b8415cdb0 0x7f0b84202280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b88b96640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b8415d190 0x7f0b84205fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b8259c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b84159490 0x7f0b840b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b8259c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b84159490 0x7f0b840b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:35584/0 (socket says 172.21.15.177:35584) 2023-11-28T20:07:48.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b8259c640 1 -- 172.21.15.177:0/721536065 learned_addr learned my addr 172.21.15.177:0/721536065 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b7bfff640 1 --2- 172.21.15.177:0/721536065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b8415cdb0 0x7f0b84202280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b88b96640 1 -- 172.21.15.177:0/721536065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84206a70 con 0x7f0b8415d190 2023-11-28T20:07:48.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b88b96640 1 -- 172.21.15.177:0/721536065 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84206d50 con 0x7f0b8415cdb0 2023-11-28T20:07:48.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b88b96640 1 -- 172.21.15.177:0/721536065 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84154580 con 0x7f0b84159490 2023-11-28T20:07:48.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7fb7e55c3640 1 -- 172.21.15.177:0/2387742883 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7e015c070 msgr2=0x7fb7e0145960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7fb7e55c3640 1 --2- 172.21.15.177:0/2387742883 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7e015c070 0x7fb7e0145960 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8009df0 tx=0x7fb7d801c870 comp rx=0 tx=0).stop 2023-11-28T20:07:48.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a9169e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a8c15cdb0 0x7f6a8c14c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a8affd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a8c06e8a0 0x7f6a8c14d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a8affd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a8c06e8a0 0x7f6a8c14d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53300/0 (socket says 172.21.15.177:53300) 2023-11-28T20:07:48.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a8affd640 1 -- 172.21.15.177:0/1380934347 learned_addr learned my addr 172.21.15.177:0/1380934347 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f531dc98640 1 --2- 172.21.15.177:0/2372270331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53180cfe90 0x7f53180d0f50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f53140097f0 tx=0x7f531401c340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85c6eda3771db087 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f531d497640 1 -- 172.21.15.177:0/2372270331 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53140ab600 con 0x7f53180cfe90 2023-11-28T20:07:48.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7fb7e55c3640 1 -- 172.21.15.177:0/2387742883 shutdown_connections 2023-11-28T20:07:48.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7fb7e55c3640 1 --2- 172.21.15.177:0/2387742883 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7e015c070 0x7fb7e0145960 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7fb7e55c3640 1 -- 172.21.15.177:0/2387742883 >> 172.21.15.177:0/2387742883 conn(0x7fb7e006a530 msgr2=0x7fb7e006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a9169e640 1 -- 172.21.15.177:0/1380934347 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c15c380 con 0x7f6a8c15cdb0 2023-11-28T20:07:48.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a9169e640 1 -- 172.21.15.177:0/1380934347 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c15c620 con 0x7f6a8c06e8a0 2023-11-28T20:07:48.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a9169e640 1 -- 172.21.15.177:0/1380934347 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0b2530 con 0x7f6a8c159490 2023-11-28T20:07:48.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b82d9d640 1 --2- 172.21.15.177:0/721536065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b8415d190 0x7f0b84205fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7fb7e55c3640 1 -- 172.21.15.177:0/2387742883 shutdown_connections 2023-11-28T20:07:48.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7fd525d9b640 1 --2- 172.21.15.177:0/3744867450 >> [v2:172.21.15.177:6816/1088546159,v1:172.21.15.177:6817/1088546159] conn(0x7fd50806e710 0x7fd508070b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b8259c640 1 -- 172.21.15.177:0/721536065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b8415cdb0 msgr2=0x7f0b84202280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b8259c640 1 --2- 172.21.15.177:0/721536065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b8415cdb0 0x7f0b84202280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b8259c640 1 -- 172.21.15.177:0/721536065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b8415d190 msgr2=0x7f0b84205fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b8259c640 1 --2- 172.21.15.177:0/721536065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b8415d190 0x7f0b84205fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b8259c640 1 -- 172.21.15.177:0/721536065 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c009b30 con 0x7f0b84159490 2023-11-28T20:07:48.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7fb7e55c3640 1 -- 172.21.15.177:0/2387742883 wait complete. 2023-11-28T20:07:48.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f56ea7fc640 1 -- 172.21.15.177:0/2319327327 <== osd.1 v2:172.21.15.177:6824/1722845469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f56d8071e90 con 0x7f56d806f320 2023-11-28T20:07:48.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b8259c640 1 --2- 172.21.15.177:0/721536065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b84159490 0x7f0b840b1db0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400e930 tx=0x7f0b7400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b7affd640 1 -- 172.21.15.177:0/721536065 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74009690 con 0x7f0b84159490 2023-11-28T20:07:48.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f0b7affd640 1 -- 172.21.15.177:0/721536065 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7400ca00 con 0x7f0b84159490 2023-11-28T20:07:48.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a8a7fc640 1 --2- 172.21.15.177:0/1380934347 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a8c159490 0x7f6a8c0b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a8b7fe640 1 --2- 172.21.15.177:0/1380934347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a8c15cdb0 0x7f6a8c14c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a8a7fc640 1 -- 172.21.15.177:0/1380934347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a8c06e8a0 msgr2=0x7f6a8c14d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a8a7fc640 1 --2- 172.21.15.177:0/1380934347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a8c06e8a0 0x7f6a8c14d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a8a7fc640 1 -- 172.21.15.177:0/1380934347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a8c15cdb0 msgr2=0x7f6a8c14c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a8a7fc640 1 --2- 172.21.15.177:0/1380934347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a8c15cdb0 0x7f6a8c14c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f6a8a7fc640 1 -- 172.21.15.177:0/1380934347 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a84009a70 con 0x7f6a8c159490 2023-11-28T20:07:48.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f531d497640 1 -- 172.21.15.177:0/2372270331 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53140a7050 con 0x7f53180cfe90 2023-11-28T20:07:48.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f531d497640 1 -- 172.21.15.177:0/2372270331 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53140ab980 con 0x7f53180cfe90 2023-11-28T20:07:48.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f53206fd640 1 -- 172.21.15.177:0/2372270331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53180cfe90 msgr2=0x7f53180d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f53206fd640 1 --2- 172.21.15.177:0/2372270331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53180cfe90 0x7f53180d0f50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f53140097f0 tx=0x7f531401c340 comp rx=0 tx=0).stop 2023-11-28T20:07:48.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f53206fd640 1 -- 172.21.15.177:0/2372270331 shutdown_connections 2023-11-28T20:07:48.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f53206fd640 1 --2- 172.21.15.177:0/2372270331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53180cfe90 0x7f53180d0f50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f53206fd640 1 -- 172.21.15.177:0/2372270331 >> 172.21.15.177:0/2372270331 conn(0x7f531809c4b0 msgr2=0x7f53180d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f53206fd640 1 -- 172.21.15.177:0/2372270331 shutdown_connections 2023-11-28T20:07:48.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7f53206fd640 1 -- 172.21.15.177:0/2372270331 wait complete. 2023-11-28T20:07:48.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7fbbc5e65640 1 --2- 172.21.15.177:0/4063364188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc015bc90 0x7fbbc006c2c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0097c0 tx=0x7fbbbc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707c6502aba735d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f0b88b96640 1 -- 172.21.15.177:0/721536065 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b84154860 con 0x7f0b84159490 2023-11-28T20:07:48.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f6a8a7fc640 1 --2- 172.21.15.177:0/1380934347 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a8c159490 0x7f6a8c0b3010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000c430 tx=0x7f6a8000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.024+0000 7fbbc4e63640 1 -- 172.21.15.177:0/4063364188 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc0ab5f0 con 0x7fbbc015bc90 2023-11-28T20:07:48.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fbbc4e63640 1 -- 172.21.15.177:0/4063364188 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc0ab750 con 0x7fbbc015bc90 2023-11-28T20:07:48.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fbbc4e63640 1 -- 172.21.15.177:0/4063364188 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc0abae0 con 0x7fbbc015bc90 2023-11-28T20:07:48.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fd516ffd640 1 -- 172.21.15.177:0/3744867450 <== osd.2 v2:172.21.15.177:6816/1088546159 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd5080711e0 con 0x7fd50806e710 2023-11-28T20:07:48.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f0b88b96640 1 -- 172.21.15.177:0/721536065 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b84154230 con 0x7f0b84159490 2023-11-28T20:07:48.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f0b7affd640 1 -- 172.21.15.177:0/721536065 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7400cd70 con 0x7f0b84159490 2023-11-28T20:07:48.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f53206fd640 1 Processor -- start 2023-11-28T20:07:48.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fbbc80c9640 1 -- 172.21.15.177:0/4063364188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc015bc90 msgr2=0x7fbbc006c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fbbc80c9640 1 --2- 172.21.15.177:0/4063364188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc015bc90 0x7fbbc006c2c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0097c0 tx=0x7fbbbc01c410 comp rx=0 tx=0).stop 2023-11-28T20:07:48.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f0b88b96640 1 -- 172.21.15.177:0/721536065 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0b68000fd0 con 0x7f0b84159490 2023-11-28T20:07:48.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f53206fd640 1 -- start start 2023-11-28T20:07:48.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fb7e55c3640 1 Processor -- start 2023-11-28T20:07:48.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f6a737fe640 1 -- 172.21.15.177:0/1380934347 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80005cf0 con 0x7f6a8c159490 2023-11-28T20:07:48.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f6a737fe640 1 -- 172.21.15.177:0/1380934347 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a80005e50 con 0x7f6a8c159490 2023-11-28T20:07:48.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fbbc80c9640 1 -- 172.21.15.177:0/4063364188 shutdown_connections 2023-11-28T20:07:48.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fbbc80c9640 1 --2- 172.21.15.177:0/4063364188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc0145250 0x7fbbc0145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fbbc80c9640 1 --2- 172.21.15.177:0/4063364188 >> v2:172.21.15.195:3300/0 conn(0x7fbbc015c070 0x7fbbc006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fbbc80c9640 1 --2- 172.21.15.177:0/4063364188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc015bc90 0x7fbbc006c2c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fbbc80c9640 1 -- 172.21.15.177:0/4063364188 >> 172.21.15.177:0/4063364188 conn(0x7fbbc006a530 msgr2=0x7fbbc006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f6a9169e640 1 -- 172.21.15.177:0/1380934347 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c0b2810 con 0x7f6a8c159490 2023-11-28T20:07:48.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fbbc80c9640 1 -- 172.21.15.177:0/4063364188 shutdown_connections 2023-11-28T20:07:48.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f53206fd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53180b35b0 0x7f53180a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f53206fd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53180b3c70 0x7f5318156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f53206fd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53180cfe90 0x7f5318154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f53206fd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5318155990 con 0x7f53180b3c70 2023-11-28T20:07:48.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f53206fd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5318155c70 con 0x7f53180b35b0 2023-11-28T20:07:48.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f53206fd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5318155f50 con 0x7f53180cfe90 2023-11-28T20:07:48.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f531ec9a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53180cfe90 0x7f5318154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f531ec9a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53180cfe90 0x7f5318154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:35602/0 (socket says 172.21.15.177:35602) 2023-11-28T20:07:48.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f531ec9a640 1 -- 172.21.15.177:0/1121323955 learned_addr learned my addr 172.21.15.177:0/1121323955 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f6a737fe640 1 -- 172.21.15.177:0/1380934347 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a800072d0 con 0x7f6a8c159490 2023-11-28T20:07:48.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f0b7affd640 1 -- 172.21.15.177:0/721536065 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0b74013470 con 0x7f0b84159490 2023-11-28T20:07:48.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fb7e55c3640 1 -- start start 2023-11-28T20:07:48.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fb7e55c3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7e006c9d0 0x7fb7e0161e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fb7e55c3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7e015bc90 0x7fb7e0162380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fb7e55c3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7e015c070 0x7fb7e0163cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f531e499640 1 --2- 172.21.15.177:0/1121323955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53180b35b0 0x7f53180a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f531ec9a640 1 -- 172.21.15.177:0/1121323955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53180b35b0 msgr2=0x7f53180a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f531ec9a640 1 --2- 172.21.15.177:0/1121323955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53180b35b0 0x7f53180a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f531ec9a640 1 -- 172.21.15.177:0/1121323955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53180b3c70 msgr2=0x7f5318156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f531ec9a640 1 --2- 172.21.15.177:0/1121323955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53180b3c70 0x7f5318156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7f531ec9a640 1 -- 172.21.15.177:0/1121323955 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140094d0 con 0x7f53180cfe90 2023-11-28T20:07:48.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.028+0000 7fbbc80c9640 1 -- 172.21.15.177:0/4063364188 wait complete. 2023-11-28T20:07:48.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f6a9169e640 1 -- 172.21.15.177:0/1380934347 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c15bb40 con 0x7f6a8c159490 2023-11-28T20:07:48.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f531ec9a640 1 --2- 172.21.15.177:0/1121323955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53180cfe90 0x7f5318154ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5310002200 tx=0x7f531000cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f0b7affd640 1 --2- 172.21.15.177:0/721536065 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0b640664c0 0x7f0b64068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f0b7affd640 1 -- 172.21.15.177:0/721536065 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b74083ff0 con 0x7f0b84159490 2023-11-28T20:07:48.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f0b7affd640 1 --2- 172.21.15.177:0/721536065 >> [v2:172.21.15.177:6808/3088892220,v1:172.21.15.177:6809/3088892220] conn(0x7f0b6406e6e0 0x7f0b64070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f0b7affd640 1 -- 172.21.15.177:0/721536065 --> [v2:172.21.15.177:6808/3088892220,v1:172.21.15.177:6809/3088892220] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0b640711b0 con 0x7f0b6406e6e0 2023-11-28T20:07:48.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f0b7affd640 1 -- 172.21.15.177:0/721536065 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b740865f0 con 0x7f0b84159490 2023-11-28T20:07:48.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f0b7bfff640 1 --2- 172.21.15.177:0/721536065 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0b640664c0 0x7f0b64068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7fb7d7fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7e015bc90 0x7fb7e0162380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7fb7d7fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7e015bc90 0x7fb7e0162380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53330/0 (socket says 172.21.15.177:53330) 2023-11-28T20:07:48.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7fb7df7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7e015c070 0x7fb7e0163cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7fb7df7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7e015c070 0x7fb7e0163cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52814/0 (socket says 172.21.15.177:52814) 2023-11-28T20:07:48.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f6a9169e640 1 -- 172.21.15.177:0/1380934347 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a8c166150 con 0x7f6a8c159490 2023-11-28T20:07:48.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f530effd640 1 -- 172.21.15.177:0/1121323955 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310003b80 con 0x7f53180cfe90 2023-11-28T20:07:48.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f530effd640 1 -- 172.21.15.177:0/1121323955 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310003ce0 con 0x7f53180cfe90 2023-11-28T20:07:48.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f530effd640 1 -- 172.21.15.177:0/1121323955 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310015ba0 con 0x7f53180cfe90 2023-11-28T20:07:48.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f53206fd640 1 -- 172.21.15.177:0/1121323955 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5318156230 con 0x7f53180cfe90 2023-11-28T20:07:48.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f53206fd640 1 -- 172.21.15.177:0/1121323955 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53180a0c70 con 0x7f53180cfe90 2023-11-28T20:07:48.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f53206fd640 1 -- 172.21.15.177:0/1121323955 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5318160550 con 0x7f53180cfe90 2023-11-28T20:07:48.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7fbbc80c9640 1 Processor -- start 2023-11-28T20:07:48.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7f0b7bfff640 1 --2- 172.21.15.177:0/721536065 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0b640664c0 0x7f0b64068980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0b8414afa0 tx=0x7f0b6c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7fbbc80c9640 1 -- start start 2023-11-28T20:07:48.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f0b82d9d640 1 --2- 172.21.15.177:0/721536065 >> [v2:172.21.15.177:6808/3088892220,v1:172.21.15.177:6809/3088892220] conn(0x7f0b6406e6e0 0x7f0b64070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f0b82d9d640 1 --2- 172.21.15.177:0/721536065 >> [v2:172.21.15.177:6808/3088892220,v1:172.21.15.177:6809/3088892220] conn(0x7f0b6406e6e0 0x7f0b64070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7fb7e55c3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e013c7c0 con 0x7fb7e015c070 2023-11-28T20:07:48.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7fb7e55c3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e013d620 con 0x7fb7e015bc90 2023-11-28T20:07:48.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7fb7e55c3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e013ca10 con 0x7fb7e006c9d0 2023-11-28T20:07:48.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.032+0000 7fb7d7fff640 1 -- 172.21.15.177:0/1872733102 learned_addr learned my addr 172.21.15.177:0/1872733102 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fb7deffd640 1 --2- 172.21.15.177:0/1872733102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7e006c9d0 0x7fb7e0161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fb7d7fff640 1 -- 172.21.15.177:0/1872733102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7e006c9d0 msgr2=0x7fb7e0161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fb7d7fff640 1 --2- 172.21.15.177:0/1872733102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7e006c9d0 0x7fb7e0161e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fb7d7fff640 1 -- 172.21.15.177:0/1872733102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7e015c070 msgr2=0x7fb7e0163cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fb7d7fff640 1 --2- 172.21.15.177:0/1872733102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7e015c070 0x7fb7e0163cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fb7d7fff640 1 -- 172.21.15.177:0/1872733102 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d8009a70 con 0x7fb7e015bc90 2023-11-28T20:07:48.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fb7deffd640 1 --2- 172.21.15.177:0/1872733102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7e006c9d0 0x7fb7e0161e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:07:48.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc80c9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc0145250 0x7fbbc0143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc80c9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc015bc90 0x7fbbc00b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f6a737fe640 1 -- 172.21.15.177:0/1380934347 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6a80007430 con 0x7f6a8c159490 2023-11-28T20:07:48.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f0b7affd640 1 -- 172.21.15.177:0/721536065 <== osd.3 v2:172.21.15.177:6808/3088892220 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0b640711b0 con 0x7f0b6406e6e0 2023-11-28T20:07:48.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f530effd640 1 -- 172.21.15.177:0/1121323955 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f531001b070 con 0x7f53180cfe90 2023-11-28T20:07:48.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc80c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc015c070 0x7fbbc0161e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc80c9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc015a550 con 0x7fbbc0145250 2023-11-28T20:07:48.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc5e65640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc0145250 0x7fbbc0143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc80c9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc0159940 con 0x7fbbc015bc90 2023-11-28T20:07:48.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc80c9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc0159c20 con 0x7fbbc015c070 2023-11-28T20:07:48.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f530effd640 1 --2- 172.21.15.177:0/1121323955 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f52fc0664c0 0x7f52fc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f530effd640 1 -- 172.21.15.177:0/1121323955 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f531008c410 con 0x7f53180cfe90 2023-11-28T20:07:48.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f530effd640 1 --2- 172.21.15.177:0/1121323955 >> [v2:172.21.15.195:6816/1289013754,v1:172.21.15.195:6817/1289013754] conn(0x7f52fc06e6e0 0x7f52fc070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc5e65640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc0145250 0x7fbbc0143ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52818/0 (socket says 172.21.15.177:52818) 2023-11-28T20:07:48.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc5e65640 1 -- 172.21.15.177:0/290811679 learned_addr learned my addr 172.21.15.177:0/290811679 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc6666640 1 --2- 172.21.15.177:0/290811679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc015c070 0x7fbbc0161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f530effd640 1 -- 172.21.15.177:0/1121323955 --> [v2:172.21.15.195:6816/1289013754,v1:172.21.15.195:6817/1289013754] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52fc0711b0 con 0x7f52fc06e6e0 2023-11-28T20:07:48.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f530effd640 1 -- 172.21.15.177:0/1121323955 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f531008c8b0 con 0x7f53180cfe90 2023-11-28T20:07:48.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc5664640 1 --2- 172.21.15.177:0/290811679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc015bc90 0x7fbbc00b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f6a737fe640 1 --2- 172.21.15.177:0/1380934347 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6a78066540 0x7f6a78068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f6a737fe640 1 -- 172.21.15.177:0/1380934347 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a80083310 con 0x7f6a8c159490 2023-11-28T20:07:48.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fb7d7fff640 1 --2- 172.21.15.177:0/1872733102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7e015bc90 0x7fb7e0162380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800c450 tx=0x7fb7c800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f6a737fe640 1 --2- 172.21.15.177:0/1380934347 >> [v2:172.21.15.195:6800/1295097681,v1:172.21.15.195:6801/1295097681] conn(0x7f6a7806e760 0x7f6a78070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f6a737fe640 1 -- 172.21.15.177:0/1380934347 --> [v2:172.21.15.195:6800/1295097681,v1:172.21.15.195:6801/1295097681] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a78071230 con 0x7f6a7806e760 2023-11-28T20:07:48.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f6a737fe640 1 -- 172.21.15.177:0/1380934347 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a800858d0 con 0x7f6a8c159490 2023-11-28T20:07:48.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc6666640 1 -- 172.21.15.177:0/290811679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc015bc90 msgr2=0x7fbbc00b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc6666640 1 --2- 172.21.15.177:0/290811679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc015bc90 0x7fbbc00b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc6666640 1 -- 172.21.15.177:0/290811679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc0145250 msgr2=0x7fbbc0143ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc6666640 1 --2- 172.21.15.177:0/290811679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc0145250 0x7fbbc0143ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc6666640 1 -- 172.21.15.177:0/290811679 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc009420 con 0x7fbbc015c070 2023-11-28T20:07:48.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7fbbc5e65640 1 --2- 172.21.15.177:0/290811679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc0145250 0x7fbbc0143ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:48.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.036+0000 7f6a8b7fe640 1 --2- 172.21.15.177:0/1380934347 >> [v2:172.21.15.195:6800/1295097681,v1:172.21.15.195:6801/1295097681] conn(0x7f6a7806e760 0x7f6a78070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7f6a8affd640 1 --2- 172.21.15.177:0/1380934347 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6a78066540 0x7f6a78068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7fb7d77fe640 1 -- 172.21.15.177:0/1872733102 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c80074e0 con 0x7fb7e015bc90 2023-11-28T20:07:48.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7fb7d77fe640 1 -- 172.21.15.177:0/1872733102 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c8007640 con 0x7fb7e015bc90 2023-11-28T20:07:48.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7fb7d77fe640 1 -- 172.21.15.177:0/1872733102 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c80049f0 con 0x7fb7e015bc90 2023-11-28T20:07:48.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7fb7e55c3640 1 -- 172.21.15.177:0/1872733102 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e013ccf0 con 0x7fb7e015bc90 2023-11-28T20:07:48.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7fb7e55c3640 1 -- 172.21.15.177:0/1872733102 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e013d2b0 con 0x7fb7e015bc90 2023-11-28T20:07:48.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7f6a8b7fe640 1 --2- 172.21.15.177:0/1380934347 >> [v2:172.21.15.195:6800/1295097681,v1:172.21.15.195:6801/1295097681] conn(0x7f6a7806e760 0x7f6a78070b80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7fbbc6666640 1 --2- 172.21.15.177:0/290811679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc015c070 0x7fbbc0161e40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8007d40 tx=0x7fbbb800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7fbbb27fc640 1 -- 172.21.15.177:0/290811679 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80039a0 con 0x7fbbc015c070 2023-11-28T20:07:48.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7fbbb27fc640 1 -- 172.21.15.177:0/290811679 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb8003b20 con 0x7fbbc015c070 2023-11-28T20:07:48.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7fbbb27fc640 1 -- 172.21.15.177:0/290811679 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8004030 con 0x7fbbc015c070 2023-11-28T20:07:48.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7fbbc80c9640 1 -- 172.21.15.177:0/290811679 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc0159f00 con 0x7fbbc015c070 2023-11-28T20:07:48.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7fbbc80c9640 1 -- 172.21.15.177:0/290811679 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc015b070 con 0x7fbbc015c070 2023-11-28T20:07:48.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7fb7e55c3640 1 -- 172.21.15.177:0/1872733102 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7e0069440 con 0x7fb7e015bc90 2023-11-28T20:07:48.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7fbbc80c9640 1 -- 172.21.15.177:0/290811679 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbba8000fd0 con 0x7fbbc015c070 2023-11-28T20:07:48.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7fb7d77fe640 1 -- 172.21.15.177:0/1872733102 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb7c8004b50 con 0x7fb7e015bc90 2023-11-28T20:07:48.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7f6a737fe640 1 -- 172.21.15.177:0/1380934347 <== osd.5 v2:172.21.15.195:6800/1295097681 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6a78071230 con 0x7f6a7806e760 2023-11-28T20:07:48.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7f531e499640 1 --2- 172.21.15.177:0/1121323955 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f52fc0664c0 0x7f52fc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.040+0000 7fbbb27fc640 1 -- 172.21.15.177:0/290811679 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbbb8004190 con 0x7fbbc015c070 2023-11-28T20:07:48.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7f531dc98640 1 --2- 172.21.15.177:0/1121323955 >> [v2:172.21.15.195:6816/1289013754,v1:172.21.15.195:6817/1289013754] conn(0x7f52fc06e6e0 0x7f52fc070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7fb7d77fe640 1 --2- 172.21.15.177:0/1872733102 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb7c0066540 0x7fb7c0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7f6a8affd640 1 --2- 172.21.15.177:0/1380934347 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6a78066540 0x7f6a78068a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009b80 tx=0x7f6a7c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7fbbb27fc640 1 --2- 172.21.15.177:0/290811679 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbba4066540 0x7fbba4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7fb7deffd640 1 --2- 172.21.15.177:0/1872733102 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb7c0066540 0x7fb7c0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7f531dc98640 1 --2- 172.21.15.177:0/1121323955 >> [v2:172.21.15.195:6816/1289013754,v1:172.21.15.195:6817/1289013754] conn(0x7f52fc06e6e0 0x7f52fc070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7fbbb27fc640 1 -- 172.21.15.177:0/290811679 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbb8083d10 con 0x7fbbc015c070 2023-11-28T20:07:48.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7f531e499640 1 --2- 172.21.15.177:0/1121323955 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f52fc0664c0 0x7f52fc068980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5308007fd0 tx=0x7f5308009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7fbbb27fc640 1 --2- 172.21.15.177:0/290811679 >> [v2:172.21.15.195:6824/1875951680,v1:172.21.15.195:6825/1875951680] conn(0x7fbba406e6e0 0x7fbba4070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7fbbb27fc640 1 -- 172.21.15.177:0/290811679 --> [v2:172.21.15.195:6824/1875951680,v1:172.21.15.195:6825/1875951680] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbba40711b0 con 0x7fbba406e6e0 2023-11-28T20:07:48.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7fb7d77fe640 1 -- 172.21.15.177:0/1872733102 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7c8083300 con 0x7fb7e015bc90 2023-11-28T20:07:48.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7fb7deffd640 1 --2- 172.21.15.177:0/1872733102 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb7c0066540 0x7fb7c0068a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb7e01fd4a0 tx=0x7fb7d0007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7f530effd640 1 -- 172.21.15.177:0/1121323955 <== osd.6 v2:172.21.15.195:6816/1289013754 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f52fc0711b0 con 0x7f52fc06e6e0 2023-11-28T20:07:48.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7fb7d77fe640 1 --2- 172.21.15.177:0/1872733102 >> [v2:172.21.15.195:6808/3998424383,v1:172.21.15.195:6809/3998424383] conn(0x7fb7c006e760 0x7fb7c0070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7fbbc5e65640 1 --2- 172.21.15.177:0/290811679 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbba4066540 0x7fbba4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7fb7d77fe640 1 -- 172.21.15.177:0/1872733102 --> [v2:172.21.15.195:6808/3998424383,v1:172.21.15.195:6809/3998424383] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7c0071230 con 0x7fb7c006e760 2023-11-28T20:07:48.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7fb7d77fe640 1 -- 172.21.15.177:0/1872733102 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7c80858c0 con 0x7fb7e015bc90 2023-11-28T20:07:48.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7fbbb27fc640 1 -- 172.21.15.177:0/290811679 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbb8003ed0 con 0x7fbbc015c070 2023-11-28T20:07:48.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7fb7df7fe640 1 --2- 172.21.15.177:0/1872733102 >> [v2:172.21.15.195:6808/3998424383,v1:172.21.15.195:6809/3998424383] conn(0x7fb7c006e760 0x7fb7c0070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.044+0000 7fbbc5664640 1 --2- 172.21.15.177:0/290811679 >> [v2:172.21.15.195:6824/1875951680,v1:172.21.15.195:6825/1875951680] conn(0x7fbba406e6e0 0x7fbba4070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.048+0000 7fb7df7fe640 1 --2- 172.21.15.177:0/1872733102 >> [v2:172.21.15.195:6808/3998424383,v1:172.21.15.195:6809/3998424383] conn(0x7fb7c006e760 0x7fb7c0070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.048+0000 7fbbc5e65640 1 --2- 172.21.15.177:0/290811679 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbba4066540 0x7fbba4068a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0097c0 tx=0x7fbbbc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.048+0000 7fbbc5664640 1 --2- 172.21.15.177:0/290811679 >> [v2:172.21.15.195:6824/1875951680,v1:172.21.15.195:6825/1875951680] conn(0x7fbba406e6e0 0x7fbba4070b00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.048+0000 7fb7d77fe640 1 -- 172.21.15.177:0/1872733102 <== osd.4 v2:172.21.15.195:6808/3998424383 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb7c0071230 con 0x7fb7c006e760 2023-11-28T20:07:48.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.048+0000 7fbbb27fc640 1 -- 172.21.15.177:0/290811679 <== osd.7 v2:172.21.15.195:6824/1875951680 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbba40711b0 con 0x7fbba406e6e0 2023-11-28T20:07:48.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.052+0000 7fbdf9965640 1 -- 172.21.15.177:0/2099833319 --> [v2:172.21.15.177:6800/3095629541,v1:172.21.15.177:6801/3095629541] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbdf4070320 con 0x7fbde0072b70 2023-11-28T20:07:48.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.052+0000 7fbddbfff640 1 -- 172.21.15.177:0/2099833319 <== osd.0 v2:172.21.15.177:6800/3095629541 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbde8001320 con 0x7fbde0072b70 2023-11-28T20:07:48.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.056+0000 7fbdf9965640 1 -- 172.21.15.177:0/2099833319 >> [v2:172.21.15.177:6800/3095629541,v1:172.21.15.177:6801/3095629541] conn(0x7fbde0072b70 msgr2=0x7fbde0074f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.056+0000 7fbdf9965640 1 --2- 172.21.15.177:0/2099833319 >> [v2:172.21.15.177:6800/3095629541,v1:172.21.15.177:6801/3095629541] conn(0x7fbde0072b70 0x7fbde0074f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.056+0000 7fbdf9965640 1 -- 172.21.15.177:0/2099833319 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbde006a950 msgr2=0x7fbde006ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.056+0000 7fbdf9965640 1 --2- 172.21.15.177:0/2099833319 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbde006a950 0x7fbde006ce10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbde400b680 tx=0x7fbde4005b10 comp rx=0 tx=0).stop 2023-11-28T20:07:48.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.056+0000 7fbdf9965640 1 -- 172.21.15.177:0/2099833319 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdf40d0b60 msgr2=0x7fbdf40b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.056+0000 7fbdf9965640 1 --2- 172.21.15.177:0/2099833319 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdf40d0b60 0x7fbdf40b2750 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0b0040 tx=0x7fbdec0195f0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.056+0000 7fbdf3fff640 1 -- 172.21.15.177:0/2099833319 reap_dead start 2023-11-28T20:07:48.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.056+0000 7fbdf9965640 1 -- 172.21.15.177:0/2099833319 shutdown_connections 2023-11-28T20:07:48.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.056+0000 7fbdf9965640 1 -- 172.21.15.177:0/2099833319 >> 172.21.15.177:0/2099833319 conn(0x7fbdf406dc90 msgr2=0x7fbdf4147bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.056+0000 7f56faba7640 1 -- 172.21.15.177:0/2319327327 --> [v2:172.21.15.177:6824/1722845469,v1:172.21.15.177:6825/1722845469] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f56f4070710 con 0x7f56d806f320 2023-11-28T20:07:48.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.056+0000 7fd514ff9640 1 -- 172.21.15.177:0/3744867450 --> [v2:172.21.15.177:6816/1088546159,v1:172.21.15.177:6817/1088546159] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd500002cc0 con 0x7fd50806e710 2023-11-28T20:07:48.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.056+0000 7fbdf9965640 1 -- 172.21.15.177:0/2099833319 shutdown_connections 2023-11-28T20:07:48.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.056+0000 7fbdf9965640 1 -- 172.21.15.177:0/2099833319 wait complete. 2023-11-28T20:07:48.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.056+0000 7f56ea7fc640 1 -- 172.21.15.177:0/2319327327 <== osd.1 v2:172.21.15.177:6824/1722845469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f56e4004a20 con 0x7f56d806f320 2023-11-28T20:07:48.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7fd516ffd640 1 -- 172.21.15.177:0/3744867450 <== osd.2 v2:172.21.15.177:6816/1088546159 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd500002cc0 con 0x7fd50806e710 2023-11-28T20:07:48.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7f56faba7640 1 -- 172.21.15.177:0/2319327327 >> [v2:172.21.15.177:6824/1722845469,v1:172.21.15.177:6825/1722845469] conn(0x7f56d806f320 msgr2=0x7f56d80717c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7f56faba7640 1 --2- 172.21.15.177:0/2319327327 >> [v2:172.21.15.177:6824/1722845469,v1:172.21.15.177:6825/1722845469] conn(0x7f56d806f320 0x7f56d80717c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7f56faba7640 1 -- 172.21.15.177:0/2319327327 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f56d80664f0 msgr2=0x7f56d80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7f56faba7640 1 --2- 172.21.15.177:0/2319327327 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f56d80664f0 0x7f56d80689b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f56f00b2000 tx=0x7f56f00ab000 comp rx=0 tx=0).stop 2023-11-28T20:07:48.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7f56faba7640 1 -- 172.21.15.177:0/2319327327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56f4158f50 msgr2=0x7f56f406cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7f56faba7640 1 --2- 172.21.15.177:0/2319327327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56f4158f50 0x7f56f406cc20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00c7f0 tx=0x7f56ec00ccb0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7f56fa3a6640 1 -- 172.21.15.177:0/2319327327 reap_dead start 2023-11-28T20:07:48.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7fd514ff9640 1 -- 172.21.15.177:0/3744867450 >> [v2:172.21.15.177:6816/1088546159,v1:172.21.15.177:6817/1088546159] conn(0x7fd50806e710 msgr2=0x7fd508070b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7fd514ff9640 1 --2- 172.21.15.177:0/3744867450 >> [v2:172.21.15.177:6816/1088546159,v1:172.21.15.177:6817/1088546159] conn(0x7fd50806e710 0x7fd508070b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7f56faba7640 1 -- 172.21.15.177:0/2319327327 shutdown_connections 2023-11-28T20:07:48.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7f56faba7640 1 -- 172.21.15.177:0/2319327327 >> 172.21.15.177:0/2319327327 conn(0x7f56f40b0920 msgr2=0x7f56f41512a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7fd514ff9640 1 -- 172.21.15.177:0/3744867450 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd5080664f0 msgr2=0x7fd5080689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7fd514ff9640 1 --2- 172.21.15.177:0/3744867450 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd5080664f0 0x7fd5080689b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5280643d0 tx=0x7fd52806d040 comp rx=0 tx=0).stop 2023-11-28T20:07:48.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7f56faba7640 1 -- 172.21.15.177:0/2319327327 shutdown_connections 2023-11-28T20:07:48.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7f56faba7640 1 -- 172.21.15.177:0/2319327327 wait complete. 2023-11-28T20:07:48.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7fd514ff9640 1 -- 172.21.15.177:0/3744867450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd520057ae0 msgr2=0x7fd52003e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7fd514ff9640 1 --2- 172.21.15.177:0/3744867450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd520057ae0 0x7fd52003e320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0ab000 tx=0x7fd51c01ad30 comp rx=0 tx=0).stop 2023-11-28T20:07:48.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.060+0000 7fd526d9d640 1 -- 172.21.15.177:0/3744867450 reap_dead start 2023-11-28T20:07:48.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.064+0000 7fd514ff9640 1 -- 172.21.15.177:0/3744867450 shutdown_connections 2023-11-28T20:07:48.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.064+0000 7fd514ff9640 1 -- 172.21.15.177:0/3744867450 >> 172.21.15.177:0/3744867450 conn(0x7fd5200559c0 msgr2=0x7fd5200e1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.064+0000 7fd514ff9640 1 -- 172.21.15.177:0/3744867450 shutdown_connections 2023-11-28T20:07:48.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.064+0000 7fd514ff9640 1 -- 172.21.15.177:0/3744867450 wait complete. 2023-11-28T20:07:48.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.064+0000 7f0b88b96640 1 -- 172.21.15.177:0/721536065 --> [v2:172.21.15.177:6808/3088892220,v1:172.21.15.177:6809/3088892220] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0b68002cc0 con 0x7f0b6406e6e0 2023-11-28T20:07:48.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.068+0000 7f0b7affd640 1 -- 172.21.15.177:0/721536065 <== osd.3 v2:172.21.15.177:6808/3088892220 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0b68002cc0 con 0x7f0b6406e6e0 2023-11-28T20:07:48.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f0b88b96640 1 -- 172.21.15.177:0/721536065 >> [v2:172.21.15.177:6808/3088892220,v1:172.21.15.177:6809/3088892220] conn(0x7f0b6406e6e0 msgr2=0x7f0b64070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f0b88b96640 1 --2- 172.21.15.177:0/721536065 >> [v2:172.21.15.177:6808/3088892220,v1:172.21.15.177:6809/3088892220] conn(0x7f0b6406e6e0 0x7f0b64070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f0b88b96640 1 -- 172.21.15.177:0/721536065 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0b640664c0 msgr2=0x7f0b64068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f0b88b96640 1 --2- 172.21.15.177:0/721536065 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0b640664c0 0x7f0b64068980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0b8414afa0 tx=0x7f0b6c009040 comp rx=0 tx=0).stop 2023-11-28T20:07:48.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f0b88b96640 1 -- 172.21.15.177:0/721536065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b84159490 msgr2=0x7f0b840b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f0b88b96640 1 --2- 172.21.15.177:0/721536065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b84159490 0x7f0b840b1db0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400e930 tx=0x7f0b7400edf0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f0b82d9d640 1 -- 172.21.15.177:0/721536065 reap_dead start 2023-11-28T20:07:48.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f0b88b96640 1 -- 172.21.15.177:0/721536065 shutdown_connections 2023-11-28T20:07:48.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f6a9169e640 1 -- 172.21.15.177:0/1380934347 --> [v2:172.21.15.195:6800/1295097681,v1:172.21.15.195:6801/1295097681] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6a8c069440 con 0x7f6a7806e760 2023-11-28T20:07:48.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f0b88b96640 1 -- 172.21.15.177:0/721536065 >> 172.21.15.177:0/721536065 conn(0x7f0b8406c2c0 msgr2=0x7f0b840cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f0b88b96640 1 -- 172.21.15.177:0/721536065 shutdown_connections 2023-11-28T20:07:48.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f0b88b96640 1 -- 172.21.15.177:0/721536065 wait complete. 2023-11-28T20:07:48.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7fb7e55c3640 1 -- 172.21.15.177:0/1872733102 --> [v2:172.21.15.195:6808/3998424383,v1:172.21.15.195:6809/3998424383] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb7e013d760 con 0x7fb7c006e760 2023-11-28T20:07:48.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f6a737fe640 1 -- 172.21.15.177:0/1380934347 <== osd.5 v2:172.21.15.195:6800/1295097681 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6a8c069440 con 0x7f6a7806e760 2023-11-28T20:07:48.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7fb7d77fe640 1 -- 172.21.15.177:0/1872733102 <== osd.4 v2:172.21.15.195:6808/3998424383 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb7e013d760 con 0x7fb7c006e760 2023-11-28T20:07:48.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f6a9169e640 1 -- 172.21.15.177:0/1380934347 >> [v2:172.21.15.195:6800/1295097681,v1:172.21.15.195:6801/1295097681] conn(0x7f6a7806e760 msgr2=0x7f6a78070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f6a9169e640 1 --2- 172.21.15.177:0/1380934347 >> [v2:172.21.15.195:6800/1295097681,v1:172.21.15.195:6801/1295097681] conn(0x7f6a7806e760 0x7f6a78070b80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f6a9169e640 1 -- 172.21.15.177:0/1380934347 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6a78066540 msgr2=0x7f6a78068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f6a9169e640 1 --2- 172.21.15.177:0/1380934347 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6a78066540 0x7f6a78068a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009b80 tx=0x7f6a7c009190 comp rx=0 tx=0).stop 2023-11-28T20:07:48.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f6a9169e640 1 -- 172.21.15.177:0/1380934347 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a8c159490 msgr2=0x7f6a8c0b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.072+0000 7f6a9169e640 1 --2- 172.21.15.177:0/1380934347 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a8c159490 0x7f6a8c0b3010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000c430 tx=0x7f6a8000c8f0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7f6a8b7fe640 1 -- 172.21.15.177:0/1380934347 reap_dead start 2023-11-28T20:07:48.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7f6a9169e640 1 -- 172.21.15.177:0/1380934347 shutdown_connections 2023-11-28T20:07:48.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7f6a9169e640 1 -- 172.21.15.177:0/1380934347 >> 172.21.15.177:0/1380934347 conn(0x7f6a8c06c2c0 msgr2=0x7f6a8c167060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7fb7e55c3640 1 -- 172.21.15.177:0/1872733102 >> [v2:172.21.15.195:6808/3998424383,v1:172.21.15.195:6809/3998424383] conn(0x7fb7c006e760 msgr2=0x7fb7c0070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7fb7e55c3640 1 --2- 172.21.15.177:0/1872733102 >> [v2:172.21.15.195:6808/3998424383,v1:172.21.15.195:6809/3998424383] conn(0x7fb7c006e760 0x7fb7c0070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7f6a9169e640 1 -- 172.21.15.177:0/1380934347 shutdown_connections 2023-11-28T20:07:48.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7f6a9169e640 1 -- 172.21.15.177:0/1380934347 wait complete. 2023-11-28T20:07:48.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7fb7e55c3640 1 -- 172.21.15.177:0/1872733102 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb7c0066540 msgr2=0x7fb7c0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7f53206fd640 1 -- 172.21.15.177:0/1121323955 --> [v2:172.21.15.195:6816/1289013754,v1:172.21.15.195:6817/1289013754] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f53180b3990 con 0x7f52fc06e6e0 2023-11-28T20:07:48.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7fb7e55c3640 1 --2- 172.21.15.177:0/1872733102 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb7c0066540 0x7fb7c0068a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb7e01fd4a0 tx=0x7fb7d0007e40 comp rx=0 tx=0).stop 2023-11-28T20:07:48.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7fb7e55c3640 1 -- 172.21.15.177:0/1872733102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7e015bc90 msgr2=0x7fb7e0162380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7fb7e55c3640 1 --2- 172.21.15.177:0/1872733102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7e015bc90 0x7fb7e0162380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800c450 tx=0x7fb7c800c910 comp rx=0 tx=0).stop 2023-11-28T20:07:48.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7fbbc80c9640 1 -- 172.21.15.177:0/290811679 --> [v2:172.21.15.195:6824/1875951680,v1:172.21.15.195:6825/1875951680] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbba8002cc0 con 0x7fbba406e6e0 2023-11-28T20:07:48.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7fb7df7fe640 1 -- 172.21.15.177:0/1872733102 reap_dead start 2023-11-28T20:07:48.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7fb7e55c3640 1 -- 172.21.15.177:0/1872733102 shutdown_connections 2023-11-28T20:07:48.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7fb7e55c3640 1 -- 172.21.15.177:0/1872733102 >> 172.21.15.177:0/1872733102 conn(0x7fb7e006a530 msgr2=0x7fb7e00b04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7fb7e55c3640 1 -- 172.21.15.177:0/1872733102 shutdown_connections 2023-11-28T20:07:48.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7f530effd640 1 -- 172.21.15.177:0/1121323955 <== osd.6 v2:172.21.15.195:6816/1289013754 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5314004040 con 0x7f52fc06e6e0 2023-11-28T20:07:48.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7fbbb27fc640 1 -- 172.21.15.177:0/290811679 <== osd.7 v2:172.21.15.195:6824/1875951680 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbba8002cc0 con 0x7fbba406e6e0 2023-11-28T20:07:48.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7fb7e55c3640 1 -- 172.21.15.177:0/1872733102 wait complete. 2023-11-28T20:07:48.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7fbbc80c9640 1 -- 172.21.15.177:0/290811679 >> [v2:172.21.15.195:6824/1875951680,v1:172.21.15.195:6825/1875951680] conn(0x7fbba406e6e0 msgr2=0x7fbba4070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.076+0000 7fbbc80c9640 1 --2- 172.21.15.177:0/290811679 >> [v2:172.21.15.195:6824/1875951680,v1:172.21.15.195:6825/1875951680] conn(0x7fbba406e6e0 0x7fbba4070b00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7fbbc80c9640 1 -- 172.21.15.177:0/290811679 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbba4066540 msgr2=0x7fbba4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7fbbc80c9640 1 --2- 172.21.15.177:0/290811679 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbba4066540 0x7fbba4068a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0097c0 tx=0x7fbbbc0a7000 comp rx=0 tx=0).stop 2023-11-28T20:07:48.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7fbbc80c9640 1 -- 172.21.15.177:0/290811679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc015c070 msgr2=0x7fbbc0161e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7fbbc80c9640 1 --2- 172.21.15.177:0/290811679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc015c070 0x7fbbc0161e40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8007d40 tx=0x7fbbb800e4b0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7fbbc6666640 1 -- 172.21.15.177:0/290811679 reap_dead start 2023-11-28T20:07:48.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7fbbc80c9640 1 -- 172.21.15.177:0/290811679 shutdown_connections 2023-11-28T20:07:48.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7fbbc80c9640 1 -- 172.21.15.177:0/290811679 >> 172.21.15.177:0/290811679 conn(0x7fbbc006a530 msgr2=0x7fbbc00b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7fbbc80c9640 1 -- 172.21.15.177:0/290811679 shutdown_connections 2023-11-28T20:07:48.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7fbbc80c9640 1 -- 172.21.15.177:0/290811679 wait complete. 2023-11-28T20:07:48.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7f53206fd640 1 -- 172.21.15.177:0/1121323955 >> [v2:172.21.15.195:6816/1289013754,v1:172.21.15.195:6817/1289013754] conn(0x7f52fc06e6e0 msgr2=0x7f52fc070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7f53206fd640 1 --2- 172.21.15.177:0/1121323955 >> [v2:172.21.15.195:6816/1289013754,v1:172.21.15.195:6817/1289013754] conn(0x7f52fc06e6e0 0x7f52fc070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7f53206fd640 1 -- 172.21.15.177:0/1121323955 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f52fc0664c0 msgr2=0x7f52fc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7f53206fd640 1 --2- 172.21.15.177:0/1121323955 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f52fc0664c0 0x7f52fc068980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5308007fd0 tx=0x7f5308009040 comp rx=0 tx=0).stop 2023-11-28T20:07:48.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7f53206fd640 1 -- 172.21.15.177:0/1121323955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53180cfe90 msgr2=0x7f5318154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7f53206fd640 1 --2- 172.21.15.177:0/1121323955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53180cfe90 0x7f5318154ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5310002200 tx=0x7f531000cb90 comp rx=0 tx=0).stop 2023-11-28T20:07:48.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7f531ec9a640 1 -- 172.21.15.177:0/1121323955 reap_dead start 2023-11-28T20:07:48.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7f53206fd640 1 -- 172.21.15.177:0/1121323955 shutdown_connections 2023-11-28T20:07:48.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.080+0000 7f53206fd640 1 -- 172.21.15.177:0/1121323955 >> 172.21.15.177:0/1121323955 conn(0x7f531809c4b0 msgr2=0x7f53180b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.084+0000 7f53206fd640 1 -- 172.21.15.177:0/1121323955 shutdown_connections 2023-11-28T20:07:48.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.084+0000 7f53206fd640 1 -- 172.21.15.177:0/1121323955 wait complete. 2023-11-28T20:07:48.113 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-28T20:07:48.114 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T20:07:48.115 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-11-28T20:07:48.115 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T20:07:48.116 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-28T20:07:48.116 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T20:07:48.120 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-28T20:07:48.120 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T20:07:48.123 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-11-28T20:07:48.124 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T20:07:48.133 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-11-28T20:07:48.133 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-11-28T20:07:48.134 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T20:07:48.134 INFO:teuthology.orchestra.run.smithi177.stdout:55834574855 2023-11-28T20:07:48.135 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T20:07:48.136 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T20:07:48.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.332+0000 7fb02513e640 1 Processor -- start 2023-11-28T20:07:48.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.332+0000 7fb02513e640 1 -- start start 2023-11-28T20:07:48.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.332+0000 7fb02513e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb02015cdb0 0x7fb0200cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fb02513e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb02015d190 0x7fb02015d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fb02513e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0200ce840 con 0x7fb020159490 2023-11-28T20:07:48.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fb02513e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0200ce560 con 0x7fb02015d190 2023-11-28T20:07:48.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fb02513e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb020070f80 con 0x7fb02015cdb0 2023-11-28T20:07:48.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fb01ed9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb02015cdb0 0x7fb0200cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fb01f59e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb02015d190 0x7fb02015d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fb01e59c640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb020159490 0x7fb0200b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:41294/0 (socket says 172.21.15.177:41294) 2023-11-28T20:07:48.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fb01e59c640 1 -- 172.21.15.177:0/2665142414 learned_addr learned my addr 172.21.15.177:0/2665142414 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:48.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fe257fff640 1 Processor -- start 2023-11-28T20:07:48.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fe257fff640 1 -- start start 2023-11-28T20:07:48.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fb01dd9b640 1 -- 172.21.15.177:0/2665142414 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085659745 0 0) 0x7fb0200ce840 con 0x7fb020159490 2023-11-28T20:07:48.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fb01dd9b640 1 -- 172.21.15.177:0/2665142414 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb008007940 con 0x7fb020159490 2023-11-28T20:07:48.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fb01f59e640 1 -- 172.21.15.177:0/2665142414 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb02015cdb0 msgr2=0x7fb0200cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fb01f59e640 1 --2- 172.21.15.177:0/2665142414 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb02015cdb0 0x7fb0200cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fb01f59e640 1 -- 172.21.15.177:0/2665142414 >> v1:172.21.15.195:6789/0 conn(0x7fb020159490 legacy=0x7fb0200b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.336+0000 7fb01f59e640 1 -- 172.21.15.177:0/2665142414 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb020071260 con 0x7fb02015d190 2023-11-28T20:07:48.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fed54432640 1 Processor -- start 2023-11-28T20:07:48.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fed54432640 1 -- start start 2023-11-28T20:07:48.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7f3b82679640 1 Processor -- start 2023-11-28T20:07:48.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe257fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe25806d030 0x7fe2580713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe257fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe258071910 0x7fe2580b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe257fff640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2581625e0 con 0x7fe25814af30 2023-11-28T20:07:48.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe257fff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2581619f0 con 0x7fe258071910 2023-11-28T20:07:48.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe257fff640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25814b310 con 0x7fe25806d030 2023-11-28T20:07:48.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe256ffd640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fe25814af30 0x7fe25806c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:41308/0 (socket says 172.21.15.177:41308) 2023-11-28T20:07:48.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe256ffd640 1 -- 172.21.15.177:0/229062672 learned_addr learned my addr 172.21.15.177:0/229062672 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:48.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 -- 172.21.15.177:0/229062672 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444103041 0 0) 0x7fe2581625e0 con 0x7fe25814af30 2023-11-28T20:07:48.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe2577fe640 1 --2- 172.21.15.177:0/229062672 >> v2:172.21.15.177:3300/0 conn(0x7fe258071910 0x7fe2580b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 -- 172.21.15.177:0/229062672 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe240003530 con 0x7fe25814af30 2023-11-28T20:07:48.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe2567fc640 1 --2- 172.21.15.177:0/229062672 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe25806d030 0x7fe2580713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 -- 172.21.15.177:0/229062672 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1306985194 0 0) 0x7fe240003530 con 0x7fe25814af30 2023-11-28T20:07:48.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 -- 172.21.15.177:0/229062672 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe25806d030 msgr2=0x7fe2580713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 --2- 172.21.15.177:0/229062672 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe25806d030 0x7fe2580713d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 -- 172.21.15.177:0/229062672 >> v2:172.21.15.177:3300/0 conn(0x7fe258071910 msgr2=0x7fe2580b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 --2- 172.21.15.177:0/229062672 >> v2:172.21.15.177:3300/0 conn(0x7fe258071910 0x7fe2580b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 -- 172.21.15.177:0/229062672 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe258161cb0 con 0x7fe25814af30 2023-11-28T20:07:48.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 -- 172.21.15.177:0/229062672 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7fe24c001680 con 0x7fe25814af30 2023-11-28T20:07:48.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 -- 172.21.15.177:0/229062672 >> v1:172.21.15.195:6789/0 conn(0x7fe25814af30 legacy=0x7fe25806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 --2- 172.21.15.177:0/229062672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe240003980 0x7fe240003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 --2- 172.21.15.177:0/229062672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2400047d0 0x7fe240004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 --2- 172.21.15.177:0/229062672 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe25806d030 0x7fe240005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 -- 172.21.15.177:0/229062672 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2581619f0 con 0x7fe240003980 2023-11-28T20:07:48.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 -- 172.21.15.177:0/229062672 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25814b310 con 0x7fe2400047d0 2023-11-28T20:07:48.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe255ffb640 1 -- 172.21.15.177:0/229062672 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24000bbd0 con 0x7fe25806d030 2023-11-28T20:07:48.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7f3b82679640 1 -- start start 2023-11-28T20:07:48.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fed54432640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fed4c06c9d0 0x7fed4c145250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fed54432640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fed4c15c070 0x7fed4c145790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fed54432640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c145fc0 con 0x7fed4c15bc90 2023-11-28T20:07:48.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fed54432640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c1462a0 con 0x7fed4c06c9d0 2023-11-28T20:07:48.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fed54432640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c146580 con 0x7fed4c15c070 2023-11-28T20:07:48.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe2567fc640 1 --2- 172.21.15.177:0/229062672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2400047d0 0x7fe240004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe2577fe640 1 --2- 172.21.15.177:0/229062672 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe25806d030 0x7fe240005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe256ffd640 1 --2- 172.21.15.177:0/229062672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe240003980 0x7fe240003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe256ffd640 1 -- 172.21.15.177:0/229062672 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe25806d030 msgr2=0x7fe240005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe256ffd640 1 --2- 172.21.15.177:0/229062672 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe25806d030 0x7fe240005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe256ffd640 1 -- 172.21.15.177:0/229062672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2400047d0 msgr2=0x7fe240004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fb01f59e640 1 --2- 172.21.15.177:0/2665142414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb02015d190 0x7fb02015d5f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb0100097c0 tx=0x7fb010024d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c064c0b92bde6ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fed529cf640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fed4c15c070 0x7fed4c145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fed521ce640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fed4c15bc90 0x7fed4c06c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:41318/0 (socket says 172.21.15.177:41318) 2023-11-28T20:07:48.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fb01dd9b640 1 -- 172.21.15.177:0/2665142414 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100ade00 con 0x7fb02015d190 2023-11-28T20:07:48.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fb01dd9b640 1 -- 172.21.15.177:0/2665142414 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0100b5440 con 0x7fb02015d190 2023-11-28T20:07:48.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fb01dd9b640 1 -- 172.21.15.177:0/2665142414 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100b57d0 con 0x7fb02015d190 2023-11-28T20:07:48.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fb02513e640 1 -- 172.21.15.177:0/2665142414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb02015d190 msgr2=0x7fb02015d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fb02513e640 1 --2- 172.21.15.177:0/2665142414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb02015d190 0x7fb02015d5f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb0100097c0 tx=0x7fb010024d50 comp rx=0 tx=0).stop 2023-11-28T20:07:48.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe256ffd640 1 --2- 172.21.15.177:0/229062672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2400047d0 0x7fe240004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fe256ffd640 1 -- 172.21.15.177:0/229062672 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe258161cb0 con 0x7fe240003980 2023-11-28T20:07:48.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fe2567fc640 1 --2- 172.21.15.177:0/229062672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2400047d0 0x7fe240004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:07:48.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fb02513e640 1 -- 172.21.15.177:0/2665142414 shutdown_connections 2023-11-28T20:07:48.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fb02513e640 1 --2- 172.21.15.177:0/2665142414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb02015d190 0x7fb02015d5f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fb02513e640 1 --2- 172.21.15.177:0/2665142414 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb02015cdb0 0x7fb0200cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fb02513e640 1 -- 172.21.15.177:0/2665142414 >> 172.21.15.177:0/2665142414 conn(0x7fb02006c2c0 msgr2=0x7fb02006c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fb02513e640 1 -- 172.21.15.177:0/2665142414 shutdown_connections 2023-11-28T20:07:48.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fb02513e640 1 -- 172.21.15.177:0/2665142414 wait complete. 2023-11-28T20:07:48.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7f3b82679640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3b7c15cdb0 0x7f3b7c0cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7f3b7bfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3b7c15cdb0 0x7f3b7c0cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7f3b82679640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3b7c15d190 0x7f3b7c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7f3b82679640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7c0ce840 con 0x7f3b7c159490 2023-11-28T20:07:48.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7f3b82679640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7c0ce560 con 0x7f3b7c15d190 2023-11-28T20:07:48.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7f3b82679640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7c070f80 con 0x7f3b7c15cdb0 2023-11-28T20:07:48.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.340+0000 7fed521ce640 1 -- 172.21.15.177:0/1536909013 learned_addr learned my addr 172.21.15.177:0/1536909013 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:48.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fed529cf640 1 -- 172.21.15.177:0/1536909013 >> v2:172.21.15.177:3300/0 conn(0x7fed4c06c9d0 msgr2=0x7fed4c145250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fed529cf640 1 --2- 172.21.15.177:0/1536909013 >> v2:172.21.15.177:3300/0 conn(0x7fed4c06c9d0 0x7fed4c145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fed529cf640 1 -- 172.21.15.177:0/1536909013 >> v1:172.21.15.195:6789/0 conn(0x7fed4c15bc90 legacy=0x7fed4c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.344+0000 7fed529cf640 1 -- 172.21.15.177:0/1536909013 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c146860 con 0x7fed4c15c070 2023-11-28T20:07:48.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7f3b7bfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3b7c15cdb0 0x7f3b7c0cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53376/0 (socket says 172.21.15.177:53376) 2023-11-28T20:07:48.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7f3b7bfff640 1 -- 172.21.15.177:0/1523449076 learned_addr learned my addr 172.21.15.177:0/1523449076 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fe256ffd640 1 --2- 172.21.15.177:0/229062672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe240003980 0x7fe240003da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00c290 tx=0x7fe24c01cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f1e4c7bfffe8fb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fe255ffb640 1 -- 172.21.15.177:0/229062672 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c005ae0 con 0x7fe240003980 2023-11-28T20:07:48.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7f3b80c16640 1 --2- 172.21.15.177:0/1523449076 >> v2:172.21.15.177:3300/0 conn(0x7f3b7c15d190 0x7f3b7c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fb02513e640 1 Processor -- start 2023-11-28T20:07:48.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fe255ffb640 1 -- 172.21.15.177:0/229062672 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c005c60 con 0x7fe240003980 2023-11-28T20:07:48.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fe255ffb640 1 -- 172.21.15.177:0/229062672 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c0a5aa0 con 0x7fe240003980 2023-11-28T20:07:48.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fed529cf640 1 --2- 172.21.15.177:0/1536909013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed4c15c070 0x7fed4c145790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0097c0 tx=0x7fed3c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3316f73985269ad3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fb02513e640 1 -- start start 2023-11-28T20:07:48.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7f3b80c16640 1 -- 172.21.15.177:0/1523449076 >> v2:172.21.15.195:3300/0 conn(0x7f3b7c15cdb0 msgr2=0x7f3b7c0cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fed511cc640 1 -- 172.21.15.177:0/1536909013 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0ad660 con 0x7fed4c15c070 2023-11-28T20:07:48.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7f3b80c16640 1 --2- 172.21.15.177:0/1523449076 >> v2:172.21.15.195:3300/0 conn(0x7f3b7c15cdb0 0x7f3b7c0cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fed511cc640 1 -- 172.21.15.177:0/1536909013 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c0ad7c0 con 0x7fed4c15c070 2023-11-28T20:07:48.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fe257fff640 1 -- 172.21.15.177:0/229062672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe240003980 msgr2=0x7fe240003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fe257fff640 1 --2- 172.21.15.177:0/229062672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe240003980 0x7fe240003da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00c290 tx=0x7fe24c01cc90 comp rx=0 tx=0).stop 2023-11-28T20:07:48.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fe2577fe640 1 -- 172.21.15.177:0/229062672 reap_dead start 2023-11-28T20:07:48.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fe257fff640 1 -- 172.21.15.177:0/229062672 shutdown_connections 2023-11-28T20:07:48.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fe257fff640 1 -- 172.21.15.177:0/229062672 >> 172.21.15.177:0/229062672 conn(0x7fe25806a930 msgr2=0x7fe25806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fed511cc640 1 -- 172.21.15.177:0/1536909013 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0adb50 con 0x7fed4c15c070 2023-11-28T20:07:48.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7f3b80c16640 1 -- 172.21.15.177:0/1523449076 >> v1:172.21.15.195:6789/0 conn(0x7f3b7c159490 legacy=0x7f3b7c0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fb02513e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb020159490 0x7fb020154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb02513e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02015cdb0 0x7fb020150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7f3b80c16640 1 -- 172.21.15.177:0/1523449076 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c071260 con 0x7f3b7c15d190 2023-11-28T20:07:48.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fed54432640 1 -- 172.21.15.177:0/1536909013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed4c15c070 msgr2=0x7fed4c145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fed54432640 1 --2- 172.21.15.177:0/1536909013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed4c15c070 0x7fed4c145790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0097c0 tx=0x7fed3c01c3c0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fed54432640 1 -- 172.21.15.177:0/1536909013 shutdown_connections 2023-11-28T20:07:48.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fed54432640 1 --2- 172.21.15.177:0/1536909013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed4c15c070 0x7fed4c145790 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fed54432640 1 --2- 172.21.15.177:0/1536909013 >> v2:172.21.15.177:3300/0 conn(0x7fed4c06c9d0 0x7fed4c145250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fed54432640 1 -- 172.21.15.177:0/1536909013 >> 172.21.15.177:0/1536909013 conn(0x7fed4c06a530 msgr2=0x7fed4c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb02513e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb02015d190 0x7fb02014ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fe257fff640 1 -- 172.21.15.177:0/229062672 shutdown_connections 2023-11-28T20:07:48.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.348+0000 7fe257fff640 1 -- 172.21.15.177:0/229062672 wait complete. 2023-11-28T20:07:48.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb02513e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb020142160 con 0x7fb02015cdb0 2023-11-28T20:07:48.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb02513e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb020152180 con 0x7fb020159490 2023-11-28T20:07:48.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb02513e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0201554a0 con 0x7fb02015d190 2023-11-28T20:07:48.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb01ed9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb020159490 0x7fb020154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb01ed9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb020159490 0x7fb020154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53382/0 (socket says 172.21.15.177:53382) 2023-11-28T20:07:48.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb01ed9d640 1 -- 172.21.15.177:0/2869969056 learned_addr learned my addr 172.21.15.177:0/2869969056 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb01e59c640 1 --2- 172.21.15.177:0/2869969056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02015cdb0 0x7fb020150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb01ed9d640 1 -- 172.21.15.177:0/2869969056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb02015d190 msgr2=0x7fb02014ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb01ed9d640 1 --2- 172.21.15.177:0/2869969056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb02015d190 0x7fb02014ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb01ed9d640 1 -- 172.21.15.177:0/2869969056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02015cdb0 msgr2=0x7fb020150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fed54432640 1 -- 172.21.15.177:0/1536909013 shutdown_connections 2023-11-28T20:07:48.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fed54432640 1 -- 172.21.15.177:0/1536909013 wait complete. 2023-11-28T20:07:48.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb01ed9d640 1 --2- 172.21.15.177:0/2869969056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02015cdb0 0x7fb020150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb01ed9d640 1 -- 172.21.15.177:0/2869969056 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb010009420 con 0x7fb020159490 2023-11-28T20:07:48.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb01e59c640 1 --2- 172.21.15.177:0/2869969056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02015cdb0 0x7fb020150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:07:48.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb01ed9d640 1 --2- 172.21.15.177:0/2869969056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb020159490 0x7fb020154ec0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb01400fa60 tx=0x7fb01400ff20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb0077fe640 1 -- 172.21.15.177:0/2869969056 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01400c070 con 0x7fb020159490 2023-11-28T20:07:48.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.352+0000 7fb0077fe640 1 -- 172.21.15.177:0/2869969056 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01400dcd0 con 0x7fb020159490 2023-11-28T20:07:48.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.356+0000 7fb0077fe640 1 -- 172.21.15.177:0/2869969056 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01401a680 con 0x7fb020159490 2023-11-28T20:07:48.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.356+0000 7fb02513e640 1 -- 172.21.15.177:0/2869969056 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb020152970 con 0x7fb020159490 2023-11-28T20:07:48.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.356+0000 7fb02513e640 1 -- 172.21.15.177:0/2869969056 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0201523b0 con 0x7fb020159490 2023-11-28T20:07:48.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.356+0000 7fe257fff640 1 Processor -- start 2023-11-28T20:07:48.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.356+0000 7f3b80c16640 1 --2- 172.21.15.177:0/1523449076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b7c15d190 0x7f3b7c15d600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0b51c0 tx=0x7f3b7401cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd0541e6f49ae3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.356+0000 7fe257fff640 1 -- start start 2023-11-28T20:07:48.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.356+0000 7fed54432640 1 Processor -- start 2023-11-28T20:07:48.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.356+0000 7fed54432640 1 -- start start 2023-11-28T20:07:48.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.356+0000 7f3b7affd640 1 -- 172.21.15.177:0/1523449076 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b740a5bd0 con 0x7f3b7c15d190 2023-11-28T20:07:48.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.356+0000 7f3b7affd640 1 -- 172.21.15.177:0/1523449076 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b740a5d30 con 0x7f3b7c15d190 2023-11-28T20:07:48.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.356+0000 7f3b7affd640 1 -- 172.21.15.177:0/1523449076 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b740a5ea0 con 0x7f3b7c15d190 2023-11-28T20:07:48.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.356+0000 7fb0077fe640 1 -- 172.21.15.177:0/2869969056 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb01401a7e0 con 0x7fb020159490 2023-11-28T20:07:48.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.356+0000 7fe257fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe240003980 0x7fe258149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fe257fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2581f9800 0x7fe2580ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fb02513e640 1 -- 172.21.15.177:0/2869969056 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb020069440 con 0x7fb020159490 2023-11-28T20:07:48.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fe256ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe240003980 0x7fe258149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fe256ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe240003980 0x7fe258149ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:35650/0 (socket says 172.21.15.177:35650) 2023-11-28T20:07:48.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fe256ffd640 1 -- 172.21.15.177:0/2698412061 learned_addr learned my addr 172.21.15.177:0/2698412061 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fe257fff640 1 --2- 172.21.15.177:0/2698412061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2580cd400 0x7fe2581fd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7f3b82679640 1 -- 172.21.15.177:0/1523449076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b7c15d190 msgr2=0x7f3b7c15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fb0077fe640 1 --2- 172.21.15.177:0/2869969056 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb00c0664a0 0x7fb00c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fb0077fe640 1 -- 172.21.15.177:0/2869969056 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb014015070 con 0x7fb020159490 2023-11-28T20:07:48.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7f3b82679640 1 --2- 172.21.15.177:0/1523449076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b7c15d190 0x7f3b7c15d600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0b51c0 tx=0x7f3b7401cae0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed54432640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed4c06c9d0 0x7fed4c1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fe2567fc640 1 --2- 172.21.15.177:0/2698412061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2581f9800 0x7fe2580ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fe257fff640 1 -- 172.21.15.177:0/2698412061 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25814a3e0 con 0x7fe2580cd400 2023-11-28T20:07:48.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fe257fff640 1 -- 172.21.15.177:0/2698412061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2580ce1b0 con 0x7fe2581f9800 2023-11-28T20:07:48.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fe2577fe640 1 --2- 172.21.15.177:0/2698412061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2580cd400 0x7fe2581fd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fe257fff640 1 -- 172.21.15.177:0/2698412061 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2580cc9e0 con 0x7fe240003980 2023-11-28T20:07:48.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7f3b82679640 1 -- 172.21.15.177:0/1523449076 shutdown_connections 2023-11-28T20:07:48.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7f3b82679640 1 --2- 172.21.15.177:0/1523449076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b7c15d190 0x7f3b7c15d600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7f3b82679640 1 --2- 172.21.15.177:0/1523449076 >> v2:172.21.15.195:3300/0 conn(0x7f3b7c15cdb0 0x7f3b7c0cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7f3b82679640 1 -- 172.21.15.177:0/1523449076 >> 172.21.15.177:0/1523449076 conn(0x7f3b7c06c2c0 msgr2=0x7f3b7c06c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7f3b82679640 1 -- 172.21.15.177:0/1523449076 shutdown_connections 2023-11-28T20:07:48.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fb01e59c640 1 --2- 172.21.15.177:0/2869969056 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb00c0664a0 0x7fb00c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7f3b82679640 1 -- 172.21.15.177:0/1523449076 wait complete. 2023-11-28T20:07:48.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed54432640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed4c15bc90 0x7fed4c161e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed54432640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed4c15c070 0x7fed4c0aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed54432640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c1646f0 con 0x7fed4c15c070 2023-11-28T20:07:48.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed54432640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c162380 con 0x7fed4c06c9d0 2023-11-28T20:07:48.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed54432640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c163d50 con 0x7fed4c15bc90 2023-11-28T20:07:48.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed521ce640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed4c06c9d0 0x7fed4c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed521ce640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed4c06c9d0 0x7fed4c1549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53406/0 (socket says 172.21.15.177:53406) 2023-11-28T20:07:48.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed521ce640 1 -- 172.21.15.177:0/899116141 learned_addr learned my addr 172.21.15.177:0/899116141 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed529cf640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed4c15c070 0x7fed4c0aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed519cd640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed4c15bc90 0x7fed4c161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed521ce640 1 -- 172.21.15.177:0/899116141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed4c15bc90 msgr2=0x7fed4c161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed521ce640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed4c15bc90 0x7fed4c161e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed521ce640 1 -- 172.21.15.177:0/899116141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed4c15c070 msgr2=0x7fed4c0aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed521ce640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed4c15c070 0x7fed4c0aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed521ce640 1 -- 172.21.15.177:0/899116141 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c009420 con 0x7fed4c06c9d0 2023-11-28T20:07:48.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed519cd640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed4c15bc90 0x7fed4c161e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:07:48.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed529cf640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed4c15c070 0x7fed4c0aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:48.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.360+0000 7fed521ce640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed4c06c9d0 0x7fed4c1549a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed4400cb40 tx=0x7fed4400a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7fe2567fc640 1 -- 172.21.15.177:0/2698412061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe240003980 msgr2=0x7fe258149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7fe2567fc640 1 --2- 172.21.15.177:0/2698412061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe240003980 0x7fe258149ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7fe2567fc640 1 -- 172.21.15.177:0/2698412061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2580cd400 msgr2=0x7fe2581fd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7fe2567fc640 1 --2- 172.21.15.177:0/2698412061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2580cd400 0x7fe2581fd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7fe2567fc640 1 -- 172.21.15.177:0/2698412061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2580af490 con 0x7fe2581f9800 2023-11-28T20:07:48.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7fb01e59c640 1 --2- 172.21.15.177:0/2869969056 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb00c0664a0 0x7fb00c068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb0200b3710 tx=0x7fb01800a040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7fe2567fc640 1 --2- 172.21.15.177:0/2698412061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2581f9800 0x7fe2580ccec0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe24800f890 tx=0x7fe24800fd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7f3b82679640 1 Processor -- start 2023-11-28T20:07:48.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7f3b82679640 1 -- start start 2023-11-28T20:07:48.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7f3b82679640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b7c159490 0x7f3b7c152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7f3b82679640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b7c15cdb0 0x7f3b7c156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7f3b7bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b7c159490 0x7f3b7c152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7f3b7bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b7c159490 0x7f3b7c152bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52900/0 (socket says 172.21.15.177:52900) 2023-11-28T20:07:48.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7f3b7bfff640 1 -- 172.21.15.177:0/3547406114 learned_addr learned my addr 172.21.15.177:0/3547406114 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7f3b82679640 1 --2- 172.21.15.177:0/3547406114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b7c15d190 0x7f3b7c14c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7f3b82679640 1 -- 172.21.15.177:0/3547406114 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c155a50 con 0x7f3b7c159490 2023-11-28T20:07:48.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7f3b82679640 1 -- 172.21.15.177:0/3547406114 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c14c680 con 0x7f3b7c15d190 2023-11-28T20:07:48.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7f3b82679640 1 -- 172.21.15.177:0/3547406114 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c1550c0 con 0x7f3b7c15cdb0 2023-11-28T20:07:48.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7f3b7b7fe640 1 --2- 172.21.15.177:0/3547406114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b7c15cdb0 0x7f3b7c156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7f3b80c16640 1 --2- 172.21.15.177:0/3547406114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b7c15d190 0x7f3b7c14c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.364+0000 7fed42ffd640 1 -- 172.21.15.177:0/899116141 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4400aca0 con 0x7fed4c06c9d0 2023-11-28T20:07:48.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7fed54432640 1 -- 172.21.15.177:0/899116141 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c164030 con 0x7fed4c06c9d0 2023-11-28T20:07:48.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7fed54432640 1 -- 172.21.15.177:0/899116141 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c162650 con 0x7fed4c06c9d0 2023-11-28T20:07:48.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7fed42ffd640 1 -- 172.21.15.177:0/899116141 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4400ae00 con 0x7fed4c06c9d0 2023-11-28T20:07:48.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7fed42ffd640 1 -- 172.21.15.177:0/899116141 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44012620 con 0x7fed4c06c9d0 2023-11-28T20:07:48.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7fe23f7fe640 1 -- 172.21.15.177:0/2698412061 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24800dbb0 con 0x7fe2581f9800 2023-11-28T20:07:48.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7fe23f7fe640 1 -- 172.21.15.177:0/2698412061 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24800c040 con 0x7fe2581f9800 2023-11-28T20:07:48.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7fe23f7fe640 1 -- 172.21.15.177:0/2698412061 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248013440 con 0x7fe2581f9800 2023-11-28T20:07:48.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7fe257fff640 1 -- 172.21.15.177:0/2698412061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2580aebf0 con 0x7fe2581f9800 2023-11-28T20:07:48.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7fe257fff640 1 -- 172.21.15.177:0/2698412061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2580af1b0 con 0x7fe2581f9800 2023-11-28T20:07:48.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7fb0077fe640 1 -- 172.21.15.177:0/2869969056 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb01401f080 con 0x7fb020159490 2023-11-28T20:07:48.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7f3b7b7fe640 1 -- 172.21.15.177:0/3547406114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b7c15d190 msgr2=0x7f3b7c14c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7f3b7b7fe640 1 --2- 172.21.15.177:0/3547406114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b7c15d190 0x7f3b7c14c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7f3b7b7fe640 1 -- 172.21.15.177:0/3547406114 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b7c159490 msgr2=0x7f3b7c152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7f3b7b7fe640 1 --2- 172.21.15.177:0/3547406114 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b7c159490 0x7f3b7c152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7f3b7b7fe640 1 -- 172.21.15.177:0/3547406114 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b74009a70 con 0x7f3b7c15cdb0 2023-11-28T20:07:48.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7f3b7b7fe640 1 --2- 172.21.15.177:0/3547406114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b7c15cdb0 0x7f3b7c156410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b70001ec0 tx=0x7f3b7000c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7fe257fff640 1 -- 172.21.15.177:0/2698412061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2580ccba0 con 0x7fe2581f9800 2023-11-28T20:07:48.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7f3b78ff9640 1 -- 172.21.15.177:0/3547406114 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b700052d0 con 0x7f3b7c15cdb0 2023-11-28T20:07:48.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7f3b78ff9640 1 -- 172.21.15.177:0/3547406114 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b70005430 con 0x7f3b7c15cdb0 2023-11-28T20:07:48.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.368+0000 7f3b78ff9640 1 -- 172.21.15.177:0/3547406114 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70003840 con 0x7f3b7c15cdb0 2023-11-28T20:07:48.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.372+0000 7fed54432640 1 -- 172.21.15.177:0/899116141 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed34005260 con 0x7fed4c06c9d0 2023-11-28T20:07:48.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.372+0000 7fed42ffd640 1 -- 172.21.15.177:0/899116141 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fed44012780 con 0x7fed4c06c9d0 2023-11-28T20:07:48.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.372+0000 7f3b82679640 1 -- 172.21.15.177:0/3547406114 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7c1531d0 con 0x7f3b7c15cdb0 2023-11-28T20:07:48.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.372+0000 7f3b82679640 1 -- 172.21.15.177:0/3547406114 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c155670 con 0x7f3b7c15cdb0 2023-11-28T20:07:48.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.372+0000 7fe23f7fe640 1 -- 172.21.15.177:0/2698412061 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe2480135a0 con 0x7fe2581f9800 2023-11-28T20:07:48.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.372+0000 7fed42ffd640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fed30066470 0x7fed30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.372+0000 7fed42ffd640 1 -- 172.21.15.177:0/899116141 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed44083d90 con 0x7fed4c06c9d0 2023-11-28T20:07:48.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.372+0000 7f3b82679640 1 -- 172.21.15.177:0/3547406114 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7c069440 con 0x7f3b7c15cdb0 2023-11-28T20:07:48.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.372+0000 7fed519cd640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fed30066470 0x7fed30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.372+0000 7fe23f7fe640 1 --2- 172.21.15.177:0/2698412061 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe244066540 0x7fe244068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.372+0000 7fe23f7fe640 1 -- 172.21.15.177:0/2698412061 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe248084570 con 0x7fe2581f9800 2023-11-28T20:07:48.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.376+0000 7fe256ffd640 1 --2- 172.21.15.177:0/2698412061 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe244066540 0x7fe244068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.376+0000 7f3b78ff9640 1 -- 172.21.15.177:0/3547406114 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b700039a0 con 0x7f3b7c15cdb0 2023-11-28T20:07:48.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.376+0000 7fed519cd640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fed30066470 0x7fed30068930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0b09c0 tx=0x7fed48009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.376+0000 7fe256ffd640 1 --2- 172.21.15.177:0/2698412061 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe244066540 0x7fe244068a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe24c000c10 tx=0x7fe24c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.376+0000 7f3b78ff9640 1 --2- 172.21.15.177:0/3547406114 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3b68066470 0x7f3b68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.376+0000 7f3b78ff9640 1 -- 172.21.15.177:0/3547406114 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b70083360 con 0x7f3b7c15cdb0 2023-11-28T20:07:48.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.376+0000 7f3b7bfff640 1 --2- 172.21.15.177:0/3547406114 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3b68066470 0x7f3b68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.376+0000 7fe23f7fe640 1 -- 172.21.15.177:0/2698412061 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe2480519d0 con 0x7fe2581f9800 2023-11-28T20:07:48.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.384+0000 7f3b7bfff640 1 --2- 172.21.15.177:0/3547406114 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3b68066470 0x7f3b68068930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c008520 tx=0x7f3b6c00d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.388+0000 7fed42ffd640 1 -- 172.21.15.177:0/899116141 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fed440512b0 con 0x7fed4c06c9d0 2023-11-28T20:07:48.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.388+0000 7f3b78ff9640 1 -- 172.21.15.177:0/3547406114 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b70050880 con 0x7f3b7c15cdb0 2023-11-28T20:07:48.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.424+0000 7f10c2df8640 1 Processor -- start 2023-11-28T20:07:48.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.424+0000 7f10c2df8640 1 -- start start 2023-11-28T20:07:48.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7f10c2df8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f10bc15cdb0 0x7f10bc0cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7f10c2df8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10bc15d190 0x7f10bc15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7f10c2df8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc0ce840 con 0x7f10bc159490 2023-11-28T20:07:48.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7f10c2df8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc0ce560 con 0x7f10bc15cdb0 2023-11-28T20:07:48.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7f10c2df8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc070f80 con 0x7f10bc15d190 2023-11-28T20:07:48.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7f10c0b94640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f10bc15cdb0 0x7f10bc0cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7f10bbfff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f10bc159490 0x7f10bc0b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:41342/0 (socket says 172.21.15.177:41342) 2023-11-28T20:07:48.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7f10bbfff640 1 -- 172.21.15.177:0/277467289 learned_addr learned my addr 172.21.15.177:0/277467289 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:48.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7f10c1395640 1 --2- 172.21.15.177:0/277467289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10bc15d190 0x7f10bc15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7f10bb7fe640 1 -- 172.21.15.177:0/277467289 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920824771 0 0) 0x7f10bc0ce840 con 0x7f10bc159490 2023-11-28T20:07:48.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7f10bb7fe640 1 -- 172.21.15.177:0/277467289 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10a4007940 con 0x7f10bc159490 2023-11-28T20:07:48.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7efc5a217640 1 Processor -- start 2023-11-28T20:07:48.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7efc5a217640 1 -- start start 2023-11-28T20:07:48.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7f10c1395640 1 -- 172.21.15.177:0/277467289 >> v2:172.21.15.195:3300/0 conn(0x7f10bc15cdb0 msgr2=0x7f10bc0cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7f10c1395640 1 --2- 172.21.15.177:0/277467289 >> v2:172.21.15.195:3300/0 conn(0x7f10bc15cdb0 0x7f10bc0cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7f10c1395640 1 -- 172.21.15.177:0/277467289 >> v1:172.21.15.195:6789/0 conn(0x7f10bc159490 legacy=0x7f10bc0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7f10c1395640 1 -- 172.21.15.177:0/277467289 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc071260 con 0x7f10bc15d190 2023-11-28T20:07:48.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7f10c0b94640 1 --2- 172.21.15.177:0/277467289 >> v2:172.21.15.195:3300/0 conn(0x7f10bc15cdb0 0x7f10bc0cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:48.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7fb9e9101640 1 Processor -- start 2023-11-28T20:07:48.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.428+0000 7fb9e9101640 1 -- start start 2023-11-28T20:07:48.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7fb9e9101640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb9e40cd7a0 0x7fb9e4159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7fb9e9101640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e406e100 con 0x7fb9e41500a0 2023-11-28T20:07:48.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7fb9e9101640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40cc740 con 0x7fb9e40ce6c0 2023-11-28T20:07:48.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7fb9e9101640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e415a650 con 0x7fb9e40cd7a0 2023-11-28T20:07:48.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7efc5a217640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efc4c04fa50 0x7efc4c04fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7efc5a217640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc4c0df360 0x7efc4c007160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7fb9e259c640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb9e40ce6c0 0x7fb9e41598e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:41344/0 (socket says 172.21.15.177:41344) 2023-11-28T20:07:48.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7efc5a217640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4c005e70 con 0x7efc4c04f590 2023-11-28T20:07:48.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7efc59215640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efc4c04fa50 0x7efc4c04fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7efc59215640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efc4c04fa50 0x7efc4c04fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52912/0 (socket says 172.21.15.177:52912) 2023-11-28T20:07:48.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7efc59215640 1 -- 172.21.15.177:0/1932457659 learned_addr learned my addr 172.21.15.177:0/1932457659 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7efc5a217640 1 -- 172.21.15.177:0/1932457659 --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4c006cd0 con 0x7efc4c04fa50 2023-11-28T20:07:48.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4aec9a7640 1 Processor -- start 2023-11-28T20:07:48.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7efc5a217640 1 -- 172.21.15.177:0/1932457659 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c054360 con 0x7efc4c0df360 2023-11-28T20:07:48.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7fb9e2d9d640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fb9e41500a0 0x7fb9e40cdfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:41928/0 (socket says 172.21.15.177:41928) 2023-11-28T20:07:48.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7fb9e359e640 1 --2- 172.21.15.177:0/4101413735 >> v2:172.21.15.177:3300/0 conn(0x7fb9e40cd7a0 0x7fb9e4159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.432+0000 7fb9e259c640 1 -- 172.21.15.177:0/4101413735 learned_addr learned my addr 172.21.15.177:0/4101413735 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:48.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7fb9e359e640 1 -- 172.21.15.177:0/4101413735 >> v1:172.21.15.195:6789/0 conn(0x7fb9e40ce6c0 legacy=0x7fb9e41598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7fb9e359e640 1 -- 172.21.15.177:0/4101413735 >> v1:172.21.15.177:6789/0 conn(0x7fb9e41500a0 legacy=0x7fb9e40cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7fb9e359e640 1 -- 172.21.15.177:0/4101413735 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40cc9e0 con 0x7fb9e40cd7a0 2023-11-28T20:07:48.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7efc58a14640 1 --2- 172.21.15.177:0/1932457659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc4c0df360 0x7efc4c007160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f10c1395640 1 --2- 172.21.15.177:0/277467289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10bc15d190 0x7f10bc15d620 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f10b400be30 tx=0x7f10b4025120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79ea5d8eaba0fda3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7efc59215640 1 -- 172.21.15.177:0/1932457659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc4c0df360 msgr2=0x7efc4c007160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4aec9a7640 1 -- start start 2023-11-28T20:07:48.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7efc59215640 1 --2- 172.21.15.177:0/1932457659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc4c0df360 0x7efc4c007160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f10bb7fe640 1 -- 172.21.15.177:0/277467289 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b400b2d0 con 0x7f10bc15d190 2023-11-28T20:07:48.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f10bb7fe640 1 -- 172.21.15.177:0/277467289 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b40b0050 con 0x7f10bc15d190 2023-11-28T20:07:48.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4aec9a7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae80b1440 0x7f4ae806e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4aec9a7640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4ae8158ec0 0x7f4ae8159300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4ae6ffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4ae8158ec0 0x7f4ae8159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4ae6ffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4ae8158ec0 0x7f4ae8159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53436/0 (socket says 172.21.15.177:53436) 2023-11-28T20:07:48.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4ae7fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f4ae80b3590 0x7f4ae80cc7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:41940/0 (socket says 172.21.15.177:41940) 2023-11-28T20:07:48.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4ae77fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae80b1440 0x7f4ae806e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4aec9a7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae80b1c20 con 0x7f4ae80b3590 2023-11-28T20:07:48.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4ae6ffd640 1 -- 172.21.15.177:0/3955179435 learned_addr learned my addr 172.21.15.177:0/3955179435 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4aec9a7640 1 -- 172.21.15.177:0/3955179435 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae806eb60 con 0x7f4ae8158ec0 2023-11-28T20:07:48.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4ae77fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae80b1440 0x7f4ae806e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:35670/0 (socket says 172.21.15.177:35670) 2023-11-28T20:07:48.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4aec9a7640 1 -- 172.21.15.177:0/3955179435 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae8159910 con 0x7f4ae80b1440 2023-11-28T20:07:48.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4ae6ffd640 1 -- 172.21.15.177:0/3955179435 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae80b1440 msgr2=0x7f4ae806e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:48.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4ae6ffd640 1 --2- 172.21.15.177:0/3955179435 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae80b1440 0x7f4ae806e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4ae6ffd640 1 -- 172.21.15.177:0/3955179435 >> v1:172.21.15.177:6789/0 conn(0x7f4ae80b3590 legacy=0x7f4ae80cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f4ae6ffd640 1 -- 172.21.15.177:0/3955179435 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae8159bf0 con 0x7f4ae8158ec0 2023-11-28T20:07:48.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7efc59215640 1 -- 172.21.15.177:0/1932457659 >> v1:172.21.15.177:6789/0 conn(0x7efc4c04f590 legacy=0x7efc4c037ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7efc59215640 1 -- 172.21.15.177:0/1932457659 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c050370 con 0x7efc4c04fa50 2023-11-28T20:07:48.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f10c2df8640 1 -- 172.21.15.177:0/277467289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10bc15d190 msgr2=0x7f10bc15d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f10bb7fe640 1 -- 172.21.15.177:0/277467289 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b400b2d0 con 0x7f10bc15d190 2023-11-28T20:07:48.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f10c2df8640 1 --2- 172.21.15.177:0/277467289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10bc15d190 0x7f10bc15d620 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f10b400be30 tx=0x7f10b4025120 comp rx=0 tx=0).stop 2023-11-28T20:07:48.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f10c2df8640 1 -- 172.21.15.177:0/277467289 shutdown_connections 2023-11-28T20:07:48.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f10c2df8640 1 --2- 172.21.15.177:0/277467289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10bc15d190 0x7f10bc15d620 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f10c2df8640 1 --2- 172.21.15.177:0/277467289 >> v2:172.21.15.195:3300/0 conn(0x7f10bc15cdb0 0x7f10bc0cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f10c2df8640 1 -- 172.21.15.177:0/277467289 >> 172.21.15.177:0/277467289 conn(0x7f10bc06c2c0 msgr2=0x7f10bc06c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f10c2df8640 1 -- 172.21.15.177:0/277467289 shutdown_connections 2023-11-28T20:07:48.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.436+0000 7f10c2df8640 1 -- 172.21.15.177:0/277467289 wait complete. 2023-11-28T20:07:48.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.440+0000 7efc59215640 1 --2- 172.21.15.177:0/1932457659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc4c04fa50 0x7efc4c04fe30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efc5404fb60 tx=0x7efc54096a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62bd90f18c339fb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.440+0000 7f10c2df8640 1 Processor -- start 2023-11-28T20:07:48.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.440+0000 7fb9e359e640 1 --2- 172.21.15.177:0/4101413735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9e40cd7a0 0x7fb9e4159ff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009d90 tx=0x7fb9dc01d120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773c87c470fa8eda server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f10c2df8640 1 -- start start 2023-11-28T20:07:48.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f4ae6ffd640 1 --2- 172.21.15.177:0/3955179435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae8158ec0 0x7f4ae8159300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009870 tx=0x7f4ad801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1dc1f7e8dc2a04a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f4ae67fc640 1 -- 172.21.15.177:0/3955179435 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80ab620 con 0x7f4ae8158ec0 2023-11-28T20:07:48.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f4ae67fc640 1 -- 172.21.15.177:0/3955179435 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad80ab780 con 0x7f4ae8158ec0 2023-11-28T20:07:48.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f4ae67fc640 1 -- 172.21.15.177:0/3955179435 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80abb10 con 0x7f4ae8158ec0 2023-11-28T20:07:48.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.440+0000 7efc4bfff640 1 -- 172.21.15.177:0/1932457659 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5411f8d0 con 0x7efc4c04fa50 2023-11-28T20:07:48.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7efc4bfff640 1 -- 172.21.15.177:0/1932457659 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5411fa70 con 0x7efc4c04fa50 2023-11-28T20:07:48.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7efc4bfff640 1 -- 172.21.15.177:0/1932457659 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5411fea0 con 0x7efc4c04fa50 2023-11-28T20:07:48.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f10c2df8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10bc159490 0x7f10bc142e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7fb9e1d9b640 1 -- 172.21.15.177:0/4101413735 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0ac600 con 0x7fb9e40cd7a0 2023-11-28T20:07:48.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7fb9e1d9b640 1 -- 172.21.15.177:0/4101413735 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc0a8050 con 0x7fb9e40cd7a0 2023-11-28T20:07:48.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f10c2df8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10bc15cdb0 0x7f10bc141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f4aec9a7640 1 -- 172.21.15.177:0/3955179435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae8158ec0 msgr2=0x7f4ae8159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f4aec9a7640 1 --2- 172.21.15.177:0/3955179435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae8158ec0 0x7f4ae8159300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009870 tx=0x7f4ad801c510 comp rx=0 tx=0).stop 2023-11-28T20:07:48.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f4aec9a7640 1 -- 172.21.15.177:0/3955179435 shutdown_connections 2023-11-28T20:07:48.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f4aec9a7640 1 --2- 172.21.15.177:0/3955179435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae8158ec0 0x7f4ae8159300 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f4aec9a7640 1 --2- 172.21.15.177:0/3955179435 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae80b1440 0x7f4ae806e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f4aec9a7640 1 -- 172.21.15.177:0/3955179435 >> 172.21.15.177:0/3955179435 conn(0x7f4ae80b0920 msgr2=0x7f4ae80b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f4aec9a7640 1 -- 172.21.15.177:0/3955179435 shutdown_connections 2023-11-28T20:07:48.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f4aec9a7640 1 -- 172.21.15.177:0/3955179435 wait complete. 2023-11-28T20:07:48.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7efc5a217640 1 -- 172.21.15.177:0/1932457659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc4c04fa50 msgr2=0x7efc4c04fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7efc5a217640 1 --2- 172.21.15.177:0/1932457659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc4c04fa50 0x7efc4c04fe30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efc5404fb60 tx=0x7efc54096a60 comp rx=0 tx=0).stop 2023-11-28T20:07:48.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7efc5a217640 1 -- 172.21.15.177:0/1932457659 shutdown_connections 2023-11-28T20:07:48.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7efc5a217640 1 --2- 172.21.15.177:0/1932457659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc4c0df360 0x7efc4c007160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7efc5a217640 1 --2- 172.21.15.177:0/1932457659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc4c04fa50 0x7efc4c04fe30 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efc5404fb60 tx=0x7efc54096a60 comp rx=0 tx=0).stop 2023-11-28T20:07:48.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7efc5a217640 1 -- 172.21.15.177:0/1932457659 >> 172.21.15.177:0/1932457659 conn(0x7efc4c009f90 msgr2=0x7efc4c00a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f10c0b94640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10bc159490 0x7f10bc142e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f10c0b94640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10bc159490 0x7f10bc142e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53442/0 (socket says 172.21.15.177:53442) 2023-11-28T20:07:48.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f10c0b94640 1 -- 172.21.15.177:0/1653123180 learned_addr learned my addr 172.21.15.177:0/1653123180 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f10bbfff640 1 --2- 172.21.15.177:0/1653123180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10bc15cdb0 0x7f10bc141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f10c2df8640 1 --2- 172.21.15.177:0/1653123180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10bc15d190 0x7f10bc158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f10c2df8640 1 -- 172.21.15.177:0/1653123180 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc158bf0 con 0x7f10bc15cdb0 2023-11-28T20:07:48.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f10c2df8640 1 -- 172.21.15.177:0/1653123180 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc142040 con 0x7f10bc159490 2023-11-28T20:07:48.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7f10c2df8640 1 -- 172.21.15.177:0/1653123180 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc142320 con 0x7f10bc15d190 2023-11-28T20:07:48.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.444+0000 7fb9e1d9b640 1 -- 172.21.15.177:0/4101413735 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0ac980 con 0x7fb9e40cd7a0 2023-11-28T20:07:48.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4aec9a7640 1 Processor -- start 2023-11-28T20:07:48.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f10c1395640 1 --2- 172.21.15.177:0/1653123180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10bc15d190 0x7f10bc158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f10c1395640 1 -- 172.21.15.177:0/1653123180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10bc159490 msgr2=0x7f10bc142e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f10c1395640 1 --2- 172.21.15.177:0/1653123180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10bc159490 0x7f10bc142e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f10c1395640 1 -- 172.21.15.177:0/1653123180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10bc15cdb0 msgr2=0x7f10bc141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f10c1395640 1 --2- 172.21.15.177:0/1653123180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10bc15cdb0 0x7f10bc141800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f10c1395640 1 -- 172.21.15.177:0/1653123180 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b400ba90 con 0x7f10bc15d190 2023-11-28T20:07:48.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4aec9a7640 1 -- start start 2023-11-28T20:07:48.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f10c1395640 1 --2- 172.21.15.177:0/1653123180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10bc15d190 0x7f10bc158280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f10b40b3000 tx=0x7f10b4021ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f10b97fa640 1 -- 172.21.15.177:0/1653123180 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4009a10 con 0x7f10bc15d190 2023-11-28T20:07:48.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4aec9a7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae80b1440 0x7f4ae814a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4aec9a7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ae80b3590 0x7f4ae8157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4aec9a7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae8158ec0 0x7f4ae814e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f10c2df8640 1 -- 172.21.15.177:0/1653123180 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc142600 con 0x7f10bc15d190 2023-11-28T20:07:48.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4aec9a7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae8157b90 con 0x7f4ae80b3590 2023-11-28T20:07:48.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4aec9a7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae806daf0 con 0x7f4ae8158ec0 2023-11-28T20:07:48.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4aec9a7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae806dd90 con 0x7f4ae80b1440 2023-11-28T20:07:48.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4ae77fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae80b1440 0x7f4ae814a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4ae7fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae8158ec0 0x7f4ae814e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4ae7fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae8158ec0 0x7f4ae814e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53448/0 (socket says 172.21.15.177:53448) 2023-11-28T20:07:48.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4ae7fff640 1 -- 172.21.15.177:0/1138377908 learned_addr learned my addr 172.21.15.177:0/1138377908 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f10b97fa640 1 -- 172.21.15.177:0/1653123180 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b4009b70 con 0x7f10bc15d190 2023-11-28T20:07:48.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7efc5a217640 1 -- 172.21.15.177:0/1932457659 shutdown_connections 2023-11-28T20:07:48.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4ae7fff640 1 -- 172.21.15.177:0/1138377908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae80b1440 msgr2=0x7f4ae814a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4ae7fff640 1 --2- 172.21.15.177:0/1138377908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae80b1440 0x7f4ae814a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4ae7fff640 1 -- 172.21.15.177:0/1138377908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ae80b3590 msgr2=0x7f4ae8157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4ae7fff640 1 --2- 172.21.15.177:0/1138377908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ae80b3590 0x7f4ae8157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7f4ae7fff640 1 -- 172.21.15.177:0/1138377908 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad80094d0 con 0x7f4ae8158ec0 2023-11-28T20:07:48.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7f10c2df8640 1 -- 172.21.15.177:0/1653123180 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc143340 con 0x7f10bc15d190 2023-11-28T20:07:48.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7f10b97fa640 1 -- 172.21.15.177:0/1653123180 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4009a10 con 0x7f10bc15d190 2023-11-28T20:07:48.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7f4ae7fff640 1 --2- 172.21.15.177:0/1138377908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae8158ec0 0x7f4ae814e8c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00c440 tx=0x7f4adc00c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7f4acffff640 1 -- 172.21.15.177:0/1138377908 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc007480 con 0x7f4ae8158ec0 2023-11-28T20:07:48.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7fb9e9101640 1 -- 172.21.15.177:0/4101413735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9e40cd7a0 msgr2=0x7fb9e4159ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7fb9e9101640 1 --2- 172.21.15.177:0/4101413735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9e40cd7a0 0x7fb9e4159ff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009d90 tx=0x7fb9dc01d120 comp rx=0 tx=0).stop 2023-11-28T20:07:48.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7f4acffff640 1 -- 172.21.15.177:0/1138377908 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc0075e0 con 0x7f4ae8158ec0 2023-11-28T20:07:48.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7f4acffff640 1 -- 172.21.15.177:0/1138377908 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc004a10 con 0x7f4ae8158ec0 2023-11-28T20:07:48.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7f4aec9a7640 1 -- 172.21.15.177:0/1138377908 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae806e070 con 0x7f4ae8158ec0 2023-11-28T20:07:48.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.448+0000 7efc5a217640 1 -- 172.21.15.177:0/1932457659 wait complete. 2023-11-28T20:07:48.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7fb9e9101640 1 -- 172.21.15.177:0/4101413735 shutdown_connections 2023-11-28T20:07:48.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7fb9e9101640 1 --2- 172.21.15.177:0/4101413735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9e40cd7a0 0x7fb9e4159ff0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7fb9e9101640 1 -- 172.21.15.177:0/4101413735 >> 172.21.15.177:0/4101413735 conn(0x7fb9e40aea50 msgr2=0x7fb9e40722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7f4aec9a7640 1 -- 172.21.15.177:0/1138377908 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae8157880 con 0x7f4ae8158ec0 2023-11-28T20:07:48.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7fb9e9101640 1 -- 172.21.15.177:0/4101413735 shutdown_connections 2023-11-28T20:07:48.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7fb9e9101640 1 -- 172.21.15.177:0/4101413735 wait complete. 2023-11-28T20:07:48.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7f10c2df8640 1 -- 172.21.15.177:0/1653123180 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109c005260 con 0x7f10bc15d190 2023-11-28T20:07:48.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.452+0000 7efc5a217640 1 Processor -- start 2023-11-28T20:07:48.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7f10b97fa640 1 -- 172.21.15.177:0/1653123180 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f10b4009ce0 con 0x7f10bc15d190 2023-11-28T20:07:48.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc5a217640 1 -- start start 2023-11-28T20:07:48.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc5a217640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc4c04f590 0x7efc4c04e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc5a217640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc4c0df360 0x7efc4c0c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc5a217640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc4c0cea90 0x7efc4c0e1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc5a217640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c0c9da0 con 0x7efc4c0cea90 2023-11-28T20:07:48.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc5a217640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c0d1940 con 0x7efc4c0df360 2023-11-28T20:07:48.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc5a217640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c0d1050 con 0x7efc4c04f590 2023-11-28T20:07:48.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc58a14640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc4c0df360 0x7efc4c0c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc58a14640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc4c0df360 0x7efc4c0c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53450/0 (socket says 172.21.15.177:53450) 2023-11-28T20:07:48.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc58a14640 1 -- 172.21.15.177:0/3223161278 learned_addr learned my addr 172.21.15.177:0/3223161278 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc59a16640 1 --2- 172.21.15.177:0/3223161278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc4c0cea90 0x7efc4c0e1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc58a14640 1 -- 172.21.15.177:0/3223161278 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc4c04f590 msgr2=0x7efc4c04e5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:07:48.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc58a14640 1 --2- 172.21.15.177:0/3223161278 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc4c04f590 0x7efc4c04e5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc58a14640 1 -- 172.21.15.177:0/3223161278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc4c0cea90 msgr2=0x7efc4c0e1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc58a14640 1 --2- 172.21.15.177:0/3223161278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc4c0cea90 0x7efc4c0e1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc58a14640 1 -- 172.21.15.177:0/3223161278 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc540688e0 con 0x7efc4c0df360 2023-11-28T20:07:48.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7efc58a14640 1 --2- 172.21.15.177:0/3223161278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc4c0df360 0x7efc4c0c9860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc4400d800 tx=0x7efc4400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7f10b97fa640 1 --2- 172.21.15.177:0/1653123180 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10a80664d0 0x7f10a8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7f10b97fa640 1 -- 172.21.15.177:0/1653123180 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10b40f7030 con 0x7f10bc15d190 2023-11-28T20:07:48.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7fb9e9101640 1 Processor -- start 2023-11-28T20:07:48.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7f4acffff640 1 -- 172.21.15.177:0/1138377908 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4adc004b70 con 0x7f4ae8158ec0 2023-11-28T20:07:48.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7f4aec9a7640 1 -- 172.21.15.177:0/1138377908 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae809d080 con 0x7f4ae8158ec0 2023-11-28T20:07:48.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7f4acffff640 1 --2- 172.21.15.177:0/1138377908 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4ad4066470 0x7f4ad4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7f4acffff640 1 -- 172.21.15.177:0/1138377908 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4adc053fd0 con 0x7f4ae8158ec0 2023-11-28T20:07:48.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7f4ae77fe640 1 --2- 172.21.15.177:0/1138377908 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4ad4066470 0x7f4ad4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7f10c0b94640 1 --2- 172.21.15.177:0/1653123180 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10a80664d0 0x7f10a8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7f4ae77fe640 1 --2- 172.21.15.177:0/1138377908 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4ad4066470 0x7f4ad4068930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00113e0 tx=0x7f4ae000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.456+0000 7fb9e9101640 1 -- start start 2023-11-28T20:07:48.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e9101640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9e40cd7a0 0x7fb9e414a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e9101640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9e40ce6c0 0x7fb9e414d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e9101640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9e41500a0 0x7fb9e4162fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e9101640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40cdc10 con 0x7fb9e40cd7a0 2023-11-28T20:07:48.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e2d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9e40cd7a0 0x7fb9e414a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e9101640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4163f40 con 0x7fb9e40ce6c0 2023-11-28T20:07:48.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e9101640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4163980 con 0x7fb9e41500a0 2023-11-28T20:07:48.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e259c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9e40ce6c0 0x7fb9e414d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e2d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9e40cd7a0 0x7fb9e414a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52936/0 (socket says 172.21.15.177:52936) 2023-11-28T20:07:48.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e2d9d640 1 -- 172.21.15.177:0/812073276 learned_addr learned my addr 172.21.15.177:0/812073276 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:48.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e359e640 1 --2- 172.21.15.177:0/812073276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9e41500a0 0x7fb9e4162fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7f10c0b94640 1 --2- 172.21.15.177:0/1653123180 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10a80664d0 0x7f10a8068990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f10bc1310c0 tx=0x7f10ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e359e640 1 -- 172.21.15.177:0/812073276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9e40ce6c0 msgr2=0x7fb9e414d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e359e640 1 --2- 172.21.15.177:0/812073276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9e40ce6c0 0x7fb9e414d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e359e640 1 -- 172.21.15.177:0/812073276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9e40cd7a0 msgr2=0x7fb9e414a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e359e640 1 --2- 172.21.15.177:0/812073276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9e40cd7a0 0x7fb9e414a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e359e640 1 -- 172.21.15.177:0/812073276 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc009a70 con 0x7fb9e41500a0 2023-11-28T20:07:48.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e259c640 1 --2- 172.21.15.177:0/812073276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9e40ce6c0 0x7fb9e414d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:48.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e359e640 1 --2- 172.21.15.177:0/812073276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9e41500a0 0x7fb9e4162fa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb9e406b470 tx=0x7fb9dc019ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9db7fe640 1 -- 172.21.15.177:0/812073276 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0b6820 con 0x7fb9e41500a0 2023-11-28T20:07:48.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9db7fe640 1 -- 172.21.15.177:0/812073276 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc0b6980 con 0x7fb9e41500a0 2023-11-28T20:07:48.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9db7fe640 1 -- 172.21.15.177:0/812073276 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0b6d30 con 0x7fb9e41500a0 2023-11-28T20:07:48.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e9101640 1 -- 172.21.15.177:0/812073276 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e4163c60 con 0x7fb9e41500a0 2023-11-28T20:07:48.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7f10b97fa640 1 -- 172.21.15.177:0/1653123180 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10b412b060 con 0x7f10bc15d190 2023-11-28T20:07:48.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7fb9e9101640 1 -- 172.21.15.177:0/812073276 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e4156610 con 0x7fb9e41500a0 2023-11-28T20:07:48.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7efc49ffb640 1 -- 172.21.15.177:0/3223161278 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4400b6c0 con 0x7efc4c0df360 2023-11-28T20:07:48.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7efc49ffb640 1 -- 172.21.15.177:0/3223161278 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4400b820 con 0x7efc4c0df360 2023-11-28T20:07:48.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.460+0000 7efc49ffb640 1 -- 172.21.15.177:0/3223161278 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4400bb90 con 0x7efc4c0df360 2023-11-28T20:07:48.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.464+0000 7f4acffff640 1 -- 172.21.15.177:0/1138377908 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4adc050aa0 con 0x7f4ae8158ec0 2023-11-28T20:07:48.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.464+0000 7fb9e9101640 1 -- 172.21.15.177:0/812073276 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e4156190 con 0x7fb9e41500a0 2023-11-28T20:07:48.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.464+0000 7efc5a217640 1 -- 172.21.15.177:0/3223161278 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4c007820 con 0x7efc4c0df360 2023-11-28T20:07:48.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.464+0000 7efc5a217640 1 -- 172.21.15.177:0/3223161278 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4c0d15d0 con 0x7efc4c0df360 2023-11-28T20:07:48.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.464+0000 7fb9db7fe640 1 -- 172.21.15.177:0/812073276 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb9dc0b3050 con 0x7fb9e41500a0 2023-11-28T20:07:48.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.468+0000 7fb9db7fe640 1 --2- 172.21.15.177:0/812073276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb9c40664c0 0x7fb9c4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.468+0000 7fb9db7fe640 1 -- 172.21.15.177:0/812073276 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9dc11ea40 con 0x7fb9e41500a0 2023-11-28T20:07:48.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.468+0000 7fb9e2d9d640 1 --2- 172.21.15.177:0/812073276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb9c40664c0 0x7fb9c4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.464+0000 7efc5a217640 1 -- 172.21.15.177:0/3223161278 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4c005370 con 0x7efc4c0df360 2023-11-28T20:07:48.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.468+0000 7efc49ffb640 1 -- 172.21.15.177:0/3223161278 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efc4400bcf0 con 0x7efc4c0df360 2023-11-28T20:07:48.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.468+0000 7efc49ffb640 1 --2- 172.21.15.177:0/3223161278 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efc380664c0 0x7efc38068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:48.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.468+0000 7efc49ffb640 1 -- 172.21.15.177:0/3223161278 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc44055480 con 0x7efc4c0df360 2023-11-28T20:07:48.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.472+0000 7efc59215640 1 --2- 172.21.15.177:0/3223161278 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efc380664c0 0x7efc38068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:48.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.472+0000 7fb9e2d9d640 1 --2- 172.21.15.177:0/812073276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb9c40664c0 0x7fb9c4068980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0099d0 tx=0x7fb9cc009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.472+0000 7efc59215640 1 --2- 172.21.15.177:0/3223161278 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efc380664c0 0x7efc38068980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00b4f0 tx=0x7efc54121070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:48.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.472+0000 7fb9db7fe640 1 -- 172.21.15.177:0/812073276 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9e4156190 con 0x7fb9e41500a0 2023-11-28T20:07:48.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.472+0000 7efc49ffb640 1 -- 172.21.15.177:0/3223161278 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc44089060 con 0x7efc4c0df360 2023-11-28T20:07:48.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.700+0000 7fb02513e640 1 -- 172.21.15.177:0/2869969056 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb02015c8e0 con 0x7fb020159490 2023-11-28T20:07:48.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.704+0000 7fb0077fe640 1 -- 172.21.15.177:0/2869969056 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb014051560 con 0x7fb020159490 2023-11-28T20:07:48.710 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-11-28T20:07:48.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.708+0000 7fb02513e640 1 -- 172.21.15.177:0/2869969056 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb00c0664a0 msgr2=0x7fb00c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.708+0000 7fb02513e640 1 --2- 172.21.15.177:0/2869969056 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb00c0664a0 0x7fb00c068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb0200b3710 tx=0x7fb01800a040 comp rx=0 tx=0).stop 2023-11-28T20:07:48.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.708+0000 7fb02513e640 1 -- 172.21.15.177:0/2869969056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb020159490 msgr2=0x7fb020154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.708+0000 7fb02513e640 1 --2- 172.21.15.177:0/2869969056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb020159490 0x7fb020154ec0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb01400fa60 tx=0x7fb01400ff20 comp rx=0 tx=0).stop 2023-11-28T20:07:48.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.708+0000 7fb02513e640 1 -- 172.21.15.177:0/2869969056 shutdown_connections 2023-11-28T20:07:48.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.708+0000 7fb02513e640 1 --2- 172.21.15.177:0/2869969056 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb00c0664a0 0x7fb00c068960 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.708+0000 7fb02513e640 1 --2- 172.21.15.177:0/2869969056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb02015d190 0x7fb02014ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.708+0000 7fb02513e640 1 --2- 172.21.15.177:0/2869969056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02015cdb0 0x7fb020150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.708+0000 7fb02513e640 1 --2- 172.21.15.177:0/2869969056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb020159490 0x7fb020154ec0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.708+0000 7fb02513e640 1 -- 172.21.15.177:0/2869969056 >> 172.21.15.177:0/2869969056 conn(0x7fb02006c2c0 msgr2=0x7fb0200cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.708+0000 7fb02513e640 1 -- 172.21.15.177:0/2869969056 shutdown_connections 2023-11-28T20:07:48.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.708+0000 7fb02513e640 1 -- 172.21.15.177:0/2869969056 wait complete. 2023-11-28T20:07:48.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.712+0000 7f3b82679640 1 -- 172.21.15.177:0/3547406114 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3b7c15c8e0 con 0x7f3b7c15cdb0 2023-11-28T20:07:48.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.712+0000 7f3b78ff9640 1 -- 172.21.15.177:0/3547406114 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b70053ea0 con 0x7f3b7c15cdb0 2023-11-28T20:07:48.717 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-11-28T20:07:48.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.712+0000 7fed54432640 1 -- 172.21.15.177:0/899116141 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fed34005510 con 0x7fed4c06c9d0 2023-11-28T20:07:48.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.716+0000 7fed42ffd640 1 -- 172.21.15.177:0/899116141 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed44017020 con 0x7fed4c06c9d0 2023-11-28T20:07:48.719 INFO:teuthology.orchestra.run.smithi177.stdout:55834574852 2023-11-28T20:07:48.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.716+0000 7f3b82679640 1 -- 172.21.15.177:0/3547406114 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3b68066470 msgr2=0x7f3b68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.716+0000 7f3b82679640 1 --2- 172.21.15.177:0/3547406114 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3b68066470 0x7f3b68068930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c008520 tx=0x7f3b6c00d040 comp rx=0 tx=0).stop 2023-11-28T20:07:48.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.716+0000 7f3b82679640 1 -- 172.21.15.177:0/3547406114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b7c15cdb0 msgr2=0x7f3b7c156410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.716+0000 7f3b82679640 1 --2- 172.21.15.177:0/3547406114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b7c15cdb0 0x7f3b7c156410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b70001ec0 tx=0x7f3b7000c890 comp rx=0 tx=0).stop 2023-11-28T20:07:48.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.716+0000 7f3b82679640 1 -- 172.21.15.177:0/3547406114 shutdown_connections 2023-11-28T20:07:48.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.716+0000 7f3b82679640 1 --2- 172.21.15.177:0/3547406114 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3b68066470 0x7f3b68068930 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.716+0000 7f3b82679640 1 --2- 172.21.15.177:0/3547406114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b7c15d190 0x7f3b7c14c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.716+0000 7f3b82679640 1 --2- 172.21.15.177:0/3547406114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b7c15cdb0 0x7f3b7c156410 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.716+0000 7f3b82679640 1 --2- 172.21.15.177:0/3547406114 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b7c159490 0x7f3b7c152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.716+0000 7f3b82679640 1 -- 172.21.15.177:0/3547406114 >> 172.21.15.177:0/3547406114 conn(0x7f3b7c06c2c0 msgr2=0x7f3b7c0cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.716+0000 7f3b82679640 1 -- 172.21.15.177:0/3547406114 shutdown_connections 2023-11-28T20:07:48.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.716+0000 7f3b82679640 1 -- 172.21.15.177:0/3547406114 wait complete. 2023-11-28T20:07:48.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.720+0000 7fed54432640 1 -- 172.21.15.177:0/899116141 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fed30066470 msgr2=0x7fed30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.720+0000 7fed54432640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fed30066470 0x7fed30068930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0b09c0 tx=0x7fed48009110 comp rx=0 tx=0).stop 2023-11-28T20:07:48.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.720+0000 7fed54432640 1 -- 172.21.15.177:0/899116141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed4c06c9d0 msgr2=0x7fed4c1549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.720+0000 7fed54432640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed4c06c9d0 0x7fed4c1549a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed4400cb40 tx=0x7fed4400a060 comp rx=0 tx=0).stop 2023-11-28T20:07:48.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.720+0000 7fed54432640 1 -- 172.21.15.177:0/899116141 shutdown_connections 2023-11-28T20:07:48.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.720+0000 7fed54432640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fed30066470 0x7fed30068930 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.720+0000 7fed54432640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed4c15c070 0x7fed4c0aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.720+0000 7fed54432640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed4c15bc90 0x7fed4c161e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.720+0000 7fed54432640 1 --2- 172.21.15.177:0/899116141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed4c06c9d0 0x7fed4c1549a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.720+0000 7fed54432640 1 -- 172.21.15.177:0/899116141 >> 172.21.15.177:0/899116141 conn(0x7fed4c06a530 msgr2=0x7fed4c071b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.720+0000 7fe257fff640 1 -- 172.21.15.177:0/2698412061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe2580693d0 con 0x7fe2581f9800 2023-11-28T20:07:48.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.720+0000 7fed54432640 1 -- 172.21.15.177:0/899116141 shutdown_connections 2023-11-28T20:07:48.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.720+0000 7fed54432640 1 -- 172.21.15.177:0/899116141 wait complete. 2023-11-28T20:07:48.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.720+0000 7fe23f7fe640 1 -- 172.21.15.177:0/2698412061 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe248054ff0 con 0x7fe2581f9800 2023-11-28T20:07:48.729 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-11-28T20:07:48.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.724+0000 7fe257fff640 1 -- 172.21.15.177:0/2698412061 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe244066540 msgr2=0x7fe244068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.724+0000 7fe257fff640 1 --2- 172.21.15.177:0/2698412061 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe244066540 0x7fe244068a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe24c000c10 tx=0x7fe24c0a7070 comp rx=0 tx=0).stop 2023-11-28T20:07:48.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.724+0000 7fe257fff640 1 -- 172.21.15.177:0/2698412061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2581f9800 msgr2=0x7fe2580ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.724+0000 7fe257fff640 1 --2- 172.21.15.177:0/2698412061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2581f9800 0x7fe2580ccec0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe24800f890 tx=0x7fe24800fd50 comp rx=0 tx=0).stop 2023-11-28T20:07:48.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.728+0000 7fe257fff640 1 -- 172.21.15.177:0/2698412061 shutdown_connections 2023-11-28T20:07:48.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.728+0000 7fe257fff640 1 --2- 172.21.15.177:0/2698412061 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe244066540 0x7fe244068a00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.728+0000 7fe257fff640 1 --2- 172.21.15.177:0/2698412061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2580cd400 0x7fe2581fd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.728+0000 7fe257fff640 1 --2- 172.21.15.177:0/2698412061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2581f9800 0x7fe2580ccec0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.728+0000 7fe257fff640 1 --2- 172.21.15.177:0/2698412061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe240003980 0x7fe258149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.728+0000 7fe257fff640 1 -- 172.21.15.177:0/2698412061 >> 172.21.15.177:0/2698412061 conn(0x7fe25806a930 msgr2=0x7fe258144610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.732+0000 7fe257fff640 1 -- 172.21.15.177:0/2698412061 shutdown_connections 2023-11-28T20:07:48.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.732+0000 7fe257fff640 1 -- 172.21.15.177:0/2698412061 wait complete. 2023-11-28T20:07:48.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-11-28T20:07:48.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-11-28T20:07:48.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-11-28T20:07:48.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-11-28T20:07:48.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.772+0000 7f4aec9a7640 1 -- 172.21.15.177:0/1138377908 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4ae804e930 con 0x7f4ae8158ec0 2023-11-28T20:07:48.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.772+0000 7f10c2df8640 1 -- 172.21.15.177:0/1653123180 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f109c0057e0 con 0x7f10bc15d190 2023-11-28T20:07:48.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f4acffff640 1 -- 172.21.15.177:0/1138377908 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4adc050c40 con 0x7f4ae8158ec0 2023-11-28T20:07:48.779 INFO:teuthology.orchestra.run.smithi177.stdout:55834574852 2023-11-28T20:07:48.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f10b97fa640 1 -- 172.21.15.177:0/1653123180 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f10b40f3370 con 0x7f10bc15d190 2023-11-28T20:07:48.779 INFO:teuthology.orchestra.run.smithi177.stdout:55834574852 2023-11-28T20:07:48.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7efc5a217640 1 -- 172.21.15.177:0/3223161278 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efc4c04f160 con 0x7efc4c0df360 2023-11-28T20:07:48.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f10c2df8640 1 -- 172.21.15.177:0/1653123180 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10a80664d0 msgr2=0x7f10a8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f10c2df8640 1 --2- 172.21.15.177:0/1653123180 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10a80664d0 0x7f10a8068990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f10bc1310c0 tx=0x7f10ac008040 comp rx=0 tx=0).stop 2023-11-28T20:07:48.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f10c2df8640 1 -- 172.21.15.177:0/1653123180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10bc15d190 msgr2=0x7f10bc158280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f10c2df8640 1 --2- 172.21.15.177:0/1653123180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10bc15d190 0x7f10bc158280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f10b40b3000 tx=0x7f10b4021ec0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f10c2df8640 1 -- 172.21.15.177:0/1653123180 shutdown_connections 2023-11-28T20:07:48.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f10c2df8640 1 --2- 172.21.15.177:0/1653123180 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10a80664d0 0x7f10a8068990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f10c2df8640 1 --2- 172.21.15.177:0/1653123180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10bc15d190 0x7f10bc158280 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f10c2df8640 1 --2- 172.21.15.177:0/1653123180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10bc15cdb0 0x7f10bc141800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f10c2df8640 1 --2- 172.21.15.177:0/1653123180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10bc159490 0x7f10bc142e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f10c2df8640 1 -- 172.21.15.177:0/1653123180 >> 172.21.15.177:0/1653123180 conn(0x7f10bc06c2c0 msgr2=0x7f10bc0ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f4aec9a7640 1 -- 172.21.15.177:0/1138377908 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4ad4066470 msgr2=0x7f4ad4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f4aec9a7640 1 --2- 172.21.15.177:0/1138377908 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4ad4066470 0x7f4ad4068930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00113e0 tx=0x7f4ae000b040 comp rx=0 tx=0).stop 2023-11-28T20:07:48.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f10c2df8640 1 -- 172.21.15.177:0/1653123180 shutdown_connections 2023-11-28T20:07:48.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f4aec9a7640 1 -- 172.21.15.177:0/1138377908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae8158ec0 msgr2=0x7f4ae814e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f4aec9a7640 1 --2- 172.21.15.177:0/1138377908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae8158ec0 0x7f4ae814e8c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00c440 tx=0x7f4adc00c900 comp rx=0 tx=0).stop 2023-11-28T20:07:48.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7efc49ffb640 1 -- 172.21.15.177:0/3223161278 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc44089060 con 0x7efc4c0df360 2023-11-28T20:07:48.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f4aec9a7640 1 -- 172.21.15.177:0/1138377908 shutdown_connections 2023-11-28T20:07:48.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f4aec9a7640 1 --2- 172.21.15.177:0/1138377908 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4ad4066470 0x7f4ad4068930 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f4aec9a7640 1 --2- 172.21.15.177:0/1138377908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae8158ec0 0x7f4ae814e8c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f4aec9a7640 1 --2- 172.21.15.177:0/1138377908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ae80b3590 0x7f4ae8157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f4aec9a7640 1 --2- 172.21.15.177:0/1138377908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae80b1440 0x7f4ae814a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f4aec9a7640 1 -- 172.21.15.177:0/1138377908 >> 172.21.15.177:0/1138377908 conn(0x7f4ae80b0920 msgr2=0x7f4ae80b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f10c2df8640 1 -- 172.21.15.177:0/1653123180 wait complete. 2023-11-28T20:07:48.785 INFO:teuthology.orchestra.run.smithi177.stdout:55834574852 2023-11-28T20:07:48.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f4aec9a7640 1 -- 172.21.15.177:0/1138377908 shutdown_connections 2023-11-28T20:07:48.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.776+0000 7f4aec9a7640 1 -- 172.21.15.177:0/1138377908 wait complete. 2023-11-28T20:07:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.780+0000 7efc5a217640 1 -- 172.21.15.177:0/3223161278 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efc380664c0 msgr2=0x7efc38068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.780+0000 7efc5a217640 1 --2- 172.21.15.177:0/3223161278 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efc380664c0 0x7efc38068980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00b4f0 tx=0x7efc54121070 comp rx=0 tx=0).stop 2023-11-28T20:07:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.780+0000 7efc5a217640 1 -- 172.21.15.177:0/3223161278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc4c0df360 msgr2=0x7efc4c0c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.780+0000 7efc5a217640 1 --2- 172.21.15.177:0/3223161278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc4c0df360 0x7efc4c0c9860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc4400d800 tx=0x7efc4400dcc0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.780+0000 7efc5a217640 1 -- 172.21.15.177:0/3223161278 shutdown_connections 2023-11-28T20:07:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.780+0000 7efc5a217640 1 --2- 172.21.15.177:0/3223161278 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efc380664c0 0x7efc38068980 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.780+0000 7efc5a217640 1 --2- 172.21.15.177:0/3223161278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc4c0cea90 0x7efc4c0e1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.780+0000 7efc5a217640 1 --2- 172.21.15.177:0/3223161278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc4c0df360 0x7efc4c0c9860 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.780+0000 7efc5a217640 1 --2- 172.21.15.177:0/3223161278 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc4c04f590 0x7efc4c04e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.780+0000 7efc5a217640 1 -- 172.21.15.177:0/3223161278 >> 172.21.15.177:0/3223161278 conn(0x7efc4c009f90 msgr2=0x7efc4c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.780+0000 7efc5a217640 1 -- 172.21.15.177:0/3223161278 shutdown_connections 2023-11-28T20:07:48.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.780+0000 7efc5a217640 1 -- 172.21.15.177:0/3223161278 wait complete. 2023-11-28T20:07:48.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.800+0000 7fb9e9101640 1 -- 172.21.15.177:0/812073276 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb9e4156830 con 0x7fb9e41500a0 2023-11-28T20:07:48.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.800+0000 7fb9db7fe640 1 -- 172.21.15.177:0/812073276 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb9e4156190 con 0x7fb9e41500a0 2023-11-28T20:07:48.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2023-11-28T20:07:48.807 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-28T20:07:48.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.804+0000 7fb9e9101640 1 -- 172.21.15.177:0/812073276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb9c40664c0 msgr2=0x7fb9c4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.804+0000 7fb9e9101640 1 --2- 172.21.15.177:0/812073276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb9c40664c0 0x7fb9c4068980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0099d0 tx=0x7fb9cc009110 comp rx=0 tx=0).stop 2023-11-28T20:07:48.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.804+0000 7fb9e9101640 1 -- 172.21.15.177:0/812073276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9e41500a0 msgr2=0x7fb9e4162fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:48.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.804+0000 7fb9e9101640 1 --2- 172.21.15.177:0/812073276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9e41500a0 0x7fb9e4162fa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb9e406b470 tx=0x7fb9dc019ec0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.804+0000 7fb9e9101640 1 -- 172.21.15.177:0/812073276 shutdown_connections 2023-11-28T20:07:48.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.804+0000 7fb9e9101640 1 --2- 172.21.15.177:0/812073276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb9c40664c0 0x7fb9c4068980 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.804+0000 7fb9e9101640 1 --2- 172.21.15.177:0/812073276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9e41500a0 0x7fb9e4162fa0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.804+0000 7fb9e9101640 1 --2- 172.21.15.177:0/812073276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9e40ce6c0 0x7fb9e414d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.804+0000 7fb9e9101640 1 --2- 172.21.15.177:0/812073276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9e40cd7a0 0x7fb9e414a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:48.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.804+0000 7fb9e9101640 1 -- 172.21.15.177:0/812073276 >> 172.21.15.177:0/812073276 conn(0x7fb9e40aea50 msgr2=0x7fb9e40cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:48.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.804+0000 7fb9e9101640 1 -- 172.21.15.177:0/812073276 shutdown_connections 2023-11-28T20:07:48.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:48.804+0000 7fb9e9101640 1 -- 172.21.15.177:0/812073276 wait complete. 2023-11-28T20:07:48.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-11-28T20:07:48.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-11-28T20:07:48.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-11-28T20:07:49.752 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T20:07:49.759 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T20:07:49.760 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T20:07:49.772 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T20:07:49.807 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T20:07:49.811 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T20:07:49.814 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T20:07:49.829 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T20:07:49.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.948+0000 7f81d332a640 1 Processor -- start 2023-11-28T20:07:49.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.948+0000 7f81d332a640 1 -- start start 2023-11-28T20:07:49.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.948+0000 7f81d332a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f81cc0d0d00 0x7f81cc0d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:49.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.948+0000 7f81d332a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81cc0d0320 con 0x7f81cc0d1500 2023-11-28T20:07:49.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.948+0000 7f81d332a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81cc15daa0 con 0x7f81cc15d5e0 2023-11-28T20:07:49.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.948+0000 7f81d332a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81cc15dd80 con 0x7f81cc0d0d00 2023-11-28T20:07:49.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.952+0000 7f81d10c6640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f81cc0d1500 0x7f81cc0d18e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51526/0 (socket says 172.21.15.177:51526) 2023-11-28T20:07:49.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.952+0000 7f81d10c6640 1 -- 172.21.15.177:0/1715549336 learned_addr learned my addr 172.21.15.177:0/1715549336 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:49.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.952+0000 7f81d18c7640 1 --2- 172.21.15.177:0/1715549336 >> v2:172.21.15.195:3300/0 conn(0x7f81cc0d0d00 0x7f81cc0d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:49.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.952+0000 7f81c3fff640 1 -- 172.21.15.177:0/1715549336 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018620633 0 0) 0x7f81cc0d0320 con 0x7f81cc0d1500 2023-11-28T20:07:49.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.952+0000 7f81c3fff640 1 -- 172.21.15.177:0/1715549336 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81b8003530 con 0x7f81cc0d1500 2023-11-28T20:07:49.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.952+0000 7f81c3fff640 1 -- 172.21.15.177:0/1715549336 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376115165 0 0) 0x7f81cc15daa0 con 0x7f81cc15d5e0 2023-11-28T20:07:49.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.952+0000 7f81d18c7640 1 -- 172.21.15.177:0/1715549336 >> v1:172.21.15.195:6789/0 conn(0x7f81cc15d5e0 legacy=0x7f81cc0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:49.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.952+0000 7f81d18c7640 1 -- 172.21.15.177:0/1715549336 >> v1:172.21.15.177:6789/0 conn(0x7f81cc0d1500 legacy=0x7f81cc0d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:49.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.952+0000 7f81d18c7640 1 -- 172.21.15.177:0/1715549336 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc15e060 con 0x7f81cc0d0d00 2023-11-28T20:07:49.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.960+0000 7f81d18c7640 1 --2- 172.21.15.177:0/1715549336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81cc0d0d00 0x7f81cc0d3a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009d90 tx=0x7f81c401c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fbf358c65adb883 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:49.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.960+0000 7f81c3fff640 1 -- 172.21.15.177:0/1715549336 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8001680 con 0x7f81cc0d0d00 2023-11-28T20:07:49.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.960+0000 7f81c3fff640 1 -- 172.21.15.177:0/1715549336 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c40a5550 con 0x7f81cc0d0d00 2023-11-28T20:07:49.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.960+0000 7f81d332a640 1 -- 172.21.15.177:0/1715549336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81cc0d0d00 msgr2=0x7f81cc0d3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:49.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.960+0000 7f81c3fff640 1 -- 172.21.15.177:0/1715549336 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8001680 con 0x7f81cc0d0d00 2023-11-28T20:07:49.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.960+0000 7f81d332a640 1 --2- 172.21.15.177:0/1715549336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81cc0d0d00 0x7f81cc0d3a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009d90 tx=0x7f81c401c6d0 comp rx=0 tx=0).stop 2023-11-28T20:07:49.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.960+0000 7f81d332a640 1 -- 172.21.15.177:0/1715549336 shutdown_connections 2023-11-28T20:07:49.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.960+0000 7f81d332a640 1 --2- 172.21.15.177:0/1715549336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81cc0d0d00 0x7f81cc0d3a40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:49.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.960+0000 7f81d332a640 1 -- 172.21.15.177:0/1715549336 >> 172.21.15.177:0/1715549336 conn(0x7f81cc0d2f20 msgr2=0x7f81cc0d3330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:49.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.960+0000 7f81d332a640 1 -- 172.21.15.177:0/1715549336 shutdown_connections 2023-11-28T20:07:49.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.960+0000 7f81d332a640 1 -- 172.21.15.177:0/1715549336 wait complete. 2023-11-28T20:07:49.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.964+0000 7f81d332a640 1 Processor -- start 2023-11-28T20:07:49.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.964+0000 7f81d332a640 1 -- start start 2023-11-28T20:07:49.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d332a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81cc0d0d00 0x7f81cc1599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:49.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d332a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81cc0d1500 0x7f81cc0b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:49.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d332a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81cc15d5e0 0x7f81cc0cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:49.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d332a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0b5c20 con 0x7f81cc0d0d00 2023-11-28T20:07:49.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d332a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0b5f00 con 0x7f81cc0d1500 2023-11-28T20:07:49.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d332a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0cbd10 con 0x7f81cc15d5e0 2023-11-28T20:07:49.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d10c6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81cc0d0d00 0x7f81cc1599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:49.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d10c6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81cc0d0d00 0x7f81cc1599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44524/0 (socket says 172.21.15.177:44524) 2023-11-28T20:07:49.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d10c6640 1 -- 172.21.15.177:0/507071107 learned_addr learned my addr 172.21.15.177:0/507071107 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:49.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d18c7640 1 --2- 172.21.15.177:0/507071107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81cc15d5e0 0x7f81cc0cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:49.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d08c5640 1 --2- 172.21.15.177:0/507071107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81cc0d1500 0x7f81cc0b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:49.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d18c7640 1 -- 172.21.15.177:0/507071107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81cc0d1500 msgr2=0x7f81cc0b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:49.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d18c7640 1 --2- 172.21.15.177:0/507071107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81cc0d1500 0x7f81cc0b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:49.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d18c7640 1 -- 172.21.15.177:0/507071107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81cc0d0d00 msgr2=0x7f81cc1599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:49.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d18c7640 1 --2- 172.21.15.177:0/507071107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81cc0d0d00 0x7f81cc1599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:49.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d18c7640 1 -- 172.21.15.177:0/507071107 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4009a70 con 0x7f81cc15d5e0 2023-11-28T20:07:49.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81d18c7640 1 --2- 172.21.15.177:0/507071107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81cc15d5e0 0x7f81cc0cc510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f81c40ac000 tx=0x7f81c4019470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:49.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81c1ffb640 1 -- 172.21.15.177:0/507071107 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40a6b60 con 0x7f81cc15d5e0 2023-11-28T20:07:49.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81c1ffb640 1 -- 172.21.15.177:0/507071107 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c40a6cc0 con 0x7f81cc15d5e0 2023-11-28T20:07:49.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.968+0000 7f81c1ffb640 1 -- 172.21.15.177:0/507071107 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4004240 con 0x7f81cc15d5e0 2023-11-28T20:07:49.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.972+0000 7f81d332a640 1 -- 172.21.15.177:0/507071107 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81cc0cbff0 con 0x7f81cc15d5e0 2023-11-28T20:07:49.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.972+0000 7f81d332a640 1 -- 172.21.15.177:0/507071107 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81cc0cb9c0 con 0x7f81cc15d5e0 2023-11-28T20:07:49.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.976+0000 7f81d332a640 1 -- 172.21.15.177:0/507071107 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81cc0693d0 con 0x7f81cc15d5e0 2023-11-28T20:07:49.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.976+0000 7f81c1ffb640 1 -- 172.21.15.177:0/507071107 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81c40b4050 con 0x7f81cc15d5e0 2023-11-28T20:07:49.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.976+0000 7f81c1ffb640 1 --2- 172.21.15.177:0/507071107 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f81b00664c0 0x7f81b0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:49.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.976+0000 7f81d10c6640 1 --2- 172.21.15.177:0/507071107 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f81b00664c0 0x7f81b0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:49.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.976+0000 7f81c1ffb640 1 -- 172.21.15.177:0/507071107 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81c40ef910 con 0x7f81cc15d5e0 2023-11-28T20:07:49.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.980+0000 7f81d10c6640 1 --2- 172.21.15.177:0/507071107 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f81b00664c0 0x7f81b0068980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f81c8000fc0 tx=0x7f81c8001bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:49.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:49.980+0000 7f81c1ffb640 1 -- 172.21.15.177:0/507071107 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81c40ec3e0 con 0x7f81cc15d5e0 2023-11-28T20:07:50.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.012+0000 7fad1a417640 1 Processor -- start 2023-11-28T20:07:50.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.016+0000 7fad1a417640 1 -- start start 2023-11-28T20:07:50.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.016+0000 7fad1a417640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fad14161140 0x7fad1406e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.016+0000 7fad1a417640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fad140b1de0 0x7fad140cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.016+0000 7fad1a417640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1406c520 con 0x7fad14161520 2023-11-28T20:07:50.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.016+0000 7fad1a417640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1406ec60 con 0x7fad14161140 2023-11-28T20:07:50.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.016+0000 7fad1a417640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad140b2330 con 0x7fad140b1de0 2023-11-28T20:07:50.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.016+0000 7fad189b4640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fad14161520 0x7fad140afe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:34406/0 (socket says 172.21.15.177:34406) 2023-11-28T20:07:50.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.016+0000 7fad189b4640 1 -- 172.21.15.177:0/1013776730 learned_addr learned my addr 172.21.15.177:0/1013776730 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:50.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.016+0000 7fcb30eea640 1 Processor -- start 2023-11-28T20:07:50.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.016+0000 7fcb30eea640 1 -- start start 2023-11-28T20:07:50.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.020+0000 7fcb30eea640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcb2c0b3330 0x7fcb2c16e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.020+0000 7fcb30eea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb2c071670 0x7fcb2c071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.020+0000 7fcb30eea640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2c0711e0 con 0x7fcb2c08a710 2023-11-28T20:07:50.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.020+0000 7fcb30eea640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2c08aaf0 con 0x7fcb2c0b3330 2023-11-28T20:07:50.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.020+0000 7fcb30eea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c0b3770 con 0x7fcb2c071670 2023-11-28T20:07:50.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.020+0000 7fcb2a59c640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fcb2c08a710 0x7fcb2c16d990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:34410/0 (socket says 172.21.15.177:34410) 2023-11-28T20:07:50.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.020+0000 7fcb2a59c640 1 -- 172.21.15.177:0/3923605849 learned_addr learned my addr 172.21.15.177:0/3923605849 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:50.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.020+0000 7fcb29d9b640 1 --2- 172.21.15.177:0/3923605849 >> v2:172.21.15.195:3300/0 conn(0x7fcb2c0b3330 0x7fcb2c16e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.020+0000 7fcb2ad9d640 1 --2- 172.21.15.177:0/3923605849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb2c071670 0x7fcb2c071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.020+0000 7fcb2ad9d640 1 -- 172.21.15.177:0/3923605849 >> v2:172.21.15.195:3300/0 conn(0x7fcb2c0b3330 msgr2=0x7fcb2c16e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.020+0000 7fcb2ad9d640 1 --2- 172.21.15.177:0/3923605849 >> v2:172.21.15.195:3300/0 conn(0x7fcb2c0b3330 0x7fcb2c16e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.020+0000 7fcb2ad9d640 1 -- 172.21.15.177:0/3923605849 >> v1:172.21.15.195:6789/0 conn(0x7fcb2c08a710 legacy=0x7fcb2c16d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.020+0000 7fcb2ad9d640 1 -- 172.21.15.177:0/3923605849 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c0b3d20 con 0x7fcb2c071670 2023-11-28T20:07:50.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad13fff640 1 --2- 172.21.15.177:0/1013776730 >> v2:172.21.15.177:3300/0 conn(0x7fad14161140 0x7fad1406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 -- 172.21.15.177:0/1013776730 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120590124 0 0) 0x7fad1406c520 con 0x7fad14161520 2023-11-28T20:07:50.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 -- 172.21.15.177:0/1013776730 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad00003530 con 0x7fad14161520 2023-11-28T20:07:50.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad0bfff640 1 --2- 172.21.15.177:0/1013776730 >> v2:172.21.15.195:3300/0 conn(0x7fad140b1de0 0x7fad140cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 -- 172.21.15.177:0/1013776730 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 222803156 0 0) 0x7fad00003530 con 0x7fad14161520 2023-11-28T20:07:50.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 -- 172.21.15.177:0/1013776730 >> v2:172.21.15.195:3300/0 conn(0x7fad140b1de0 msgr2=0x7fad140cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 --2- 172.21.15.177:0/1013776730 >> v2:172.21.15.195:3300/0 conn(0x7fad140b1de0 0x7fad140cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 -- 172.21.15.177:0/1013776730 >> v2:172.21.15.177:3300/0 conn(0x7fad14161140 msgr2=0x7fad1406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 --2- 172.21.15.177:0/1013776730 >> v2:172.21.15.177:3300/0 conn(0x7fad14161140 0x7fad1406e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 -- 172.21.15.177:0/1013776730 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad140b2610 con 0x7fad14161520 2023-11-28T20:07:50.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 -- 172.21.15.177:0/1013776730 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7fad0c001a00 con 0x7fad14161520 2023-11-28T20:07:50.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 -- 172.21.15.177:0/1013776730 >> v1:172.21.15.195:6789/0 conn(0x7fad14161520 legacy=0x7fad140afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 --2- 172.21.15.177:0/1013776730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad00003980 0x7fad00003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 --2- 172.21.15.177:0/1013776730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad000047d0 0x7fad00004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 --2- 172.21.15.177:0/1013776730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad00005190 0x7fad0001c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 -- 172.21.15.177:0/1013776730 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1406ec60 con 0x7fad00003980 2023-11-28T20:07:50.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 -- 172.21.15.177:0/1013776730 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad140b2330 con 0x7fad00005190 2023-11-28T20:07:50.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad137fe640 1 -- 172.21.15.177:0/1013776730 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0001d150 con 0x7fad000047d0 2023-11-28T20:07:50.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad0bfff640 1 --2- 172.21.15.177:0/1013776730 >> v2:172.21.15.195:3300/0 conn(0x7fad140b1de0 0x7fad140cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:50.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad189b4640 1 --2- 172.21.15.177:0/1013776730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad00005190 0x7fad0001c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad0bfff640 1 --2- 172.21.15.177:0/1013776730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad000047d0 0x7fad00004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad189b4640 1 -- 172.21.15.177:0/1013776730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad000047d0 msgr2=0x7fad00004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad189b4640 1 --2- 172.21.15.177:0/1013776730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad000047d0 0x7fad00004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad189b4640 1 -- 172.21.15.177:0/1013776730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad00003980 msgr2=0x7fad00003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad189b4640 1 --2- 172.21.15.177:0/1013776730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad00003980 0x7fad00003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.024+0000 7fad189b4640 1 -- 172.21.15.177:0/1013776730 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad140b2610 con 0x7fad00005190 2023-11-28T20:07:50.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.028+0000 7fad189b4640 1 -- 172.21.15.177:0/1013776730 reap_dead start 2023-11-28T20:07:50.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fad189b4640 1 --2- 172.21.15.177:0/1013776730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad00005190 0x7fad0001c9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00a8c0 tx=0x7fad0c01d350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aac965386d05e835 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fcb2ad9d640 1 --2- 172.21.15.177:0/3923605849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb2c071670 0x7fcb2c071b00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009d90 tx=0x7fcb2401c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d0c8fc25332752c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fadc0a9f640 1 Processor -- start 2023-11-28T20:07:50.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fadc0a9f640 1 -- start start 2023-11-28T20:07:50.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fad137fe640 1 -- 172.21.15.177:0/1013776730 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c0ac620 con 0x7fad00005190 2023-11-28T20:07:50.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fad137fe640 1 -- 172.21.15.177:0/1013776730 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c0a8070 con 0x7fad00005190 2023-11-28T20:07:50.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fad1a417640 1 -- 172.21.15.177:0/1013776730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad00005190 msgr2=0x7fad0001c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fad137fe640 1 -- 172.21.15.177:0/1013776730 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c0ac9e0 con 0x7fad00005190 2023-11-28T20:07:50.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fad1a417640 1 --2- 172.21.15.177:0/1013776730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad00005190 0x7fad0001c9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00a8c0 tx=0x7fad0c01d350 comp rx=0 tx=0).stop 2023-11-28T20:07:50.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fcb2959a640 1 -- 172.21.15.177:0/3923605849 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240a5890 con 0x7fcb2c071670 2023-11-28T20:07:50.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fadc0a9f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadbc1467f0 0x7fadbc06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fadc0a9f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fadbc0b3600 0x7fadbc15ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fadc0a9f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadbc06df70 con 0x7fadbc15e110 2023-11-28T20:07:50.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fadc0a9f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadbc06e250 con 0x7fadbc0b3600 2023-11-28T20:07:50.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fadc0a9f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc06e530 con 0x7fadbc1467f0 2023-11-28T20:07:50.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fcb2959a640 1 -- 172.21.15.177:0/3923605849 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb240a59f0 con 0x7fcb2c071670 2023-11-28T20:07:50.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fcb2959a640 1 -- 172.21.15.177:0/3923605849 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240a5d80 con 0x7fcb2c071670 2023-11-28T20:07:50.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fadbb7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadbc1467f0 0x7fadbc06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fad1a417640 1 -- 172.21.15.177:0/1013776730 shutdown_connections 2023-11-28T20:07:50.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fad1a417640 1 --2- 172.21.15.177:0/1013776730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad00005190 0x7fad0001c9a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fad1a417640 1 -- 172.21.15.177:0/1013776730 >> 172.21.15.177:0/1013776730 conn(0x7fad140aea50 msgr2=0x7fad140722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.036+0000 7fad1a417640 1 -- 172.21.15.177:0/1013776730 shutdown_connections 2023-11-28T20:07:50.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.036+0000 7fad1a417640 1 -- 172.21.15.177:0/1013776730 wait complete. 2023-11-28T20:07:50.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fadbb7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadbc1467f0 0x7fadbc06d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:41862/0 (socket says 172.21.15.177:41862) 2023-11-28T20:07:50.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fadbb7fe640 1 -- 172.21.15.177:0/127651522 learned_addr learned my addr 172.21.15.177:0/127651522 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:50.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.032+0000 7fadbbfff640 1 --2- 172.21.15.177:0/127651522 >> v2:172.21.15.195:3300/0 conn(0x7fadbc0b3600 0x7fadbc15ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.036+0000 7fadbb7fe640 1 -- 172.21.15.177:0/127651522 >> v2:172.21.15.195:3300/0 conn(0x7fadbc0b3600 msgr2=0x7fadbc15ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.036+0000 7fadbb7fe640 1 --2- 172.21.15.177:0/127651522 >> v2:172.21.15.195:3300/0 conn(0x7fadbc0b3600 0x7fadbc15ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.036+0000 7fadbb7fe640 1 -- 172.21.15.177:0/127651522 >> v1:172.21.15.195:6789/0 conn(0x7fadbc15e110 legacy=0x7fadbc0b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.036+0000 7fadbb7fe640 1 -- 172.21.15.177:0/127651522 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc06e810 con 0x7fadbc1467f0 2023-11-28T20:07:50.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.036+0000 7fcb30eea640 1 -- 172.21.15.177:0/3923605849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb2c071670 msgr2=0x7fcb2c071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.036+0000 7fcb30eea640 1 --2- 172.21.15.177:0/3923605849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb2c071670 0x7fcb2c071b00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009d90 tx=0x7fcb2401c890 comp rx=0 tx=0).stop 2023-11-28T20:07:50.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.036+0000 7fcb30eea640 1 -- 172.21.15.177:0/3923605849 shutdown_connections 2023-11-28T20:07:50.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.036+0000 7fcb30eea640 1 --2- 172.21.15.177:0/3923605849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb2c071670 0x7fcb2c071b00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.036+0000 7fcb30eea640 1 --2- 172.21.15.177:0/3923605849 >> v2:172.21.15.195:3300/0 conn(0x7fcb2c0b3330 0x7fcb2c16e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.036+0000 7fcb30eea640 1 -- 172.21.15.177:0/3923605849 >> 172.21.15.177:0/3923605849 conn(0x7fcb2c06c2c0 msgr2=0x7fcb2c06c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.036+0000 7fcb30eea640 1 -- 172.21.15.177:0/3923605849 shutdown_connections 2023-11-28T20:07:50.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.036+0000 7fcb30eea640 1 -- 172.21.15.177:0/3923605849 wait complete. 2023-11-28T20:07:50.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.036+0000 7fad1a417640 1 Processor -- start 2023-11-28T20:07:50.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.040+0000 7fad1a417640 1 -- start start 2023-11-28T20:07:50.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.040+0000 7fcb30eea640 1 Processor -- start 2023-11-28T20:07:50.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.040+0000 7fad1a417640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad00005190 0x7fad141521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.040+0000 7fad1a417640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad141619e0 0x7fad1414ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.040+0000 7fad1a417640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad140cd920 0x7fad140cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.040+0000 7fad1a417640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad140ce310 con 0x7fad00005190 2023-11-28T20:07:50.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.040+0000 7fad1a417640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad141621c0 con 0x7fad141619e0 2023-11-28T20:07:50.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.040+0000 7fad1a417640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad141624a0 con 0x7fad140cd920 2023-11-28T20:07:50.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.040+0000 7fcb30eea640 1 -- start start 2023-11-28T20:07:50.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad0bfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad141619e0 0x7fad1414ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad189b4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad140cd920 0x7fad140cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad13fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad00005190 0x7fad141521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad13fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad00005190 0x7fad141521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44554/0 (socket says 172.21.15.177:44554) 2023-11-28T20:07:50.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad13fff640 1 -- 172.21.15.177:0/4042869946 learned_addr learned my addr 172.21.15.177:0/4042869946 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:50.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb30eea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb2c071670 0x7fcb2c0896e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb30eea640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb2c08a710 0x7fcb2c15ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb30eea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb2c0b3330 0x7fcb2c15f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb30eea640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c16d640 con 0x7fcb2c071670 2023-11-28T20:07:50.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb30eea640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c14f3d0 con 0x7fcb2c08a710 2023-11-28T20:07:50.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb30eea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c14f6b0 con 0x7fcb2c0b3330 2023-11-28T20:07:50.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad13fff640 1 -- 172.21.15.177:0/4042869946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad140cd920 msgr2=0x7fad140cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad13fff640 1 --2- 172.21.15.177:0/4042869946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad140cd920 0x7fad140cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad13fff640 1 -- 172.21.15.177:0/4042869946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad141619e0 msgr2=0x7fad1414ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad13fff640 1 --2- 172.21.15.177:0/4042869946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad141619e0 0x7fad1414ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad13fff640 1 -- 172.21.15.177:0/4042869946 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad14162780 con 0x7fad00005190 2023-11-28T20:07:50.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad0bfff640 1 --2- 172.21.15.177:0/4042869946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad141619e0 0x7fad1414ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:50.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad13fff640 1 --2- 172.21.15.177:0/4042869946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad00005190 0x7fad141521c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7facfc00d7d0 tx=0x7facfc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb29d9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb2c08a710 0x7fcb2c15ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb29d9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb2c08a710 0x7fcb2c15ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53754/0 (socket says 172.21.15.177:53754) 2023-11-28T20:07:50.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb29d9b640 1 -- 172.21.15.177:0/3077657446 learned_addr learned my addr 172.21.15.177:0/3077657446 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:50.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb2ad9d640 1 --2- 172.21.15.177:0/3077657446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb2c0b3330 0x7fcb2c15f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb29d9b640 1 -- 172.21.15.177:0/3077657446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb2c0b3330 msgr2=0x7fcb2c15f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb29d9b640 1 --2- 172.21.15.177:0/3077657446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb2c0b3330 0x7fcb2c15f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb29d9b640 1 -- 172.21.15.177:0/3077657446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb2c071670 msgr2=0x7fcb2c0896e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:07:50.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad117fa640 1 -- 172.21.15.177:0/4042869946 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc0096a0 con 0x7fad00005190 2023-11-28T20:07:50.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad117fa640 1 -- 172.21.15.177:0/4042869946 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc009840 con 0x7fad00005190 2023-11-28T20:07:50.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad117fa640 1 -- 172.21.15.177:0/4042869946 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc009bf0 con 0x7fad00005190 2023-11-28T20:07:50.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad1a417640 1 -- 172.21.15.177:0/4042869946 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad14162a60 con 0x7fad00005190 2023-11-28T20:07:50.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad1a417640 1 -- 172.21.15.177:0/4042869946 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad14161e60 con 0x7fad00005190 2023-11-28T20:07:50.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fadbb7fe640 1 --2- 172.21.15.177:0/127651522 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadbc1467f0 0x7fadbc06d8d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fadac009870 tx=0x7fadac01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e8a3a158faf73ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb2a59c640 1 --2- 172.21.15.177:0/3077657446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb2c071670 0x7fcb2c0896e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fadbaffd640 1 -- 172.21.15.177:0/127651522 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac0ab620 con 0x7fadbc1467f0 2023-11-28T20:07:50.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fadbaffd640 1 -- 172.21.15.177:0/127651522 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac0ab780 con 0x7fadbc1467f0 2023-11-28T20:07:50.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fadbaffd640 1 -- 172.21.15.177:0/127651522 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac0abb10 con 0x7fadbc1467f0 2023-11-28T20:07:50.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb29d9b640 1 --2- 172.21.15.177:0/3077657446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb2c071670 0x7fcb2c0896e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fcb29d9b640 1 -- 172.21.15.177:0/3077657446 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb24009a70 con 0x7fcb2c08a710 2023-11-28T20:07:50.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.048+0000 7fcb29d9b640 1 --2- 172.21.15.177:0/3077657446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb2c08a710 0x7fcb2c15ec10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00d800 tx=0x7fcb1c00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.048+0000 7fcb1affd640 1 -- 172.21.15.177:0/3077657446 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c00b6c0 con 0x7fcb2c08a710 2023-11-28T20:07:50.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.048+0000 7fadc0a9f640 1 -- 172.21.15.177:0/127651522 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadbc1467f0 msgr2=0x7fadbc06d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.048+0000 7fadc0a9f640 1 --2- 172.21.15.177:0/127651522 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadbc1467f0 0x7fadbc06d8d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fadac009870 tx=0x7fadac01c510 comp rx=0 tx=0).stop 2023-11-28T20:07:50.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.044+0000 7fad1a417640 1 -- 172.21.15.177:0/4042869946 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad140693d0 con 0x7fad00005190 2023-11-28T20:07:50.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.048+0000 7fcb1affd640 1 -- 172.21.15.177:0/3077657446 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c00b820 con 0x7fcb2c08a710 2023-11-28T20:07:50.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.048+0000 7fcb1affd640 1 -- 172.21.15.177:0/3077657446 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c00bbb0 con 0x7fcb2c08a710 2023-11-28T20:07:50.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.048+0000 7fadc0a9f640 1 -- 172.21.15.177:0/127651522 shutdown_connections 2023-11-28T20:07:50.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.048+0000 7fadc0a9f640 1 --2- 172.21.15.177:0/127651522 >> v2:172.21.15.195:3300/0 conn(0x7fadbc0b3600 0x7fadbc15ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.048+0000 7fadc0a9f640 1 --2- 172.21.15.177:0/127651522 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadbc1467f0 0x7fadbc06d8d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.048+0000 7fadc0a9f640 1 -- 172.21.15.177:0/127651522 >> 172.21.15.177:0/127651522 conn(0x7fadbc0b0ae0 msgr2=0x7fadbc0b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.048+0000 7fadc0a9f640 1 -- 172.21.15.177:0/127651522 shutdown_connections 2023-11-28T20:07:50.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.048+0000 7fcb30eea640 1 -- 172.21.15.177:0/3077657446 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2c151aa0 con 0x7fcb2c08a710 2023-11-28T20:07:50.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.048+0000 7fcb30eea640 1 -- 172.21.15.177:0/3077657446 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2c15f960 con 0x7fcb2c08a710 2023-11-28T20:07:50.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.048+0000 7fadc0a9f640 1 -- 172.21.15.177:0/127651522 wait complete. 2023-11-28T20:07:50.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.052+0000 7fadc0a9f640 1 Processor -- start 2023-11-28T20:07:50.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.052+0000 7fadc0a9f640 1 -- start start 2023-11-28T20:07:50.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.052+0000 7fcb30eea640 1 -- 172.21.15.177:0/3077657446 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2c151fc0 con 0x7fcb2c08a710 2023-11-28T20:07:50.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.052+0000 7fadc0a9f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadbc0b3600 0x7fadbc13c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.052+0000 7fadc0a9f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadbc1467f0 0x7fadbc0cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.052+0000 7fadc0a9f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadbc15e110 0x7fadbc0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fadbb7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadbc0b3600 0x7fadbc13c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fadbb7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadbc0b3600 0x7fadbc13c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:41894/0 (socket says 172.21.15.177:41894) 2023-11-28T20:07:50.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fadbbfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadbc15e110 0x7fadbc0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fadbbfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadbc15e110 0x7fadbc0cc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53768/0 (socket says 172.21.15.177:53768) 2023-11-28T20:07:50.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fadbb7fe640 1 -- 172.21.15.177:0/2002514783 learned_addr learned my addr 172.21.15.177:0/2002514783 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:50.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fadc0a9f640 1 -- 172.21.15.177:0/2002514783 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc13cc20 con 0x7fadbc1467f0 2023-11-28T20:07:50.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fadc0a9f640 1 -- 172.21.15.177:0/2002514783 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc13dd20 con 0x7fadbc15e110 2023-11-28T20:07:50.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fadc0a9f640 1 -- 172.21.15.177:0/2002514783 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc13ce30 con 0x7fadbc0b3600 2023-11-28T20:07:50.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fadbbfff640 1 -- 172.21.15.177:0/2002514783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadbc0b3600 msgr2=0x7fadbc13c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fadbbfff640 1 --2- 172.21.15.177:0/2002514783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadbc0b3600 0x7fadbc13c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fadbbfff640 1 -- 172.21.15.177:0/2002514783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadbc1467f0 msgr2=0x7fadbc0cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fadbbfff640 1 --2- 172.21.15.177:0/2002514783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadbc1467f0 0x7fadbc0cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fadbbfff640 1 -- 172.21.15.177:0/2002514783 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac0094d0 con 0x7fadbc15e110 2023-11-28T20:07:50.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fadbb7fe640 1 --2- 172.21.15.177:0/2002514783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadbc0b3600 0x7fadbc13c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:07:50.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fadbbfff640 1 --2- 172.21.15.177:0/2002514783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadbc15e110 0x7fadbc0cc760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fadbc15d6d0 tx=0x7fadb400d9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fcb1affd640 1 -- 172.21.15.177:0/3077657446 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcb1c00bd10 con 0x7fcb2c08a710 2023-11-28T20:07:50.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.060+0000 7fcb1affd640 1 --2- 172.21.15.177:0/3077657446 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcb0c0664f0 0x7fcb0c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.060+0000 7fcb2a59c640 1 --2- 172.21.15.177:0/3077657446 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcb0c0664f0 0x7fcb0c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.056+0000 7fad117fa640 1 -- 172.21.15.177:0/4042869946 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7facfc009d50 con 0x7fad00005190 2023-11-28T20:07:50.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.060+0000 7fad117fa640 1 --2- 172.21.15.177:0/4042869946 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7facf40664a0 0x7facf4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.060+0000 7fad117fa640 1 -- 172.21.15.177:0/4042869946 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facfc084dd0 con 0x7fad00005190 2023-11-28T20:07:50.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.060+0000 7fad0bfff640 1 --2- 172.21.15.177:0/4042869946 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7facf40664a0 0x7facf4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.060+0000 7fadb8ff9640 1 -- 172.21.15.177:0/2002514783 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb40125f0 con 0x7fadbc15e110 2023-11-28T20:07:50.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.060+0000 7fadb8ff9640 1 -- 172.21.15.177:0/2002514783 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb4012750 con 0x7fadbc15e110 2023-11-28T20:07:50.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.060+0000 7fadb8ff9640 1 -- 172.21.15.177:0/2002514783 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4012b00 con 0x7fadbc15e110 2023-11-28T20:07:50.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.064+0000 7fcb1affd640 1 -- 172.21.15.177:0/3077657446 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb1c0553d0 con 0x7fcb2c08a710 2023-11-28T20:07:50.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.064+0000 7fcb1affd640 1 -- 172.21.15.177:0/3077657446 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb2c151fc0 con 0x7fcb2c08a710 2023-11-28T20:07:50.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.064+0000 7fad117fa640 1 -- 172.21.15.177:0/4042869946 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7facfc052230 con 0x7fad00005190 2023-11-28T20:07:50.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.064+0000 7fcb2a59c640 1 --2- 172.21.15.177:0/3077657446 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcb0c0664f0 0x7fcb0c0689b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb20001ec0 tx=0x7fcb2000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.064+0000 7fad0bfff640 1 --2- 172.21.15.177:0/4042869946 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7facf40664a0 0x7facf4068960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fad14165e20 tx=0x7fad04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.068+0000 7fadc0a9f640 1 -- 172.21.15.177:0/2002514783 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadbc13d110 con 0x7fadbc15e110 2023-11-28T20:07:50.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.068+0000 7fadc0a9f640 1 -- 172.21.15.177:0/2002514783 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadbc13d6d0 con 0x7fadbc15e110 2023-11-28T20:07:50.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.072+0000 7fadc0a9f640 1 -- 172.21.15.177:0/2002514783 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadbc0693d0 con 0x7fadbc15e110 2023-11-28T20:07:50.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.076+0000 7fadb8ff9640 1 -- 172.21.15.177:0/2002514783 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fadb4012c60 con 0x7fadbc15e110 2023-11-28T20:07:50.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.076+0000 7fadb8ff9640 1 --2- 172.21.15.177:0/2002514783 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad9c066470 0x7fad9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.076+0000 7fadb8ff9640 1 -- 172.21.15.177:0/2002514783 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadb40842f0 con 0x7fadbc15e110 2023-11-28T20:07:50.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.076+0000 7fadbb7fe640 1 --2- 172.21.15.177:0/2002514783 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad9c066470 0x7fad9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.080+0000 7fadb8ff9640 1 -- 172.21.15.177:0/2002514783 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fadb40516e0 con 0x7fadbc15e110 2023-11-28T20:07:50.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.080+0000 7fadbb7fe640 1 --2- 172.21.15.177:0/2002514783 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad9c066470 0x7fad9c068930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fadac01c550 tx=0x7fadac0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.104+0000 7f13253b8640 1 Processor -- start 2023-11-28T20:07:50.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.104+0000 7f13253b8640 1 -- start start 2023-11-28T20:07:50.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f30342c9640 1 Processor -- start 2023-11-28T20:07:50.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f13253b8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f132006e8a0 0x7f13200cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f13253b8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1320159230 0x7f13200b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f30342c9640 1 -- start start 2023-11-28T20:07:50.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f13253b8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13200b2500 con 0x7f1320071a60 2023-11-28T20:07:50.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f13253b8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132015ddc0 con 0x7f132006e8a0 2023-11-28T20:07:50.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f13253b8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1320160120 con 0x7f1320159230 2023-11-28T20:07:50.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f131e7fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1320159230 0x7f13200b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f131e7fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1320159230 0x7f13200b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:41906/0 (socket says 172.21.15.177:41906) 2023-11-28T20:07:50.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f131e7fc640 1 -- 172.21.15.177:0/801001153 learned_addr learned my addr 172.21.15.177:0/801001153 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:50.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f131effd640 1 --2- 172.21.15.177:0/801001153 >> v2:172.21.15.177:3300/0 conn(0x7f132006e8a0 0x7f13200cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f9807b72640 1 Processor -- start 2023-11-28T20:07:50.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f131e7fc640 1 -- 172.21.15.177:0/801001153 >> v2:172.21.15.177:3300/0 conn(0x7f132006e8a0 msgr2=0x7f13200cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f131e7fc640 1 --2- 172.21.15.177:0/801001153 >> v2:172.21.15.177:3300/0 conn(0x7f132006e8a0 0x7f13200cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f131e7fc640 1 -- 172.21.15.177:0/801001153 >> v1:172.21.15.177:6789/0 conn(0x7f1320071a60 legacy=0x7f1320071ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f131e7fc640 1 -- 172.21.15.177:0/801001153 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1320159690 con 0x7f1320159230 2023-11-28T20:07:50.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.108+0000 7f9807b72640 1 -- start start 2023-11-28T20:07:50.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f9807b72640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f97f80df740 0x7f97f8006700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f9807b72640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f97f80543a0 0x7f97f8006c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f9807b72640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f8050ae0 con 0x7f97f80535f0 2023-11-28T20:07:50.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f9807b72640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f80525e0 con 0x7f97f80543a0 2023-11-28T20:07:50.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f9807b72640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f80dfb20 con 0x7f97f80df740 2023-11-28T20:07:50.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f30342c9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f302c0d1780 0x7f302c0d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f30342c9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f302c0cfac0 0x7f302c0cff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f30342c9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302c0d0d30 con 0x7f302c0b3bc0 2023-11-28T20:07:50.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f30342c9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f302c0d0490 con 0x7f302c0cfac0 2023-11-28T20:07:50.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f30342c9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f302c160f80 con 0x7f302c0d1780 2023-11-28T20:07:50.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f980590e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f97f80df740 0x7f97f8006700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f980590e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f97f80df740 0x7f97f8006700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53778/0 (socket says 172.21.15.177:53778) 2023-11-28T20:07:50.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f980590e640 1 -- 172.21.15.177:0/1478054444 learned_addr learned my addr 172.21.15.177:0/1478054444 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:50.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f980610f640 1 --2- 172.21.15.177:0/1478054444 >> v2:172.21.15.177:3300/0 conn(0x7f97f80543a0 0x7f97f8006c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f3031864640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f302c0d1780 0x7f302c0d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f3031864640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f302c0d1780 0x7f302c0d1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53788/0 (socket says 172.21.15.177:53788) 2023-11-28T20:07:50.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.112+0000 7f3031864640 1 -- 172.21.15.177:0/3213617853 learned_addr learned my addr 172.21.15.177:0/3213617853 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:50.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f3032866640 1 --2- 172.21.15.177:0/3213617853 >> v2:172.21.15.177:3300/0 conn(0x7f302c0cfac0 0x7f302c0cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f131e7fc640 1 --2- 172.21.15.177:0/801001153 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1320159230 0x7f13200b1fc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1314009870 tx=0x7f131401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb7d545bd4694ab2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f131dffb640 1 -- 172.21.15.177:0/801001153 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140a9400 con 0x7f1320159230 2023-11-28T20:07:50.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f131dffb640 1 -- 172.21.15.177:0/801001153 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13140a9560 con 0x7f1320159230 2023-11-28T20:07:50.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f131dffb640 1 -- 172.21.15.177:0/801001153 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140a98f0 con 0x7f1320159230 2023-11-28T20:07:50.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f980590e640 1 -- 172.21.15.177:0/1478054444 >> v2:172.21.15.177:3300/0 conn(0x7f97f80543a0 msgr2=0x7f97f8006c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f980590e640 1 --2- 172.21.15.177:0/1478054444 >> v2:172.21.15.177:3300/0 conn(0x7f97f80543a0 0x7f97f8006c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f980590e640 1 -- 172.21.15.177:0/1478054444 >> v1:172.21.15.195:6789/0 conn(0x7f97f80535f0 legacy=0x7f97f8053c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f980590e640 1 -- 172.21.15.177:0/1478054444 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f8052830 con 0x7f97f80df740 2023-11-28T20:07:50.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f3031864640 1 -- 172.21.15.177:0/3213617853 >> v2:172.21.15.177:3300/0 conn(0x7f302c0cfac0 msgr2=0x7f302c0cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f3031864640 1 --2- 172.21.15.177:0/3213617853 >> v2:172.21.15.177:3300/0 conn(0x7f302c0cfac0 0x7f302c0cff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f3031864640 1 -- 172.21.15.177:0/3213617853 >> v1:172.21.15.177:6789/0 conn(0x7f302c0b3bc0 legacy=0x7f302c0b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f13253b8640 1 -- 172.21.15.177:0/801001153 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1320159230 msgr2=0x7f13200b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f13253b8640 1 --2- 172.21.15.177:0/801001153 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1320159230 0x7f13200b1fc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1314009870 tx=0x7f131401c540 comp rx=0 tx=0).stop 2023-11-28T20:07:50.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f3031864640 1 -- 172.21.15.177:0/3213617853 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c0d12f0 con 0x7f302c0d1780 2023-11-28T20:07:50.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f13253b8640 1 -- 172.21.15.177:0/801001153 shutdown_connections 2023-11-28T20:07:50.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f13253b8640 1 --2- 172.21.15.177:0/801001153 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1320159230 0x7f13200b1fc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f13253b8640 1 --2- 172.21.15.177:0/801001153 >> v2:172.21.15.177:3300/0 conn(0x7f132006e8a0 0x7f13200cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.116+0000 7f13253b8640 1 -- 172.21.15.177:0/801001153 >> 172.21.15.177:0/801001153 conn(0x7f132006c2c0 msgr2=0x7f132006c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.120+0000 7f13253b8640 1 -- 172.21.15.177:0/801001153 shutdown_connections 2023-11-28T20:07:50.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.120+0000 7f3031864640 1 --2- 172.21.15.177:0/3213617853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f302c0d1780 0x7f302c0d1be0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f302c073f00 tx=0x7f301c01c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35711d1e5499c06f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.120+0000 7f980590e640 1 --2- 172.21.15.177:0/1478054444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97f80df740 0x7f97f8006700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97f8052510 tx=0x7f97fc01f380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ded76355221aec49 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.120+0000 7f13253b8640 1 -- 172.21.15.177:0/801001153 wait complete. 2023-11-28T20:07:50.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.120+0000 7f13253b8640 1 Processor -- start 2023-11-28T20:07:50.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.120+0000 7f980490c640 1 -- 172.21.15.177:0/1478054444 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc004030 con 0x7f97f80df740 2023-11-28T20:07:50.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.120+0000 7f3031063640 1 -- 172.21.15.177:0/3213617853 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c0ac410 con 0x7f302c0d1780 2023-11-28T20:07:50.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.120+0000 7f980490c640 1 -- 172.21.15.177:0/1478054444 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc0ab030 con 0x7f97f80df740 2023-11-28T20:07:50.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.124+0000 7f980490c640 1 -- 172.21.15.177:0/1478054444 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc004410 con 0x7f97f80df740 2023-11-28T20:07:50.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.124+0000 7f3031063640 1 -- 172.21.15.177:0/3213617853 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c0ac570 con 0x7f302c0d1780 2023-11-28T20:07:50.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.124+0000 7f3031063640 1 -- 172.21.15.177:0/3213617853 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c0ac900 con 0x7f302c0d1780 2023-11-28T20:07:50.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.124+0000 7f9807b72640 1 -- 172.21.15.177:0/1478054444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97f80df740 msgr2=0x7f97f8006700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.124+0000 7f9807b72640 1 --2- 172.21.15.177:0/1478054444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97f80df740 0x7f97f8006700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97f8052510 tx=0x7f97fc01f380 comp rx=0 tx=0).stop 2023-11-28T20:07:50.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.124+0000 7f9807b72640 1 -- 172.21.15.177:0/1478054444 shutdown_connections 2023-11-28T20:07:50.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.124+0000 7f9807b72640 1 --2- 172.21.15.177:0/1478054444 >> v2:172.21.15.177:3300/0 conn(0x7f97f80543a0 0x7f97f8006c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.124+0000 7f9807b72640 1 --2- 172.21.15.177:0/1478054444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97f80df740 0x7f97f8006700 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.124+0000 7f9807b72640 1 -- 172.21.15.177:0/1478054444 >> 172.21.15.177:0/1478054444 conn(0x7f97f8009f90 msgr2=0x7f97f800a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.124+0000 7f9807b72640 1 -- 172.21.15.177:0/1478054444 shutdown_connections 2023-11-28T20:07:50.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.124+0000 7f9807b72640 1 -- 172.21.15.177:0/1478054444 wait complete. 2023-11-28T20:07:50.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.124+0000 7f30342c9640 1 -- 172.21.15.177:0/3213617853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f302c0d1780 msgr2=0x7f302c0d1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.124+0000 7f30342c9640 1 --2- 172.21.15.177:0/3213617853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f302c0d1780 0x7f302c0d1be0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f302c073f00 tx=0x7f301c01c4c0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f13253b8640 1 -- start start 2023-11-28T20:07:50.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f30342c9640 1 -- 172.21.15.177:0/3213617853 shutdown_connections 2023-11-28T20:07:50.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f30342c9640 1 --2- 172.21.15.177:0/3213617853 >> v2:172.21.15.177:3300/0 conn(0x7f302c0cfac0 0x7f302c0cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f30342c9640 1 --2- 172.21.15.177:0/3213617853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f302c0d1780 0x7f302c0d1be0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f30342c9640 1 -- 172.21.15.177:0/3213617853 >> 172.21.15.177:0/3213617853 conn(0x7f302c09c430 msgr2=0x7f302c0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f13253b8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f132006e8a0 0x7f1320163640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f13253b8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1320071a60 0x7f132015f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f13253b8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1320159230 0x7f132015fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f30342c9640 1 -- 172.21.15.177:0/3213617853 shutdown_connections 2023-11-28T20:07:50.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f9807b72640 1 Processor -- start 2023-11-28T20:07:50.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f9807b72640 1 -- start start 2023-11-28T20:07:50.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f9807b72640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97f80535f0 0x7f97f80de5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f9807b72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97f80543a0 0x7f97f80cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f9807b72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97f80df740 0x7f97f80db850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f9807b72640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80dbd90 con 0x7f97f80df740 2023-11-28T20:07:50.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f9807b72640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80dd160 con 0x7f97f80535f0 2023-11-28T20:07:50.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f9807b72640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80dbfc0 con 0x7f97f80543a0 2023-11-28T20:07:50.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.128+0000 7f30342c9640 1 -- 172.21.15.177:0/3213617853 wait complete. 2023-11-28T20:07:50.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f980590e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97f80535f0 0x7f97f80de5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f980590e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97f80535f0 0x7f97f80de5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53792/0 (socket says 172.21.15.177:53792) 2023-11-28T20:07:50.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f980590e640 1 -- 172.21.15.177:0/2740958081 learned_addr learned my addr 172.21.15.177:0/2740958081 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:50.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f980510d640 1 --2- 172.21.15.177:0/2740958081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97f80543a0 0x7f97f80cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f30342c9640 1 Processor -- start 2023-11-28T20:07:50.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f980590e640 1 -- 172.21.15.177:0/2740958081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97f80543a0 msgr2=0x7f97f80cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f980590e640 1 --2- 172.21.15.177:0/2740958081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97f80543a0 0x7f97f80cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f980590e640 1 -- 172.21.15.177:0/2740958081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97f80df740 msgr2=0x7f97f80db850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f980590e640 1 --2- 172.21.15.177:0/2740958081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97f80df740 0x7f97f80db850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f980590e640 1 -- 172.21.15.177:0/2740958081 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97fc00b590 con 0x7f97f80535f0 2023-11-28T20:07:50.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f30342c9640 1 -- start start 2023-11-28T20:07:50.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f980590e640 1 --2- 172.21.15.177:0/2740958081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97f80535f0 0x7f97f80de5a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f97fc01cfb0 tx=0x7f97fc01c120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f97f67fc640 1 -- 172.21.15.177:0/2740958081 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc003b70 con 0x7f97f80535f0 2023-11-28T20:07:50.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f97f67fc640 1 -- 172.21.15.177:0/2740958081 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc003cd0 con 0x7f97f80535f0 2023-11-28T20:07:50.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f97f67fc640 1 -- 172.21.15.177:0/2740958081 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc0bd670 con 0x7f97f80535f0 2023-11-28T20:07:50.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f9807b72640 1 -- 172.21.15.177:0/2740958081 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f8049b50 con 0x7f97f80535f0 2023-11-28T20:07:50.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.132+0000 7f9807b72640 1 -- 172.21.15.177:0/2740958081 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f804a110 con 0x7f97f80535f0 2023-11-28T20:07:50.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f13253b8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132014f1c0 con 0x7f1320159230 2023-11-28T20:07:50.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f13253b8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132014e260 con 0x7f132006e8a0 2023-11-28T20:07:50.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f13253b8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132014e540 con 0x7f1320071a60 2023-11-28T20:07:50.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f131e7fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1320071a60 0x7f132015f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f131e7fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1320071a60 0x7f132015f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:41932/0 (socket says 172.21.15.177:41932) 2023-11-28T20:07:50.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f131e7fc640 1 -- 172.21.15.177:0/3830973599 learned_addr learned my addr 172.21.15.177:0/3830973599 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:50.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f131f7fe640 1 --2- 172.21.15.177:0/3830973599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1320159230 0x7f132015fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f30342c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f302c0b3bc0 0x7f302c0c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f131effd640 1 --2- 172.21.15.177:0/3830973599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f132006e8a0 0x7f1320163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f30342c9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f302c0cfac0 0x7f302c202360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f3032065640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f302c0b3bc0 0x7f302c0c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f3032065640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f302c0b3bc0 0x7f302c0c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:41944/0 (socket says 172.21.15.177:41944) 2023-11-28T20:07:50.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f131e7fc640 1 -- 172.21.15.177:0/3830973599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f132006e8a0 msgr2=0x7f1320163640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f131e7fc640 1 --2- 172.21.15.177:0/3830973599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f132006e8a0 0x7f1320163640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f131e7fc640 1 -- 172.21.15.177:0/3830973599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1320159230 msgr2=0x7f132015fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f131e7fc640 1 --2- 172.21.15.177:0/3830973599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1320159230 0x7f132015fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f131e7fc640 1 -- 172.21.15.177:0/3830973599 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13140094d0 con 0x7f1320071a60 2023-11-28T20:07:50.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f3032065640 1 -- 172.21.15.177:0/2015496452 learned_addr learned my addr 172.21.15.177:0/2015496452 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:50.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f3031864640 1 --2- 172.21.15.177:0/2015496452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f302c0cfac0 0x7f302c202360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f131e7fc640 1 --2- 172.21.15.177:0/3830973599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1320071a60 0x7f132015f5e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f13140097c0 tx=0x7f13140192e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f30342c9640 1 --2- 172.21.15.177:0/2015496452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f302c0d1780 0x7f302c06bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f30342c9640 1 -- 172.21.15.177:0/2015496452 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c09cea0 con 0x7f302c0d1780 2023-11-28T20:07:50.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f13077fe640 1 -- 172.21.15.177:0/3830973599 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140a9400 con 0x7f1320071a60 2023-11-28T20:07:50.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f13077fe640 1 -- 172.21.15.177:0/3830973599 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13140b1820 con 0x7f1320071a60 2023-11-28T20:07:50.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f13077fe640 1 -- 172.21.15.177:0/3830973599 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140b1bd0 con 0x7f1320071a60 2023-11-28T20:07:50.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f97f67fc640 1 -- 172.21.15.177:0/2740958081 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f97fc0bd7d0 con 0x7f97f80535f0 2023-11-28T20:07:50.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f97e3fff640 1 -- 172.21.15.177:0/2740958081 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f8005370 con 0x7f97f80535f0 2023-11-28T20:07:50.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f3032866640 1 --2- 172.21.15.177:0/2015496452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f302c0d1780 0x7f302c06bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f30342c9640 1 -- 172.21.15.177:0/2015496452 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c0c89f0 con 0x7f302c0cfac0 2023-11-28T20:07:50.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f30342c9640 1 -- 172.21.15.177:0/2015496452 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302c2028a0 con 0x7f302c0b3bc0 2023-11-28T20:07:50.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f13253b8640 1 -- 172.21.15.177:0/3830973599 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132014e820 con 0x7f1320071a60 2023-11-28T20:07:50.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7f13253b8640 1 -- 172.21.15.177:0/3830973599 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132014ede0 con 0x7f1320071a60 2023-11-28T20:07:50.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7fd0d1bfd640 1 Processor -- start 2023-11-28T20:07:50.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.136+0000 7fd0d1bfd640 1 -- start start 2023-11-28T20:07:50.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7fd0d1bfd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0cc0b2ef0 0x7fd0cc071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7fd0d0bfb640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fd0cc14af50 0x7fd0cc0702b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51560/0 (socket says 172.21.15.177:51560) 2023-11-28T20:07:50.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7fd0d0bfb640 1 -- 172.21.15.177:0/405926457 learned_addr learned my addr 172.21.15.177:0/405926457 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:50.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7f3032065640 1 -- 172.21.15.177:0/2015496452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f302c0cfac0 msgr2=0x7f302c202360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7f3032065640 1 --2- 172.21.15.177:0/2015496452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f302c0cfac0 0x7f302c202360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7f3032065640 1 -- 172.21.15.177:0/2015496452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f302c0d1780 msgr2=0x7f302c06bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7f3032065640 1 --2- 172.21.15.177:0/2015496452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f302c0d1780 0x7f302c06bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7f3032065640 1 -- 172.21.15.177:0/2015496452 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c0094d0 con 0x7f302c0b3bc0 2023-11-28T20:07:50.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7f3032065640 1 --2- 172.21.15.177:0/2015496452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f302c0b3bc0 0x7f302c0c84b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f302800b3e0 tx=0x7f302800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7f3022ffd640 1 -- 172.21.15.177:0/2015496452 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3028011830 con 0x7f302c0b3bc0 2023-11-28T20:07:50.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7f3022ffd640 1 -- 172.21.15.177:0/2015496452 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30280119b0 con 0x7f302c0b3bc0 2023-11-28T20:07:50.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7f3022ffd640 1 -- 172.21.15.177:0/2015496452 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3028011d60 con 0x7f302c0b3bc0 2023-11-28T20:07:50.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7f97f67fc640 1 --2- 172.21.15.177:0/2740958081 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97e4066470 0x7f97e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7f97f67fc640 1 -- 172.21.15.177:0/2740958081 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97fc122e10 con 0x7f97f80535f0 2023-11-28T20:07:50.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7fd0d1bfd640 1 --2- 172.21.15.177:0/405926457 >> v2:172.21.15.195:3300/0 conn(0x7fd0cc0718b0 0x7fd0cc0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7fd0cbfff640 1 --2- 172.21.15.177:0/405926457 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0cc0b2ef0 0x7fd0cc071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7f30342c9640 1 -- 172.21.15.177:0/2015496452 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302c0a08e0 con 0x7f302c0b3bc0 2023-11-28T20:07:50.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7f30342c9640 1 -- 172.21.15.177:0/2015496452 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302c09d0b0 con 0x7f302c0b3bc0 2023-11-28T20:07:50.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7fd0d1bfd640 1 -- 172.21.15.177:0/405926457 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0cc071d00 con 0x7fd0cc14af50 2023-11-28T20:07:50.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7fd0d1bfd640 1 -- 172.21.15.177:0/405926457 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0cc0710e0 con 0x7fd0cc0718b0 2023-11-28T20:07:50.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7f13253b8640 1 -- 172.21.15.177:0/3830973599 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1320069440 con 0x7f1320071a60 2023-11-28T20:07:50.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7fd0d1bfd640 1 -- 172.21.15.177:0/405926457 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc070b20 con 0x7fd0cc0b2ef0 2023-11-28T20:07:50.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7fd0d13fc640 1 --2- 172.21.15.177:0/405926457 >> v2:172.21.15.195:3300/0 conn(0x7fd0cc0718b0 0x7fd0cc0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7fd0cbfff640 1 -- 172.21.15.177:0/405926457 >> v2:172.21.15.195:3300/0 conn(0x7fd0cc0718b0 msgr2=0x7fd0cc0ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7fd0cbfff640 1 --2- 172.21.15.177:0/405926457 >> v2:172.21.15.195:3300/0 conn(0x7fd0cc0718b0 0x7fd0cc0ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7fd0cbfff640 1 -- 172.21.15.177:0/405926457 >> v1:172.21.15.177:6789/0 conn(0x7fd0cc14af50 legacy=0x7fd0cc0702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7fd0cbfff640 1 -- 172.21.15.177:0/405926457 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0cc070e00 con 0x7fd0cc0b2ef0 2023-11-28T20:07:50.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.140+0000 7f980510d640 1 --2- 172.21.15.177:0/2740958081 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97e4066470 0x7f97e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.144+0000 7f13077fe640 1 -- 172.21.15.177:0/3830973599 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13140b1d30 con 0x7f1320071a60 2023-11-28T20:07:50.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.144+0000 7f980510d640 1 --2- 172.21.15.177:0/2740958081 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97e4066470 0x7f97e4068930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97f8177da0 tx=0x7f97f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.144+0000 7f13077fe640 1 --2- 172.21.15.177:0/3830973599 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f130c0664c0 0x7f130c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.144+0000 7f131effd640 1 --2- 172.21.15.177:0/3830973599 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f130c0664c0 0x7f130c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.144+0000 7f30342c9640 1 -- 172.21.15.177:0/2015496452 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302c0674d0 con 0x7f302c0b3bc0 2023-11-28T20:07:50.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.144+0000 7f3022ffd640 1 -- 172.21.15.177:0/2015496452 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f302801a400 con 0x7f302c0b3bc0 2023-11-28T20:07:50.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.144+0000 7f131effd640 1 --2- 172.21.15.177:0/3830973599 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f130c0664c0 0x7f130c068980 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1310007a60 tx=0x7f1310008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.148+0000 7f13077fe640 1 -- 172.21.15.177:0/3830973599 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13140ef470 con 0x7f1320071a60 2023-11-28T20:07:50.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.148+0000 7fd0cbfff640 1 --2- 172.21.15.177:0/405926457 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0cc0b2ef0 0x7fd0cc071370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40097c0 tx=0x7fd0b401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aa397de0a01b29 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.148+0000 7f97f67fc640 1 -- 172.21.15.177:0/2740958081 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97fc0f01f0 con 0x7f97f80535f0 2023-11-28T20:07:50.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.148+0000 7f3022ffd640 1 --2- 172.21.15.177:0/2015496452 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3010066540 0x7f3010068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.148+0000 7f3022ffd640 1 -- 172.21.15.177:0/2015496452 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3028083eb0 con 0x7f302c0b3bc0 2023-11-28T20:07:50.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.148+0000 7f3031864640 1 --2- 172.21.15.177:0/2015496452 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3010066540 0x7f3010068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.148+0000 7f3022ffd640 1 -- 172.21.15.177:0/2015496452 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30280513c0 con 0x7f302c0b3bc0 2023-11-28T20:07:50.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.152+0000 7f3031864640 1 --2- 172.21.15.177:0/2015496452 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3010066540 0x7f3010068a00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f302c073f00 tx=0x7f301c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.156+0000 7fd0cb7fe640 1 -- 172.21.15.177:0/405926457 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b40ab5f0 con 0x7fd0cc0b2ef0 2023-11-28T20:07:50.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.156+0000 7fd0cb7fe640 1 -- 172.21.15.177:0/405926457 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b40ab750 con 0x7fd0cc0b2ef0 2023-11-28T20:07:50.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.156+0000 7fd0cb7fe640 1 -- 172.21.15.177:0/405926457 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b40abb20 con 0x7fd0cc0b2ef0 2023-11-28T20:07:50.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.156+0000 7f13077fe640 1 -- 172.21.15.177:0/3830973599 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f13140ebf40 con 0x7f1320071a60 2023-11-28T20:07:50.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.156+0000 7fd0d1bfd640 1 -- 172.21.15.177:0/405926457 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0cc0b2ef0 msgr2=0x7fd0cc071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.156+0000 7fd0d1bfd640 1 --2- 172.21.15.177:0/405926457 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0cc0b2ef0 0x7fd0cc071370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40097c0 tx=0x7fd0b401c430 comp rx=0 tx=0).stop 2023-11-28T20:07:50.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.156+0000 7fd0d1bfd640 1 -- 172.21.15.177:0/405926457 shutdown_connections 2023-11-28T20:07:50.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.156+0000 7fd0d1bfd640 1 --2- 172.21.15.177:0/405926457 >> v2:172.21.15.195:3300/0 conn(0x7fd0cc0718b0 0x7fd0cc0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.156+0000 7fd0d1bfd640 1 --2- 172.21.15.177:0/405926457 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0cc0b2ef0 0x7fd0cc071370 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.156+0000 7fd0d1bfd640 1 -- 172.21.15.177:0/405926457 >> 172.21.15.177:0/405926457 conn(0x7fd0cc0b0ae0 msgr2=0x7fd0cc0b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.156+0000 7fd0d1bfd640 1 -- 172.21.15.177:0/405926457 shutdown_connections 2023-11-28T20:07:50.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.156+0000 7fd0d1bfd640 1 -- 172.21.15.177:0/405926457 wait complete. 2023-11-28T20:07:50.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.160+0000 7fd0d1bfd640 1 Processor -- start 2023-11-28T20:07:50.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.160+0000 7fd0d1bfd640 1 -- start start 2023-11-28T20:07:50.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d1bfd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0cc0718b0 0x7fd0cc142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d1bfd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0cc0b2ef0 0x7fd0cc163680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d1bfd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0cc14af50 0x7fd0cc149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0cbfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0cc0b2ef0 0x7fd0cc163680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0cbfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0cc0b2ef0 0x7fd0cc163680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:53820/0 (socket says 172.21.15.177:53820) 2023-11-28T20:07:50.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d0bfb640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0cc0718b0 0x7fd0cc142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d0bfb640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0cc0718b0 0x7fd0cc142a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:41956/0 (socket says 172.21.15.177:41956) 2023-11-28T20:07:50.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d13fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0cc14af50 0x7fd0cc149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d13fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0cc14af50 0x7fd0cc149810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44626/0 (socket says 172.21.15.177:44626) 2023-11-28T20:07:50.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d1bfd640 1 -- 172.21.15.177:0/1086850310 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc1425f0 con 0x7fd0cc14af50 2023-11-28T20:07:50.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0cbfff640 1 -- 172.21.15.177:0/1086850310 learned_addr learned my addr 172.21.15.177:0/1086850310 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:50.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d1bfd640 1 -- 172.21.15.177:0/1086850310 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc141fe0 con 0x7fd0cc0b2ef0 2023-11-28T20:07:50.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d1bfd640 1 -- 172.21.15.177:0/1086850310 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc164270 con 0x7fd0cc0718b0 2023-11-28T20:07:50.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d0bfb640 1 -- 172.21.15.177:0/1086850310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0cc0b2ef0 msgr2=0x7fd0cc163680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d0bfb640 1 --2- 172.21.15.177:0/1086850310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0cc0b2ef0 0x7fd0cc163680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d0bfb640 1 -- 172.21.15.177:0/1086850310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0cc14af50 msgr2=0x7fd0cc149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d0bfb640 1 --2- 172.21.15.177:0/1086850310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0cc14af50 0x7fd0cc149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d0bfb640 1 -- 172.21.15.177:0/1086850310 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b4009420 con 0x7fd0cc0718b0 2023-11-28T20:07:50.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d13fc640 1 --2- 172.21.15.177:0/1086850310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0cc14af50 0x7fd0cc149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:07:50.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0cbfff640 1 --2- 172.21.15.177:0/1086850310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0cc0b2ef0 0x7fd0cc163680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:07:50.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d0bfb640 1 --2- 172.21.15.177:0/1086850310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0cc0718b0 0x7fd0cc142a80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00b490 tx=0x7fd0bc00b950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0c97fa640 1 -- 172.21.15.177:0/1086850310 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc011830 con 0x7fd0cc0718b0 2023-11-28T20:07:50.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0c97fa640 1 -- 172.21.15.177:0/1086850310 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0bc0119b0 con 0x7fd0cc0718b0 2023-11-28T20:07:50.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0c97fa640 1 -- 172.21.15.177:0/1086850310 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc011da0 con 0x7fd0cc0718b0 2023-11-28T20:07:50.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d1bfd640 1 -- 172.21.15.177:0/1086850310 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0cc163f90 con 0x7fd0cc0718b0 2023-11-28T20:07:50.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.164+0000 7fd0d1bfd640 1 -- 172.21.15.177:0/1086850310 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0cc163bc0 con 0x7fd0cc0718b0 2023-11-28T20:07:50.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.168+0000 7fd0c97fa640 1 -- 172.21.15.177:0/1086850310 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd0bc01a400 con 0x7fd0cc0718b0 2023-11-28T20:07:50.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.172+0000 7fd0c2ffd640 1 -- 172.21.15.177:0/1086850310 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0cc0693d0 con 0x7fd0cc0718b0 2023-11-28T20:07:50.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.172+0000 7fd0c97fa640 1 --2- 172.21.15.177:0/1086850310 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd0ac066540 0x7fd0ac068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.172+0000 7fd0c97fa640 1 -- 172.21.15.177:0/1086850310 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0bc083d20 con 0x7fd0cc0718b0 2023-11-28T20:07:50.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.176+0000 7fd0cbfff640 1 --2- 172.21.15.177:0/1086850310 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd0ac066540 0x7fd0ac068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.176+0000 7fd0cbfff640 1 --2- 172.21.15.177:0/1086850310 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd0ac066540 0x7fd0ac068a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40097c0 tx=0x7fd0b40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.184+0000 7fd0c97fa640 1 -- 172.21.15.177:0/1086850310 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd0bc051380 con 0x7fd0cc0718b0 2023-11-28T20:07:50.382 INFO:teuthology.orchestra.run.smithi177.stdout:55834574855 2023-11-28T20:07:50.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.376+0000 7f81d332a640 1 -- 172.21.15.177:0/507071107 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f81cc0b6040 con 0x7f81cc15d5e0 2023-11-28T20:07:50.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.376+0000 7f81c1ffb640 1 -- 172.21.15.177:0/507071107 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f81c40b2020 con 0x7f81cc15d5e0 2023-11-28T20:07:50.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.384+0000 7f81d332a640 1 -- 172.21.15.177:0/507071107 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f81b00664c0 msgr2=0x7f81b0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.384+0000 7f81d332a640 1 --2- 172.21.15.177:0/507071107 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f81b00664c0 0x7f81b0068980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f81c8000fc0 tx=0x7f81c8001bc0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.384+0000 7f81d332a640 1 -- 172.21.15.177:0/507071107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81cc15d5e0 msgr2=0x7f81cc0cc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.384+0000 7f81d332a640 1 --2- 172.21.15.177:0/507071107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81cc15d5e0 0x7f81cc0cc510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f81c40ac000 tx=0x7f81c4019470 comp rx=0 tx=0).stop 2023-11-28T20:07:50.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.384+0000 7f81d332a640 1 -- 172.21.15.177:0/507071107 shutdown_connections 2023-11-28T20:07:50.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.384+0000 7f81d332a640 1 --2- 172.21.15.177:0/507071107 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f81b00664c0 0x7f81b0068980 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.384+0000 7f81d332a640 1 --2- 172.21.15.177:0/507071107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81cc15d5e0 0x7f81cc0cc510 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.384+0000 7f81d332a640 1 --2- 172.21.15.177:0/507071107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81cc0d1500 0x7f81cc0b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.384+0000 7f81d332a640 1 --2- 172.21.15.177:0/507071107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81cc0d0d00 0x7f81cc1599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.384+0000 7f81d332a640 1 -- 172.21.15.177:0/507071107 >> 172.21.15.177:0/507071107 conn(0x7f81cc0d2f20 msgr2=0x7f81cc0b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.384+0000 7f81d332a640 1 -- 172.21.15.177:0/507071107 shutdown_connections 2023-11-28T20:07:50.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.384+0000 7f81d332a640 1 -- 172.21.15.177:0/507071107 wait complete. 2023-11-28T20:07:50.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.416+0000 7fcb30eea640 1 -- 172.21.15.177:0/3077657446 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcb2c151fc0 con 0x7fcb2c08a710 2023-11-28T20:07:50.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.416+0000 7fcb1affd640 1 -- 172.21.15.177:0/3077657446 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcb2c151fc0 con 0x7fcb2c08a710 2023-11-28T20:07:50.420 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-28T20:07:50.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.424+0000 7fcb30eea640 1 -- 172.21.15.177:0/3077657446 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcb0c0664f0 msgr2=0x7fcb0c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.424+0000 7fcb30eea640 1 --2- 172.21.15.177:0/3077657446 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcb0c0664f0 0x7fcb0c0689b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb20001ec0 tx=0x7fcb2000b040 comp rx=0 tx=0).stop 2023-11-28T20:07:50.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.424+0000 7fcb30eea640 1 -- 172.21.15.177:0/3077657446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb2c08a710 msgr2=0x7fcb2c15ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.424+0000 7fcb30eea640 1 --2- 172.21.15.177:0/3077657446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb2c08a710 0x7fcb2c15ec10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00d800 tx=0x7fcb1c00dcc0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.428+0000 7fcb30eea640 1 -- 172.21.15.177:0/3077657446 shutdown_connections 2023-11-28T20:07:50.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.428+0000 7fcb30eea640 1 --2- 172.21.15.177:0/3077657446 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcb0c0664f0 0x7fcb0c0689b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.428+0000 7fcb30eea640 1 --2- 172.21.15.177:0/3077657446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb2c0b3330 0x7fcb2c15f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.428+0000 7fcb30eea640 1 --2- 172.21.15.177:0/3077657446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb2c08a710 0x7fcb2c15ec10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.428+0000 7fcb30eea640 1 --2- 172.21.15.177:0/3077657446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb2c071670 0x7fcb2c0896e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.428+0000 7fcb30eea640 1 -- 172.21.15.177:0/3077657446 >> 172.21.15.177:0/3077657446 conn(0x7fcb2c06c2c0 msgr2=0x7fcb2c0b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.428+0000 7fcb30eea640 1 -- 172.21.15.177:0/3077657446 shutdown_connections 2023-11-28T20:07:50.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.428+0000 7fcb30eea640 1 -- 172.21.15.177:0/3077657446 wait complete. 2023-11-28T20:07:50.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2023-11-28T20:07:50.446 DEBUG:teuthology.parallel:result is None 2023-11-28T20:07:50.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.448+0000 7fadc0a9f640 1 -- 172.21.15.177:0/2002514783 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fadbc13de60 con 0x7fadbc15e110 2023-11-28T20:07:50.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.448+0000 7fadb8ff9640 1 -- 172.21.15.177:0/2002514783 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fadb4054d00 con 0x7fadbc15e110 2023-11-28T20:07:50.461 INFO:teuthology.orchestra.run.smithi177.stdout:55834574855 2023-11-28T20:07:50.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.456+0000 7fadc0a9f640 1 -- 172.21.15.177:0/2002514783 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad9c066470 msgr2=0x7fad9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.456+0000 7fadc0a9f640 1 --2- 172.21.15.177:0/2002514783 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad9c066470 0x7fad9c068930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fadac01c550 tx=0x7fadac0b6040 comp rx=0 tx=0).stop 2023-11-28T20:07:50.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.456+0000 7fadc0a9f640 1 -- 172.21.15.177:0/2002514783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadbc15e110 msgr2=0x7fadbc0cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.456+0000 7fadc0a9f640 1 --2- 172.21.15.177:0/2002514783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadbc15e110 0x7fadbc0cc760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fadbc15d6d0 tx=0x7fadb400d9c0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.460+0000 7fadc0a9f640 1 -- 172.21.15.177:0/2002514783 shutdown_connections 2023-11-28T20:07:50.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.460+0000 7fadc0a9f640 1 --2- 172.21.15.177:0/2002514783 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad9c066470 0x7fad9c068930 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.460+0000 7fadc0a9f640 1 --2- 172.21.15.177:0/2002514783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadbc15e110 0x7fadbc0cc760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.460+0000 7fadc0a9f640 1 --2- 172.21.15.177:0/2002514783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadbc1467f0 0x7fadbc0cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.460+0000 7fadc0a9f640 1 --2- 172.21.15.177:0/2002514783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadbc0b3600 0x7fadbc13c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.460+0000 7fadc0a9f640 1 -- 172.21.15.177:0/2002514783 >> 172.21.15.177:0/2002514783 conn(0x7fadbc0b0ae0 msgr2=0x7fadbc0b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.460+0000 7fadc0a9f640 1 -- 172.21.15.177:0/2002514783 shutdown_connections 2023-11-28T20:07:50.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.460+0000 7fadc0a9f640 1 -- 172.21.15.177:0/2002514783 wait complete. 2023-11-28T20:07:50.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2023-11-28T20:07:50.467 DEBUG:teuthology.parallel:result is None 2023-11-28T20:07:50.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.476+0000 7f30342c9640 1 -- 172.21.15.177:0/2015496452 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f302c0c9580 con 0x7f302c0b3bc0 2023-11-28T20:07:50.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.476+0000 7f3022ffd640 1 -- 172.21.15.177:0/2015496452 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3028015090 con 0x7f302c0b3bc0 2023-11-28T20:07:50.480 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-28T20:07:50.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.476+0000 7f13253b8640 1 -- 172.21.15.177:0/3830973599 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f132015c8e0 con 0x7f1320071a60 2023-11-28T20:07:50.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.476+0000 7fad1a417640 1 -- 172.21.15.177:0/4042869946 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fad14162f10 con 0x7fad00005190 2023-11-28T20:07:50.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.476+0000 7f13077fe640 1 -- 172.21.15.177:0/3830973599 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f13140a6020 con 0x7f1320071a60 2023-11-28T20:07:50.483 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-28T20:07:50.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.476+0000 7fad117fa640 1 -- 172.21.15.177:0/4042869946 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7facfc055850 con 0x7fad00005190 2023-11-28T20:07:50.483 INFO:teuthology.orchestra.run.smithi177.stdout:55834574855 2023-11-28T20:07:50.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f30342c9640 1 -- 172.21.15.177:0/2015496452 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3010066540 msgr2=0x7f3010068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f30342c9640 1 --2- 172.21.15.177:0/2015496452 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3010066540 0x7f3010068a00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f302c073f00 tx=0x7f301c008040 comp rx=0 tx=0).stop 2023-11-28T20:07:50.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f30342c9640 1 -- 172.21.15.177:0/2015496452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f302c0b3bc0 msgr2=0x7f302c0c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f30342c9640 1 --2- 172.21.15.177:0/2015496452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f302c0b3bc0 0x7f302c0c84b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f302800b3e0 tx=0x7f302800b8a0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f30342c9640 1 -- 172.21.15.177:0/2015496452 shutdown_connections 2023-11-28T20:07:50.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f13253b8640 1 -- 172.21.15.177:0/3830973599 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f130c0664c0 msgr2=0x7f130c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f13253b8640 1 --2- 172.21.15.177:0/3830973599 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f130c0664c0 0x7f130c068980 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1310007a60 tx=0x7f1310008040 comp rx=0 tx=0).stop 2023-11-28T20:07:50.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f30342c9640 1 --2- 172.21.15.177:0/2015496452 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3010066540 0x7f3010068a00 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f302c073f00 tx=0x7f301c008040 comp rx=0 tx=0).stop 2023-11-28T20:07:50.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f30342c9640 1 --2- 172.21.15.177:0/2015496452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f302c0d1780 0x7f302c06bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f30342c9640 1 --2- 172.21.15.177:0/2015496452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f302c0cfac0 0x7f302c202360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f30342c9640 1 --2- 172.21.15.177:0/2015496452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f302c0b3bc0 0x7f302c0c84b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f30342c9640 1 -- 172.21.15.177:0/2015496452 >> 172.21.15.177:0/2015496452 conn(0x7f302c09c430 msgr2=0x7f302c071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f30342c9640 1 -- 172.21.15.177:0/2015496452 shutdown_connections 2023-11-28T20:07:50.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f30342c9640 1 -- 172.21.15.177:0/2015496452 wait complete. 2023-11-28T20:07:50.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f13253b8640 1 -- 172.21.15.177:0/3830973599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1320071a60 msgr2=0x7f132015f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f13253b8640 1 --2- 172.21.15.177:0/3830973599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1320071a60 0x7f132015f5e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f13140097c0 tx=0x7f13140192e0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f13253b8640 1 -- 172.21.15.177:0/3830973599 shutdown_connections 2023-11-28T20:07:50.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f13253b8640 1 --2- 172.21.15.177:0/3830973599 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f130c0664c0 0x7f130c068980 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f13253b8640 1 --2- 172.21.15.177:0/3830973599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1320159230 0x7f132015fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f13253b8640 1 --2- 172.21.15.177:0/3830973599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1320071a60 0x7f132015f5e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7fad1a417640 1 -- 172.21.15.177:0/4042869946 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7facf40664a0 msgr2=0x7facf4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7fad1a417640 1 --2- 172.21.15.177:0/4042869946 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7facf40664a0 0x7facf4068960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fad14165e20 tx=0x7fad04008040 comp rx=0 tx=0).stop 2023-11-28T20:07:50.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7fad1a417640 1 -- 172.21.15.177:0/4042869946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad00005190 msgr2=0x7fad141521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7fad1a417640 1 --2- 172.21.15.177:0/4042869946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad00005190 0x7fad141521c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7facfc00d7d0 tx=0x7facfc00dc90 comp rx=0 tx=0).stop 2023-11-28T20:07:50.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f13253b8640 1 --2- 172.21.15.177:0/3830973599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f132006e8a0 0x7f1320163640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7fad1a417640 1 -- 172.21.15.177:0/4042869946 shutdown_connections 2023-11-28T20:07:50.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7fad1a417640 1 --2- 172.21.15.177:0/4042869946 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7facf40664a0 0x7facf4068960 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7fad1a417640 1 --2- 172.21.15.177:0/4042869946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad140cd920 0x7fad140cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7fad1a417640 1 --2- 172.21.15.177:0/4042869946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad141619e0 0x7fad1414ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7fad1a417640 1 --2- 172.21.15.177:0/4042869946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad00005190 0x7fad141521c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7fad1a417640 1 -- 172.21.15.177:0/4042869946 >> 172.21.15.177:0/4042869946 conn(0x7fad140aea50 msgr2=0x7fad14071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7f13253b8640 1 -- 172.21.15.177:0/3830973599 >> 172.21.15.177:0/3830973599 conn(0x7f132006c2c0 msgr2=0x7f1320071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.480+0000 7fad1a417640 1 -- 172.21.15.177:0/4042869946 shutdown_connections 2023-11-28T20:07:50.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.484+0000 7fad1a417640 1 -- 172.21.15.177:0/4042869946 wait complete. 2023-11-28T20:07:50.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.484+0000 7f97e3fff640 1 -- 172.21.15.177:0/2740958081 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f97f8005370 con 0x7f97f80535f0 2023-11-28T20:07:50.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.484+0000 7f13253b8640 1 -- 172.21.15.177:0/3830973599 shutdown_connections 2023-11-28T20:07:50.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.484+0000 7f13253b8640 1 -- 172.21.15.177:0/3830973599 wait complete. 2023-11-28T20:07:50.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.484+0000 7f97f67fc640 1 -- 172.21.15.177:0/2740958081 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97fc0f3810 con 0x7f97f80535f0 2023-11-28T20:07:50.491 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-28T20:07:50.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.484+0000 7f97e3fff640 1 -- 172.21.15.177:0/2740958081 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97e4066470 msgr2=0x7f97e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.484+0000 7f97e3fff640 1 --2- 172.21.15.177:0/2740958081 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97e4066470 0x7f97e4068930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97f8177da0 tx=0x7f97f0009040 comp rx=0 tx=0).stop 2023-11-28T20:07:50.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.488+0000 7f97e3fff640 1 -- 172.21.15.177:0/2740958081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97f80535f0 msgr2=0x7f97f80de5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.488+0000 7f97e3fff640 1 --2- 172.21.15.177:0/2740958081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97f80535f0 0x7f97f80de5a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f97fc01cfb0 tx=0x7f97fc01c120 comp rx=0 tx=0).stop 2023-11-28T20:07:50.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.488+0000 7f97e3fff640 1 -- 172.21.15.177:0/2740958081 shutdown_connections 2023-11-28T20:07:50.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.488+0000 7f97e3fff640 1 --2- 172.21.15.177:0/2740958081 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97e4066470 0x7f97e4068930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.488+0000 7f97e3fff640 1 --2- 172.21.15.177:0/2740958081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97f80df740 0x7f97f80db850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.488+0000 7f97e3fff640 1 --2- 172.21.15.177:0/2740958081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97f80543a0 0x7f97f80cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.488+0000 7f97e3fff640 1 --2- 172.21.15.177:0/2740958081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97f80535f0 0x7f97f80de5a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.488+0000 7f97e3fff640 1 -- 172.21.15.177:0/2740958081 >> 172.21.15.177:0/2740958081 conn(0x7f97f8009f90 msgr2=0x7f97f80d9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.488+0000 7f97e3fff640 1 -- 172.21.15.177:0/2740958081 shutdown_connections 2023-11-28T20:07:50.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.488+0000 7f97e3fff640 1 -- 172.21.15.177:0/2740958081 wait complete. 2023-11-28T20:07:50.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2023-11-28T20:07:50.496 DEBUG:teuthology.parallel:result is None 2023-11-28T20:07:50.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2023-11-28T20:07:50.515 DEBUG:teuthology.parallel:result is None 2023-11-28T20:07:50.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.4 2023-11-28T20:07:50.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2023-11-28T20:07:50.531 DEBUG:teuthology.parallel:result is None 2023-11-28T20:07:50.531 DEBUG:teuthology.parallel:result is None 2023-11-28T20:07:50.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2023-11-28T20:07:50.533 DEBUG:teuthology.parallel:result is None 2023-11-28T20:07:50.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.568+0000 7fd0c2ffd640 1 -- 172.21.15.177:0/1086850310 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd0cc146a50 con 0x7fd0cc0718b0 2023-11-28T20:07:50.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.568+0000 7fd0c97fa640 1 -- 172.21.15.177:0/1086850310 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd0bc015070 con 0x7fd0cc0718b0 2023-11-28T20:07:50.571 INFO:teuthology.orchestra.run.smithi177.stdout:55834574856 2023-11-28T20:07:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.568+0000 7fd0c2ffd640 1 -- 172.21.15.177:0/1086850310 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd0ac066540 msgr2=0x7fd0ac068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.568+0000 7fd0c2ffd640 1 --2- 172.21.15.177:0/1086850310 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd0ac066540 0x7fd0ac068a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40097c0 tx=0x7fd0b40a7000 comp rx=0 tx=0).stop 2023-11-28T20:07:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.568+0000 7fd0c2ffd640 1 -- 172.21.15.177:0/1086850310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0cc0718b0 msgr2=0x7fd0cc142a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.568+0000 7fd0c2ffd640 1 --2- 172.21.15.177:0/1086850310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0cc0718b0 0x7fd0cc142a80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00b490 tx=0x7fd0bc00b950 comp rx=0 tx=0).stop 2023-11-28T20:07:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.568+0000 7fd0c2ffd640 1 -- 172.21.15.177:0/1086850310 shutdown_connections 2023-11-28T20:07:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.568+0000 7fd0c2ffd640 1 --2- 172.21.15.177:0/1086850310 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd0ac066540 0x7fd0ac068a00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.568+0000 7fd0c2ffd640 1 --2- 172.21.15.177:0/1086850310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0cc14af50 0x7fd0cc149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.568+0000 7fd0c2ffd640 1 --2- 172.21.15.177:0/1086850310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0cc0b2ef0 0x7fd0cc163680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.568+0000 7fd0c2ffd640 1 --2- 172.21.15.177:0/1086850310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0cc0718b0 0x7fd0cc142a80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.568+0000 7fd0c2ffd640 1 -- 172.21.15.177:0/1086850310 >> 172.21.15.177:0/1086850310 conn(0x7fd0cc0b0ae0 msgr2=0x7fd0cc0aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.568+0000 7fd0c2ffd640 1 -- 172.21.15.177:0/1086850310 shutdown_connections 2023-11-28T20:07:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.568+0000 7fd0c2ffd640 1 -- 172.21.15.177:0/1086850310 wait complete. 2023-11-28T20:07:50.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.7 2023-11-28T20:07:50.592 DEBUG:teuthology.parallel:result is None 2023-11-28T20:07:50.593 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T20:07:50.593 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:07:50.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.768+0000 7f2ac0d2a640 1 Processor -- start 2023-11-28T20:07:50.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.768+0000 7f2ac0d2a640 1 -- start start 2023-11-28T20:07:50.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.768+0000 7f2ac0d2a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2abc0cfe90 0x7f2abc0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.768+0000 7f2ac0d2a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2abc0b3c70 0x7f2abc15f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.768+0000 7f2ac0d2a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2abc0d3880 con 0x7f2abc0b35b0 2023-11-28T20:07:50.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.768+0000 7f2ac0d2a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2abc0d4090 con 0x7f2abc0cfe90 2023-11-28T20:07:50.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.768+0000 7f2ac0d2a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2abc0cdc80 con 0x7f2abc0b3c70 2023-11-28T20:07:50.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.768+0000 7f2ab9d9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2abc0cfe90 0x7f2abc0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.768+0000 7f2ab9d9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2abc0cfe90 0x7f2abc0d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44638/0 (socket says 172.21.15.177:44638) 2023-11-28T20:07:50.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.768+0000 7f2ab9d9b640 1 -- 172.21.15.177:0/563971136 learned_addr learned my addr 172.21.15.177:0/563971136 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:50.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.768+0000 7f2abad9d640 1 --2- 172.21.15.177:0/563971136 >> v2:172.21.15.195:3300/0 conn(0x7f2abc0b3c70 0x7f2abc15f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.772+0000 7f2ab9d9b640 1 -- 172.21.15.177:0/563971136 >> v2:172.21.15.195:3300/0 conn(0x7f2abc0b3c70 msgr2=0x7f2abc15f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.772+0000 7f2ab9d9b640 1 --2- 172.21.15.177:0/563971136 >> v2:172.21.15.195:3300/0 conn(0x7f2abc0b3c70 0x7f2abc15f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.772+0000 7f2ab9d9b640 1 -- 172.21.15.177:0/563971136 >> v1:172.21.15.195:6789/0 conn(0x7f2abc0b35b0 legacy=0x7f2abc0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:50.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.772+0000 7f2ab9d9b640 1 -- 172.21.15.177:0/563971136 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc0d3ad0 con 0x7f2abc0cfe90 2023-11-28T20:07:50.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.772+0000 7f2ab9d9b640 1 --2- 172.21.15.177:0/563971136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2abc0cfe90 0x7f2abc0d0f50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0d2ae0 tx=0x7f2ab001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37381220a77cdc7b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.772+0000 7f2ab959a640 1 -- 172.21.15.177:0/563971136 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00aa660 con 0x7f2abc0cfe90 2023-11-28T20:07:50.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.772+0000 7f2ab959a640 1 -- 172.21.15.177:0/563971136 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab00aa7c0 con 0x7f2abc0cfe90 2023-11-28T20:07:50.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.772+0000 7f2ab959a640 1 -- 172.21.15.177:0/563971136 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00aab50 con 0x7f2abc0cfe90 2023-11-28T20:07:50.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.772+0000 7f2ac0d2a640 1 -- 172.21.15.177:0/563971136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2abc0cfe90 msgr2=0x7f2abc0d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.772+0000 7f2ac0d2a640 1 --2- 172.21.15.177:0/563971136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2abc0cfe90 0x7f2abc0d0f50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0d2ae0 tx=0x7f2ab001c500 comp rx=0 tx=0).stop 2023-11-28T20:07:50.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ac0d2a640 1 -- 172.21.15.177:0/563971136 shutdown_connections 2023-11-28T20:07:50.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ac0d2a640 1 --2- 172.21.15.177:0/563971136 >> v2:172.21.15.195:3300/0 conn(0x7f2abc0b3c70 0x7f2abc15f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ac0d2a640 1 --2- 172.21.15.177:0/563971136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2abc0cfe90 0x7f2abc0d0f50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ac0d2a640 1 -- 172.21.15.177:0/563971136 >> 172.21.15.177:0/563971136 conn(0x7f2abc09c4b0 msgr2=0x7f2abc0d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ac0d2a640 1 -- 172.21.15.177:0/563971136 shutdown_connections 2023-11-28T20:07:50.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ac0d2a640 1 -- 172.21.15.177:0/563971136 wait complete. 2023-11-28T20:07:50.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ac0d2a640 1 Processor -- start 2023-11-28T20:07:50.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ac0d2a640 1 -- start start 2023-11-28T20:07:50.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ac0d2a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2abc0b35b0 0x7f2abc0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ac0d2a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2abc0b3c70 0x7f2abc15e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ac0d2a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2abc0cfe90 0x7f2abc0b7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ac0d2a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0b70b0 con 0x7f2abc0b3c70 2023-11-28T20:07:50.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ac0d2a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0b7390 con 0x7f2abc0b35b0 2023-11-28T20:07:50.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ac0d2a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0b7670 con 0x7f2abc0cfe90 2023-11-28T20:07:50.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ab9d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2abc0b3c70 0x7f2abc15e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ab9d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2abc0b3c70 0x7f2abc15e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44652/0 (socket says 172.21.15.177:44652) 2023-11-28T20:07:50.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ab9d9b640 1 -- 172.21.15.177:0/2513358139 learned_addr learned my addr 172.21.15.177:0/2513358139 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:50.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2abad9d640 1 --2- 172.21.15.177:0/2513358139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2abc0cfe90 0x7f2abc0b7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2aba59c640 1 --2- 172.21.15.177:0/2513358139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2abc0b35b0 0x7f2abc0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ab9d9b640 1 -- 172.21.15.177:0/2513358139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2abc0cfe90 msgr2=0x7f2abc0b7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ab9d9b640 1 --2- 172.21.15.177:0/2513358139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2abc0cfe90 0x7f2abc0b7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ab9d9b640 1 -- 172.21.15.177:0/2513358139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2abc0b35b0 msgr2=0x7f2abc0ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ab9d9b640 1 --2- 172.21.15.177:0/2513358139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2abc0b35b0 0x7f2abc0ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2ab9d9b640 1 -- 172.21.15.177:0/2513358139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab00094d0 con 0x7f2abc0b3c70 2023-11-28T20:07:50.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.776+0000 7f2aba59c640 1 --2- 172.21.15.177:0/2513358139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2abc0b35b0 0x7f2abc0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:50.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.780+0000 7f2ab9d9b640 1 --2- 172.21.15.177:0/2513358139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2abc0b3c70 0x7f2abc15e210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0019110 tx=0x7f2ab001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.780+0000 7f2aaaffd640 1 -- 172.21.15.177:0/2513358139 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00b3800 con 0x7f2abc0b3c70 2023-11-28T20:07:50.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.780+0000 7f2aaaffd640 1 -- 172.21.15.177:0/2513358139 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab00b3980 con 0x7f2abc0b3c70 2023-11-28T20:07:50.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.780+0000 7f2aaaffd640 1 -- 172.21.15.177:0/2513358139 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00b3d30 con 0x7f2abc0b3c70 2023-11-28T20:07:50.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.780+0000 7f2ac0d2a640 1 -- 172.21.15.177:0/2513358139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2abc0b7950 con 0x7f2abc0b3c70 2023-11-28T20:07:50.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.780+0000 7f2ac0d2a640 1 -- 172.21.15.177:0/2513358139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2abc0ca780 con 0x7f2abc0b3c70 2023-11-28T20:07:50.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.780+0000 7f2ac0d2a640 1 -- 172.21.15.177:0/2513358139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2abc069440 con 0x7f2abc0b3c70 2023-11-28T20:07:50.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.780+0000 7f2aaaffd640 1 -- 172.21.15.177:0/2513358139 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ab00b2380 con 0x7f2abc0b3c70 2023-11-28T20:07:50.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.780+0000 7f2aaaffd640 1 --2- 172.21.15.177:0/2513358139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2a9c066470 0x7f2a9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:50.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.780+0000 7f2aaaffd640 1 -- 172.21.15.177:0/2513358139 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ab00a6040 con 0x7f2abc0b3c70 2023-11-28T20:07:50.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.780+0000 7f2aba59c640 1 --2- 172.21.15.177:0/2513358139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2a9c066470 0x7f2a9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:50.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.784+0000 7f2aba59c640 1 --2- 172.21.15.177:0/2513358139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2a9c066470 0x7f2a9c068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0b2af0 tx=0x7f2aac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:50.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.788+0000 7f2aaaffd640 1 -- 172.21.15.177:0/2513358139 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ab00eb730 con 0x7f2abc0b3c70 2023-11-28T20:07:50.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.940+0000 7f2ac0d2a640 1 -- 172.21.15.177:0/2513358139 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2abc0d3170 con 0x7f2a9c066470 2023-11-28T20:07:50.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.948+0000 7f2aaaffd640 1 -- 172.21.15.177:0/2513358139 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264525 (secure 0 0 0) 0x7f2abc0d3170 con 0x7f2a9c066470 2023-11-28T20:07:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:50.955 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:07:50.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.952+0000 7f2ac0d2a640 1 -- 172.21.15.177:0/2513358139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2a9c066470 msgr2=0x7f2a9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.952+0000 7f2ac0d2a640 1 --2- 172.21.15.177:0/2513358139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2a9c066470 0x7f2a9c068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0b2af0 tx=0x7f2aac009040 comp rx=0 tx=0).stop 2023-11-28T20:07:50.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.952+0000 7f2ac0d2a640 1 -- 172.21.15.177:0/2513358139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2abc0b3c70 msgr2=0x7f2abc15e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:50.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.952+0000 7f2ac0d2a640 1 --2- 172.21.15.177:0/2513358139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2abc0b3c70 0x7f2abc15e210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0019110 tx=0x7f2ab001ad40 comp rx=0 tx=0).stop 2023-11-28T20:07:50.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.952+0000 7f2ac0d2a640 1 -- 172.21.15.177:0/2513358139 shutdown_connections 2023-11-28T20:07:50.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.952+0000 7f2ac0d2a640 1 --2- 172.21.15.177:0/2513358139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2a9c066470 0x7f2a9c068930 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.952+0000 7f2ac0d2a640 1 --2- 172.21.15.177:0/2513358139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2abc0cfe90 0x7f2abc0b7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.952+0000 7f2ac0d2a640 1 --2- 172.21.15.177:0/2513358139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2abc0b3c70 0x7f2abc15e210 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.952+0000 7f2ac0d2a640 1 --2- 172.21.15.177:0/2513358139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2abc0b35b0 0x7f2abc0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:50.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.952+0000 7f2ac0d2a640 1 -- 172.21.15.177:0/2513358139 >> 172.21.15.177:0/2513358139 conn(0x7f2abc09c4b0 msgr2=0x7f2abc0afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:50.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.952+0000 7f2ac0d2a640 1 -- 172.21.15.177:0/2513358139 shutdown_connections 2023-11-28T20:07:50.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:50.952+0000 7f2ac0d2a640 1 -- 172.21.15.177:0/2513358139 wait complete. 2023-11-28T20:07:50.974 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-28T20:07:49.419782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231500,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743220,"statfs":{"total":773094113280,"available":772857057280,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001657"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610824+0000","last_change":"2023-11-28T20:07:42.131471+0000","last_active":"2023-11-28T20:07:43.610824+0000","last_peered":"2023-11-28T20:07:43.610824+0000","last_clean":"2023-11-28T20:07:43.610824+0000","last_became_active":"2023-11-28T20:07:42.131182+0000","last_became_peered":"2023-11-28T20:07:42.131182+0000","last_unstale":"2023-11-28T20:07:43.610824+0000","last_undegraded":"2023-11-28T20:07:43.610824+0000","last_fullsized":"2023-11-28T20:07:43.610824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:16:03.993270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108961+0000","last_change":"2023-11-28T20:07:42.125245+0000","last_active":"2023-11-28T20:07:43.108961+0000","last_peered":"2023-11-28T20:07:43.108961+0000","last_clean":"2023-11-28T20:07:43.108961+0000","last_became_active":"2023-11-28T20:07:42.124182+0000","last_became_peered":"2023-11-28T20:07:42.124182+0000","last_unstale":"2023-11-28T20:07:43.108961+0000","last_undegraded":"2023-11-28T20:07:43.108961+0000","last_fullsized":"2023-11-28T20:07:43.108961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108178+0000","last_change":"2023-11-28T20:07:42.116843+0000","last_active":"2023-11-28T20:07:43.108178+0000","last_peered":"2023-11-28T20:07:43.108178+0000","last_clean":"2023-11-28T20:07:43.108178+0000","last_became_active":"2023-11-28T20:07:42.116310+0000","last_became_peered":"2023-11-28T20:07:42.116310+0000","last_unstale":"2023-11-28T20:07:43.108178+0000","last_undegraded":"2023-11-28T20:07:43.108178+0000","last_fullsized":"2023-11-28T20:07:43.108178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610034+0000","last_change":"2023-11-28T20:07:42.128042+0000","last_active":"2023-11-28T20:07:43.610034+0000","last_peered":"2023-11-28T20:07:43.610034+0000","last_clean":"2023-11-28T20:07:43.610034+0000","last_became_active":"2023-11-28T20:07:42.127792+0000","last_became_peered":"2023-11-28T20:07:42.127792+0000","last_unstale":"2023-11-28T20:07:43.610034+0000","last_undegraded":"2023-11-28T20:07:43.610034+0000","last_fullsized":"2023-11-28T20:07:43.610034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:21.201026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609510+0000","last_change":"2023-11-28T20:07:42.128904+0000","last_active":"2023-11-28T20:07:43.609510+0000","last_peered":"2023-11-28T20:07:43.609510+0000","last_clean":"2023-11-28T20:07:43.609510+0000","last_became_active":"2023-11-28T20:07:42.128610+0000","last_became_peered":"2023-11-28T20:07:42.128610+0000","last_unstale":"2023-11-28T20:07:43.609510+0000","last_undegraded":"2023-11-28T20:07:43.609510+0000","last_fullsized":"2023-11-28T20:07:43.609510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:21.201026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609733+0000","last_change":"2023-11-28T20:07:42.131901+0000","last_active":"2023-11-28T20:07:43.609733+0000","last_peered":"2023-11-28T20:07:43.609733+0000","last_clean":"2023-11-28T20:07:43.609733+0000","last_became_active":"2023-11-28T20:07:42.125991+0000","last_became_peered":"2023-11-28T20:07:42.125991+0000","last_unstale":"2023-11-28T20:07:43.609733+0000","last_undegraded":"2023-11-28T20:07:43.609733+0000","last_fullsized":"2023-11-28T20:07:43.609733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.608915+0000","last_change":"2023-11-28T20:07:42.125304+0000","last_active":"2023-11-28T20:07:43.608915+0000","last_peered":"2023-11-28T20:07:43.608915+0000","last_clean":"2023-11-28T20:07:43.608915+0000","last_became_active":"2023-11-28T20:07:42.124956+0000","last_became_peered":"2023-11-28T20:07:42.124956+0000","last_unstale":"2023-11-28T20:07:43.608915+0000","last_undegraded":"2023-11-28T20:07:43.608915+0000","last_fullsized":"2023-11-28T20:07:43.608915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:48.514241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108891+0000","last_change":"2023-11-28T20:07:42.112403+0000","last_active":"2023-11-28T20:07:43.108891+0000","last_peered":"2023-11-28T20:07:43.108891+0000","last_clean":"2023-11-28T20:07:43.108891+0000","last_became_active":"2023-11-28T20:07:42.112073+0000","last_became_peered":"2023-11-28T20:07:42.112073+0000","last_unstale":"2023-11-28T20:07:43.108891+0000","last_undegraded":"2023-11-28T20:07:43.108891+0000","last_fullsized":"2023-11-28T20:07:43.108891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610824+0000","last_change":"2023-11-28T20:07:42.137462+0000","last_active":"2023-11-28T20:07:43.610824+0000","last_peered":"2023-11-28T20:07:43.610824+0000","last_clean":"2023-11-28T20:07:43.610824+0000","last_became_active":"2023-11-28T20:07:42.137147+0000","last_became_peered":"2023-11-28T20:07:42.137147+0000","last_unstale":"2023-11-28T20:07:43.610824+0000","last_undegraded":"2023-11-28T20:07:43.610824+0000","last_fullsized":"2023-11-28T20:07:43.610824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:31.880338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124481+0000","last_change":"2023-11-28T20:07:42.137727+0000","last_active":"2023-11-28T20:07:43.124481+0000","last_peered":"2023-11-28T20:07:43.124481+0000","last_clean":"2023-11-28T20:07:43.124481+0000","last_became_active":"2023-11-28T20:07:42.137387+0000","last_became_peered":"2023-11-28T20:07:42.137387+0000","last_unstale":"2023-11-28T20:07:43.124481+0000","last_undegraded":"2023-11-28T20:07:43.124481+0000","last_fullsized":"2023-11-28T20:07:43.124481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124350+0000","last_change":"2023-11-28T20:07:42.129540+0000","last_active":"2023-11-28T20:07:43.124350+0000","last_peered":"2023-11-28T20:07:43.124350+0000","last_clean":"2023-11-28T20:07:43.124350+0000","last_became_active":"2023-11-28T20:07:42.129269+0000","last_became_peered":"2023-11-28T20:07:42.129269+0000","last_unstale":"2023-11-28T20:07:43.124350+0000","last_undegraded":"2023-11-28T20:07:43.124350+0000","last_fullsized":"2023-11-28T20:07:43.124350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609353+0000","last_change":"2023-11-28T20:07:42.118180+0000","last_active":"2023-11-28T20:07:43.609353+0000","last_peered":"2023-11-28T20:07:43.609353+0000","last_clean":"2023-11-28T20:07:43.609353+0000","last_became_active":"2023-11-28T20:07:42.117845+0000","last_became_peered":"2023-11-28T20:07:42.117845+0000","last_unstale":"2023-11-28T20:07:43.609353+0000","last_undegraded":"2023-11-28T20:07:43.609353+0000","last_fullsized":"2023-11-28T20:07:43.609353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:47.116523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108471+0000","last_change":"2023-11-28T20:07:42.118653+0000","last_active":"2023-11-28T20:07:43.108471+0000","last_peered":"2023-11-28T20:07:43.108471+0000","last_clean":"2023-11-28T20:07:43.108471+0000","last_became_active":"2023-11-28T20:07:42.118336+0000","last_became_peered":"2023-11-28T20:07:42.118336+0000","last_unstale":"2023-11-28T20:07:43.108471+0000","last_undegraded":"2023-11-28T20:07:43.108471+0000","last_fullsized":"2023-11-28T20:07:43.108471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:15.872240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107844+0000","last_change":"2023-11-28T20:07:42.121476+0000","last_active":"2023-11-28T20:07:43.107844+0000","last_peered":"2023-11-28T20:07:43.107844+0000","last_clean":"2023-11-28T20:07:43.107844+0000","last_became_active":"2023-11-28T20:07:42.121182+0000","last_became_peered":"2023-11-28T20:07:42.121182+0000","last_unstale":"2023-11-28T20:07:43.107844+0000","last_undegraded":"2023-11-28T20:07:43.107844+0000","last_fullsized":"2023-11-28T20:07:43.107844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:23.122677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108322+0000","last_change":"2023-11-28T20:07:42.126484+0000","last_active":"2023-11-28T20:07:43.108322+0000","last_peered":"2023-11-28T20:07:43.108322+0000","last_clean":"2023-11-28T20:07:43.108322+0000","last_became_active":"2023-11-28T20:07:42.126162+0000","last_became_peered":"2023-11-28T20:07:42.126162+0000","last_unstale":"2023-11-28T20:07:43.108322+0000","last_undegraded":"2023-11-28T20:07:43.108322+0000","last_fullsized":"2023-11-28T20:07:43.108322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609402+0000","last_change":"2023-11-28T20:07:42.129046+0000","last_active":"2023-11-28T20:07:43.609402+0000","last_peered":"2023-11-28T20:07:43.609402+0000","last_clean":"2023-11-28T20:07:43.609402+0000","last_became_active":"2023-11-28T20:07:42.125815+0000","last_became_peered":"2023-11-28T20:07:42.125815+0000","last_unstale":"2023-11-28T20:07:43.609402+0000","last_undegraded":"2023-11-28T20:07:43.609402+0000","last_fullsized":"2023-11-28T20:07:43.609402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610658+0000","last_change":"2023-11-28T20:07:42.134089+0000","last_active":"2023-11-28T20:07:43.610658+0000","last_peered":"2023-11-28T20:07:43.610658+0000","last_clean":"2023-11-28T20:07:43.610658+0000","last_became_active":"2023-11-28T20:07:42.133736+0000","last_became_peered":"2023-11-28T20:07:42.133736+0000","last_unstale":"2023-11-28T20:07:43.610658+0000","last_undegraded":"2023-11-28T20:07:43.610658+0000","last_fullsized":"2023-11-28T20:07:43.610658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:16:03.993270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.608519+0000","last_change":"2023-11-28T20:07:42.118484+0000","last_active":"2023-11-28T20:07:43.608519+0000","last_peered":"2023-11-28T20:07:43.608519+0000","last_clean":"2023-11-28T20:07:43.608519+0000","last_became_active":"2023-11-28T20:07:42.118184+0000","last_became_peered":"2023-11-28T20:07:42.118184+0000","last_unstale":"2023-11-28T20:07:43.608519+0000","last_undegraded":"2023-11-28T20:07:43.608519+0000","last_fullsized":"2023-11-28T20:07:43.608519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:09.986989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610141+0000","last_change":"2023-11-28T20:07:42.127821+0000","last_active":"2023-11-28T20:07:43.610141+0000","last_peered":"2023-11-28T20:07:43.610141+0000","last_clean":"2023-11-28T20:07:43.610141+0000","last_became_active":"2023-11-28T20:07:42.127530+0000","last_became_peered":"2023-11-28T20:07:42.127530+0000","last_unstale":"2023-11-28T20:07:43.610141+0000","last_undegraded":"2023-11-28T20:07:43.610141+0000","last_fullsized":"2023-11-28T20:07:43.610141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:42:04.486716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124333+0000","last_change":"2023-11-28T20:07:42.117709+0000","last_active":"2023-11-28T20:07:43.124333+0000","last_peered":"2023-11-28T20:07:43.124333+0000","last_clean":"2023-11-28T20:07:43.124333+0000","last_became_active":"2023-11-28T20:07:42.117344+0000","last_became_peered":"2023-11-28T20:07:42.117344+0000","last_unstale":"2023-11-28T20:07:43.124333+0000","last_undegraded":"2023-11-28T20:07:43.124333+0000","last_fullsized":"2023-11-28T20:07:43.124333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108064+0000","last_change":"2023-11-28T20:07:42.124921+0000","last_active":"2023-11-28T20:07:43.108064+0000","last_peered":"2023-11-28T20:07:43.108064+0000","last_clean":"2023-11-28T20:07:43.108064+0000","last_became_active":"2023-11-28T20:07:42.123003+0000","last_became_peered":"2023-11-28T20:07:42.123003+0000","last_unstale":"2023-11-28T20:07:43.108064+0000","last_undegraded":"2023-11-28T20:07:43.108064+0000","last_fullsized":"2023-11-28T20:07:43.108064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609819+0000","last_change":"2023-11-28T20:07:42.131215+0000","last_active":"2023-11-28T20:07:43.609819+0000","last_peered":"2023-11-28T20:07:43.609819+0000","last_clean":"2023-11-28T20:07:43.609819+0000","last_became_active":"2023-11-28T20:07:42.130873+0000","last_became_peered":"2023-11-28T20:07:42.130873+0000","last_unstale":"2023-11-28T20:07:43.609819+0000","last_undegraded":"2023-11-28T20:07:43.609819+0000","last_fullsized":"2023-11-28T20:07:43.609819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:48.514241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109188+0000","last_change":"2023-11-28T20:07:42.115955+0000","last_active":"2023-11-28T20:07:43.109188+0000","last_peered":"2023-11-28T20:07:43.109188+0000","last_clean":"2023-11-28T20:07:43.109188+0000","last_became_active":"2023-11-28T20:07:42.113021+0000","last_became_peered":"2023-11-28T20:07:42.113021+0000","last_unstale":"2023-11-28T20:07:43.109188+0000","last_undegraded":"2023-11-28T20:07:43.109188+0000","last_fullsized":"2023-11-28T20:07:43.109188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609630+0000","last_change":"2023-11-28T20:07:42.122012+0000","last_active":"2023-11-28T20:07:43.609630+0000","last_peered":"2023-11-28T20:07:43.609630+0000","last_clean":"2023-11-28T20:07:43.609630+0000","last_became_active":"2023-11-28T20:07:42.121735+0000","last_became_peered":"2023-11-28T20:07:42.121735+0000","last_unstale":"2023-11-28T20:07:43.609630+0000","last_undegraded":"2023-11-28T20:07:43.609630+0000","last_fullsized":"2023-11-28T20:07:43.609630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109731+0000","last_change":"2023-11-28T20:07:42.120931+0000","last_active":"2023-11-28T20:07:43.109731+0000","last_peered":"2023-11-28T20:07:43.109731+0000","last_clean":"2023-11-28T20:07:43.109731+0000","last_became_active":"2023-11-28T20:07:42.120627+0000","last_became_peered":"2023-11-28T20:07:42.120627+0000","last_unstale":"2023-11-28T20:07:43.109731+0000","last_undegraded":"2023-11-28T20:07:43.109731+0000","last_fullsized":"2023-11-28T20:07:43.109731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:21.947376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124556+0000","last_change":"2023-11-28T20:07:42.123201+0000","last_active":"2023-11-28T20:07:43.124556+0000","last_peered":"2023-11-28T20:07:43.124556+0000","last_clean":"2023-11-28T20:07:43.124556+0000","last_became_active":"2023-11-28T20:07:42.122875+0000","last_became_peered":"2023-11-28T20:07:42.122875+0000","last_unstale":"2023-11-28T20:07:43.124556+0000","last_undegraded":"2023-11-28T20:07:43.124556+0000","last_fullsized":"2023-11-28T20:07:43.124556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108521+0000","last_change":"2023-11-28T20:07:42.127975+0000","last_active":"2023-11-28T20:07:43.108521+0000","last_peered":"2023-11-28T20:07:43.108521+0000","last_clean":"2023-11-28T20:07:43.108521+0000","last_became_active":"2023-11-28T20:07:42.127673+0000","last_became_peered":"2023-11-28T20:07:42.127673+0000","last_unstale":"2023-11-28T20:07:43.108521+0000","last_undegraded":"2023-11-28T20:07:43.108521+0000","last_fullsized":"2023-11-28T20:07:43.108521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109700+0000","last_change":"2023-11-28T20:07:42.121532+0000","last_active":"2023-11-28T20:07:43.109700+0000","last_peered":"2023-11-28T20:07:43.109700+0000","last_clean":"2023-11-28T20:07:43.109700+0000","last_became_active":"2023-11-28T20:07:42.121244+0000","last_became_peered":"2023-11-28T20:07:42.121244+0000","last_unstale":"2023-11-28T20:07:43.109700+0000","last_undegraded":"2023-11-28T20:07:43.109700+0000","last_fullsized":"2023-11-28T20:07:43.109700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108193+0000","last_change":"2023-11-28T20:07:42.128684+0000","last_active":"2023-11-28T20:07:43.108193+0000","last_peered":"2023-11-28T20:07:43.108193+0000","last_clean":"2023-11-28T20:07:43.108193+0000","last_became_active":"2023-11-28T20:07:42.128383+0000","last_became_peered":"2023-11-28T20:07:42.128383+0000","last_unstale":"2023-11-28T20:07:43.108193+0000","last_undegraded":"2023-11-28T20:07:43.108193+0000","last_fullsized":"2023-11-28T20:07:43.108193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609916+0000","last_change":"2023-11-28T20:07:42.125543+0000","last_active":"2023-11-28T20:07:43.609916+0000","last_peered":"2023-11-28T20:07:43.609916+0000","last_clean":"2023-11-28T20:07:43.609916+0000","last_became_active":"2023-11-28T20:07:42.125249+0000","last_became_peered":"2023-11-28T20:07:42.125249+0000","last_unstale":"2023-11-28T20:07:43.609916+0000","last_undegraded":"2023-11-28T20:07:43.609916+0000","last_fullsized":"2023-11-28T20:07:43.609916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:21.947376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.608401+0000","last_change":"2023-11-28T20:07:42.134967+0000","last_active":"2023-11-28T20:07:43.608401+0000","last_peered":"2023-11-28T20:07:43.608401+0000","last_clean":"2023-11-28T20:07:43.608401+0000","last_became_active":"2023-11-28T20:07:42.134643+0000","last_became_peered":"2023-11-28T20:07:42.134643+0000","last_unstale":"2023-11-28T20:07:43.608401+0000","last_undegraded":"2023-11-28T20:07:43.608401+0000","last_fullsized":"2023-11-28T20:07:43.608401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:18.500544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124176+0000","last_change":"2023-11-28T20:07:42.128770+0000","last_active":"2023-11-28T20:07:43.124176+0000","last_peered":"2023-11-28T20:07:43.124176+0000","last_clean":"2023-11-28T20:07:43.124176+0000","last_became_active":"2023-11-28T20:07:42.128009+0000","last_became_peered":"2023-11-28T20:07:42.128009+0000","last_unstale":"2023-11-28T20:07:43.124176+0000","last_undegraded":"2023-11-28T20:07:43.124176+0000","last_fullsized":"2023-11-28T20:07:43.124176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.608817+0000","last_change":"2023-11-28T20:07:42.118468+0000","last_active":"2023-11-28T20:07:43.608817+0000","last_peered":"2023-11-28T20:07:43.608817+0000","last_clean":"2023-11-28T20:07:43.608817+0000","last_became_active":"2023-11-28T20:07:42.118171+0000","last_became_peered":"2023-11-28T20:07:42.118171+0000","last_unstale":"2023-11-28T20:07:43.608817+0000","last_undegraded":"2023-11-28T20:07:43.608817+0000","last_fullsized":"2023-11-28T20:07:43.608817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:01.763338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109448+0000","last_change":"2023-11-28T20:07:41.124073+0000","last_active":"2023-11-28T20:07:43.109448+0000","last_peered":"2023-11-28T20:07:43.109448+0000","last_clean":"2023-11-28T20:07:43.109448+0000","last_became_active":"2023-11-28T20:07:41.123753+0000","last_became_peered":"2023-11-28T20:07:41.123753+0000","last_unstale":"2023-11-28T20:07:43.109448+0000","last_undegraded":"2023-11-28T20:07:43.109448+0000","last_fullsized":"2023-11-28T20:07:43.109448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108309+0000","last_change":"2023-11-28T20:07:42.115734+0000","last_active":"2023-11-28T20:07:43.108309+0000","last_peered":"2023-11-28T20:07:43.108309+0000","last_clean":"2023-11-28T20:07:43.108309+0000","last_became_active":"2023-11-28T20:07:42.115363+0000","last_became_peered":"2023-11-28T20:07:42.115363+0000","last_unstale":"2023-11-28T20:07:43.108309+0000","last_undegraded":"2023-11-28T20:07:43.108309+0000","last_fullsized":"2023-11-28T20:07:43.108309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124235+0000","last_change":"2023-11-28T20:07:41.120709+0000","last_active":"2023-11-28T20:07:43.124235+0000","last_peered":"2023-11-28T20:07:43.124235+0000","last_clean":"2023-11-28T20:07:43.124235+0000","last_became_active":"2023-11-28T20:07:41.120386+0000","last_became_peered":"2023-11-28T20:07:41.120386+0000","last_unstale":"2023-11-28T20:07:43.124235+0000","last_undegraded":"2023-11-28T20:07:43.124235+0000","last_fullsized":"2023-11-28T20:07:43.124235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109227+0000","last_change":"2023-11-28T20:07:41.122847+0000","last_active":"2023-11-28T20:07:43.109227+0000","last_peered":"2023-11-28T20:07:43.109227+0000","last_clean":"2023-11-28T20:07:43.109227+0000","last_became_active":"2023-11-28T20:07:41.122369+0000","last_became_peered":"2023-11-28T20:07:41.122369+0000","last_unstale":"2023-11-28T20:07:43.109227+0000","last_undegraded":"2023-11-28T20:07:43.109227+0000","last_fullsized":"2023-11-28T20:07:43.109227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108986+0000","last_change":"2023-11-28T20:07:42.126772+0000","last_active":"2023-11-28T20:07:43.108986+0000","last_peered":"2023-11-28T20:07:43.108986+0000","last_clean":"2023-11-28T20:07:43.108986+0000","last_became_active":"2023-11-28T20:07:42.126502+0000","last_became_peered":"2023-11-28T20:07:42.126502+0000","last_unstale":"2023-11-28T20:07:43.108986+0000","last_undegraded":"2023-11-28T20:07:43.108986+0000","last_fullsized":"2023-11-28T20:07:43.108986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.445554+0000","last_change":"2023-11-28T20:07:41.126627+0000","last_active":"2023-11-28T20:07:43.445554+0000","last_peered":"2023-11-28T20:07:43.445554+0000","last_clean":"2023-11-28T20:07:43.445554+0000","last_became_active":"2023-11-28T20:07:41.126337+0000","last_became_peered":"2023-11-28T20:07:41.126337+0000","last_unstale":"2023-11-28T20:07:43.445554+0000","last_undegraded":"2023-11-28T20:07:43.445554+0000","last_fullsized":"2023-11-28T20:07:43.445554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:20.140866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108155+0000","last_change":"2023-11-28T20:07:42.126728+0000","last_active":"2023-11-28T20:07:43.108155+0000","last_peered":"2023-11-28T20:07:43.108155+0000","last_clean":"2023-11-28T20:07:43.108155+0000","last_became_active":"2023-11-28T20:07:42.125306+0000","last_became_peered":"2023-11-28T20:07:42.125306+0000","last_unstale":"2023-11-28T20:07:43.108155+0000","last_undegraded":"2023-11-28T20:07:43.108155+0000","last_fullsized":"2023-11-28T20:07:43.108155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124525+0000","last_change":"2023-11-28T20:07:41.134083+0000","last_active":"2023-11-28T20:07:43.124525+0000","last_peered":"2023-11-28T20:07:43.124525+0000","last_clean":"2023-11-28T20:07:43.124525+0000","last_became_active":"2023-11-28T20:07:41.130145+0000","last_became_peered":"2023-11-28T20:07:41.130145+0000","last_unstale":"2023-11-28T20:07:43.124525+0000","last_undegraded":"2023-11-28T20:07:43.124525+0000","last_fullsized":"2023-11-28T20:07:43.124525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610436+0000","last_change":"2023-11-28T20:07:42.136612+0000","last_active":"2023-11-28T20:07:43.610436+0000","last_peered":"2023-11-28T20:07:43.610436+0000","last_clean":"2023-11-28T20:07:43.610436+0000","last_became_active":"2023-11-28T20:07:42.134753+0000","last_became_peered":"2023-11-28T20:07:42.134753+0000","last_unstale":"2023-11-28T20:07:43.610436+0000","last_undegraded":"2023-11-28T20:07:43.610436+0000","last_fullsized":"2023-11-28T20:07:43.610436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:32.485554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.445825+0000","last_change":"2023-11-28T20:07:41.134996+0000","last_active":"2023-11-28T20:07:43.445825+0000","last_peered":"2023-11-28T20:07:43.445825+0000","last_clean":"2023-11-28T20:07:43.445825+0000","last_became_active":"2023-11-28T20:07:41.134337+0000","last_became_peered":"2023-11-28T20:07:41.134337+0000","last_unstale":"2023-11-28T20:07:43.445825+0000","last_undegraded":"2023-11-28T20:07:43.445825+0000","last_fullsized":"2023-11-28T20:07:43.445825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:27.669172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108614+0000","last_change":"2023-11-28T20:07:42.135162+0000","last_active":"2023-11-28T20:07:43.108614+0000","last_peered":"2023-11-28T20:07:43.108614+0000","last_clean":"2023-11-28T20:07:43.108614+0000","last_became_active":"2023-11-28T20:07:42.134808+0000","last_became_peered":"2023-11-28T20:07:42.134808+0000","last_unstale":"2023-11-28T20:07:43.108614+0000","last_undegraded":"2023-11-28T20:07:43.108614+0000","last_fullsized":"2023-11-28T20:07:43.108614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:48.514241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108605+0000","last_change":"2023-11-28T20:07:41.130473+0000","last_active":"2023-11-28T20:07:43.108605+0000","last_peered":"2023-11-28T20:07:43.108605+0000","last_clean":"2023-11-28T20:07:43.108605+0000","last_became_active":"2023-11-28T20:07:41.130187+0000","last_became_peered":"2023-11-28T20:07:41.130187+0000","last_unstale":"2023-11-28T20:07:43.108605+0000","last_undegraded":"2023-11-28T20:07:43.108605+0000","last_fullsized":"2023-11-28T20:07:43.108605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:14.865470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609368+0000","last_change":"2023-11-28T20:07:42.125322+0000","last_active":"2023-11-28T20:07:43.609368+0000","last_peered":"2023-11-28T20:07:43.609368+0000","last_clean":"2023-11-28T20:07:43.609368+0000","last_became_active":"2023-11-28T20:07:42.125046+0000","last_became_peered":"2023-11-28T20:07:42.125046+0000","last_unstale":"2023-11-28T20:07:43.609368+0000","last_undegraded":"2023-11-28T20:07:43.609368+0000","last_fullsized":"2023-11-28T20:07:43.609368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:15:26.123496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124339+0000","last_change":"2023-11-28T20:07:41.124966+0000","last_active":"2023-11-28T20:07:43.124339+0000","last_peered":"2023-11-28T20:07:43.124339+0000","last_clean":"2023-11-28T20:07:43.124339+0000","last_became_active":"2023-11-28T20:07:41.124663+0000","last_became_peered":"2023-11-28T20:07:41.124663+0000","last_unstale":"2023-11-28T20:07:43.124339+0000","last_undegraded":"2023-11-28T20:07:43.124339+0000","last_fullsized":"2023-11-28T20:07:43.124339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609890+0000","last_change":"2023-11-28T20:07:42.130688+0000","last_active":"2023-11-28T20:07:43.609890+0000","last_peered":"2023-11-28T20:07:43.609890+0000","last_clean":"2023-11-28T20:07:43.609890+0000","last_became_active":"2023-11-28T20:07:42.130327+0000","last_became_peered":"2023-11-28T20:07:42.130327+0000","last_unstale":"2023-11-28T20:07:43.609890+0000","last_undegraded":"2023-11-28T20:07:43.609890+0000","last_fullsized":"2023-11-28T20:07:43.609890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:14.826246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108743+0000","last_change":"2023-11-28T20:07:41.125301+0000","last_active":"2023-11-28T20:07:43.108743+0000","last_peered":"2023-11-28T20:07:43.108743+0000","last_clean":"2023-11-28T20:07:43.108743+0000","last_became_active":"2023-11-28T20:07:41.123720+0000","last_became_peered":"2023-11-28T20:07:41.123720+0000","last_unstale":"2023-11-28T20:07:43.108743+0000","last_undegraded":"2023-11-28T20:07:43.108743+0000","last_fullsized":"2023-11-28T20:07:43.108743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107964+0000","last_change":"2023-11-28T20:07:42.130256+0000","last_active":"2023-11-28T20:07:43.107964+0000","last_peered":"2023-11-28T20:07:43.107964+0000","last_clean":"2023-11-28T20:07:43.107964+0000","last_became_active":"2023-11-28T20:07:42.129938+0000","last_became_peered":"2023-11-28T20:07:42.129938+0000","last_unstale":"2023-11-28T20:07:43.107964+0000","last_undegraded":"2023-11-28T20:07:43.107964+0000","last_fullsized":"2023-11-28T20:07:43.107964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.445650+0000","last_change":"2023-11-28T20:07:41.127173+0000","last_active":"2023-11-28T20:07:43.445650+0000","last_peered":"2023-11-28T20:07:43.445650+0000","last_clean":"2023-11-28T20:07:43.445650+0000","last_became_active":"2023-11-28T20:07:41.126888+0000","last_became_peered":"2023-11-28T20:07:41.126888+0000","last_unstale":"2023-11-28T20:07:43.445650+0000","last_undegraded":"2023-11-28T20:07:43.445650+0000","last_fullsized":"2023-11-28T20:07:43.445650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:22.115906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609634+0000","last_change":"2023-11-28T20:07:42.133429+0000","last_active":"2023-11-28T20:07:43.609634+0000","last_peered":"2023-11-28T20:07:43.609634+0000","last_clean":"2023-11-28T20:07:43.609634+0000","last_became_active":"2023-11-28T20:07:42.132944+0000","last_became_peered":"2023-11-28T20:07:42.132944+0000","last_unstale":"2023-11-28T20:07:43.609634+0000","last_undegraded":"2023-11-28T20:07:43.609634+0000","last_fullsized":"2023-11-28T20:07:43.609634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:53:17.842156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124121+0000","last_change":"2023-11-28T20:07:41.127166+0000","last_active":"2023-11-28T20:07:43.124121+0000","last_peered":"2023-11-28T20:07:43.124121+0000","last_clean":"2023-11-28T20:07:43.124121+0000","last_became_active":"2023-11-28T20:07:41.122806+0000","last_became_peered":"2023-11-28T20:07:41.122806+0000","last_unstale":"2023-11-28T20:07:43.124121+0000","last_undegraded":"2023-11-28T20:07:43.124121+0000","last_fullsized":"2023-11-28T20:07:43.124121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124201+0000","last_change":"2023-11-28T20:07:42.129018+0000","last_active":"2023-11-28T20:07:43.124201+0000","last_peered":"2023-11-28T20:07:43.124201+0000","last_clean":"2023-11-28T20:07:43.124201+0000","last_became_active":"2023-11-28T20:07:42.128392+0000","last_became_peered":"2023-11-28T20:07:42.128392+0000","last_unstale":"2023-11-28T20:07:43.124201+0000","last_undegraded":"2023-11-28T20:07:43.124201+0000","last_fullsized":"2023-11-28T20:07:43.124201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.451831+0000","last_change":"2023-11-28T20:07:41.113833+0000","last_active":"2023-11-28T20:07:43.451831+0000","last_peered":"2023-11-28T20:07:43.451831+0000","last_clean":"2023-11-28T20:07:43.451831+0000","last_became_active":"2023-11-28T20:07:41.113488+0000","last_became_peered":"2023-11-28T20:07:41.113488+0000","last_unstale":"2023-11-28T20:07:43.451831+0000","last_undegraded":"2023-11-28T20:07:43.451831+0000","last_fullsized":"2023-11-28T20:07:43.451831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:00.756568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.608997+0000","last_change":"2023-11-28T20:07:42.135006+0000","last_active":"2023-11-28T20:07:43.608997+0000","last_peered":"2023-11-28T20:07:43.608997+0000","last_clean":"2023-11-28T20:07:43.608997+0000","last_became_active":"2023-11-28T20:07:42.134503+0000","last_became_peered":"2023-11-28T20:07:42.134503+0000","last_unstale":"2023-11-28T20:07:43.608997+0000","last_undegraded":"2023-11-28T20:07:43.608997+0000","last_fullsized":"2023-11-28T20:07:43.608997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:21.947376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.445584+0000","last_change":"2023-11-28T20:07:41.118939+0000","last_active":"2023-11-28T20:07:43.445584+0000","last_peered":"2023-11-28T20:07:43.445584+0000","last_clean":"2023-11-28T20:07:43.445584+0000","last_became_active":"2023-11-28T20:07:41.117672+0000","last_became_peered":"2023-11-28T20:07:41.117672+0000","last_unstale":"2023-11-28T20:07:43.445584+0000","last_undegraded":"2023-11-28T20:07:43.445584+0000","last_fullsized":"2023-11-28T20:07:43.445584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:39.280352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610513+0000","last_change":"2023-11-28T20:07:42.130339+0000","last_active":"2023-11-28T20:07:43.610513+0000","last_peered":"2023-11-28T20:07:43.610513+0000","last_clean":"2023-11-28T20:07:43.610513+0000","last_became_active":"2023-11-28T20:07:42.129788+0000","last_became_peered":"2023-11-28T20:07:42.129788+0000","last_unstale":"2023-11-28T20:07:43.610513+0000","last_undegraded":"2023-11-28T20:07:43.610513+0000","last_fullsized":"2023-11-28T20:07:43.610513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:32.485554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.451918+0000","last_change":"2023-11-28T20:07:41.114418+0000","last_active":"2023-11-28T20:07:43.451918+0000","last_peered":"2023-11-28T20:07:43.451918+0000","last_clean":"2023-11-28T20:07:43.451918+0000","last_became_active":"2023-11-28T20:07:41.114147+0000","last_became_peered":"2023-11-28T20:07:41.114147+0000","last_unstale":"2023-11-28T20:07:43.451918+0000","last_undegraded":"2023-11-28T20:07:43.451918+0000","last_fullsized":"2023-11-28T20:07:43.451918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:20.140866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610948+0000","last_change":"2023-11-28T20:07:42.133323+0000","last_active":"2023-11-28T20:07:43.610948+0000","last_peered":"2023-11-28T20:07:43.610948+0000","last_clean":"2023-11-28T20:07:43.610948+0000","last_became_active":"2023-11-28T20:07:42.132957+0000","last_became_peered":"2023-11-28T20:07:42.132957+0000","last_unstale":"2023-11-28T20:07:43.610948+0000","last_undegraded":"2023-11-28T20:07:43.610948+0000","last_fullsized":"2023-11-28T20:07:43.610948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:18.557987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108689+0000","last_change":"2023-11-28T20:07:41.123577+0000","last_active":"2023-11-28T20:07:43.108689+0000","last_peered":"2023-11-28T20:07:43.108689+0000","last_clean":"2023-11-28T20:07:43.108689+0000","last_became_active":"2023-11-28T20:07:41.123238+0000","last_became_peered":"2023-11-28T20:07:41.123238+0000","last_unstale":"2023-11-28T20:07:43.108689+0000","last_undegraded":"2023-11-28T20:07:43.108689+0000","last_fullsized":"2023-11-28T20:07:43.108689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:22.115906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610238+0000","last_change":"2023-11-28T20:07:42.123412+0000","last_active":"2023-11-28T20:07:43.610238+0000","last_peered":"2023-11-28T20:07:43.610238+0000","last_clean":"2023-11-28T20:07:43.610238+0000","last_became_active":"2023-11-28T20:07:42.123097+0000","last_became_peered":"2023-11-28T20:07:42.123097+0000","last_unstale":"2023-11-28T20:07:43.610238+0000","last_undegraded":"2023-11-28T20:07:43.610238+0000","last_fullsized":"2023-11-28T20:07:43.610238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:53:17.842156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.451883+0000","last_change":"2023-11-28T20:07:41.128647+0000","last_active":"2023-11-28T20:07:43.451883+0000","last_peered":"2023-11-28T20:07:43.451883+0000","last_clean":"2023-11-28T20:07:43.451883+0000","last_became_active":"2023-11-28T20:07:41.128419+0000","last_became_peered":"2023-11-28T20:07:41.128419+0000","last_unstale":"2023-11-28T20:07:43.451883+0000","last_undegraded":"2023-11-28T20:07:43.451883+0000","last_fullsized":"2023-11-28T20:07:43.451883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:46.109752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610010+0000","last_change":"2023-11-28T20:07:42.134474+0000","last_active":"2023-11-28T20:07:43.610010+0000","last_peered":"2023-11-28T20:07:43.610010+0000","last_clean":"2023-11-28T20:07:43.610010+0000","last_became_active":"2023-11-28T20:07:42.134196+0000","last_became_peered":"2023-11-28T20:07:42.134196+0000","last_unstale":"2023-11-28T20:07:43.610010+0000","last_undegraded":"2023-11-28T20:07:43.610010+0000","last_fullsized":"2023-11-28T20:07:43.610010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:19:47.371816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.117857+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:07:42.117857+0000","last_peered":"2023-11-28T20:07:42.117857+0000","last_clean":"2023-11-28T20:07:42.117857+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:07:42.117857+0000","last_undegraded":"2023-11-28T20:07:42.117857+0000","last_fullsized":"2023-11-28T20:07:42.117857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.445686+0000","last_change":"2023-11-28T20:07:41.125548+0000","last_active":"2023-11-28T20:07:43.445686+0000","last_peered":"2023-11-28T20:07:43.445686+0000","last_clean":"2023-11-28T20:07:43.445686+0000","last_became_active":"2023-11-28T20:07:41.124741+0000","last_became_peered":"2023-11-28T20:07:41.124741+0000","last_unstale":"2023-11-28T20:07:43.445686+0000","last_undegraded":"2023-11-28T20:07:43.445686+0000","last_fullsized":"2023-11-28T20:07:43.445686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:33.969503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108686+0000","last_change":"2023-11-28T20:07:42.120751+0000","last_active":"2023-11-28T20:07:43.108686+0000","last_peered":"2023-11-28T20:07:43.108686+0000","last_clean":"2023-11-28T20:07:43.108686+0000","last_became_active":"2023-11-28T20:07:42.120442+0000","last_became_peered":"2023-11-28T20:07:42.120442+0000","last_unstale":"2023-11-28T20:07:43.108686+0000","last_undegraded":"2023-11-28T20:07:43.108686+0000","last_fullsized":"2023-11-28T20:07:43.108686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:23.122677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.449821+0000","last_change":"2023-11-28T20:07:41.123778+0000","last_active":"2023-11-28T20:07:43.449821+0000","last_peered":"2023-11-28T20:07:43.449821+0000","last_clean":"2023-11-28T20:07:43.449821+0000","last_became_active":"2023-11-28T20:07:41.122816+0000","last_became_peered":"2023-11-28T20:07:41.122816+0000","last_unstale":"2023-11-28T20:07:43.449821+0000","last_undegraded":"2023-11-28T20:07:43.449821+0000","last_fullsized":"2023-11-28T20:07:43.449821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:14.653540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107769+0000","last_change":"2023-11-28T20:07:42.107177+0000","last_active":"2023-11-28T20:07:43.107769+0000","last_peered":"2023-11-28T20:07:43.107769+0000","last_clean":"2023-11-28T20:07:43.107769+0000","last_became_active":"2023-11-28T20:07:42.106858+0000","last_became_peered":"2023-11-28T20:07:42.106858+0000","last_unstale":"2023-11-28T20:07:43.107769+0000","last_undegraded":"2023-11-28T20:07:43.107769+0000","last_fullsized":"2023-11-28T20:07:43.107769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:15.872240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.451855+0000","last_change":"2023-11-28T20:07:41.114571+0000","last_active":"2023-11-28T20:07:43.451855+0000","last_peered":"2023-11-28T20:07:43.451855+0000","last_clean":"2023-11-28T20:07:43.451855+0000","last_became_active":"2023-11-28T20:07:41.114262+0000","last_became_peered":"2023-11-28T20:07:41.114262+0000","last_unstale":"2023-11-28T20:07:43.451855+0000","last_undegraded":"2023-11-28T20:07:43.451855+0000","last_fullsized":"2023-11-28T20:07:43.451855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:10.975521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107548+0000","last_change":"2023-11-28T20:07:42.120451+0000","last_active":"2023-11-28T20:07:43.107548+0000","last_peered":"2023-11-28T20:07:43.107548+0000","last_clean":"2023-11-28T20:07:43.107548+0000","last_became_active":"2023-11-28T20:07:42.120142+0000","last_became_peered":"2023-11-28T20:07:42.120142+0000","last_unstale":"2023-11-28T20:07:43.107548+0000","last_undegraded":"2023-11-28T20:07:43.107548+0000","last_fullsized":"2023-11-28T20:07:43.107548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.445669+0000","last_change":"2023-11-28T20:07:41.127173+0000","last_active":"2023-11-28T20:07:43.445669+0000","last_peered":"2023-11-28T20:07:43.445669+0000","last_clean":"2023-11-28T20:07:43.445669+0000","last_became_active":"2023-11-28T20:07:41.126918+0000","last_became_peered":"2023-11-28T20:07:41.126918+0000","last_unstale":"2023-11-28T20:07:43.445669+0000","last_undegraded":"2023-11-28T20:07:43.445669+0000","last_fullsized":"2023-11-28T20:07:43.445669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:07.033166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609193+0000","last_change":"2023-11-28T20:07:42.116610+0000","last_active":"2023-11-28T20:07:43.609193+0000","last_peered":"2023-11-28T20:07:43.609193+0000","last_clean":"2023-11-28T20:07:43.609193+0000","last_became_active":"2023-11-28T20:07:42.116325+0000","last_became_peered":"2023-11-28T20:07:42.116325+0000","last_unstale":"2023-11-28T20:07:43.609193+0000","last_undegraded":"2023-11-28T20:07:43.609193+0000","last_fullsized":"2023-11-28T20:07:43.609193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:21.147636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108792+0000","last_change":"2023-11-28T20:07:41.122092+0000","last_active":"2023-11-28T20:07:43.108792+0000","last_peered":"2023-11-28T20:07:43.108792+0000","last_clean":"2023-11-28T20:07:43.108792+0000","last_became_active":"2023-11-28T20:07:41.121742+0000","last_became_peered":"2023-11-28T20:07:41.121742+0000","last_unstale":"2023-11-28T20:07:43.108792+0000","last_undegraded":"2023-11-28T20:07:43.108792+0000","last_fullsized":"2023-11-28T20:07:43.108792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610402+0000","last_change":"2023-11-28T20:07:42.127953+0000","last_active":"2023-11-28T20:07:43.610402+0000","last_peered":"2023-11-28T20:07:43.610402+0000","last_clean":"2023-11-28T20:07:43.610402+0000","last_became_active":"2023-11-28T20:07:42.127517+0000","last_became_peered":"2023-11-28T20:07:42.127517+0000","last_unstale":"2023-11-28T20:07:43.610402+0000","last_undegraded":"2023-11-28T20:07:43.610402+0000","last_fullsized":"2023-11-28T20:07:43.610402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:19:47.371816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.450025+0000","last_change":"2023-11-28T20:07:41.121831+0000","last_active":"2023-11-28T20:07:43.450025+0000","last_peered":"2023-11-28T20:07:43.450025+0000","last_clean":"2023-11-28T20:07:43.450025+0000","last_became_active":"2023-11-28T20:07:41.121524+0000","last_became_peered":"2023-11-28T20:07:41.121524+0000","last_unstale":"2023-11-28T20:07:43.450025+0000","last_undegraded":"2023-11-28T20:07:43.450025+0000","last_fullsized":"2023-11-28T20:07:43.450025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107980+0000","last_change":"2023-11-28T20:07:42.115989+0000","last_active":"2023-11-28T20:07:43.107980+0000","last_peered":"2023-11-28T20:07:43.107980+0000","last_clean":"2023-11-28T20:07:43.107980+0000","last_became_active":"2023-11-28T20:07:42.114912+0000","last_became_peered":"2023-11-28T20:07:42.114912+0000","last_unstale":"2023-11-28T20:07:43.107980+0000","last_undegraded":"2023-11-28T20:07:43.107980+0000","last_fullsized":"2023-11-28T20:07:43.107980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.449935+0000","last_change":"2023-11-28T20:07:41.125968+0000","last_active":"2023-11-28T20:07:43.449935+0000","last_peered":"2023-11-28T20:07:43.449935+0000","last_clean":"2023-11-28T20:07:43.449935+0000","last_became_active":"2023-11-28T20:07:41.125651+0000","last_became_peered":"2023-11-28T20:07:41.125651+0000","last_unstale":"2023-11-28T20:07:43.449935+0000","last_undegraded":"2023-11-28T20:07:43.449935+0000","last_fullsized":"2023-11-28T20:07:43.449935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109706+0000","last_change":"2023-11-28T20:07:42.125891+0000","last_active":"2023-11-28T20:07:43.109706+0000","last_peered":"2023-11-28T20:07:43.109706+0000","last_clean":"2023-11-28T20:07:43.109706+0000","last_became_active":"2023-11-28T20:07:42.123728+0000","last_became_peered":"2023-11-28T20:07:42.123728+0000","last_unstale":"2023-11-28T20:07:43.109706+0000","last_undegraded":"2023-11-28T20:07:43.109706+0000","last_fullsized":"2023-11-28T20:07:43.109706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:48.514241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124593+0000","last_change":"2023-11-28T20:07:41.133929+0000","last_active":"2023-11-28T20:07:43.124593+0000","last_peered":"2023-11-28T20:07:43.124593+0000","last_clean":"2023-11-28T20:07:43.124593+0000","last_became_active":"2023-11-28T20:07:41.129799+0000","last_became_peered":"2023-11-28T20:07:41.129799+0000","last_unstale":"2023-11-28T20:07:43.124593+0000","last_undegraded":"2023-11-28T20:07:43.124593+0000","last_fullsized":"2023-11-28T20:07:43.124593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:14.865470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108570+0000","last_change":"2023-11-28T20:07:42.122167+0000","last_active":"2023-11-28T20:07:43.108570+0000","last_peered":"2023-11-28T20:07:43.108570+0000","last_clean":"2023-11-28T20:07:43.108570+0000","last_became_active":"2023-11-28T20:07:42.120118+0000","last_became_peered":"2023-11-28T20:07:42.120118+0000","last_unstale":"2023-11-28T20:07:43.108570+0000","last_undegraded":"2023-11-28T20:07:43.108570+0000","last_fullsized":"2023-11-28T20:07:43.108570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.449796+0000","last_change":"2023-11-28T20:07:41.125281+0000","last_active":"2023-11-28T20:07:43.449796+0000","last_peered":"2023-11-28T20:07:43.449796+0000","last_clean":"2023-11-28T20:07:43.449796+0000","last_became_active":"2023-11-28T20:07:41.124978+0000","last_became_peered":"2023-11-28T20:07:41.124978+0000","last_unstale":"2023-11-28T20:07:43.449796+0000","last_undegraded":"2023-11-28T20:07:43.449796+0000","last_fullsized":"2023-11-28T20:07:43.449796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:27.669172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609037+0000","last_change":"2023-11-28T20:07:42.115882+0000","last_active":"2023-11-28T20:07:43.609037+0000","last_peered":"2023-11-28T20:07:43.609037+0000","last_clean":"2023-11-28T20:07:43.609037+0000","last_became_active":"2023-11-28T20:07:42.114781+0000","last_became_peered":"2023-11-28T20:07:42.114781+0000","last_unstale":"2023-11-28T20:07:43.609037+0000","last_undegraded":"2023-11-28T20:07:43.609037+0000","last_fullsized":"2023-11-28T20:07:43.609037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:11.982291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108238+0000","last_change":"2023-11-28T20:07:41.121428+0000","last_active":"2023-11-28T20:07:43.108238+0000","last_peered":"2023-11-28T20:07:43.108238+0000","last_clean":"2023-11-28T20:07:43.108238+0000","last_became_active":"2023-11-28T20:07:41.121074+0000","last_became_peered":"2023-11-28T20:07:41.121074+0000","last_unstale":"2023-11-28T20:07:43.108238+0000","last_undegraded":"2023-11-28T20:07:43.108238+0000","last_fullsized":"2023-11-28T20:07:43.108238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109046+0000","last_change":"2023-11-28T20:07:42.122531+0000","last_active":"2023-11-28T20:07:43.109046+0000","last_peered":"2023-11-28T20:07:43.109046+0000","last_clean":"2023-11-28T20:07:43.109046+0000","last_became_active":"2023-11-28T20:07:42.122224+0000","last_became_peered":"2023-11-28T20:07:42.122224+0000","last_unstale":"2023-11-28T20:07:43.109046+0000","last_undegraded":"2023-11-28T20:07:43.109046+0000","last_fullsized":"2023-11-28T20:07:43.109046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108278+0000","last_change":"2023-11-28T20:07:41.118482+0000","last_active":"2023-11-28T20:07:43.108278+0000","last_peered":"2023-11-28T20:07:43.108278+0000","last_clean":"2023-11-28T20:07:43.108278+0000","last_became_active":"2023-11-28T20:07:41.117962+0000","last_became_peered":"2023-11-28T20:07:41.117962+0000","last_unstale":"2023-11-28T20:07:43.108278+0000","last_undegraded":"2023-11-28T20:07:43.108278+0000","last_fullsized":"2023-11-28T20:07:43.108278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109519+0000","last_change":"2023-11-28T20:07:42.123985+0000","last_active":"2023-11-28T20:07:43.109519+0000","last_peered":"2023-11-28T20:07:43.109519+0000","last_clean":"2023-11-28T20:07:43.109519+0000","last_became_active":"2023-11-28T20:07:42.122314+0000","last_became_peered":"2023-11-28T20:07:42.122314+0000","last_unstale":"2023-11-28T20:07:43.109519+0000","last_undegraded":"2023-11-28T20:07:43.109519+0000","last_fullsized":"2023-11-28T20:07:43.109519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.449950+0000","last_change":"2023-11-28T20:07:41.127916+0000","last_active":"2023-11-28T20:07:43.449950+0000","last_peered":"2023-11-28T20:07:43.449950+0000","last_clean":"2023-11-28T20:07:43.449950+0000","last_became_active":"2023-11-28T20:07:41.125354+0000","last_became_peered":"2023-11-28T20:07:41.125354+0000","last_unstale":"2023-11-28T20:07:43.449950+0000","last_undegraded":"2023-11-28T20:07:43.449950+0000","last_fullsized":"2023-11-28T20:07:43.449950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:33.969503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124333+0000","last_change":"2023-11-28T20:07:42.123629+0000","last_active":"2023-11-28T20:07:43.124333+0000","last_peered":"2023-11-28T20:07:43.124333+0000","last_clean":"2023-11-28T20:07:43.124333+0000","last_became_active":"2023-11-28T20:07:42.123350+0000","last_became_peered":"2023-11-28T20:07:42.123350+0000","last_unstale":"2023-11-28T20:07:43.124333+0000","last_undegraded":"2023-11-28T20:07:43.124333+0000","last_fullsized":"2023-11-28T20:07:43.124333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610425+0000","last_change":"2023-11-28T20:07:42.127778+0000","last_active":"2023-11-28T20:07:43.610425+0000","last_peered":"2023-11-28T20:07:43.610425+0000","last_clean":"2023-11-28T20:07:43.610425+0000","last_became_active":"2023-11-28T20:07:42.127127+0000","last_became_peered":"2023-11-28T20:07:42.127127+0000","last_unstale":"2023-11-28T20:07:43.610425+0000","last_undegraded":"2023-11-28T20:07:43.610425+0000","last_fullsized":"2023-11-28T20:07:43.610425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:42:04.486716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.449961+0000","last_change":"2023-11-28T20:07:41.132264+0000","last_active":"2023-11-28T20:07:43.449961+0000","last_peered":"2023-11-28T20:07:43.449961+0000","last_clean":"2023-11-28T20:07:43.449961+0000","last_became_active":"2023-11-28T20:07:41.131858+0000","last_became_peered":"2023-11-28T20:07:41.131858+0000","last_unstale":"2023-11-28T20:07:43.449961+0000","last_undegraded":"2023-11-28T20:07:43.449961+0000","last_fullsized":"2023-11-28T20:07:43.449961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610243+0000","last_change":"2023-11-28T20:07:42.125457+0000","last_active":"2023-11-28T20:07:43.610243+0000","last_peered":"2023-11-28T20:07:43.610243+0000","last_clean":"2023-11-28T20:07:43.610243+0000","last_became_active":"2023-11-28T20:07:42.125082+0000","last_became_peered":"2023-11-28T20:07:42.125082+0000","last_unstale":"2023-11-28T20:07:43.610243+0000","last_undegraded":"2023-11-28T20:07:43.610243+0000","last_fullsized":"2023-11-28T20:07:43.610243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:14.826246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.450005+0000","last_change":"2023-11-28T20:07:41.126423+0000","last_active":"2023-11-28T20:07:43.450005+0000","last_peered":"2023-11-28T20:07:43.450005+0000","last_clean":"2023-11-28T20:07:43.450005+0000","last_became_active":"2023-11-28T20:07:41.126053+0000","last_became_peered":"2023-11-28T20:07:41.126053+0000","last_unstale":"2023-11-28T20:07:43.450005+0000","last_undegraded":"2023-11-28T20:07:43.450005+0000","last_fullsized":"2023-11-28T20:07:43.450005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108551+0000","last_change":"2023-11-28T20:07:42.137656+0000","last_active":"2023-11-28T20:07:43.108551+0000","last_peered":"2023-11-28T20:07:43.108551+0000","last_clean":"2023-11-28T20:07:43.108551+0000","last_became_active":"2023-11-28T20:07:42.137370+0000","last_became_peered":"2023-11-28T20:07:42.137370+0000","last_unstale":"2023-11-28T20:07:43.108551+0000","last_undegraded":"2023-11-28T20:07:43.108551+0000","last_fullsized":"2023-11-28T20:07:43.108551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109645+0000","last_change":"2023-11-28T20:07:41.120883+0000","last_active":"2023-11-28T20:07:43.109645+0000","last_peered":"2023-11-28T20:07:43.109645+0000","last_clean":"2023-11-28T20:07:43.109645+0000","last_became_active":"2023-11-28T20:07:41.120623+0000","last_became_peered":"2023-11-28T20:07:41.120623+0000","last_unstale":"2023-11-28T20:07:43.109645+0000","last_undegraded":"2023-11-28T20:07:43.109645+0000","last_fullsized":"2023-11-28T20:07:43.109645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109672+0000","last_change":"2023-11-28T20:07:42.120123+0000","last_active":"2023-11-28T20:07:43.109672+0000","last_peered":"2023-11-28T20:07:43.109672+0000","last_clean":"2023-11-28T20:07:43.109672+0000","last_became_active":"2023-11-28T20:07:42.119516+0000","last_became_peered":"2023-11-28T20:07:42.119516+0000","last_unstale":"2023-11-28T20:07:43.109672+0000","last_undegraded":"2023-11-28T20:07:43.109672+0000","last_fullsized":"2023-11-28T20:07:43.109672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108702+0000","last_change":"2023-11-28T20:07:41.121501+0000","last_active":"2023-11-28T20:07:43.108702+0000","last_peered":"2023-11-28T20:07:43.108702+0000","last_clean":"2023-11-28T20:07:43.108702+0000","last_became_active":"2023-11-28T20:07:41.121213+0000","last_became_peered":"2023-11-28T20:07:41.121213+0000","last_unstale":"2023-11-28T20:07:43.108702+0000","last_undegraded":"2023-11-28T20:07:43.108702+0000","last_fullsized":"2023-11-28T20:07:43.108702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.8810000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.9740000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.206}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6710000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.9909999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7889999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7069999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6360000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:07:50.979 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:07:51.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.152+0000 7f9e3b679640 1 Processor -- start 2023-11-28T20:07:51.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.152+0000 7f9e3b679640 1 -- start start 2023-11-28T20:07:51.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.152+0000 7f9e3b679640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e340b4760 0x7f9e340d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.152+0000 7f9e3b679640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9e340b4b40 0x7f9e340d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.152+0000 7f9e3b679640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e34143780 con 0x7f9e34142c00 2023-11-28T20:07:51.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.152+0000 7f9e3b679640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e34161dc0 con 0x7f9e340b4b40 2023-11-28T20:07:51.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.152+0000 7f9e3b679640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3415d7c0 con 0x7f9e340b4760 2023-11-28T20:07:51.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.152+0000 7f9e38c14640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9e340b4b40 0x7f9e340d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.152+0000 7f9e38c14640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9e340b4b40 0x7f9e340d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44658/0 (socket says 172.21.15.177:44658) 2023-11-28T20:07:51.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.152+0000 7f9e38c14640 1 -- 172.21.15.177:0/1513143763 learned_addr learned my addr 172.21.15.177:0/1513143763 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:51.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.152+0000 7f9e39415640 1 --2- 172.21.15.177:0/1513143763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e340b4760 0x7f9e340d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.152+0000 7f9e38c14640 1 -- 172.21.15.177:0/1513143763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e340b4760 msgr2=0x7f9e340d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:51.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.152+0000 7f9e38c14640 1 --2- 172.21.15.177:0/1513143763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e340b4760 0x7f9e340d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.152+0000 7f9e38c14640 1 -- 172.21.15.177:0/1513143763 >> v1:172.21.15.195:6789/0 conn(0x7f9e34142c00 legacy=0x7f9e34143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.152+0000 7f9e38c14640 1 -- 172.21.15.177:0/1513143763 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e34140930 con 0x7f9e340b4b40 2023-11-28T20:07:51.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.156+0000 7f9e38c14640 1 --2- 172.21.15.177:0/1513143763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e340b4b40 0x7f9e340d15e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9e24009870 tx=0x7f9e2401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a1470993f9b137 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:51.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.156+0000 7f9e2bfff640 1 -- 172.21.15.177:0/1513143763 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e240ab600 con 0x7f9e340b4b40 2023-11-28T20:07:51.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.156+0000 7f9e2bfff640 1 -- 172.21.15.177:0/1513143763 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e240a7050 con 0x7f9e340b4b40 2023-11-28T20:07:51.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.156+0000 7f9e2bfff640 1 -- 172.21.15.177:0/1513143763 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e240ab980 con 0x7f9e340b4b40 2023-11-28T20:07:51.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.156+0000 7f9e3b679640 1 -- 172.21.15.177:0/1513143763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e340b4b40 msgr2=0x7f9e340d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.156+0000 7f9e3b679640 1 --2- 172.21.15.177:0/1513143763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e340b4b40 0x7f9e340d15e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9e24009870 tx=0x7f9e2401c540 comp rx=0 tx=0).stop 2023-11-28T20:07:51.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.156+0000 7f9e3b679640 1 -- 172.21.15.177:0/1513143763 shutdown_connections 2023-11-28T20:07:51.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.156+0000 7f9e3b679640 1 --2- 172.21.15.177:0/1513143763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e340b4b40 0x7f9e340d15e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.156+0000 7f9e3b679640 1 --2- 172.21.15.177:0/1513143763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e340b4760 0x7f9e340d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.156+0000 7f9e3b679640 1 -- 172.21.15.177:0/1513143763 >> 172.21.15.177:0/1513143763 conn(0x7f9e3406a530 msgr2=0x7f9e3406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:51.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.156+0000 7f9e3b679640 1 -- 172.21.15.177:0/1513143763 shutdown_connections 2023-11-28T20:07:51.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.156+0000 7f9e3b679640 1 -- 172.21.15.177:0/1513143763 wait complete. 2023-11-28T20:07:51.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e3b679640 1 Processor -- start 2023-11-28T20:07:51.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e3b679640 1 -- start start 2023-11-28T20:07:51.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e3b679640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e340b4760 0x7f9e341597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e3b679640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e340b4b40 0x7f9e3413cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e3b679640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e34142c00 0x7f9e34155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e3b679640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e34159dc0 con 0x7f9e340b4b40 2023-11-28T20:07:51.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e3b679640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3415a0a0 con 0x7f9e34142c00 2023-11-28T20:07:51.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e3b679640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3415a380 con 0x7f9e340b4760 2023-11-28T20:07:51.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e38c14640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e340b4b40 0x7f9e3413cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e38c14640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e340b4b40 0x7f9e3413cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44662/0 (socket says 172.21.15.177:44662) 2023-11-28T20:07:51.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e38c14640 1 -- 172.21.15.177:0/3491935079 learned_addr learned my addr 172.21.15.177:0/3491935079 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:51.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e38c14640 1 -- 172.21.15.177:0/3491935079 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e340b4760 msgr2=0x7f9e341597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e38c14640 1 --2- 172.21.15.177:0/3491935079 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e340b4760 0x7f9e341597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e39c16640 1 --2- 172.21.15.177:0/3491935079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e34142c00 0x7f9e34155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e38c14640 1 -- 172.21.15.177:0/3491935079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e34142c00 msgr2=0x7f9e34155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e38c14640 1 --2- 172.21.15.177:0/3491935079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e34142c00 0x7f9e34155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e38c14640 1 -- 172.21.15.177:0/3491935079 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e240094d0 con 0x7f9e340b4b40 2023-11-28T20:07:51.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e38c14640 1 --2- 172.21.15.177:0/3491935079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e340b4b40 0x7f9e3413cec0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9e2401a170 tx=0x7f9e240192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:51.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e29ffb640 1 -- 172.21.15.177:0/3491935079 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e240aa7b0 con 0x7f9e340b4b40 2023-11-28T20:07:51.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e29ffb640 1 -- 172.21.15.177:0/3491935079 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e240aa910 con 0x7f9e340b4b40 2023-11-28T20:07:51.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e29ffb640 1 -- 172.21.15.177:0/3491935079 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e240aac80 con 0x7f9e340b4b40 2023-11-28T20:07:51.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e3b679640 1 -- 172.21.15.177:0/3491935079 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3415a660 con 0x7f9e340b4b40 2023-11-28T20:07:51.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.160+0000 7f9e3b679640 1 -- 172.21.15.177:0/3491935079 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3415cbf0 con 0x7f9e340b4b40 2023-11-28T20:07:51.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.164+0000 7f9e3b679640 1 -- 172.21.15.177:0/3491935079 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e34069440 con 0x7f9e340b4b40 2023-11-28T20:07:51.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.164+0000 7f9e29ffb640 1 -- 172.21.15.177:0/3491935079 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9e240b2070 con 0x7f9e340b4b40 2023-11-28T20:07:51.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.164+0000 7f9e29ffb640 1 --2- 172.21.15.177:0/3491935079 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9e18066470 0x7f9e18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.164+0000 7f9e29ffb640 1 -- 172.21.15.177:0/3491935079 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e2411d4d0 con 0x7f9e340b4b40 2023-11-28T20:07:51.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.164+0000 7f9e39415640 1 --2- 172.21.15.177:0/3491935079 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9e18066470 0x7f9e18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.164+0000 7f9e39415640 1 --2- 172.21.15.177:0/3491935079 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9e18066470 0x7f9e18068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9e300098f0 tx=0x7f9e30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:51.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.168+0000 7f9e29ffb640 1 -- 172.21.15.177:0/3491935079 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e240ea8b0 con 0x7f9e340b4b40 2023-11-28T20:07:51.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.316+0000 7f9e3b679640 1 -- 172.21.15.177:0/3491935079 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9e3415e2b0 con 0x7f9e18066470 2023-11-28T20:07:51.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.324+0000 7f9e29ffb640 1 -- 172.21.15.177:0/3491935079 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264525 (secure 0 0 0) 0x7f9e30009e70 con 0x7f9e18066470 2023-11-28T20:07:51.331 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:51.333 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:07:51.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.328+0000 7f9e3b679640 1 -- 172.21.15.177:0/3491935079 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9e18066470 msgr2=0x7f9e18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.328+0000 7f9e3b679640 1 --2- 172.21.15.177:0/3491935079 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9e18066470 0x7f9e18068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9e300098f0 tx=0x7f9e30008040 comp rx=0 tx=0).stop 2023-11-28T20:07:51.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.328+0000 7f9e3b679640 1 -- 172.21.15.177:0/3491935079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e340b4b40 msgr2=0x7f9e3413cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.328+0000 7f9e3b679640 1 --2- 172.21.15.177:0/3491935079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e340b4b40 0x7f9e3413cec0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9e2401a170 tx=0x7f9e240192e0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.328+0000 7f9e3b679640 1 -- 172.21.15.177:0/3491935079 shutdown_connections 2023-11-28T20:07:51.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.328+0000 7f9e3b679640 1 --2- 172.21.15.177:0/3491935079 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9e18066470 0x7f9e18068930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.328+0000 7f9e3b679640 1 --2- 172.21.15.177:0/3491935079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e34142c00 0x7f9e34155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.328+0000 7f9e3b679640 1 --2- 172.21.15.177:0/3491935079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e340b4b40 0x7f9e3413cec0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.328+0000 7f9e3b679640 1 --2- 172.21.15.177:0/3491935079 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e340b4760 0x7f9e341597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.328+0000 7f9e3b679640 1 -- 172.21.15.177:0/3491935079 >> 172.21.15.177:0/3491935079 conn(0x7f9e3406a530 msgr2=0x7f9e34156d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:51.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.328+0000 7f9e3b679640 1 -- 172.21.15.177:0/3491935079 shutdown_connections 2023-11-28T20:07:51.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.328+0000 7f9e3b679640 1 -- 172.21.15.177:0/3491935079 wait complete. 2023-11-28T20:07:51.352 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-28T20:07:49.419782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231500,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743220,"statfs":{"total":773094113280,"available":772857057280,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001657"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610824+0000","last_change":"2023-11-28T20:07:42.131471+0000","last_active":"2023-11-28T20:07:43.610824+0000","last_peered":"2023-11-28T20:07:43.610824+0000","last_clean":"2023-11-28T20:07:43.610824+0000","last_became_active":"2023-11-28T20:07:42.131182+0000","last_became_peered":"2023-11-28T20:07:42.131182+0000","last_unstale":"2023-11-28T20:07:43.610824+0000","last_undegraded":"2023-11-28T20:07:43.610824+0000","last_fullsized":"2023-11-28T20:07:43.610824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:16:03.993270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108961+0000","last_change":"2023-11-28T20:07:42.125245+0000","last_active":"2023-11-28T20:07:43.108961+0000","last_peered":"2023-11-28T20:07:43.108961+0000","last_clean":"2023-11-28T20:07:43.108961+0000","last_became_active":"2023-11-28T20:07:42.124182+0000","last_became_peered":"2023-11-28T20:07:42.124182+0000","last_unstale":"2023-11-28T20:07:43.108961+0000","last_undegraded":"2023-11-28T20:07:43.108961+0000","last_fullsized":"2023-11-28T20:07:43.108961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108178+0000","last_change":"2023-11-28T20:07:42.116843+0000","last_active":"2023-11-28T20:07:43.108178+0000","last_peered":"2023-11-28T20:07:43.108178+0000","last_clean":"2023-11-28T20:07:43.108178+0000","last_became_active":"2023-11-28T20:07:42.116310+0000","last_became_peered":"2023-11-28T20:07:42.116310+0000","last_unstale":"2023-11-28T20:07:43.108178+0000","last_undegraded":"2023-11-28T20:07:43.108178+0000","last_fullsized":"2023-11-28T20:07:43.108178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610034+0000","last_change":"2023-11-28T20:07:42.128042+0000","last_active":"2023-11-28T20:07:43.610034+0000","last_peered":"2023-11-28T20:07:43.610034+0000","last_clean":"2023-11-28T20:07:43.610034+0000","last_became_active":"2023-11-28T20:07:42.127792+0000","last_became_peered":"2023-11-28T20:07:42.127792+0000","last_unstale":"2023-11-28T20:07:43.610034+0000","last_undegraded":"2023-11-28T20:07:43.610034+0000","last_fullsized":"2023-11-28T20:07:43.610034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:21.201026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609510+0000","last_change":"2023-11-28T20:07:42.128904+0000","last_active":"2023-11-28T20:07:43.609510+0000","last_peered":"2023-11-28T20:07:43.609510+0000","last_clean":"2023-11-28T20:07:43.609510+0000","last_became_active":"2023-11-28T20:07:42.128610+0000","last_became_peered":"2023-11-28T20:07:42.128610+0000","last_unstale":"2023-11-28T20:07:43.609510+0000","last_undegraded":"2023-11-28T20:07:43.609510+0000","last_fullsized":"2023-11-28T20:07:43.609510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:21.201026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609733+0000","last_change":"2023-11-28T20:07:42.131901+0000","last_active":"2023-11-28T20:07:43.609733+0000","last_peered":"2023-11-28T20:07:43.609733+0000","last_clean":"2023-11-28T20:07:43.609733+0000","last_became_active":"2023-11-28T20:07:42.125991+0000","last_became_peered":"2023-11-28T20:07:42.125991+0000","last_unstale":"2023-11-28T20:07:43.609733+0000","last_undegraded":"2023-11-28T20:07:43.609733+0000","last_fullsized":"2023-11-28T20:07:43.609733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.608915+0000","last_change":"2023-11-28T20:07:42.125304+0000","last_active":"2023-11-28T20:07:43.608915+0000","last_peered":"2023-11-28T20:07:43.608915+0000","last_clean":"2023-11-28T20:07:43.608915+0000","last_became_active":"2023-11-28T20:07:42.124956+0000","last_became_peered":"2023-11-28T20:07:42.124956+0000","last_unstale":"2023-11-28T20:07:43.608915+0000","last_undegraded":"2023-11-28T20:07:43.608915+0000","last_fullsized":"2023-11-28T20:07:43.608915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:48.514241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108891+0000","last_change":"2023-11-28T20:07:42.112403+0000","last_active":"2023-11-28T20:07:43.108891+0000","last_peered":"2023-11-28T20:07:43.108891+0000","last_clean":"2023-11-28T20:07:43.108891+0000","last_became_active":"2023-11-28T20:07:42.112073+0000","last_became_peered":"2023-11-28T20:07:42.112073+0000","last_unstale":"2023-11-28T20:07:43.108891+0000","last_undegraded":"2023-11-28T20:07:43.108891+0000","last_fullsized":"2023-11-28T20:07:43.108891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610824+0000","last_change":"2023-11-28T20:07:42.137462+0000","last_active":"2023-11-28T20:07:43.610824+0000","last_peered":"2023-11-28T20:07:43.610824+0000","last_clean":"2023-11-28T20:07:43.610824+0000","last_became_active":"2023-11-28T20:07:42.137147+0000","last_became_peered":"2023-11-28T20:07:42.137147+0000","last_unstale":"2023-11-28T20:07:43.610824+0000","last_undegraded":"2023-11-28T20:07:43.610824+0000","last_fullsized":"2023-11-28T20:07:43.610824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:31.880338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124481+0000","last_change":"2023-11-28T20:07:42.137727+0000","last_active":"2023-11-28T20:07:43.124481+0000","last_peered":"2023-11-28T20:07:43.124481+0000","last_clean":"2023-11-28T20:07:43.124481+0000","last_became_active":"2023-11-28T20:07:42.137387+0000","last_became_peered":"2023-11-28T20:07:42.137387+0000","last_unstale":"2023-11-28T20:07:43.124481+0000","last_undegraded":"2023-11-28T20:07:43.124481+0000","last_fullsized":"2023-11-28T20:07:43.124481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124350+0000","last_change":"2023-11-28T20:07:42.129540+0000","last_active":"2023-11-28T20:07:43.124350+0000","last_peered":"2023-11-28T20:07:43.124350+0000","last_clean":"2023-11-28T20:07:43.124350+0000","last_became_active":"2023-11-28T20:07:42.129269+0000","last_became_peered":"2023-11-28T20:07:42.129269+0000","last_unstale":"2023-11-28T20:07:43.124350+0000","last_undegraded":"2023-11-28T20:07:43.124350+0000","last_fullsized":"2023-11-28T20:07:43.124350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609353+0000","last_change":"2023-11-28T20:07:42.118180+0000","last_active":"2023-11-28T20:07:43.609353+0000","last_peered":"2023-11-28T20:07:43.609353+0000","last_clean":"2023-11-28T20:07:43.609353+0000","last_became_active":"2023-11-28T20:07:42.117845+0000","last_became_peered":"2023-11-28T20:07:42.117845+0000","last_unstale":"2023-11-28T20:07:43.609353+0000","last_undegraded":"2023-11-28T20:07:43.609353+0000","last_fullsized":"2023-11-28T20:07:43.609353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:47.116523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108471+0000","last_change":"2023-11-28T20:07:42.118653+0000","last_active":"2023-11-28T20:07:43.108471+0000","last_peered":"2023-11-28T20:07:43.108471+0000","last_clean":"2023-11-28T20:07:43.108471+0000","last_became_active":"2023-11-28T20:07:42.118336+0000","last_became_peered":"2023-11-28T20:07:42.118336+0000","last_unstale":"2023-11-28T20:07:43.108471+0000","last_undegraded":"2023-11-28T20:07:43.108471+0000","last_fullsized":"2023-11-28T20:07:43.108471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:15.872240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107844+0000","last_change":"2023-11-28T20:07:42.121476+0000","last_active":"2023-11-28T20:07:43.107844+0000","last_peered":"2023-11-28T20:07:43.107844+0000","last_clean":"2023-11-28T20:07:43.107844+0000","last_became_active":"2023-11-28T20:07:42.121182+0000","last_became_peered":"2023-11-28T20:07:42.121182+0000","last_unstale":"2023-11-28T20:07:43.107844+0000","last_undegraded":"2023-11-28T20:07:43.107844+0000","last_fullsized":"2023-11-28T20:07:43.107844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:23.122677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108322+0000","last_change":"2023-11-28T20:07:42.126484+0000","last_active":"2023-11-28T20:07:43.108322+0000","last_peered":"2023-11-28T20:07:43.108322+0000","last_clean":"2023-11-28T20:07:43.108322+0000","last_became_active":"2023-11-28T20:07:42.126162+0000","last_became_peered":"2023-11-28T20:07:42.126162+0000","last_unstale":"2023-11-28T20:07:43.108322+0000","last_undegraded":"2023-11-28T20:07:43.108322+0000","last_fullsized":"2023-11-28T20:07:43.108322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609402+0000","last_change":"2023-11-28T20:07:42.129046+0000","last_active":"2023-11-28T20:07:43.609402+0000","last_peered":"2023-11-28T20:07:43.609402+0000","last_clean":"2023-11-28T20:07:43.609402+0000","last_became_active":"2023-11-28T20:07:42.125815+0000","last_became_peered":"2023-11-28T20:07:42.125815+0000","last_unstale":"2023-11-28T20:07:43.609402+0000","last_undegraded":"2023-11-28T20:07:43.609402+0000","last_fullsized":"2023-11-28T20:07:43.609402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610658+0000","last_change":"2023-11-28T20:07:42.134089+0000","last_active":"2023-11-28T20:07:43.610658+0000","last_peered":"2023-11-28T20:07:43.610658+0000","last_clean":"2023-11-28T20:07:43.610658+0000","last_became_active":"2023-11-28T20:07:42.133736+0000","last_became_peered":"2023-11-28T20:07:42.133736+0000","last_unstale":"2023-11-28T20:07:43.610658+0000","last_undegraded":"2023-11-28T20:07:43.610658+0000","last_fullsized":"2023-11-28T20:07:43.610658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:16:03.993270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.608519+0000","last_change":"2023-11-28T20:07:42.118484+0000","last_active":"2023-11-28T20:07:43.608519+0000","last_peered":"2023-11-28T20:07:43.608519+0000","last_clean":"2023-11-28T20:07:43.608519+0000","last_became_active":"2023-11-28T20:07:42.118184+0000","last_became_peered":"2023-11-28T20:07:42.118184+0000","last_unstale":"2023-11-28T20:07:43.608519+0000","last_undegraded":"2023-11-28T20:07:43.608519+0000","last_fullsized":"2023-11-28T20:07:43.608519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:09.986989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610141+0000","last_change":"2023-11-28T20:07:42.127821+0000","last_active":"2023-11-28T20:07:43.610141+0000","last_peered":"2023-11-28T20:07:43.610141+0000","last_clean":"2023-11-28T20:07:43.610141+0000","last_became_active":"2023-11-28T20:07:42.127530+0000","last_became_peered":"2023-11-28T20:07:42.127530+0000","last_unstale":"2023-11-28T20:07:43.610141+0000","last_undegraded":"2023-11-28T20:07:43.610141+0000","last_fullsized":"2023-11-28T20:07:43.610141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:42:04.486716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124333+0000","last_change":"2023-11-28T20:07:42.117709+0000","last_active":"2023-11-28T20:07:43.124333+0000","last_peered":"2023-11-28T20:07:43.124333+0000","last_clean":"2023-11-28T20:07:43.124333+0000","last_became_active":"2023-11-28T20:07:42.117344+0000","last_became_peered":"2023-11-28T20:07:42.117344+0000","last_unstale":"2023-11-28T20:07:43.124333+0000","last_undegraded":"2023-11-28T20:07:43.124333+0000","last_fullsized":"2023-11-28T20:07:43.124333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108064+0000","last_change":"2023-11-28T20:07:42.124921+0000","last_active":"2023-11-28T20:07:43.108064+0000","last_peered":"2023-11-28T20:07:43.108064+0000","last_clean":"2023-11-28T20:07:43.108064+0000","last_became_active":"2023-11-28T20:07:42.123003+0000","last_became_peered":"2023-11-28T20:07:42.123003+0000","last_unstale":"2023-11-28T20:07:43.108064+0000","last_undegraded":"2023-11-28T20:07:43.108064+0000","last_fullsized":"2023-11-28T20:07:43.108064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609819+0000","last_change":"2023-11-28T20:07:42.131215+0000","last_active":"2023-11-28T20:07:43.609819+0000","last_peered":"2023-11-28T20:07:43.609819+0000","last_clean":"2023-11-28T20:07:43.609819+0000","last_became_active":"2023-11-28T20:07:42.130873+0000","last_became_peered":"2023-11-28T20:07:42.130873+0000","last_unstale":"2023-11-28T20:07:43.609819+0000","last_undegraded":"2023-11-28T20:07:43.609819+0000","last_fullsized":"2023-11-28T20:07:43.609819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:48.514241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109188+0000","last_change":"2023-11-28T20:07:42.115955+0000","last_active":"2023-11-28T20:07:43.109188+0000","last_peered":"2023-11-28T20:07:43.109188+0000","last_clean":"2023-11-28T20:07:43.109188+0000","last_became_active":"2023-11-28T20:07:42.113021+0000","last_became_peered":"2023-11-28T20:07:42.113021+0000","last_unstale":"2023-11-28T20:07:43.109188+0000","last_undegraded":"2023-11-28T20:07:43.109188+0000","last_fullsized":"2023-11-28T20:07:43.109188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609630+0000","last_change":"2023-11-28T20:07:42.122012+0000","last_active":"2023-11-28T20:07:43.609630+0000","last_peered":"2023-11-28T20:07:43.609630+0000","last_clean":"2023-11-28T20:07:43.609630+0000","last_became_active":"2023-11-28T20:07:42.121735+0000","last_became_peered":"2023-11-28T20:07:42.121735+0000","last_unstale":"2023-11-28T20:07:43.609630+0000","last_undegraded":"2023-11-28T20:07:43.609630+0000","last_fullsized":"2023-11-28T20:07:43.609630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109731+0000","last_change":"2023-11-28T20:07:42.120931+0000","last_active":"2023-11-28T20:07:43.109731+0000","last_peered":"2023-11-28T20:07:43.109731+0000","last_clean":"2023-11-28T20:07:43.109731+0000","last_became_active":"2023-11-28T20:07:42.120627+0000","last_became_peered":"2023-11-28T20:07:42.120627+0000","last_unstale":"2023-11-28T20:07:43.109731+0000","last_undegraded":"2023-11-28T20:07:43.109731+0000","last_fullsized":"2023-11-28T20:07:43.109731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:21.947376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124556+0000","last_change":"2023-11-28T20:07:42.123201+0000","last_active":"2023-11-28T20:07:43.124556+0000","last_peered":"2023-11-28T20:07:43.124556+0000","last_clean":"2023-11-28T20:07:43.124556+0000","last_became_active":"2023-11-28T20:07:42.122875+0000","last_became_peered":"2023-11-28T20:07:42.122875+0000","last_unstale":"2023-11-28T20:07:43.124556+0000","last_undegraded":"2023-11-28T20:07:43.124556+0000","last_fullsized":"2023-11-28T20:07:43.124556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108521+0000","last_change":"2023-11-28T20:07:42.127975+0000","last_active":"2023-11-28T20:07:43.108521+0000","last_peered":"2023-11-28T20:07:43.108521+0000","last_clean":"2023-11-28T20:07:43.108521+0000","last_became_active":"2023-11-28T20:07:42.127673+0000","last_became_peered":"2023-11-28T20:07:42.127673+0000","last_unstale":"2023-11-28T20:07:43.108521+0000","last_undegraded":"2023-11-28T20:07:43.108521+0000","last_fullsized":"2023-11-28T20:07:43.108521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109700+0000","last_change":"2023-11-28T20:07:42.121532+0000","last_active":"2023-11-28T20:07:43.109700+0000","last_peered":"2023-11-28T20:07:43.109700+0000","last_clean":"2023-11-28T20:07:43.109700+0000","last_became_active":"2023-11-28T20:07:42.121244+0000","last_became_peered":"2023-11-28T20:07:42.121244+0000","last_unstale":"2023-11-28T20:07:43.109700+0000","last_undegraded":"2023-11-28T20:07:43.109700+0000","last_fullsized":"2023-11-28T20:07:43.109700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108193+0000","last_change":"2023-11-28T20:07:42.128684+0000","last_active":"2023-11-28T20:07:43.108193+0000","last_peered":"2023-11-28T20:07:43.108193+0000","last_clean":"2023-11-28T20:07:43.108193+0000","last_became_active":"2023-11-28T20:07:42.128383+0000","last_became_peered":"2023-11-28T20:07:42.128383+0000","last_unstale":"2023-11-28T20:07:43.108193+0000","last_undegraded":"2023-11-28T20:07:43.108193+0000","last_fullsized":"2023-11-28T20:07:43.108193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:15.660310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609916+0000","last_change":"2023-11-28T20:07:42.125543+0000","last_active":"2023-11-28T20:07:43.609916+0000","last_peered":"2023-11-28T20:07:43.609916+0000","last_clean":"2023-11-28T20:07:43.609916+0000","last_became_active":"2023-11-28T20:07:42.125249+0000","last_became_peered":"2023-11-28T20:07:42.125249+0000","last_unstale":"2023-11-28T20:07:43.609916+0000","last_undegraded":"2023-11-28T20:07:43.609916+0000","last_fullsized":"2023-11-28T20:07:43.609916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:21.947376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.608401+0000","last_change":"2023-11-28T20:07:42.134967+0000","last_active":"2023-11-28T20:07:43.608401+0000","last_peered":"2023-11-28T20:07:43.608401+0000","last_clean":"2023-11-28T20:07:43.608401+0000","last_became_active":"2023-11-28T20:07:42.134643+0000","last_became_peered":"2023-11-28T20:07:42.134643+0000","last_unstale":"2023-11-28T20:07:43.608401+0000","last_undegraded":"2023-11-28T20:07:43.608401+0000","last_fullsized":"2023-11-28T20:07:43.608401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:18.500544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124176+0000","last_change":"2023-11-28T20:07:42.128770+0000","last_active":"2023-11-28T20:07:43.124176+0000","last_peered":"2023-11-28T20:07:43.124176+0000","last_clean":"2023-11-28T20:07:43.124176+0000","last_became_active":"2023-11-28T20:07:42.128009+0000","last_became_peered":"2023-11-28T20:07:42.128009+0000","last_unstale":"2023-11-28T20:07:43.124176+0000","last_undegraded":"2023-11-28T20:07:43.124176+0000","last_fullsized":"2023-11-28T20:07:43.124176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.608817+0000","last_change":"2023-11-28T20:07:42.118468+0000","last_active":"2023-11-28T20:07:43.608817+0000","last_peered":"2023-11-28T20:07:43.608817+0000","last_clean":"2023-11-28T20:07:43.608817+0000","last_became_active":"2023-11-28T20:07:42.118171+0000","last_became_peered":"2023-11-28T20:07:42.118171+0000","last_unstale":"2023-11-28T20:07:43.608817+0000","last_undegraded":"2023-11-28T20:07:43.608817+0000","last_fullsized":"2023-11-28T20:07:43.608817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:01.763338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109448+0000","last_change":"2023-11-28T20:07:41.124073+0000","last_active":"2023-11-28T20:07:43.109448+0000","last_peered":"2023-11-28T20:07:43.109448+0000","last_clean":"2023-11-28T20:07:43.109448+0000","last_became_active":"2023-11-28T20:07:41.123753+0000","last_became_peered":"2023-11-28T20:07:41.123753+0000","last_unstale":"2023-11-28T20:07:43.109448+0000","last_undegraded":"2023-11-28T20:07:43.109448+0000","last_fullsized":"2023-11-28T20:07:43.109448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108309+0000","last_change":"2023-11-28T20:07:42.115734+0000","last_active":"2023-11-28T20:07:43.108309+0000","last_peered":"2023-11-28T20:07:43.108309+0000","last_clean":"2023-11-28T20:07:43.108309+0000","last_became_active":"2023-11-28T20:07:42.115363+0000","last_became_peered":"2023-11-28T20:07:42.115363+0000","last_unstale":"2023-11-28T20:07:43.108309+0000","last_undegraded":"2023-11-28T20:07:43.108309+0000","last_fullsized":"2023-11-28T20:07:43.108309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124235+0000","last_change":"2023-11-28T20:07:41.120709+0000","last_active":"2023-11-28T20:07:43.124235+0000","last_peered":"2023-11-28T20:07:43.124235+0000","last_clean":"2023-11-28T20:07:43.124235+0000","last_became_active":"2023-11-28T20:07:41.120386+0000","last_became_peered":"2023-11-28T20:07:41.120386+0000","last_unstale":"2023-11-28T20:07:43.124235+0000","last_undegraded":"2023-11-28T20:07:43.124235+0000","last_fullsized":"2023-11-28T20:07:43.124235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109227+0000","last_change":"2023-11-28T20:07:41.122847+0000","last_active":"2023-11-28T20:07:43.109227+0000","last_peered":"2023-11-28T20:07:43.109227+0000","last_clean":"2023-11-28T20:07:43.109227+0000","last_became_active":"2023-11-28T20:07:41.122369+0000","last_became_peered":"2023-11-28T20:07:41.122369+0000","last_unstale":"2023-11-28T20:07:43.109227+0000","last_undegraded":"2023-11-28T20:07:43.109227+0000","last_fullsized":"2023-11-28T20:07:43.109227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108986+0000","last_change":"2023-11-28T20:07:42.126772+0000","last_active":"2023-11-28T20:07:43.108986+0000","last_peered":"2023-11-28T20:07:43.108986+0000","last_clean":"2023-11-28T20:07:43.108986+0000","last_became_active":"2023-11-28T20:07:42.126502+0000","last_became_peered":"2023-11-28T20:07:42.126502+0000","last_unstale":"2023-11-28T20:07:43.108986+0000","last_undegraded":"2023-11-28T20:07:43.108986+0000","last_fullsized":"2023-11-28T20:07:43.108986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.445554+0000","last_change":"2023-11-28T20:07:41.126627+0000","last_active":"2023-11-28T20:07:43.445554+0000","last_peered":"2023-11-28T20:07:43.445554+0000","last_clean":"2023-11-28T20:07:43.445554+0000","last_became_active":"2023-11-28T20:07:41.126337+0000","last_became_peered":"2023-11-28T20:07:41.126337+0000","last_unstale":"2023-11-28T20:07:43.445554+0000","last_undegraded":"2023-11-28T20:07:43.445554+0000","last_fullsized":"2023-11-28T20:07:43.445554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:20.140866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108155+0000","last_change":"2023-11-28T20:07:42.126728+0000","last_active":"2023-11-28T20:07:43.108155+0000","last_peered":"2023-11-28T20:07:43.108155+0000","last_clean":"2023-11-28T20:07:43.108155+0000","last_became_active":"2023-11-28T20:07:42.125306+0000","last_became_peered":"2023-11-28T20:07:42.125306+0000","last_unstale":"2023-11-28T20:07:43.108155+0000","last_undegraded":"2023-11-28T20:07:43.108155+0000","last_fullsized":"2023-11-28T20:07:43.108155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124525+0000","last_change":"2023-11-28T20:07:41.134083+0000","last_active":"2023-11-28T20:07:43.124525+0000","last_peered":"2023-11-28T20:07:43.124525+0000","last_clean":"2023-11-28T20:07:43.124525+0000","last_became_active":"2023-11-28T20:07:41.130145+0000","last_became_peered":"2023-11-28T20:07:41.130145+0000","last_unstale":"2023-11-28T20:07:43.124525+0000","last_undegraded":"2023-11-28T20:07:43.124525+0000","last_fullsized":"2023-11-28T20:07:43.124525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610436+0000","last_change":"2023-11-28T20:07:42.136612+0000","last_active":"2023-11-28T20:07:43.610436+0000","last_peered":"2023-11-28T20:07:43.610436+0000","last_clean":"2023-11-28T20:07:43.610436+0000","last_became_active":"2023-11-28T20:07:42.134753+0000","last_became_peered":"2023-11-28T20:07:42.134753+0000","last_unstale":"2023-11-28T20:07:43.610436+0000","last_undegraded":"2023-11-28T20:07:43.610436+0000","last_fullsized":"2023-11-28T20:07:43.610436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:32.485554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.445825+0000","last_change":"2023-11-28T20:07:41.134996+0000","last_active":"2023-11-28T20:07:43.445825+0000","last_peered":"2023-11-28T20:07:43.445825+0000","last_clean":"2023-11-28T20:07:43.445825+0000","last_became_active":"2023-11-28T20:07:41.134337+0000","last_became_peered":"2023-11-28T20:07:41.134337+0000","last_unstale":"2023-11-28T20:07:43.445825+0000","last_undegraded":"2023-11-28T20:07:43.445825+0000","last_fullsized":"2023-11-28T20:07:43.445825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:27.669172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108614+0000","last_change":"2023-11-28T20:07:42.135162+0000","last_active":"2023-11-28T20:07:43.108614+0000","last_peered":"2023-11-28T20:07:43.108614+0000","last_clean":"2023-11-28T20:07:43.108614+0000","last_became_active":"2023-11-28T20:07:42.134808+0000","last_became_peered":"2023-11-28T20:07:42.134808+0000","last_unstale":"2023-11-28T20:07:43.108614+0000","last_undegraded":"2023-11-28T20:07:43.108614+0000","last_fullsized":"2023-11-28T20:07:43.108614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:48.514241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108605+0000","last_change":"2023-11-28T20:07:41.130473+0000","last_active":"2023-11-28T20:07:43.108605+0000","last_peered":"2023-11-28T20:07:43.108605+0000","last_clean":"2023-11-28T20:07:43.108605+0000","last_became_active":"2023-11-28T20:07:41.130187+0000","last_became_peered":"2023-11-28T20:07:41.130187+0000","last_unstale":"2023-11-28T20:07:43.108605+0000","last_undegraded":"2023-11-28T20:07:43.108605+0000","last_fullsized":"2023-11-28T20:07:43.108605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:14.865470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609368+0000","last_change":"2023-11-28T20:07:42.125322+0000","last_active":"2023-11-28T20:07:43.609368+0000","last_peered":"2023-11-28T20:07:43.609368+0000","last_clean":"2023-11-28T20:07:43.609368+0000","last_became_active":"2023-11-28T20:07:42.125046+0000","last_became_peered":"2023-11-28T20:07:42.125046+0000","last_unstale":"2023-11-28T20:07:43.609368+0000","last_undegraded":"2023-11-28T20:07:43.609368+0000","last_fullsized":"2023-11-28T20:07:43.609368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:15:26.123496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124339+0000","last_change":"2023-11-28T20:07:41.124966+0000","last_active":"2023-11-28T20:07:43.124339+0000","last_peered":"2023-11-28T20:07:43.124339+0000","last_clean":"2023-11-28T20:07:43.124339+0000","last_became_active":"2023-11-28T20:07:41.124663+0000","last_became_peered":"2023-11-28T20:07:41.124663+0000","last_unstale":"2023-11-28T20:07:43.124339+0000","last_undegraded":"2023-11-28T20:07:43.124339+0000","last_fullsized":"2023-11-28T20:07:43.124339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609890+0000","last_change":"2023-11-28T20:07:42.130688+0000","last_active":"2023-11-28T20:07:43.609890+0000","last_peered":"2023-11-28T20:07:43.609890+0000","last_clean":"2023-11-28T20:07:43.609890+0000","last_became_active":"2023-11-28T20:07:42.130327+0000","last_became_peered":"2023-11-28T20:07:42.130327+0000","last_unstale":"2023-11-28T20:07:43.609890+0000","last_undegraded":"2023-11-28T20:07:43.609890+0000","last_fullsized":"2023-11-28T20:07:43.609890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:14.826246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108743+0000","last_change":"2023-11-28T20:07:41.125301+0000","last_active":"2023-11-28T20:07:43.108743+0000","last_peered":"2023-11-28T20:07:43.108743+0000","last_clean":"2023-11-28T20:07:43.108743+0000","last_became_active":"2023-11-28T20:07:41.123720+0000","last_became_peered":"2023-11-28T20:07:41.123720+0000","last_unstale":"2023-11-28T20:07:43.108743+0000","last_undegraded":"2023-11-28T20:07:43.108743+0000","last_fullsized":"2023-11-28T20:07:43.108743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107964+0000","last_change":"2023-11-28T20:07:42.130256+0000","last_active":"2023-11-28T20:07:43.107964+0000","last_peered":"2023-11-28T20:07:43.107964+0000","last_clean":"2023-11-28T20:07:43.107964+0000","last_became_active":"2023-11-28T20:07:42.129938+0000","last_became_peered":"2023-11-28T20:07:42.129938+0000","last_unstale":"2023-11-28T20:07:43.107964+0000","last_undegraded":"2023-11-28T20:07:43.107964+0000","last_fullsized":"2023-11-28T20:07:43.107964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.445650+0000","last_change":"2023-11-28T20:07:41.127173+0000","last_active":"2023-11-28T20:07:43.445650+0000","last_peered":"2023-11-28T20:07:43.445650+0000","last_clean":"2023-11-28T20:07:43.445650+0000","last_became_active":"2023-11-28T20:07:41.126888+0000","last_became_peered":"2023-11-28T20:07:41.126888+0000","last_unstale":"2023-11-28T20:07:43.445650+0000","last_undegraded":"2023-11-28T20:07:43.445650+0000","last_fullsized":"2023-11-28T20:07:43.445650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:22.115906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609634+0000","last_change":"2023-11-28T20:07:42.133429+0000","last_active":"2023-11-28T20:07:43.609634+0000","last_peered":"2023-11-28T20:07:43.609634+0000","last_clean":"2023-11-28T20:07:43.609634+0000","last_became_active":"2023-11-28T20:07:42.132944+0000","last_became_peered":"2023-11-28T20:07:42.132944+0000","last_unstale":"2023-11-28T20:07:43.609634+0000","last_undegraded":"2023-11-28T20:07:43.609634+0000","last_fullsized":"2023-11-28T20:07:43.609634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:53:17.842156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124121+0000","last_change":"2023-11-28T20:07:41.127166+0000","last_active":"2023-11-28T20:07:43.124121+0000","last_peered":"2023-11-28T20:07:43.124121+0000","last_clean":"2023-11-28T20:07:43.124121+0000","last_became_active":"2023-11-28T20:07:41.122806+0000","last_became_peered":"2023-11-28T20:07:41.122806+0000","last_unstale":"2023-11-28T20:07:43.124121+0000","last_undegraded":"2023-11-28T20:07:43.124121+0000","last_fullsized":"2023-11-28T20:07:43.124121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124201+0000","last_change":"2023-11-28T20:07:42.129018+0000","last_active":"2023-11-28T20:07:43.124201+0000","last_peered":"2023-11-28T20:07:43.124201+0000","last_clean":"2023-11-28T20:07:43.124201+0000","last_became_active":"2023-11-28T20:07:42.128392+0000","last_became_peered":"2023-11-28T20:07:42.128392+0000","last_unstale":"2023-11-28T20:07:43.124201+0000","last_undegraded":"2023-11-28T20:07:43.124201+0000","last_fullsized":"2023-11-28T20:07:43.124201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.451831+0000","last_change":"2023-11-28T20:07:41.113833+0000","last_active":"2023-11-28T20:07:43.451831+0000","last_peered":"2023-11-28T20:07:43.451831+0000","last_clean":"2023-11-28T20:07:43.451831+0000","last_became_active":"2023-11-28T20:07:41.113488+0000","last_became_peered":"2023-11-28T20:07:41.113488+0000","last_unstale":"2023-11-28T20:07:43.451831+0000","last_undegraded":"2023-11-28T20:07:43.451831+0000","last_fullsized":"2023-11-28T20:07:43.451831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:00.756568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.608997+0000","last_change":"2023-11-28T20:07:42.135006+0000","last_active":"2023-11-28T20:07:43.608997+0000","last_peered":"2023-11-28T20:07:43.608997+0000","last_clean":"2023-11-28T20:07:43.608997+0000","last_became_active":"2023-11-28T20:07:42.134503+0000","last_became_peered":"2023-11-28T20:07:42.134503+0000","last_unstale":"2023-11-28T20:07:43.608997+0000","last_undegraded":"2023-11-28T20:07:43.608997+0000","last_fullsized":"2023-11-28T20:07:43.608997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:21.947376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.445584+0000","last_change":"2023-11-28T20:07:41.118939+0000","last_active":"2023-11-28T20:07:43.445584+0000","last_peered":"2023-11-28T20:07:43.445584+0000","last_clean":"2023-11-28T20:07:43.445584+0000","last_became_active":"2023-11-28T20:07:41.117672+0000","last_became_peered":"2023-11-28T20:07:41.117672+0000","last_unstale":"2023-11-28T20:07:43.445584+0000","last_undegraded":"2023-11-28T20:07:43.445584+0000","last_fullsized":"2023-11-28T20:07:43.445584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:39.280352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610513+0000","last_change":"2023-11-28T20:07:42.130339+0000","last_active":"2023-11-28T20:07:43.610513+0000","last_peered":"2023-11-28T20:07:43.610513+0000","last_clean":"2023-11-28T20:07:43.610513+0000","last_became_active":"2023-11-28T20:07:42.129788+0000","last_became_peered":"2023-11-28T20:07:42.129788+0000","last_unstale":"2023-11-28T20:07:43.610513+0000","last_undegraded":"2023-11-28T20:07:43.610513+0000","last_fullsized":"2023-11-28T20:07:43.610513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:32.485554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.451918+0000","last_change":"2023-11-28T20:07:41.114418+0000","last_active":"2023-11-28T20:07:43.451918+0000","last_peered":"2023-11-28T20:07:43.451918+0000","last_clean":"2023-11-28T20:07:43.451918+0000","last_became_active":"2023-11-28T20:07:41.114147+0000","last_became_peered":"2023-11-28T20:07:41.114147+0000","last_unstale":"2023-11-28T20:07:43.451918+0000","last_undegraded":"2023-11-28T20:07:43.451918+0000","last_fullsized":"2023-11-28T20:07:43.451918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:20.140866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610948+0000","last_change":"2023-11-28T20:07:42.133323+0000","last_active":"2023-11-28T20:07:43.610948+0000","last_peered":"2023-11-28T20:07:43.610948+0000","last_clean":"2023-11-28T20:07:43.610948+0000","last_became_active":"2023-11-28T20:07:42.132957+0000","last_became_peered":"2023-11-28T20:07:42.132957+0000","last_unstale":"2023-11-28T20:07:43.610948+0000","last_undegraded":"2023-11-28T20:07:43.610948+0000","last_fullsized":"2023-11-28T20:07:43.610948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:18.557987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108689+0000","last_change":"2023-11-28T20:07:41.123577+0000","last_active":"2023-11-28T20:07:43.108689+0000","last_peered":"2023-11-28T20:07:43.108689+0000","last_clean":"2023-11-28T20:07:43.108689+0000","last_became_active":"2023-11-28T20:07:41.123238+0000","last_became_peered":"2023-11-28T20:07:41.123238+0000","last_unstale":"2023-11-28T20:07:43.108689+0000","last_undegraded":"2023-11-28T20:07:43.108689+0000","last_fullsized":"2023-11-28T20:07:43.108689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:22.115906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610238+0000","last_change":"2023-11-28T20:07:42.123412+0000","last_active":"2023-11-28T20:07:43.610238+0000","last_peered":"2023-11-28T20:07:43.610238+0000","last_clean":"2023-11-28T20:07:43.610238+0000","last_became_active":"2023-11-28T20:07:42.123097+0000","last_became_peered":"2023-11-28T20:07:42.123097+0000","last_unstale":"2023-11-28T20:07:43.610238+0000","last_undegraded":"2023-11-28T20:07:43.610238+0000","last_fullsized":"2023-11-28T20:07:43.610238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:53:17.842156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.451883+0000","last_change":"2023-11-28T20:07:41.128647+0000","last_active":"2023-11-28T20:07:43.451883+0000","last_peered":"2023-11-28T20:07:43.451883+0000","last_clean":"2023-11-28T20:07:43.451883+0000","last_became_active":"2023-11-28T20:07:41.128419+0000","last_became_peered":"2023-11-28T20:07:41.128419+0000","last_unstale":"2023-11-28T20:07:43.451883+0000","last_undegraded":"2023-11-28T20:07:43.451883+0000","last_fullsized":"2023-11-28T20:07:43.451883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:46.109752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610010+0000","last_change":"2023-11-28T20:07:42.134474+0000","last_active":"2023-11-28T20:07:43.610010+0000","last_peered":"2023-11-28T20:07:43.610010+0000","last_clean":"2023-11-28T20:07:43.610010+0000","last_became_active":"2023-11-28T20:07:42.134196+0000","last_became_peered":"2023-11-28T20:07:42.134196+0000","last_unstale":"2023-11-28T20:07:43.610010+0000","last_undegraded":"2023-11-28T20:07:43.610010+0000","last_fullsized":"2023-11-28T20:07:43.610010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:19:47.371816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:42.117857+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:07:42.117857+0000","last_peered":"2023-11-28T20:07:42.117857+0000","last_clean":"2023-11-28T20:07:42.117857+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:07:42.117857+0000","last_undegraded":"2023-11-28T20:07:42.117857+0000","last_fullsized":"2023-11-28T20:07:42.117857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.445686+0000","last_change":"2023-11-28T20:07:41.125548+0000","last_active":"2023-11-28T20:07:43.445686+0000","last_peered":"2023-11-28T20:07:43.445686+0000","last_clean":"2023-11-28T20:07:43.445686+0000","last_became_active":"2023-11-28T20:07:41.124741+0000","last_became_peered":"2023-11-28T20:07:41.124741+0000","last_unstale":"2023-11-28T20:07:43.445686+0000","last_undegraded":"2023-11-28T20:07:43.445686+0000","last_fullsized":"2023-11-28T20:07:43.445686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:33.969503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108686+0000","last_change":"2023-11-28T20:07:42.120751+0000","last_active":"2023-11-28T20:07:43.108686+0000","last_peered":"2023-11-28T20:07:43.108686+0000","last_clean":"2023-11-28T20:07:43.108686+0000","last_became_active":"2023-11-28T20:07:42.120442+0000","last_became_peered":"2023-11-28T20:07:42.120442+0000","last_unstale":"2023-11-28T20:07:43.108686+0000","last_undegraded":"2023-11-28T20:07:43.108686+0000","last_fullsized":"2023-11-28T20:07:43.108686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:23.122677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.449821+0000","last_change":"2023-11-28T20:07:41.123778+0000","last_active":"2023-11-28T20:07:43.449821+0000","last_peered":"2023-11-28T20:07:43.449821+0000","last_clean":"2023-11-28T20:07:43.449821+0000","last_became_active":"2023-11-28T20:07:41.122816+0000","last_became_peered":"2023-11-28T20:07:41.122816+0000","last_unstale":"2023-11-28T20:07:43.449821+0000","last_undegraded":"2023-11-28T20:07:43.449821+0000","last_fullsized":"2023-11-28T20:07:43.449821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:14.653540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107769+0000","last_change":"2023-11-28T20:07:42.107177+0000","last_active":"2023-11-28T20:07:43.107769+0000","last_peered":"2023-11-28T20:07:43.107769+0000","last_clean":"2023-11-28T20:07:43.107769+0000","last_became_active":"2023-11-28T20:07:42.106858+0000","last_became_peered":"2023-11-28T20:07:42.106858+0000","last_unstale":"2023-11-28T20:07:43.107769+0000","last_undegraded":"2023-11-28T20:07:43.107769+0000","last_fullsized":"2023-11-28T20:07:43.107769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:15.872240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.451855+0000","last_change":"2023-11-28T20:07:41.114571+0000","last_active":"2023-11-28T20:07:43.451855+0000","last_peered":"2023-11-28T20:07:43.451855+0000","last_clean":"2023-11-28T20:07:43.451855+0000","last_became_active":"2023-11-28T20:07:41.114262+0000","last_became_peered":"2023-11-28T20:07:41.114262+0000","last_unstale":"2023-11-28T20:07:43.451855+0000","last_undegraded":"2023-11-28T20:07:43.451855+0000","last_fullsized":"2023-11-28T20:07:43.451855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:10.975521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107548+0000","last_change":"2023-11-28T20:07:42.120451+0000","last_active":"2023-11-28T20:07:43.107548+0000","last_peered":"2023-11-28T20:07:43.107548+0000","last_clean":"2023-11-28T20:07:43.107548+0000","last_became_active":"2023-11-28T20:07:42.120142+0000","last_became_peered":"2023-11-28T20:07:42.120142+0000","last_unstale":"2023-11-28T20:07:43.107548+0000","last_undegraded":"2023-11-28T20:07:43.107548+0000","last_fullsized":"2023-11-28T20:07:43.107548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:08.039936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.445669+0000","last_change":"2023-11-28T20:07:41.127173+0000","last_active":"2023-11-28T20:07:43.445669+0000","last_peered":"2023-11-28T20:07:43.445669+0000","last_clean":"2023-11-28T20:07:43.445669+0000","last_became_active":"2023-11-28T20:07:41.126918+0000","last_became_peered":"2023-11-28T20:07:41.126918+0000","last_unstale":"2023-11-28T20:07:43.445669+0000","last_undegraded":"2023-11-28T20:07:43.445669+0000","last_fullsized":"2023-11-28T20:07:43.445669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:07.033166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609193+0000","last_change":"2023-11-28T20:07:42.116610+0000","last_active":"2023-11-28T20:07:43.609193+0000","last_peered":"2023-11-28T20:07:43.609193+0000","last_clean":"2023-11-28T20:07:43.609193+0000","last_became_active":"2023-11-28T20:07:42.116325+0000","last_became_peered":"2023-11-28T20:07:42.116325+0000","last_unstale":"2023-11-28T20:07:43.609193+0000","last_undegraded":"2023-11-28T20:07:43.609193+0000","last_fullsized":"2023-11-28T20:07:43.609193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:21.147636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108792+0000","last_change":"2023-11-28T20:07:41.122092+0000","last_active":"2023-11-28T20:07:43.108792+0000","last_peered":"2023-11-28T20:07:43.108792+0000","last_clean":"2023-11-28T20:07:43.108792+0000","last_became_active":"2023-11-28T20:07:41.121742+0000","last_became_peered":"2023-11-28T20:07:41.121742+0000","last_unstale":"2023-11-28T20:07:43.108792+0000","last_undegraded":"2023-11-28T20:07:43.108792+0000","last_fullsized":"2023-11-28T20:07:43.108792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610402+0000","last_change":"2023-11-28T20:07:42.127953+0000","last_active":"2023-11-28T20:07:43.610402+0000","last_peered":"2023-11-28T20:07:43.610402+0000","last_clean":"2023-11-28T20:07:43.610402+0000","last_became_active":"2023-11-28T20:07:42.127517+0000","last_became_peered":"2023-11-28T20:07:42.127517+0000","last_unstale":"2023-11-28T20:07:43.610402+0000","last_undegraded":"2023-11-28T20:07:43.610402+0000","last_fullsized":"2023-11-28T20:07:43.610402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:19:47.371816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.450025+0000","last_change":"2023-11-28T20:07:41.121831+0000","last_active":"2023-11-28T20:07:43.450025+0000","last_peered":"2023-11-28T20:07:43.450025+0000","last_clean":"2023-11-28T20:07:43.450025+0000","last_became_active":"2023-11-28T20:07:41.121524+0000","last_became_peered":"2023-11-28T20:07:41.121524+0000","last_unstale":"2023-11-28T20:07:43.450025+0000","last_undegraded":"2023-11-28T20:07:43.450025+0000","last_fullsized":"2023-11-28T20:07:43.450025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.107980+0000","last_change":"2023-11-28T20:07:42.115989+0000","last_active":"2023-11-28T20:07:43.107980+0000","last_peered":"2023-11-28T20:07:43.107980+0000","last_clean":"2023-11-28T20:07:43.107980+0000","last_became_active":"2023-11-28T20:07:42.114912+0000","last_became_peered":"2023-11-28T20:07:42.114912+0000","last_unstale":"2023-11-28T20:07:43.107980+0000","last_undegraded":"2023-11-28T20:07:43.107980+0000","last_fullsized":"2023-11-28T20:07:43.107980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:34.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.449935+0000","last_change":"2023-11-28T20:07:41.125968+0000","last_active":"2023-11-28T20:07:43.449935+0000","last_peered":"2023-11-28T20:07:43.449935+0000","last_clean":"2023-11-28T20:07:43.449935+0000","last_became_active":"2023-11-28T20:07:41.125651+0000","last_became_peered":"2023-11-28T20:07:41.125651+0000","last_unstale":"2023-11-28T20:07:43.449935+0000","last_undegraded":"2023-11-28T20:07:43.449935+0000","last_fullsized":"2023-11-28T20:07:43.449935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109706+0000","last_change":"2023-11-28T20:07:42.125891+0000","last_active":"2023-11-28T20:07:43.109706+0000","last_peered":"2023-11-28T20:07:43.109706+0000","last_clean":"2023-11-28T20:07:43.109706+0000","last_became_active":"2023-11-28T20:07:42.123728+0000","last_became_peered":"2023-11-28T20:07:42.123728+0000","last_unstale":"2023-11-28T20:07:43.109706+0000","last_undegraded":"2023-11-28T20:07:43.109706+0000","last_fullsized":"2023-11-28T20:07:43.109706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:48.514241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124593+0000","last_change":"2023-11-28T20:07:41.133929+0000","last_active":"2023-11-28T20:07:43.124593+0000","last_peered":"2023-11-28T20:07:43.124593+0000","last_clean":"2023-11-28T20:07:43.124593+0000","last_became_active":"2023-11-28T20:07:41.129799+0000","last_became_peered":"2023-11-28T20:07:41.129799+0000","last_unstale":"2023-11-28T20:07:43.124593+0000","last_undegraded":"2023-11-28T20:07:43.124593+0000","last_fullsized":"2023-11-28T20:07:43.124593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:14.865470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108570+0000","last_change":"2023-11-28T20:07:42.122167+0000","last_active":"2023-11-28T20:07:43.108570+0000","last_peered":"2023-11-28T20:07:43.108570+0000","last_clean":"2023-11-28T20:07:43.108570+0000","last_became_active":"2023-11-28T20:07:42.120118+0000","last_became_peered":"2023-11-28T20:07:42.120118+0000","last_unstale":"2023-11-28T20:07:43.108570+0000","last_undegraded":"2023-11-28T20:07:43.108570+0000","last_fullsized":"2023-11-28T20:07:43.108570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:47.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.449796+0000","last_change":"2023-11-28T20:07:41.125281+0000","last_active":"2023-11-28T20:07:43.449796+0000","last_peered":"2023-11-28T20:07:43.449796+0000","last_clean":"2023-11-28T20:07:43.449796+0000","last_became_active":"2023-11-28T20:07:41.124978+0000","last_became_peered":"2023-11-28T20:07:41.124978+0000","last_unstale":"2023-11-28T20:07:43.449796+0000","last_undegraded":"2023-11-28T20:07:43.449796+0000","last_fullsized":"2023-11-28T20:07:43.449796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:27.669172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.609037+0000","last_change":"2023-11-28T20:07:42.115882+0000","last_active":"2023-11-28T20:07:43.609037+0000","last_peered":"2023-11-28T20:07:43.609037+0000","last_clean":"2023-11-28T20:07:43.609037+0000","last_became_active":"2023-11-28T20:07:42.114781+0000","last_became_peered":"2023-11-28T20:07:42.114781+0000","last_unstale":"2023-11-28T20:07:43.609037+0000","last_undegraded":"2023-11-28T20:07:43.609037+0000","last_fullsized":"2023-11-28T20:07:43.609037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:11.982291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108238+0000","last_change":"2023-11-28T20:07:41.121428+0000","last_active":"2023-11-28T20:07:43.108238+0000","last_peered":"2023-11-28T20:07:43.108238+0000","last_clean":"2023-11-28T20:07:43.108238+0000","last_became_active":"2023-11-28T20:07:41.121074+0000","last_became_peered":"2023-11-28T20:07:41.121074+0000","last_unstale":"2023-11-28T20:07:43.108238+0000","last_undegraded":"2023-11-28T20:07:43.108238+0000","last_fullsized":"2023-11-28T20:07:43.108238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109046+0000","last_change":"2023-11-28T20:07:42.122531+0000","last_active":"2023-11-28T20:07:43.109046+0000","last_peered":"2023-11-28T20:07:43.109046+0000","last_clean":"2023-11-28T20:07:43.109046+0000","last_became_active":"2023-11-28T20:07:42.122224+0000","last_became_peered":"2023-11-28T20:07:42.122224+0000","last_unstale":"2023-11-28T20:07:43.109046+0000","last_undegraded":"2023-11-28T20:07:43.109046+0000","last_fullsized":"2023-11-28T20:07:43.109046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108278+0000","last_change":"2023-11-28T20:07:41.118482+0000","last_active":"2023-11-28T20:07:43.108278+0000","last_peered":"2023-11-28T20:07:43.108278+0000","last_clean":"2023-11-28T20:07:43.108278+0000","last_became_active":"2023-11-28T20:07:41.117962+0000","last_became_peered":"2023-11-28T20:07:41.117962+0000","last_unstale":"2023-11-28T20:07:43.108278+0000","last_undegraded":"2023-11-28T20:07:43.108278+0000","last_fullsized":"2023-11-28T20:07:43.108278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:01:08.980219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109519+0000","last_change":"2023-11-28T20:07:42.123985+0000","last_active":"2023-11-28T20:07:43.109519+0000","last_peered":"2023-11-28T20:07:43.109519+0000","last_clean":"2023-11-28T20:07:43.109519+0000","last_became_active":"2023-11-28T20:07:42.122314+0000","last_became_peered":"2023-11-28T20:07:42.122314+0000","last_unstale":"2023-11-28T20:07:43.109519+0000","last_undegraded":"2023-11-28T20:07:43.109519+0000","last_fullsized":"2023-11-28T20:07:43.109519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:59.380843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.449950+0000","last_change":"2023-11-28T20:07:41.127916+0000","last_active":"2023-11-28T20:07:43.449950+0000","last_peered":"2023-11-28T20:07:43.449950+0000","last_clean":"2023-11-28T20:07:43.449950+0000","last_became_active":"2023-11-28T20:07:41.125354+0000","last_became_peered":"2023-11-28T20:07:41.125354+0000","last_unstale":"2023-11-28T20:07:43.449950+0000","last_undegraded":"2023-11-28T20:07:43.449950+0000","last_fullsized":"2023-11-28T20:07:43.449950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:33.969503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.124333+0000","last_change":"2023-11-28T20:07:42.123629+0000","last_active":"2023-11-28T20:07:43.124333+0000","last_peered":"2023-11-28T20:07:43.124333+0000","last_clean":"2023-11-28T20:07:43.124333+0000","last_became_active":"2023-11-28T20:07:42.123350+0000","last_became_peered":"2023-11-28T20:07:42.123350+0000","last_unstale":"2023-11-28T20:07:43.124333+0000","last_undegraded":"2023-11-28T20:07:43.124333+0000","last_fullsized":"2023-11-28T20:07:43.124333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:28.675943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610425+0000","last_change":"2023-11-28T20:07:42.127778+0000","last_active":"2023-11-28T20:07:43.610425+0000","last_peered":"2023-11-28T20:07:43.610425+0000","last_clean":"2023-11-28T20:07:43.610425+0000","last_became_active":"2023-11-28T20:07:42.127127+0000","last_became_peered":"2023-11-28T20:07:42.127127+0000","last_unstale":"2023-11-28T20:07:43.610425+0000","last_undegraded":"2023-11-28T20:07:43.610425+0000","last_fullsized":"2023-11-28T20:07:43.610425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:42:04.486716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.449961+0000","last_change":"2023-11-28T20:07:41.132264+0000","last_active":"2023-11-28T20:07:43.449961+0000","last_peered":"2023-11-28T20:07:43.449961+0000","last_clean":"2023-11-28T20:07:43.449961+0000","last_became_active":"2023-11-28T20:07:41.131858+0000","last_became_peered":"2023-11-28T20:07:41.131858+0000","last_unstale":"2023-11-28T20:07:43.449961+0000","last_undegraded":"2023-11-28T20:07:43.449961+0000","last_fullsized":"2023-11-28T20:07:43.449961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:25.387877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.610243+0000","last_change":"2023-11-28T20:07:42.125457+0000","last_active":"2023-11-28T20:07:43.610243+0000","last_peered":"2023-11-28T20:07:43.610243+0000","last_clean":"2023-11-28T20:07:43.610243+0000","last_became_active":"2023-11-28T20:07:42.125082+0000","last_became_peered":"2023-11-28T20:07:42.125082+0000","last_unstale":"2023-11-28T20:07:43.610243+0000","last_undegraded":"2023-11-28T20:07:43.610243+0000","last_fullsized":"2023-11-28T20:07:43.610243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:14.826246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.450005+0000","last_change":"2023-11-28T20:07:41.126423+0000","last_active":"2023-11-28T20:07:43.450005+0000","last_peered":"2023-11-28T20:07:43.450005+0000","last_clean":"2023-11-28T20:07:43.450005+0000","last_became_active":"2023-11-28T20:07:41.126053+0000","last_became_peered":"2023-11-28T20:07:41.126053+0000","last_unstale":"2023-11-28T20:07:43.450005+0000","last_undegraded":"2023-11-28T20:07:43.450005+0000","last_fullsized":"2023-11-28T20:07:43.450005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:17.493774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108551+0000","last_change":"2023-11-28T20:07:42.137656+0000","last_active":"2023-11-28T20:07:43.108551+0000","last_peered":"2023-11-28T20:07:43.108551+0000","last_clean":"2023-11-28T20:07:43.108551+0000","last_became_active":"2023-11-28T20:07:42.137370+0000","last_became_peered":"2023-11-28T20:07:42.137370+0000","last_unstale":"2023-11-28T20:07:43.108551+0000","last_undegraded":"2023-11-28T20:07:43.108551+0000","last_fullsized":"2023-11-28T20:07:43.108551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109645+0000","last_change":"2023-11-28T20:07:41.120883+0000","last_active":"2023-11-28T20:07:43.109645+0000","last_peered":"2023-11-28T20:07:43.109645+0000","last_clean":"2023-11-28T20:07:43.109645+0000","last_became_active":"2023-11-28T20:07:41.120623+0000","last_became_peered":"2023-11-28T20:07:41.120623+0000","last_unstale":"2023-11-28T20:07:43.109645+0000","last_undegraded":"2023-11-28T20:07:43.109645+0000","last_fullsized":"2023-11-28T20:07:43.109645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.109672+0000","last_change":"2023-11-28T20:07:42.120123+0000","last_active":"2023-11-28T20:07:43.109672+0000","last_peered":"2023-11-28T20:07:43.109672+0000","last_clean":"2023-11-28T20:07:43.109672+0000","last_became_active":"2023-11-28T20:07:42.119516+0000","last_became_peered":"2023-11-28T20:07:42.119516+0000","last_unstale":"2023-11-28T20:07:43.109672+0000","last_undegraded":"2023-11-28T20:07:43.109672+0000","last_fullsized":"2023-11-28T20:07:43.109672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:41.088167+0000","last_clean_scrub_stamp":"2023-11-28T20:07:41.088167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:24.790874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T20:07:43.108702+0000","last_change":"2023-11-28T20:07:41.121501+0000","last_active":"2023-11-28T20:07:43.108702+0000","last_peered":"2023-11-28T20:07:43.108702+0000","last_clean":"2023-11-28T20:07:43.108702+0000","last_became_active":"2023-11-28T20:07:41.121213+0000","last_became_peered":"2023-11-28T20:07:41.121213+0000","last_unstale":"2023-11-28T20:07:43.108702+0000","last_undegraded":"2023-11-28T20:07:43.108702+0000","last_fullsized":"2023-11-28T20:07:43.108702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:40.081397+0000","last_clean_scrub_stamp":"2023-11-28T20:07:40.081397+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:27.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.8810000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.9740000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.206}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6710000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.9909999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7889999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7069999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6360000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:07:51.358 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T20:07:51.358 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-28T20:07:51.358 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-28T20:07:51.358 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T20:07:51.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.524+0000 7fcff15e6640 1 Processor -- start 2023-11-28T20:07:51.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.528+0000 7fcff15e6640 1 -- start start 2023-11-28T20:07:51.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.528+0000 7fcff15e6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcfec0ce500 0x7fcfec167e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.528+0000 7fcff15e6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfec0b29f0 con 0x7fcfec15d200 2023-11-28T20:07:51.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.528+0000 7fcff15e6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfec0d1870 con 0x7fcfec0d2ba0 2023-11-28T20:07:51.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.528+0000 7fcff15e6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfec0d2fe0 con 0x7fcfec0ce500 2023-11-28T20:07:51.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.528+0000 7fcfeaffd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fcfec15d200 0x7fcfec0d1160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51564/0 (socket says 172.21.15.177:51564) 2023-11-28T20:07:51.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.528+0000 7fcfeaffd640 1 -- 172.21.15.177:0/1886770890 learned_addr learned my addr 172.21.15.177:0/1886770890 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:51.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.528+0000 7fcfeb7fe640 1 --2- 172.21.15.177:0/1886770890 >> v2:172.21.15.177:3300/0 conn(0x7fcfec0ce500 0x7fcfec167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.528+0000 7fcfeb7fe640 1 -- 172.21.15.177:0/1886770890 >> v1:172.21.15.195:6789/0 conn(0x7fcfec0d2ba0 legacy=0x7fcfec0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.528+0000 7fcfeb7fe640 1 -- 172.21.15.177:0/1886770890 >> v1:172.21.15.177:6789/0 conn(0x7fcfec15d200 legacy=0x7fcfec0d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.528+0000 7fcfeb7fe640 1 -- 172.21.15.177:0/1886770890 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec0d1b00 con 0x7fcfec0ce500 2023-11-28T20:07:51.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.532+0000 7fcfeb7fe640 1 --2- 172.21.15.177:0/1886770890 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec0ce500 0x7fcfec167e00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009d90 tx=0x7fcfe401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cda94b7f149e6e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:51.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.532+0000 7fcfe9ffb640 1 -- 172.21.15.177:0/1886770890 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40af600 con 0x7fcfec0ce500 2023-11-28T20:07:51.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.532+0000 7fcfe9ffb640 1 -- 172.21.15.177:0/1886770890 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe40ab050 con 0x7fcfec0ce500 2023-11-28T20:07:51.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.532+0000 7fcfe9ffb640 1 -- 172.21.15.177:0/1886770890 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40af980 con 0x7fcfec0ce500 2023-11-28T20:07:51.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.532+0000 7fcff15e6640 1 -- 172.21.15.177:0/1886770890 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec0ce500 msgr2=0x7fcfec167e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.532+0000 7fcff15e6640 1 --2- 172.21.15.177:0/1886770890 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec0ce500 0x7fcfec167e00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009d90 tx=0x7fcfe401f130 comp rx=0 tx=0).stop 2023-11-28T20:07:51.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.532+0000 7fcff15e6640 1 -- 172.21.15.177:0/1886770890 shutdown_connections 2023-11-28T20:07:51.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.532+0000 7fcff15e6640 1 --2- 172.21.15.177:0/1886770890 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec0ce500 0x7fcfec167e00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.532+0000 7fcff15e6640 1 -- 172.21.15.177:0/1886770890 >> 172.21.15.177:0/1886770890 conn(0x7fcfec072260 msgr2=0x7fcfec0cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:51.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.532+0000 7fcff15e6640 1 -- 172.21.15.177:0/1886770890 shutdown_connections 2023-11-28T20:07:51.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.532+0000 7fcff15e6640 1 -- 172.21.15.177:0/1886770890 wait complete. 2023-11-28T20:07:51.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.532+0000 7fcff15e6640 1 Processor -- start 2023-11-28T20:07:51.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.532+0000 7fcff15e6640 1 -- start start 2023-11-28T20:07:51.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcff15e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec0ce500 0x7fcfec0cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcff15e6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfec0d2ba0 0x7fcfec153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcff15e6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfec15d200 0x7fcfec15f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcff15e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec1536a0 con 0x7fcfec0ce500 2023-11-28T20:07:51.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcff15e6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec15fdf0 con 0x7fcfec0d2ba0 2023-11-28T20:07:51.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcff15e6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec0ca320 con 0x7fcfec15d200 2023-11-28T20:07:51.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcfeaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec0ce500 0x7fcfec0cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcfeaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec0ce500 0x7fcfec0cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44678/0 (socket says 172.21.15.177:44678) 2023-11-28T20:07:51.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcfeaffd640 1 -- 172.21.15.177:0/2104198185 learned_addr learned my addr 172.21.15.177:0/2104198185 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:51.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcfeb7fe640 1 --2- 172.21.15.177:0/2104198185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfec15d200 0x7fcfec15f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcfea7fc640 1 --2- 172.21.15.177:0/2104198185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfec0d2ba0 0x7fcfec153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcfeaffd640 1 -- 172.21.15.177:0/2104198185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfec15d200 msgr2=0x7fcfec15f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcfeaffd640 1 --2- 172.21.15.177:0/2104198185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfec15d200 0x7fcfec15f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcfeaffd640 1 -- 172.21.15.177:0/2104198185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfec0d2ba0 msgr2=0x7fcfec153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcfeaffd640 1 --2- 172.21.15.177:0/2104198185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfec0d2ba0 0x7fcfec153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcfeaffd640 1 -- 172.21.15.177:0/2104198185 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe4009a70 con 0x7fcfec0ce500 2023-11-28T20:07:51.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcfea7fc640 1 --2- 172.21.15.177:0/2104198185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfec0d2ba0 0x7fcfec153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:51.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcfeaffd640 1 --2- 172.21.15.177:0/2104198185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec0ce500 0x7fcfec0cb0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00c400 tx=0x7fcfdc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:51.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcfd37fe640 1 -- 172.21.15.177:0/2104198185 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc005cf0 con 0x7fcfec0ce500 2023-11-28T20:07:51.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcfd37fe640 1 -- 172.21.15.177:0/2104198185 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfdc005e50 con 0x7fcfec0ce500 2023-11-28T20:07:51.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcfd37fe640 1 -- 172.21.15.177:0/2104198185 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc0072d0 con 0x7fcfec0ce500 2023-11-28T20:07:51.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcff15e6640 1 -- 172.21.15.177:0/2104198185 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec15fb50 con 0x7fcfec0ce500 2023-11-28T20:07:51.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcff15e6640 1 -- 172.21.15.177:0/2104198185 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec0ca8a0 con 0x7fcfec0ce500 2023-11-28T20:07:51.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.536+0000 7fcff15e6640 1 -- 172.21.15.177:0/2104198185 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfec069440 con 0x7fcfec0ce500 2023-11-28T20:07:51.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.540+0000 7fcfd37fe640 1 -- 172.21.15.177:0/2104198185 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcfdc007430 con 0x7fcfec0ce500 2023-11-28T20:07:51.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.540+0000 7fcfd37fe640 1 --2- 172.21.15.177:0/2104198185 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfd8066470 0x7fcfd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.540+0000 7fcfd37fe640 1 -- 172.21.15.177:0/2104198185 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfdc083280 con 0x7fcfec0ce500 2023-11-28T20:07:51.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.540+0000 7fcfea7fc640 1 --2- 172.21.15.177:0/2104198185 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfd8066470 0x7fcfd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.540+0000 7fcfea7fc640 1 --2- 172.21.15.177:0/2104198185 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfd8066470 0x7fcfd8068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0d00e0 tx=0x7fcfe0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:51.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.544+0000 7fcfd37fe640 1 -- 172.21.15.177:0/2104198185 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcfdc050840 con 0x7fcfec0ce500 2023-11-28T20:07:51.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.724+0000 7fcff15e6640 1 -- 172.21.15.177:0/2104198185 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcfec0cfe30 con 0x7fcfec0ce500 2023-11-28T20:07:51.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.724+0000 7fcfd37fe640 1 -- 172.21.15.177:0/2104198185 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fcfdc053e60 con 0x7fcfec0ce500 2023-11-28T20:07:51.727 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:51.727 INFO:teuthology.orchestra.run.smithi177.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-28T20:07:51.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.724+0000 7fcff15e6640 1 -- 172.21.15.177:0/2104198185 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfd8066470 msgr2=0x7fcfd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.724+0000 7fcff15e6640 1 --2- 172.21.15.177:0/2104198185 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfd8066470 0x7fcfd8068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0d00e0 tx=0x7fcfe0009040 comp rx=0 tx=0).stop 2023-11-28T20:07:51.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.724+0000 7fcff15e6640 1 -- 172.21.15.177:0/2104198185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec0ce500 msgr2=0x7fcfec0cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.724+0000 7fcff15e6640 1 --2- 172.21.15.177:0/2104198185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec0ce500 0x7fcfec0cb0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00c400 tx=0x7fcfdc00c8c0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.724+0000 7fcff15e6640 1 -- 172.21.15.177:0/2104198185 shutdown_connections 2023-11-28T20:07:51.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.724+0000 7fcff15e6640 1 --2- 172.21.15.177:0/2104198185 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfd8066470 0x7fcfd8068930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.724+0000 7fcff15e6640 1 --2- 172.21.15.177:0/2104198185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfec15d200 0x7fcfec15f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.724+0000 7fcff15e6640 1 --2- 172.21.15.177:0/2104198185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfec0d2ba0 0x7fcfec153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.724+0000 7fcff15e6640 1 --2- 172.21.15.177:0/2104198185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec0ce500 0x7fcfec0cb0a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.724+0000 7fcff15e6640 1 -- 172.21.15.177:0/2104198185 >> 172.21.15.177:0/2104198185 conn(0x7fcfec072260 msgr2=0x7fcfec06b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:51.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.724+0000 7fcff15e6640 1 -- 172.21.15.177:0/2104198185 shutdown_connections 2023-11-28T20:07:51.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.724+0000 7fcff15e6640 1 -- 172.21.15.177:0/2104198185 wait complete. 2023-11-28T20:07:51.749 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-28T20:07:51.750 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:07:51.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.884+0000 7f0f410dd640 1 Processor -- start 2023-11-28T20:07:51.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.884+0000 7f0f410dd640 1 -- start start 2023-11-28T20:07:51.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.884+0000 7f0f410dd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0f3c06c9d0 0x7f0f3c070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.884+0000 7f0f410dd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0f3c072180 0x7f0f3c0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.884+0000 7f0f410dd640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c0710e0 con 0x7f0f3c144840 2023-11-28T20:07:51.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.884+0000 7f0f410dd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c15f010 con 0x7f0f3c072180 2023-11-28T20:07:51.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.884+0000 7f0f410dd640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c070ee0 con 0x7f0f3c06c9d0 2023-11-28T20:07:51.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.884+0000 7f0f3b59e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0f3c072180 0x7f0f3c0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.884+0000 7f0f3b59e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0f3c072180 0x7f0f3c0709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44690/0 (socket says 172.21.15.177:44690) 2023-11-28T20:07:51.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.884+0000 7f0f3b59e640 1 -- 172.21.15.177:0/2941705209 learned_addr learned my addr 172.21.15.177:0/2941705209 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:51.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.884+0000 7f0f33fff640 1 --2- 172.21.15.177:0/2941705209 >> v2:172.21.15.195:3300/0 conn(0x7f0f3c06c9d0 0x7f0f3c070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.884+0000 7f0f3b59e640 1 -- 172.21.15.177:0/2941705209 >> v2:172.21.15.195:3300/0 conn(0x7f0f3c06c9d0 msgr2=0x7f0f3c070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:51.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.884+0000 7f0f3b59e640 1 --2- 172.21.15.177:0/2941705209 >> v2:172.21.15.195:3300/0 conn(0x7f0f3c06c9d0 0x7f0f3c070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.884+0000 7f0f3b59e640 1 -- 172.21.15.177:0/2941705209 >> v1:172.21.15.195:6789/0 conn(0x7f0f3c144840 legacy=0x7f0f3c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:51.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.884+0000 7f0f3b59e640 1 -- 172.21.15.177:0/2941705209 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c0713c0 con 0x7f0f3c072180 2023-11-28T20:07:51.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.888+0000 7f0f3b59e640 1 --2- 172.21.15.177:0/2941705209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f3c072180 0x7f0f3c0709a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c06d140 tx=0x7f0f3401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9044d83ceec1131 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:51.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.888+0000 7f0f3a59c640 1 -- 172.21.15.177:0/2941705209 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f340a5820 con 0x7f0f3c072180 2023-11-28T20:07:51.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.888+0000 7f0f3a59c640 1 -- 172.21.15.177:0/2941705209 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f340a5980 con 0x7f0f3c072180 2023-11-28T20:07:51.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.888+0000 7f0f3a59c640 1 -- 172.21.15.177:0/2941705209 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f340a5d10 con 0x7f0f3c072180 2023-11-28T20:07:51.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.888+0000 7f0f410dd640 1 -- 172.21.15.177:0/2941705209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f3c072180 msgr2=0x7f0f3c0709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.888+0000 7f0f410dd640 1 --2- 172.21.15.177:0/2941705209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f3c072180 0x7f0f3c0709a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c06d140 tx=0x7f0f3401c960 comp rx=0 tx=0).stop 2023-11-28T20:07:51.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.888+0000 7f0f410dd640 1 -- 172.21.15.177:0/2941705209 shutdown_connections 2023-11-28T20:07:51.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.888+0000 7f0f410dd640 1 --2- 172.21.15.177:0/2941705209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f3c072180 0x7f0f3c0709a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.888+0000 7f0f410dd640 1 --2- 172.21.15.177:0/2941705209 >> v2:172.21.15.195:3300/0 conn(0x7f0f3c06c9d0 0x7f0f3c070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.888+0000 7f0f410dd640 1 -- 172.21.15.177:0/2941705209 >> 172.21.15.177:0/2941705209 conn(0x7f0f3c06a530 msgr2=0x7f0f3c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:51.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.888+0000 7f0f410dd640 1 -- 172.21.15.177:0/2941705209 shutdown_connections 2023-11-28T20:07:51.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.888+0000 7f0f410dd640 1 -- 172.21.15.177:0/2941705209 wait complete. 2023-11-28T20:07:51.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f410dd640 1 Processor -- start 2023-11-28T20:07:51.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f410dd640 1 -- start start 2023-11-28T20:07:51.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f410dd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f3c06c9d0 0x7f0f3c143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f410dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f3c072180 0x7f0f3c139310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f410dd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f3c144840 0x7f0f3c1373e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f410dd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c1439d0 con 0x7f0f3c072180 2023-11-28T20:07:51.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f410dd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c15a210 con 0x7f0f3c144840 2023-11-28T20:07:51.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f410dd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c15a4f0 con 0x7f0f3c06c9d0 2023-11-28T20:07:51.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f33fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f3c072180 0x7f0f3c139310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f33fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f3c072180 0x7f0f3c139310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44702/0 (socket says 172.21.15.177:44702) 2023-11-28T20:07:51.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f33fff640 1 -- 172.21.15.177:0/1584932951 learned_addr learned my addr 172.21.15.177:0/1584932951 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:51.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f3b59e640 1 --2- 172.21.15.177:0/1584932951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f3c144840 0x7f0f3c1373e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f3ad9d640 1 --2- 172.21.15.177:0/1584932951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f3c06c9d0 0x7f0f3c143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f33fff640 1 -- 172.21.15.177:0/1584932951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f3c06c9d0 msgr2=0x7f0f3c143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f33fff640 1 --2- 172.21.15.177:0/1584932951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f3c06c9d0 0x7f0f3c143490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f33fff640 1 -- 172.21.15.177:0/1584932951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f3c144840 msgr2=0x7f0f3c1373e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:51.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f33fff640 1 --2- 172.21.15.177:0/1584932951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f3c144840 0x7f0f3c1373e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:51.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f33fff640 1 -- 172.21.15.177:0/1584932951 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f34009b30 con 0x7f0f3c072180 2023-11-28T20:07:51.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f33fff640 1 --2- 172.21.15.177:0/1584932951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f3c072180 0x7f0f3c139310 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400d7d0 tx=0x7f0f2400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:51.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f337fe640 1 -- 172.21.15.177:0/1584932951 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2400b6c0 con 0x7f0f3c072180 2023-11-28T20:07:51.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f337fe640 1 -- 172.21.15.177:0/1584932951 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2400b820 con 0x7f0f3c072180 2023-11-28T20:07:51.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f337fe640 1 -- 172.21.15.177:0/1584932951 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2400bbd0 con 0x7f0f3c072180 2023-11-28T20:07:51.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f410dd640 1 -- 172.21.15.177:0/1584932951 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c15a7d0 con 0x7f0f3c072180 2023-11-28T20:07:51.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.892+0000 7f0f410dd640 1 -- 172.21.15.177:0/1584932951 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c15ad90 con 0x7f0f3c072180 2023-11-28T20:07:51.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.896+0000 7f0f410dd640 1 -- 172.21.15.177:0/1584932951 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c15af50 con 0x7f0f3c072180 2023-11-28T20:07:51.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.896+0000 7f0f337fe640 1 -- 172.21.15.177:0/1584932951 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0f2400bd30 con 0x7f0f3c072180 2023-11-28T20:07:51.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.896+0000 7f0f337fe640 1 --2- 172.21.15.177:0/1584932951 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0f1c066470 0x7f0f1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:51.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.896+0000 7f0f337fe640 1 -- 172.21.15.177:0/1584932951 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f240842f0 con 0x7f0f3c072180 2023-11-28T20:07:51.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.896+0000 7f0f3ad9d640 1 --2- 172.21.15.177:0/1584932951 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0f1c066470 0x7f0f1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:51.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.896+0000 7f0f3ad9d640 1 --2- 172.21.15.177:0/1584932951 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0f1c066470 0x7f0f1c068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0098e0 tx=0x7f0f2c009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:51.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:51.900+0000 7f0f337fe640 1 -- 172.21.15.177:0/1584932951 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0f24051780 con 0x7f0f3c072180 2023-11-28T20:07:52.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.052+0000 7f0f410dd640 1 -- 172.21.15.177:0/1584932951 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f3c069440 con 0x7f0f3c072180 2023-11-28T20:07:52.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.052+0000 7f0f337fe640 1 -- 172.21.15.177:0/1584932951 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f0f24054da0 con 0x7f0f3c072180 2023-11-28T20:07:52.057 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:52.057 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:07:52.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.056+0000 7f0f410dd640 1 -- 172.21.15.177:0/1584932951 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0f1c066470 msgr2=0x7f0f1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.056+0000 7f0f410dd640 1 --2- 172.21.15.177:0/1584932951 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0f1c066470 0x7f0f1c068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0098e0 tx=0x7f0f2c009060 comp rx=0 tx=0).stop 2023-11-28T20:07:52.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.056+0000 7f0f410dd640 1 -- 172.21.15.177:0/1584932951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f3c072180 msgr2=0x7f0f3c139310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.056+0000 7f0f410dd640 1 --2- 172.21.15.177:0/1584932951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f3c072180 0x7f0f3c139310 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400d7d0 tx=0x7f0f2400dc90 comp rx=0 tx=0).stop 2023-11-28T20:07:52.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.056+0000 7f0f410dd640 1 -- 172.21.15.177:0/1584932951 shutdown_connections 2023-11-28T20:07:52.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.056+0000 7f0f410dd640 1 --2- 172.21.15.177:0/1584932951 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0f1c066470 0x7f0f1c068930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.056+0000 7f0f410dd640 1 --2- 172.21.15.177:0/1584932951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f3c144840 0x7f0f3c1373e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.056+0000 7f0f410dd640 1 --2- 172.21.15.177:0/1584932951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f3c072180 0x7f0f3c139310 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.056+0000 7f0f410dd640 1 --2- 172.21.15.177:0/1584932951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f3c06c9d0 0x7f0f3c143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.056+0000 7f0f410dd640 1 -- 172.21.15.177:0/1584932951 >> 172.21.15.177:0/1584932951 conn(0x7f0f3c06a530 msgr2=0x7f0f3c15d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:52.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.056+0000 7f0f410dd640 1 -- 172.21.15.177:0/1584932951 shutdown_connections 2023-11-28T20:07:52.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.056+0000 7f0f410dd640 1 -- 172.21.15.177:0/1584932951 wait complete. 2023-11-28T20:07:52.078 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:07:52.078 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:07:52.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.216+0000 7f6d63279640 1 Processor -- start 2023-11-28T20:07:52.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.216+0000 7f6d63279640 1 -- start start 2023-11-28T20:07:52.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.216+0000 7f6d63279640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6d5c158ca0 0x7f6d5c15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.216+0000 7f6d63279640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5c15b670 con 0x7f6d5c0cba10 2023-11-28T20:07:52.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.216+0000 7f6d63279640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5c15c510 con 0x7f6d5c0b42d0 2023-11-28T20:07:52.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.216+0000 7f6d63279640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5c15f410 con 0x7f6d5c158ca0 2023-11-28T20:07:52.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.216+0000 7f6d60814640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f6d5c0cba10 0x7f6d5c15be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51572/0 (socket says 172.21.15.177:51572) 2023-11-28T20:07:52.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.216+0000 7f6d60814640 1 -- 172.21.15.177:0/3276798681 learned_addr learned my addr 172.21.15.177:0/3276798681 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:52.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.216+0000 7f6d61015640 1 --2- 172.21.15.177:0/3276798681 >> v2:172.21.15.195:3300/0 conn(0x7f6d5c158ca0 0x7f6d5c15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.216+0000 7f6d53fff640 1 -- 172.21.15.177:0/3276798681 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371790260 0 0) 0x7f6d5c15b670 con 0x7f6d5c0cba10 2023-11-28T20:07:52.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.216+0000 7f6d53fff640 1 -- 172.21.15.177:0/3276798681 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d48003530 con 0x7f6d5c0cba10 2023-11-28T20:07:52.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.216+0000 7f6d53fff640 1 -- 172.21.15.177:0/3276798681 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 783108116 0 0) 0x7f6d48003530 con 0x7f6d5c0cba10 2023-11-28T20:07:52.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.216+0000 7f6d61015640 1 -- 172.21.15.177:0/3276798681 >> v1:172.21.15.195:6789/0 conn(0x7f6d5c0b42d0 legacy=0x7f6d5c0703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.216+0000 7f6d61015640 1 -- 172.21.15.177:0/3276798681 >> v1:172.21.15.177:6789/0 conn(0x7f6d5c0cba10 legacy=0x7f6d5c15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.216+0000 7f6d61015640 1 -- 172.21.15.177:0/3276798681 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c15f6f0 con 0x7f6d5c158ca0 2023-11-28T20:07:52.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.220+0000 7f6d61015640 1 --2- 172.21.15.177:0/3276798681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c158ca0 0x7f6d5c15eb50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d580097c0 tx=0x7f6d5801c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=254d6518e31b6c24 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:52.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.220+0000 7f6d53fff640 1 -- 172.21.15.177:0/3276798681 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c001680 con 0x7f6d5c158ca0 2023-11-28T20:07:52.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.220+0000 7f6d53fff640 1 -- 172.21.15.177:0/3276798681 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d580a7050 con 0x7f6d5c158ca0 2023-11-28T20:07:52.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.220+0000 7f6d53fff640 1 -- 172.21.15.177:0/3276798681 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d580ab620 con 0x7f6d5c158ca0 2023-11-28T20:07:52.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.220+0000 7f6d63279640 1 -- 172.21.15.177:0/3276798681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c158ca0 msgr2=0x7f6d5c15eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.220+0000 7f6d63279640 1 --2- 172.21.15.177:0/3276798681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c158ca0 0x7f6d5c15eb50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d580097c0 tx=0x7f6d5801c250 comp rx=0 tx=0).stop 2023-11-28T20:07:52.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.220+0000 7f6d63279640 1 -- 172.21.15.177:0/3276798681 shutdown_connections 2023-11-28T20:07:52.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.220+0000 7f6d63279640 1 --2- 172.21.15.177:0/3276798681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c158ca0 0x7f6d5c15eb50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.220+0000 7f6d63279640 1 -- 172.21.15.177:0/3276798681 >> 172.21.15.177:0/3276798681 conn(0x7f6d5c0b0cc0 msgr2=0x7f6d5c0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:52.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.220+0000 7f6d63279640 1 -- 172.21.15.177:0/3276798681 shutdown_connections 2023-11-28T20:07:52.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.220+0000 7f6d63279640 1 -- 172.21.15.177:0/3276798681 wait complete. 2023-11-28T20:07:52.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d63279640 1 Processor -- start 2023-11-28T20:07:52.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d63279640 1 -- start start 2023-11-28T20:07:52.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d63279640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d5c0b42d0 0x7f6d5c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d63279640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c0cba10 0x7f6d5c0b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d63279640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d5c158ca0 0x7f6d5c0b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d63279640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c0b3200 con 0x7f6d5c0b42d0 2023-11-28T20:07:52.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d63279640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c0b3fe0 con 0x7f6d5c0cba10 2023-11-28T20:07:52.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d63279640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c0ad780 con 0x7f6d5c158ca0 2023-11-28T20:07:52.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d61015640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d5c0b42d0 0x7f6d5c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d61015640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d5c0b42d0 0x7f6d5c0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44710/0 (socket says 172.21.15.177:44710) 2023-11-28T20:07:52.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d61015640 1 -- 172.21.15.177:0/3990988709 learned_addr learned my addr 172.21.15.177:0/3990988709 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:52.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d61816640 1 --2- 172.21.15.177:0/3990988709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d5c158ca0 0x7f6d5c0b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d60814640 1 --2- 172.21.15.177:0/3990988709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c0cba10 0x7f6d5c0b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d61015640 1 -- 172.21.15.177:0/3990988709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d5c158ca0 msgr2=0x7f6d5c0b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d61015640 1 --2- 172.21.15.177:0/3990988709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d5c158ca0 0x7f6d5c0b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d61015640 1 -- 172.21.15.177:0/3990988709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c0cba10 msgr2=0x7f6d5c0b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d61015640 1 --2- 172.21.15.177:0/3990988709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c0cba10 0x7f6d5c0b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d61015640 1 -- 172.21.15.177:0/3990988709 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d58009420 con 0x7f6d5c0b42d0 2023-11-28T20:07:52.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d61015640 1 --2- 172.21.15.177:0/3990988709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d5c0b42d0 0x7f6d5c0b3990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6d580097c0 tx=0x7f6d5801aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:52.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d51ffb640 1 -- 172.21.15.177:0/3990988709 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58004220 con 0x7f6d5c0b42d0 2023-11-28T20:07:52.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d51ffb640 1 -- 172.21.15.177:0/3990988709 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d58004380 con 0x7f6d5c0b42d0 2023-11-28T20:07:52.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d63279640 1 -- 172.21.15.177:0/3990988709 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5c0ada60 con 0x7f6d5c0b42d0 2023-11-28T20:07:52.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d51ffb640 1 -- 172.21.15.177:0/3990988709 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d580b78a0 con 0x7f6d5c0b42d0 2023-11-28T20:07:52.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.224+0000 7f6d63279640 1 -- 172.21.15.177:0/3990988709 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5c0ae020 con 0x7f6d5c0b42d0 2023-11-28T20:07:52.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.228+0000 7f6d63279640 1 -- 172.21.15.177:0/3990988709 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5c0ae210 con 0x7f6d5c0b42d0 2023-11-28T20:07:52.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.228+0000 7f6d51ffb640 1 -- 172.21.15.177:0/3990988709 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6d580b7a00 con 0x7f6d5c0b42d0 2023-11-28T20:07:52.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.228+0000 7f6d51ffb640 1 --2- 172.21.15.177:0/3990988709 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6d40066470 0x7f6d40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.228+0000 7f6d51ffb640 1 -- 172.21.15.177:0/3990988709 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d5811db90 con 0x7f6d5c0b42d0 2023-11-28T20:07:52.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.228+0000 7f6d60814640 1 --2- 172.21.15.177:0/3990988709 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6d40066470 0x7f6d40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.228+0000 7f6d60814640 1 --2- 172.21.15.177:0/3990988709 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6d40066470 0x7f6d40068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c000fc0 tx=0x7f6d4c001a60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:52.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.232+0000 7f6d51ffb640 1 -- 172.21.15.177:0/3990988709 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d580eb020 con 0x7f6d5c0b42d0 2023-11-28T20:07:52.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.384+0000 7f6d63279640 1 -- 172.21.15.177:0/3990988709 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d5c0693d0 con 0x7f6d5c0b42d0 2023-11-28T20:07:52.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.384+0000 7f6d51ffb640 1 -- 172.21.15.177:0/3990988709 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d580b00a0 con 0x7f6d5c0b42d0 2023-11-28T20:07:52.390 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:07:52.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.388+0000 7f6d63279640 1 -- 172.21.15.177:0/3990988709 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6d40066470 msgr2=0x7f6d40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.388+0000 7f6d63279640 1 --2- 172.21.15.177:0/3990988709 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6d40066470 0x7f6d40068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c000fc0 tx=0x7f6d4c001a60 comp rx=0 tx=0).stop 2023-11-28T20:07:52.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.388+0000 7f6d63279640 1 -- 172.21.15.177:0/3990988709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d5c0b42d0 msgr2=0x7f6d5c0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.388+0000 7f6d63279640 1 --2- 172.21.15.177:0/3990988709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d5c0b42d0 0x7f6d5c0b3990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6d580097c0 tx=0x7f6d5801aa90 comp rx=0 tx=0).stop 2023-11-28T20:07:52.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.388+0000 7f6d63279640 1 -- 172.21.15.177:0/3990988709 shutdown_connections 2023-11-28T20:07:52.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.388+0000 7f6d63279640 1 --2- 172.21.15.177:0/3990988709 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6d40066470 0x7f6d40068930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.388+0000 7f6d63279640 1 --2- 172.21.15.177:0/3990988709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d5c158ca0 0x7f6d5c0b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.388+0000 7f6d63279640 1 --2- 172.21.15.177:0/3990988709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c0cba10 0x7f6d5c0b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.388+0000 7f6d63279640 1 --2- 172.21.15.177:0/3990988709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d5c0b42d0 0x7f6d5c0b3990 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.388+0000 7f6d63279640 1 -- 172.21.15.177:0/3990988709 >> 172.21.15.177:0/3990988709 conn(0x7f6d5c0b0cc0 msgr2=0x7f6d5c0b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:52.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.388+0000 7f6d63279640 1 -- 172.21.15.177:0/3990988709 shutdown_connections 2023-11-28T20:07:52.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.388+0000 7f6d63279640 1 -- 172.21.15.177:0/3990988709 wait complete. 2023-11-28T20:07:52.410 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:07:52.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.548+0000 7f798b1b8640 1 Processor -- start 2023-11-28T20:07:52.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.548+0000 7f798b1b8640 1 -- start start 2023-11-28T20:07:52.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.548+0000 7f798b1b8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7984071d90 0x7f7984072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.548+0000 7f798b1b8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f798415adb0 0x7f798413d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.548+0000 7f798b1b8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798413d2b0 con 0x7f798413f5f0 2023-11-28T20:07:52.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.548+0000 7f798b1b8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7984140520 con 0x7f798415adb0 2023-11-28T20:07:52.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.548+0000 7f798b1b8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79840cd7f0 con 0x7f7984071d90 2023-11-28T20:07:52.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.548+0000 7f797bfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f798415adb0 0x7f798413d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.548+0000 7f797bfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f798415adb0 0x7f798413d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44714/0 (socket says 172.21.15.177:44714) 2023-11-28T20:07:52.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.548+0000 7f797bfff640 1 -- 172.21.15.177:0/1066202982 learned_addr learned my addr 172.21.15.177:0/1066202982 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:52.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.548+0000 7f797bfff640 1 -- 172.21.15.177:0/1066202982 >> v2:172.21.15.195:3300/0 conn(0x7f7984071d90 msgr2=0x7f7984072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:52.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.548+0000 7f797bfff640 1 --2- 172.21.15.177:0/1066202982 >> v2:172.21.15.195:3300/0 conn(0x7f7984071d90 0x7f7984072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.548+0000 7f797bfff640 1 -- 172.21.15.177:0/1066202982 >> v1:172.21.15.195:6789/0 conn(0x7f798413f5f0 legacy=0x7f79840ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:52.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.548+0000 7f797bfff640 1 -- 172.21.15.177:0/1066202982 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79840cdd70 con 0x7f798415adb0 2023-11-28T20:07:52.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.552+0000 7f797bfff640 1 --2- 172.21.15.177:0/1066202982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f798415adb0 0x7f798413d560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f79840b1d80 tx=0x7f797401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4968261c039ca9fd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:52.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.552+0000 7f797b7fe640 1 -- 172.21.15.177:0/1066202982 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79740aa620 con 0x7f798415adb0 2023-11-28T20:07:52.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.552+0000 7f797b7fe640 1 -- 172.21.15.177:0/1066202982 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79740aa780 con 0x7f798415adb0 2023-11-28T20:07:52.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.552+0000 7f797b7fe640 1 -- 172.21.15.177:0/1066202982 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79740aab10 con 0x7f798415adb0 2023-11-28T20:07:52.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.552+0000 7f798b1b8640 1 -- 172.21.15.177:0/1066202982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f798415adb0 msgr2=0x7f798413d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.552+0000 7f798b1b8640 1 --2- 172.21.15.177:0/1066202982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f798415adb0 0x7f798413d560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f79840b1d80 tx=0x7f797401c4c0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.552+0000 7f798b1b8640 1 -- 172.21.15.177:0/1066202982 shutdown_connections 2023-11-28T20:07:52.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.552+0000 7f798b1b8640 1 --2- 172.21.15.177:0/1066202982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f798415adb0 0x7f798413d560 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.552+0000 7f798b1b8640 1 --2- 172.21.15.177:0/1066202982 >> v2:172.21.15.195:3300/0 conn(0x7f7984071d90 0x7f7984072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.552+0000 7f798b1b8640 1 -- 172.21.15.177:0/1066202982 >> 172.21.15.177:0/1066202982 conn(0x7f79840b0cc0 msgr2=0x7f79840b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:52.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.552+0000 7f798b1b8640 1 -- 172.21.15.177:0/1066202982 shutdown_connections 2023-11-28T20:07:52.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.552+0000 7f798b1b8640 1 -- 172.21.15.177:0/1066202982 wait complete. 2023-11-28T20:07:52.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f798b1b8640 1 Processor -- start 2023-11-28T20:07:52.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f798b1b8640 1 -- start start 2023-11-28T20:07:52.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f798b1b8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7984071d90 0x7f79841f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f798b1b8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f798413f5f0 0x7f7984136760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f798b1b8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f798415adb0 0x7f7984150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f798b1b8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79840b1d80 con 0x7f798413f5f0 2023-11-28T20:07:52.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f798b1b8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79840b2060 con 0x7f7984071d90 2023-11-28T20:07:52.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f798b1b8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798413e8a0 con 0x7f798415adb0 2023-11-28T20:07:52.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f797bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f798413f5f0 0x7f7984136760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f797bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f798413f5f0 0x7f7984136760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44726/0 (socket says 172.21.15.177:44726) 2023-11-28T20:07:52.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f797bfff640 1 -- 172.21.15.177:0/393766881 learned_addr learned my addr 172.21.15.177:0/393766881 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:52.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f797bfff640 1 -- 172.21.15.177:0/393766881 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f798415adb0 msgr2=0x7f7984150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f797bfff640 1 --2- 172.21.15.177:0/393766881 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f798415adb0 0x7f7984150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f797bfff640 1 -- 172.21.15.177:0/393766881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7984071d90 msgr2=0x7f79841f49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f7988f54640 1 --2- 172.21.15.177:0/393766881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7984071d90 0x7f79841f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f797bfff640 1 --2- 172.21.15.177:0/393766881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7984071d90 0x7f79841f49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f797bfff640 1 -- 172.21.15.177:0/393766881 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79740094d0 con 0x7f798413f5f0 2023-11-28T20:07:52.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f7988f54640 1 --2- 172.21.15.177:0/393766881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7984071d90 0x7f79841f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:52.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f797bfff640 1 --2- 172.21.15.177:0/393766881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f798413f5f0 0x7f7984136760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f79740ac040 tx=0x7f797401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:52.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f79797fa640 1 -- 172.21.15.177:0/393766881 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79740b3800 con 0x7f798413f5f0 2023-11-28T20:07:52.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f79797fa640 1 -- 172.21.15.177:0/393766881 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79740b3960 con 0x7f798413f5f0 2023-11-28T20:07:52.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f79797fa640 1 -- 172.21.15.177:0/393766881 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79740b3d10 con 0x7f798413f5f0 2023-11-28T20:07:52.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f798b1b8640 1 -- 172.21.15.177:0/393766881 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798413eb80 con 0x7f798413f5f0 2023-11-28T20:07:52.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f798b1b8640 1 -- 172.21.15.177:0/393766881 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79841f4f20 con 0x7f798413f5f0 2023-11-28T20:07:52.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.556+0000 7f798b1b8640 1 -- 172.21.15.177:0/393766881 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7984073cf0 con 0x7f798413f5f0 2023-11-28T20:07:52.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.560+0000 7f79797fa640 1 -- 172.21.15.177:0/393766881 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f79740c73a0 con 0x7f798413f5f0 2023-11-28T20:07:52.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.560+0000 7f79797fa640 1 --2- 172.21.15.177:0/393766881 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7970066470 0x7f7970068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.560+0000 7f79797fa640 1 -- 172.21.15.177:0/393766881 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f797411e830 con 0x7f798413f5f0 2023-11-28T20:07:52.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.560+0000 7f7988f54640 1 --2- 172.21.15.177:0/393766881 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7970066470 0x7f7970068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.560+0000 7f7988f54640 1 --2- 172.21.15.177:0/393766881 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7970066470 0x7f7970068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7984137040 tx=0x7f7980008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:52.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.564+0000 7f79797fa640 1 -- 172.21.15.177:0/393766881 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7984073cf0 con 0x7f798413f5f0 2023-11-28T20:07:52.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.712+0000 7f798b1b8640 1 -- 172.21.15.177:0/393766881 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7984073cf0 con 0x7f798413f5f0 2023-11-28T20:07:52.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.712+0000 7f79797fa640 1 -- 172.21.15.177:0/393766881 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7984073cf0 con 0x7f798413f5f0 2023-11-28T20:07:52.718 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:07:52.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.716+0000 7f798b1b8640 1 -- 172.21.15.177:0/393766881 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7970066470 msgr2=0x7f7970068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.716+0000 7f798b1b8640 1 --2- 172.21.15.177:0/393766881 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7970066470 0x7f7970068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7984137040 tx=0x7f7980008040 comp rx=0 tx=0).stop 2023-11-28T20:07:52.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.716+0000 7f798b1b8640 1 -- 172.21.15.177:0/393766881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f798413f5f0 msgr2=0x7f7984136760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.716+0000 7f798b1b8640 1 --2- 172.21.15.177:0/393766881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f798413f5f0 0x7f7984136760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f79740ac040 tx=0x7f797401ad00 comp rx=0 tx=0).stop 2023-11-28T20:07:52.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.716+0000 7f798b1b8640 1 -- 172.21.15.177:0/393766881 shutdown_connections 2023-11-28T20:07:52.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.716+0000 7f798b1b8640 1 --2- 172.21.15.177:0/393766881 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7970066470 0x7f7970068930 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.716+0000 7f798b1b8640 1 --2- 172.21.15.177:0/393766881 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f798415adb0 0x7f7984150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.716+0000 7f798b1b8640 1 --2- 172.21.15.177:0/393766881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f798413f5f0 0x7f7984136760 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.716+0000 7f798b1b8640 1 --2- 172.21.15.177:0/393766881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7984071d90 0x7f79841f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.716+0000 7f798b1b8640 1 -- 172.21.15.177:0/393766881 >> 172.21.15.177:0/393766881 conn(0x7f79840b0cc0 msgr2=0x7f7984137230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:52.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.716+0000 7f798b1b8640 1 -- 172.21.15.177:0/393766881 shutdown_connections 2023-11-28T20:07:52.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.716+0000 7f798b1b8640 1 -- 172.21.15.177:0/393766881 wait complete. 2023-11-28T20:07:52.739 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:07:52.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdffb89e640 1 Processor -- start 2023-11-28T20:07:52.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdffb89e640 1 -- start start 2023-11-28T20:07:52.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdffb89e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdff414b1e0 0x7fdff40b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdffb89e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff40b4770 con 0x7fdff414abe0 2023-11-28T20:07:52.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdffb89e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff40b1fc0 con 0x7fdff40b4350 2023-11-28T20:07:52.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdffb89e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff4166130 con 0x7fdff414b1e0 2023-11-28T20:07:52.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdff963a640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fdff414abe0 0x7fdff4165a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51580/0 (socket says 172.21.15.177:51580) 2023-11-28T20:07:52.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdff963a640 1 -- 172.21.15.177:0/3277263471 learned_addr learned my addr 172.21.15.177:0/3277263471 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:52.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdff8e39640 1 --2- 172.21.15.177:0/3277263471 >> v2:172.21.15.195:3300/0 conn(0x7fdff414b1e0 0x7fdff40b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdfebfff640 1 -- 172.21.15.177:0/3277263471 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379902584 0 0) 0x7fdff40b4770 con 0x7fdff414abe0 2023-11-28T20:07:52.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdfebfff640 1 -- 172.21.15.177:0/3277263471 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfe0003530 con 0x7fdff414abe0 2023-11-28T20:07:52.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdfebfff640 1 -- 172.21.15.177:0/3277263471 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3362005604 0 0) 0x7fdfe0003530 con 0x7fdff414abe0 2023-11-28T20:07:52.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdfebfff640 1 -- 172.21.15.177:0/3277263471 >> v2:172.21.15.195:3300/0 conn(0x7fdff414b1e0 msgr2=0x7fdff40b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:52.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdfebfff640 1 --2- 172.21.15.177:0/3277263471 >> v2:172.21.15.195:3300/0 conn(0x7fdff414b1e0 0x7fdff40b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdfebfff640 1 -- 172.21.15.177:0/3277263471 >> v1:172.21.15.195:6789/0 conn(0x7fdff40b4350 legacy=0x7fdff40703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdfebfff640 1 -- 172.21.15.177:0/3277263471 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff40b2260 con 0x7fdff414abe0 2023-11-28T20:07:52.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdfebfff640 1 -- 172.21.15.177:0/3277263471 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7fdff0001680 con 0x7fdff414abe0 2023-11-28T20:07:52.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdfebfff640 1 -- 172.21.15.177:0/3277263471 >> v1:172.21.15.177:6789/0 conn(0x7fdff414abe0 legacy=0x7fdff4165a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdfebfff640 1 --2- 172.21.15.177:0/3277263471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfe0003980 0x7fdfe0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdfebfff640 1 --2- 172.21.15.177:0/3277263471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe00047d0 0x7fdfe0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdfebfff640 1 --2- 172.21.15.177:0/3277263471 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe0005190 0x7fdfe000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdfebfff640 1 -- 172.21.15.177:0/3277263471 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff4166130 con 0x7fdfe00047d0 2023-11-28T20:07:52.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdfebfff640 1 -- 172.21.15.177:0/3277263471 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe000c030 con 0x7fdfe0003980 2023-11-28T20:07:52.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdfebfff640 1 -- 172.21.15.177:0/3277263471 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe000c1f0 con 0x7fdfe0005190 2023-11-28T20:07:52.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdff8e39640 1 --2- 172.21.15.177:0/3277263471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe00047d0 0x7fdfe0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdff963a640 1 --2- 172.21.15.177:0/3277263471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfe0003980 0x7fdfe0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdff9e3b640 1 --2- 172.21.15.177:0/3277263471 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe0005190 0x7fdfe000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdff8e39640 1 -- 172.21.15.177:0/3277263471 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe0005190 msgr2=0x7fdfe000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:52.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdff8e39640 1 --2- 172.21.15.177:0/3277263471 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe0005190 0x7fdfe000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdff8e39640 1 -- 172.21.15.177:0/3277263471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfe0003980 msgr2=0x7fdfe0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:52.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdff8e39640 1 --2- 172.21.15.177:0/3277263471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfe0003980 0x7fdfe0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdff8e39640 1 -- 172.21.15.177:0/3277263471 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe0003530 con 0x7fdfe00047d0 2023-11-28T20:07:52.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdff963a640 1 --2- 172.21.15.177:0/3277263471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfe0003980 0x7fdfe0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:52.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdff9e3b640 1 --2- 172.21.15.177:0/3277263471 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe0005190 0x7fdfe000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:52.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.876+0000 7fdff9e3b640 1 -- 172.21.15.177:0/3277263471 reap_dead start 2023-11-28T20:07:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.880+0000 7fdff8e39640 1 --2- 172.21.15.177:0/3277263471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe00047d0 0x7fdfe0004c50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009ae0 tx=0x7fdfe401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992ff85053f16172 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.880+0000 7fdfebfff640 1 -- 172.21.15.177:0/3277263471 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40a5640 con 0x7fdfe00047d0 2023-11-28T20:07:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.880+0000 7fdfebfff640 1 -- 172.21.15.177:0/3277263471 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe40a57a0 con 0x7fdfe00047d0 2023-11-28T20:07:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.880+0000 7fdfebfff640 1 -- 172.21.15.177:0/3277263471 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40a5b50 con 0x7fdfe00047d0 2023-11-28T20:07:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.880+0000 7fdffb89e640 1 -- 172.21.15.177:0/3277263471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe00047d0 msgr2=0x7fdfe0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.880+0000 7fdffb89e640 1 --2- 172.21.15.177:0/3277263471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe00047d0 0x7fdfe0004c50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009ae0 tx=0x7fdfe401ca50 comp rx=0 tx=0).stop 2023-11-28T20:07:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.880+0000 7fdffb89e640 1 -- 172.21.15.177:0/3277263471 shutdown_connections 2023-11-28T20:07:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.880+0000 7fdffb89e640 1 --2- 172.21.15.177:0/3277263471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe00047d0 0x7fdfe0004c50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.880+0000 7fdffb89e640 1 -- 172.21.15.177:0/3277263471 >> 172.21.15.177:0/3277263471 conn(0x7fdff40b0cc0 msgr2=0x7fdff40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.880+0000 7fdffb89e640 1 -- 172.21.15.177:0/3277263471 shutdown_connections 2023-11-28T20:07:52.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.880+0000 7fdffb89e640 1 -- 172.21.15.177:0/3277263471 wait complete. 2023-11-28T20:07:52.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdffb89e640 1 Processor -- start 2023-11-28T20:07:52.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdffb89e640 1 -- start start 2023-11-28T20:07:52.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdffb89e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfe00047d0 0x7fdff41385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdffb89e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdff40c8ef0 0x7fdff41f70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdffb89e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdff41f7610 0x7fdff406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdffb89e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff4138130 con 0x7fdff40c8ef0 2023-11-28T20:07:52.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdffb89e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff41f7c90 con 0x7fdfe00047d0 2023-11-28T20:07:52.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdffb89e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff41f7f70 con 0x7fdff41f7610 2023-11-28T20:07:52.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdff8e39640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdff40c8ef0 0x7fdff41f70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdff8e39640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdff40c8ef0 0x7fdff41f70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44746/0 (socket says 172.21.15.177:44746) 2023-11-28T20:07:52.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdff8e39640 1 -- 172.21.15.177:0/1556878826 learned_addr learned my addr 172.21.15.177:0/1556878826 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:52.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdff8e39640 1 -- 172.21.15.177:0/1556878826 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdff41f7610 msgr2=0x7fdff406c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdff9e3b640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdff41f7610 0x7fdff406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdff963a640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfe00047d0 0x7fdff41385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdff8e39640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdff41f7610 0x7fdff406c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdff8e39640 1 -- 172.21.15.177:0/1556878826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfe00047d0 msgr2=0x7fdff41385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:52.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdff8e39640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfe00047d0 0x7fdff41385c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:52.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdff8e39640 1 -- 172.21.15.177:0/1556878826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff4137ae0 con 0x7fdff40c8ef0 2023-11-28T20:07:52.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdff963a640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfe00047d0 0x7fdff41385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:52.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdff9e3b640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdff41f7610 0x7fdff406c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:52.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdff8e39640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdff40c8ef0 0x7fdff41f70d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdfe401c880 tx=0x7fdfe40197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:52.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdfe9ffb640 1 -- 172.21.15.177:0/1556878826 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40bd070 con 0x7fdff40c8ef0 2023-11-28T20:07:52.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdfe9ffb640 1 -- 172.21.15.177:0/1556878826 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe4004020 con 0x7fdff40c8ef0 2023-11-28T20:07:52.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdffb89e640 1 -- 172.21.15.177:0/1556878826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff4137dc0 con 0x7fdff40c8ef0 2023-11-28T20:07:52.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdfe9ffb640 1 -- 172.21.15.177:0/1556878826 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40043d0 con 0x7fdff40c8ef0 2023-11-28T20:07:52.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.884+0000 7fdffb89e640 1 -- 172.21.15.177:0/1556878826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff406ca50 con 0x7fdff40c8ef0 2023-11-28T20:07:52.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.888+0000 7fdffb89e640 1 -- 172.21.15.177:0/1556878826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff41f7a20 con 0x7fdff40c8ef0 2023-11-28T20:07:52.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.888+0000 7fdfe9ffb640 1 -- 172.21.15.177:0/1556878826 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdfe40b4070 con 0x7fdff40c8ef0 2023-11-28T20:07:52.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.888+0000 7fdfe9ffb640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdfd80664a0 0x7fdfd8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:52.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.888+0000 7fdfe9ffb640 1 -- 172.21.15.177:0/1556878826 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfe411dbc0 con 0x7fdff40c8ef0 2023-11-28T20:07:52.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.888+0000 7fdff963a640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdfd80664a0 0x7fdfd8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:52.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.888+0000 7fdff963a640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdfd80664a0 0x7fdfd8068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdff00017b0 tx=0x7fdff0004810 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:52.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:52.892+0000 7fdfe9ffb640 1 -- 172.21.15.177:0/1556878826 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdfe40eb030 con 0x7fdff40c8ef0 2023-11-28T20:07:53.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.044+0000 7fdffb89e640 1 -- 172.21.15.177:0/1556878826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdff40693d0 con 0x7fdff40c8ef0 2023-11-28T20:07:53.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.044+0000 7fdfe9ffb640 1 -- 172.21.15.177:0/1556878826 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdfe40ee650 con 0x7fdff40c8ef0 2023-11-28T20:07:53.047 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:07:53.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.044+0000 7fdffb89e640 1 -- 172.21.15.177:0/1556878826 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdfd80664a0 msgr2=0x7fdfd8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.044+0000 7fdffb89e640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdfd80664a0 0x7fdfd8068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdff00017b0 tx=0x7fdff0004810 comp rx=0 tx=0).stop 2023-11-28T20:07:53.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.044+0000 7fdffb89e640 1 -- 172.21.15.177:0/1556878826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdff40c8ef0 msgr2=0x7fdff41f70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.044+0000 7fdffb89e640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdff40c8ef0 0x7fdff41f70d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdfe401c880 tx=0x7fdfe40197f0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.044+0000 7fdffb89e640 1 -- 172.21.15.177:0/1556878826 shutdown_connections 2023-11-28T20:07:53.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.044+0000 7fdffb89e640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdfd80664a0 0x7fdfd8068960 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.044+0000 7fdffb89e640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdff41f7610 0x7fdff406c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.044+0000 7fdffb89e640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdff40c8ef0 0x7fdff41f70d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.044+0000 7fdffb89e640 1 --2- 172.21.15.177:0/1556878826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfe00047d0 0x7fdff41385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.044+0000 7fdffb89e640 1 -- 172.21.15.177:0/1556878826 >> 172.21.15.177:0/1556878826 conn(0x7fdff40b0cc0 msgr2=0x7fdff40cb230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:53.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.044+0000 7fdffb89e640 1 -- 172.21.15.177:0/1556878826 shutdown_connections 2023-11-28T20:07:53.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.044+0000 7fdffb89e640 1 -- 172.21.15.177:0/1556878826 wait complete. 2023-11-28T20:07:53.068 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:07:53.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.200+0000 7f3680f96640 1 Processor -- start 2023-11-28T20:07:53.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.200+0000 7f3680f96640 1 -- start start 2023-11-28T20:07:53.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.204+0000 7f3680f96640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f367c06c9d0 0x7f367c15a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.204+0000 7f3680f96640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367c15b3a0 con 0x7f367c13cf30 2023-11-28T20:07:53.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.204+0000 7f3680f96640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367c13f720 con 0x7f367c15ab70 2023-11-28T20:07:53.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.204+0000 7f3680f96640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367c13d310 con 0x7f367c06c9d0 2023-11-28T20:07:53.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.204+0000 7f3673fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f367c06c9d0 0x7f367c15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:53.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.204+0000 7f3673fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f367c06c9d0 0x7f367c15a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44758/0 (socket says 172.21.15.177:44758) 2023-11-28T20:07:53.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.204+0000 7f3673fff640 1 -- 172.21.15.177:0/41686147 learned_addr learned my addr 172.21.15.177:0/41686147 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:53.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.204+0000 7f3673fff640 1 -- 172.21.15.177:0/41686147 >> v1:172.21.15.195:6789/0 conn(0x7f367c15ab70 legacy=0x7f367c0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.204+0000 7f3673fff640 1 -- 172.21.15.177:0/41686147 >> v1:172.21.15.177:6789/0 conn(0x7f367c13cf30 legacy=0x7f367c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.204+0000 7f3673fff640 1 -- 172.21.15.177:0/41686147 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c13fa00 con 0x7f367c06c9d0 2023-11-28T20:07:53.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.204+0000 7f3673fff640 1 --2- 172.21.15.177:0/41686147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f367c06c9d0 0x7f367c15a630 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3664009870 tx=0x7f366401e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ba37c38a5dcee8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:53.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3679d9b640 1 -- 172.21.15.177:0/41686147 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640ab680 con 0x7f367c06c9d0 2023-11-28T20:07:53.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3679d9b640 1 -- 172.21.15.177:0/41686147 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36640ab7e0 con 0x7f367c06c9d0 2023-11-28T20:07:53.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3679d9b640 1 -- 172.21.15.177:0/41686147 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640abb70 con 0x7f367c06c9d0 2023-11-28T20:07:53.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3680f96640 1 -- 172.21.15.177:0/41686147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f367c06c9d0 msgr2=0x7f367c15a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3680f96640 1 --2- 172.21.15.177:0/41686147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f367c06c9d0 0x7f367c15a630 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3664009870 tx=0x7f366401e6c0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3680f96640 1 -- 172.21.15.177:0/41686147 shutdown_connections 2023-11-28T20:07:53.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3680f96640 1 --2- 172.21.15.177:0/41686147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f367c06c9d0 0x7f367c15a630 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3680f96640 1 -- 172.21.15.177:0/41686147 >> 172.21.15.177:0/41686147 conn(0x7f367c06a530 msgr2=0x7f367c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:53.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3680f96640 1 -- 172.21.15.177:0/41686147 shutdown_connections 2023-11-28T20:07:53.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3680f96640 1 -- 172.21.15.177:0/41686147 wait complete. 2023-11-28T20:07:53.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3680f96640 1 Processor -- start 2023-11-28T20:07:53.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3680f96640 1 -- start start 2023-11-28T20:07:53.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3680f96640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f367c06c9d0 0x7f367c152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3680f96640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f367c13cf30 0x7f367c135b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3680f96640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f367c15ab70 0x7f367c151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3680f96640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c1360b0 con 0x7f367c06c9d0 2023-11-28T20:07:53.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3680f96640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c153240 con 0x7f367c13cf30 2023-11-28T20:07:53.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f3680f96640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367c153520 con 0x7f367c15ab70 2023-11-28T20:07:53.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f367a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f367c06c9d0 0x7f367c152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:53.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f367a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f367c06c9d0 0x7f367c152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44764/0 (socket says 172.21.15.177:44764) 2023-11-28T20:07:53.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.208+0000 7f367a59c640 1 -- 172.21.15.177:0/2198580616 learned_addr learned my addr 172.21.15.177:0/2198580616 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:53.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f367a59c640 1 -- 172.21.15.177:0/2198580616 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f367c15ab70 msgr2=0x7f367c151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f3673fff640 1 --2- 172.21.15.177:0/2198580616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f367c13cf30 0x7f367c135b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:53.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f367a59c640 1 --2- 172.21.15.177:0/2198580616 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f367c15ab70 0x7f367c151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f367a59c640 1 -- 172.21.15.177:0/2198580616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f367c13cf30 msgr2=0x7f367c135b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f367a59c640 1 --2- 172.21.15.177:0/2198580616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f367c13cf30 0x7f367c135b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f367a59c640 1 -- 172.21.15.177:0/2198580616 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36640094d0 con 0x7f367c06c9d0 2023-11-28T20:07:53.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f3673fff640 1 --2- 172.21.15.177:0/2198580616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f367c13cf30 0x7f367c135b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:53.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f367a59c640 1 --2- 172.21.15.177:0/2198580616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f367c06c9d0 0x7f367c152bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f366c00c500 tx=0x7f366c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:53.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f3672ffd640 1 -- 172.21.15.177:0/2198580616 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c005220 con 0x7f367c06c9d0 2023-11-28T20:07:53.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f3672ffd640 1 -- 172.21.15.177:0/2198580616 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366c005380 con 0x7f367c06c9d0 2023-11-28T20:07:53.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f3680f96640 1 -- 172.21.15.177:0/2198580616 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f367c153800 con 0x7f367c06c9d0 2023-11-28T20:07:53.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f3672ffd640 1 -- 172.21.15.177:0/2198580616 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c007270 con 0x7f367c06c9d0 2023-11-28T20:07:53.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f3680f96640 1 -- 172.21.15.177:0/2198580616 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f367c151580 con 0x7f367c06c9d0 2023-11-28T20:07:53.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f3680f96640 1 -- 172.21.15.177:0/2198580616 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f367c0cc6b0 con 0x7f367c06c9d0 2023-11-28T20:07:53.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f3672ffd640 1 -- 172.21.15.177:0/2198580616 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f366c0073d0 con 0x7f367c06c9d0 2023-11-28T20:07:53.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f3672ffd640 1 --2- 172.21.15.177:0/2198580616 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f365c0664a0 0x7f365c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.212+0000 7f3672ffd640 1 -- 172.21.15.177:0/2198580616 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f366c0837b0 con 0x7f367c06c9d0 2023-11-28T20:07:53.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.216+0000 7f3673fff640 1 --2- 172.21.15.177:0/2198580616 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f365c0664a0 0x7f365c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:53.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.216+0000 7f3673fff640 1 --2- 172.21.15.177:0/2198580616 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f365c0664a0 0x7f365c068960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f36640b0000 tx=0x7f3664008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:53.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.216+0000 7f3672ffd640 1 -- 172.21.15.177:0/2198580616 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f366c050ba0 con 0x7f367c06c9d0 2023-11-28T20:07:53.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.400+0000 7f3680f96640 1 -- 172.21.15.177:0/2198580616 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f367c070440 con 0x7f367c06c9d0 2023-11-28T20:07:53.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.400+0000 7f3672ffd640 1 -- 172.21.15.177:0/2198580616 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f367c070440 con 0x7f367c06c9d0 2023-11-28T20:07:53.406 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:53.406 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2688190991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2688190991},{"type":"v1","addr":"172.21.15.177:6835","nonce":2688190991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/17424302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":17424302},{"type":"v1","addr":"172.21.15.177:6837","nonce":17424302}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3833908165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3833908165},{"type":"v1","addr":"172.21.15.195:6834","nonce":3833908165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:07:41.477909+0000","modified":"2023-11-28T20:07:44.615409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6835/1726998944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1726998944},{"type":"v1","addr":"172.21.15.195:6835","nonce":1726998944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T20:07:53.406 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-28T20:07:53.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.404+0000 7f3680f96640 1 -- 172.21.15.177:0/2198580616 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f365c0664a0 msgr2=0x7f365c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.404+0000 7f3680f96640 1 --2- 172.21.15.177:0/2198580616 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f365c0664a0 0x7f365c068960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f36640b0000 tx=0x7f3664008040 comp rx=0 tx=0).stop 2023-11-28T20:07:53.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.404+0000 7f3680f96640 1 -- 172.21.15.177:0/2198580616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f367c06c9d0 msgr2=0x7f367c152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.404+0000 7f3680f96640 1 --2- 172.21.15.177:0/2198580616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f367c06c9d0 0x7f367c152bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f366c00c500 tx=0x7f366c00c9c0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.404+0000 7f3680f96640 1 -- 172.21.15.177:0/2198580616 shutdown_connections 2023-11-28T20:07:53.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.404+0000 7f3680f96640 1 --2- 172.21.15.177:0/2198580616 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f365c0664a0 0x7f365c068960 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.404+0000 7f3680f96640 1 --2- 172.21.15.177:0/2198580616 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f367c15ab70 0x7f367c151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.404+0000 7f3680f96640 1 --2- 172.21.15.177:0/2198580616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f367c13cf30 0x7f367c135b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.404+0000 7f3680f96640 1 --2- 172.21.15.177:0/2198580616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f367c06c9d0 0x7f367c152bb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.404+0000 7f3680f96640 1 -- 172.21.15.177:0/2198580616 >> 172.21.15.177:0/2198580616 conn(0x7f367c06a530 msgr2=0x7f367c13d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:53.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.404+0000 7f3680f96640 1 -- 172.21.15.177:0/2198580616 shutdown_connections 2023-11-28T20:07:53.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.404+0000 7f3680f96640 1 -- 172.21.15.177:0/2198580616 wait complete. 2023-11-28T20:07:53.428 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:07:53.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5ed53f5640 1 Processor -- start 2023-11-28T20:07:53.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5ed53f5640 1 -- start start 2023-11-28T20:07:53.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5ed53f5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ed00cfe90 0x7f5ed00d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5ed53f5640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed00d3880 con 0x7f5ed00b35b0 2023-11-28T20:07:53.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5ed53f5640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed00cdc80 con 0x7f5ed00b3c70 2023-11-28T20:07:53.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5ed53f5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00d4090 con 0x7f5ed00cfe90 2023-11-28T20:07:53.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5eceffd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5ed00b35b0 0x7f5ed00cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51598/0 (socket says 172.21.15.177:51598) 2023-11-28T20:07:53.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5eceffd640 1 -- 172.21.15.177:0/477579132 learned_addr learned my addr 172.21.15.177:0/477579132 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:53.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5ec67fc640 1 --2- 172.21.15.177:0/477579132 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ed00cfe90 0x7f5ed00d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5ece7fc640 1 -- 172.21.15.177:0/477579132 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429582247 0 0) 0x7f5ed00d3880 con 0x7f5ed00b35b0 2023-11-28T20:07:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5ece7fc640 1 -- 172.21.15.177:0/477579132 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ebc003530 con 0x7f5ed00b35b0 2023-11-28T20:07:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5ece7fc640 1 -- 172.21.15.177:0/477579132 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860473970 0 0) 0x7f5ed00cdc80 con 0x7f5ed00b3c70 2023-11-28T20:07:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5ece7fc640 1 -- 172.21.15.177:0/477579132 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed00d3880 con 0x7f5ed00b3c70 2023-11-28T20:07:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5ec67fc640 1 -- 172.21.15.177:0/477579132 >> v1:172.21.15.195:6789/0 conn(0x7f5ed00b3c70 legacy=0x7f5ed00ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5ece7fc640 1 -- 172.21.15.177:0/477579132 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 492325793 0 0) 0x7f5ebc003530 con 0x7f5ed00b35b0 2023-11-28T20:07:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5ec67fc640 1 -- 172.21.15.177:0/477579132 >> v1:172.21.15.177:6789/0 conn(0x7f5ed00b35b0 legacy=0x7f5ed00cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.564+0000 7f5ec67fc640 1 -- 172.21.15.177:0/477579132 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed00d3ad0 con 0x7f5ed00cfe90 2023-11-28T20:07:53.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.568+0000 7f5ec67fc640 1 --2- 172.21.15.177:0/477579132 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ed00cfe90 0x7f5ed00d0f50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009dc0 tx=0x7f5eb801c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99b9e96b1231a328 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:53.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.568+0000 7f5ece7fc640 1 -- 172.21.15.177:0/477579132 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0001680 con 0x7f5ed00cfe90 2023-11-28T20:07:53.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.568+0000 7f5ece7fc640 1 -- 172.21.15.177:0/477579132 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb80a5610 con 0x7f5ed00cfe90 2023-11-28T20:07:53.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.568+0000 7f5ece7fc640 1 -- 172.21.15.177:0/477579132 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb80a59a0 con 0x7f5ed00cfe90 2023-11-28T20:07:53.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.568+0000 7f5ed53f5640 1 -- 172.21.15.177:0/477579132 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ed00cfe90 msgr2=0x7f5ed00d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.568+0000 7f5ed53f5640 1 --2- 172.21.15.177:0/477579132 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ed00cfe90 0x7f5ed00d0f50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009dc0 tx=0x7f5eb801c7d0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.568+0000 7f5ed53f5640 1 -- 172.21.15.177:0/477579132 shutdown_connections 2023-11-28T20:07:53.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.568+0000 7f5ed53f5640 1 --2- 172.21.15.177:0/477579132 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ed00cfe90 0x7f5ed00d0f50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.568+0000 7f5ed53f5640 1 -- 172.21.15.177:0/477579132 >> 172.21.15.177:0/477579132 conn(0x7f5ed009c4b0 msgr2=0x7f5ed00d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:53.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.568+0000 7f5ed53f5640 1 -- 172.21.15.177:0/477579132 shutdown_connections 2023-11-28T20:07:53.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.568+0000 7f5ed53f5640 1 -- 172.21.15.177:0/477579132 wait complete. 2023-11-28T20:07:53.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ed53f5640 1 Processor -- start 2023-11-28T20:07:53.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ed53f5640 1 -- start start 2023-11-28T20:07:53.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ed53f5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ed00b35b0 0x7f5ed0155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ed53f5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ed00b3c70 0x7f5ed0159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ed53f5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ed00cfe90 0x7f5ed01f9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ed53f5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00cbde0 con 0x7f5ed00cfe90 2023-11-28T20:07:53.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ed53f5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00ca7e0 con 0x7f5ed00b3c70 2023-11-28T20:07:53.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ed53f5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00caac0 con 0x7f5ed00b35b0 2023-11-28T20:07:53.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ecf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ed00cfe90 0x7f5ed01f9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:53.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ecf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ed00cfe90 0x7f5ed01f9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44776/0 (socket says 172.21.15.177:44776) 2023-11-28T20:07:53.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ecf7fe640 1 -- 172.21.15.177:0/3000622341 learned_addr learned my addr 172.21.15.177:0/3000622341 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:53.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ec67fc640 1 --2- 172.21.15.177:0/3000622341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ed00b3c70 0x7f5ed0159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:53.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5eceffd640 1 --2- 172.21.15.177:0/3000622341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ed00b35b0 0x7f5ed0155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:53.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ecf7fe640 1 -- 172.21.15.177:0/3000622341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ed00b35b0 msgr2=0x7f5ed0155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ecf7fe640 1 --2- 172.21.15.177:0/3000622341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ed00b35b0 0x7f5ed0155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ecf7fe640 1 -- 172.21.15.177:0/3000622341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ed00b3c70 msgr2=0x7f5ed0159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ecf7fe640 1 --2- 172.21.15.177:0/3000622341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ed00b3c70 0x7f5ed0159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ecf7fe640 1 -- 172.21.15.177:0/3000622341 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb8009a70 con 0x7f5ed00cfe90 2023-11-28T20:07:53.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ecf7fe640 1 --2- 172.21.15.177:0/3000622341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ed00cfe90 0x7f5ed01f9bd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800c3c0 tx=0x7f5ec800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:53.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ec7fff640 1 -- 172.21.15.177:0/3000622341 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80052d0 con 0x7f5ed00cfe90 2023-11-28T20:07:53.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ec7fff640 1 -- 172.21.15.177:0/3000622341 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec8005430 con 0x7f5ed00cfe90 2023-11-28T20:07:53.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ed53f5640 1 -- 172.21.15.177:0/3000622341 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed00cada0 con 0x7f5ed00cfe90 2023-11-28T20:07:53.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ec7fff640 1 -- 172.21.15.177:0/3000622341 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8003840 con 0x7f5ed00cfe90 2023-11-28T20:07:53.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.572+0000 7f5ed53f5640 1 -- 172.21.15.177:0/3000622341 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed015b4d0 con 0x7f5ed00cfe90 2023-11-28T20:07:53.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.576+0000 7f5ed53f5640 1 -- 172.21.15.177:0/3000622341 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed0069440 con 0x7f5ed00cfe90 2023-11-28T20:07:53.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.576+0000 7f5ec7fff640 1 -- 172.21.15.177:0/3000622341 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5ec80039a0 con 0x7f5ed00cfe90 2023-11-28T20:07:53.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.576+0000 7f5ec7fff640 1 --2- 172.21.15.177:0/3000622341 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5eb0066470 0x7f5eb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.576+0000 7f5ec7fff640 1 -- 172.21.15.177:0/3000622341 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ec8083430 con 0x7f5ed00cfe90 2023-11-28T20:07:53.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.576+0000 7f5eceffd640 1 --2- 172.21.15.177:0/3000622341 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5eb0066470 0x7f5eb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:53.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.576+0000 7f5eceffd640 1 --2- 172.21.15.177:0/3000622341 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5eb0066470 0x7f5eb0068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5ec00011f0 tx=0x7f5ec0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:53.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.580+0000 7f5ec7fff640 1 -- 172.21.15.177:0/3000622341 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ec80508a0 con 0x7f5ed00cfe90 2023-11-28T20:07:53.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.732+0000 7f5ed53f5640 1 -- 172.21.15.177:0/3000622341 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ed015ec30 con 0x7f5ed00cfe90 2023-11-28T20:07:53.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.732+0000 7f5ec7fff640 1 -- 172.21.15.177:0/3000622341 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f5ec8053ec0 con 0x7f5ed00cfe90 2023-11-28T20:07:53.735 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:53.736 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:07:53.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.732+0000 7f5ed53f5640 1 -- 172.21.15.177:0/3000622341 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5eb0066470 msgr2=0x7f5eb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.732+0000 7f5ed53f5640 1 --2- 172.21.15.177:0/3000622341 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5eb0066470 0x7f5eb0068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5ec00011f0 tx=0x7f5ec0009040 comp rx=0 tx=0).stop 2023-11-28T20:07:53.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.732+0000 7f5ed53f5640 1 -- 172.21.15.177:0/3000622341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ed00cfe90 msgr2=0x7f5ed01f9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.732+0000 7f5ed53f5640 1 --2- 172.21.15.177:0/3000622341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ed00cfe90 0x7f5ed01f9bd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800c3c0 tx=0x7f5ec800c880 comp rx=0 tx=0).stop 2023-11-28T20:07:53.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.732+0000 7f5ed53f5640 1 -- 172.21.15.177:0/3000622341 shutdown_connections 2023-11-28T20:07:53.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.732+0000 7f5ed53f5640 1 --2- 172.21.15.177:0/3000622341 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5eb0066470 0x7f5eb0068930 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.732+0000 7f5ed53f5640 1 --2- 172.21.15.177:0/3000622341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ed00cfe90 0x7f5ed01f9bd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.732+0000 7f5ed53f5640 1 --2- 172.21.15.177:0/3000622341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ed00b3c70 0x7f5ed0159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.732+0000 7f5ed53f5640 1 --2- 172.21.15.177:0/3000622341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ed00b35b0 0x7f5ed0155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.732+0000 7f5ed53f5640 1 -- 172.21.15.177:0/3000622341 >> 172.21.15.177:0/3000622341 conn(0x7f5ed009c4b0 msgr2=0x7f5ed00d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:53.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.732+0000 7f5ed53f5640 1 -- 172.21.15.177:0/3000622341 shutdown_connections 2023-11-28T20:07:53.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.732+0000 7f5ed53f5640 1 -- 172.21.15.177:0/3000622341 wait complete. 2023-11-28T20:07:53.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:07:53.757 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:07:53.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.892+0000 7f3eedcea640 1 Processor -- start 2023-11-28T20:07:53.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.892+0000 7f3eedcea640 1 -- start start 2023-11-28T20:07:53.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.896+0000 7f3eedcea640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3ee8158ca0 0x7f3ee815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.896+0000 7f3eedcea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ee80cba10 0x7f3ee815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.896+0000 7f3eedcea640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee815b670 con 0x7f3ee80b42d0 2023-11-28T20:07:53.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.896+0000 7f3eedcea640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee815f410 con 0x7f3ee8158ca0 2023-11-28T20:07:53.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.896+0000 7f3eedcea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee815f6f0 con 0x7f3ee80cba10 2023-11-28T20:07:53.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.896+0000 7f3ee77fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3ee8158ca0 0x7f3ee815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:53.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.896+0000 7f3ee77fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3ee8158ca0 0x7f3ee815eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44784/0 (socket says 172.21.15.177:44784) 2023-11-28T20:07:53.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.896+0000 7f3ee77fe640 1 -- 172.21.15.177:0/4271370908 learned_addr learned my addr 172.21.15.177:0/4271370908 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:53.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.896+0000 7f3ee6ffd640 1 --2- 172.21.15.177:0/4271370908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ee80cba10 0x7f3ee815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:53.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.896+0000 7f3ee77fe640 1 -- 172.21.15.177:0/4271370908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ee80cba10 msgr2=0x7f3ee815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:53.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.896+0000 7f3ee77fe640 1 --2- 172.21.15.177:0/4271370908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ee80cba10 0x7f3ee815be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.896+0000 7f3ee77fe640 1 -- 172.21.15.177:0/4271370908 >> v1:172.21.15.177:6789/0 conn(0x7f3ee80b42d0 legacy=0x7f3ee80703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.896+0000 7f3ee77fe640 1 -- 172.21.15.177:0/4271370908 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee815b8e0 con 0x7f3ee8158ca0 2023-11-28T20:07:53.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.900+0000 7f3ee77fe640 1 --2- 172.21.15.177:0/4271370908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee8158ca0 0x7f3ee815eb50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009870 tx=0x7f3ed801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf50b37d99302ddb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:53.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.900+0000 7f3ee67fc640 1 -- 172.21.15.177:0/4271370908 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80a9620 con 0x7f3ee8158ca0 2023-11-28T20:07:53.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.900+0000 7f3ee67fc640 1 -- 172.21.15.177:0/4271370908 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed80a9780 con 0x7f3ee8158ca0 2023-11-28T20:07:53.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.900+0000 7f3ee67fc640 1 -- 172.21.15.177:0/4271370908 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80a9b10 con 0x7f3ee8158ca0 2023-11-28T20:07:53.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.900+0000 7f3eedcea640 1 -- 172.21.15.177:0/4271370908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee8158ca0 msgr2=0x7f3ee815eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.900+0000 7f3eedcea640 1 --2- 172.21.15.177:0/4271370908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee8158ca0 0x7f3ee815eb50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009870 tx=0x7f3ed801c540 comp rx=0 tx=0).stop 2023-11-28T20:07:53.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.900+0000 7f3eedcea640 1 -- 172.21.15.177:0/4271370908 shutdown_connections 2023-11-28T20:07:53.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.900+0000 7f3eedcea640 1 --2- 172.21.15.177:0/4271370908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ee80cba10 0x7f3ee815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.900+0000 7f3eedcea640 1 --2- 172.21.15.177:0/4271370908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee8158ca0 0x7f3ee815eb50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.900+0000 7f3eedcea640 1 -- 172.21.15.177:0/4271370908 >> 172.21.15.177:0/4271370908 conn(0x7f3ee80b0cc0 msgr2=0x7f3ee80b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:53.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.900+0000 7f3eedcea640 1 -- 172.21.15.177:0/4271370908 shutdown_connections 2023-11-28T20:07:53.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.900+0000 7f3eedcea640 1 -- 172.21.15.177:0/4271370908 wait complete. 2023-11-28T20:07:53.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.900+0000 7f3eedcea640 1 Processor -- start 2023-11-28T20:07:53.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.900+0000 7f3eedcea640 1 -- start start 2023-11-28T20:07:53.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3eedcea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ee80b42d0 0x7f3ee8152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3eedcea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee80cba10 0x7f3ee814b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3eedcea640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ee8158ca0 0x7f3ee81574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3eedcea640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee8152e90 con 0x7f3ee80cba10 2023-11-28T20:07:53.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3eedcea640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee814d020 con 0x7f3ee8158ca0 2023-11-28T20:07:53.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3eedcea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee814d300 con 0x7f3ee80b42d0 2023-11-28T20:07:53.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3ee6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee80cba10 0x7f3ee814b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:53.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3ee6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee80cba10 0x7f3ee814b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44798/0 (socket says 172.21.15.177:44798) 2023-11-28T20:07:53.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3ee6ffd640 1 -- 172.21.15.177:0/1856702288 learned_addr learned my addr 172.21.15.177:0/1856702288 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:53.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3ee7fff640 1 --2- 172.21.15.177:0/1856702288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ee8158ca0 0x7f3ee81574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:53.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3ee77fe640 1 --2- 172.21.15.177:0/1856702288 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ee80b42d0 0x7f3ee8152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:53.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3ee6ffd640 1 -- 172.21.15.177:0/1856702288 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ee80b42d0 msgr2=0x7f3ee8152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3ee6ffd640 1 --2- 172.21.15.177:0/1856702288 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ee80b42d0 0x7f3ee8152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3ee6ffd640 1 -- 172.21.15.177:0/1856702288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ee8158ca0 msgr2=0x7f3ee81574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:53.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3ee6ffd640 1 --2- 172.21.15.177:0/1856702288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ee8158ca0 0x7f3ee81574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:53.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3ee6ffd640 1 -- 172.21.15.177:0/1856702288 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed80094d0 con 0x7f3ee80cba10 2023-11-28T20:07:53.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3ee6ffd640 1 --2- 172.21.15.177:0/1856702288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee80cba10 0x7f3ee814b820 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00d7d0 tx=0x7f3edc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:53.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3ecffff640 1 -- 172.21.15.177:0/1856702288 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00b6c0 con 0x7f3ee80cba10 2023-11-28T20:07:53.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3ecffff640 1 -- 172.21.15.177:0/1856702288 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc00b820 con 0x7f3ee80cba10 2023-11-28T20:07:53.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3ecffff640 1 -- 172.21.15.177:0/1856702288 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00bbd0 con 0x7f3ee80cba10 2023-11-28T20:07:53.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3eedcea640 1 -- 172.21.15.177:0/1856702288 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee815d7c0 con 0x7f3ee80cba10 2023-11-28T20:07:53.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3eedcea640 1 -- 172.21.15.177:0/1856702288 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee815dd80 con 0x7f3ee80cba10 2023-11-28T20:07:53.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3eedcea640 1 -- 172.21.15.177:0/1856702288 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee815df40 con 0x7f3ee80cba10 2023-11-28T20:07:53.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.904+0000 7f3ecffff640 1 -- 172.21.15.177:0/1856702288 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3edc00bd30 con 0x7f3ee80cba10 2023-11-28T20:07:53.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.908+0000 7f3ecffff640 1 --2- 172.21.15.177:0/1856702288 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3ed4066470 0x7f3ed4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:53.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.908+0000 7f3ecffff640 1 -- 172.21.15.177:0/1856702288 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3edc0843d0 con 0x7f3ee80cba10 2023-11-28T20:07:53.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.908+0000 7f3ee77fe640 1 --2- 172.21.15.177:0/1856702288 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3ed4066470 0x7f3ed4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:53.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.908+0000 7f3ee77fe640 1 --2- 172.21.15.177:0/1856702288 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3ed4066470 0x7f3ed4068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80ae000 tx=0x7f3ed80b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:53.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:53.912+0000 7f3ecffff640 1 -- 172.21.15.177:0/1856702288 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3edc051840 con 0x7f3ee80cba10 2023-11-28T20:07:54.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.064+0000 7f3eedcea640 1 -- 172.21.15.177:0/1856702288 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3ee80693d0 con 0x7f3ee80cba10 2023-11-28T20:07:54.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.064+0000 7f3ecffff640 1 -- 172.21.15.177:0/1856702288 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3edc054e60 con 0x7f3ee80cba10 2023-11-28T20:07:54.067 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:07:54.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.064+0000 7f3eedcea640 1 -- 172.21.15.177:0/1856702288 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3ed4066470 msgr2=0x7f3ed4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.064+0000 7f3eedcea640 1 --2- 172.21.15.177:0/1856702288 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3ed4066470 0x7f3ed4068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80ae000 tx=0x7f3ed80b3040 comp rx=0 tx=0).stop 2023-11-28T20:07:54.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.064+0000 7f3eedcea640 1 -- 172.21.15.177:0/1856702288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee80cba10 msgr2=0x7f3ee814b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.064+0000 7f3eedcea640 1 --2- 172.21.15.177:0/1856702288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee80cba10 0x7f3ee814b820 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00d7d0 tx=0x7f3edc00dc90 comp rx=0 tx=0).stop 2023-11-28T20:07:54.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.064+0000 7f3eedcea640 1 -- 172.21.15.177:0/1856702288 shutdown_connections 2023-11-28T20:07:54.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.064+0000 7f3eedcea640 1 --2- 172.21.15.177:0/1856702288 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3ed4066470 0x7f3ed4068930 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.064+0000 7f3eedcea640 1 --2- 172.21.15.177:0/1856702288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ee8158ca0 0x7f3ee81574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.064+0000 7f3eedcea640 1 --2- 172.21.15.177:0/1856702288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ee80cba10 0x7f3ee814b820 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.064+0000 7f3eedcea640 1 --2- 172.21.15.177:0/1856702288 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ee80b42d0 0x7f3ee8152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.064+0000 7f3eedcea640 1 -- 172.21.15.177:0/1856702288 >> 172.21.15.177:0/1856702288 conn(0x7f3ee80b0cc0 msgr2=0x7f3ee815a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:54.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.064+0000 7f3eedcea640 1 -- 172.21.15.177:0/1856702288 shutdown_connections 2023-11-28T20:07:54.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.064+0000 7f3eedcea640 1 -- 172.21.15.177:0/1856702288 wait complete. 2023-11-28T20:07:54.088 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:07:54.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f236a3d1640 1 Processor -- start 2023-11-28T20:07:54.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f236a3d1640 1 -- start start 2023-11-28T20:07:54.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f236a3d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2364158ca0 0x7f236415eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f236a3d1640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f23640cba10 0x7f236415be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f236a3d1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f23640b42d0 0x7f23640b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f236a3d1640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23640b4c40 con 0x7f23640cba10 2023-11-28T20:07:54.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f236a3d1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236415b670 con 0x7f23640b42d0 2023-11-28T20:07:54.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f236a3d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236415f410 con 0x7f2364158ca0 2023-11-28T20:07:54.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f23637fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f23640cba10 0x7f236415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f23637fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f23640cba10 0x7f236415be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44808/0 (socket says 172.21.15.177:44808) 2023-11-28T20:07:54.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f23637fe640 1 -- 172.21.15.177:0/1149517561 learned_addr learned my addr 172.21.15.177:0/1149517561 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:54.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f2363fff640 1 --2- 172.21.15.177:0/1149517561 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2364158ca0 0x7f236415eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f236896e640 1 --2- 172.21.15.177:0/1149517561 >> v2:172.21.15.195:3300/0 conn(0x7f23640b42d0 0x7f23640b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f23637fe640 1 -- 172.21.15.177:0/1149517561 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2364158ca0 msgr2=0x7f236415eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:54.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f23637fe640 1 --2- 172.21.15.177:0/1149517561 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2364158ca0 0x7f236415eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f23637fe640 1 -- 172.21.15.177:0/1149517561 >> v2:172.21.15.195:3300/0 conn(0x7f23640b42d0 msgr2=0x7f23640b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:54.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f23637fe640 1 --2- 172.21.15.177:0/1149517561 >> v2:172.21.15.195:3300/0 conn(0x7f23640b42d0 0x7f23640b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.224+0000 7f23637fe640 1 -- 172.21.15.177:0/1149517561 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236415f6f0 con 0x7f23640cba10 2023-11-28T20:07:54.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.228+0000 7f23637fe640 1 --2- 172.21.15.177:0/1149517561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23640cba10 0x7f236415be00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f23640725c0 tx=0x7f235801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63d6b06bb889f36 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:54.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.228+0000 7f2362ffd640 1 -- 172.21.15.177:0/1149517561 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23580aa610 con 0x7f23640cba10 2023-11-28T20:07:54.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.228+0000 7f2362ffd640 1 -- 172.21.15.177:0/1149517561 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23580a6040 con 0x7f23640cba10 2023-11-28T20:07:54.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.228+0000 7f2362ffd640 1 -- 172.21.15.177:0/1149517561 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23580aa990 con 0x7f23640cba10 2023-11-28T20:07:54.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.228+0000 7f236a3d1640 1 -- 172.21.15.177:0/1149517561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23640cba10 msgr2=0x7f236415be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.228+0000 7f236a3d1640 1 --2- 172.21.15.177:0/1149517561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23640cba10 0x7f236415be00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f23640725c0 tx=0x7f235801c4d0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.228+0000 7f236a3d1640 1 -- 172.21.15.177:0/1149517561 shutdown_connections 2023-11-28T20:07:54.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.228+0000 7f236a3d1640 1 --2- 172.21.15.177:0/1149517561 >> v2:172.21.15.195:3300/0 conn(0x7f23640b42d0 0x7f23640b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.228+0000 7f236a3d1640 1 --2- 172.21.15.177:0/1149517561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23640cba10 0x7f236415be00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.228+0000 7f236a3d1640 1 --2- 172.21.15.177:0/1149517561 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2364158ca0 0x7f236415eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.228+0000 7f236a3d1640 1 -- 172.21.15.177:0/1149517561 >> 172.21.15.177:0/1149517561 conn(0x7f23640b0cc0 msgr2=0x7f23640b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:54.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.228+0000 7f236a3d1640 1 -- 172.21.15.177:0/1149517561 shutdown_connections 2023-11-28T20:07:54.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.228+0000 7f236a3d1640 1 -- 172.21.15.177:0/1149517561 wait complete. 2023-11-28T20:07:54.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236a3d1640 1 Processor -- start 2023-11-28T20:07:54.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236a3d1640 1 -- start start 2023-11-28T20:07:54.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236a3d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23640b42d0 0x7f23641454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236a3d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23640cba10 0x7f23640cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236a3d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2364158ca0 0x7f23640cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236a3d1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23640b09c0 con 0x7f2364158ca0 2023-11-28T20:07:54.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236a3d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2364148480 con 0x7f23640b42d0 2023-11-28T20:07:54.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236a3d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23640afdb0 con 0x7f23640cba10 2023-11-28T20:07:54.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236896e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2364158ca0 0x7f23640cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236896e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2364158ca0 0x7f23640cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44814/0 (socket says 172.21.15.177:44814) 2023-11-28T20:07:54.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236896e640 1 -- 172.21.15.177:0/3300774961 learned_addr learned my addr 172.21.15.177:0/3300774961 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:54.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f23637fe640 1 --2- 172.21.15.177:0/3300774961 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23640cba10 0x7f23640cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f2363fff640 1 --2- 172.21.15.177:0/3300774961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23640b42d0 0x7f23641454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236896e640 1 -- 172.21.15.177:0/3300774961 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23640cba10 msgr2=0x7f23640cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236896e640 1 --2- 172.21.15.177:0/3300774961 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23640cba10 0x7f23640cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236896e640 1 -- 172.21.15.177:0/3300774961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23640b42d0 msgr2=0x7f23641454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236896e640 1 --2- 172.21.15.177:0/3300774961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23640b42d0 0x7f23641454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236896e640 1 -- 172.21.15.177:0/3300774961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23580094d0 con 0x7f2364158ca0 2023-11-28T20:07:54.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236896e640 1 --2- 172.21.15.177:0/3300774961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2364158ca0 0x7f23640cce00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f235c00efc0 tx=0x7f235c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:54.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f2360ff9640 1 -- 172.21.15.177:0/3300774961 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c014480 con 0x7f2364158ca0 2023-11-28T20:07:54.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f2360ff9640 1 -- 172.21.15.177:0/3300774961 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c00f040 con 0x7f2364158ca0 2023-11-28T20:07:54.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236a3d1640 1 -- 172.21.15.177:0/3300774961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23640b0090 con 0x7f2364158ca0 2023-11-28T20:07:54.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f2360ff9640 1 -- 172.21.15.177:0/3300774961 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c014820 con 0x7f2364158ca0 2023-11-28T20:07:54.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.232+0000 7f236a3d1640 1 -- 172.21.15.177:0/3300774961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23640b0650 con 0x7f2364158ca0 2023-11-28T20:07:54.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.236+0000 7f236a3d1640 1 -- 172.21.15.177:0/3300774961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23640693d0 con 0x7f2364158ca0 2023-11-28T20:07:54.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.236+0000 7f2360ff9640 1 -- 172.21.15.177:0/3300774961 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f235c014980 con 0x7f2364158ca0 2023-11-28T20:07:54.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.236+0000 7f2360ff9640 1 --2- 172.21.15.177:0/3300774961 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2350066470 0x7f2350068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.236+0000 7f2360ff9640 1 -- 172.21.15.177:0/3300774961 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f235c084c10 con 0x7f2364158ca0 2023-11-28T20:07:54.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.236+0000 7f2363fff640 1 --2- 172.21.15.177:0/3300774961 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2350066470 0x7f2350068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.236+0000 7f2363fff640 1 --2- 172.21.15.177:0/3300774961 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2350066470 0x7f2350068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f23640710d0 tx=0x7f2354009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:54.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.240+0000 7f2360ff9640 1 -- 172.21.15.177:0/3300774961 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f235c052130 con 0x7f2364158ca0 2023-11-28T20:07:54.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.392+0000 7f236a3d1640 1 -- 172.21.15.177:0/3300774961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2364144dc0 con 0x7f2364158ca0 2023-11-28T20:07:54.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.392+0000 7f2360ff9640 1 -- 172.21.15.177:0/3300774961 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f235c018020 con 0x7f2364158ca0 2023-11-28T20:07:54.396 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:07:54.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.392+0000 7f236a3d1640 1 -- 172.21.15.177:0/3300774961 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2350066470 msgr2=0x7f2350068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.392+0000 7f236a3d1640 1 --2- 172.21.15.177:0/3300774961 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2350066470 0x7f2350068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f23640710d0 tx=0x7f2354009190 comp rx=0 tx=0).stop 2023-11-28T20:07:54.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.392+0000 7f236a3d1640 1 -- 172.21.15.177:0/3300774961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2364158ca0 msgr2=0x7f23640cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.392+0000 7f236a3d1640 1 --2- 172.21.15.177:0/3300774961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2364158ca0 0x7f23640cce00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f235c00efc0 tx=0x7f235c00c490 comp rx=0 tx=0).stop 2023-11-28T20:07:54.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.392+0000 7f236a3d1640 1 -- 172.21.15.177:0/3300774961 shutdown_connections 2023-11-28T20:07:54.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.392+0000 7f236a3d1640 1 --2- 172.21.15.177:0/3300774961 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2350066470 0x7f2350068930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.392+0000 7f236a3d1640 1 --2- 172.21.15.177:0/3300774961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2364158ca0 0x7f23640cce00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.392+0000 7f236a3d1640 1 --2- 172.21.15.177:0/3300774961 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23640cba10 0x7f23640cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.392+0000 7f236a3d1640 1 --2- 172.21.15.177:0/3300774961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23640b42d0 0x7f23641454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.392+0000 7f236a3d1640 1 -- 172.21.15.177:0/3300774961 >> 172.21.15.177:0/3300774961 conn(0x7f23640b0cc0 msgr2=0x7f23641591a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:54.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.396+0000 7f236a3d1640 1 -- 172.21.15.177:0/3300774961 shutdown_connections 2023-11-28T20:07:54.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.396+0000 7f236a3d1640 1 -- 172.21.15.177:0/3300774961 wait complete. 2023-11-28T20:07:54.417 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:07:54.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.552+0000 7f946f8ad640 1 Processor -- start 2023-11-28T20:07:54.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.552+0000 7f946f8ad640 1 -- start start 2023-11-28T20:07:54.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.556+0000 7f946f8ad640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94681571d0 0x7f9468070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.556+0000 7f946f8ad640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f94680ae830 0x7f946815d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.556+0000 7f946f8ad640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94681575b0 con 0x7f946815d710 2023-11-28T20:07:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.556+0000 7f946f8ad640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946815dba0 con 0x7f94680ae830 2023-11-28T20:07:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.556+0000 7f946f8ad640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9468071600 con 0x7f94681571d0 2023-11-28T20:07:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.556+0000 7f946ce48640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f94680ae830 0x7f946815d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.556+0000 7f946ce48640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f94680ae830 0x7f946815d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44822/0 (socket says 172.21.15.177:44822) 2023-11-28T20:07:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.556+0000 7f946ce48640 1 -- 172.21.15.177:0/1982440350 learned_addr learned my addr 172.21.15.177:0/1982440350 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.556+0000 7f946de4a640 1 --1- 172.21.15.177:0/1982440350 >> v1:172.21.15.177:6789/0 conn(0x7f946815d710 0x7f9468159be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51610/0 (socket says 172.21.15.177:51610) 2023-11-28T20:07:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.556+0000 7f946d649640 1 --2- 172.21.15.177:0/1982440350 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94681571d0 0x7f9468070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.556+0000 7f946ce48640 1 -- 172.21.15.177:0/1982440350 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94681571d0 msgr2=0x7f9468070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.556+0000 7f946ce48640 1 --2- 172.21.15.177:0/1982440350 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94681571d0 0x7f9468070c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.556+0000 7f946ce48640 1 -- 172.21.15.177:0/1982440350 >> v1:172.21.15.177:6789/0 conn(0x7f946815d710 legacy=0x7f9468159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.556+0000 7f946ce48640 1 -- 172.21.15.177:0/1982440350 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94680718e0 con 0x7f94680ae830 2023-11-28T20:07:54.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.560+0000 7f946ce48640 1 --2- 172.21.15.177:0/1982440350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94680ae830 0x7f946815d1d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9458009870 tx=0x7f945801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90d799f63259835 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:54.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.560+0000 7f945ffff640 1 -- 172.21.15.177:0/1982440350 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580a7070 con 0x7f94680ae830 2023-11-28T20:07:54.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.560+0000 7f945ffff640 1 -- 172.21.15.177:0/1982440350 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94580ab430 con 0x7f94680ae830 2023-11-28T20:07:54.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.560+0000 7f945ffff640 1 -- 172.21.15.177:0/1982440350 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580ab7c0 con 0x7f94680ae830 2023-11-28T20:07:54.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.560+0000 7f946f8ad640 1 -- 172.21.15.177:0/1982440350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94680ae830 msgr2=0x7f946815d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.560+0000 7f946f8ad640 1 --2- 172.21.15.177:0/1982440350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94680ae830 0x7f946815d1d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9458009870 tx=0x7f945801c4b0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.560+0000 7f946f8ad640 1 -- 172.21.15.177:0/1982440350 shutdown_connections 2023-11-28T20:07:54.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.560+0000 7f946f8ad640 1 --2- 172.21.15.177:0/1982440350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94680ae830 0x7f946815d1d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.560+0000 7f946f8ad640 1 --2- 172.21.15.177:0/1982440350 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94681571d0 0x7f9468070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.560+0000 7f946f8ad640 1 -- 172.21.15.177:0/1982440350 >> 172.21.15.177:0/1982440350 conn(0x7f94680b0cc0 msgr2=0x7f94680b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:54.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.560+0000 7f946f8ad640 1 -- 172.21.15.177:0/1982440350 shutdown_connections 2023-11-28T20:07:54.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.560+0000 7f946f8ad640 1 -- 172.21.15.177:0/1982440350 wait complete. 2023-11-28T20:07:54.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.560+0000 7f946f8ad640 1 Processor -- start 2023-11-28T20:07:54.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.560+0000 7f946f8ad640 1 -- start start 2023-11-28T20:07:54.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946f8ad640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94680ae830 0x7f94680c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946f8ad640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94681571d0 0x7f94680c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946f8ad640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946815d710 0x7f946815cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946f8ad640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94680c79b0 con 0x7f946815d710 2023-11-28T20:07:54.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946f8ad640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94680c8fd0 con 0x7f94680ae830 2023-11-28T20:07:54.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946f8ad640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94680c92b0 con 0x7f94681571d0 2023-11-28T20:07:54.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946de4a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946815d710 0x7f946815cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946de4a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946815d710 0x7f946815cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44824/0 (socket says 172.21.15.177:44824) 2023-11-28T20:07:54.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946de4a640 1 -- 172.21.15.177:0/3899207386 learned_addr learned my addr 172.21.15.177:0/3899207386 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:54.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946ce48640 1 --2- 172.21.15.177:0/3899207386 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94681571d0 0x7f94680c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946d649640 1 --2- 172.21.15.177:0/3899207386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94680ae830 0x7f94680c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946de4a640 1 -- 172.21.15.177:0/3899207386 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94681571d0 msgr2=0x7f94680c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946de4a640 1 --2- 172.21.15.177:0/3899207386 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94681571d0 0x7f94680c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946de4a640 1 -- 172.21.15.177:0/3899207386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94680ae830 msgr2=0x7f94680c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946de4a640 1 --2- 172.21.15.177:0/3899207386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94680ae830 0x7f94680c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946de4a640 1 -- 172.21.15.177:0/3899207386 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94580094d0 con 0x7f946815d710 2023-11-28T20:07:54.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946d649640 1 --2- 172.21.15.177:0/3899207386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94680ae830 0x7f94680c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:54.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946de4a640 1 --2- 172.21.15.177:0/3899207386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946815d710 0x7f946815cbf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f946000c700 tx=0x7f946000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:54.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f945dffb640 1 -- 172.21.15.177:0/3899207386 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946000ce10 con 0x7f946815d710 2023-11-28T20:07:54.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f945dffb640 1 -- 172.21.15.177:0/3899207386 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946000a640 con 0x7f946815d710 2023-11-28T20:07:54.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f945dffb640 1 -- 172.21.15.177:0/3899207386 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946000a9b0 con 0x7f946815d710 2023-11-28T20:07:54.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946f8ad640 1 -- 172.21.15.177:0/3899207386 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94680c9590 con 0x7f946815d710 2023-11-28T20:07:54.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946f8ad640 1 -- 172.21.15.177:0/3899207386 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94680c9b50 con 0x7f946815d710 2023-11-28T20:07:54.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f946f8ad640 1 -- 172.21.15.177:0/3899207386 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94680693d0 con 0x7f946815d710 2023-11-28T20:07:54.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.564+0000 7f945dffb640 1 -- 172.21.15.177:0/3899207386 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f946000ab10 con 0x7f946815d710 2023-11-28T20:07:54.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.568+0000 7f945dffb640 1 --2- 172.21.15.177:0/3899207386 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f944c066470 0x7f944c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.568+0000 7f945dffb640 1 -- 172.21.15.177:0/3899207386 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9460083510 con 0x7f946815d710 2023-11-28T20:07:54.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.568+0000 7f946d649640 1 --2- 172.21.15.177:0/3899207386 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f944c066470 0x7f944c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.568+0000 7f946d649640 1 --2- 172.21.15.177:0/3899207386 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f944c066470 0x7f944c068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9464007a70 tx=0x7f9464008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:54.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.572+0000 7f945dffb640 1 -- 172.21.15.177:0/3899207386 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9460050a40 con 0x7f946815d710 2023-11-28T20:07:54.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.720+0000 7f946f8ad640 1 -- 172.21.15.177:0/3899207386 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94680c9d40 con 0x7f946815d710 2023-11-28T20:07:54.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.720+0000 7f945dffb640 1 -- 172.21.15.177:0/3899207386 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9460081e60 con 0x7f946815d710 2023-11-28T20:07:54.723 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:07:54.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.720+0000 7f946f8ad640 1 -- 172.21.15.177:0/3899207386 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f944c066470 msgr2=0x7f944c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.720+0000 7f946f8ad640 1 --2- 172.21.15.177:0/3899207386 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f944c066470 0x7f944c068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9464007a70 tx=0x7f9464008040 comp rx=0 tx=0).stop 2023-11-28T20:07:54.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.720+0000 7f946f8ad640 1 -- 172.21.15.177:0/3899207386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946815d710 msgr2=0x7f946815cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.720+0000 7f946f8ad640 1 --2- 172.21.15.177:0/3899207386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946815d710 0x7f946815cbf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f946000c700 tx=0x7f946000cbc0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.720+0000 7f946f8ad640 1 -- 172.21.15.177:0/3899207386 shutdown_connections 2023-11-28T20:07:54.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.720+0000 7f946f8ad640 1 --2- 172.21.15.177:0/3899207386 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f944c066470 0x7f944c068930 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.720+0000 7f946f8ad640 1 --2- 172.21.15.177:0/3899207386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946815d710 0x7f946815cbf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.720+0000 7f946f8ad640 1 --2- 172.21.15.177:0/3899207386 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94681571d0 0x7f94680c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.720+0000 7f946f8ad640 1 --2- 172.21.15.177:0/3899207386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94680ae830 0x7f94680c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.720+0000 7f946f8ad640 1 -- 172.21.15.177:0/3899207386 >> 172.21.15.177:0/3899207386 conn(0x7f94680b0cc0 msgr2=0x7f94680aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:54.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.720+0000 7f946f8ad640 1 -- 172.21.15.177:0/3899207386 shutdown_connections 2023-11-28T20:07:54.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.720+0000 7f946f8ad640 1 -- 172.21.15.177:0/3899207386 wait complete. 2023-11-28T20:07:54.744 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:07:54.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.876+0000 7fe8679c4640 1 Processor -- start 2023-11-28T20:07:54.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.876+0000 7fe8679c4640 1 -- start start 2023-11-28T20:07:54.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.880+0000 7fe8679c4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe86006c2c0 0x7fe86006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.880+0000 7fe8679c4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8601408c0 con 0x7fe860140180 2023-11-28T20:07:54.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.880+0000 7fe8679c4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86015db80 con 0x7fe8600b3400 2023-11-28T20:07:54.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.880+0000 7fe8679c4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86006ccb0 con 0x7fe86006c2c0 2023-11-28T20:07:54.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.880+0000 7fe864f5f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe86006c2c0 0x7fe86006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.880+0000 7fe864f5f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe86006c2c0 0x7fe86006c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44840/0 (socket says 172.21.15.177:44840) 2023-11-28T20:07:54.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.880+0000 7fe864f5f640 1 -- 172.21.15.177:0/2327220411 learned_addr learned my addr 172.21.15.177:0/2327220411 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:54.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.880+0000 7fe864f5f640 1 -- 172.21.15.177:0/2327220411 >> v1:172.21.15.195:6789/0 conn(0x7fe8600b3400 legacy=0x7fe8600b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.880+0000 7fe864f5f640 1 -- 172.21.15.177:0/2327220411 >> v1:172.21.15.177:6789/0 conn(0x7fe860140180 legacy=0x7fe860071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.880+0000 7fe864f5f640 1 -- 172.21.15.177:0/2327220411 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86015de60 con 0x7fe86006c2c0 2023-11-28T20:07:54.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.884+0000 7fe864f5f640 1 --2- 172.21.15.177:0/2327220411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe86006c2c0 0x7fe86006c770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe850009870 tx=0x7fe85001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa754e946d228778 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:54.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.884+0000 7fe857fff640 1 -- 172.21.15.177:0/2327220411 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8500ab680 con 0x7fe86006c2c0 2023-11-28T20:07:54.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.884+0000 7fe857fff640 1 -- 172.21.15.177:0/2327220411 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8500ab7e0 con 0x7fe86006c2c0 2023-11-28T20:07:54.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.884+0000 7fe857fff640 1 -- 172.21.15.177:0/2327220411 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8500abb70 con 0x7fe86006c2c0 2023-11-28T20:07:54.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.884+0000 7fe8679c4640 1 -- 172.21.15.177:0/2327220411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe86006c2c0 msgr2=0x7fe86006c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.884+0000 7fe8679c4640 1 --2- 172.21.15.177:0/2327220411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe86006c2c0 0x7fe86006c770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe850009870 tx=0x7fe85001c480 comp rx=0 tx=0).stop 2023-11-28T20:07:54.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.884+0000 7fe8679c4640 1 -- 172.21.15.177:0/2327220411 shutdown_connections 2023-11-28T20:07:54.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.884+0000 7fe8679c4640 1 --2- 172.21.15.177:0/2327220411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe86006c2c0 0x7fe86006c770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.884+0000 7fe8679c4640 1 -- 172.21.15.177:0/2327220411 >> 172.21.15.177:0/2327220411 conn(0x7fe86006a530 msgr2=0x7fe86006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:54.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.884+0000 7fe8679c4640 1 -- 172.21.15.177:0/2327220411 shutdown_connections 2023-11-28T20:07:54.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.884+0000 7fe8679c4640 1 -- 172.21.15.177:0/2327220411 wait complete. 2023-11-28T20:07:54.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.884+0000 7fe8679c4640 1 Processor -- start 2023-11-28T20:07:54.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.884+0000 7fe8679c4640 1 -- start start 2023-11-28T20:07:54.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe8679c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe86006c2c0 0x7fe86015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe8679c4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8600b3400 0x7fe86013a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe8679c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe860140180 0x7fe86013aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe8679c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86013b010 con 0x7fe86006c2c0 2023-11-28T20:07:54.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe8679c4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe860157000 con 0x7fe8600b3400 2023-11-28T20:07:54.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe8679c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86015c130 con 0x7fe860140180 2023-11-28T20:07:54.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe865760640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe86006c2c0 0x7fe86015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe865760640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe86006c2c0 0x7fe86015cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44844/0 (socket says 172.21.15.177:44844) 2023-11-28T20:07:54.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe865760640 1 -- 172.21.15.177:0/345431573 learned_addr learned my addr 172.21.15.177:0/345431573 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:54.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe865760640 1 -- 172.21.15.177:0/345431573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe860140180 msgr2=0x7fe86013aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe865760640 1 --2- 172.21.15.177:0/345431573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe860140180 0x7fe86013aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe865760640 1 -- 172.21.15.177:0/345431573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8600b3400 msgr2=0x7fe86013a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:54.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe865760640 1 --2- 172.21.15.177:0/345431573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8600b3400 0x7fe86013a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:54.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe865760640 1 -- 172.21.15.177:0/345431573 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8500094d0 con 0x7fe86006c2c0 2023-11-28T20:07:54.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe865760640 1 --2- 172.21.15.177:0/345431573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe86006c2c0 0x7fe86015cbf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00c500 tx=0x7fe85c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:54.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe855ffb640 1 -- 172.21.15.177:0/345431573 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c005220 con 0x7fe86006c2c0 2023-11-28T20:07:54.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe855ffb640 1 -- 172.21.15.177:0/345431573 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c005380 con 0x7fe86006c2c0 2023-11-28T20:07:54.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe8679c4640 1 -- 172.21.15.177:0/345431573 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86015c410 con 0x7fe86006c2c0 2023-11-28T20:07:54.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe855ffb640 1 -- 172.21.15.177:0/345431573 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c007270 con 0x7fe86006c2c0 2023-11-28T20:07:54.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe8679c4640 1 -- 172.21.15.177:0/345431573 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86015bd90 con 0x7fe86006c2c0 2023-11-28T20:07:54.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe8679c4640 1 -- 172.21.15.177:0/345431573 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe860069440 con 0x7fe86006c2c0 2023-11-28T20:07:54.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.888+0000 7fe855ffb640 1 -- 172.21.15.177:0/345431573 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe85c0073d0 con 0x7fe86006c2c0 2023-11-28T20:07:54.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.892+0000 7fe855ffb640 1 --2- 172.21.15.177:0/345431573 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe844066470 0x7fe844068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:54.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.892+0000 7fe855ffb640 1 -- 172.21.15.177:0/345431573 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe85c083880 con 0x7fe86006c2c0 2023-11-28T20:07:54.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.892+0000 7fe864f5f640 1 --2- 172.21.15.177:0/345431573 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe844066470 0x7fe844068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:54.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.892+0000 7fe864f5f640 1 --2- 172.21.15.177:0/345431573 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe844066470 0x7fe844068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe8500af000 tx=0x7fe850008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:54.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:54.896+0000 7fe855ffb640 1 -- 172.21.15.177:0/345431573 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe85c050c70 con 0x7fe86006c2c0 2023-11-28T20:07:55.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.076+0000 7fe8679c4640 1 -- 172.21.15.177:0/345431573 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8600b3d30 con 0x7fe86006c2c0 2023-11-28T20:07:55.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.076+0000 7fe855ffb640 1 -- 172.21.15.177:0/345431573 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fe85c054290 con 0x7fe86006c2c0 2023-11-28T20:07:55.079 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:55.080 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2688190991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2688190991},{"type":"v1","addr":"172.21.15.177:6835","nonce":2688190991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/17424302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":17424302},{"type":"v1","addr":"172.21.15.177:6837","nonce":17424302}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3833908165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3833908165},{"type":"v1","addr":"172.21.15.195:6834","nonce":3833908165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:07:41.477909+0000","modified":"2023-11-28T20:07:44.615409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6835/1726998944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1726998944},{"type":"v1","addr":"172.21.15.195:6835","nonce":1726998944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T20:07:55.080 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-28T20:07:55.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.076+0000 7fe8679c4640 1 -- 172.21.15.177:0/345431573 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe844066470 msgr2=0x7fe844068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:55.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.076+0000 7fe8679c4640 1 --2- 172.21.15.177:0/345431573 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe844066470 0x7fe844068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe8500af000 tx=0x7fe850008040 comp rx=0 tx=0).stop 2023-11-28T20:07:55.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.076+0000 7fe8679c4640 1 -- 172.21.15.177:0/345431573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe86006c2c0 msgr2=0x7fe86015cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:55.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.076+0000 7fe8679c4640 1 --2- 172.21.15.177:0/345431573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe86006c2c0 0x7fe86015cbf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00c500 tx=0x7fe85c00c9c0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.076+0000 7fe8679c4640 1 -- 172.21.15.177:0/345431573 shutdown_connections 2023-11-28T20:07:55.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.076+0000 7fe8679c4640 1 --2- 172.21.15.177:0/345431573 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe844066470 0x7fe844068930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.076+0000 7fe8679c4640 1 --2- 172.21.15.177:0/345431573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe860140180 0x7fe86013aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.076+0000 7fe8679c4640 1 --2- 172.21.15.177:0/345431573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8600b3400 0x7fe86013a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.076+0000 7fe8679c4640 1 --2- 172.21.15.177:0/345431573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe86006c2c0 0x7fe86015cbf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.076+0000 7fe8679c4640 1 -- 172.21.15.177:0/345431573 >> 172.21.15.177:0/345431573 conn(0x7fe86006a530 msgr2=0x7fe860141990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:55.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.076+0000 7fe8679c4640 1 -- 172.21.15.177:0/345431573 shutdown_connections 2023-11-28T20:07:55.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.076+0000 7fe8679c4640 1 -- 172.21.15.177:0/345431573 wait complete. 2023-11-28T20:07:55.100 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:07:55.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.232+0000 7f7724891640 1 Processor -- start 2023-11-28T20:07:55.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.232+0000 7f7724891640 1 -- start start 2023-11-28T20:07:55.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f7724891640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7720144840 0x7f772006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:55.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f7724891640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7720072180 0x7f772006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:55.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f7724891640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7720070460 0x7f77200708e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:55.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f7724891640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772015f010 con 0x7f7720070460 2023-11-28T20:07:55.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f7724891640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7720070e20 con 0x7f7720072180 2023-11-28T20:07:55.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f7724891640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77200710e0 con 0x7f7720144840 2023-11-28T20:07:55.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f771ed9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7720070460 0x7f77200708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:55.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f771ed9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7720070460 0x7f77200708e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44846/0 (socket says 172.21.15.177:44846) 2023-11-28T20:07:55.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f771ed9d640 1 -- 172.21.15.177:0/221155055 learned_addr learned my addr 172.21.15.177:0/221155055 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:55.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f7715d9b640 1 --2- 172.21.15.177:0/221155055 >> v2:172.21.15.195:3300/0 conn(0x7f7720072180 0x7f772006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:55.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f771e59c640 1 --2- 172.21.15.177:0/221155055 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7720144840 0x7f772006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:55.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f771ed9d640 1 -- 172.21.15.177:0/221155055 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7720144840 msgr2=0x7f772006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:55.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f771ed9d640 1 --2- 172.21.15.177:0/221155055 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7720144840 0x7f772006c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f771ed9d640 1 -- 172.21.15.177:0/221155055 >> v2:172.21.15.195:3300/0 conn(0x7f7720072180 msgr2=0x7f772006c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:55.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f771ed9d640 1 --2- 172.21.15.177:0/221155055 >> v2:172.21.15.195:3300/0 conn(0x7f7720072180 0x7f772006c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f771ed9d640 1 -- 172.21.15.177:0/221155055 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77200713c0 con 0x7f7720070460 2023-11-28T20:07:55.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f7715d9b640 1 --2- 172.21.15.177:0/221155055 >> v2:172.21.15.195:3300/0 conn(0x7f7720072180 0x7f772006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:55.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.236+0000 7f771e59c640 1 --2- 172.21.15.177:0/221155055 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7720144840 0x7f772006c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:55.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.240+0000 7f771ed9d640 1 --2- 172.21.15.177:0/221155055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7720070460 0x7f77200708e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7720067f30 tx=0x7f771801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63551f7d460a04 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:55.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.240+0000 7f771dd9b640 1 -- 172.21.15.177:0/221155055 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180a5820 con 0x7f7720070460 2023-11-28T20:07:55.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.240+0000 7f771dd9b640 1 -- 172.21.15.177:0/221155055 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77180a5980 con 0x7f7720070460 2023-11-28T20:07:55.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.240+0000 7f771dd9b640 1 -- 172.21.15.177:0/221155055 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180a5d10 con 0x7f7720070460 2023-11-28T20:07:55.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.240+0000 7f7724891640 1 -- 172.21.15.177:0/221155055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7720070460 msgr2=0x7f77200708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:55.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.240+0000 7f7724891640 1 --2- 172.21.15.177:0/221155055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7720070460 0x7f77200708e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7720067f30 tx=0x7f771801c9a0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.240+0000 7f7724891640 1 -- 172.21.15.177:0/221155055 shutdown_connections 2023-11-28T20:07:55.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.240+0000 7f7724891640 1 --2- 172.21.15.177:0/221155055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7720070460 0x7f77200708e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.240+0000 7f7724891640 1 --2- 172.21.15.177:0/221155055 >> v2:172.21.15.195:3300/0 conn(0x7f7720072180 0x7f772006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.240+0000 7f7724891640 1 --2- 172.21.15.177:0/221155055 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7720144840 0x7f772006c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.240+0000 7f7724891640 1 -- 172.21.15.177:0/221155055 >> 172.21.15.177:0/221155055 conn(0x7f772006a530 msgr2=0x7f772006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:55.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.240+0000 7f7724891640 1 -- 172.21.15.177:0/221155055 shutdown_connections 2023-11-28T20:07:55.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.240+0000 7f7724891640 1 -- 172.21.15.177:0/221155055 wait complete. 2023-11-28T20:07:55.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.240+0000 7f7724891640 1 Processor -- start 2023-11-28T20:07:55.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.240+0000 7f7724891640 1 -- start start 2023-11-28T20:07:55.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f7724891640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7720070460 0x7f7720139340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:55.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f7724891640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7720072180 0x7f772013c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:55.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f7724891640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7720144840 0x7f772015fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:55.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f7724891640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77201f34b0 con 0x7f7720070460 2023-11-28T20:07:55.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f7724891640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7720139880 con 0x7f7720072180 2023-11-28T20:07:55.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f7724891640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772013ed80 con 0x7f7720144840 2023-11-28T20:07:55.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f771e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7720070460 0x7f7720139340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:55.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f771e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7720070460 0x7f7720139340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44862/0 (socket says 172.21.15.177:44862) 2023-11-28T20:07:55.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f771e59c640 1 -- 172.21.15.177:0/165623934 learned_addr learned my addr 172.21.15.177:0/165623934 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:55.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f771e59c640 1 -- 172.21.15.177:0/165623934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7720144840 msgr2=0x7f772015fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:55.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f771e59c640 1 --2- 172.21.15.177:0/165623934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7720144840 0x7f772015fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f771e59c640 1 -- 172.21.15.177:0/165623934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7720072180 msgr2=0x7f772013c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:55.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f771e59c640 1 --2- 172.21.15.177:0/165623934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7720072180 0x7f772013c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f771e59c640 1 -- 172.21.15.177:0/165623934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7718009b30 con 0x7f7720070460 2023-11-28T20:07:55.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f771e59c640 1 --2- 172.21.15.177:0/165623934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7720070460 0x7f7720139340 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f771000c7f0 tx=0x7f771000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:55.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f77177fe640 1 -- 172.21.15.177:0/165623934 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710007820 con 0x7f7720070460 2023-11-28T20:07:55.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f77177fe640 1 -- 172.21.15.177:0/165623934 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7710007980 con 0x7f7720070460 2023-11-28T20:07:55.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f77177fe640 1 -- 172.21.15.177:0/165623934 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710007d30 con 0x7f7720070460 2023-11-28T20:07:55.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f7724891640 1 -- 172.21.15.177:0/165623934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772013f060 con 0x7f7720070460 2023-11-28T20:07:55.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f7724891640 1 -- 172.21.15.177:0/165623934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772013f620 con 0x7f7720070460 2023-11-28T20:07:55.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f7724891640 1 -- 172.21.15.177:0/165623934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7720069440 con 0x7f7720070460 2023-11-28T20:07:55.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.244+0000 7f77177fe640 1 -- 172.21.15.177:0/165623934 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f77100113f0 con 0x7f7720070460 2023-11-28T20:07:55.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.248+0000 7f77177fe640 1 --2- 172.21.15.177:0/165623934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7700066470 0x7f7700068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:55.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.248+0000 7f77177fe640 1 -- 172.21.15.177:0/165623934 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77100841c0 con 0x7f7720070460 2023-11-28T20:07:55.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.248+0000 7f7715d9b640 1 --2- 172.21.15.177:0/165623934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7700066470 0x7f7700068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:55.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.248+0000 7f7715d9b640 1 --2- 172.21.15.177:0/165623934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7700066470 0x7f7700068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f77201435c0 tx=0x7f7708008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:55.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.252+0000 7f77177fe640 1 -- 172.21.15.177:0/165623934 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77100515a0 con 0x7f7720070460 2023-11-28T20:07:55.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.404+0000 7f7724891640 1 -- 172.21.15.177:0/165623934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f772006d170 con 0x7f7720070460 2023-11-28T20:07:55.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.404+0000 7f77177fe640 1 -- 172.21.15.177:0/165623934 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f7710054bc0 con 0x7f7720070460 2023-11-28T20:07:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:55.409 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:07:55.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.404+0000 7f7724891640 1 -- 172.21.15.177:0/165623934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7700066470 msgr2=0x7f7700068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:55.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.404+0000 7f7724891640 1 --2- 172.21.15.177:0/165623934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7700066470 0x7f7700068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f77201435c0 tx=0x7f7708008040 comp rx=0 tx=0).stop 2023-11-28T20:07:55.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.404+0000 7f7724891640 1 -- 172.21.15.177:0/165623934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7720070460 msgr2=0x7f7720139340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:55.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.404+0000 7f7724891640 1 --2- 172.21.15.177:0/165623934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7720070460 0x7f7720139340 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f771000c7f0 tx=0x7f771000ccb0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.404+0000 7f7724891640 1 -- 172.21.15.177:0/165623934 shutdown_connections 2023-11-28T20:07:55.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.404+0000 7f7724891640 1 --2- 172.21.15.177:0/165623934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7700066470 0x7f7700068930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.404+0000 7f7724891640 1 --2- 172.21.15.177:0/165623934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7720144840 0x7f772015fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.404+0000 7f7724891640 1 --2- 172.21.15.177:0/165623934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7720072180 0x7f772013c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.404+0000 7f7724891640 1 --2- 172.21.15.177:0/165623934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7720070460 0x7f7720139340 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.404+0000 7f7724891640 1 -- 172.21.15.177:0/165623934 >> 172.21.15.177:0/165623934 conn(0x7f772006a530 msgr2=0x7f772006c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:55.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.408+0000 7f7724891640 1 -- 172.21.15.177:0/165623934 shutdown_connections 2023-11-28T20:07:55.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.408+0000 7f7724891640 1 -- 172.21.15.177:0/165623934 wait complete. 2023-11-28T20:07:55.430 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:07:55.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03f679640 1 Processor -- start 2023-11-28T20:07:55.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03f679640 1 -- start start 2023-11-28T20:07:55.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03f679640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0380b35b0 0x7fe0380d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:55.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03f679640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe0380b3c70 0x7fe03815f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:55.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03f679640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0380d3880 con 0x7fe0380cf780 2023-11-28T20:07:55.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03f679640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0380d4090 con 0x7fe0380b3c70 2023-11-28T20:07:55.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03f679640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380cdc80 con 0x7fe0380b35b0 2023-11-28T20:07:55.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03cc14640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe0380b3c70 0x7fe03815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:55.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03cc14640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe0380b3c70 0x7fe03815f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44866/0 (socket says 172.21.15.177:44866) 2023-11-28T20:07:55.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03cc14640 1 -- 172.21.15.177:0/1611828841 learned_addr learned my addr 172.21.15.177:0/1611828841 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:55.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03dc16640 1 --1- 172.21.15.177:0/1611828841 >> v1:172.21.15.177:6789/0 conn(0x7fe0380cf780 0x7fe0380ce440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51636/0 (socket says 172.21.15.177:51636) 2023-11-28T20:07:55.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03d415640 1 --2- 172.21.15.177:0/1611828841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0380b35b0 0x7fe0380d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:55.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe02ffff640 1 -- 172.21.15.177:0/1611828841 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553151356 0 0) 0x7fe0380d3880 con 0x7fe0380cf780 2023-11-28T20:07:55.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe02ffff640 1 -- 172.21.15.177:0/1611828841 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe024003530 con 0x7fe0380cf780 2023-11-28T20:07:55.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03cc14640 1 -- 172.21.15.177:0/1611828841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0380b35b0 msgr2=0x7fe0380d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:55.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03cc14640 1 --2- 172.21.15.177:0/1611828841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0380b35b0 0x7fe0380d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03cc14640 1 -- 172.21.15.177:0/1611828841 >> v1:172.21.15.177:6789/0 conn(0x7fe0380cf780 legacy=0x7fe0380ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:55.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.564+0000 7fe03cc14640 1 -- 172.21.15.177:0/1611828841 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0380d3ad0 con 0x7fe0380b3c70 2023-11-28T20:07:55.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.568+0000 7fe03cc14640 1 --2- 172.21.15.177:0/1611828841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380b3c70 0x7fe03815f060 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe028009870 tx=0x7fe02801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a349f0d5899f92e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:55.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.568+0000 7fe02ffff640 1 -- 172.21.15.177:0/1611828841 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0280a9400 con 0x7fe0380b3c70 2023-11-28T20:07:55.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.568+0000 7fe02ffff640 1 -- 172.21.15.177:0/1611828841 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0280a9560 con 0x7fe0380b3c70 2023-11-28T20:07:55.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.568+0000 7fe02ffff640 1 -- 172.21.15.177:0/1611828841 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0280a98f0 con 0x7fe0380b3c70 2023-11-28T20:07:55.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.568+0000 7fe03f679640 1 -- 172.21.15.177:0/1611828841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380b3c70 msgr2=0x7fe03815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:55.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.568+0000 7fe03f679640 1 --2- 172.21.15.177:0/1611828841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380b3c70 0x7fe03815f060 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe028009870 tx=0x7fe02801c540 comp rx=0 tx=0).stop 2023-11-28T20:07:55.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.568+0000 7fe03f679640 1 -- 172.21.15.177:0/1611828841 shutdown_connections 2023-11-28T20:07:55.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.568+0000 7fe03f679640 1 --2- 172.21.15.177:0/1611828841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380b3c70 0x7fe03815f060 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.568+0000 7fe03f679640 1 --2- 172.21.15.177:0/1611828841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0380b35b0 0x7fe0380d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.568+0000 7fe03f679640 1 -- 172.21.15.177:0/1611828841 >> 172.21.15.177:0/1611828841 conn(0x7fe03809c4b0 msgr2=0x7fe0380d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:55.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.568+0000 7fe03f679640 1 -- 172.21.15.177:0/1611828841 shutdown_connections 2023-11-28T20:07:55.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.568+0000 7fe03f679640 1 -- 172.21.15.177:0/1611828841 wait complete. 2023-11-28T20:07:55.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03f679640 1 Processor -- start 2023-11-28T20:07:55.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03f679640 1 -- start start 2023-11-28T20:07:55.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03f679640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380b35b0 0x7fe038155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:55.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03f679640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0380b3c70 0x7fe0380cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:55.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03f679640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0380cf780 0x7fe0380ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:55.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03f679640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe038155ec0 con 0x7fe0380b35b0 2023-11-28T20:07:55.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03f679640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe038156160 con 0x7fe0380b3c70 2023-11-28T20:07:55.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03f679640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe038156440 con 0x7fe0380cf780 2023-11-28T20:07:55.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03d415640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380b35b0 0x7fe038155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:55.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03d415640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380b35b0 0x7fe038155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44880/0 (socket says 172.21.15.177:44880) 2023-11-28T20:07:55.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03d415640 1 -- 172.21.15.177:0/2514700691 learned_addr learned my addr 172.21.15.177:0/2514700691 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:55.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03dc16640 1 --2- 172.21.15.177:0/2514700691 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0380cf780 0x7fe0380ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:55.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03cc14640 1 --2- 172.21.15.177:0/2514700691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0380b3c70 0x7fe0380cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:55.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03d415640 1 -- 172.21.15.177:0/2514700691 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0380cf780 msgr2=0x7fe0380ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:55.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03d415640 1 --2- 172.21.15.177:0/2514700691 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0380cf780 0x7fe0380ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03d415640 1 -- 172.21.15.177:0/2514700691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0380b3c70 msgr2=0x7fe0380cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:55.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03d415640 1 --2- 172.21.15.177:0/2514700691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0380b3c70 0x7fe0380cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03d415640 1 -- 172.21.15.177:0/2514700691 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0280094d0 con 0x7fe0380b35b0 2023-11-28T20:07:55.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03d415640 1 --2- 172.21.15.177:0/2514700691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380b35b0 0x7fe038155120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe03400e930 tx=0x7fe03400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:55.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe02dffb640 1 -- 172.21.15.177:0/2514700691 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034009690 con 0x7fe0380b35b0 2023-11-28T20:07:55.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe02dffb640 1 -- 172.21.15.177:0/2514700691 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03400ca00 con 0x7fe0380b35b0 2023-11-28T20:07:55.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe02dffb640 1 -- 172.21.15.177:0/2514700691 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03400cd70 con 0x7fe0380b35b0 2023-11-28T20:07:55.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.572+0000 7fe03f679640 1 -- 172.21.15.177:0/2514700691 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0380d0120 con 0x7fe0380b35b0 2023-11-28T20:07:55.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.576+0000 7fe03f679640 1 -- 172.21.15.177:0/2514700691 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe038156a00 con 0x7fe0380b35b0 2023-11-28T20:07:55.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.576+0000 7fe03f679640 1 -- 172.21.15.177:0/2514700691 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe038069440 con 0x7fe0380b35b0 2023-11-28T20:07:55.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.576+0000 7fe02dffb640 1 -- 172.21.15.177:0/2514700691 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe034013470 con 0x7fe0380b35b0 2023-11-28T20:07:55.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.576+0000 7fe02dffb640 1 --2- 172.21.15.177:0/2514700691 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe01c066470 0x7fe01c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:55.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.576+0000 7fe02dffb640 1 -- 172.21.15.177:0/2514700691 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0340840d0 con 0x7fe0380b35b0 2023-11-28T20:07:55.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.576+0000 7fe03cc14640 1 --2- 172.21.15.177:0/2514700691 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe01c066470 0x7fe01c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:55.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.576+0000 7fe03cc14640 1 --2- 172.21.15.177:0/2514700691 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe01c066470 0x7fe01c068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe0280ae000 tx=0x7fe0280b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:55.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.580+0000 7fe02dffb640 1 -- 172.21.15.177:0/2514700691 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe034051610 con 0x7fe0380b35b0 2023-11-28T20:07:55.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.764+0000 7fe03f679640 1 -- 172.21.15.177:0/2514700691 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0380d0720 con 0x7fe0380b35b0 2023-11-28T20:07:55.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.764+0000 7fe02dffb640 1 -- 172.21.15.177:0/2514700691 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fe034054c30 con 0x7fe0380b35b0 2023-11-28T20:07:55.767 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:07:55.767 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2688190991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2688190991},{"type":"v1","addr":"172.21.15.177:6835","nonce":2688190991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/17424302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":17424302},{"type":"v1","addr":"172.21.15.177:6837","nonce":17424302}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3833908165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3833908165},{"type":"v1","addr":"172.21.15.195:6834","nonce":3833908165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:07:41.477909+0000","modified":"2023-11-28T20:07:44.615409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6835/1726998944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1726998944},{"type":"v1","addr":"172.21.15.195:6835","nonce":1726998944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T20:07:55.768 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-28T20:07:55.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.764+0000 7fe03f679640 1 -- 172.21.15.177:0/2514700691 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe01c066470 msgr2=0x7fe01c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:55.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.764+0000 7fe03f679640 1 --2- 172.21.15.177:0/2514700691 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe01c066470 0x7fe01c068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe0280ae000 tx=0x7fe0280b3040 comp rx=0 tx=0).stop 2023-11-28T20:07:55.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.764+0000 7fe03f679640 1 -- 172.21.15.177:0/2514700691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380b35b0 msgr2=0x7fe038155120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:55.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.764+0000 7fe03f679640 1 --2- 172.21.15.177:0/2514700691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380b35b0 0x7fe038155120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe03400e930 tx=0x7fe03400edf0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.764+0000 7fe03f679640 1 -- 172.21.15.177:0/2514700691 shutdown_connections 2023-11-28T20:07:55.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.764+0000 7fe03f679640 1 --2- 172.21.15.177:0/2514700691 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe01c066470 0x7fe01c068930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.764+0000 7fe03f679640 1 --2- 172.21.15.177:0/2514700691 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0380cf780 0x7fe0380ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.764+0000 7fe03f679640 1 --2- 172.21.15.177:0/2514700691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0380b3c70 0x7fe0380cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.764+0000 7fe03f679640 1 --2- 172.21.15.177:0/2514700691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380b35b0 0x7fe038155120 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:55.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.764+0000 7fe03f679640 1 -- 172.21.15.177:0/2514700691 >> 172.21.15.177:0/2514700691 conn(0x7fe03809c4b0 msgr2=0x7fe03815e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:55.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.764+0000 7fe03f679640 1 -- 172.21.15.177:0/2514700691 shutdown_connections 2023-11-28T20:07:55.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:55.764+0000 7fe03f679640 1 -- 172.21.15.177:0/2514700691 wait complete. 2023-11-28T20:07:56.192 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T20:07:41.477909+0000', 'modified': '2023-11-28T20:07:44.615409+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.195:6835/1726998944', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6833', 'nonce': 1726998944}, {'type': 'v1', 'addr': '172.21.15.195:6835', 'nonce': 1726998944}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T20:07:56.192 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T20:07:56.192 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-28T20:07:56.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.328+0000 7f271b246640 1 Processor -- start 2023-11-28T20:07:56.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.328+0000 7f271b246640 1 -- start start 2023-11-28T20:07:56.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.328+0000 7f271b246640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f271406c9d0 0x7f2714070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.332+0000 7f271b246640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27140710e0 con 0x7f2714144840 2023-11-28T20:07:56.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.332+0000 7f271b246640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27140713c0 con 0x7f2714072180 2023-11-28T20:07:56.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.332+0000 7f271b246640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271415f010 con 0x7f271406c9d0 2023-11-28T20:07:56.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.332+0000 7f2713fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f271406c9d0 0x7f2714070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.332+0000 7f2713fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f271406c9d0 0x7f2714070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44890/0 (socket says 172.21.15.177:44890) 2023-11-28T20:07:56.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.332+0000 7f2713fff640 1 -- 172.21.15.177:0/3723738425 learned_addr learned my addr 172.21.15.177:0/3723738425 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:56.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.332+0000 7f2713fff640 1 -- 172.21.15.177:0/3723738425 >> v1:172.21.15.195:6789/0 conn(0x7f2714072180 legacy=0x7f271415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.332+0000 7f2713fff640 1 -- 172.21.15.177:0/3723738425 >> v1:172.21.15.177:6789/0 conn(0x7f2714144840 legacy=0x7f271406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.332+0000 7f2713fff640 1 -- 172.21.15.177:0/3723738425 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27140716a0 con 0x7f271406c9d0 2023-11-28T20:07:56.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.332+0000 7f2713fff640 1 --2- 172.21.15.177:0/3723738425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f271406c9d0 0x7f2714070460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2700009870 tx=0x7f270001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5835f4949bc21181 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:56.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.336+0000 7f27137fe640 1 -- 172.21.15.177:0/3723738425 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000aa670 con 0x7f271406c9d0 2023-11-28T20:07:56.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.336+0000 7f27137fe640 1 -- 172.21.15.177:0/3723738425 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27000aa7d0 con 0x7f271406c9d0 2023-11-28T20:07:56.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.336+0000 7f27137fe640 1 -- 172.21.15.177:0/3723738425 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000aab60 con 0x7f271406c9d0 2023-11-28T20:07:56.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.336+0000 7f271b246640 1 -- 172.21.15.177:0/3723738425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f271406c9d0 msgr2=0x7f2714070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.336+0000 7f271b246640 1 --2- 172.21.15.177:0/3723738425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f271406c9d0 0x7f2714070460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2700009870 tx=0x7f270001c510 comp rx=0 tx=0).stop 2023-11-28T20:07:56.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.336+0000 7f271b246640 1 -- 172.21.15.177:0/3723738425 shutdown_connections 2023-11-28T20:07:56.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.336+0000 7f271b246640 1 --2- 172.21.15.177:0/3723738425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f271406c9d0 0x7f2714070460 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.336+0000 7f271b246640 1 -- 172.21.15.177:0/3723738425 >> 172.21.15.177:0/3723738425 conn(0x7f271406a530 msgr2=0x7f271406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:56.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.336+0000 7f271b246640 1 -- 172.21.15.177:0/3723738425 shutdown_connections 2023-11-28T20:07:56.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.336+0000 7f271b246640 1 -- 172.21.15.177:0/3723738425 wait complete. 2023-11-28T20:07:56.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.336+0000 7f271b246640 1 Processor -- start 2023-11-28T20:07:56.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.336+0000 7f271b246640 1 -- start start 2023-11-28T20:07:56.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f271b246640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f271406c9d0 0x7f271415a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f271b246640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2714072180 0x7f27141427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f271b246640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2714144840 0x7f271415d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f271b246640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271413d5f0 con 0x7f271406c9d0 2023-11-28T20:07:56.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f271b246640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271413c550 con 0x7f2714072180 2023-11-28T20:07:56.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f271b246640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271413c830 con 0x7f2714144840 2023-11-28T20:07:56.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f2718fe2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f271406c9d0 0x7f271415a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f2718fe2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f271406c9d0 0x7f271415a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44896/0 (socket says 172.21.15.177:44896) 2023-11-28T20:07:56.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f2718fe2640 1 -- 172.21.15.177:0/221004679 learned_addr learned my addr 172.21.15.177:0/221004679 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:56.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f2713fff640 1 --2- 172.21.15.177:0/221004679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2714072180 0x7f27141427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f27197e3640 1 --2- 172.21.15.177:0/221004679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2714144840 0x7f271415d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f2718fe2640 1 -- 172.21.15.177:0/221004679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2714144840 msgr2=0x7f271415d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f2718fe2640 1 --2- 172.21.15.177:0/221004679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2714144840 0x7f271415d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f2718fe2640 1 -- 172.21.15.177:0/221004679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2714072180 msgr2=0x7f27141427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f2718fe2640 1 --2- 172.21.15.177:0/221004679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2714072180 0x7f27141427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f2718fe2640 1 -- 172.21.15.177:0/221004679 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27000094d0 con 0x7f271406c9d0 2023-11-28T20:07:56.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f27197e3640 1 --2- 172.21.15.177:0/221004679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2714144840 0x7f271415d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:56.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f2718fe2640 1 --2- 172.21.15.177:0/221004679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f271406c9d0 0x7f271415a090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f270800c7a0 tx=0x7f270800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:56.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f27117fa640 1 -- 172.21.15.177:0/221004679 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2708003b80 con 0x7f271406c9d0 2023-11-28T20:07:56.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f27117fa640 1 -- 172.21.15.177:0/221004679 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2708003ce0 con 0x7f271406c9d0 2023-11-28T20:07:56.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f271b246640 1 -- 172.21.15.177:0/221004679 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271413cb10 con 0x7f271406c9d0 2023-11-28T20:07:56.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f27117fa640 1 -- 172.21.15.177:0/221004679 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270800aa90 con 0x7f271406c9d0 2023-11-28T20:07:56.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.340+0000 7f271b246640 1 -- 172.21.15.177:0/221004679 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271413d0d0 con 0x7f271406c9d0 2023-11-28T20:07:56.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f27117fa640 1 -- 172.21.15.177:0/221004679 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f270800abf0 con 0x7f271406c9d0 2023-11-28T20:07:56.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f27117fa640 1 --2- 172.21.15.177:0/221004679 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f26f8066470 0x7f26f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f27117fa640 1 -- 172.21.15.177:0/221004679 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2708083cb0 con 0x7f271406c9d0 2023-11-28T20:07:56.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f2713fff640 1 --2- 172.21.15.177:0/221004679 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f26f8066470 0x7f26f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f271e5b6000 1 Processor -- start 2023-11-28T20:07:56.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f271e5b6000 1 -- start start 2023-11-28T20:07:56.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f2713fff640 1 --2- 172.21.15.177:0/221004679 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f26f8066470 0x7f26f8068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f27000ae000 tx=0x7f27000b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:56.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f271e5b6000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28ee3cc90 0x55f28ee3d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f271e5b6000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3d5b0 0x55f28edf2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f271e5b6000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28edf3320 0x55f28edf3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f271e5b6000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28ec5d130 con 0x55f28ee3d5b0 2023-11-28T20:07:56.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f271e5b6000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28ec4a9a0 con 0x55f28ee3cc90 2023-11-28T20:07:56.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f271e5b6000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f28ec47ed0 con 0x55f28edf3320 2023-11-28T20:07:56.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f2713fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3d5b0 0x55f28edf2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f2713fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3d5b0 0x55f28edf2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44904/0 (socket says 172.21.15.177:44904) 2023-11-28T20:07:56.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f2713fff640 1 -- 172.21.15.177:0/2277422538 learned_addr learned my addr 172.21.15.177:0/2277422538 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:56.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f2713fff640 1 -- 172.21.15.177:0/2277422538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28edf3320 msgr2=0x55f28edf3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:56.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f2713fff640 1 --2- 172.21.15.177:0/2277422538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28edf3320 0x55f28edf3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f2713fff640 1 -- 172.21.15.177:0/2277422538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28ee3cc90 msgr2=0x55f28ee3d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:56.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f2713fff640 1 --2- 172.21.15.177:0/2277422538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28ee3cc90 0x55f28ee3d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.344+0000 7f2713fff640 1 -- 172.21.15.177:0/2277422538 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f28e93b890 con 0x55f28ee3d5b0 2023-11-28T20:07:56.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f2713fff640 1 --2- 172.21.15.177:0/2277422538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3d5b0 0x55f28edf2de0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2700019120 tx=0x7f2700004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cdfc37e19c48a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:56.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f26fe7fc640 1 -- 172.21.15.177:0/2277422538 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000bfba0 con 0x55f28ee3d5b0 2023-11-28T20:07:56.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f26fe7fc640 1 -- 172.21.15.177:0/2277422538 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27000bfd00 con 0x55f28ee3d5b0 2023-11-28T20:07:56.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f26fe7fc640 1 -- 172.21.15.177:0/2277422538 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000bd600 con 0x55f28ee3d5b0 2023-11-28T20:07:56.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 -- 172.21.15.177:0/2277422538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3d5b0 msgr2=0x55f28edf2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2277422538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3d5b0 0x55f28edf2de0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2700019120 tx=0x7f2700004740 comp rx=0 tx=0).stop 2023-11-28T20:07:56.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 -- 172.21.15.177:0/2277422538 shutdown_connections 2023-11-28T20:07:56.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2277422538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28edf3320 0x55f28edf3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2277422538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3d5b0 0x55f28edf2de0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2277422538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28ee3cc90 0x55f28ee3d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 -- 172.21.15.177:0/2277422538 >> 172.21.15.177:0/2277422538 conn(0x55f28edef2d0 msgr2=0x55f28edf16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:56.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 -- 172.21.15.177:0/2277422538 shutdown_connections 2023-11-28T20:07:56.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 -- 172.21.15.177:0/2277422538 wait complete. 2023-11-28T20:07:56.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 -- start start 2023-11-28T20:07:56.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 Processor -- start 2023-11-28T20:07:56.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28edf3320 0x55f28edf7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3cc90 0x55f28edf8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28ee3d5b0 0x55f28ee0b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28ec437c0 con 0x55f28ee3cc90 2023-11-28T20:07:56.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28ebfbbf0 con 0x55f28ee3d5b0 2023-11-28T20:07:56.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f28ec01a90 con 0x55f28edf3320 2023-11-28T20:07:56.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f271e5b6000 10 client.0 _ll_register_callbacks cb 0x55f28edde3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:07:56.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f2713fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3cc90 0x55f28edf8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f2713fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3cc90 0x55f28edf8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44918/0 (socket says 172.21.15.177:44918) 2023-11-28T20:07:56.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f2713fff640 1 -- 172.21.15.177:0/2193108646 learned_addr learned my addr 172.21.15.177:0/2193108646 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:56.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f2718fe2640 1 --2- 172.21.15.177:0/2193108646 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28edf3320 0x55f28edf7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f27197e3640 1 --2- 172.21.15.177:0/2193108646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28ee3d5b0 0x55f28ee0b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f2713fff640 1 -- 172.21.15.177:0/2193108646 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28edf3320 msgr2=0x55f28edf7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:56.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f2713fff640 1 --2- 172.21.15.177:0/2193108646 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28edf3320 0x55f28edf7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f2713fff640 1 -- 172.21.15.177:0/2193108646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28ee3d5b0 msgr2=0x55f28ee0b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:56.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f2713fff640 1 --2- 172.21.15.177:0/2193108646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28ee3d5b0 0x55f28ee0b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.348+0000 7f2713fff640 1 -- 172.21.15.177:0/2193108646 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27140716a0 con 0x55f28ee3cc90 2023-11-28T20:07:56.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f2713fff640 1 --2- 172.21.15.177:0/2193108646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3cc90 0x55f28edf8280 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f27000ac040 tx=0x7f270001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52636be5b0f4fbf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:56.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f26f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-11-28T20:07:56.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f26f37fe640 1 -- 172.21.15.177:0/2193108646 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000bd8c0 con 0x55f28ee3cc90 2023-11-28T20:07:56.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f26f37fe640 1 -- 172.21.15.177:0/2193108646 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27000d3ad0 con 0x55f28ee3cc90 2023-11-28T20:07:56.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 1 -- 172.21.15.177:0/2193108646 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f28ec05470 con 0x55f28ee3cc90 2023-11-28T20:07:56.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f26f37fe640 1 -- 172.21.15.177:0/2193108646 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27000d3c90 con 0x55f28ee3cc90 2023-11-28T20:07:56.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 10 client.4641 fetch_fsmap learned FSMap version 8 2023-11-28T20:07:56.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 1 -- 172.21.15.177:0/2193108646 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55f28ec04190 con 0x55f28ee3cc90 2023-11-28T20:07:56.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f26f37fe640 1 -- 172.21.15.177:0/2193108646 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f28ec05470 con 0x55f28ee3cc90 2023-11-28T20:07:56.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f26f37fe640 1 -- 172.21.15.177:0/2193108646 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f27000a8050 con 0x55f28ee3cc90 2023-11-28T20:07:56.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 10 client.4641 fetch_fsmap finished waiting for FSMap version 8 2023-11-28T20:07:56.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 10 client.4641 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-28T20:07:56.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 20 client.4641 populate_metadata read hostname 'smithi177' 2023-11-28T20:07:56.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2193108646 >> [v2:172.21.15.195:6833/1726998944,v1:172.21.15.195:6835/1726998944] conn(0x55f28ee0c320 0x55f28ee4ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 4 client.4641 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T20:07:56.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 1 -- 172.21.15.177:0/2193108646 --> [v2:172.21.15.195:6833/1726998944,v1:172.21.15.195:6835/1726998944] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f28ec08b50 con 0x55f28ee0c320 2023-11-28T20:07:56.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f2718fe2640 1 --2- 172.21.15.177:0/2193108646 >> [v2:172.21.15.195:6833/1726998944,v1:172.21.15.195:6835/1726998944] conn(0x55f28ee0c320 0x55f28ee4ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f2718fe2640 1 --2- 172.21.15.177:0/2193108646 >> [v2:172.21.15.195:6833/1726998944,v1:172.21.15.195:6835/1726998944] conn(0x55f28ee0c320 0x55f28ee4ef50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cae836a37b2f25d server_cookie=51758f2db44105ce in_seq=0 out_seq=0 2023-11-28T20:07:56.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f26f37fe640 10 client.4641 ms_handle_connect on v2:172.21.15.195:6833/1726998944 2023-11-28T20:07:56.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f26f37fe640 1 -- 172.21.15.177:0/2193108646 <== mds.0 v2:172.21.15.195:6833/1726998944 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f28ec08b50 con 0x55f28ee0c320 2023-11-28T20:07:56.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f26f37fe640 10 client.4641 handle_command_reply: tid=0 2023-11-28T20:07:56.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 1 client.4641 shutdown 2023-11-28T20:07:56.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 1 -- 172.21.15.177:0/2193108646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3cc90 msgr2=0x55f28edf8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2193108646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3cc90 0x55f28edf8280 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f27000ac040 tx=0x7f270001ad50 comp rx=0 tx=0).stop 2023-11-28T20:07:56.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 1 -- 172.21.15.177:0/2193108646 shutdown_connections 2023-11-28T20:07:56.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2193108646 >> [v2:172.21.15.195:6833/1726998944,v1:172.21.15.195:6835/1726998944] conn(0x55f28ee0c320 0x55f28ee4ef50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2193108646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28ee3d5b0 0x55f28ee0b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2193108646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3cc90 0x55f28edf8280 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f26f37fe640 0 client.4641 ms_handle_reset on v2:172.21.15.195:6833/1726998944 2023-11-28T20:07:56.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2193108646 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28edf3320 0x55f28edf7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 1 -- 172.21.15.177:0/2193108646 >> 172.21.15.177:0/2193108646 conn(0x55f28edef2d0 msgr2=0x55f28edf16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:56.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 1 -- 172.21.15.177:0/2193108646 shutdown_connections 2023-11-28T20:07:56.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 1 -- 172.21.15.177:0/2193108646 wait complete. 2023-11-28T20:07:56.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.352+0000 7f271e5b6000 20 client.4641 trim_cache size 0 max 16384 2023-11-28T20:07:56.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f271e5b6000 1 Processor -- start 2023-11-28T20:07:56.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f271e5b6000 1 -- start start 2023-11-28T20:07:56.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f271e5b6000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28edf3320 0x55f28ee3bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f271e5b6000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3cc90 0x55f28ee3ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f271e5b6000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28ee3d5b0 0x55f28ee3b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f271e5b6000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28e8fc940 con 0x55f28ee3cc90 2023-11-28T20:07:56.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f271e5b6000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28ec40bc0 con 0x55f28edf3320 2023-11-28T20:07:56.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f271e5b6000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f28ec1de30 con 0x55f28ee3d5b0 2023-11-28T20:07:56.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f2713fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3cc90 0x55f28ee3ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f2713fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3cc90 0x55f28ee3ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44928/0 (socket says 172.21.15.177:44928) 2023-11-28T20:07:56.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f2713fff640 1 -- 172.21.15.177:0/2028926075 learned_addr learned my addr 172.21.15.177:0/2028926075 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:56.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f2713fff640 1 -- 172.21.15.177:0/2028926075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28ee3d5b0 msgr2=0x55f28ee3b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:56.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f2713fff640 1 --2- 172.21.15.177:0/2028926075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28ee3d5b0 0x55f28ee3b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f2713fff640 1 -- 172.21.15.177:0/2028926075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28edf3320 msgr2=0x55f28ee3bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:56.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f2713fff640 1 --2- 172.21.15.177:0/2028926075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28edf3320 0x55f28ee3bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.368+0000 7f2713fff640 1 -- 172.21.15.177:0/2028926075 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f28ebea490 con 0x55f28ee3cc90 2023-11-28T20:07:56.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f2713fff640 1 --2- 172.21.15.177:0/2028926075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3cc90 0x55f28ee3ab30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f27000aa510 tx=0x7f270000b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63a50a0a420cbb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:56.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f26feffd640 1 -- 172.21.15.177:0/2028926075 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000bd8c0 con 0x55f28ee3cc90 2023-11-28T20:07:56.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f26feffd640 1 -- 172.21.15.177:0/2028926075 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27000d3e90 con 0x55f28ee3cc90 2023-11-28T20:07:56.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f26feffd640 1 -- 172.21.15.177:0/2028926075 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000bdcf0 con 0x55f28ee3cc90 2023-11-28T20:07:56.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 -- 172.21.15.177:0/2028926075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3cc90 msgr2=0x55f28ee3ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2028926075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3cc90 0x55f28ee3ab30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f27000aa510 tx=0x7f270000b070 comp rx=0 tx=0).stop 2023-11-28T20:07:56.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 -- 172.21.15.177:0/2028926075 shutdown_connections 2023-11-28T20:07:56.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2028926075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28ee3d5b0 0x55f28ee3b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2028926075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3cc90 0x55f28ee3ab30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2028926075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28edf3320 0x55f28ee3bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 -- 172.21.15.177:0/2028926075 >> 172.21.15.177:0/2028926075 conn(0x55f28edef2d0 msgr2=0x55f28ee4a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:56.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 -- 172.21.15.177:0/2028926075 shutdown_connections 2023-11-28T20:07:56.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 -- 172.21.15.177:0/2028926075 wait complete. 2023-11-28T20:07:56.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 -- start start 2023-11-28T20:07:56.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 Processor -- start 2023-11-28T20:07:56.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28edf3320 0x55f28edf4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28ee3cc90 0x55f28ee4ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3d5b0 0x55f28ee504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28ebde8a0 con 0x55f28ee3d5b0 2023-11-28T20:07:56.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28e93c1b0 con 0x55f28ee3cc90 2023-11-28T20:07:56.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f28ec42650 con 0x55f28edf3320 2023-11-28T20:07:56.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f271e5b6000 10 client.0 _ll_register_callbacks cb 0x55f28ec91c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:07:56.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f27197e3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3d5b0 0x55f28ee504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f27197e3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3d5b0 0x55f28ee504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44930/0 (socket says 172.21.15.177:44930) 2023-11-28T20:07:56.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f27197e3640 1 -- 172.21.15.177:0/2740617179 learned_addr learned my addr 172.21.15.177:0/2740617179 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:56.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f2713fff640 1 --2- 172.21.15.177:0/2740617179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28ee3cc90 0x55f28ee4ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f2718fe2640 1 --2- 172.21.15.177:0/2740617179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28edf3320 0x55f28edf4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f27197e3640 1 -- 172.21.15.177:0/2740617179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28edf3320 msgr2=0x55f28edf4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f27197e3640 1 --2- 172.21.15.177:0/2740617179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28edf3320 0x55f28edf4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f27197e3640 1 -- 172.21.15.177:0/2740617179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28ee3cc90 msgr2=0x55f28ee4ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f27197e3640 1 --2- 172.21.15.177:0/2740617179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28ee3cc90 0x55f28ee4ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f27197e3640 1 -- 172.21.15.177:0/2740617179 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f28ec04190 con 0x55f28ee3d5b0 2023-11-28T20:07:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f2718fe2640 1 --2- 172.21.15.177:0/2740617179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28edf3320 0x55f28edf4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f27197e3640 1 --2- 172.21.15.177:0/2740617179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3d5b0 0x55f28ee504e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f270c003a60 tx=0x7f270c003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502cb0230b0e2bf4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.372+0000 7f26f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-11-28T20:07:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f26f37fe640 1 -- 172.21.15.177:0/2740617179 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c018070 con 0x55f28ee3d5b0 2023-11-28T20:07:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f26f37fe640 1 -- 172.21.15.177:0/2740617179 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f270c001a60 con 0x55f28ee3d5b0 2023-11-28T20:07:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 1 -- 172.21.15.177:0/2740617179 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f28ec42110 con 0x55f28ee3d5b0 2023-11-28T20:07:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f26f37fe640 1 -- 172.21.15.177:0/2740617179 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f270c001c20 con 0x55f28ee3d5b0 2023-11-28T20:07:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 10 client.4647 fetch_fsmap learned FSMap version 8 2023-11-28T20:07:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 1 -- 172.21.15.177:0/2740617179 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55f28e93bcc0 con 0x55f28ee3d5b0 2023-11-28T20:07:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f26f37fe640 1 -- 172.21.15.177:0/2740617179 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f28ec42110 con 0x55f28ee3d5b0 2023-11-28T20:07:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f26f37fe640 1 -- 172.21.15.177:0/2740617179 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f270c01b020 con 0x55f28ee3d5b0 2023-11-28T20:07:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 10 client.4647 fetch_fsmap finished waiting for FSMap version 8 2023-11-28T20:07:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 10 client.4647 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-28T20:07:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 20 client.4647 populate_metadata read hostname 'smithi177' 2023-11-28T20:07:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2740617179 >> [v2:172.21.15.195:6833/1726998944,v1:172.21.15.195:6835/1726998944] conn(0x55f28ee9d010 0x55f28ee9d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 4 client.4647 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T20:07:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 1 -- 172.21.15.177:0/2740617179 --> [v2:172.21.15.195:6833/1726998944,v1:172.21.15.195:6835/1726998944] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f28ec719a0 con 0x55f28ee9d010 2023-11-28T20:07:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f2718fe2640 1 --2- 172.21.15.177:0/2740617179 >> [v2:172.21.15.195:6833/1726998944,v1:172.21.15.195:6835/1726998944] conn(0x55f28ee9d010 0x55f28ee9d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f26f37fe640 10 client.4647 ms_handle_connect on v2:172.21.15.195:6833/1726998944 2023-11-28T20:07:56.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f2718fe2640 1 --2- 172.21.15.177:0/2740617179 >> [v2:172.21.15.195:6833/1726998944,v1:172.21.15.195:6835/1726998944] conn(0x55f28ee9d010 0x55f28ee9d3f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54e8a3ca971155ba server_cookie=315bd8b8c4740668 in_seq=0 out_seq=0 2023-11-28T20:07:56.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f26f37fe640 1 -- 172.21.15.177:0/2740617179 <== mds.0 v2:172.21.15.195:6833/1726998944 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55f28ec719a0 con 0x55f28ee9d010 2023-11-28T20:07:56.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f26f37fe640 10 client.4647 handle_command_reply: tid=0 2023-11-28T20:07:56.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 1 client.4647 shutdown 2023-11-28T20:07:56.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 1 -- 172.21.15.177:0/2740617179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3d5b0 msgr2=0x55f28ee504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2740617179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3d5b0 0x55f28ee504e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f270c003a60 tx=0x7f270c003f20 comp rx=0 tx=0).stop 2023-11-28T20:07:56.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 1 -- 172.21.15.177:0/2740617179 shutdown_connections 2023-11-28T20:07:56.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2740617179 >> [v2:172.21.15.195:6833/1726998944,v1:172.21.15.195:6835/1726998944] conn(0x55f28ee9d010 0x55f28ee9d3f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2740617179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f28ee3d5b0 0x55f28ee504e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2740617179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f28ee3cc90 0x55f28ee4ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f26f37fe640 0 client.4647 ms_handle_reset on v2:172.21.15.195:6833/1726998944 2023-11-28T20:07:56.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 1 --2- 172.21.15.177:0/2740617179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f28edf3320 0x55f28edf4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 1 -- 172.21.15.177:0/2740617179 >> 172.21.15.177:0/2740617179 conn(0x55f28edef2d0 msgr2=0x55f28edf16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:56.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 1 -- 172.21.15.177:0/2740617179 shutdown_connections 2023-11-28T20:07:56.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 1 -- 172.21.15.177:0/2740617179 wait complete. 2023-11-28T20:07:56.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271e5b6000 20 client.4647 trim_cache size 0 max 16384 2023-11-28T20:07:56.385 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:07:56.386 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "281097bd-2f79-488c-a8b5-264c5bd230f4", 2023-11-28T20:07:56.386 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-11-28T20:07:56.386 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 4293, 2023-11-28T20:07:56.386 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-11-28T20:07:56.386 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-11-28T20:07:56.386 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-11-28T20:07:56.386 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 14.142324238, 2023-11-28T20:07:56.386 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 8, 2023-11-28T20:07:56.386 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 20, 2023-11-28T20:07:56.386 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 20, 2023-11-28T20:07:56.387 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 21.098506674999999 2023-11-28T20:07:56.387 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:07:56.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271b246640 1 -- 172.21.15.177:0/221004679 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f26f8066470 msgr2=0x7f26f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271b246640 1 --2- 172.21.15.177:0/221004679 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f26f8066470 0x7f26f8068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f27000ae000 tx=0x7f27000b5040 comp rx=0 tx=0).stop 2023-11-28T20:07:56.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271b246640 1 -- 172.21.15.177:0/221004679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f271406c9d0 msgr2=0x7f271415a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271b246640 1 --2- 172.21.15.177:0/221004679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f271406c9d0 0x7f271415a090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f270800c7a0 tx=0x7f270800cc60 comp rx=0 tx=0).stop 2023-11-28T20:07:56.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271b246640 1 -- 172.21.15.177:0/221004679 shutdown_connections 2023-11-28T20:07:56.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271b246640 1 --2- 172.21.15.177:0/221004679 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f26f8066470 0x7f26f8068930 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271b246640 1 --2- 172.21.15.177:0/221004679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2714144840 0x7f271415d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271b246640 1 --2- 172.21.15.177:0/221004679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2714072180 0x7f27141427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271b246640 1 --2- 172.21.15.177:0/221004679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f271406c9d0 0x7f271415a090 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271b246640 1 -- 172.21.15.177:0/221004679 >> 172.21.15.177:0/221004679 conn(0x7f271406a530 msgr2=0x7f271415b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:56.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271b246640 1 -- 172.21.15.177:0/221004679 shutdown_connections 2023-11-28T20:07:56.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.376+0000 7f271b246640 1 -- 172.21.15.177:0/221004679 wait complete. 2023-11-28T20:07:56.400 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-28T20:07:56.425 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-28T20:07:56.425 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-28T20:07:56.426 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-28T20:07:56.426 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T20:07:56.426 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:07:56.426 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-28T20:07:56.426 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T20:07:56.426 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T20:07:56.426 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-28T20:07:56.426 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T20:07:56.426 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T20:07:56.426 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-28T20:07:56.427 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T20:07:56.427 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T20:07:56.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:56.427 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2023-11-28T20:07:56.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:56.438 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2023-11-28T20:07:56.511 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2023-11-28T20:07:56.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:07:56.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:56.513 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-11-28T20:07:56.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:56.523 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2023-11-28T20:07:56.593 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2023-11-28T20:07:56.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:07:56.595 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-28T20:07:56.595 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:07:56.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc96e1c4640 1 Processor -- start 2023-11-28T20:07:56.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc96e1c4640 1 -- start start 2023-11-28T20:07:56.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc96e1c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc96815d160 0x7fc9680aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc96e1c4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9680addf0 con 0x7fc96806b540 2023-11-28T20:07:56.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc96e1c4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9680ae0d0 con 0x7fc96806cd80 2023-11-28T20:07:56.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc96e1c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96806e010 con 0x7fc96815d160 2023-11-28T20:07:56.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc967fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc96806b540 0x7fc9680b27f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51664/0 (socket says 172.21.15.177:51664) 2023-11-28T20:07:56.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc967fff640 1 -- 172.21.15.177:0/3695965758 learned_addr learned my addr 172.21.15.177:0/3695965758 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:56.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc9677fe640 1 --2- 172.21.15.177:0/3695965758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc96815d160 0x7fc9680aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc966ffd640 1 -- 172.21.15.177:0/3695965758 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375559630 0 0) 0x7fc9680addf0 con 0x7fc96806b540 2023-11-28T20:07:56.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc966ffd640 1 -- 172.21.15.177:0/3695965758 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc954003530 con 0x7fc96806b540 2023-11-28T20:07:56.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc966ffd640 1 -- 172.21.15.177:0/3695965758 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 941878824 0 0) 0x7fc954003530 con 0x7fc96806b540 2023-11-28T20:07:56.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc966ffd640 1 -- 172.21.15.177:0/3695965758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc96815d160 msgr2=0x7fc9680aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:56.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc966ffd640 1 --2- 172.21.15.177:0/3695965758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc96815d160 0x7fc9680aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc966ffd640 1 -- 172.21.15.177:0/3695965758 >> v1:172.21.15.195:6789/0 conn(0x7fc96806cd80 legacy=0x7fc9680ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc966ffd640 1 -- 172.21.15.177:0/3695965758 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9680ae3b0 con 0x7fc96806b540 2023-11-28T20:07:56.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc966ffd640 1 -- 172.21.15.177:0/3695965758 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7fc960001a00 con 0x7fc96806b540 2023-11-28T20:07:56.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc966ffd640 1 -- 172.21.15.177:0/3695965758 >> v1:172.21.15.177:6789/0 conn(0x7fc96806b540 legacy=0x7fc9680b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc966ffd640 1 --2- 172.21.15.177:0/3695965758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9540039b0 0x7fc954003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc966ffd640 1 --2- 172.21.15.177:0/3695965758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc96815d160 0x7fc9540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc966ffd640 1 --2- 172.21.15.177:0/3695965758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc954004d10 0x7fc954005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc966ffd640 1 -- 172.21.15.177:0/3695965758 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96806e010 con 0x7fc9540039b0 2023-11-28T20:07:56.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc966ffd640 1 -- 172.21.15.177:0/3695965758 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95400ba40 con 0x7fc954004d10 2023-11-28T20:07:56.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc966ffd640 1 -- 172.21.15.177:0/3695965758 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95400bc00 con 0x7fc96815d160 2023-11-28T20:07:56.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc9677fe640 1 --2- 172.21.15.177:0/3695965758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9540039b0 0x7fc954003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc95ffff640 1 --2- 172.21.15.177:0/3695965758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc96815d160 0x7fc9540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc967fff640 1 --2- 172.21.15.177:0/3695965758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc954004d10 0x7fc954005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc9677fe640 1 -- 172.21.15.177:0/3695965758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc96815d160 msgr2=0x7fc9540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:56.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc9677fe640 1 --2- 172.21.15.177:0/3695965758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc96815d160 0x7fc9540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc9677fe640 1 -- 172.21.15.177:0/3695965758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc954004d10 msgr2=0x7fc954005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:56.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.772+0000 7fc9677fe640 1 --2- 172.21.15.177:0/3695965758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc954004d10 0x7fc954005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.776+0000 7fc9677fe640 1 -- 172.21.15.177:0/3695965758 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc954003530 con 0x7fc9540039b0 2023-11-28T20:07:56.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.776+0000 7fc95ffff640 1 --2- 172.21.15.177:0/3695965758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc96815d160 0x7fc9540047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:56.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.776+0000 7fc9677fe640 1 --2- 172.21.15.177:0/3695965758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9540039b0 0x7fc954003d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc958009ae0 tx=0x7fc95801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db6db4fc916cc43 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:56.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.776+0000 7fc966ffd640 1 -- 172.21.15.177:0/3695965758 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9580a6430 con 0x7fc9540039b0 2023-11-28T20:07:56.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.776+0000 7fc966ffd640 1 -- 172.21.15.177:0/3695965758 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9580a6590 con 0x7fc9540039b0 2023-11-28T20:07:56.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.776+0000 7fc966ffd640 1 -- 172.21.15.177:0/3695965758 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9580a6940 con 0x7fc9540039b0 2023-11-28T20:07:56.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.776+0000 7fc96e1c4640 1 -- 172.21.15.177:0/3695965758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9540039b0 msgr2=0x7fc954003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.776+0000 7fc96e1c4640 1 --2- 172.21.15.177:0/3695965758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9540039b0 0x7fc954003d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc958009ae0 tx=0x7fc95801ca50 comp rx=0 tx=0).stop 2023-11-28T20:07:56.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.776+0000 7fc967fff640 1 -- 172.21.15.177:0/3695965758 reap_dead start 2023-11-28T20:07:56.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.776+0000 7fc96e1c4640 1 -- 172.21.15.177:0/3695965758 shutdown_connections 2023-11-28T20:07:56.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.776+0000 7fc96e1c4640 1 -- 172.21.15.177:0/3695965758 >> 172.21.15.177:0/3695965758 conn(0x7fc9680b1af0 msgr2=0x7fc968070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:56.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.776+0000 7fc96e1c4640 1 -- 172.21.15.177:0/3695965758 shutdown_connections 2023-11-28T20:07:56.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.776+0000 7fc96e1c4640 1 -- 172.21.15.177:0/3695965758 wait complete. 2023-11-28T20:07:56.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc96e1c4640 1 Processor -- start 2023-11-28T20:07:56.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc96e1c4640 1 -- start start 2023-11-28T20:07:56.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc96e1c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9540039b0 0x7fc96814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc96e1c4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc96814dde0 0x7fc968150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc96e1c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc96806d180 0x7fc96806d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc96e1c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680aea70 con 0x7fc96806d180 2023-11-28T20:07:56.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc96e1c4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96806db40 con 0x7fc96814dde0 2023-11-28T20:07:56.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc96e1c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96814d630 con 0x7fc9540039b0 2023-11-28T20:07:56.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc967fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc96806d180 0x7fc96806d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc967fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc96806d180 0x7fc96806d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44960/0 (socket says 172.21.15.177:44960) 2023-11-28T20:07:56.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc967fff640 1 -- 172.21.15.177:0/800966139 learned_addr learned my addr 172.21.15.177:0/800966139 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:56.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc9677fe640 1 --2- 172.21.15.177:0/800966139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9540039b0 0x7fc96814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc95ffff640 1 --2- 172.21.15.177:0/800966139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc96814dde0 0x7fc968150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc967fff640 1 -- 172.21.15.177:0/800966139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9540039b0 msgr2=0x7fc96814d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc967fff640 1 --2- 172.21.15.177:0/800966139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9540039b0 0x7fc96814d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc967fff640 1 -- 172.21.15.177:0/800966139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc96814dde0 msgr2=0x7fc968150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc967fff640 1 --2- 172.21.15.177:0/800966139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc96814dde0 0x7fc968150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc967fff640 1 -- 172.21.15.177:0/800966139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96814ef60 con 0x7fc96806d180 2023-11-28T20:07:56.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc967fff640 1 --2- 172.21.15.177:0/800966139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc96806d180 0x7fc96806d600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc9680b4e80 tx=0x7fc960007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:56.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc964ff9640 1 -- 172.21.15.177:0/800966139 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960017070 con 0x7fc96806d180 2023-11-28T20:07:56.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc964ff9640 1 -- 172.21.15.177:0/800966139 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96000e9a0 con 0x7fc96806d180 2023-11-28T20:07:56.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc964ff9640 1 -- 172.21.15.177:0/800966139 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96000eb50 con 0x7fc96806d180 2023-11-28T20:07:56.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.780+0000 7fc96e1c4640 1 -- 172.21.15.177:0/800966139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96814e350 con 0x7fc96806d180 2023-11-28T20:07:56.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.784+0000 7fc96e1c4640 1 -- 172.21.15.177:0/800966139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96814e910 con 0x7fc96806d180 2023-11-28T20:07:56.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.784+0000 7fc96e1c4640 1 -- 172.21.15.177:0/800966139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc968069440 con 0x7fc96806d180 2023-11-28T20:07:56.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.784+0000 7fc964ff9640 1 -- 172.21.15.177:0/800966139 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc96000ecb0 con 0x7fc96806d180 2023-11-28T20:07:56.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.784+0000 7fc964ff9640 1 --2- 172.21.15.177:0/800966139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc948066470 0x7fc948068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:56.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.784+0000 7fc964ff9640 1 -- 172.21.15.177:0/800966139 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc960083880 con 0x7fc96806d180 2023-11-28T20:07:56.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.784+0000 7fc9677fe640 1 --2- 172.21.15.177:0/800966139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc948066470 0x7fc948068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:56.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.784+0000 7fc9677fe640 1 --2- 172.21.15.177:0/800966139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc948066470 0x7fc948068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc9580ad000 tx=0x7fc9580b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:56.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.788+0000 7fc964ff9640 1 -- 172.21.15.177:0/800966139 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc960050c80 con 0x7fc96806d180 2023-11-28T20:07:56.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.972+0000 7fc96e1c4640 1 -- 172.21.15.177:0/800966139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc968071c10 con 0x7fc96806d180 2023-11-28T20:07:56.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.972+0000 7fc964ff9640 1 -- 172.21.15.177:0/800966139 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc9600542a0 con 0x7fc96806d180 2023-11-28T20:07:56.975 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:07:56.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.972+0000 7fc96e1c4640 1 -- 172.21.15.177:0/800966139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc948066470 msgr2=0x7fc948068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.972+0000 7fc96e1c4640 1 --2- 172.21.15.177:0/800966139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc948066470 0x7fc948068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc9580ad000 tx=0x7fc9580b3040 comp rx=0 tx=0).stop 2023-11-28T20:07:56.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.972+0000 7fc96e1c4640 1 -- 172.21.15.177:0/800966139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc96806d180 msgr2=0x7fc96806d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:56.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.972+0000 7fc96e1c4640 1 --2- 172.21.15.177:0/800966139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc96806d180 0x7fc96806d600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc9680b4e80 tx=0x7fc960007bc0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.972+0000 7fc96e1c4640 1 -- 172.21.15.177:0/800966139 shutdown_connections 2023-11-28T20:07:56.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.972+0000 7fc96e1c4640 1 --2- 172.21.15.177:0/800966139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc948066470 0x7fc948068930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.972+0000 7fc96e1c4640 1 --2- 172.21.15.177:0/800966139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc96806d180 0x7fc96806d600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.972+0000 7fc96e1c4640 1 --2- 172.21.15.177:0/800966139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc96814dde0 0x7fc968150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.972+0000 7fc96e1c4640 1 --2- 172.21.15.177:0/800966139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9540039b0 0x7fc96814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:56.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.972+0000 7fc96e1c4640 1 -- 172.21.15.177:0/800966139 >> 172.21.15.177:0/800966139 conn(0x7fc9680b1af0 msgr2=0x7fc9680b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:56.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.972+0000 7fc96e1c4640 1 -- 172.21.15.177:0/800966139 shutdown_connections 2023-11-28T20:07:56.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:56.972+0000 7fc96e1c4640 1 -- 172.21.15.177:0/800966139 wait complete. 2023-11-28T20:07:56.995 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T20:07:56.996 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:07:56.996 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-11-28T20:07:56.996 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T20:07:56.996 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:07:56.996 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T20:07:56.996 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T20:07:56.996 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:07:56.996 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:07:56.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:56.996 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-11-28T20:07:57.006 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:07:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:07:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:07:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-11-28T20:07:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:57.006 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:07:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:07:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-11-28T20:07:57.006 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:07:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:07:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-11-28T20:07:57.007 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:07:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-11-28T20:07:57.007 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:07:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-11-28T20:07:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:07:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42397sec preferred_lft 42397sec 2023-11-28T20:07:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-11-28T20:07:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:57.007 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:07:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:91:19:71:65 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:07:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:07:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:57.009 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T20:07:57.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:57.009 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-28T20:07:57.009 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-28T20:07:57.009 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add name ceph-brx type bridge 2023-11-28T20:07:57.009 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr flush dev ceph-brx 2023-11-28T20:07:57.009 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set ceph-brx up 2023-11-28T20:07:57.009 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T20:07:57.009 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-28T20:07:57.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:57.122 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:07:57.141 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-11-28T20:07:57.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:57.143 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-11-28T20:07:57.212 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-11-28T20:07:57.213 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:07:57.213 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:07:57.213 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:07:57.213 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:07:57.213 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:07:57.213 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:07:57.213 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:07:57.213 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:07:57.213 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:07:57.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:57.214 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-28T20:07:57.214 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-28T20:07:57.214 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:07:57.214 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:07:57.214 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:07:57.214 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-28T20:07:57.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:57.308 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-11-28T20:07:57.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:57.318 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2023-11-28T20:07:57.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:57.375 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-28T20:07:57.375 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-28T20:07:57.375 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:07:57.375 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-28T20:07:57.375 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-28T20:07:57.459 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-28T20:07:57.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:57.460 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-28T20:07:57.460 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-28T20:07:57.460 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-28T20:07:57.460 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T20:07:57.460 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-28T20:07:57.460 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-28T20:07:57.460 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-28T20:07:57.460 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-28T20:07:57.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:57.627 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-28T20:07:57.627 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-28T20:07:57.627 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-11-28T20:07:57.627 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T20:07:57.627 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-28T20:07:57.668 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T20:07:57.668 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:07:57.669 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T20:07:57.723 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:07:57.723 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:07:57.723 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:07:57.774 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:07:57.843 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:07:57.899 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:07:57.900 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:07:57.900 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:07:57.900 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:07:57.900 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:07:57.900 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:07:57.900 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:07:57.900 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:07:57.900 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:07:57.900 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:07:57.900 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:07:57.900 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:07:57.901 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:07:57.901 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:07:57.901 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:07:57.901 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:07:57.901 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:07:57.901 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:07:57.901 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:07:57.901 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:07:57.901 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:07:57.901 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:07:57.902 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:07:57.902 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:07:57.902 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:07:57.902 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:07:57.902 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:07:57.902 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:07:57.902 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:07:57.903 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:07:57.903 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:07:57.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:57.904 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:07:57.958 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T20:07:57.958 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T20:07:58.009 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:07:58.031 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:07:58.088 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:07:58.088 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:07:58.088 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:07:58.088 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:07:58.088 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:07:58.088 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:07:58.088 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:07:58.088 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:07:58.088 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:07:58.088 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:07:58.088 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:07:58.089 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:07:58.089 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:07:58.089 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:07:58.089 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:07:58.089 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:07:58.089 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:07:58.089 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:07:58.089 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:07:58.089 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:07:58.089 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:07:58.089 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:07:58.089 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:07:58.090 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:07:58.090 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:07:58.090 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:07:58.090 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:07:58.090 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:07:58.090 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:07:58.090 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:07:58.090 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:07:58.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:58.091 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:07:58.118 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-11-28T20:07:58.112+0000 7fdbde559580 -1 init, newargv = 0x559c9e514220 newargc=15 2023-11-28T20:07:58.118 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[45911]: starting ceph client 2023-11-28T20:07:58.127 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[45911]: starting fuse 2023-11-28T20:07:58.129 INFO:teuthology.orchestra.run.smithi177.stdout:43 2023-11-28T20:07:58.129 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T20:07:58.129 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-11-28T20:07:58.129 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-11-28T20:07:58.129 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-11-28T20:07:58.130 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-11-28T20:07:58.130 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-11-28T20:07:58.130 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:07:58.130 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-11-28T20:07:58.130 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T20:07:58.130 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-11-28T20:07:58.130 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T20:07:58.130 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:07:58.130 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-11-28T20:07:58.130 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-11-28T20:07:58.130 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-11-28T20:07:58.130 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-11-28T20:07:58.130 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:07:58.131 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-11-28T20:07:58.131 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T20:07:58.131 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T20:07:58.131 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T20:07:58.131 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-11-28T20:07:58.131 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-11-28T20:07:58.131 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-11-28T20:07:58.131 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T20:07:58.131 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:07:58.131 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-11-28T20:07:58.131 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-11-28T20:07:58.251 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.45911.asok 2023-11-28T20:07:58.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T20:07:58.262 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45911.asok 2023-11-28T20:07:58.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:58.262 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45911.asok status 2023-11-28T20:07:58.440 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:07:58.440 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-11-28T20:07:58.440 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T20:07:58.440 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T20:07:58.440 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-11-28T20:07:58.441 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-11-28T20:07:58.441 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T20:07:58.441 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "45911", 2023-11-28T20:07:58.441 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-11-28T20:07:58.441 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:07:58.441 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-11-28T20:07:58.441 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-11-28T20:07:58.442 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 4662, 2023-11-28T20:07:58.442 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-11-28T20:07:58.442 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-11-28T20:07:58.442 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-11-28T20:07:58.442 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 4662 2023-11-28T20:07:58.443 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:07:58.443 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:07:58.443 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:07:58.443 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:07:58.443 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 740841628 2023-11-28T20:07:58.443 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:07:58.444 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:07:58.444 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:07:58.444 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:07:58.444 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:07:58.444 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 740841628 2023-11-28T20:07:58.444 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:07:58.445 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.4662 192.168.0.1:0/740841628", 2023-11-28T20:07:58.445 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/740841628", 2023-11-28T20:07:58.445 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-11-28T20:07:58.445 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 8, 2023-11-28T20:07:58.445 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 20, 2023-11-28T20:07:58.445 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-11-28T20:07:58.445 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-11-28T20:07:58.445 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-11-28T20:07:58.445 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:07:58.455 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:07:58.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.588+0000 7f5a91fb8640 1 Processor -- start 2023-11-28T20:07:58.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.588+0000 7f5a91fb8640 1 -- start start 2023-11-28T20:07:58.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a91fb8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a8c06c9d0 0x7f5a8c15a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:58.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a91fb8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c15b3a0 con 0x7f5a8c15ab70 2023-11-28T20:07:58.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a91fb8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c13f720 con 0x7f5a8c13cf30 2023-11-28T20:07:58.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a91fb8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c13d310 con 0x7f5a8c06c9d0 2023-11-28T20:07:58.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8bfff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5a8c15ab70 0x7f5a8c0cd880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51678/0 (socket says 172.21.15.177:51678) 2023-11-28T20:07:58.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8bfff640 1 -- 172.21.15.177:0/3640473203 learned_addr learned my addr 172.21.15.177:0/3640473203 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:07:58.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8affd640 1 --2- 172.21.15.177:0/3640473203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a8c06c9d0 0x7f5a8c15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:58.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772900977 0 0) 0x7f5a8c15b3a0 con 0x7f5a8c15ab70 2023-11-28T20:07:58.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a74003530 con 0x7f5a8c15ab70 2023-11-28T20:07:58.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705571752 0 0) 0x7f5a8c13f720 con 0x7f5a8c13cf30 2023-11-28T20:07:58.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a8c15b3a0 con 0x7f5a8c13cf30 2023-11-28T20:07:58.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2631425042 0 0) 0x7f5a74003530 con 0x7f5a8c15ab70 2023-11-28T20:07:58.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a8c06c9d0 msgr2=0x7f5a8c15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:58.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 --2- 172.21.15.177:0/3640473203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a8c06c9d0 0x7f5a8c15a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:58.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 >> v1:172.21.15.195:6789/0 conn(0x7f5a8c13cf30 legacy=0x7f5a8c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:58.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c13fa00 con 0x7f5a8c15ab70 2023-11-28T20:07:58.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f5a84001a00 con 0x7f5a8c15ab70 2023-11-28T20:07:58.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 >> v1:172.21.15.177:6789/0 conn(0x7f5a8c15ab70 legacy=0x7f5a8c0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:58.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 --2- 172.21.15.177:0/3640473203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a74003b40 0x7f5a74003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:58.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 --2- 172.21.15.177:0/3640473203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a740047d0 0x7f5a74004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:58.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 --2- 172.21.15.177:0/3640473203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a8c06c9d0 0x7f5a740051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:58.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7400dd30 con 0x7f5a740047d0 2023-11-28T20:07:58.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7400de70 con 0x7f5a74003b40 2023-11-28T20:07:58.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7400e000 con 0x7f5a8c06c9d0 2023-11-28T20:07:58.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8affd640 1 --2- 172.21.15.177:0/3640473203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a740047d0 0x7f5a74004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:58.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8bfff640 1 --2- 172.21.15.177:0/3640473203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a8c06c9d0 0x7f5a740051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:58.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8b7fe640 1 --2- 172.21.15.177:0/3640473203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a74003b40 0x7f5a74003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:58.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8affd640 1 -- 172.21.15.177:0/3640473203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a8c06c9d0 msgr2=0x7f5a740051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:58.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8affd640 1 --2- 172.21.15.177:0/3640473203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a8c06c9d0 0x7f5a740051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:58.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8affd640 1 -- 172.21.15.177:0/3640473203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a74003b40 msgr2=0x7f5a74003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:07:58.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8affd640 1 --2- 172.21.15.177:0/3640473203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a74003b40 0x7f5a74003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:58.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8affd640 1 -- 172.21.15.177:0/3640473203 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a74003530 con 0x7f5a740047d0 2023-11-28T20:07:58.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.592+0000 7f5a8b7fe640 1 --2- 172.21.15.177:0/3640473203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a74003b40 0x7f5a74003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:07:58.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.596+0000 7f5a8affd640 1 --2- 172.21.15.177:0/3640473203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a740047d0 0x7f5a74004c50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009b10 tx=0x7f5a8001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff645eb62fa7a42 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:58.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.596+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a800a6430 con 0x7f5a740047d0 2023-11-28T20:07:58.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.596+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a800a6590 con 0x7f5a740047d0 2023-11-28T20:07:58.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.596+0000 7f5a8a7fc640 1 -- 172.21.15.177:0/3640473203 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a800a6940 con 0x7f5a740047d0 2023-11-28T20:07:58.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.596+0000 7f5a91fb8640 1 -- 172.21.15.177:0/3640473203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a740047d0 msgr2=0x7f5a74004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:58.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.596+0000 7f5a91fb8640 1 --2- 172.21.15.177:0/3640473203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a740047d0 0x7f5a74004c50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009b10 tx=0x7f5a8001ca50 comp rx=0 tx=0).stop 2023-11-28T20:07:58.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.596+0000 7f5a8bfff640 1 -- 172.21.15.177:0/3640473203 reap_dead start 2023-11-28T20:07:58.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.596+0000 7f5a91fb8640 1 -- 172.21.15.177:0/3640473203 shutdown_connections 2023-11-28T20:07:58.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.596+0000 7f5a91fb8640 1 -- 172.21.15.177:0/3640473203 >> 172.21.15.177:0/3640473203 conn(0x7f5a8c06a530 msgr2=0x7f5a8c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:58.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.596+0000 7f5a91fb8640 1 -- 172.21.15.177:0/3640473203 shutdown_connections 2023-11-28T20:07:58.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.596+0000 7f5a91fb8640 1 -- 172.21.15.177:0/3640473203 wait complete. 2023-11-28T20:07:58.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.596+0000 7f5a91fb8640 1 Processor -- start 2023-11-28T20:07:58.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.596+0000 7f5a91fb8640 1 -- start start 2023-11-28T20:07:58.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a91fb8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a740047d0 0x7f5a8c13dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:58.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a91fb8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a8c156b50 0x7f5a8c0b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:58.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a91fb8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a8c156fd0 0x7f5a8c0b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:58.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a91fb8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c13d310 con 0x7f5a740047d0 2023-11-28T20:07:58.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a91fb8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1577d0 con 0x7f5a8c156b50 2023-11-28T20:07:58.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a91fb8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1574f0 con 0x7f5a8c156fd0 2023-11-28T20:07:58.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a8b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a740047d0 0x7f5a8c13dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:58.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a8b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a740047d0 0x7f5a8c13dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44990/0 (socket says 172.21.15.177:44990) 2023-11-28T20:07:58.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a8b7fe640 1 -- 172.21.15.177:0/2064950861 learned_addr learned my addr 172.21.15.177:0/2064950861 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:07:58.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a8bfff640 1 --2- 172.21.15.177:0/2064950861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a8c156fd0 0x7f5a8c0b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:58.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a8affd640 1 --2- 172.21.15.177:0/2064950861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a8c156b50 0x7f5a8c0b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:58.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a8b7fe640 1 -- 172.21.15.177:0/2064950861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a8c156fd0 msgr2=0x7f5a8c0b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:58.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a8b7fe640 1 --2- 172.21.15.177:0/2064950861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a8c156fd0 0x7f5a8c0b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:58.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a8b7fe640 1 -- 172.21.15.177:0/2064950861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a8c156b50 msgr2=0x7f5a8c0b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:58.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a8b7fe640 1 --2- 172.21.15.177:0/2064950861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a8c156b50 0x7f5a8c0b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:58.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a8b7fe640 1 -- 172.21.15.177:0/2064950861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c13d4f0 con 0x7f5a740047d0 2023-11-28T20:07:58.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a8affd640 1 --2- 172.21.15.177:0/2064950861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a8c156b50 0x7f5a8c0b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:07:58.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a8b7fe640 1 --2- 172.21.15.177:0/2064950861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a740047d0 0x7f5a8c13dfd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00e7b0 tx=0x7f5a7c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:58.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a73fff640 1 -- 172.21.15.177:0/2064950861 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c017070 con 0x7f5a740047d0 2023-11-28T20:07:58.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a73fff640 1 -- 172.21.15.177:0/2064950861 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c0050d0 con 0x7f5a740047d0 2023-11-28T20:07:58.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a91fb8640 1 -- 172.21.15.177:0/2064950861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c13d7d0 con 0x7f5a740047d0 2023-11-28T20:07:58.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a73fff640 1 -- 172.21.15.177:0/2064950861 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c005260 con 0x7f5a740047d0 2023-11-28T20:07:58.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a91fb8640 1 -- 172.21.15.177:0/2064950861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c1f64b0 con 0x7f5a740047d0 2023-11-28T20:07:58.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.600+0000 7f5a91fb8640 1 -- 172.21.15.177:0/2064950861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8c070440 con 0x7f5a740047d0 2023-11-28T20:07:58.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.604+0000 7f5a73fff640 1 -- 172.21.15.177:0/2064950861 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5a7c007020 con 0x7f5a740047d0 2023-11-28T20:07:58.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.604+0000 7f5a73fff640 1 --2- 172.21.15.177:0/2064950861 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5a78066470 0x7f5a78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:07:58.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.604+0000 7f5a73fff640 1 -- 172.21.15.177:0/2064950861 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a7c0836e0 con 0x7f5a740047d0 2023-11-28T20:07:58.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.604+0000 7f5a8affd640 1 --2- 172.21.15.177:0/2064950861 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5a78066470 0x7f5a78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:07:58.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.604+0000 7f5a8affd640 1 --2- 172.21.15.177:0/2064950861 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5a78066470 0x7f5a78068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5a800ad000 tx=0x7f5a800046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:07:58.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.608+0000 7f5a73fff640 1 -- 172.21.15.177:0/2064950861 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5a8c070440 con 0x7f5a740047d0 2023-11-28T20:07:58.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.788+0000 7f5a91fb8640 1 -- 172.21.15.177:0/2064950861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5a8c070440 con 0x7f5a740047d0 2023-11-28T20:07:58.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.788+0000 7f5a73fff640 1 -- 172.21.15.177:0/2064950861 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5a8c070440 con 0x7f5a740047d0 2023-11-28T20:07:58.794 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:07:58.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.792+0000 7f5a91fb8640 1 -- 172.21.15.177:0/2064950861 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5a78066470 msgr2=0x7f5a78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:58.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.792+0000 7f5a91fb8640 1 --2- 172.21.15.177:0/2064950861 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5a78066470 0x7f5a78068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5a800ad000 tx=0x7f5a800046d0 comp rx=0 tx=0).stop 2023-11-28T20:07:58.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.792+0000 7f5a91fb8640 1 -- 172.21.15.177:0/2064950861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a740047d0 msgr2=0x7f5a8c13dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:07:58.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.792+0000 7f5a91fb8640 1 --2- 172.21.15.177:0/2064950861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a740047d0 0x7f5a8c13dfd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00e7b0 tx=0x7f5a7c00ec70 comp rx=0 tx=0).stop 2023-11-28T20:07:58.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.792+0000 7f5a91fb8640 1 -- 172.21.15.177:0/2064950861 shutdown_connections 2023-11-28T20:07:58.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.792+0000 7f5a91fb8640 1 --2- 172.21.15.177:0/2064950861 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5a78066470 0x7f5a78068930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:58.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.792+0000 7f5a91fb8640 1 --2- 172.21.15.177:0/2064950861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a8c156fd0 0x7f5a8c0b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:58.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.792+0000 7f5a91fb8640 1 --2- 172.21.15.177:0/2064950861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a8c156b50 0x7f5a8c0b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:58.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.792+0000 7f5a91fb8640 1 --2- 172.21.15.177:0/2064950861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a740047d0 0x7f5a8c13dfd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:07:58.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.792+0000 7f5a91fb8640 1 -- 172.21.15.177:0/2064950861 >> 172.21.15.177:0/2064950861 conn(0x7f5a8c06a530 msgr2=0x7f5a8c15f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:07:58.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.792+0000 7f5a91fb8640 1 -- 172.21.15.177:0/2064950861 shutdown_connections 2023-11-28T20:07:58.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:07:58.792+0000 7f5a91fb8640 1 -- 172.21.15.177:0/2064950861 wait complete. 2023-11-28T20:07:58.815 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T20:07:58.815 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:07:58.815 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-11-28T20:07:58.816 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-28T20:07:58.816 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T20:07:58.816 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T20:07:58.816 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T20:07:58.816 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:07:58.816 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-28T20:07:58.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:58.817 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-11-28T20:07:58.827 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:07:58.828 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:07:58.828 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:07:58.828 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:58.828 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-11-28T20:07:58.828 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:58.829 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:07:58.829 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:07:58.829 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-11-28T20:07:58.829 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:07:58.829 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:07:58.829 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-11-28T20:07:58.829 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:07:58.830 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-11-28T20:07:58.830 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:07:58.830 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-11-28T20:07:58.830 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:07:58.830 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42395sec preferred_lft 42395sec 2023-11-28T20:07:58.830 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-11-28T20:07:58.830 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:58.831 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:07:58.831 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:91:19:71:65 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:07:58.831 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:07:58.831 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:58.831 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:07:58.831 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:07:58.832 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:07:58.832 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:58.832 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-28T20:07:58.832 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:58.832 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:07:58.832 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:07:58.832 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-28T20:07:58.832 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:58.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:58.833 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:07:58.892 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-11-28T20:07:58.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:58.895 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-11-28T20:07:58.952 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-11-28T20:07:58.953 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:07:58.953 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:07:58.953 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:07:58.953 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:07:58.953 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:07:58.953 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:07:58.954 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:07:58.954 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:07:58.954 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:07:58.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:58.954 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-28T20:07:58.955 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-28T20:07:58.955 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:07:58.955 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:07:58.955 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:07:58.955 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-28T20:07:59.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:59.044 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-11-28T20:07:59.054 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T20:07:59.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:59.055 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2023-11-28T20:07:59.107 INFO:teuthology.orchestra.run.smithi177.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-28T20:07:59.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:59.107 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-28T20:07:59.107 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-28T20:07:59.107 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:07:59.108 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-28T20:07:59.108 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-28T20:07:59.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:59.191 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T20:07:59.254 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:07:59.254 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:07:59.254 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:07:59.255 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:59.255 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-11-28T20:07:59.255 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:59.255 INFO:teuthology.orchestra.run.smithi177.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:07:59.255 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 6a:a9:52:bd:64:47 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T20:07:59.255 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T20:07:59.255 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:59.255 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::68a9:52ff:febd:6447/64 scope link tentative 2023-11-28T20:07:59.255 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:59.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:59.257 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T20:07:59.318 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:07:59.318 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:07:59.318 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:07:59.319 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:59.319 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-11-28T20:07:59.319 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:59.319 INFO:teuthology.orchestra.run.smithi177.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:07:59.319 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 6a:a9:52:bd:64:47 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T20:07:59.319 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T20:07:59.319 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:59.319 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::68a9:52ff:febd:6447/64 scope link tentative 2023-11-28T20:07:59.319 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:07:59.320 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-28T20:07:59.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:59.321 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-28T20:07:59.321 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-28T20:07:59.321 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-28T20:07:59.321 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T20:07:59.321 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-28T20:07:59.321 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-28T20:07:59.321 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-28T20:07:59.321 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-28T20:07:59.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:59.463 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-28T20:07:59.463 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-28T20:07:59.463 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.1 up 2023-11-28T20:07:59.463 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T20:07:59.464 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-28T20:07:59.504 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-28T20:07:59.505 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:07:59.505 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-28T20:07:59.558 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-28T20:07:59.558 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:07:59.559 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-28T20:07:59.614 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:07:59.682 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:07:59.736 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:07:59.736 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:07:59.736 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:07:59.736 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:07:59.737 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:07:59.737 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:07:59.737 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:07:59.737 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:07:59.737 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:07:59.737 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:07:59.738 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:07:59.738 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:07:59.738 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:07:59.738 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:07:59.738 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:07:59.738 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:07:59.739 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:07:59.739 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:07:59.739 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:07:59.739 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:07:59.739 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:07:59.740 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:07:59.740 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:07:59.740 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:07:59.740 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:07:59.741 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:07:59.741 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:07:59.741 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:07:59.741 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:07:59.741 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:07:59.741 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:07:59.741 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-28T20:07:59.742 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:07:59.742 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:07:59.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:59.743 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:07:59.797 INFO:teuthology.orchestra.run.smithi177.stdout:43 2023-11-28T20:07:59.798 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-28T20:07:59.800 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-28T20:07:59.845 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:07:59.867 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:07:59.923 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:07:59.924 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:07:59.924 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:07:59.924 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:07:59.924 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:07:59.924 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:07:59.924 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:07:59.924 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:07:59.924 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:07:59.924 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:07:59.924 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:07:59.925 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:07:59.925 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:07:59.925 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:07:59.925 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:07:59.925 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:07:59.925 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:07:59.925 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:07:59.925 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:07:59.925 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:07:59.925 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:07:59.925 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:07:59.925 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:07:59.926 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:07:59.926 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:07:59.926 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:07:59.926 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:07:59.926 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:07:59.926 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:07:59.926 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:07:59.926 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:07:59.926 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-28T20:07:59.926 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:07:59.926 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:07:59.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:07:59.927 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:07:59.940 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi177.stderr:2023-11-28T20:07:59.936+0000 7fcbb1bf8580 -1 init, newargv = 0x563a002bed70 newargc=15 2023-11-28T20:07:59.940 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi177.stderr:ceph-fuse[46045]: starting ceph client 2023-11-28T20:07:59.947 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi177.stderr:ceph-fuse[46045]: starting fuse 2023-11-28T20:07:59.949 INFO:teuthology.orchestra.run.smithi177.stdout:43 2023-11-28T20:07:59.949 INFO:teuthology.orchestra.run.smithi177.stdout:44 2023-11-28T20:07:59.950 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-28T20:07:59.950 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-11-28T20:07:59.950 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-11-28T20:07:59.950 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-11-28T20:07:59.950 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-11-28T20:07:59.950 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-11-28T20:07:59.950 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:07:59.951 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-11-28T20:07:59.951 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-28T20:07:59.951 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-11-28T20:07:59.951 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-28T20:07:59.951 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:07:59.951 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-11-28T20:07:59.951 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-11-28T20:07:59.951 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-11-28T20:07:59.951 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-11-28T20:07:59.952 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:07:59.952 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-11-28T20:07:59.952 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T20:07:59.952 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T20:07:59.952 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T20:07:59.952 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-11-28T20:07:59.952 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-11-28T20:07:59.952 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-11-28T20:07:59.953 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T20:07:59.953 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:07:59.953 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.2")) 2023-11-28T20:07:59.953 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-11-28T20:08:00.070 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.2.46045.asok 2023-11-28T20:08:00.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T20:08:00.083 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.46045.asok 2023-11-28T20:08:00.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:00.084 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.46045.asok status 2023-11-28T20:08:00.254 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:08:00.254 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-11-28T20:08:00.254 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T20:08:00.254 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T20:08:00.254 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "2", 2023-11-28T20:08:00.254 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-11-28T20:08:00.254 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-28T20:08:00.254 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "46045", 2023-11-28T20:08:00.255 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-11-28T20:08:00.255 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:00.255 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-11-28T20:08:00.255 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-11-28T20:08:00.255 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 4677, 2023-11-28T20:08:00.255 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-11-28T20:08:00.255 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-11-28T20:08:00.255 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-11-28T20:08:00.255 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 4677 2023-11-28T20:08:00.255 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:00.255 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:08:00.255 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:08:00.255 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.2:0", 2023-11-28T20:08:00.256 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 2107408347 2023-11-28T20:08:00.256 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:00.256 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:00.256 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:08:00.256 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:08:00.256 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.2:0", 2023-11-28T20:08:00.256 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 2107408347 2023-11-28T20:08:00.256 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:00.256 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.4677 192.168.0.2:0/2107408347", 2023-11-28T20:08:00.256 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.2:0/2107408347", 2023-11-28T20:08:00.256 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-11-28T20:08:00.257 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 8, 2023-11-28T20:08:00.257 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 20, 2023-11-28T20:08:00.257 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-11-28T20:08:00.257 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-11-28T20:08:00.257 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-11-28T20:08:00.257 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:08:00.269 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:08:00.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a11832640 1 Processor -- start 2023-11-28T20:08:00.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a11832640 1 -- start start 2023-11-28T20:08:00.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a11832640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3a0c0d1500 0x7f3a0c0d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:00.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a11832640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0c0d0320 con 0x7f3a0c0d0d00 2023-11-28T20:08:00.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a11832640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0c15daa0 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a11832640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0c15dd80 con 0x7f3a0c0d1500 2023-11-28T20:08:00.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a0b7fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f3a0c0d0d00 0x7f3a0c0cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:58222/0 (socket says 172.21.15.177:58222) 2023-11-28T20:08:00.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a0b7fe640 1 -- 172.21.15.177:0/1660865992 learned_addr learned my addr 172.21.15.177:0/1660865992 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:00.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a0affd640 1 --2- 172.21.15.177:0/1660865992 >> v2:172.21.15.195:3300/0 conn(0x7f3a0c0d1500 0x7f3a0c0d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:00.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a0a7fc640 1 -- 172.21.15.177:0/1660865992 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916163473 0 0) 0x7f3a0c0d0320 con 0x7f3a0c0d0d00 2023-11-28T20:08:00.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a0a7fc640 1 -- 172.21.15.177:0/1660865992 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39f8003530 con 0x7f3a0c0d0d00 2023-11-28T20:08:00.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a0a7fc640 1 -- 172.21.15.177:0/1660865992 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494682044 0 0) 0x7f3a0c15daa0 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a0a7fc640 1 -- 172.21.15.177:0/1660865992 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a0c0d0320 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a0affd640 1 -- 172.21.15.177:0/1660865992 >> v1:172.21.15.195:6789/0 conn(0x7f3a0c15d5e0 legacy=0x7f3a0c0d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:00.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a0affd640 1 -- 172.21.15.177:0/1660865992 >> v1:172.21.15.177:6789/0 conn(0x7f3a0c0d0d00 legacy=0x7f3a0c0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:00.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.404+0000 7f3a0affd640 1 -- 172.21.15.177:0/1660865992 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c15e060 con 0x7f3a0c0d1500 2023-11-28T20:08:00.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.408+0000 7f3a0affd640 1 --2- 172.21.15.177:0/1660865992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a0c0d1500 0x7f3a0c0d3a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0097c0 tx=0x7f39fc01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75af9aa2e0e5dd14 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:00.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.408+0000 7f3a0a7fc640 1 -- 172.21.15.177:0/1660865992 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc0ac620 con 0x7f3a0c0d1500 2023-11-28T20:08:00.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.408+0000 7f3a0a7fc640 1 -- 172.21.15.177:0/1660865992 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc0ac780 con 0x7f3a0c0d1500 2023-11-28T20:08:00.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.408+0000 7f3a0a7fc640 1 -- 172.21.15.177:0/1660865992 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc0acb10 con 0x7f3a0c0d1500 2023-11-28T20:08:00.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.408+0000 7f3a11832640 1 -- 172.21.15.177:0/1660865992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a0c0d1500 msgr2=0x7f3a0c0d3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:00.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.408+0000 7f3a11832640 1 --2- 172.21.15.177:0/1660865992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a0c0d1500 0x7f3a0c0d3a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0097c0 tx=0x7f39fc01c3c0 comp rx=0 tx=0).stop 2023-11-28T20:08:00.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.408+0000 7f3a11832640 1 -- 172.21.15.177:0/1660865992 shutdown_connections 2023-11-28T20:08:00.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.408+0000 7f3a11832640 1 --2- 172.21.15.177:0/1660865992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a0c0d1500 0x7f3a0c0d3a40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:00.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.408+0000 7f3a11832640 1 -- 172.21.15.177:0/1660865992 >> 172.21.15.177:0/1660865992 conn(0x7f3a0c0d2f20 msgr2=0x7f3a0c0d3330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:00.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.408+0000 7f3a11832640 1 -- 172.21.15.177:0/1660865992 shutdown_connections 2023-11-28T20:08:00.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.408+0000 7f3a11832640 1 -- 172.21.15.177:0/1660865992 wait complete. 2023-11-28T20:08:00.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a11832640 1 Processor -- start 2023-11-28T20:08:00.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a11832640 1 -- start start 2023-11-28T20:08:00.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a11832640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a0c0d0d00 0x7f3a0c152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:00.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a11832640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a0c0d1500 0x7f3a0c154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:00.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a11832640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a0c15d5e0 0x7f3a0c15c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:00.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a11832640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c1544b0 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a11832640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c153ea0 con 0x7f3a0c0d0d00 2023-11-28T20:08:00.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a11832640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c154e80 con 0x7f3a0c0d1500 2023-11-28T20:08:00.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a0b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a0c15d5e0 0x7f3a0c15c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:00.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a0b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a0c15d5e0 0x7f3a0c15c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41350/0 (socket says 172.21.15.177:41350) 2023-11-28T20:08:00.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a0b7fe640 1 -- 172.21.15.177:0/3069739760 learned_addr learned my addr 172.21.15.177:0/3069739760 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:00.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a03fff640 1 --2- 172.21.15.177:0/3069739760 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a0c0d1500 0x7f3a0c154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:00.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a0affd640 1 --2- 172.21.15.177:0/3069739760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a0c0d0d00 0x7f3a0c152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:00.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a0b7fe640 1 -- 172.21.15.177:0/3069739760 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a0c0d1500 msgr2=0x7f3a0c154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:00.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a0b7fe640 1 --2- 172.21.15.177:0/3069739760 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a0c0d1500 0x7f3a0c154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:00.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a0b7fe640 1 -- 172.21.15.177:0/3069739760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a0c0d0d00 msgr2=0x7f3a0c152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:00.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a0b7fe640 1 --2- 172.21.15.177:0/3069739760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a0c0d0d00 0x7f3a0c152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:00.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a0b7fe640 1 -- 172.21.15.177:0/3069739760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39fc009420 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a0b7fe640 1 --2- 172.21.15.177:0/3069739760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a0c15d5e0 0x7f3a0c15c0e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400cba0 tx=0x7f3a0400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:00.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a08ff9640 1 -- 172.21.15.177:0/3069739760 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0400ace0 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a08ff9640 1 -- 172.21.15.177:0/3069739760 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0400ae40 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a11832640 1 -- 172.21.15.177:0/3069739760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0c15caf0 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a08ff9640 1 -- 172.21.15.177:0/3069739760 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04012620 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.412+0000 7f3a11832640 1 -- 172.21.15.177:0/3069739760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0c15cdd0 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.416+0000 7f3a11832640 1 -- 172.21.15.177:0/3069739760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0c154620 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.416+0000 7f3a08ff9640 1 -- 172.21.15.177:0/3069739760 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3a04007070 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.416+0000 7f3a08ff9640 1 --2- 172.21.15.177:0/3069739760 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39ec066470 0x7f39ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:00.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.416+0000 7f3a08ff9640 1 -- 172.21.15.177:0/3069739760 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a04083ff0 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.416+0000 7f3a0affd640 1 --2- 172.21.15.177:0/3069739760 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39ec066470 0x7f39ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:00.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.416+0000 7f3a0affd640 1 --2- 172.21.15.177:0/3069739760 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39ec066470 0x7f39ec068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0ae000 tx=0x7f39fc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:00.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.420+0000 7f3a08ff9640 1 -- 172.21.15.177:0/3069739760 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a040b5280 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.604+0000 7f3a11832640 1 -- 172.21.15.177:0/3069739760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3a0c0693d0 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.604+0000 7f3a08ff9640 1 -- 172.21.15.177:0/3069739760 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3a04054e00 con 0x7f3a0c15d5e0 2023-11-28T20:08:00.607 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:08:00.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.604+0000 7f3a11832640 1 -- 172.21.15.177:0/3069739760 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39ec066470 msgr2=0x7f39ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:00.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.604+0000 7f3a11832640 1 --2- 172.21.15.177:0/3069739760 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39ec066470 0x7f39ec068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0ae000 tx=0x7f39fc0a7000 comp rx=0 tx=0).stop 2023-11-28T20:08:00.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.604+0000 7f3a11832640 1 -- 172.21.15.177:0/3069739760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a0c15d5e0 msgr2=0x7f3a0c15c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:00.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.604+0000 7f3a11832640 1 --2- 172.21.15.177:0/3069739760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a0c15d5e0 0x7f3a0c15c0e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400cba0 tx=0x7f3a0400a430 comp rx=0 tx=0).stop 2023-11-28T20:08:00.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.604+0000 7f3a11832640 1 -- 172.21.15.177:0/3069739760 shutdown_connections 2023-11-28T20:08:00.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.604+0000 7f3a11832640 1 --2- 172.21.15.177:0/3069739760 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39ec066470 0x7f39ec068930 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:00.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.604+0000 7f3a11832640 1 --2- 172.21.15.177:0/3069739760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a0c15d5e0 0x7f3a0c15c0e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:00.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.604+0000 7f3a11832640 1 --2- 172.21.15.177:0/3069739760 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a0c0d1500 0x7f3a0c154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:00.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.604+0000 7f3a11832640 1 --2- 172.21.15.177:0/3069739760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a0c0d0d00 0x7f3a0c152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:00.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.604+0000 7f3a11832640 1 -- 172.21.15.177:0/3069739760 >> 172.21.15.177:0/3069739760 conn(0x7f3a0c0d2f20 msgr2=0x7f3a0c0b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:00.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.604+0000 7f3a11832640 1 -- 172.21.15.177:0/3069739760 shutdown_connections 2023-11-28T20:08:00.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:00.604+0000 7f3a11832640 1 -- 172.21.15.177:0/3069739760 wait complete. 2023-11-28T20:08:00.627 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T20:08:00.628 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:08:00.628 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2023-11-28T20:08:00.628 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T20:08:00.628 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T20:08:00.628 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T20:08:00.628 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T20:08:00.628 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:08:00.628 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:08:00.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:00.629 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2023-11-28T20:08:00.637 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:08:00.638 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:08:00.638 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:08:00.638 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:00.638 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2023-11-28T20:08:00.638 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:00.638 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:08:00.638 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:00.638 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2023-11-28T20:08:00.638 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:08:00.639 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:00.639 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2023-11-28T20:08:00.639 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:08:00.639 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:00.639 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:08:00.639 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:00.639 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:08:00.639 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42393sec preferred_lft 42393sec 2023-11-28T20:08:00.639 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link 2023-11-28T20:08:00.639 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:00.639 INFO:teuthology.orchestra.run.smithi195.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:08:00.639 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 02:42:44:c3:25:4d brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:00.640 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:08:00.640 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:00.640 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T20:08:00.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:00.641 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2023-11-28T20:08:00.641 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2023-11-28T20:08:00.641 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add name ceph-brx type bridge 2023-11-28T20:08:00.641 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr flush dev ceph-brx 2023-11-28T20:08:00.641 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set ceph-brx up 2023-11-28T20:08:00.641 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T20:08:00.641 DEBUG:teuthology.orchestra.run.smithi195:> ') 2023-11-28T20:08:00.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:00.751 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:08:00.770 INFO:teuthology.orchestra.run.smithi195.stdout:1 2023-11-28T20:08:00.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:00.772 DEBUG:teuthology.orchestra.run.smithi195:> route 2023-11-28T20:08:00.852 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2023-11-28T20:08:00.853 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:08:00.853 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:08:00.853 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:08:00.853 INFO:teuthology.orchestra.run.smithi195.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:08:00.853 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:08:00.854 INFO:teuthology.orchestra.run.smithi195.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:08:00.854 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:08:00.854 INFO:teuthology.orchestra.run.smithi195.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:08:00.854 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:08:00.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:00.855 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2023-11-28T20:08:00.855 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2023-11-28T20:08:00.855 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:08:00.855 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:08:00.856 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:08:00.856 DEBUG:teuthology.orchestra.run.smithi195:> ') 2023-11-28T20:08:00.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:00.944 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2023-11-28T20:08:00.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:00.954 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2023-11-28T20:08:01.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:01.010 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2023-11-28T20:08:01.010 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2023-11-28T20:08:01.010 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:08:01.010 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-28T20:08:01.010 DEBUG:teuthology.orchestra.run.smithi195:> ') 2023-11-28T20:08:01.096 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-28T20:08:01.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:01.097 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2023-11-28T20:08:01.097 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2023-11-28T20:08:01.097 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-28T20:08:01.098 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T20:08:01.098 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-28T20:08:01.098 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-28T20:08:01.098 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-28T20:08:01.098 DEBUG:teuthology.orchestra.run.smithi195:> ') 2023-11-28T20:08:01.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:01.259 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2023-11-28T20:08:01.259 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2023-11-28T20:08:01.259 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2023-11-28T20:08:01.259 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T20:08:01.259 DEBUG:teuthology.orchestra.run.smithi195:> ') 2023-11-28T20:08:01.300 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-28T20:08:01.300 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:08:01.301 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T20:08:01.354 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:08:01.354 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:08:01.354 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:08:01.405 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2023-11-28T20:08:01.474 DEBUG:teuthology.orchestra.run.smithi195:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:08:01.527 INFO:teuthology.orchestra.run.smithi195.stdout:/sys 2023-11-28T20:08:01.527 INFO:teuthology.orchestra.run.smithi195.stdout:/proc 2023-11-28T20:08:01.527 INFO:teuthology.orchestra.run.smithi195.stdout:/dev 2023-11-28T20:08:01.527 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/pts 2023-11-28T20:08:01.527 INFO:teuthology.orchestra.run.smithi195.stdout:/run 2023-11-28T20:08:01.528 INFO:teuthology.orchestra.run.smithi195.stdout:/ 2023-11-28T20:08:01.528 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/security 2023-11-28T20:08:01.528 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/shm 2023-11-28T20:08:01.528 INFO:teuthology.orchestra.run.smithi195.stdout:/run/lock 2023-11-28T20:08:01.528 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup 2023-11-28T20:08:01.528 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/pstore 2023-11-28T20:08:01.528 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/bpf 2023-11-28T20:08:01.528 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:08:01.528 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/hugepages 2023-11-28T20:08:01.528 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/mqueue 2023-11-28T20:08:01.528 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/debug 2023-11-28T20:08:01.529 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/tracing 2023-11-28T20:08:01.529 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/fs/nfsd 2023-11-28T20:08:01.529 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/fuse/connections 2023-11-28T20:08:01.529 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/config 2023-11-28T20:08:01.529 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:08:01.529 INFO:teuthology.orchestra.run.smithi195.stdout:/run/rpc_pipefs 2023-11-28T20:08:01.529 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/1000 2023-11-28T20:08:01.529 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph 2023-11-28T20:08:01.529 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-4 2023-11-28T20:08:01.529 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-5 2023-11-28T20:08:01.530 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-6 2023-11-28T20:08:01.530 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-7 2023-11-28T20:08:01.530 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns 2023-11-28T20:08:01.530 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:08:01.530 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:08:01.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:01.531 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2023-11-28T20:08:01.585 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T20:08:01.585 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-28T20:08:01.636 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2023-11-28T20:08:01.657 DEBUG:teuthology.orchestra.run.smithi195:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:08:01.711 INFO:teuthology.orchestra.run.smithi195.stdout:/sys 2023-11-28T20:08:01.711 INFO:teuthology.orchestra.run.smithi195.stdout:/proc 2023-11-28T20:08:01.711 INFO:teuthology.orchestra.run.smithi195.stdout:/dev 2023-11-28T20:08:01.711 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/pts 2023-11-28T20:08:01.711 INFO:teuthology.orchestra.run.smithi195.stdout:/run 2023-11-28T20:08:01.711 INFO:teuthology.orchestra.run.smithi195.stdout:/ 2023-11-28T20:08:01.711 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/security 2023-11-28T20:08:01.712 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/shm 2023-11-28T20:08:01.712 INFO:teuthology.orchestra.run.smithi195.stdout:/run/lock 2023-11-28T20:08:01.712 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup 2023-11-28T20:08:01.712 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/pstore 2023-11-28T20:08:01.712 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/bpf 2023-11-28T20:08:01.712 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:08:01.712 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/hugepages 2023-11-28T20:08:01.712 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/mqueue 2023-11-28T20:08:01.712 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/debug 2023-11-28T20:08:01.712 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/tracing 2023-11-28T20:08:01.713 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/fs/nfsd 2023-11-28T20:08:01.713 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/fuse/connections 2023-11-28T20:08:01.713 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/config 2023-11-28T20:08:01.713 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:08:01.713 INFO:teuthology.orchestra.run.smithi195.stdout:/run/rpc_pipefs 2023-11-28T20:08:01.713 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/1000 2023-11-28T20:08:01.713 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph 2023-11-28T20:08:01.713 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-4 2023-11-28T20:08:01.713 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-5 2023-11-28T20:08:01.713 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-6 2023-11-28T20:08:01.714 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-7 2023-11-28T20:08:01.714 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns 2023-11-28T20:08:01.714 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:08:01.714 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:08:01.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:01.715 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2023-11-28T20:08:01.742 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:2023-11-28T20:08:01.738+0000 7f9c7fb7c580 -1 init, newargv = 0x55b1e4737020 newargc=15 2023-11-28T20:08:01.742 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:ceph-fuse[42792]: starting ceph client 2023-11-28T20:08:01.750 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:ceph-fuse[42792]: starting fuse 2023-11-28T20:08:01.751 INFO:teuthology.orchestra.run.smithi195.stdout:43 2023-11-28T20:08:01.751 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T20:08:01.751 DEBUG:teuthology.orchestra.run.smithi195:> sudo stdin-killer -- python3 -c ' 2023-11-28T20:08:01.752 DEBUG:teuthology.orchestra.run.smithi195:> import glob 2023-11-28T20:08:01.752 DEBUG:teuthology.orchestra.run.smithi195:> import re 2023-11-28T20:08:01.752 DEBUG:teuthology.orchestra.run.smithi195:> import os 2023-11-28T20:08:01.752 DEBUG:teuthology.orchestra.run.smithi195:> import subprocess 2023-11-28T20:08:01.752 DEBUG:teuthology.orchestra.run.smithi195:> 2023-11-28T20:08:01.752 DEBUG:teuthology.orchestra.run.smithi195:> def _find_admin_socket(client_name): 2023-11-28T20:08:01.752 DEBUG:teuthology.orchestra.run.smithi195:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-28T20:08:01.752 DEBUG:teuthology.orchestra.run.smithi195:> files = glob.glob(asok_path) 2023-11-28T20:08:01.752 DEBUG:teuthology.orchestra.run.smithi195:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-28T20:08:01.752 DEBUG:teuthology.orchestra.run.smithi195:> 2023-11-28T20:08:01.752 DEBUG:teuthology.orchestra.run.smithi195:> # Given a non-glob path, it better be there 2023-11-28T20:08:01.752 DEBUG:teuthology.orchestra.run.smithi195:> if "*" not in asok_path: 2023-11-28T20:08:01.753 DEBUG:teuthology.orchestra.run.smithi195:> assert(len(files) == 1) 2023-11-28T20:08:01.753 DEBUG:teuthology.orchestra.run.smithi195:> return files[0] 2023-11-28T20:08:01.753 DEBUG:teuthology.orchestra.run.smithi195:> 2023-11-28T20:08:01.753 DEBUG:teuthology.orchestra.run.smithi195:> for f in files: 2023-11-28T20:08:01.753 DEBUG:teuthology.orchestra.run.smithi195:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T20:08:01.753 DEBUG:teuthology.orchestra.run.smithi195:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T20:08:01.753 DEBUG:teuthology.orchestra.run.smithi195:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T20:08:01.753 DEBUG:teuthology.orchestra.run.smithi195:> contents = proc_f.read() 2023-11-28T20:08:01.753 DEBUG:teuthology.orchestra.run.smithi195:> if mountpoint in contents: 2023-11-28T20:08:01.753 DEBUG:teuthology.orchestra.run.smithi195:> return f 2023-11-28T20:08:01.753 DEBUG:teuthology.orchestra.run.smithi195:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T20:08:01.754 DEBUG:teuthology.orchestra.run.smithi195:> 2023-11-28T20:08:01.754 DEBUG:teuthology.orchestra.run.smithi195:> print(_find_admin_socket("client.1")) 2023-11-28T20:08:01.754 DEBUG:teuthology.orchestra.run.smithi195:> ' 2023-11-28T20:08:01.877 INFO:teuthology.orchestra.run.smithi195.stdout:/var/run/ceph/ceph-client.1.42792.asok 2023-11-28T20:08:01.881 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:08:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T20:08:01.889 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.42792.asok 2023-11-28T20:08:01.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:01.889 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.42792.asok status 2023-11-28T20:08:02.065 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-11-28T20:08:02.065 INFO:teuthology.orchestra.run.smithi195.stdout: "metadata": { 2023-11-28T20:08:02.066 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T20:08:02.066 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T20:08:02.066 INFO:teuthology.orchestra.run.smithi195.stdout: "entity_id": "1", 2023-11-28T20:08:02.066 INFO:teuthology.orchestra.run.smithi195.stdout: "hostname": "smithi195", 2023-11-28T20:08:02.066 INFO:teuthology.orchestra.run.smithi195.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-28T20:08:02.066 INFO:teuthology.orchestra.run.smithi195.stdout: "pid": "42792", 2023-11-28T20:08:02.066 INFO:teuthology.orchestra.run.smithi195.stdout: "root": "/" 2023-11-28T20:08:02.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-11-28T20:08:02.066 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_count": 0, 2023-11-28T20:08:02.066 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_pinned_count": 0, 2023-11-28T20:08:02.067 INFO:teuthology.orchestra.run.smithi195.stdout: "id": 4639, 2023-11-28T20:08:02.067 INFO:teuthology.orchestra.run.smithi195.stdout: "inst": { 2023-11-28T20:08:02.067 INFO:teuthology.orchestra.run.smithi195.stdout: "name": { 2023-11-28T20:08:02.067 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "client", 2023-11-28T20:08:02.067 INFO:teuthology.orchestra.run.smithi195.stdout: "num": 4639 2023-11-28T20:08:02.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-11-28T20:08:02.067 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2023-11-28T20:08:02.067 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2023-11-28T20:08:02.067 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "172.21.15.195:0", 2023-11-28T20:08:02.067 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 3179148144 2023-11-28T20:08:02.067 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-11-28T20:08:02.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-11-28T20:08:02.068 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2023-11-28T20:08:02.068 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2023-11-28T20:08:02.068 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "172.21.15.195:0", 2023-11-28T20:08:02.068 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 3179148144 2023-11-28T20:08:02.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-11-28T20:08:02.068 INFO:teuthology.orchestra.run.smithi195.stdout: "inst_str": "client.4639 172.21.15.195:0/3179148144", 2023-11-28T20:08:02.068 INFO:teuthology.orchestra.run.smithi195.stdout: "addr_str": "172.21.15.195:0/3179148144", 2023-11-28T20:08:02.068 INFO:teuthology.orchestra.run.smithi195.stdout: "inode_count": 1, 2023-11-28T20:08:02.068 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_epoch": 8, 2023-11-28T20:08:02.068 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch": 20, 2023-11-28T20:08:02.068 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch_barrier": 0, 2023-11-28T20:08:02.069 INFO:teuthology.orchestra.run.smithi195.stdout: "blocklisted": false, 2023-11-28T20:08:02.069 INFO:teuthology.orchestra.run.smithi195.stdout: "fs_name": "cephfs" 2023-11-28T20:08:02.069 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-11-28T20:08:02.081 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:08:02.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.224+0000 7f548d4ea640 1 Processor -- start 2023-11-28T20:08:02.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.224+0000 7f548d4ea640 1 -- start start 2023-11-28T20:08:02.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f548d4ea640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f548815bc90 0x7f548806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:02.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f548d4ea640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f548815c070 0x7f548806c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:02.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f548d4ea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5488145250 0x7f5488145700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:02.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f548d4ea640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5488145fc0 con 0x7f548815c070 2023-11-28T20:08:02.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f548d4ea640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54881462a0 con 0x7f548815bc90 2023-11-28T20:08:02.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f548d4ea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5488146580 con 0x7f5488145250 2023-11-28T20:08:02.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f547ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f548815c070 0x7f548806c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:02.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f547ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f548815c070 0x7f548806c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41352/0 (socket says 172.21.15.177:41352) 2023-11-28T20:08:02.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f547ffff640 1 -- 172.21.15.177:0/1974580654 learned_addr learned my addr 172.21.15.177:0/1974580654 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:02.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f5486ffd640 1 --2- 172.21.15.177:0/1974580654 >> v2:172.21.15.195:3300/0 conn(0x7f548815bc90 0x7f548806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:02.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f54877fe640 1 --2- 172.21.15.177:0/1974580654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5488145250 0x7f5488145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:02.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f547ffff640 1 -- 172.21.15.177:0/1974580654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5488145250 msgr2=0x7f5488145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:02.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f547ffff640 1 --2- 172.21.15.177:0/1974580654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5488145250 0x7f5488145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:02.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f547ffff640 1 -- 172.21.15.177:0/1974580654 >> v2:172.21.15.195:3300/0 conn(0x7f548815bc90 msgr2=0x7f548806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:02.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f547ffff640 1 --2- 172.21.15.177:0/1974580654 >> v2:172.21.15.195:3300/0 conn(0x7f548815bc90 0x7f548806c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:02.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f547ffff640 1 -- 172.21.15.177:0/1974580654 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5488146860 con 0x7f548815c070 2023-11-28T20:08:02.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.228+0000 7f547ffff640 1 --2- 172.21.15.177:0/1974580654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815c070 0x7f548806c800 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5470009870 tx=0x7f547001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c6c96ff88de7c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:02.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f54867fc640 1 -- 172.21.15.177:0/1974580654 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700aa610 con 0x7f548815c070 2023-11-28T20:08:02.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f54867fc640 1 -- 172.21.15.177:0/1974580654 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54700a6040 con 0x7f548815c070 2023-11-28T20:08:02.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f54867fc640 1 -- 172.21.15.177:0/1974580654 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700aa990 con 0x7f548815c070 2023-11-28T20:08:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 -- 172.21.15.177:0/1974580654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815c070 msgr2=0x7f548806c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 --2- 172.21.15.177:0/1974580654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815c070 0x7f548806c800 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5470009870 tx=0x7f547001c4d0 comp rx=0 tx=0).stop 2023-11-28T20:08:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 -- 172.21.15.177:0/1974580654 shutdown_connections 2023-11-28T20:08:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 --2- 172.21.15.177:0/1974580654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5488145250 0x7f5488145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 --2- 172.21.15.177:0/1974580654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815c070 0x7f548806c800 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 --2- 172.21.15.177:0/1974580654 >> v2:172.21.15.195:3300/0 conn(0x7f548815bc90 0x7f548806c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 -- 172.21.15.177:0/1974580654 >> 172.21.15.177:0/1974580654 conn(0x7f548806a530 msgr2=0x7f548806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 -- 172.21.15.177:0/1974580654 shutdown_connections 2023-11-28T20:08:02.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 -- 172.21.15.177:0/1974580654 wait complete. 2023-11-28T20:08:02.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 Processor -- start 2023-11-28T20:08:02.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 -- start start 2023-11-28T20:08:02.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5488145250 0x7f5488143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:02.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815bc90 0x7f5488140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:02.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548815c070 0x7f548813fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:02.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5488163130 con 0x7f548815bc90 2023-11-28T20:08:02.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548815a8c0 con 0x7f5488145250 2023-11-28T20:08:02.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f548d4ea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54881636d0 con 0x7f548815c070 2023-11-28T20:08:02.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f547ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815bc90 0x7f5488140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:02.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f547ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815bc90 0x7f5488140d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41356/0 (socket says 172.21.15.177:41356) 2023-11-28T20:08:02.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f547ffff640 1 -- 172.21.15.177:0/3767843356 learned_addr learned my addr 172.21.15.177:0/3767843356 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:02.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.232+0000 7f5486ffd640 1 --2- 172.21.15.177:0/3767843356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5488145250 0x7f5488143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f54877fe640 1 --2- 172.21.15.177:0/3767843356 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548815c070 0x7f548813fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f547ffff640 1 -- 172.21.15.177:0/3767843356 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548815c070 msgr2=0x7f548813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f547ffff640 1 --2- 172.21.15.177:0/3767843356 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548815c070 0x7f548813fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f547ffff640 1 -- 172.21.15.177:0/3767843356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5488145250 msgr2=0x7f5488143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f547ffff640 1 --2- 172.21.15.177:0/3767843356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5488145250 0x7f5488143460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f547ffff640 1 -- 172.21.15.177:0/3767843356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54700094d0 con 0x7f548815bc90 2023-11-28T20:08:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f547ffff640 1 --2- 172.21.15.177:0/3767843356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815bc90 0x7f5488140d40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f54700ac040 tx=0x7f5470019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f547f7fe640 1 -- 172.21.15.177:0/3767843356 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700be410 con 0x7f548815bc90 2023-11-28T20:08:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f547f7fe640 1 -- 172.21.15.177:0/3767843356 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54700be590 con 0x7f548815bc90 2023-11-28T20:08:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f548d4ea640 1 -- 172.21.15.177:0/3767843356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548815a300 con 0x7f548815bc90 2023-11-28T20:08:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f547f7fe640 1 -- 172.21.15.177:0/3767843356 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700be940 con 0x7f548815bc90 2023-11-28T20:08:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f548d4ea640 1 -- 172.21.15.177:0/3767843356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5488163360 con 0x7f548815bc90 2023-11-28T20:08:02.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f548d4ea640 1 -- 172.21.15.177:0/3767843356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5488163860 con 0x7f548815bc90 2023-11-28T20:08:02.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f547f7fe640 1 -- 172.21.15.177:0/3767843356 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f54700beaa0 con 0x7f548815bc90 2023-11-28T20:08:02.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f547f7fe640 1 --2- 172.21.15.177:0/3767843356 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5468066470 0x7f5468068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:02.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.236+0000 7f547f7fe640 1 -- 172.21.15.177:0/3767843356 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f547011e4d0 con 0x7f548815bc90 2023-11-28T20:08:02.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.240+0000 7f5486ffd640 1 --2- 172.21.15.177:0/3767843356 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5468066470 0x7f5468068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:02.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.240+0000 7f5486ffd640 1 --2- 172.21.15.177:0/3767843356 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5468066470 0x7f5468068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5478009b60 tx=0x7f5478009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:02.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.244+0000 7f547f7fe640 1 -- 172.21.15.177:0/3767843356 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f54700eba70 con 0x7f548815bc90 2023-11-28T20:08:02.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.428+0000 7f548d4ea640 1 -- 172.21.15.177:0/3767843356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5488069440 con 0x7f548815bc90 2023-11-28T20:08:02.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.428+0000 7f547f7fe640 1 -- 172.21.15.177:0/3767843356 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f54700ef090 con 0x7f548815bc90 2023-11-28T20:08:02.432 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:08:02.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.428+0000 7f548d4ea640 1 -- 172.21.15.177:0/3767843356 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5468066470 msgr2=0x7f5468068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:02.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.428+0000 7f548d4ea640 1 --2- 172.21.15.177:0/3767843356 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5468066470 0x7f5468068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5478009b60 tx=0x7f5478009190 comp rx=0 tx=0).stop 2023-11-28T20:08:02.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.428+0000 7f548d4ea640 1 -- 172.21.15.177:0/3767843356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815bc90 msgr2=0x7f5488140d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:02.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.428+0000 7f548d4ea640 1 --2- 172.21.15.177:0/3767843356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815bc90 0x7f5488140d40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f54700ac040 tx=0x7f5470019270 comp rx=0 tx=0).stop 2023-11-28T20:08:02.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.428+0000 7f548d4ea640 1 -- 172.21.15.177:0/3767843356 shutdown_connections 2023-11-28T20:08:02.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.428+0000 7f548d4ea640 1 --2- 172.21.15.177:0/3767843356 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5468066470 0x7f5468068930 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:02.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.428+0000 7f548d4ea640 1 --2- 172.21.15.177:0/3767843356 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548815c070 0x7f548813fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:02.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.428+0000 7f548d4ea640 1 --2- 172.21.15.177:0/3767843356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815bc90 0x7f5488140d40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:02.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.428+0000 7f548d4ea640 1 --2- 172.21.15.177:0/3767843356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5488145250 0x7f5488143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:02.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.428+0000 7f548d4ea640 1 -- 172.21.15.177:0/3767843356 >> 172.21.15.177:0/3767843356 conn(0x7f548806a530 msgr2=0x7f54880aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:02.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.428+0000 7f548d4ea640 1 -- 172.21.15.177:0/3767843356 shutdown_connections 2023-11-28T20:08:02.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:02.428+0000 7f548d4ea640 1 -- 172.21.15.177:0/3767843356 wait complete. 2023-11-28T20:08:02.454 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T20:08:02.454 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:08:02.454 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2023-11-28T20:08:02.454 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-28T20:08:02.454 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T20:08:02.454 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T20:08:02.455 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T20:08:02.455 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:08:02.455 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-28T20:08:02.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:02.456 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2023-11-28T20:08:02.465 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:08:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:08:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:08:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2023-11-28T20:08:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:02.466 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:08:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2023-11-28T20:08:02.466 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:08:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2023-11-28T20:08:02.466 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:08:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:02.466 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:08:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:08:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42391sec preferred_lft 42391sec 2023-11-28T20:08:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link 2023-11-28T20:08:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:02.467 INFO:teuthology.orchestra.run.smithi195.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:08:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 02:42:44:c3:25:4d brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:08:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:02.467 INFO:teuthology.orchestra.run.smithi195.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:08:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:08:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-28T20:08:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:02.468 INFO:teuthology.orchestra.run.smithi195.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:08:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:08:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-28T20:08:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:02.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:02.469 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:08:02.531 INFO:teuthology.orchestra.run.smithi195.stdout:1 2023-11-28T20:08:02.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:02.534 DEBUG:teuthology.orchestra.run.smithi195:> route 2023-11-28T20:08:02.587 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2023-11-28T20:08:02.587 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:08:02.587 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:08:02.588 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:08:02.588 INFO:teuthology.orchestra.run.smithi195.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:08:02.588 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:08:02.588 INFO:teuthology.orchestra.run.smithi195.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:08:02.588 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:08:02.588 INFO:teuthology.orchestra.run.smithi195.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:08:02.588 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:08:02.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:02.589 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2023-11-28T20:08:02.589 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2023-11-28T20:08:02.589 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:08:02.589 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:08:02.589 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:08:02.589 DEBUG:teuthology.orchestra.run.smithi195:> ') 2023-11-28T20:08:02.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:02.679 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2023-11-28T20:08:02.688 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T20:08:02.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:02.689 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2023-11-28T20:08:02.737 INFO:teuthology.orchestra.run.smithi195.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-28T20:08:02.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:02.738 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2023-11-28T20:08:02.738 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2023-11-28T20:08:02.738 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T20:08:02.738 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-28T20:08:02.738 DEBUG:teuthology.orchestra.run.smithi195:> ') 2023-11-28T20:08:02.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:02.819 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T20:08:02.886 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:08:02.886 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:08:02.886 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:08:02.886 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:02.886 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2023-11-28T20:08:02.886 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:02.886 INFO:teuthology.orchestra.run.smithi195.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:08:02.887 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:4b:14:53:c3:f4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T20:08:02.887 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T20:08:02.887 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:02.887 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::304b:14ff:fe53:c3f4/64 scope link tentative 2023-11-28T20:08:02.887 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:02.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:02.888 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T20:08:02.953 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:08:02.954 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:08:02.954 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:08:02.954 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:02.954 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2023-11-28T20:08:02.954 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:02.954 INFO:teuthology.orchestra.run.smithi195.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:08:02.954 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:4b:14:53:c3:f4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T20:08:02.954 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T20:08:02.955 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:02.955 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::304b:14ff:fe53:c3f4/64 scope link tentative 2023-11-28T20:08:02.955 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:02.956 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-28T20:08:02.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:02.956 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2023-11-28T20:08:02.956 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2023-11-28T20:08:02.956 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-28T20:08:02.956 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T20:08:02.957 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-28T20:08:02.957 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-28T20:08:02.957 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-28T20:08:02.957 DEBUG:teuthology.orchestra.run.smithi195:> ') 2023-11-28T20:08:03.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:03.094 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2023-11-28T20:08:03.094 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2023-11-28T20:08:03.095 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.1 up 2023-11-28T20:08:03.095 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T20:08:03.095 DEBUG:teuthology.orchestra.run.smithi195:> ') 2023-11-28T20:08:03.137 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-28T20:08:03.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:08:03.137 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-28T20:08:03.185 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-28T20:08:03.186 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:08:03.186 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-28T20:08:03.242 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2023-11-28T20:08:03.310 DEBUG:teuthology.orchestra.run.smithi195:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:08:03.364 INFO:teuthology.orchestra.run.smithi195.stdout:/sys 2023-11-28T20:08:03.364 INFO:teuthology.orchestra.run.smithi195.stdout:/proc 2023-11-28T20:08:03.364 INFO:teuthology.orchestra.run.smithi195.stdout:/dev 2023-11-28T20:08:03.364 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/pts 2023-11-28T20:08:03.364 INFO:teuthology.orchestra.run.smithi195.stdout:/run 2023-11-28T20:08:03.364 INFO:teuthology.orchestra.run.smithi195.stdout:/ 2023-11-28T20:08:03.364 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/security 2023-11-28T20:08:03.364 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/shm 2023-11-28T20:08:03.364 INFO:teuthology.orchestra.run.smithi195.stdout:/run/lock 2023-11-28T20:08:03.364 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup 2023-11-28T20:08:03.365 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/pstore 2023-11-28T20:08:03.365 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/bpf 2023-11-28T20:08:03.365 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:08:03.365 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/hugepages 2023-11-28T20:08:03.365 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/mqueue 2023-11-28T20:08:03.365 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/debug 2023-11-28T20:08:03.365 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/tracing 2023-11-28T20:08:03.365 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/fs/nfsd 2023-11-28T20:08:03.365 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/fuse/connections 2023-11-28T20:08:03.365 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/config 2023-11-28T20:08:03.365 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:08:03.365 INFO:teuthology.orchestra.run.smithi195.stdout:/run/rpc_pipefs 2023-11-28T20:08:03.365 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/1000 2023-11-28T20:08:03.366 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph 2023-11-28T20:08:03.366 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-4 2023-11-28T20:08:03.366 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-5 2023-11-28T20:08:03.366 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-6 2023-11-28T20:08:03.366 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-7 2023-11-28T20:08:03.366 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns 2023-11-28T20:08:03.366 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:08:03.366 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:08:03.366 INFO:teuthology.orchestra.run.smithi195.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-28T20:08:03.366 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T20:08:03.366 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T20:08:03.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:03.367 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2023-11-28T20:08:03.417 INFO:teuthology.orchestra.run.smithi195.stdout:43 2023-11-28T20:08:03.417 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-28T20:08:03.417 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-28T20:08:03.464 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2023-11-28T20:08:03.486 DEBUG:teuthology.orchestra.run.smithi195:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:08:03.539 INFO:teuthology.orchestra.run.smithi195.stdout:/sys 2023-11-28T20:08:03.539 INFO:teuthology.orchestra.run.smithi195.stdout:/proc 2023-11-28T20:08:03.539 INFO:teuthology.orchestra.run.smithi195.stdout:/dev 2023-11-28T20:08:03.539 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/pts 2023-11-28T20:08:03.539 INFO:teuthology.orchestra.run.smithi195.stdout:/run 2023-11-28T20:08:03.539 INFO:teuthology.orchestra.run.smithi195.stdout:/ 2023-11-28T20:08:03.540 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/security 2023-11-28T20:08:03.540 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/shm 2023-11-28T20:08:03.540 INFO:teuthology.orchestra.run.smithi195.stdout:/run/lock 2023-11-28T20:08:03.540 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup 2023-11-28T20:08:03.540 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/pstore 2023-11-28T20:08:03.540 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/bpf 2023-11-28T20:08:03.540 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:08:03.540 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/hugepages 2023-11-28T20:08:03.540 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/mqueue 2023-11-28T20:08:03.541 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/debug 2023-11-28T20:08:03.541 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/tracing 2023-11-28T20:08:03.541 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/fs/nfsd 2023-11-28T20:08:03.541 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/fuse/connections 2023-11-28T20:08:03.541 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/config 2023-11-28T20:08:03.541 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:08:03.541 INFO:teuthology.orchestra.run.smithi195.stdout:/run/rpc_pipefs 2023-11-28T20:08:03.541 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/1000 2023-11-28T20:08:03.541 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph 2023-11-28T20:08:03.541 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-4 2023-11-28T20:08:03.541 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-5 2023-11-28T20:08:03.542 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-6 2023-11-28T20:08:03.542 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-7 2023-11-28T20:08:03.542 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns 2023-11-28T20:08:03.542 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:08:03.542 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:08:03.542 INFO:teuthology.orchestra.run.smithi195.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-28T20:08:03.542 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T20:08:03.542 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T20:08:03.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:03.544 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2023-11-28T20:08:03.559 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi195.stderr:2023-11-28T20:08:03.554+0000 7fdc5af31580 -1 init, newargv = 0x55c907f520b0 newargc=15 2023-11-28T20:08:03.560 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi195.stderr:ceph-fuse[42898]: starting ceph client 2023-11-28T20:08:03.567 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi195.stderr:ceph-fuse[42898]: starting fuse 2023-11-28T20:08:03.568 INFO:teuthology.orchestra.run.smithi195.stdout:43 2023-11-28T20:08:03.568 INFO:teuthology.orchestra.run.smithi195.stdout:44 2023-11-28T20:08:03.569 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-28T20:08:03.570 DEBUG:teuthology.orchestra.run.smithi195:> sudo stdin-killer -- python3 -c ' 2023-11-28T20:08:03.570 DEBUG:teuthology.orchestra.run.smithi195:> import glob 2023-11-28T20:08:03.570 DEBUG:teuthology.orchestra.run.smithi195:> import re 2023-11-28T20:08:03.570 DEBUG:teuthology.orchestra.run.smithi195:> import os 2023-11-28T20:08:03.571 DEBUG:teuthology.orchestra.run.smithi195:> import subprocess 2023-11-28T20:08:03.571 DEBUG:teuthology.orchestra.run.smithi195:> 2023-11-28T20:08:03.571 DEBUG:teuthology.orchestra.run.smithi195:> def _find_admin_socket(client_name): 2023-11-28T20:08:03.571 DEBUG:teuthology.orchestra.run.smithi195:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-28T20:08:03.571 DEBUG:teuthology.orchestra.run.smithi195:> files = glob.glob(asok_path) 2023-11-28T20:08:03.571 DEBUG:teuthology.orchestra.run.smithi195:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-28T20:08:03.571 DEBUG:teuthology.orchestra.run.smithi195:> 2023-11-28T20:08:03.572 DEBUG:teuthology.orchestra.run.smithi195:> # Given a non-glob path, it better be there 2023-11-28T20:08:03.572 DEBUG:teuthology.orchestra.run.smithi195:> if "*" not in asok_path: 2023-11-28T20:08:03.572 DEBUG:teuthology.orchestra.run.smithi195:> assert(len(files) == 1) 2023-11-28T20:08:03.573 DEBUG:teuthology.orchestra.run.smithi195:> return files[0] 2023-11-28T20:08:03.573 DEBUG:teuthology.orchestra.run.smithi195:> 2023-11-28T20:08:03.573 DEBUG:teuthology.orchestra.run.smithi195:> for f in files: 2023-11-28T20:08:03.573 DEBUG:teuthology.orchestra.run.smithi195:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T20:08:03.573 DEBUG:teuthology.orchestra.run.smithi195:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T20:08:03.573 DEBUG:teuthology.orchestra.run.smithi195:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T20:08:03.574 DEBUG:teuthology.orchestra.run.smithi195:> contents = proc_f.read() 2023-11-28T20:08:03.574 DEBUG:teuthology.orchestra.run.smithi195:> if mountpoint in contents: 2023-11-28T20:08:03.574 DEBUG:teuthology.orchestra.run.smithi195:> return f 2023-11-28T20:08:03.574 DEBUG:teuthology.orchestra.run.smithi195:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T20:08:03.574 DEBUG:teuthology.orchestra.run.smithi195:> 2023-11-28T20:08:03.575 DEBUG:teuthology.orchestra.run.smithi195:> print(_find_admin_socket("client.3")) 2023-11-28T20:08:03.575 DEBUG:teuthology.orchestra.run.smithi195:> ' 2023-11-28T20:08:03.689 INFO:teuthology.orchestra.run.smithi195.stdout:/var/run/ceph/ceph-client.3.42898.asok 2023-11-28T20:08:03.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-11-28T20:08:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T20:08:03.700 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.42898.asok 2023-11-28T20:08:03.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:03.701 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.42898.asok status 2023-11-28T20:08:03.869 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-11-28T20:08:03.869 INFO:teuthology.orchestra.run.smithi195.stdout: "metadata": { 2023-11-28T20:08:03.869 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T20:08:03.869 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T20:08:03.870 INFO:teuthology.orchestra.run.smithi195.stdout: "entity_id": "3", 2023-11-28T20:08:03.870 INFO:teuthology.orchestra.run.smithi195.stdout: "hostname": "smithi195", 2023-11-28T20:08:03.870 INFO:teuthology.orchestra.run.smithi195.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-28T20:08:03.870 INFO:teuthology.orchestra.run.smithi195.stdout: "pid": "42898", 2023-11-28T20:08:03.870 INFO:teuthology.orchestra.run.smithi195.stdout: "root": "/" 2023-11-28T20:08:03.870 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-11-28T20:08:03.870 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_count": 0, 2023-11-28T20:08:03.871 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_pinned_count": 0, 2023-11-28T20:08:03.871 INFO:teuthology.orchestra.run.smithi195.stdout: "id": 4654, 2023-11-28T20:08:03.871 INFO:teuthology.orchestra.run.smithi195.stdout: "inst": { 2023-11-28T20:08:03.871 INFO:teuthology.orchestra.run.smithi195.stdout: "name": { 2023-11-28T20:08:03.871 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "client", 2023-11-28T20:08:03.871 INFO:teuthology.orchestra.run.smithi195.stdout: "num": 4654 2023-11-28T20:08:03.871 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-11-28T20:08:03.872 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2023-11-28T20:08:03.872 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2023-11-28T20:08:03.872 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "192.168.0.2:0", 2023-11-28T20:08:03.872 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 2489920977 2023-11-28T20:08:03.872 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-11-28T20:08:03.872 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-11-28T20:08:03.872 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2023-11-28T20:08:03.873 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2023-11-28T20:08:03.873 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "192.168.0.2:0", 2023-11-28T20:08:03.873 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 2489920977 2023-11-28T20:08:03.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-11-28T20:08:03.873 INFO:teuthology.orchestra.run.smithi195.stdout: "inst_str": "client.4654 192.168.0.2:0/2489920977", 2023-11-28T20:08:03.873 INFO:teuthology.orchestra.run.smithi195.stdout: "addr_str": "192.168.0.2:0/2489920977", 2023-11-28T20:08:03.873 INFO:teuthology.orchestra.run.smithi195.stdout: "inode_count": 1, 2023-11-28T20:08:03.874 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_epoch": 8, 2023-11-28T20:08:03.874 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch": 20, 2023-11-28T20:08:03.874 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch_barrier": 0, 2023-11-28T20:08:03.874 INFO:teuthology.orchestra.run.smithi195.stdout: "blocklisted": false, 2023-11-28T20:08:03.874 INFO:teuthology.orchestra.run.smithi195.stdout: "fs_name": "cephfs" 2023-11-28T20:08:03.874 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-11-28T20:08:03.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:03.884 DEBUG:teuthology.orchestra.run.smithi177:> stat --file-system '--printf=%T 2023-11-28T20:08:03.884 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T20:08:03.894 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-11-28T20:08:03.894 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T20:08:03.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:03.895 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:08:03.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:03.966 DEBUG:teuthology.orchestra.run.smithi177:> stat --file-system '--printf=%T 2023-11-28T20:08:03.966 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-28T20:08:04.015 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-11-28T20:08:04.015 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-28T20:08:04.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:04.015 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-28T20:08:04.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:04.088 DEBUG:teuthology.orchestra.run.smithi195:> stat --file-system '--printf=%T 2023-11-28T20:08:04.088 DEBUG:teuthology.orchestra.run.smithi195:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-28T20:08:04.098 INFO:teuthology.orchestra.run.smithi195.stdout:fuseblk 2023-11-28T20:08:04.098 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-28T20:08:04.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:04.098 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:08:04.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:04.161 DEBUG:teuthology.orchestra.run.smithi195:> stat --file-system '--printf=%T 2023-11-28T20:08:04.161 DEBUG:teuthology.orchestra.run.smithi195:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-28T20:08:04.214 INFO:teuthology.orchestra.run.smithi195.stdout:fuseblk 2023-11-28T20:08:04.214 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-28T20:08:04.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:04.215 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-28T20:08:04.281 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-28T20:08:04.298 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:04.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.444+0000 7f5e7e481640 1 Processor -- start 2023-11-28T20:08:04.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.444+0000 7f5e7e481640 1 -- start start 2023-11-28T20:08:04.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.444+0000 7f5e7e481640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5e780ce680 0x7f5e78168170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:04.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.444+0000 7f5e7e481640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e780cf130 con 0x7f5e781608c0 2023-11-28T20:08:04.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.444+0000 7f5e7e481640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e780d0330 con 0x7f5e78160ca0 2023-11-28T20:08:04.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.444+0000 7f5e7e481640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e780ceb70 con 0x7f5e780ce680 2023-11-28T20:08:04.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.448+0000 7f5e7d47f640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5e781608c0 0x7f5e780cf510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:58232/0 (socket says 172.21.15.177:58232) 2023-11-28T20:08:04.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.448+0000 7f5e7d47f640 1 -- 172.21.15.177:0/3529623095 learned_addr learned my addr 172.21.15.177:0/3529623095 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:04.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.448+0000 7f5e7dc80640 1 --2- 172.21.15.177:0/3529623095 >> v2:172.21.15.177:3300/0 conn(0x7f5e780ce680 0x7f5e78168170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:04.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.448+0000 7f5e6ffff640 1 -- 172.21.15.177:0/3529623095 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289490276 0 0) 0x7f5e780cf130 con 0x7f5e781608c0 2023-11-28T20:08:04.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.448+0000 7f5e6ffff640 1 -- 172.21.15.177:0/3529623095 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e64003530 con 0x7f5e781608c0 2023-11-28T20:08:04.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.448+0000 7f5e7dc80640 1 -- 172.21.15.177:0/3529623095 >> v1:172.21.15.195:6789/0 conn(0x7f5e78160ca0 legacy=0x7f5e780cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:04.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.448+0000 7f5e7dc80640 1 -- 172.21.15.177:0/3529623095 >> v1:172.21.15.177:6789/0 conn(0x7f5e781608c0 legacy=0x7f5e780cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:04.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.448+0000 7f5e7dc80640 1 -- 172.21.15.177:0/3529623095 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e780cee50 con 0x7f5e780ce680 2023-11-28T20:08:04.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.448+0000 7f5e7dc80640 1 --2- 172.21.15.177:0/3529623095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e780ce680 0x7f5e78168170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009d90 tx=0x7f5e7001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d7c3cecd93ee22 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:04.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.448+0000 7f5e6ffff640 1 -- 172.21.15.177:0/3529623095 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700a59e0 con 0x7f5e780ce680 2023-11-28T20:08:04.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.448+0000 7f5e6ffff640 1 -- 172.21.15.177:0/3529623095 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e700a5b40 con 0x7f5e780ce680 2023-11-28T20:08:04.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.448+0000 7f5e6ffff640 1 -- 172.21.15.177:0/3529623095 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700ad440 con 0x7f5e780ce680 2023-11-28T20:08:04.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7e481640 1 -- 172.21.15.177:0/3529623095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e780ce680 msgr2=0x7f5e78168170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:04.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7e481640 1 --2- 172.21.15.177:0/3529623095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e780ce680 0x7f5e78168170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009d90 tx=0x7f5e7001c920 comp rx=0 tx=0).stop 2023-11-28T20:08:04.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7e481640 1 -- 172.21.15.177:0/3529623095 shutdown_connections 2023-11-28T20:08:04.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7e481640 1 --2- 172.21.15.177:0/3529623095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e780ce680 0x7f5e78168170 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7e481640 1 -- 172.21.15.177:0/3529623095 >> 172.21.15.177:0/3529623095 conn(0x7f5e780d2fd0 msgr2=0x7f5e780d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:04.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7e481640 1 -- 172.21.15.177:0/3529623095 shutdown_connections 2023-11-28T20:08:04.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7e481640 1 -- 172.21.15.177:0/3529623095 wait complete. 2023-11-28T20:08:04.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7e481640 1 Processor -- start 2023-11-28T20:08:04.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7e481640 1 -- start start 2023-11-28T20:08:04.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7e481640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e780ce680 0x7f5e78154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:04.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7e481640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e781608c0 0x7f5e780cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:04.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7e481640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e78160ca0 0x7f5e780cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:04.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7e481640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e780b8a70 con 0x7f5e781608c0 2023-11-28T20:08:04.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7e481640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e780b7e60 con 0x7f5e780ce680 2023-11-28T20:08:04.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7e481640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e780b8140 con 0x7f5e78160ca0 2023-11-28T20:08:04.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7cc7e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e781608c0 0x7f5e780cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:04.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7d47f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e780ce680 0x7f5e78154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:04.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7cc7e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e781608c0 0x7f5e780cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41368/0 (socket says 172.21.15.177:41368) 2023-11-28T20:08:04.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7cc7e640 1 -- 172.21.15.177:0/1792762768 learned_addr learned my addr 172.21.15.177:0/1792762768 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:04.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7dc80640 1 --2- 172.21.15.177:0/1792762768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e78160ca0 0x7f5e780cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:04.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7cc7e640 1 -- 172.21.15.177:0/1792762768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e78160ca0 msgr2=0x7f5e780cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:04.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7cc7e640 1 --2- 172.21.15.177:0/1792762768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e78160ca0 0x7f5e780cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7cc7e640 1 -- 172.21.15.177:0/1792762768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e780ce680 msgr2=0x7f5e78154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:04.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7cc7e640 1 --2- 172.21.15.177:0/1792762768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e780ce680 0x7f5e78154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.452+0000 7f5e7cc7e640 1 -- 172.21.15.177:0/1792762768 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e70009a70 con 0x7f5e781608c0 2023-11-28T20:08:04.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.456+0000 7f5e7cc7e640 1 --2- 172.21.15.177:0/1792762768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e781608c0 0x7f5e780cc7d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800c390 tx=0x7f5e6800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:04.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.456+0000 7f5e6dffb640 1 -- 172.21.15.177:0/1792762768 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e680052d0 con 0x7f5e781608c0 2023-11-28T20:08:04.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.456+0000 7f5e6dffb640 1 -- 172.21.15.177:0/1792762768 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e68005430 con 0x7f5e781608c0 2023-11-28T20:08:04.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.456+0000 7f5e7e481640 1 -- 172.21.15.177:0/1792762768 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e780b8420 con 0x7f5e781608c0 2023-11-28T20:08:04.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.456+0000 7f5e6dffb640 1 -- 172.21.15.177:0/1792762768 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68003820 con 0x7f5e781608c0 2023-11-28T20:08:04.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.456+0000 7f5e7e481640 1 -- 172.21.15.177:0/1792762768 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e78154eb0 con 0x7f5e781608c0 2023-11-28T20:08:04.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.456+0000 7f5e7e481640 1 -- 172.21.15.177:0/1792762768 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e780a1000 con 0x7f5e781608c0 2023-11-28T20:08:04.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.456+0000 7f5e6dffb640 1 -- 172.21.15.177:0/1792762768 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5e68003980 con 0x7f5e781608c0 2023-11-28T20:08:04.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.456+0000 7f5e6dffb640 1 --2- 172.21.15.177:0/1792762768 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5e5c066470 0x7f5e5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:04.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.456+0000 7f5e6dffb640 1 -- 172.21.15.177:0/1792762768 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e68083350 con 0x7f5e781608c0 2023-11-28T20:08:04.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.456+0000 7f5e7d47f640 1 --2- 172.21.15.177:0/1792762768 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5e5c066470 0x7f5e5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:04.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.460+0000 7f5e7d47f640 1 --2- 172.21.15.177:0/1792762768 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5e5c066470 0x7f5e5c068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5e740011f0 tx=0x7f5e74007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:04.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.460+0000 7f5e6dffb640 1 -- 172.21.15.177:0/1792762768 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5e68050870 con 0x7f5e781608c0 2023-11-28T20:08:04.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.612+0000 7f5e7e481640 1 -- 172.21.15.177:0/1792762768 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e780b8bb0 con 0x7f5e781608c0 2023-11-28T20:08:04.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.612+0000 7f5e6dffb640 1 -- 172.21.15.177:0/1792762768 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f5e780b8bb0 con 0x7f5e781608c0 2023-11-28T20:08:04.617 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:04.617 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:04.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.616+0000 7f5e7e481640 1 -- 172.21.15.177:0/1792762768 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5e5c066470 msgr2=0x7f5e5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:04.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.616+0000 7f5e7e481640 1 --2- 172.21.15.177:0/1792762768 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5e5c066470 0x7f5e5c068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5e740011f0 tx=0x7f5e74007d40 comp rx=0 tx=0).stop 2023-11-28T20:08:04.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.616+0000 7f5e7e481640 1 -- 172.21.15.177:0/1792762768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e781608c0 msgr2=0x7f5e780cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:04.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.616+0000 7f5e7e481640 1 --2- 172.21.15.177:0/1792762768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e781608c0 0x7f5e780cc7d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800c390 tx=0x7f5e6800c850 comp rx=0 tx=0).stop 2023-11-28T20:08:04.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.616+0000 7f5e7e481640 1 -- 172.21.15.177:0/1792762768 shutdown_connections 2023-11-28T20:08:04.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.616+0000 7f5e7e481640 1 --2- 172.21.15.177:0/1792762768 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5e5c066470 0x7f5e5c068930 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.616+0000 7f5e7e481640 1 --2- 172.21.15.177:0/1792762768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e78160ca0 0x7f5e780cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.616+0000 7f5e7e481640 1 --2- 172.21.15.177:0/1792762768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e781608c0 0x7f5e780cc7d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.616+0000 7f5e7e481640 1 --2- 172.21.15.177:0/1792762768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e780ce680 0x7f5e78154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.616+0000 7f5e7e481640 1 -- 172.21.15.177:0/1792762768 >> 172.21.15.177:0/1792762768 conn(0x7f5e780d2fd0 msgr2=0x7f5e7815e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:04.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.616+0000 7f5e7e481640 1 -- 172.21.15.177:0/1792762768 shutdown_connections 2023-11-28T20:08:04.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.616+0000 7f5e7e481640 1 -- 172.21.15.177:0/1792762768 wait complete. 2023-11-28T20:08:04.638 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:04.638 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:04.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f712159d640 1 Processor -- start 2023-11-28T20:08:04.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f712159d640 1 -- start start 2023-11-28T20:08:04.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f712159d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f711c0b35b0 0x7f711c0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:04.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f712159d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f711c0b3c70 0x7f711c15f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f712159d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f711c0cf780 0x7f711c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f712159d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c0d4090 con 0x7f711c0b35b0 2023-11-28T20:08:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f712159d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c0d0130 con 0x7f711c0cf780 2023-11-28T20:08:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f712159d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0d3880 con 0x7f711c0b3c70 2023-11-28T20:08:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f711affd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f711c0b35b0 0x7f711c0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f711affd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f711c0b35b0 0x7f711c0d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41382/0 (socket says 172.21.15.177:41382) 2023-11-28T20:08:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f711affd640 1 -- 172.21.15.177:0/483629268 learned_addr learned my addr 172.21.15.177:0/483629268 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:04.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f711b7fe640 1 --2- 172.21.15.177:0/483629268 >> v2:172.21.15.195:3300/0 conn(0x7f711c0cf780 0x7f711c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:04.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f71127fc640 1 --2- 172.21.15.177:0/483629268 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f711c0b3c70 0x7f711c15f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:04.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f711affd640 1 -- 172.21.15.177:0/483629268 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f711c0b3c70 msgr2=0x7f711c15f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:04.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f711affd640 1 --2- 172.21.15.177:0/483629268 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f711c0b3c70 0x7f711c15f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f711affd640 1 -- 172.21.15.177:0/483629268 >> v2:172.21.15.195:3300/0 conn(0x7f711c0cf780 msgr2=0x7f711c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:04.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f711affd640 1 --2- 172.21.15.177:0/483629268 >> v2:172.21.15.195:3300/0 conn(0x7f711c0cf780 0x7f711c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f711affd640 1 -- 172.21.15.177:0/483629268 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c0cdc80 con 0x7f711c0b35b0 2023-11-28T20:08:04.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.776+0000 7f711b7fe640 1 --2- 172.21.15.177:0/483629268 >> v2:172.21.15.195:3300/0 conn(0x7f711c0cf780 0x7f711c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:04.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.780+0000 7f711affd640 1 --2- 172.21.15.177:0/483629268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f711c0b35b0 0x7f711c0d0f50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f711c08c5e0 tx=0x7f710c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41b2d0d97ec480c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:04.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.780+0000 7f711a7fc640 1 -- 172.21.15.177:0/483629268 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c0aa620 con 0x7f711c0b35b0 2023-11-28T20:08:04.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.780+0000 7f711a7fc640 1 -- 172.21.15.177:0/483629268 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c0aa780 con 0x7f711c0b35b0 2023-11-28T20:08:04.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.780+0000 7f711a7fc640 1 -- 172.21.15.177:0/483629268 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c0aab10 con 0x7f711c0b35b0 2023-11-28T20:08:04.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.780+0000 7f712159d640 1 -- 172.21.15.177:0/483629268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f711c0b35b0 msgr2=0x7f711c0d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:04.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.780+0000 7f712159d640 1 --2- 172.21.15.177:0/483629268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f711c0b35b0 0x7f711c0d0f50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f711c08c5e0 tx=0x7f710c01c500 comp rx=0 tx=0).stop 2023-11-28T20:08:04.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.780+0000 7f712159d640 1 -- 172.21.15.177:0/483629268 shutdown_connections 2023-11-28T20:08:04.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.780+0000 7f712159d640 1 --2- 172.21.15.177:0/483629268 >> v2:172.21.15.195:3300/0 conn(0x7f711c0cf780 0x7f711c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.780+0000 7f712159d640 1 --2- 172.21.15.177:0/483629268 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f711c0b3c70 0x7f711c15f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.780+0000 7f712159d640 1 --2- 172.21.15.177:0/483629268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f711c0b35b0 0x7f711c0d0f50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.780+0000 7f712159d640 1 -- 172.21.15.177:0/483629268 >> 172.21.15.177:0/483629268 conn(0x7f711c09c4b0 msgr2=0x7f711c0d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:04.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.780+0000 7f712159d640 1 -- 172.21.15.177:0/483629268 shutdown_connections 2023-11-28T20:08:04.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.780+0000 7f712159d640 1 -- 172.21.15.177:0/483629268 wait complete. 2023-11-28T20:08:04.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f712159d640 1 Processor -- start 2023-11-28T20:08:04.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f712159d640 1 -- start start 2023-11-28T20:08:04.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f712159d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f711c0b35b0 0x7f711c1592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:04.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f712159d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f711c0b3c70 0x7f711c0ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:04.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f712159d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f711c0cf780 0x7f711c144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:04.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f712159d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c159800 con 0x7f711c0cf780 2023-11-28T20:08:04.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f712159d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c09d270 con 0x7f711c0b3c70 2023-11-28T20:08:04.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f712159d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c159a90 con 0x7f711c0b35b0 2023-11-28T20:08:04.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f711b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f711c0cf780 0x7f711c144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:04.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f711b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f711c0cf780 0x7f711c144070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41394/0 (socket says 172.21.15.177:41394) 2023-11-28T20:08:04.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f711b7fe640 1 -- 172.21.15.177:0/2345184145 learned_addr learned my addr 172.21.15.177:0/2345184145 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:04.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f711affd640 1 --2- 172.21.15.177:0/2345184145 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f711c0b35b0 0x7f711c1592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:04.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f71127fc640 1 --2- 172.21.15.177:0/2345184145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f711c0b3c70 0x7f711c0ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:04.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f711b7fe640 1 -- 172.21.15.177:0/2345184145 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f711c0b35b0 msgr2=0x7f711c1592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:04.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f711b7fe640 1 --2- 172.21.15.177:0/2345184145 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f711c0b35b0 0x7f711c1592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f711b7fe640 1 -- 172.21.15.177:0/2345184145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f711c0b3c70 msgr2=0x7f711c0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:04.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f711b7fe640 1 --2- 172.21.15.177:0/2345184145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f711c0b3c70 0x7f711c0ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f711b7fe640 1 -- 172.21.15.177:0/2345184145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c0094d0 con 0x7f711c0cf780 2023-11-28T20:08:04.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f711b7fe640 1 --2- 172.21.15.177:0/2345184145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f711c0cf780 0x7f711c144070 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7114007d40 tx=0x7f711400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:04.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f7113fff640 1 -- 172.21.15.177:0/2345184145 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71140039a0 con 0x7f711c0cf780 2023-11-28T20:08:04.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f7113fff640 1 -- 172.21.15.177:0/2345184145 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711400f040 con 0x7f711c0cf780 2023-11-28T20:08:04.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f712159d640 1 -- 172.21.15.177:0/2345184145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c159d70 con 0x7f711c0cf780 2023-11-28T20:08:04.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f7113fff640 1 -- 172.21.15.177:0/2345184145 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114003d40 con 0x7f711c0cf780 2023-11-28T20:08:04.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.784+0000 7f712159d640 1 -- 172.21.15.177:0/2345184145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c09cf20 con 0x7f711c0cf780 2023-11-28T20:08:04.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.788+0000 7f712159d640 1 -- 172.21.15.177:0/2345184145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c0693d0 con 0x7f711c0cf780 2023-11-28T20:08:04.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.788+0000 7f7113fff640 1 -- 172.21.15.177:0/2345184145 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7114004030 con 0x7f711c0cf780 2023-11-28T20:08:04.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.788+0000 7f7113fff640 1 --2- 172.21.15.177:0/2345184145 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70fc066470 0x7f70fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:04.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.788+0000 7f7113fff640 1 -- 172.21.15.177:0/2345184145 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7114084020 con 0x7f711c0cf780 2023-11-28T20:08:04.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.788+0000 7f711affd640 1 --2- 172.21.15.177:0/2345184145 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70fc066470 0x7f70fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:04.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.788+0000 7f711affd640 1 --2- 172.21.15.177:0/2345184145 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70fc066470 0x7f70fc068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f710c0ae000 tx=0x7f710c0b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:04.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.792+0000 7f7113fff640 1 -- 172.21.15.177:0/2345184145 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7114051550 con 0x7f711c0cf780 2023-11-28T20:08:04.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.940+0000 7f712159d640 1 -- 172.21.15.177:0/2345184145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f711c15a220 con 0x7f711c0cf780 2023-11-28T20:08:04.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.940+0000 7f7113fff640 1 -- 172.21.15.177:0/2345184145 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f711401a020 con 0x7f711c0cf780 2023-11-28T20:08:04.946 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:04.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.944+0000 7f712159d640 1 -- 172.21.15.177:0/2345184145 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70fc066470 msgr2=0x7f70fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:04.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.944+0000 7f712159d640 1 --2- 172.21.15.177:0/2345184145 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70fc066470 0x7f70fc068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f710c0ae000 tx=0x7f710c0b5040 comp rx=0 tx=0).stop 2023-11-28T20:08:04.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.944+0000 7f712159d640 1 -- 172.21.15.177:0/2345184145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f711c0cf780 msgr2=0x7f711c144070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:04.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.944+0000 7f712159d640 1 --2- 172.21.15.177:0/2345184145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f711c0cf780 0x7f711c144070 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7114007d40 tx=0x7f711400d4a0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.944+0000 7f712159d640 1 -- 172.21.15.177:0/2345184145 shutdown_connections 2023-11-28T20:08:04.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.944+0000 7f712159d640 1 --2- 172.21.15.177:0/2345184145 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70fc066470 0x7f70fc068930 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.944+0000 7f712159d640 1 --2- 172.21.15.177:0/2345184145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f711c0cf780 0x7f711c144070 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.944+0000 7f712159d640 1 --2- 172.21.15.177:0/2345184145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f711c0b3c70 0x7f711c0ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.944+0000 7f712159d640 1 --2- 172.21.15.177:0/2345184145 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f711c0b35b0 0x7f711c1592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:04.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.944+0000 7f712159d640 1 -- 172.21.15.177:0/2345184145 >> 172.21.15.177:0/2345184145 conn(0x7f711c09c4b0 msgr2=0x7f711c15e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:04.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.944+0000 7f712159d640 1 -- 172.21.15.177:0/2345184145 shutdown_connections 2023-11-28T20:08:04.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:04.944+0000 7f712159d640 1 -- 172.21.15.177:0/2345184145 wait complete. 2023-11-28T20:08:04.967 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:05.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.104+0000 7f3b6fb80640 1 Processor -- start 2023-11-28T20:08:05.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.104+0000 7f3b6fb80640 1 -- start start 2023-11-28T20:08:05.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.108+0000 7f3b6fb80640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3b68158ca0 0x7f3b6815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.108+0000 7f3b6fb80640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6815b670 con 0x7f3b680b42d0 2023-11-28T20:08:05.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.108+0000 7f3b6fb80640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6815c510 con 0x7f3b680cba10 2023-11-28T20:08:05.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.108+0000 7f3b6fb80640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6815f410 con 0x7f3b68158ca0 2023-11-28T20:08:05.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.108+0000 7f3b6e11d640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f3b680b42d0 0x7f3b680703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:58246/0 (socket says 172.21.15.177:58246) 2023-11-28T20:08:05.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.108+0000 7f3b6e11d640 1 -- 172.21.15.177:0/3618374800 learned_addr learned my addr 172.21.15.177:0/3618374800 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:05.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.108+0000 7f3b6d91c640 1 --2- 172.21.15.177:0/3618374800 >> v2:172.21.15.195:3300/0 conn(0x7f3b68158ca0 0x7f3b6815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.108+0000 7f3b6c91a640 1 -- 172.21.15.177:0/3618374800 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921397313 0 0) 0x7f3b6815b670 con 0x7f3b680b42d0 2023-11-28T20:08:05.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.108+0000 7f3b6c91a640 1 -- 172.21.15.177:0/3618374800 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b54003530 con 0x7f3b680b42d0 2023-11-28T20:08:05.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.108+0000 7f3b6c91a640 1 -- 172.21.15.177:0/3618374800 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363698138 0 0) 0x7f3b6815c510 con 0x7f3b680cba10 2023-11-28T20:08:05.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.108+0000 7f3b6c91a640 1 -- 172.21.15.177:0/3618374800 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b6815b670 con 0x7f3b680cba10 2023-11-28T20:08:05.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.108+0000 7f3b6d91c640 1 -- 172.21.15.177:0/3618374800 >> v1:172.21.15.195:6789/0 conn(0x7f3b680cba10 legacy=0x7f3b6815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.108+0000 7f3b6d91c640 1 -- 172.21.15.177:0/3618374800 >> v1:172.21.15.177:6789/0 conn(0x7f3b680b42d0 legacy=0x7f3b680703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.108+0000 7f3b6d91c640 1 -- 172.21.15.177:0/3618374800 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6815f6f0 con 0x7f3b68158ca0 2023-11-28T20:08:05.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.112+0000 7f3b6d91c640 1 --2- 172.21.15.177:0/3618374800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b68158ca0 0x7f3b6815eb50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3b640097c0 tx=0x7f3b6401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4ae435f26dc811b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:05.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.112+0000 7f3b6c91a640 1 -- 172.21.15.177:0/3618374800 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640ab670 con 0x7f3b68158ca0 2023-11-28T20:08:05.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.112+0000 7f3b6c91a640 1 -- 172.21.15.177:0/3618374800 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b640ab7d0 con 0x7f3b68158ca0 2023-11-28T20:08:05.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.112+0000 7f3b6c91a640 1 -- 172.21.15.177:0/3618374800 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640abb40 con 0x7f3b68158ca0 2023-11-28T20:08:05.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.112+0000 7f3b6fb80640 1 -- 172.21.15.177:0/3618374800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b68158ca0 msgr2=0x7f3b6815eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.112+0000 7f3b6fb80640 1 --2- 172.21.15.177:0/3618374800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b68158ca0 0x7f3b6815eb50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3b640097c0 tx=0x7f3b6401c450 comp rx=0 tx=0).stop 2023-11-28T20:08:05.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.112+0000 7f3b6fb80640 1 -- 172.21.15.177:0/3618374800 shutdown_connections 2023-11-28T20:08:05.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.112+0000 7f3b6fb80640 1 --2- 172.21.15.177:0/3618374800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b68158ca0 0x7f3b6815eb50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.112+0000 7f3b6fb80640 1 -- 172.21.15.177:0/3618374800 >> 172.21.15.177:0/3618374800 conn(0x7f3b680b0cc0 msgr2=0x7f3b680b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:05.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.112+0000 7f3b6fb80640 1 -- 172.21.15.177:0/3618374800 shutdown_connections 2023-11-28T20:08:05.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.112+0000 7f3b6fb80640 1 -- 172.21.15.177:0/3618374800 wait complete. 2023-11-28T20:08:05.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.112+0000 7f3b6fb80640 1 Processor -- start 2023-11-28T20:08:05.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.112+0000 7f3b6fb80640 1 -- start start 2023-11-28T20:08:05.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6fb80640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b680b42d0 0x7f3b680c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6fb80640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b680cba10 0x7f3b681474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6fb80640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b68158ca0 0x7f3b68148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6fb80640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68148860 con 0x7f3b68158ca0 2023-11-28T20:08:05.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6fb80640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b681479f0 con 0x7f3b680b42d0 2023-11-28T20:08:05.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6fb80640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68147140 con 0x7f3b680cba10 2023-11-28T20:08:05.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6e11d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b68158ca0 0x7f3b68148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6e11d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b68158ca0 0x7f3b68148cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41404/0 (socket says 172.21.15.177:41404) 2023-11-28T20:08:05.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6e11d640 1 -- 172.21.15.177:0/3337120067 learned_addr learned my addr 172.21.15.177:0/3337120067 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:05.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6d11b640 1 --2- 172.21.15.177:0/3337120067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b680cba10 0x7f3b681474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6d91c640 1 --2- 172.21.15.177:0/3337120067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b680b42d0 0x7f3b680c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6e11d640 1 -- 172.21.15.177:0/3337120067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b680cba10 msgr2=0x7f3b681474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6e11d640 1 --2- 172.21.15.177:0/3337120067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b680cba10 0x7f3b681474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6e11d640 1 -- 172.21.15.177:0/3337120067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b680b42d0 msgr2=0x7f3b680c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6e11d640 1 --2- 172.21.15.177:0/3337120067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b680b42d0 0x7f3b680c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6e11d640 1 -- 172.21.15.177:0/3337120067 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b64009420 con 0x7f3b68158ca0 2023-11-28T20:08:05.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6d11b640 1 --2- 172.21.15.177:0/3337120067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b680cba10 0x7f3b681474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:05.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6e11d640 1 --2- 172.21.15.177:0/3337120067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b68158ca0 0x7f3b68148cf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000cb40 tx=0x7f3b6000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:05.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b5e7fc640 1 -- 172.21.15.177:0/3337120067 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6000aca0 con 0x7f3b68158ca0 2023-11-28T20:08:05.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b5e7fc640 1 -- 172.21.15.177:0/3337120067 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6000ae20 con 0x7f3b68158ca0 2023-11-28T20:08:05.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b5e7fc640 1 -- 172.21.15.177:0/3337120067 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b60012640 con 0x7f3b68158ca0 2023-11-28T20:08:05.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6fb80640 1 -- 172.21.15.177:0/3337120067 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b680b4c70 con 0x7f3b68158ca0 2023-11-28T20:08:05.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6fb80640 1 -- 172.21.15.177:0/3337120067 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b68147f30 con 0x7f3b68158ca0 2023-11-28T20:08:05.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b6fb80640 1 -- 172.21.15.177:0/3337120067 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b68073cf0 con 0x7f3b68158ca0 2023-11-28T20:08:05.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.116+0000 7f3b5e7fc640 1 -- 172.21.15.177:0/3337120067 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b60007070 con 0x7f3b68158ca0 2023-11-28T20:08:05.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.120+0000 7f3b5e7fc640 1 --2- 172.21.15.177:0/3337120067 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3b4c066470 0x7f3b4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.120+0000 7f3b5e7fc640 1 -- 172.21.15.177:0/3337120067 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b60083d40 con 0x7f3b68158ca0 2023-11-28T20:08:05.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.120+0000 7f3b6d91c640 1 --2- 172.21.15.177:0/3337120067 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3b4c066470 0x7f3b4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.120+0000 7f3b6d91c640 1 --2- 172.21.15.177:0/3337120067 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3b4c066470 0x7f3b4c068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3b640af000 tx=0x7f3b640a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:05.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.124+0000 7f3b5e7fc640 1 -- 172.21.15.177:0/3337120067 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b68073cf0 con 0x7f3b68158ca0 2023-11-28T20:08:05.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.272+0000 7f3b6fb80640 1 -- 172.21.15.177:0/3337120067 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b68073cf0 con 0x7f3b68158ca0 2023-11-28T20:08:05.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.272+0000 7f3b5e7fc640 1 -- 172.21.15.177:0/3337120067 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b60017020 con 0x7f3b68158ca0 2023-11-28T20:08:05.277 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:05.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.276+0000 7f3b6fb80640 1 -- 172.21.15.177:0/3337120067 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3b4c066470 msgr2=0x7f3b4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.276+0000 7f3b6fb80640 1 --2- 172.21.15.177:0/3337120067 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3b4c066470 0x7f3b4c068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3b640af000 tx=0x7f3b640a7000 comp rx=0 tx=0).stop 2023-11-28T20:08:05.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.276+0000 7f3b6fb80640 1 -- 172.21.15.177:0/3337120067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b68158ca0 msgr2=0x7f3b68148cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.276+0000 7f3b6fb80640 1 --2- 172.21.15.177:0/3337120067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b68158ca0 0x7f3b68148cf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000cb40 tx=0x7f3b6000a060 comp rx=0 tx=0).stop 2023-11-28T20:08:05.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.276+0000 7f3b6fb80640 1 -- 172.21.15.177:0/3337120067 shutdown_connections 2023-11-28T20:08:05.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.276+0000 7f3b6fb80640 1 --2- 172.21.15.177:0/3337120067 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3b4c066470 0x7f3b4c068930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.276+0000 7f3b6fb80640 1 --2- 172.21.15.177:0/3337120067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b68158ca0 0x7f3b68148cf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.276+0000 7f3b6fb80640 1 --2- 172.21.15.177:0/3337120067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b680cba10 0x7f3b681474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.276+0000 7f3b6fb80640 1 --2- 172.21.15.177:0/3337120067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b680b42d0 0x7f3b680c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.276+0000 7f3b6fb80640 1 -- 172.21.15.177:0/3337120067 >> 172.21.15.177:0/3337120067 conn(0x7f3b680b0cc0 msgr2=0x7f3b680cb240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:05.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.276+0000 7f3b6fb80640 1 -- 172.21.15.177:0/3337120067 shutdown_connections 2023-11-28T20:08:05.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.276+0000 7f3b6fb80640 1 -- 172.21.15.177:0/3337120067 wait complete. 2023-11-28T20:08:05.298 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:05.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe317e17640 1 Processor -- start 2023-11-28T20:08:05.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe317e17640 1 -- start start 2023-11-28T20:08:05.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe317e17640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe3100cfe90 0x7fe3100d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe317e17640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe3100b3c70 0x7fe31015f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe317e17640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3100d3880 con 0x7fe3100b35b0 2023-11-28T20:08:05.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe317e17640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3100d4090 con 0x7fe3100b3c70 2023-11-28T20:08:05.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe317e17640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3100cdc80 con 0x7fe3100cfe90 2023-11-28T20:08:05.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe3163b4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe3100b3c70 0x7fe31015f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe3163b4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe3100b3c70 0x7fe31015f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41416/0 (socket says 172.21.15.177:41416) 2023-11-28T20:08:05.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe3163b4640 1 -- 172.21.15.177:0/1826146912 learned_addr learned my addr 172.21.15.177:0/1826146912 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:05.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe315bb3640 1 --1- 172.21.15.177:0/1826146912 >> v1:172.21.15.177:6789/0 conn(0x7fe3100b35b0 0x7fe3100cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:58248/0 (socket says 172.21.15.177:58248) 2023-11-28T20:08:05.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe3153b2640 1 --2- 172.21.15.177:0/1826146912 >> v2:172.21.15.195:3300/0 conn(0x7fe3100cfe90 0x7fe3100d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe3163b4640 1 -- 172.21.15.177:0/1826146912 >> v2:172.21.15.195:3300/0 conn(0x7fe3100cfe90 msgr2=0x7fe3100d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:05.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe3163b4640 1 --2- 172.21.15.177:0/1826146912 >> v2:172.21.15.195:3300/0 conn(0x7fe3100cfe90 0x7fe3100d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe3163b4640 1 -- 172.21.15.177:0/1826146912 >> v1:172.21.15.177:6789/0 conn(0x7fe3100b35b0 legacy=0x7fe3100cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe3163b4640 1 -- 172.21.15.177:0/1826146912 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3100d3ad0 con 0x7fe3100b3c70 2023-11-28T20:08:05.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.436+0000 7fe314bb1640 1 -- 172.21.15.177:0/1826146912 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378599899 0 0) 0x7fe3100d3880 con 0x7fe3100b35b0 2023-11-28T20:08:05.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.440+0000 7fe3163b4640 1 --2- 172.21.15.177:0/1826146912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3100b3c70 0x7fe31015f060 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe31008bde0 tx=0x7fe30801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2537f5e4e501ab06 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:05.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.440+0000 7fe314bb1640 1 -- 172.21.15.177:0/1826146912 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3080a5890 con 0x7fe3100b3c70 2023-11-28T20:08:05.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.440+0000 7fe314bb1640 1 -- 172.21.15.177:0/1826146912 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3080a59f0 con 0x7fe3100b3c70 2023-11-28T20:08:05.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.440+0000 7fe314bb1640 1 -- 172.21.15.177:0/1826146912 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3080a5d80 con 0x7fe3100b3c70 2023-11-28T20:08:05.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.440+0000 7fe317e17640 1 -- 172.21.15.177:0/1826146912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3100b3c70 msgr2=0x7fe31015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.440+0000 7fe317e17640 1 --2- 172.21.15.177:0/1826146912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3100b3c70 0x7fe31015f060 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe31008bde0 tx=0x7fe30801c9d0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.440+0000 7fe317e17640 1 -- 172.21.15.177:0/1826146912 shutdown_connections 2023-11-28T20:08:05.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.440+0000 7fe317e17640 1 --2- 172.21.15.177:0/1826146912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3100b3c70 0x7fe31015f060 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.440+0000 7fe317e17640 1 --2- 172.21.15.177:0/1826146912 >> v2:172.21.15.195:3300/0 conn(0x7fe3100cfe90 0x7fe3100d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.440+0000 7fe317e17640 1 -- 172.21.15.177:0/1826146912 >> 172.21.15.177:0/1826146912 conn(0x7fe31009c4b0 msgr2=0x7fe3100d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:05.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.440+0000 7fe317e17640 1 -- 172.21.15.177:0/1826146912 shutdown_connections 2023-11-28T20:08:05.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.440+0000 7fe317e17640 1 -- 172.21.15.177:0/1826146912 wait complete. 2023-11-28T20:08:05.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe317e17640 1 Processor -- start 2023-11-28T20:08:05.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe317e17640 1 -- start start 2023-11-28T20:08:05.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe317e17640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3100b35b0 0x7fe31015ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe317e17640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3100b3c70 0x7fe310151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe317e17640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3100cfe90 0x7fe310152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe317e17640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3100cbd90 con 0x7fe3100b3c70 2023-11-28T20:08:05.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe317e17640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3101529a0 con 0x7fe3100b35b0 2023-11-28T20:08:05.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe317e17640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3100cd160 con 0x7fe3100cfe90 2023-11-28T20:08:05.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe3153b2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3100b3c70 0x7fe310151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe3153b2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3100b3c70 0x7fe310151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41424/0 (socket says 172.21.15.177:41424) 2023-11-28T20:08:05.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe3153b2640 1 -- 172.21.15.177:0/3056932521 learned_addr learned my addr 172.21.15.177:0/3056932521 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:05.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe315bb3640 1 --2- 172.21.15.177:0/3056932521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3100b35b0 0x7fe31015ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe3163b4640 1 --2- 172.21.15.177:0/3056932521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3100cfe90 0x7fe310152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe3153b2640 1 -- 172.21.15.177:0/3056932521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3100cfe90 msgr2=0x7fe310152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe3153b2640 1 --2- 172.21.15.177:0/3056932521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3100cfe90 0x7fe310152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe3153b2640 1 -- 172.21.15.177:0/3056932521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3100b35b0 msgr2=0x7fe31015ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe3153b2640 1 --2- 172.21.15.177:0/3056932521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3100b35b0 0x7fe31015ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe3153b2640 1 -- 172.21.15.177:0/3056932521 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe308009b30 con 0x7fe3100b3c70 2023-11-28T20:08:05.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe3163b4640 1 --2- 172.21.15.177:0/3056932521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3100cfe90 0x7fe310152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:05.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe3153b2640 1 --2- 172.21.15.177:0/3056932521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3100b3c70 0x7fe310151f20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe30000e8a0 tx=0x7fe30000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:05.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe3067fc640 1 -- 172.21.15.177:0/3056932521 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300009510 con 0x7fe3100b3c70 2023-11-28T20:08:05.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe3067fc640 1 -- 172.21.15.177:0/3056932521 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30000c940 con 0x7fe3100b3c70 2023-11-28T20:08:05.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe317e17640 1 -- 172.21.15.177:0/3056932521 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3100cbfe0 con 0x7fe3100b3c70 2023-11-28T20:08:05.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe3067fc640 1 -- 172.21.15.177:0/3056932521 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30000ccb0 con 0x7fe3100b3c70 2023-11-28T20:08:05.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.444+0000 7fe317e17640 1 -- 172.21.15.177:0/3056932521 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3100cc5a0 con 0x7fe3100b3c70 2023-11-28T20:08:05.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.448+0000 7fe317e17640 1 -- 172.21.15.177:0/3056932521 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3100b90c0 con 0x7fe3100b3c70 2023-11-28T20:08:05.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.448+0000 7fe3067fc640 1 -- 172.21.15.177:0/3056932521 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe300013470 con 0x7fe3100b3c70 2023-11-28T20:08:05.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.448+0000 7fe3067fc640 1 --2- 172.21.15.177:0/3056932521 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe2f4066470 0x7fe2f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.448+0000 7fe3067fc640 1 -- 172.21.15.177:0/3056932521 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe300083f90 con 0x7fe3100b3c70 2023-11-28T20:08:05.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.448+0000 7fe315bb3640 1 --2- 172.21.15.177:0/3056932521 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe2f4066470 0x7fe2f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.448+0000 7fe315bb3640 1 --2- 172.21.15.177:0/3056932521 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe2f4066470 0x7fe2f4068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe30c007fd0 tx=0x7fe30c007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:05.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.452+0000 7fe3067fc640 1 -- 172.21.15.177:0/3056932521 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe300051420 con 0x7fe3100b3c70 2023-11-28T20:08:05.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.604+0000 7fe317e17640 1 -- 172.21.15.177:0/3056932521 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe3100693d0 con 0x7fe3100b3c70 2023-11-28T20:08:05.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.604+0000 7fe3067fc640 1 -- 172.21.15.177:0/3056932521 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe300017020 con 0x7fe3100b3c70 2023-11-28T20:08:05.607 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:05.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.604+0000 7fe317e17640 1 -- 172.21.15.177:0/3056932521 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe2f4066470 msgr2=0x7fe2f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.604+0000 7fe317e17640 1 --2- 172.21.15.177:0/3056932521 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe2f4066470 0x7fe2f4068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe30c007fd0 tx=0x7fe30c007d60 comp rx=0 tx=0).stop 2023-11-28T20:08:05.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.604+0000 7fe317e17640 1 -- 172.21.15.177:0/3056932521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3100b3c70 msgr2=0x7fe310151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.604+0000 7fe317e17640 1 --2- 172.21.15.177:0/3056932521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3100b3c70 0x7fe310151f20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe30000e8a0 tx=0x7fe30000eca0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.604+0000 7fe317e17640 1 -- 172.21.15.177:0/3056932521 shutdown_connections 2023-11-28T20:08:05.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.604+0000 7fe317e17640 1 --2- 172.21.15.177:0/3056932521 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe2f4066470 0x7fe2f4068930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.604+0000 7fe317e17640 1 --2- 172.21.15.177:0/3056932521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3100cfe90 0x7fe310152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.604+0000 7fe317e17640 1 --2- 172.21.15.177:0/3056932521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3100b3c70 0x7fe310151f20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.604+0000 7fe317e17640 1 --2- 172.21.15.177:0/3056932521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3100b35b0 0x7fe31015ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.604+0000 7fe317e17640 1 -- 172.21.15.177:0/3056932521 >> 172.21.15.177:0/3056932521 conn(0x7fe31009c4b0 msgr2=0x7fe3100b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:05.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.604+0000 7fe317e17640 1 -- 172.21.15.177:0/3056932521 shutdown_connections 2023-11-28T20:08:05.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.604+0000 7fe317e17640 1 -- 172.21.15.177:0/3056932521 wait complete. 2023-11-28T20:08:05.628 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:05.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.760+0000 7fc593209640 1 Processor -- start 2023-11-28T20:08:05.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.760+0000 7fc593209640 1 -- start start 2023-11-28T20:08:05.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc593209640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc58c13cf30 0x7fc58c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc593209640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc58c06c800 0x7fc58c15a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc593209640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc58c15ab70 0x7fc58c071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc593209640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c13d310 con 0x7fc58c15ab70 2023-11-28T20:08:05.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc593209640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c1404e0 con 0x7fc58c13cf30 2023-11-28T20:08:05.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc593209640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c15b3a0 con 0x7fc58c06c800 2023-11-28T20:08:05.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc5917a6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc58c15ab70 0x7fc58c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc5917a6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc58c15ab70 0x7fc58c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41436/0 (socket says 172.21.15.177:41436) 2023-11-28T20:08:05.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc5917a6640 1 -- 172.21.15.177:0/1299575351 learned_addr learned my addr 172.21.15.177:0/1299575351 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:05.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc590fa5640 1 --2- 172.21.15.177:0/1299575351 >> v2:172.21.15.195:3300/0 conn(0x7fc58c13cf30 0x7fc58c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc583fff640 1 --2- 172.21.15.177:0/1299575351 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc58c06c800 0x7fc58c15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc5917a6640 1 -- 172.21.15.177:0/1299575351 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc58c06c800 msgr2=0x7fc58c15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:05.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc5917a6640 1 --2- 172.21.15.177:0/1299575351 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc58c06c800 0x7fc58c15a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc5917a6640 1 -- 172.21.15.177:0/1299575351 >> v2:172.21.15.195:3300/0 conn(0x7fc58c13cf30 msgr2=0x7fc58c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:05.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc5917a6640 1 --2- 172.21.15.177:0/1299575351 >> v2:172.21.15.195:3300/0 conn(0x7fc58c13cf30 0x7fc58c06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.764+0000 7fc5917a6640 1 -- 172.21.15.177:0/1299575351 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c06cc40 con 0x7fc58c15ab70 2023-11-28T20:08:05.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.768+0000 7fc5917a6640 1 --2- 172.21.15.177:0/1299575351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc58c15ab70 0x7fc58c071570 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc58c06b510 tx=0x7fc58401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8743313a7bd7eb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:05.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.768+0000 7fc5837fe640 1 -- 172.21.15.177:0/1299575351 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5840a5790 con 0x7fc58c15ab70 2023-11-28T20:08:05.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.768+0000 7fc5837fe640 1 -- 172.21.15.177:0/1299575351 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5840a58f0 con 0x7fc58c15ab70 2023-11-28T20:08:05.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.768+0000 7fc5837fe640 1 -- 172.21.15.177:0/1299575351 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5840a5c80 con 0x7fc58c15ab70 2023-11-28T20:08:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.768+0000 7fc593209640 1 -- 172.21.15.177:0/1299575351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc58c15ab70 msgr2=0x7fc58c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.768+0000 7fc593209640 1 --2- 172.21.15.177:0/1299575351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc58c15ab70 0x7fc58c071570 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc58c06b510 tx=0x7fc58401c910 comp rx=0 tx=0).stop 2023-11-28T20:08:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.768+0000 7fc593209640 1 -- 172.21.15.177:0/1299575351 shutdown_connections 2023-11-28T20:08:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.768+0000 7fc593209640 1 --2- 172.21.15.177:0/1299575351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc58c15ab70 0x7fc58c071570 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.768+0000 7fc593209640 1 --2- 172.21.15.177:0/1299575351 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc58c06c800 0x7fc58c15a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.768+0000 7fc593209640 1 --2- 172.21.15.177:0/1299575351 >> v2:172.21.15.195:3300/0 conn(0x7fc58c13cf30 0x7fc58c06c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.768+0000 7fc593209640 1 -- 172.21.15.177:0/1299575351 >> 172.21.15.177:0/1299575351 conn(0x7fc58c06a530 msgr2=0x7fc58c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.768+0000 7fc593209640 1 -- 172.21.15.177:0/1299575351 shutdown_connections 2023-11-28T20:08:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.768+0000 7fc593209640 1 -- 172.21.15.177:0/1299575351 wait complete. 2023-11-28T20:08:05.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.768+0000 7fc593209640 1 Processor -- start 2023-11-28T20:08:05.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.768+0000 7fc593209640 1 -- start start 2023-11-28T20:08:05.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc593209640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc58c06c800 0x7fc58c1374d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc593209640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc58c13cf30 0x7fc58c1597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc593209640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc58c15ab70 0x7fc58c148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc593209640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c15ccb0 con 0x7fc58c06c800 2023-11-28T20:08:05.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc593209640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c1398d0 con 0x7fc58c15ab70 2023-11-28T20:08:05.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc593209640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c139b70 con 0x7fc58c13cf30 2023-11-28T20:08:05.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc590fa5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc58c06c800 0x7fc58c1374d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc590fa5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc58c06c800 0x7fc58c1374d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41440/0 (socket says 172.21.15.177:41440) 2023-11-28T20:08:05.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc590fa5640 1 -- 172.21.15.177:0/2739000429 learned_addr learned my addr 172.21.15.177:0/2739000429 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:05.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc583fff640 1 --2- 172.21.15.177:0/2739000429 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc58c13cf30 0x7fc58c1597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc5917a6640 1 --2- 172.21.15.177:0/2739000429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc58c15ab70 0x7fc58c148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc590fa5640 1 -- 172.21.15.177:0/2739000429 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc58c13cf30 msgr2=0x7fc58c1597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc590fa5640 1 --2- 172.21.15.177:0/2739000429 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc58c13cf30 0x7fc58c1597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc590fa5640 1 -- 172.21.15.177:0/2739000429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc58c15ab70 msgr2=0x7fc58c148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc590fa5640 1 --2- 172.21.15.177:0/2739000429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc58c15ab70 0x7fc58c148b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc590fa5640 1 -- 172.21.15.177:0/2739000429 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc584009b30 con 0x7fc58c06c800 2023-11-28T20:08:05.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc5917a6640 1 --2- 172.21.15.177:0/2739000429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc58c15ab70 0x7fc58c148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:05.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc590fa5640 1 --2- 172.21.15.177:0/2739000429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc58c06c800 0x7fc58c1374d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc588010fc0 tx=0x7fc58800e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:05.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc5817fa640 1 -- 172.21.15.177:0/2739000429 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58800bb80 con 0x7fc58c06c800 2023-11-28T20:08:05.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc5817fa640 1 -- 172.21.15.177:0/2739000429 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc588011040 con 0x7fc58c06c800 2023-11-28T20:08:05.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc593209640 1 -- 172.21.15.177:0/2739000429 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c139e50 con 0x7fc58c06c800 2023-11-28T20:08:05.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc5817fa640 1 -- 172.21.15.177:0/2739000429 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5880166a0 con 0x7fc58c06c800 2023-11-28T20:08:05.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc593209640 1 -- 172.21.15.177:0/2739000429 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c15c940 con 0x7fc58c06c800 2023-11-28T20:08:05.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc593209640 1 -- 172.21.15.177:0/2739000429 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58c069440 con 0x7fc58c06c800 2023-11-28T20:08:05.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.772+0000 7fc5817fa640 1 -- 172.21.15.177:0/2739000429 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc588016800 con 0x7fc58c06c800 2023-11-28T20:08:05.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.776+0000 7fc5817fa640 1 --2- 172.21.15.177:0/2739000429 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc578066470 0x7fc578068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:05.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.776+0000 7fc5817fa640 1 -- 172.21.15.177:0/2739000429 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc588086990 con 0x7fc58c06c800 2023-11-28T20:08:05.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.776+0000 7fc583fff640 1 --2- 172.21.15.177:0/2739000429 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc578066470 0x7fc578068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:05.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.776+0000 7fc583fff640 1 --2- 172.21.15.177:0/2739000429 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc578066470 0x7fc578068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc58c06e670 tx=0x7fc57c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:05.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.780+0000 7fc5817fa640 1 -- 172.21.15.177:0/2739000429 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc588053e00 con 0x7fc58c06c800 2023-11-28T20:08:05.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.928+0000 7fc593209640 1 -- 172.21.15.177:0/2739000429 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc58c0ae930 con 0x7fc58c06c800 2023-11-28T20:08:05.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.932+0000 7fc5817fa640 1 -- 172.21.15.177:0/2739000429 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7fc588057420 con 0x7fc58c06c800 2023-11-28T20:08:05.935 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:05.935 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:05.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.932+0000 7fc593209640 1 -- 172.21.15.177:0/2739000429 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc578066470 msgr2=0x7fc578068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.932+0000 7fc593209640 1 --2- 172.21.15.177:0/2739000429 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc578066470 0x7fc578068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc58c06e670 tx=0x7fc57c008040 comp rx=0 tx=0).stop 2023-11-28T20:08:05.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.932+0000 7fc593209640 1 -- 172.21.15.177:0/2739000429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc58c06c800 msgr2=0x7fc58c1374d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:05.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.932+0000 7fc593209640 1 --2- 172.21.15.177:0/2739000429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc58c06c800 0x7fc58c1374d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc588010fc0 tx=0x7fc58800e490 comp rx=0 tx=0).stop 2023-11-28T20:08:05.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.932+0000 7fc593209640 1 -- 172.21.15.177:0/2739000429 shutdown_connections 2023-11-28T20:08:05.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.932+0000 7fc593209640 1 --2- 172.21.15.177:0/2739000429 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc578066470 0x7fc578068930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.932+0000 7fc593209640 1 --2- 172.21.15.177:0/2739000429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc58c15ab70 0x7fc58c148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.932+0000 7fc593209640 1 --2- 172.21.15.177:0/2739000429 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc58c13cf30 0x7fc58c1597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.932+0000 7fc593209640 1 --2- 172.21.15.177:0/2739000429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc58c06c800 0x7fc58c1374d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:05.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.932+0000 7fc593209640 1 -- 172.21.15.177:0/2739000429 >> 172.21.15.177:0/2739000429 conn(0x7fc58c06a530 msgr2=0x7fc58c15c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:05.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.932+0000 7fc593209640 1 -- 172.21.15.177:0/2739000429 shutdown_connections 2023-11-28T20:08:05.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:05.932+0000 7fc593209640 1 -- 172.21.15.177:0/2739000429 wait complete. 2023-11-28T20:08:05.956 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:05.957 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:06.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.092+0000 7f2245b9d640 1 Processor -- start 2023-11-28T20:08:06.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.092+0000 7f2245b9d640 1 -- start start 2023-11-28T20:08:06.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.092+0000 7f2245b9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2240071d90 0x7f2240072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.092+0000 7f2245b9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f224015adb0 0x7f224013d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.096+0000 7f2245b9d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224013d2b0 con 0x7f224013f5f0 2023-11-28T20:08:06.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.096+0000 7f2245b9d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2240140520 con 0x7f2240071d90 2023-11-28T20:08:06.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.096+0000 7f2245b9d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22400cd7f0 con 0x7f224015adb0 2023-11-28T20:08:06.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.096+0000 7f223effd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f224015adb0 0x7f224013d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.096+0000 7f223ffff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f224013f5f0 0x7f22400ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:54630/0 (socket says 172.21.15.177:54630) 2023-11-28T20:08:06.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.096+0000 7f223ffff640 1 -- 172.21.15.177:0/2255204011 learned_addr learned my addr 172.21.15.177:0/2255204011 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:06.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.096+0000 7f223f7fe640 1 --2- 172.21.15.177:0/2255204011 >> v2:172.21.15.195:3300/0 conn(0x7f2240071d90 0x7f2240072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.096+0000 7f223effd640 1 -- 172.21.15.177:0/2255204011 >> v2:172.21.15.195:3300/0 conn(0x7f2240071d90 msgr2=0x7f2240072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:06.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.096+0000 7f223effd640 1 --2- 172.21.15.177:0/2255204011 >> v2:172.21.15.195:3300/0 conn(0x7f2240071d90 0x7f2240072170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.096+0000 7f223effd640 1 -- 172.21.15.177:0/2255204011 >> v1:172.21.15.195:6789/0 conn(0x7f224013f5f0 legacy=0x7f22400ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.096+0000 7f223e7fc640 1 -- 172.21.15.177:0/2255204011 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068872019 0 0) 0x7f224013d2b0 con 0x7f224013f5f0 2023-11-28T20:08:06.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.096+0000 7f223effd640 1 -- 172.21.15.177:0/2255204011 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22400cdd70 con 0x7f224015adb0 2023-11-28T20:08:06.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.096+0000 7f223effd640 1 --2- 172.21.15.177:0/2255204011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f224015adb0 0x7f224013d560 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f22340097c0 tx=0x7f223401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0a16083630c9701 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:06.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f223e7fc640 1 -- 172.21.15.177:0/2255204011 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22340ab680 con 0x7f224015adb0 2023-11-28T20:08:06.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f223e7fc640 1 -- 172.21.15.177:0/2255204011 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22340ab7e0 con 0x7f224015adb0 2023-11-28T20:08:06.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f223e7fc640 1 -- 172.21.15.177:0/2255204011 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22340abb70 con 0x7f224015adb0 2023-11-28T20:08:06.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 -- 172.21.15.177:0/2255204011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f224015adb0 msgr2=0x7f224013d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 --2- 172.21.15.177:0/2255204011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f224015adb0 0x7f224013d560 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f22340097c0 tx=0x7f223401c480 comp rx=0 tx=0).stop 2023-11-28T20:08:06.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 -- 172.21.15.177:0/2255204011 shutdown_connections 2023-11-28T20:08:06.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 --2- 172.21.15.177:0/2255204011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f224015adb0 0x7f224013d560 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 --2- 172.21.15.177:0/2255204011 >> v2:172.21.15.195:3300/0 conn(0x7f2240071d90 0x7f2240072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 -- 172.21.15.177:0/2255204011 >> 172.21.15.177:0/2255204011 conn(0x7f22400b0cc0 msgr2=0x7f22400b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:06.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 -- 172.21.15.177:0/2255204011 shutdown_connections 2023-11-28T20:08:06.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 -- 172.21.15.177:0/2255204011 wait complete. 2023-11-28T20:08:06.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 Processor -- start 2023-11-28T20:08:06.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 -- start start 2023-11-28T20:08:06.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2240071d90 0x7f22400aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f224013f5f0 0x7f224013bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f224015adb0 0x7f22401f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22401f6040 con 0x7f2240071d90 2023-11-28T20:08:06.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22401f6320 con 0x7f224015adb0 2023-11-28T20:08:06.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.100+0000 7f2245b9d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22401f6600 con 0x7f224013f5f0 2023-11-28T20:08:06.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f223f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2240071d90 0x7f22400aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f223f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2240071d90 0x7f22400aa7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41442/0 (socket says 172.21.15.177:41442) 2023-11-28T20:08:06.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f223f7fe640 1 -- 172.21.15.177:0/2175629484 learned_addr learned my addr 172.21.15.177:0/2175629484 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:06.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f223effd640 1 --2- 172.21.15.177:0/2175629484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f224013f5f0 0x7f224013bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f223ffff640 1 --2- 172.21.15.177:0/2175629484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f224015adb0 0x7f22401f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f223f7fe640 1 -- 172.21.15.177:0/2175629484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f224013f5f0 msgr2=0x7f224013bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f223f7fe640 1 --2- 172.21.15.177:0/2175629484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f224013f5f0 0x7f224013bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f223f7fe640 1 -- 172.21.15.177:0/2175629484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f224015adb0 msgr2=0x7f22401f70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f223f7fe640 1 --2- 172.21.15.177:0/2175629484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f224015adb0 0x7f22401f70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f223f7fe640 1 -- 172.21.15.177:0/2175629484 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2234009420 con 0x7f2240071d90 2023-11-28T20:08:06.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f223f7fe640 1 --2- 172.21.15.177:0/2175629484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2240071d90 0x7f22400aa7b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f223000e930 tx=0x7f223000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:06.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f2227fff640 1 -- 172.21.15.177:0/2175629484 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230009690 con 0x7f2240071d90 2023-11-28T20:08:06.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f2227fff640 1 -- 172.21.15.177:0/2175629484 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223000ca00 con 0x7f2240071d90 2023-11-28T20:08:06.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f2245b9d640 1 -- 172.21.15.177:0/2175629484 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22401f68e0 con 0x7f2240071d90 2023-11-28T20:08:06.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f2227fff640 1 -- 172.21.15.177:0/2175629484 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223000cd70 con 0x7f2240071d90 2023-11-28T20:08:06.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f2245b9d640 1 -- 172.21.15.177:0/2175629484 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22400aacf0 con 0x7f2240071d90 2023-11-28T20:08:06.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f2245b9d640 1 -- 172.21.15.177:0/2175629484 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22400693d0 con 0x7f2240071d90 2023-11-28T20:08:06.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f2227fff640 1 -- 172.21.15.177:0/2175629484 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2230013470 con 0x7f2240071d90 2023-11-28T20:08:06.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.104+0000 7f2227fff640 1 --2- 172.21.15.177:0/2175629484 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f222c066470 0x7f222c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.108+0000 7f2227fff640 1 -- 172.21.15.177:0/2175629484 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2230083ff0 con 0x7f2240071d90 2023-11-28T20:08:06.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.108+0000 7f223effd640 1 --2- 172.21.15.177:0/2175629484 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f222c066470 0x7f222c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.108+0000 7f223effd640 1 --2- 172.21.15.177:0/2175629484 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f222c066470 0x7f222c068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22340af000 tx=0x7f22340a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:06.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.108+0000 7f2227fff640 1 -- 172.21.15.177:0/2175629484 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f22300b5280 con 0x7f2240071d90 2023-11-28T20:08:06.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.264+0000 7f2245b9d640 1 -- 172.21.15.177:0/2175629484 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f224006e710 con 0x7f2240071d90 2023-11-28T20:08:06.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.264+0000 7f2227fff640 1 -- 172.21.15.177:0/2175629484 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f22300170a0 con 0x7f2240071d90 2023-11-28T20:08:06.270 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:06.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.268+0000 7f2245b9d640 1 -- 172.21.15.177:0/2175629484 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f222c066470 msgr2=0x7f222c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.268+0000 7f2245b9d640 1 --2- 172.21.15.177:0/2175629484 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f222c066470 0x7f222c068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22340af000 tx=0x7f22340a7000 comp rx=0 tx=0).stop 2023-11-28T20:08:06.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.268+0000 7f2245b9d640 1 -- 172.21.15.177:0/2175629484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2240071d90 msgr2=0x7f22400aa7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.268+0000 7f2245b9d640 1 --2- 172.21.15.177:0/2175629484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2240071d90 0x7f22400aa7b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f223000e930 tx=0x7f223000edf0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.268+0000 7f2245b9d640 1 -- 172.21.15.177:0/2175629484 shutdown_connections 2023-11-28T20:08:06.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.268+0000 7f2245b9d640 1 --2- 172.21.15.177:0/2175629484 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f222c066470 0x7f222c068930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.268+0000 7f2245b9d640 1 --2- 172.21.15.177:0/2175629484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f224015adb0 0x7f22401f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.268+0000 7f2245b9d640 1 --2- 172.21.15.177:0/2175629484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f224013f5f0 0x7f224013bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.268+0000 7f2245b9d640 1 --2- 172.21.15.177:0/2175629484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2240071d90 0x7f22400aa7b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.268+0000 7f2245b9d640 1 -- 172.21.15.177:0/2175629484 >> 172.21.15.177:0/2175629484 conn(0x7f22400b0cc0 msgr2=0x7f2240143180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:06.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.268+0000 7f2245b9d640 1 -- 172.21.15.177:0/2175629484 shutdown_connections 2023-11-28T20:08:06.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.268+0000 7f2245b9d640 1 -- 172.21.15.177:0/2175629484 wait complete. 2023-11-28T20:08:06.291 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:06.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe01f18d640 1 Processor -- start 2023-11-28T20:08:06.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe01f18d640 1 -- start start 2023-11-28T20:08:06.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe01f18d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0180b4740 0x7fe01806ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe01f18d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe01815ed90 0x7fe01815f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe01f18d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01815e900 con 0x7fe018146960 2023-11-28T20:08:06.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe01f18d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01815dcf0 con 0x7fe01815ed90 2023-11-28T20:08:06.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe01f18d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01815dfd0 con 0x7fe0180b4740 2023-11-28T20:08:06.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe01cf29640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe018146960 0x7fe0180b4030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:58254/0 (socket says 172.21.15.177:58254) 2023-11-28T20:08:06.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe01cf29640 1 -- 172.21.15.177:0/3605462839 learned_addr learned my addr 172.21.15.177:0/3605462839 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:06.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe01d72a640 1 --2- 172.21.15.177:0/3605462839 >> v2:172.21.15.195:3300/0 conn(0x7fe01815ed90 0x7fe01815f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00ffff640 1 --2- 172.21.15.177:0/3605462839 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0180b4740 0x7fe01806ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 -- 172.21.15.177:0/3605462839 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818657328 0 0) 0x7fe01815e900 con 0x7fe018146960 2023-11-28T20:08:06.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 -- 172.21.15.177:0/3605462839 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe000003530 con 0x7fe018146960 2023-11-28T20:08:06.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 -- 172.21.15.177:0/3605462839 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4124351747 0 0) 0x7fe000003530 con 0x7fe018146960 2023-11-28T20:08:06.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 -- 172.21.15.177:0/3605462839 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0180b4740 msgr2=0x7fe01806ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:06.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 --2- 172.21.15.177:0/3605462839 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0180b4740 0x7fe01806ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 -- 172.21.15.177:0/3605462839 >> v2:172.21.15.195:3300/0 conn(0x7fe01815ed90 msgr2=0x7fe01815f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:06.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 --2- 172.21.15.177:0/3605462839 >> v2:172.21.15.195:3300/0 conn(0x7fe01815ed90 0x7fe01815f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 -- 172.21.15.177:0/3605462839 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01815e2b0 con 0x7fe018146960 2023-11-28T20:08:06.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 -- 172.21.15.177:0/3605462839 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7fe014001680 con 0x7fe018146960 2023-11-28T20:08:06.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 -- 172.21.15.177:0/3605462839 >> v1:172.21.15.177:6789/0 conn(0x7fe018146960 legacy=0x7fe0180b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 --2- 172.21.15.177:0/3605462839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe000003980 0x7fe000003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 --2- 172.21.15.177:0/3605462839 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0180b4740 0x7fe0000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 --2- 172.21.15.177:0/3605462839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe000004d10 0x7fe000005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 -- 172.21.15.177:0/3605462839 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01815dcf0 con 0x7fe000004d10 2023-11-28T20:08:06.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 -- 172.21.15.177:0/3605462839 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01815dfd0 con 0x7fe000003980 2023-11-28T20:08:06.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.432+0000 7fe00f7fe640 1 -- 172.21.15.177:0/3605462839 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00000b990 con 0x7fe0180b4740 2023-11-28T20:08:06.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.436+0000 7fe01cf29640 1 --2- 172.21.15.177:0/3605462839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe000003980 0x7fe000003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.436+0000 7fe00ffff640 1 --2- 172.21.15.177:0/3605462839 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0180b4740 0x7fe0000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.436+0000 7fe01d72a640 1 --2- 172.21.15.177:0/3605462839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe000004d10 0x7fe000005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.436+0000 7fe01cf29640 1 -- 172.21.15.177:0/3605462839 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0180b4740 msgr2=0x7fe0000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:06.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.436+0000 7fe01cf29640 1 --2- 172.21.15.177:0/3605462839 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0180b4740 0x7fe0000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.436+0000 7fe01cf29640 1 -- 172.21.15.177:0/3605462839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe000004d10 msgr2=0x7fe000005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:06.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.436+0000 7fe01cf29640 1 --2- 172.21.15.177:0/3605462839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe000004d10 0x7fe000005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.436+0000 7fe01cf29640 1 -- 172.21.15.177:0/3605462839 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe000003530 con 0x7fe000003980 2023-11-28T20:08:06.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.436+0000 7fe01d72a640 1 --2- 172.21.15.177:0/3605462839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe000004d10 0x7fe000005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:06.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.436+0000 7fe01cf29640 1 --2- 172.21.15.177:0/3605462839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe000003980 0x7fe000003da0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe01400c110 tx=0x7fe01401cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c354a8b548d0bc2b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:06.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.436+0000 7fe00f7fe640 1 -- 172.21.15.177:0/3605462839 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0140058e0 con 0x7fe000003980 2023-11-28T20:08:06.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.436+0000 7fe00f7fe640 1 -- 172.21.15.177:0/3605462839 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe014005a60 con 0x7fe000003980 2023-11-28T20:08:06.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.436+0000 7fe00f7fe640 1 -- 172.21.15.177:0/3605462839 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014005e10 con 0x7fe000003980 2023-11-28T20:08:06.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe01f18d640 1 -- 172.21.15.177:0/3605462839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe000003980 msgr2=0x7fe000003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe01f18d640 1 --2- 172.21.15.177:0/3605462839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe000003980 0x7fe000003da0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe01400c110 tx=0x7fe01401cba0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe01d72a640 1 -- 172.21.15.177:0/3605462839 reap_dead start 2023-11-28T20:08:06.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe01f18d640 1 -- 172.21.15.177:0/3605462839 shutdown_connections 2023-11-28T20:08:06.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe01f18d640 1 -- 172.21.15.177:0/3605462839 >> 172.21.15.177:0/3605462839 conn(0x7fe018070b40 msgr2=0x7fe018066320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:06.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe01f18d640 1 -- 172.21.15.177:0/3605462839 shutdown_connections 2023-11-28T20:08:06.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe01f18d640 1 -- 172.21.15.177:0/3605462839 wait complete. 2023-11-28T20:08:06.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe01f18d640 1 Processor -- start 2023-11-28T20:08:06.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe01f18d640 1 -- start start 2023-11-28T20:08:06.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe01f18d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe000003980 0x7fe01815a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe01f18d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe01813eab0 0x7fe01813ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe01f18d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0180cadc0 0x7fe0180cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe01f18d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180cb780 con 0x7fe01813eab0 2023-11-28T20:08:06.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe01f18d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0181f3a30 con 0x7fe0180cadc0 2023-11-28T20:08:06.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe01f18d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe018140d90 con 0x7fe000003980 2023-11-28T20:08:06.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe00ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe01813eab0 0x7fe01813ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe00ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe01813eab0 0x7fe01813ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41458/0 (socket says 172.21.15.177:41458) 2023-11-28T20:08:06.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.440+0000 7fe00ffff640 1 -- 172.21.15.177:0/1746238503 learned_addr learned my addr 172.21.15.177:0/1746238503 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:06.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe01d72a640 1 --2- 172.21.15.177:0/1746238503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0180cadc0 0x7fe0180cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe01cf29640 1 --2- 172.21.15.177:0/1746238503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe000003980 0x7fe01815a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe00ffff640 1 -- 172.21.15.177:0/1746238503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe000003980 msgr2=0x7fe01815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe00ffff640 1 --2- 172.21.15.177:0/1746238503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe000003980 0x7fe01815a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe00ffff640 1 -- 172.21.15.177:0/1746238503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0180cadc0 msgr2=0x7fe0180cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe00ffff640 1 --2- 172.21.15.177:0/1746238503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0180cadc0 0x7fe0180cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe00ffff640 1 -- 172.21.15.177:0/1746238503 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01813f4f0 con 0x7fe01813eab0 2023-11-28T20:08:06.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe00ffff640 1 --2- 172.21.15.177:0/1746238503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe01813eab0 0x7fe01813ef10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe008011990 tx=0x7fe008011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:06.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe00d7fa640 1 -- 172.21.15.177:0/1746238503 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00800fad0 con 0x7fe01813eab0 2023-11-28T20:08:06.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe00d7fa640 1 -- 172.21.15.177:0/1746238503 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00800fc30 con 0x7fe01813eab0 2023-11-28T20:08:06.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe00d7fa640 1 -- 172.21.15.177:0/1746238503 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe008014440 con 0x7fe01813eab0 2023-11-28T20:08:06.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe01f18d640 1 -- 172.21.15.177:0/1746238503 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe018140fe0 con 0x7fe01813eab0 2023-11-28T20:08:06.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe01f18d640 1 -- 172.21.15.177:0/1746238503 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0181415a0 con 0x7fe01813eab0 2023-11-28T20:08:06.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe01f18d640 1 -- 172.21.15.177:0/1746238503 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0180693d0 con 0x7fe01813eab0 2023-11-28T20:08:06.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe00d7fa640 1 -- 172.21.15.177:0/1746238503 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe0080145a0 con 0x7fe01813eab0 2023-11-28T20:08:06.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.444+0000 7fe00d7fa640 1 --2- 172.21.15.177:0/1746238503 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe004066470 0x7fe004068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.448+0000 7fe00d7fa640 1 -- 172.21.15.177:0/1746238503 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe008084630 con 0x7fe01813eab0 2023-11-28T20:08:06.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.448+0000 7fe01cf29640 1 --2- 172.21.15.177:0/1746238503 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe004066470 0x7fe004068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.448+0000 7fe01cf29640 1 --2- 172.21.15.177:0/1746238503 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe004066470 0x7fe004068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe0140aa000 tx=0x7fe0140019b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:06.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.452+0000 7fe00d7fa640 1 -- 172.21.15.177:0/1746238503 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe008051aa0 con 0x7fe01813eab0 2023-11-28T20:08:06.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.600+0000 7fe01f18d640 1 -- 172.21.15.177:0/1746238503 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0180664c0 con 0x7fe01813eab0 2023-11-28T20:08:06.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.600+0000 7fe00d7fa640 1 -- 172.21.15.177:0/1746238503 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe0080550c0 con 0x7fe01813eab0 2023-11-28T20:08:06.604 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:06.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.604+0000 7fe01f18d640 1 -- 172.21.15.177:0/1746238503 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe004066470 msgr2=0x7fe004068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.604+0000 7fe01f18d640 1 --2- 172.21.15.177:0/1746238503 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe004066470 0x7fe004068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe0140aa000 tx=0x7fe0140019b0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.604+0000 7fe01f18d640 1 -- 172.21.15.177:0/1746238503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe01813eab0 msgr2=0x7fe01813ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.604+0000 7fe01f18d640 1 --2- 172.21.15.177:0/1746238503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe01813eab0 0x7fe01813ef10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe008011990 tx=0x7fe008011e50 comp rx=0 tx=0).stop 2023-11-28T20:08:06.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.604+0000 7fe01f18d640 1 -- 172.21.15.177:0/1746238503 shutdown_connections 2023-11-28T20:08:06.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.604+0000 7fe01f18d640 1 --2- 172.21.15.177:0/1746238503 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe004066470 0x7fe004068930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.604+0000 7fe01f18d640 1 --2- 172.21.15.177:0/1746238503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0180cadc0 0x7fe0180cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.604+0000 7fe01f18d640 1 --2- 172.21.15.177:0/1746238503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe01813eab0 0x7fe01813ef10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.604+0000 7fe01f18d640 1 --2- 172.21.15.177:0/1746238503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe000003980 0x7fe01815a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.604+0000 7fe01f18d640 1 -- 172.21.15.177:0/1746238503 >> 172.21.15.177:0/1746238503 conn(0x7fe018070b40 msgr2=0x7fe01815f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:06.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.604+0000 7fe01f18d640 1 -- 172.21.15.177:0/1746238503 shutdown_connections 2023-11-28T20:08:06.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.604+0000 7fe01f18d640 1 -- 172.21.15.177:0/1746238503 wait complete. 2023-11-28T20:08:06.625 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:06.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.760+0000 7f04b005a640 1 Processor -- start 2023-11-28T20:08:06.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04b005a640 1 -- start start 2023-11-28T20:08:06.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04b005a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04a8158ca0 0x7f04a815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04b005a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f04a80b42d0 0x7f04a80b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04b005a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a80b4c40 con 0x7f04a80cba10 2023-11-28T20:08:06.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04b005a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a815b670 con 0x7f04a80b42d0 2023-11-28T20:08:06.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04b005a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a815c510 con 0x7f04a8158ca0 2023-11-28T20:08:06.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04ae5f7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f04a80b42d0 0x7f04a80b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04ae5f7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f04a80b42d0 0x7f04a80b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41466/0 (socket says 172.21.15.177:41466) 2023-11-28T20:08:06.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04ae5f7640 1 -- 172.21.15.177:0/414488974 learned_addr learned my addr 172.21.15.177:0/414488974 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:06.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04ad5f5640 1 --1- 172.21.15.177:0/414488974 >> v1:172.21.15.177:6789/0 conn(0x7f04a80cba10 0x7f04a815be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:58268/0 (socket says 172.21.15.177:58268) 2023-11-28T20:08:06.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04addf6640 1 --2- 172.21.15.177:0/414488974 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04a8158ca0 0x7f04a815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04ae5f7640 1 -- 172.21.15.177:0/414488974 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04a8158ca0 msgr2=0x7f04a815eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:06.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04acdf4640 1 -- 172.21.15.177:0/414488974 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011481389 0 0) 0x7f04a80b4c40 con 0x7f04a80cba10 2023-11-28T20:08:06.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04ae5f7640 1 --2- 172.21.15.177:0/414488974 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04a8158ca0 0x7f04a815eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04ae5f7640 1 -- 172.21.15.177:0/414488974 >> v1:172.21.15.177:6789/0 conn(0x7f04a80cba10 legacy=0x7f04a815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.764+0000 7f04ae5f7640 1 -- 172.21.15.177:0/414488974 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a815f410 con 0x7f04a80b42d0 2023-11-28T20:08:06.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.768+0000 7f04ae5f7640 1 --2- 172.21.15.177:0/414488974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04a80b42d0 0x7f04a80b4700 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009e50 tx=0x7f04a001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cb480906a226e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:06.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.768+0000 7f04acdf4640 1 -- 172.21.15.177:0/414488974 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a00a58a0 con 0x7f04a80b42d0 2023-11-28T20:08:06.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.768+0000 7f04acdf4640 1 -- 172.21.15.177:0/414488974 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a00a5a00 con 0x7f04a80b42d0 2023-11-28T20:08:06.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.768+0000 7f04acdf4640 1 -- 172.21.15.177:0/414488974 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a00a5d90 con 0x7f04a80b42d0 2023-11-28T20:08:06.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.768+0000 7f04b005a640 1 -- 172.21.15.177:0/414488974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04a80b42d0 msgr2=0x7f04a80b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.768+0000 7f04b005a640 1 --2- 172.21.15.177:0/414488974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04a80b42d0 0x7f04a80b4700 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009e50 tx=0x7f04a001c9e0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.768+0000 7f04b005a640 1 -- 172.21.15.177:0/414488974 shutdown_connections 2023-11-28T20:08:06.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.768+0000 7f04b005a640 1 --2- 172.21.15.177:0/414488974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04a80b42d0 0x7f04a80b4700 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.768+0000 7f04b005a640 1 --2- 172.21.15.177:0/414488974 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04a8158ca0 0x7f04a815eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.768+0000 7f04b005a640 1 -- 172.21.15.177:0/414488974 >> 172.21.15.177:0/414488974 conn(0x7f04a80b0cc0 msgr2=0x7f04a80b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:06.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.768+0000 7f04b005a640 1 -- 172.21.15.177:0/414488974 shutdown_connections 2023-11-28T20:08:06.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.768+0000 7f04b005a640 1 -- 172.21.15.177:0/414488974 wait complete. 2023-11-28T20:08:06.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04b005a640 1 Processor -- start 2023-11-28T20:08:06.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04b005a640 1 -- start start 2023-11-28T20:08:06.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04b005a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04a80b42d0 0x7f04a815c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04b005a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04a80cba10 0x7f04a814e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04b005a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04a8158ca0 0x7f04a814c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04b005a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a8153cc0 con 0x7f04a80cba10 2023-11-28T20:08:06.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04b005a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a815dcd0 con 0x7f04a8158ca0 2023-11-28T20:08:06.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04b005a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a815d190 con 0x7f04a80b42d0 2023-11-28T20:08:06.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04ad5f5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04a80cba10 0x7f04a814e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04ad5f5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04a80cba10 0x7f04a814e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41478/0 (socket says 172.21.15.177:41478) 2023-11-28T20:08:06.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04ad5f5640 1 -- 172.21.15.177:0/4177093754 learned_addr learned my addr 172.21.15.177:0/4177093754 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:06.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04addf6640 1 --2- 172.21.15.177:0/4177093754 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04a80b42d0 0x7f04a815c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04ae5f7640 1 --2- 172.21.15.177:0/4177093754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04a8158ca0 0x7f04a814c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04ad5f5640 1 -- 172.21.15.177:0/4177093754 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04a80b42d0 msgr2=0x7f04a815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04ad5f5640 1 --2- 172.21.15.177:0/4177093754 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04a80b42d0 0x7f04a815c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04ad5f5640 1 -- 172.21.15.177:0/4177093754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04a8158ca0 msgr2=0x7f04a814c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04ad5f5640 1 --2- 172.21.15.177:0/4177093754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04a8158ca0 0x7f04a814c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04ad5f5640 1 -- 172.21.15.177:0/4177093754 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a0009b30 con 0x7f04a80cba10 2023-11-28T20:08:06.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04ad5f5640 1 --2- 172.21.15.177:0/4177093754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04a80cba10 0x7f04a814e360 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f049800c3e0 tx=0x7f049800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:06.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f049e7fc640 1 -- 172.21.15.177:0/4177093754 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04980074e0 con 0x7f04a80cba10 2023-11-28T20:08:06.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f049e7fc640 1 -- 172.21.15.177:0/4177093754 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0498007640 con 0x7f04a80cba10 2023-11-28T20:08:06.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f049e7fc640 1 -- 172.21.15.177:0/4177093754 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0498004a30 con 0x7f04a80cba10 2023-11-28T20:08:06.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04b005a640 1 -- 172.21.15.177:0/4177093754 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a815d430 con 0x7f04a80cba10 2023-11-28T20:08:06.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04b005a640 1 -- 172.21.15.177:0/4177093754 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a815d9f0 con 0x7f04a80cba10 2023-11-28T20:08:06.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.772+0000 7f04b005a640 1 -- 172.21.15.177:0/4177093754 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a8153e00 con 0x7f04a80cba10 2023-11-28T20:08:06.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.776+0000 7f049e7fc640 1 -- 172.21.15.177:0/4177093754 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0498004b90 con 0x7f04a80cba10 2023-11-28T20:08:06.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.776+0000 7f049e7fc640 1 --2- 172.21.15.177:0/4177093754 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f048c066470 0x7f048c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:06.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.776+0000 7f049e7fc640 1 -- 172.21.15.177:0/4177093754 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0498083980 con 0x7f04a80cba10 2023-11-28T20:08:06.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.776+0000 7f04addf6640 1 --2- 172.21.15.177:0/4177093754 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f048c066470 0x7f048c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:06.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.776+0000 7f04addf6640 1 --2- 172.21.15.177:0/4177093754 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f048c066470 0x7f048c068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009af0 tx=0x7f04a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:06.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.780+0000 7f049e7fc640 1 -- 172.21.15.177:0/4177093754 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f04a8153e00 con 0x7f04a80cba10 2023-11-28T20:08:06.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.928+0000 7f04b005a640 1 -- 172.21.15.177:0/4177093754 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f04a8153e00 con 0x7f04a80cba10 2023-11-28T20:08:06.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.928+0000 7f049e7fc640 1 -- 172.21.15.177:0/4177093754 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f04a8153e00 con 0x7f04a80cba10 2023-11-28T20:08:06.933 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:06.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.932+0000 7f04b005a640 1 -- 172.21.15.177:0/4177093754 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f048c066470 msgr2=0x7f048c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.932+0000 7f04b005a640 1 --2- 172.21.15.177:0/4177093754 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f048c066470 0x7f048c068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009af0 tx=0x7f04a4008040 comp rx=0 tx=0).stop 2023-11-28T20:08:06.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.932+0000 7f04b005a640 1 -- 172.21.15.177:0/4177093754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04a80cba10 msgr2=0x7f04a814e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:06.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.932+0000 7f04b005a640 1 --2- 172.21.15.177:0/4177093754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04a80cba10 0x7f04a814e360 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f049800c3e0 tx=0x7f049800c8a0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.932+0000 7f04b005a640 1 -- 172.21.15.177:0/4177093754 shutdown_connections 2023-11-28T20:08:06.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.932+0000 7f04b005a640 1 --2- 172.21.15.177:0/4177093754 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f048c066470 0x7f048c068930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.932+0000 7f04b005a640 1 --2- 172.21.15.177:0/4177093754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04a8158ca0 0x7f04a814c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.932+0000 7f04b005a640 1 --2- 172.21.15.177:0/4177093754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04a80cba10 0x7f04a814e360 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.932+0000 7f04b005a640 1 --2- 172.21.15.177:0/4177093754 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04a80b42d0 0x7f04a815c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:06.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.932+0000 7f04b005a640 1 -- 172.21.15.177:0/4177093754 >> 172.21.15.177:0/4177093754 conn(0x7f04a80b0cc0 msgr2=0x7f04a80b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:06.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.932+0000 7f04b005a640 1 -- 172.21.15.177:0/4177093754 shutdown_connections 2023-11-28T20:08:06.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:06.932+0000 7f04b005a640 1 -- 172.21.15.177:0/4177093754 wait complete. 2023-11-28T20:08:06.955 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:07.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.088+0000 7f9a7579d640 1 Processor -- start 2023-11-28T20:08:07.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.088+0000 7f9a7579d640 1 -- start start 2023-11-28T20:08:07.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.092+0000 7f9a7579d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9a7015d200 0x7f9a700d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.092+0000 7f9a7579d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9a700d15a0 0x7f9a700b6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.092+0000 7f9a7579d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a700b29f0 con 0x7f9a700d1160 2023-11-28T20:08:07.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.092+0000 7f9a7579d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a700d1b00 con 0x7f9a700d15a0 2023-11-28T20:08:07.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.092+0000 7f9a7579d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a700d1de0 con 0x7f9a7015d200 2023-11-28T20:08:07.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.092+0000 7f9a6f7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9a700d15a0 0x7f9a700b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.092+0000 7f9a6f7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9a700d15a0 0x7f9a700b6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41488/0 (socket says 172.21.15.177:41488) 2023-11-28T20:08:07.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.092+0000 7f9a6f7fe640 1 -- 172.21.15.177:0/3210955521 learned_addr learned my addr 172.21.15.177:0/3210955521 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:07.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.092+0000 7f9a6effd640 1 --2- 172.21.15.177:0/3210955521 >> v2:172.21.15.195:3300/0 conn(0x7f9a7015d200 0x7f9a700d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.092+0000 7f9a6f7fe640 1 -- 172.21.15.177:0/3210955521 >> v2:172.21.15.195:3300/0 conn(0x7f9a7015d200 msgr2=0x7f9a700d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:07.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.092+0000 7f9a6f7fe640 1 --2- 172.21.15.177:0/3210955521 >> v2:172.21.15.195:3300/0 conn(0x7f9a7015d200 0x7f9a700d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.092+0000 7f9a6f7fe640 1 -- 172.21.15.177:0/3210955521 >> v1:172.21.15.177:6789/0 conn(0x7f9a700d1160 legacy=0x7f9a700cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.092+0000 7f9a6f7fe640 1 -- 172.21.15.177:0/3210955521 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a700d20c0 con 0x7f9a700d15a0 2023-11-28T20:08:07.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.092+0000 7f9a6e7fc640 1 -- 172.21.15.177:0/3210955521 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415205094 0 0) 0x7f9a700b29f0 con 0x7f9a700d1160 2023-11-28T20:08:07.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a6f7fe640 1 --2- 172.21.15.177:0/3210955521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a700d15a0 0x7f9a700b6190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9a700b5800 tx=0x7f9a6801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5da3ff59fd3d4c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:07.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a6e7fc640 1 -- 172.21.15.177:0/3210955521 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a680af400 con 0x7f9a700d15a0 2023-11-28T20:08:07.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a6e7fc640 1 -- 172.21.15.177:0/3210955521 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a680ab050 con 0x7f9a700d15a0 2023-11-28T20:08:07.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a6e7fc640 1 -- 172.21.15.177:0/3210955521 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a680af780 con 0x7f9a700d15a0 2023-11-28T20:08:07.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 -- 172.21.15.177:0/3210955521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a700d15a0 msgr2=0x7f9a700b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 --2- 172.21.15.177:0/3210955521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a700d15a0 0x7f9a700b6190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9a700b5800 tx=0x7f9a6801f1c0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 -- 172.21.15.177:0/3210955521 shutdown_connections 2023-11-28T20:08:07.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 --2- 172.21.15.177:0/3210955521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a700d15a0 0x7f9a700b6190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 --2- 172.21.15.177:0/3210955521 >> v2:172.21.15.195:3300/0 conn(0x7f9a7015d200 0x7f9a700d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 -- 172.21.15.177:0/3210955521 >> 172.21.15.177:0/3210955521 conn(0x7f9a70072260 msgr2=0x7f9a700cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:07.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 -- 172.21.15.177:0/3210955521 shutdown_connections 2023-11-28T20:08:07.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 -- 172.21.15.177:0/3210955521 wait complete. 2023-11-28T20:08:07.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 Processor -- start 2023-11-28T20:08:07.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 -- start start 2023-11-28T20:08:07.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a700d1160 0x7f9a700c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a700d15a0 0x7f9a700cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a7015d200 0x7f9a7015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a700c7530 con 0x7f9a700d1160 2023-11-28T20:08:07.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a700c80b0 con 0x7f9a700d15a0 2023-11-28T20:08:07.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a7579d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a700c84d0 con 0x7f9a7015d200 2023-11-28T20:08:07.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.096+0000 7f9a6effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a700d1160 0x7f9a700c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a6effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a700d1160 0x7f9a700c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41494/0 (socket says 172.21.15.177:41494) 2023-11-28T20:08:07.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a6effd640 1 -- 172.21.15.177:0/2097456928 learned_addr learned my addr 172.21.15.177:0/2097456928 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:07.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a667fc640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a700d15a0 0x7f9a700cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a6f7fe640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a7015d200 0x7f9a7015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a6effd640 1 -- 172.21.15.177:0/2097456928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a7015d200 msgr2=0x7f9a7015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a6effd640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a7015d200 0x7f9a7015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a6effd640 1 -- 172.21.15.177:0/2097456928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a700d15a0 msgr2=0x7f9a700cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a6effd640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a700d15a0 0x7f9a700cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a6effd640 1 -- 172.21.15.177:0/2097456928 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a68009b30 con 0x7f9a700d1160 2023-11-28T20:08:07.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a667fc640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a700d15a0 0x7f9a700cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:07.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a6f7fe640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a7015d200 0x7f9a7015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:07.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a6effd640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a700d1160 0x7f9a700c9750 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000e8a0 tx=0x7f9a6000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:07.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a67fff640 1 -- 172.21.15.177:0/2097456928 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60009510 con 0x7f9a700d1160 2023-11-28T20:08:07.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a67fff640 1 -- 172.21.15.177:0/2097456928 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6000c940 con 0x7f9a700d1160 2023-11-28T20:08:07.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a67fff640 1 -- 172.21.15.177:0/2097456928 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6000ccb0 con 0x7f9a700d1160 2023-11-28T20:08:07.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a7579d640 1 -- 172.21.15.177:0/2097456928 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a700c7710 con 0x7f9a700d1160 2023-11-28T20:08:07.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a7579d640 1 -- 172.21.15.177:0/2097456928 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a700c7cd0 con 0x7f9a700d1160 2023-11-28T20:08:07.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a7579d640 1 -- 172.21.15.177:0/2097456928 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a70069440 con 0x7f9a700d1160 2023-11-28T20:08:07.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a67fff640 1 -- 172.21.15.177:0/2097456928 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9a60013470 con 0x7f9a700d1160 2023-11-28T20:08:07.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.100+0000 7f9a67fff640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9a50066470 0x7f9a50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.104+0000 7f9a67fff640 1 -- 172.21.15.177:0/2097456928 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a60083ff0 con 0x7f9a700d1160 2023-11-28T20:08:07.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.104+0000 7f9a667fc640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9a50066470 0x7f9a50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.104+0000 7f9a667fc640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9a50066470 0x7f9a50068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9a700c9600 tx=0x7f9a58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:07.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.104+0000 7f9a67fff640 1 -- 172.21.15.177:0/2097456928 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a600513d0 con 0x7f9a700d1160 2023-11-28T20:08:07.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.256+0000 7f9a7579d640 1 -- 172.21.15.177:0/2097456928 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a700b1fc0 con 0x7f9a700d1160 2023-11-28T20:08:07.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.260+0000 7f9a67fff640 1 -- 172.21.15.177:0/2097456928 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f9a700b1fc0 con 0x7f9a700d1160 2023-11-28T20:08:07.263 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:07.263 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:07.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.260+0000 7f9a7579d640 1 -- 172.21.15.177:0/2097456928 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9a50066470 msgr2=0x7f9a50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.260+0000 7f9a7579d640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9a50066470 0x7f9a50068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9a700c9600 tx=0x7f9a58009040 comp rx=0 tx=0).stop 2023-11-28T20:08:07.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.260+0000 7f9a7579d640 1 -- 172.21.15.177:0/2097456928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a700d1160 msgr2=0x7f9a700c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.260+0000 7f9a7579d640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a700d1160 0x7f9a700c9750 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000e8a0 tx=0x7f9a6000eca0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.260+0000 7f9a7579d640 1 -- 172.21.15.177:0/2097456928 shutdown_connections 2023-11-28T20:08:07.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.260+0000 7f9a7579d640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9a50066470 0x7f9a50068930 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.260+0000 7f9a7579d640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a7015d200 0x7f9a7015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.260+0000 7f9a7579d640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a700d15a0 0x7f9a700cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.260+0000 7f9a7579d640 1 --2- 172.21.15.177:0/2097456928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a700d1160 0x7f9a700c9750 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.260+0000 7f9a7579d640 1 -- 172.21.15.177:0/2097456928 >> 172.21.15.177:0/2097456928 conn(0x7f9a70072260 msgr2=0x7f9a700b7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:07.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.260+0000 7f9a7579d640 1 -- 172.21.15.177:0/2097456928 shutdown_connections 2023-11-28T20:08:07.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.260+0000 7f9a7579d640 1 -- 172.21.15.177:0/2097456928 wait complete. 2023-11-28T20:08:07.284 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:07.284 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:07.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.420+0000 7fd76ba79640 1 Processor -- start 2023-11-28T20:08:07.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.420+0000 7fd76ba79640 1 -- start start 2023-11-28T20:08:07.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.424+0000 7fd76ba79640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd76415d2b0 0x7fd7640d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.424+0000 7fd76ba79640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7640d1cf0 0x7fd7640cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.424+0000 7fd76ba79640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7640aff30 con 0x7fd76415d690 2023-11-28T20:08:07.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.424+0000 7fd76ba79640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7640b01d0 con 0x7fd76415d2b0 2023-11-28T20:08:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.424+0000 7fd76ba79640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7640b04b0 con 0x7fd7640d1cf0 2023-11-28T20:08:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.424+0000 7fd769815640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd76415d2b0 0x7fd7640d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.424+0000 7fd769815640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd76415d2b0 0x7fd7640d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41498/0 (socket says 172.21.15.177:41498) 2023-11-28T20:08:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.424+0000 7fd769815640 1 -- 172.21.15.177:0/243419935 learned_addr learned my addr 172.21.15.177:0/243419935 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.424+0000 7fd76a016640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fd76415d690 0x7fd7640cdd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:58290/0 (socket says 172.21.15.177:58290) 2023-11-28T20:08:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.424+0000 7fd769014640 1 --2- 172.21.15.177:0/243419935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7640d1cf0 0x7fd7640cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.424+0000 7fd769815640 1 -- 172.21.15.177:0/243419935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7640d1cf0 msgr2=0x7fd7640cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.424+0000 7fd769815640 1 --2- 172.21.15.177:0/243419935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7640d1cf0 0x7fd7640cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.424+0000 7fd769815640 1 -- 172.21.15.177:0/243419935 >> v1:172.21.15.177:6789/0 conn(0x7fd76415d690 legacy=0x7fd7640cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.424+0000 7fd769815640 1 -- 172.21.15.177:0/243419935 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7640b0790 con 0x7fd76415d2b0 2023-11-28T20:08:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.428+0000 7fd769815640 1 --2- 172.21.15.177:0/243419935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76415d2b0 0x7fd7640d17b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd760009870 tx=0x7fd76001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82787f94e0202fcc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.428+0000 7fd768813640 1 -- 172.21.15.177:0/243419935 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7600aa640 con 0x7fd76415d2b0 2023-11-28T20:08:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.428+0000 7fd768813640 1 -- 172.21.15.177:0/243419935 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7600aa7a0 con 0x7fd76415d2b0 2023-11-28T20:08:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.428+0000 7fd768813640 1 -- 172.21.15.177:0/243419935 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7600aab30 con 0x7fd76415d2b0 2023-11-28T20:08:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.428+0000 7fd76ba79640 1 -- 172.21.15.177:0/243419935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76415d2b0 msgr2=0x7fd7640d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.428+0000 7fd76ba79640 1 --2- 172.21.15.177:0/243419935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76415d2b0 0x7fd7640d17b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd760009870 tx=0x7fd76001c540 comp rx=0 tx=0).stop 2023-11-28T20:08:07.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.428+0000 7fd76ba79640 1 -- 172.21.15.177:0/243419935 shutdown_connections 2023-11-28T20:08:07.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.428+0000 7fd76ba79640 1 --2- 172.21.15.177:0/243419935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7640d1cf0 0x7fd7640cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.428+0000 7fd76ba79640 1 --2- 172.21.15.177:0/243419935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76415d2b0 0x7fd7640d17b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.428+0000 7fd76ba79640 1 -- 172.21.15.177:0/243419935 >> 172.21.15.177:0/243419935 conn(0x7fd76409c510 msgr2=0x7fd7640d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:07.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.428+0000 7fd76ba79640 1 -- 172.21.15.177:0/243419935 shutdown_connections 2023-11-28T20:08:07.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.428+0000 7fd76ba79640 1 -- 172.21.15.177:0/243419935 wait complete. 2023-11-28T20:08:07.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.428+0000 7fd76ba79640 1 Processor -- start 2023-11-28T20:08:07.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.428+0000 7fd76ba79640 1 -- start start 2023-11-28T20:08:07.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76ba79640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7640d1cf0 0x7fd7641fa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76ba79640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd76415d2b0 0x7fd76414efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76ba79640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76415d690 0x7fd764155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76ba79640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7640cd020 con 0x7fd76415d690 2023-11-28T20:08:07.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76ba79640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7641fac00 con 0x7fd7640d1cf0 2023-11-28T20:08:07.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76ba79640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76414f4e0 con 0x7fd76415d2b0 2023-11-28T20:08:07.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76a016640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76415d690 0x7fd764155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76a016640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76415d690 0x7fd764155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41510/0 (socket says 172.21.15.177:41510) 2023-11-28T20:08:07.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76a016640 1 -- 172.21.15.177:0/4038852201 learned_addr learned my addr 172.21.15.177:0/4038852201 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:07.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd769014640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd76415d2b0 0x7fd76414efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd769815640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7640d1cf0 0x7fd7641fa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76a016640 1 -- 172.21.15.177:0/4038852201 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd76415d2b0 msgr2=0x7fd76414efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76a016640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd76415d2b0 0x7fd76414efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76a016640 1 -- 172.21.15.177:0/4038852201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7640d1cf0 msgr2=0x7fd7641fa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76a016640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7640d1cf0 0x7fd7641fa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76a016640 1 -- 172.21.15.177:0/4038852201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7600094d0 con 0x7fd76415d690 2023-11-28T20:08:07.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd769014640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd76415d2b0 0x7fd76414efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:07.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd769815640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7640d1cf0 0x7fd7641fa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:07.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76a016640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76415d690 0x7fd764155610 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00c700 tx=0x7fd75c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:07.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd75a7fc640 1 -- 172.21.15.177:0/4038852201 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c00ce10 con 0x7fd76415d690 2023-11-28T20:08:07.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd75a7fc640 1 -- 172.21.15.177:0/4038852201 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c00a640 con 0x7fd76415d690 2023-11-28T20:08:07.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd75a7fc640 1 -- 172.21.15.177:0/4038852201 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c00a9b0 con 0x7fd76415d690 2023-11-28T20:08:07.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76ba79640 1 -- 172.21.15.177:0/4038852201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd764152630 con 0x7fd76415d690 2023-11-28T20:08:07.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76ba79640 1 -- 172.21.15.177:0/4038852201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd764152bf0 con 0x7fd76415d690 2023-11-28T20:08:07.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd76ba79640 1 -- 172.21.15.177:0/4038852201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7640679f0 con 0x7fd76415d690 2023-11-28T20:08:07.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.432+0000 7fd75a7fc640 1 -- 172.21.15.177:0/4038852201 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd75c00ab10 con 0x7fd76415d690 2023-11-28T20:08:07.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.436+0000 7fd75a7fc640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd748066470 0x7fd748068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.436+0000 7fd75a7fc640 1 -- 172.21.15.177:0/4038852201 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd75c083520 con 0x7fd76415d690 2023-11-28T20:08:07.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.436+0000 7fd769815640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd748066470 0x7fd748068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.436+0000 7fd769815640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd748066470 0x7fd748068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd7600ae000 tx=0x7fd760008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:07.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.440+0000 7fd75a7fc640 1 -- 172.21.15.177:0/4038852201 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd75c050a40 con 0x7fd76415d690 2023-11-28T20:08:07.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.588+0000 7fd76ba79640 1 -- 172.21.15.177:0/4038852201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7640693d0 con 0x7fd76415d690 2023-11-28T20:08:07.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.588+0000 7fd75a7fc640 1 -- 172.21.15.177:0/4038852201 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd75c054060 con 0x7fd76415d690 2023-11-28T20:08:07.594 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:07.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.592+0000 7fd76ba79640 1 -- 172.21.15.177:0/4038852201 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd748066470 msgr2=0x7fd748068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.592+0000 7fd76ba79640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd748066470 0x7fd748068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd7600ae000 tx=0x7fd760008040 comp rx=0 tx=0).stop 2023-11-28T20:08:07.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.592+0000 7fd76ba79640 1 -- 172.21.15.177:0/4038852201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76415d690 msgr2=0x7fd764155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.592+0000 7fd76ba79640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76415d690 0x7fd764155610 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00c700 tx=0x7fd75c00cbc0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.592+0000 7fd76ba79640 1 -- 172.21.15.177:0/4038852201 shutdown_connections 2023-11-28T20:08:07.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.592+0000 7fd76ba79640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd748066470 0x7fd748068930 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.592+0000 7fd76ba79640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76415d690 0x7fd764155610 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.592+0000 7fd76ba79640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd76415d2b0 0x7fd76414efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.592+0000 7fd76ba79640 1 --2- 172.21.15.177:0/4038852201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7640d1cf0 0x7fd7641fa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.592+0000 7fd76ba79640 1 -- 172.21.15.177:0/4038852201 >> 172.21.15.177:0/4038852201 conn(0x7fd76409c510 msgr2=0x7fd7640b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:07.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.592+0000 7fd76ba79640 1 -- 172.21.15.177:0/4038852201 shutdown_connections 2023-11-28T20:08:07.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.592+0000 7fd76ba79640 1 -- 172.21.15.177:0/4038852201 wait complete. 2023-11-28T20:08:07.615 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:07.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.752+0000 7f5c90716640 1 Processor -- start 2023-11-28T20:08:07.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.752+0000 7f5c90716640 1 -- start start 2023-11-28T20:08:07.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.752+0000 7f5c90716640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c88071d90 0x7f5c88072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.752+0000 7f5c90716640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5c8813f5f0 0x7f5c880ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.752+0000 7f5c90716640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c8813d2b0 con 0x7f5c8815adb0 2023-11-28T20:08:07.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.752+0000 7f5c90716640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c88140520 con 0x7f5c8813f5f0 2023-11-28T20:08:07.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.752+0000 7f5c90716640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c880cd7f0 con 0x7f5c88071d90 2023-11-28T20:08:07.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.752+0000 7f5c8e4b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c88071d90 0x7f5c88072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.752+0000 7f5c8ecb3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5c8813f5f0 0x7f5c880ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.752+0000 7f5c8dcb1640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f5c8815adb0 0x7f5c8813d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:54640/0 (socket says 172.21.15.177:54640) 2023-11-28T20:08:07.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.756+0000 7f5c8e4b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c88071d90 0x7f5c88072170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:44324/0 (socket says 172.21.15.177:44324) 2023-11-28T20:08:07.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.756+0000 7f5c8dcb1640 1 -- 172.21.15.177:0/431266674 learned_addr learned my addr 172.21.15.177:0/431266674 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:07.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.756+0000 7f5c8e4b2640 1 -- 172.21.15.177:0/431266674 >> v2:172.21.15.195:3300/0 conn(0x7f5c8813f5f0 msgr2=0x7f5c880ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:07.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.756+0000 7f5c8e4b2640 1 --2- 172.21.15.177:0/431266674 >> v2:172.21.15.195:3300/0 conn(0x7f5c8813f5f0 0x7f5c880ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.756+0000 7f5c8e4b2640 1 -- 172.21.15.177:0/431266674 >> v1:172.21.15.195:6789/0 conn(0x7f5c8815adb0 legacy=0x7f5c8813d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.756+0000 7f5c8e4b2640 1 -- 172.21.15.177:0/431266674 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c880cdd70 con 0x7f5c88071d90 2023-11-28T20:08:07.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.756+0000 7f5c8ecb3640 1 --2- 172.21.15.177:0/431266674 >> v2:172.21.15.195:3300/0 conn(0x7f5c8813f5f0 0x7f5c880ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:07.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.756+0000 7f5c8e4b2640 1 --2- 172.21.15.177:0/431266674 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c88071d90 0x7f5c88072170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400ba60 tx=0x7f5c8401eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3388d13be8cc8cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:07.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.756+0000 7f5c8d4b0640 1 -- 172.21.15.177:0/431266674 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c840a7b20 con 0x7f5c88071d90 2023-11-28T20:08:07.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.756+0000 7f5c8d4b0640 1 -- 172.21.15.177:0/431266674 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c840a7c80 con 0x7f5c88071d90 2023-11-28T20:08:07.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.756+0000 7f5c8d4b0640 1 -- 172.21.15.177:0/431266674 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c840af440 con 0x7f5c88071d90 2023-11-28T20:08:07.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 -- 172.21.15.177:0/431266674 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c88071d90 msgr2=0x7f5c88072170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 --2- 172.21.15.177:0/431266674 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c88071d90 0x7f5c88072170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400ba60 tx=0x7f5c8401eb50 comp rx=0 tx=0).stop 2023-11-28T20:08:07.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 -- 172.21.15.177:0/431266674 shutdown_connections 2023-11-28T20:08:07.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 --2- 172.21.15.177:0/431266674 >> v2:172.21.15.195:3300/0 conn(0x7f5c8813f5f0 0x7f5c880ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 --2- 172.21.15.177:0/431266674 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c88071d90 0x7f5c88072170 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 -- 172.21.15.177:0/431266674 >> 172.21.15.177:0/431266674 conn(0x7f5c880b0cc0 msgr2=0x7f5c880b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:07.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 -- 172.21.15.177:0/431266674 shutdown_connections 2023-11-28T20:08:07.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 -- 172.21.15.177:0/431266674 wait complete. 2023-11-28T20:08:07.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 Processor -- start 2023-11-28T20:08:07.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 -- start start 2023-11-28T20:08:07.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c88071d90 0x7f5c880b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c8813f5f0 0x7f5c8813ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c8815adb0 0x7f5c88134e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c88143110 con 0x7f5c8815adb0 2023-11-28T20:08:07.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c880b2790 con 0x7f5c88071d90 2023-11-28T20:08:07.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c90716640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c880b29a0 con 0x7f5c8813f5f0 2023-11-28T20:08:07.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c8ecb3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c8815adb0 0x7f5c88134e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c8e4b2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c88071d90 0x7f5c880b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c8e4b2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c88071d90 0x7f5c880b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:44614/0 (socket says 172.21.15.177:44614) 2023-11-28T20:08:07.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c8e4b2640 1 -- 172.21.15.177:0/1344579084 learned_addr learned my addr 172.21.15.177:0/1344579084 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:07.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c8dcb1640 1 --2- 172.21.15.177:0/1344579084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c8813f5f0 0x7f5c8813ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c8ecb3640 1 -- 172.21.15.177:0/1344579084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c8813f5f0 msgr2=0x7f5c8813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c8ecb3640 1 --2- 172.21.15.177:0/1344579084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c8813f5f0 0x7f5c8813ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c8ecb3640 1 -- 172.21.15.177:0/1344579084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c88071d90 msgr2=0x7f5c880b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c8ecb3640 1 --2- 172.21.15.177:0/1344579084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c88071d90 0x7f5c880b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.760+0000 7f5c8ecb3640 1 -- 172.21.15.177:0/1344579084 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c80009a70 con 0x7f5c8815adb0 2023-11-28T20:08:07.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.764+0000 7f5c8ecb3640 1 --2- 172.21.15.177:0/1344579084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c8815adb0 0x7f5c88134e70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000efc0 tx=0x7f5c8000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:07.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.764+0000 7f5c7effd640 1 -- 172.21.15.177:0/1344579084 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8000cd30 con 0x7f5c8815adb0 2023-11-28T20:08:07.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.764+0000 7f5c7effd640 1 -- 172.21.15.177:0/1344579084 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8000f040 con 0x7f5c8815adb0 2023-11-28T20:08:07.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.764+0000 7f5c7effd640 1 -- 172.21.15.177:0/1344579084 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c80003be0 con 0x7f5c8815adb0 2023-11-28T20:08:07.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.764+0000 7f5c90716640 1 -- 172.21.15.177:0/1344579084 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8400b6c0 con 0x7f5c8815adb0 2023-11-28T20:08:07.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.764+0000 7f5c90716640 1 -- 172.21.15.177:0/1344579084 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c880b2f60 con 0x7f5c8815adb0 2023-11-28T20:08:07.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.764+0000 7f5c90716640 1 -- 172.21.15.177:0/1344579084 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8813dc00 con 0x7f5c8815adb0 2023-11-28T20:08:07.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.764+0000 7f5c7effd640 1 -- 172.21.15.177:0/1344579084 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5c80014480 con 0x7f5c8815adb0 2023-11-28T20:08:07.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.764+0000 7f5c7effd640 1 --2- 172.21.15.177:0/1344579084 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5c6c066470 0x7f5c6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:07.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.764+0000 7f5c7effd640 1 -- 172.21.15.177:0/1344579084 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c800849f0 con 0x7f5c8815adb0 2023-11-28T20:08:07.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.764+0000 7f5c8e4b2640 1 --2- 172.21.15.177:0/1344579084 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5c6c066470 0x7f5c6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:07.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.768+0000 7f5c8e4b2640 1 --2- 172.21.15.177:0/1344579084 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5c6c066470 0x7f5c6c068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5c84000c10 tx=0x7f5c840a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:07.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.768+0000 7f5c7effd640 1 -- 172.21.15.177:0/1344579084 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5c80051e80 con 0x7f5c8815adb0 2023-11-28T20:08:07.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.920+0000 7f5c90716640 1 -- 172.21.15.177:0/1344579084 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c88135d10 con 0x7f5c8815adb0 2023-11-28T20:08:07.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.920+0000 7f5c7effd640 1 -- 172.21.15.177:0/1344579084 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5c800554a0 con 0x7f5c8815adb0 2023-11-28T20:08:07.924 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:07.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.920+0000 7f5c90716640 1 -- 172.21.15.177:0/1344579084 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5c6c066470 msgr2=0x7f5c6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.920+0000 7f5c90716640 1 --2- 172.21.15.177:0/1344579084 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5c6c066470 0x7f5c6c068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5c84000c10 tx=0x7f5c840a9070 comp rx=0 tx=0).stop 2023-11-28T20:08:07.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.920+0000 7f5c90716640 1 -- 172.21.15.177:0/1344579084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c8815adb0 msgr2=0x7f5c88134e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:07.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.920+0000 7f5c90716640 1 --2- 172.21.15.177:0/1344579084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c8815adb0 0x7f5c88134e70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000efc0 tx=0x7f5c8000c490 comp rx=0 tx=0).stop 2023-11-28T20:08:07.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.920+0000 7f5c90716640 1 -- 172.21.15.177:0/1344579084 shutdown_connections 2023-11-28T20:08:07.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.920+0000 7f5c90716640 1 --2- 172.21.15.177:0/1344579084 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5c6c066470 0x7f5c6c068930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.920+0000 7f5c90716640 1 --2- 172.21.15.177:0/1344579084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c8815adb0 0x7f5c88134e70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.920+0000 7f5c90716640 1 --2- 172.21.15.177:0/1344579084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c8813f5f0 0x7f5c8813ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.920+0000 7f5c90716640 1 --2- 172.21.15.177:0/1344579084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c88071d90 0x7f5c880b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:07.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.920+0000 7f5c90716640 1 -- 172.21.15.177:0/1344579084 >> 172.21.15.177:0/1344579084 conn(0x7f5c880b0cc0 msgr2=0x7f5c8813de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:07.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.920+0000 7f5c90716640 1 -- 172.21.15.177:0/1344579084 shutdown_connections 2023-11-28T20:08:07.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:07.920+0000 7f5c90716640 1 -- 172.21.15.177:0/1344579084 wait complete. 2023-11-28T20:08:07.945 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:08.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.080+0000 7f818d7e6640 1 Processor -- start 2023-11-28T20:08:08.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.080+0000 7f818d7e6640 1 -- start start 2023-11-28T20:08:08.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.084+0000 7f818d7e6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f81880ae830 0x7f818815d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.084+0000 7f818d7e6640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f818815d710 0x7f81880ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.084+0000 7f818d7e6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81881575b0 con 0x7f81881571d0 2023-11-28T20:08:08.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.084+0000 7f818d7e6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818815db40 con 0x7f81880ae830 2023-11-28T20:08:08.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.084+0000 7f818d7e6640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8188071390 con 0x7f818815d710 2023-11-28T20:08:08.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.084+0000 7f817ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f81880ae830 0x7f818815d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.084+0000 7f817ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f81880ae830 0x7f818815d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41528/0 (socket says 172.21.15.177:41528) 2023-11-28T20:08:08.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.084+0000 7f817ffff640 1 -- 172.21.15.177:0/1209575512 learned_addr learned my addr 172.21.15.177:0/1209575512 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:08.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.084+0000 7f81877fe640 1 --2- 172.21.15.177:0/1209575512 >> v2:172.21.15.195:3300/0 conn(0x7f818815d710 0x7f81880ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.084+0000 7f817ffff640 1 -- 172.21.15.177:0/1209575512 >> v2:172.21.15.195:3300/0 conn(0x7f818815d710 msgr2=0x7f81880ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:08.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.084+0000 7f817ffff640 1 --2- 172.21.15.177:0/1209575512 >> v2:172.21.15.195:3300/0 conn(0x7f818815d710 0x7f81880ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.084+0000 7f817ffff640 1 -- 172.21.15.177:0/1209575512 >> v1:172.21.15.195:6789/0 conn(0x7f81881571d0 legacy=0x7f8188070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.084+0000 7f817ffff640 1 -- 172.21.15.177:0/1209575512 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8188071600 con 0x7f81880ae830 2023-11-28T20:08:08.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.088+0000 7f817ffff640 1 --2- 172.21.15.177:0/1209575512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81880ae830 0x7f818815d1d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f81880ccdc0 tx=0x7f817001e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34aaae4b9087bda5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:08.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.088+0000 7f81867fc640 1 -- 172.21.15.177:0/1209575512 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8170004230 con 0x7f81880ae830 2023-11-28T20:08:08.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.088+0000 7f81867fc640 1 -- 172.21.15.177:0/1209575512 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81700ab070 con 0x7f81880ae830 2023-11-28T20:08:08.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.088+0000 7f81867fc640 1 -- 172.21.15.177:0/1209575512 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81700a7770 con 0x7f81880ae830 2023-11-28T20:08:08.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.088+0000 7f818d7e6640 1 -- 172.21.15.177:0/1209575512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81880ae830 msgr2=0x7f818815d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.088+0000 7f818d7e6640 1 --2- 172.21.15.177:0/1209575512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81880ae830 0x7f818815d1d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f81880ccdc0 tx=0x7f817001e920 comp rx=0 tx=0).stop 2023-11-28T20:08:08.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.088+0000 7f818d7e6640 1 -- 172.21.15.177:0/1209575512 shutdown_connections 2023-11-28T20:08:08.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.088+0000 7f818d7e6640 1 --2- 172.21.15.177:0/1209575512 >> v2:172.21.15.195:3300/0 conn(0x7f818815d710 0x7f81880ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.088+0000 7f818d7e6640 1 --2- 172.21.15.177:0/1209575512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81880ae830 0x7f818815d1d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.088+0000 7f818d7e6640 1 -- 172.21.15.177:0/1209575512 >> 172.21.15.177:0/1209575512 conn(0x7f81880b0cc0 msgr2=0x7f81880b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:08.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.088+0000 7f818d7e6640 1 -- 172.21.15.177:0/1209575512 shutdown_connections 2023-11-28T20:08:08.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.088+0000 7f818d7e6640 1 -- 172.21.15.177:0/1209575512 wait complete. 2023-11-28T20:08:08.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.088+0000 7f818d7e6640 1 Processor -- start 2023-11-28T20:08:08.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.088+0000 7f818d7e6640 1 -- start start 2023-11-28T20:08:08.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f818d7e6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81880ae830 0x7f8188153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f818d7e6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81881571d0 0x7f818814d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f818d7e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f818815d710 0x7f8188151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f818d7e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8188152de0 con 0x7f818815d710 2023-11-28T20:08:08.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f818d7e6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8188153740 con 0x7f81881571d0 2023-11-28T20:08:08.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f818d7e6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8188151f50 con 0x7f81880ae830 2023-11-28T20:08:08.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f81877fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f818815d710 0x7f8188151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f81877fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f818815d710 0x7f8188151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41544/0 (socket says 172.21.15.177:41544) 2023-11-28T20:08:08.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f81877fe640 1 -- 172.21.15.177:0/375262047 learned_addr learned my addr 172.21.15.177:0/375262047 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:08.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f817ffff640 1 --2- 172.21.15.177:0/375262047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81881571d0 0x7f818814d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f8186ffd640 1 --2- 172.21.15.177:0/375262047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81880ae830 0x7f8188153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f81877fe640 1 -- 172.21.15.177:0/375262047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81880ae830 msgr2=0x7f8188153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f81877fe640 1 --2- 172.21.15.177:0/375262047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81880ae830 0x7f8188153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f81877fe640 1 -- 172.21.15.177:0/375262047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81881571d0 msgr2=0x7f818814d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f81877fe640 1 --2- 172.21.15.177:0/375262047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81881571d0 0x7f818814d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f81877fe640 1 -- 172.21.15.177:0/375262047 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817000b780 con 0x7f818815d710 2023-11-28T20:08:08.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f81877fe640 1 --2- 172.21.15.177:0/375262047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f818815d710 0x7f8188151450 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8180007e60 tx=0x7f818000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:08.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f817f7fe640 1 -- 172.21.15.177:0/375262047 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180014420 con 0x7f818815d710 2023-11-28T20:08:08.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f817f7fe640 1 -- 172.21.15.177:0/375262047 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81800145a0 con 0x7f818815d710 2023-11-28T20:08:08.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f818d7e6640 1 -- 172.21.15.177:0/375262047 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8188152160 con 0x7f818815d710 2023-11-28T20:08:08.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f817f7fe640 1 -- 172.21.15.177:0/375262047 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180014950 con 0x7f818815d710 2023-11-28T20:08:08.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f818d7e6640 1 -- 172.21.15.177:0/375262047 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8188152720 con 0x7f818815d710 2023-11-28T20:08:08.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f818d7e6640 1 -- 172.21.15.177:0/375262047 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8188152f20 con 0x7f818815d710 2023-11-28T20:08:08.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.092+0000 7f817f7fe640 1 -- 172.21.15.177:0/375262047 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8180014ab0 con 0x7f818815d710 2023-11-28T20:08:08.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.096+0000 7f817f7fe640 1 --2- 172.21.15.177:0/375262047 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8168066470 0x7f8168068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.096+0000 7f817f7fe640 1 -- 172.21.15.177:0/375262047 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81800845c0 con 0x7f818815d710 2023-11-28T20:08:08.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.096+0000 7f8186ffd640 1 --2- 172.21.15.177:0/375262047 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8168066470 0x7f8168068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.096+0000 7f8186ffd640 1 --2- 172.21.15.177:0/375262047 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8168066470 0x7f8168068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8178007fd0 tx=0x7f8178009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:08.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.100+0000 7f817f7fe640 1 -- 172.21.15.177:0/375262047 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8188152f20 con 0x7f818815d710 2023-11-28T20:08:08.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.244+0000 7f818d7e6640 1 -- 172.21.15.177:0/375262047 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8188152f20 con 0x7f818815d710 2023-11-28T20:08:08.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.248+0000 7f817f7fe640 1 -- 172.21.15.177:0/375262047 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8188152f20 con 0x7f818815d710 2023-11-28T20:08:08.250 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:08.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.248+0000 7f818d7e6640 1 -- 172.21.15.177:0/375262047 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8168066470 msgr2=0x7f8168068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.248+0000 7f818d7e6640 1 --2- 172.21.15.177:0/375262047 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8168066470 0x7f8168068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8178007fd0 tx=0x7f8178009040 comp rx=0 tx=0).stop 2023-11-28T20:08:08.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.248+0000 7f818d7e6640 1 -- 172.21.15.177:0/375262047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f818815d710 msgr2=0x7f8188151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.248+0000 7f818d7e6640 1 --2- 172.21.15.177:0/375262047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f818815d710 0x7f8188151450 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8180007e60 tx=0x7f818000e4b0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.248+0000 7f818d7e6640 1 -- 172.21.15.177:0/375262047 shutdown_connections 2023-11-28T20:08:08.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.248+0000 7f818d7e6640 1 --2- 172.21.15.177:0/375262047 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8168066470 0x7f8168068930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.248+0000 7f818d7e6640 1 --2- 172.21.15.177:0/375262047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f818815d710 0x7f8188151450 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.248+0000 7f818d7e6640 1 --2- 172.21.15.177:0/375262047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81881571d0 0x7f818814d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.248+0000 7f818d7e6640 1 --2- 172.21.15.177:0/375262047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81880ae830 0x7f8188153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.248+0000 7f818d7e6640 1 -- 172.21.15.177:0/375262047 >> 172.21.15.177:0/375262047 conn(0x7f81880b0cc0 msgr2=0x7f818815cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:08.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.248+0000 7f818d7e6640 1 -- 172.21.15.177:0/375262047 shutdown_connections 2023-11-28T20:08:08.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.248+0000 7f818d7e6640 1 -- 172.21.15.177:0/375262047 wait complete. 2023-11-28T20:08:08.272 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:08.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f8675101640 1 Processor -- start 2023-11-28T20:08:08.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f8675101640 1 -- start start 2023-11-28T20:08:08.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f8675101640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f86700b35b0 0x7f86700d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f8675101640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86700d3880 con 0x7f86700b3c70 2023-11-28T20:08:08.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f8675101640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86700cdc80 con 0x7f86700cfe90 2023-11-28T20:08:08.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f8675101640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86700d4090 con 0x7f86700b35b0 2023-11-28T20:08:08.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866e59c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f86700b3c70 0x7f86700cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:58306/0 (socket says 172.21.15.177:58306) 2023-11-28T20:08:08.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866e59c640 1 -- 172.21.15.177:0/1636634026 learned_addr learned my addr 172.21.15.177:0/1636634026 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:08.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866ed9d640 1 --2- 172.21.15.177:0/1636634026 >> v2:172.21.15.195:3300/0 conn(0x7f86700b35b0 0x7f86700d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920671398 0 0) 0x7f86700d3880 con 0x7f86700b3c70 2023-11-28T20:08:08.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8658003530 con 0x7f86700b3c70 2023-11-28T20:08:08.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212468924 0 0) 0x7f86700cdc80 con 0x7f86700cfe90 2023-11-28T20:08:08.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86700d3880 con 0x7f86700cfe90 2023-11-28T20:08:08.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 870692885 0 0) 0x7f8658003530 con 0x7f86700b3c70 2023-11-28T20:08:08.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 >> v2:172.21.15.195:3300/0 conn(0x7f86700b35b0 msgr2=0x7f86700d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:08.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 --2- 172.21.15.177:0/1636634026 >> v2:172.21.15.195:3300/0 conn(0x7f86700b35b0 0x7f86700d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 >> v1:172.21.15.195:6789/0 conn(0x7f86700cfe90 legacy=0x7f86700ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86700d3ad0 con 0x7f86700b3c70 2023-11-28T20:08:08.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f8664001680 con 0x7f86700b3c70 2023-11-28T20:08:08.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 >> v1:172.21.15.177:6789/0 conn(0x7f86700b3c70 legacy=0x7f86700cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 --2- 172.21.15.177:0/1636634026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8658003b10 0x7f8658003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 --2- 172.21.15.177:0/1636634026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86580047d0 0x7f8658004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 --2- 172.21.15.177:0/1636634026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8658005190 0x7f865800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86700d4090 con 0x7f8658003b10 2023-11-28T20:08:08.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865800c010 con 0x7f8658005190 2023-11-28T20:08:08.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865800c1d0 con 0x7f86580047d0 2023-11-28T20:08:08.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866ed9d640 1 --2- 172.21.15.177:0/1636634026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8658003b10 0x7f8658003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866f59e640 1 --2- 172.21.15.177:0/1636634026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8658005190 0x7f865800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.408+0000 7f866e59c640 1 --2- 172.21.15.177:0/1636634026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86580047d0 0x7f8658004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f866ed9d640 1 -- 172.21.15.177:0/1636634026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86580047d0 msgr2=0x7f8658004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:08.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f866ed9d640 1 --2- 172.21.15.177:0/1636634026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86580047d0 0x7f8658004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f866ed9d640 1 -- 172.21.15.177:0/1636634026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8658005190 msgr2=0x7f865800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:08.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f866ed9d640 1 --2- 172.21.15.177:0/1636634026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8658005190 0x7f865800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f866ed9d640 1 -- 172.21.15.177:0/1636634026 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658003530 con 0x7f8658003b10 2023-11-28T20:08:08.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f866f59e640 1 --2- 172.21.15.177:0/1636634026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8658005190 0x7f865800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:08.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f866f59e640 1 -- 172.21.15.177:0/1636634026 reap_dead start 2023-11-28T20:08:08.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f866e59c640 1 --2- 172.21.15.177:0/1636634026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86580047d0 0x7f8658004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:08.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f866ed9d640 1 --2- 172.21.15.177:0/1636634026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8658003b10 0x7f8658003f10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8660009ae0 tx=0x7f866001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1720e7928805ac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:08.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600a6510 con 0x7f8658003b10 2023-11-28T20:08:08.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86600a6670 con 0x7f8658003b10 2023-11-28T20:08:08.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f866dd9b640 1 -- 172.21.15.177:0/1636634026 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600a6a20 con 0x7f8658003b10 2023-11-28T20:08:08.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f8675101640 1 -- 172.21.15.177:0/1636634026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8658003b10 msgr2=0x7f8658003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f8675101640 1 --2- 172.21.15.177:0/1636634026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8658003b10 0x7f8658003f10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8660009ae0 tx=0x7f866001ca20 comp rx=0 tx=0).stop 2023-11-28T20:08:08.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f8675101640 1 -- 172.21.15.177:0/1636634026 shutdown_connections 2023-11-28T20:08:08.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f8675101640 1 --2- 172.21.15.177:0/1636634026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8658003b10 0x7f8658003f10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.412+0000 7f8675101640 1 -- 172.21.15.177:0/1636634026 >> 172.21.15.177:0/1636634026 conn(0x7f867009c4b0 msgr2=0x7f86700d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:08.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f8675101640 1 -- 172.21.15.177:0/1636634026 shutdown_connections 2023-11-28T20:08:08.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f8675101640 1 -- 172.21.15.177:0/1636634026 wait complete. 2023-11-28T20:08:08.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f8675101640 1 Processor -- start 2023-11-28T20:08:08.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f8675101640 1 -- start start 2023-11-28T20:08:08.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f8675101640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8658003b10 0x7f8670150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f8675101640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86700cc3e0 0x7f86700cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f8675101640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86700a04a0 0x7f86700a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f8675101640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86701fb290 con 0x7f86700cc3e0 2023-11-28T20:08:08.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f8675101640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86701fa610 con 0x7f8658003b10 2023-11-28T20:08:08.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f8675101640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86701fa8f0 con 0x7f86700a04a0 2023-11-28T20:08:08.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f866e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86700cc3e0 0x7f86700cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f866e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86700cc3e0 0x7f86700cc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41568/0 (socket says 172.21.15.177:41568) 2023-11-28T20:08:08.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f866e59c640 1 -- 172.21.15.177:0/4241347139 learned_addr learned my addr 172.21.15.177:0/4241347139 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:08.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f866ed9d640 1 --2- 172.21.15.177:0/4241347139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8658003b10 0x7f8670150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f866f59e640 1 --2- 172.21.15.177:0/4241347139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86700a04a0 0x7f86700a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f866e59c640 1 -- 172.21.15.177:0/4241347139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86700a04a0 msgr2=0x7f86700a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f866e59c640 1 --2- 172.21.15.177:0/4241347139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86700a04a0 0x7f86700a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f866e59c640 1 -- 172.21.15.177:0/4241347139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8658003b10 msgr2=0x7f8670150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f866e59c640 1 --2- 172.21.15.177:0/4241347139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8658003b10 0x7f8670150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.416+0000 7f866e59c640 1 -- 172.21.15.177:0/4241347139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86701fabd0 con 0x7f86700cc3e0 2023-11-28T20:08:08.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.420+0000 7f866e59c640 1 --2- 172.21.15.177:0/4241347139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86700cc3e0 0x7f86700cc860 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8664001c30 tx=0x7f866400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:08.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.420+0000 7f86577fe640 1 -- 172.21.15.177:0/4241347139 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866400ee40 con 0x7f86700cc3e0 2023-11-28T20:08:08.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.420+0000 7f86577fe640 1 -- 172.21.15.177:0/4241347139 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866400c8a0 con 0x7f86700cc3e0 2023-11-28T20:08:08.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.420+0000 7f86577fe640 1 -- 172.21.15.177:0/4241347139 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866400cc30 con 0x7f86700cc3e0 2023-11-28T20:08:08.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.420+0000 7f8675101640 1 -- 172.21.15.177:0/4241347139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86701faeb0 con 0x7f86700cc3e0 2023-11-28T20:08:08.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.420+0000 7f8675101640 1 -- 172.21.15.177:0/4241347139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86700ccda0 con 0x7f86700cc3e0 2023-11-28T20:08:08.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.420+0000 7f8675101640 1 -- 172.21.15.177:0/4241347139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86701fb3d0 con 0x7f86700cc3e0 2023-11-28T20:08:08.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.420+0000 7f86577fe640 1 -- 172.21.15.177:0/4241347139 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f866401d460 con 0x7f86700cc3e0 2023-11-28T20:08:08.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.420+0000 7f86577fe640 1 --2- 172.21.15.177:0/4241347139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f865c0664a0 0x7f865c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.420+0000 7f86577fe640 1 -- 172.21.15.177:0/4241347139 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8664083c80 con 0x7f86700cc3e0 2023-11-28T20:08:08.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.420+0000 7f866ed9d640 1 --2- 172.21.15.177:0/4241347139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f865c0664a0 0x7f865c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.424+0000 7f866ed9d640 1 --2- 172.21.15.177:0/4241347139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f865c0664a0 0x7f865c068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f86600af000 tx=0x7f86600046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:08.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.424+0000 7f86577fe640 1 -- 172.21.15.177:0/4241347139 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86701fb3d0 con 0x7f86700cc3e0 2023-11-28T20:08:08.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.580+0000 7f8675101640 1 -- 172.21.15.177:0/4241347139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86701fb3d0 con 0x7f86700cc3e0 2023-11-28T20:08:08.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.580+0000 7f86577fe640 1 -- 172.21.15.177:0/4241347139 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f86701fb3d0 con 0x7f86700cc3e0 2023-11-28T20:08:08.585 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:08.585 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:08.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.584+0000 7f8675101640 1 -- 172.21.15.177:0/4241347139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f865c0664a0 msgr2=0x7f865c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.584+0000 7f8675101640 1 --2- 172.21.15.177:0/4241347139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f865c0664a0 0x7f865c068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f86600af000 tx=0x7f86600046d0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.584+0000 7f8675101640 1 -- 172.21.15.177:0/4241347139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86700cc3e0 msgr2=0x7f86700cc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.584+0000 7f8675101640 1 --2- 172.21.15.177:0/4241347139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86700cc3e0 0x7f86700cc860 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8664001c30 tx=0x7f866400ebf0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.584+0000 7f8675101640 1 -- 172.21.15.177:0/4241347139 shutdown_connections 2023-11-28T20:08:08.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.584+0000 7f8675101640 1 --2- 172.21.15.177:0/4241347139 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f865c0664a0 0x7f865c068960 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.584+0000 7f8675101640 1 --2- 172.21.15.177:0/4241347139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86700a04a0 0x7f86700a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.584+0000 7f8675101640 1 --2- 172.21.15.177:0/4241347139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86700cc3e0 0x7f86700cc860 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.584+0000 7f8675101640 1 --2- 172.21.15.177:0/4241347139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8658003b10 0x7f8670150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.584+0000 7f8675101640 1 -- 172.21.15.177:0/4241347139 >> 172.21.15.177:0/4241347139 conn(0x7f867009c4b0 msgr2=0x7f867006c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:08.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.584+0000 7f8675101640 1 -- 172.21.15.177:0/4241347139 shutdown_connections 2023-11-28T20:08:08.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.584+0000 7f8675101640 1 -- 172.21.15.177:0/4241347139 wait complete. 2023-11-28T20:08:08.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:08.606 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:08.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.744+0000 7f00a0c5a640 1 Processor -- start 2023-11-28T20:08:08.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.744+0000 7f00a0c5a640 1 -- start start 2023-11-28T20:08:08.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.744+0000 7f00a0c5a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f009c071d90 0x7f009c072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.744+0000 7f00a0c5a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f009c15adb0 0x7f009c13d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.744+0000 7f00a0c5a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f009c13d2b0 con 0x7f009c13f5f0 2023-11-28T20:08:08.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.744+0000 7f00a0c5a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f009c140520 con 0x7f009c15adb0 2023-11-28T20:08:08.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.744+0000 7f00a0c5a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f009c0cd7f0 con 0x7f009c071d90 2023-11-28T20:08:08.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.744+0000 7f0091d9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f009c15adb0 0x7f009c13d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.744+0000 7f0091d9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f009c15adb0 0x7f009c13d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33440/0 (socket says 172.21.15.177:33440) 2023-11-28T20:08:08.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.744+0000 7f0091d9b640 1 -- 172.21.15.177:0/3666530940 learned_addr learned my addr 172.21.15.177:0/3666530940 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:08.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.744+0000 7f009a59c640 1 --2- 172.21.15.177:0/3666530940 >> v2:172.21.15.195:3300/0 conn(0x7f009c071d90 0x7f009c072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.744+0000 7f0091d9b640 1 -- 172.21.15.177:0/3666530940 >> v2:172.21.15.195:3300/0 conn(0x7f009c071d90 msgr2=0x7f009c072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:08.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.744+0000 7f0091d9b640 1 --2- 172.21.15.177:0/3666530940 >> v2:172.21.15.195:3300/0 conn(0x7f009c071d90 0x7f009c072170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.744+0000 7f0091d9b640 1 -- 172.21.15.177:0/3666530940 >> v1:172.21.15.195:6789/0 conn(0x7f009c13f5f0 legacy=0x7f009c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:08.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.744+0000 7f0091d9b640 1 -- 172.21.15.177:0/3666530940 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009c0cdd70 con 0x7f009c15adb0 2023-11-28T20:08:08.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.748+0000 7f0091d9b640 1 --2- 172.21.15.177:0/3666530940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009c15adb0 0x7f009c13d560 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f009c0b1d80 tx=0x7f008401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19198db754e838f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.748+0000 7f0099d9b640 1 -- 172.21.15.177:0/3666530940 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840a5850 con 0x7f009c15adb0 2023-11-28T20:08:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.748+0000 7f0099d9b640 1 -- 172.21.15.177:0/3666530940 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00840a59b0 con 0x7f009c15adb0 2023-11-28T20:08:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.748+0000 7f0099d9b640 1 -- 172.21.15.177:0/3666530940 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840a5d40 con 0x7f009c15adb0 2023-11-28T20:08:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.748+0000 7f00a0c5a640 1 -- 172.21.15.177:0/3666530940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009c15adb0 msgr2=0x7f009c13d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.748+0000 7f00a0c5a640 1 --2- 172.21.15.177:0/3666530940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009c15adb0 0x7f009c13d560 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f009c0b1d80 tx=0x7f008401c990 comp rx=0 tx=0).stop 2023-11-28T20:08:08.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.748+0000 7f00a0c5a640 1 -- 172.21.15.177:0/3666530940 shutdown_connections 2023-11-28T20:08:08.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.748+0000 7f00a0c5a640 1 --2- 172.21.15.177:0/3666530940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009c15adb0 0x7f009c13d560 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.748+0000 7f00a0c5a640 1 --2- 172.21.15.177:0/3666530940 >> v2:172.21.15.195:3300/0 conn(0x7f009c071d90 0x7f009c072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.748+0000 7f00a0c5a640 1 -- 172.21.15.177:0/3666530940 >> 172.21.15.177:0/3666530940 conn(0x7f009c0b0cc0 msgr2=0x7f009c0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:08.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.748+0000 7f00a0c5a640 1 -- 172.21.15.177:0/3666530940 shutdown_connections 2023-11-28T20:08:08.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.748+0000 7f00a0c5a640 1 -- 172.21.15.177:0/3666530940 wait complete. 2023-11-28T20:08:08.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f00a0c5a640 1 Processor -- start 2023-11-28T20:08:08.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f00a0c5a640 1 -- start start 2023-11-28T20:08:08.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f00a0c5a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009c071d90 0x7f009c0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f00a0c5a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f009c13f5f0 0x7f009c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f00a0c5a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f009c15adb0 0x7f009c0b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f00a0c5a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c0b26f0 con 0x7f009c071d90 2023-11-28T20:08:08.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f00a0c5a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c0b29d0 con 0x7f009c15adb0 2023-11-28T20:08:08.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f00a0c5a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009c0b2cb0 con 0x7f009c13f5f0 2023-11-28T20:08:08.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f009a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009c071d90 0x7f009c0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f009a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009c071d90 0x7f009c0b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33444/0 (socket says 172.21.15.177:33444) 2023-11-28T20:08:08.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f009a59c640 1 -- 172.21.15.177:0/1714841758 learned_addr learned my addr 172.21.15.177:0/1714841758 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:08.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f009ad9d640 1 --2- 172.21.15.177:0/1714841758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f009c15adb0 0x7f009c0b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f0091d9b640 1 --2- 172.21.15.177:0/1714841758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f009c13f5f0 0x7f009c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f009a59c640 1 -- 172.21.15.177:0/1714841758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f009c13f5f0 msgr2=0x7f009c070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f009a59c640 1 --2- 172.21.15.177:0/1714841758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f009c13f5f0 0x7f009c070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f009a59c640 1 -- 172.21.15.177:0/1714841758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f009c15adb0 msgr2=0x7f009c0b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f009a59c640 1 --2- 172.21.15.177:0/1714841758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f009c15adb0 0x7f009c0b3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f009a59c640 1 -- 172.21.15.177:0/1714841758 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0084009b30 con 0x7f009c071d90 2023-11-28T20:08:08.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f009a59c640 1 --2- 172.21.15.177:0/1714841758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009c071d90 0x7f009c0b1d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c7f0 tx=0x7f008c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:08.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f00937fe640 1 -- 172.21.15.177:0/1714841758 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c007820 con 0x7f009c071d90 2023-11-28T20:08:08.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f00937fe640 1 -- 172.21.15.177:0/1714841758 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c007980 con 0x7f009c071d90 2023-11-28T20:08:08.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f00937fe640 1 -- 172.21.15.177:0/1714841758 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c007d30 con 0x7f009c071d90 2023-11-28T20:08:08.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f00a0c5a640 1 -- 172.21.15.177:0/1714841758 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009c0b2f90 con 0x7f009c071d90 2023-11-28T20:08:08.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.752+0000 7f00a0c5a640 1 -- 172.21.15.177:0/1714841758 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009c0b22c0 con 0x7f009c071d90 2023-11-28T20:08:08.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.756+0000 7f00a0c5a640 1 -- 172.21.15.177:0/1714841758 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f009c0cd9e0 con 0x7f009c071d90 2023-11-28T20:08:08.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.756+0000 7f00937fe640 1 -- 172.21.15.177:0/1714841758 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f008c024480 con 0x7f009c071d90 2023-11-28T20:08:08.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.756+0000 7f00937fe640 1 --2- 172.21.15.177:0/1714841758 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f007c066470 0x7f007c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:08.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.756+0000 7f00937fe640 1 -- 172.21.15.177:0/1714841758 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f008c0841c0 con 0x7f009c071d90 2023-11-28T20:08:08.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.756+0000 7f0091d9b640 1 --2- 172.21.15.177:0/1714841758 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f007c066470 0x7f007c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:08.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.756+0000 7f0091d9b640 1 --2- 172.21.15.177:0/1714841758 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f007c066470 0x7f007c068930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f00840ae000 tx=0x7f00840a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:08.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.760+0000 7f00937fe640 1 -- 172.21.15.177:0/1714841758 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f008c051860 con 0x7f009c071d90 2023-11-28T20:08:08.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.912+0000 7f00a0c5a640 1 -- 172.21.15.177:0/1714841758 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f009c0cd9e0 con 0x7f009c071d90 2023-11-28T20:08:08.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.912+0000 7f00937fe640 1 -- 172.21.15.177:0/1714841758 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f008c01f020 con 0x7f009c071d90 2023-11-28T20:08:08.918 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:08.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.916+0000 7f00a0c5a640 1 -- 172.21.15.177:0/1714841758 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f007c066470 msgr2=0x7f007c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.916+0000 7f00a0c5a640 1 --2- 172.21.15.177:0/1714841758 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f007c066470 0x7f007c068930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f00840ae000 tx=0x7f00840a7070 comp rx=0 tx=0).stop 2023-11-28T20:08:08.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.916+0000 7f00a0c5a640 1 -- 172.21.15.177:0/1714841758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009c071d90 msgr2=0x7f009c0b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:08.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.916+0000 7f00a0c5a640 1 --2- 172.21.15.177:0/1714841758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009c071d90 0x7f009c0b1d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c7f0 tx=0x7f008c00ccb0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.916+0000 7f00a0c5a640 1 -- 172.21.15.177:0/1714841758 shutdown_connections 2023-11-28T20:08:08.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.916+0000 7f00a0c5a640 1 --2- 172.21.15.177:0/1714841758 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f007c066470 0x7f007c068930 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.916+0000 7f00a0c5a640 1 --2- 172.21.15.177:0/1714841758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f009c15adb0 0x7f009c0b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.916+0000 7f00a0c5a640 1 --2- 172.21.15.177:0/1714841758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f009c13f5f0 0x7f009c070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.916+0000 7f00a0c5a640 1 --2- 172.21.15.177:0/1714841758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f009c071d90 0x7f009c0b1d80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:08.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.916+0000 7f00a0c5a640 1 -- 172.21.15.177:0/1714841758 >> 172.21.15.177:0/1714841758 conn(0x7f009c0b0cc0 msgr2=0x7f009c15cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:08.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.916+0000 7f00a0c5a640 1 -- 172.21.15.177:0/1714841758 shutdown_connections 2023-11-28T20:08:08.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:08.916+0000 7f00a0c5a640 1 -- 172.21.15.177:0/1714841758 wait complete. 2023-11-28T20:08:08.939 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:09.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.076+0000 7f45f57f8640 1 Processor -- start 2023-11-28T20:08:09.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.076+0000 7f45f57f8640 1 -- start start 2023-11-28T20:08:09.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.080+0000 7f45f57f8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f45f00ad880 0x7f45f00adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.080+0000 7f45f57f8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f45f006e1f0 0x7f45f015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.080+0000 7f45f57f8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f00ae1a0 con 0x7f45f006dd70 2023-11-28T20:08:09.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.080+0000 7f45f57f8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f006e620 con 0x7f45f006e1f0 2023-11-28T20:08:09.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.080+0000 7f45f57f8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f006c9f0 con 0x7f45f00ad880 2023-11-28T20:08:09.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.080+0000 7f45ef7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f45f006e1f0 0x7f45f015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.080+0000 7f45e67fc640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f45f006dd70 0x7f45f015b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36434/0 (socket says 172.21.15.177:36434) 2023-11-28T20:08:09.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.080+0000 7f45e67fc640 1 -- 172.21.15.177:0/1642196416 learned_addr learned my addr 172.21.15.177:0/1642196416 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:09.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.080+0000 7f45eeffd640 1 --2- 172.21.15.177:0/1642196416 >> v2:172.21.15.195:3300/0 conn(0x7f45f00ad880 0x7f45f00adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.080+0000 7f45ef7fe640 1 -- 172.21.15.177:0/1642196416 >> v2:172.21.15.195:3300/0 conn(0x7f45f00ad880 msgr2=0x7f45f00adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:09.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.080+0000 7f45ef7fe640 1 --2- 172.21.15.177:0/1642196416 >> v2:172.21.15.195:3300/0 conn(0x7f45f00ad880 0x7f45f00adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.080+0000 7f45ef7fe640 1 -- 172.21.15.177:0/1642196416 >> v1:172.21.15.177:6789/0 conn(0x7f45f006dd70 legacy=0x7f45f015b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.080+0000 7f45ef7fe640 1 -- 172.21.15.177:0/1642196416 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f006ccd0 con 0x7f45f006e1f0 2023-11-28T20:08:09.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45ef7fe640 1 --2- 172.21.15.177:0/1642196416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45f006e1f0 0x7f45f015bbb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f45f006bd40 tx=0x7f45e801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ddf3b6fde1db89 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:09.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45ee7fc640 1 -- 172.21.15.177:0/1642196416 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e80a7070 con 0x7f45f006e1f0 2023-11-28T20:08:09.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45ee7fc640 1 -- 172.21.15.177:0/1642196416 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e80ab430 con 0x7f45f006e1f0 2023-11-28T20:08:09.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45ee7fc640 1 -- 172.21.15.177:0/1642196416 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e80ab7c0 con 0x7f45f006e1f0 2023-11-28T20:08:09.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 -- 172.21.15.177:0/1642196416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45f006e1f0 msgr2=0x7f45f015bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 --2- 172.21.15.177:0/1642196416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45f006e1f0 0x7f45f015bbb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f45f006bd40 tx=0x7f45e801c430 comp rx=0 tx=0).stop 2023-11-28T20:08:09.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 -- 172.21.15.177:0/1642196416 shutdown_connections 2023-11-28T20:08:09.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 --2- 172.21.15.177:0/1642196416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45f006e1f0 0x7f45f015bbb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 --2- 172.21.15.177:0/1642196416 >> v2:172.21.15.195:3300/0 conn(0x7f45f00ad880 0x7f45f00adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 -- 172.21.15.177:0/1642196416 >> 172.21.15.177:0/1642196416 conn(0x7f45f00b0920 msgr2=0x7f45f00b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:09.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 -- 172.21.15.177:0/1642196416 shutdown_connections 2023-11-28T20:08:09.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 -- 172.21.15.177:0/1642196416 wait complete. 2023-11-28T20:08:09.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 Processor -- start 2023-11-28T20:08:09.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 -- start start 2023-11-28T20:08:09.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45f006dd70 0x7f45f013d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45f006e1f0 0x7f45f013aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45f00ad880 0x7f45f00afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00cb290 con 0x7f45f00ad880 2023-11-28T20:08:09.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f013c3f0 con 0x7f45f006e1f0 2023-11-28T20:08:09.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.084+0000 7f45f57f8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f013c6d0 con 0x7f45f006dd70 2023-11-28T20:08:09.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45ef7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45f00ad880 0x7f45f00afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45ef7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45f00ad880 0x7f45f00afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33460/0 (socket says 172.21.15.177:33460) 2023-11-28T20:08:09.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45ef7fe640 1 -- 172.21.15.177:0/421636148 learned_addr learned my addr 172.21.15.177:0/421636148 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:09.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45e67fc640 1 --2- 172.21.15.177:0/421636148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45f006e1f0 0x7f45f013aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45eeffd640 1 --2- 172.21.15.177:0/421636148 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45f006dd70 0x7f45f013d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45ef7fe640 1 -- 172.21.15.177:0/421636148 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45f006dd70 msgr2=0x7f45f013d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45ef7fe640 1 --2- 172.21.15.177:0/421636148 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45f006dd70 0x7f45f013d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45ef7fe640 1 -- 172.21.15.177:0/421636148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45f006e1f0 msgr2=0x7f45f013aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45ef7fe640 1 --2- 172.21.15.177:0/421636148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45f006e1f0 0x7f45f013aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45ef7fe640 1 -- 172.21.15.177:0/421636148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e8009420 con 0x7f45f00ad880 2023-11-28T20:08:09.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45ef7fe640 1 --2- 172.21.15.177:0/421636148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45f00ad880 0x7f45f00afad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f45e80ad040 tx=0x7f45e801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:09.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45e7fff640 1 -- 172.21.15.177:0/421636148 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e80bf610 con 0x7f45f00ad880 2023-11-28T20:08:09.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45e7fff640 1 -- 172.21.15.177:0/421636148 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e80bf790 con 0x7f45f00ad880 2023-11-28T20:08:09.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45e7fff640 1 -- 172.21.15.177:0/421636148 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e80bfb40 con 0x7f45f00ad880 2023-11-28T20:08:09.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45f57f8640 1 -- 172.21.15.177:0/421636148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f013c9b0 con 0x7f45f00ad880 2023-11-28T20:08:09.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45f57f8640 1 -- 172.21.15.177:0/421636148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f0143cb0 con 0x7f45f00ad880 2023-11-28T20:08:09.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45f57f8640 1 -- 172.21.15.177:0/421636148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f0143ea0 con 0x7f45f00ad880 2023-11-28T20:08:09.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45e7fff640 1 -- 172.21.15.177:0/421636148 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f45e80b5400 con 0x7f45f00ad880 2023-11-28T20:08:09.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.088+0000 7f45e7fff640 1 --2- 172.21.15.177:0/421636148 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45d0066470 0x7f45d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.092+0000 7f45e7fff640 1 -- 172.21.15.177:0/421636148 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45e811e4e0 con 0x7f45f00ad880 2023-11-28T20:08:09.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.092+0000 7f45eeffd640 1 --2- 172.21.15.177:0/421636148 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45d0066470 0x7f45d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.092+0000 7f45eeffd640 1 --2- 172.21.15.177:0/421636148 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45d0066470 0x7f45d0068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f45e0011340 tx=0x7f45e000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:09.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.092+0000 7f45e7fff640 1 -- 172.21.15.177:0/421636148 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f45e80eba10 con 0x7f45f00ad880 2023-11-28T20:08:09.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.244+0000 7f45f57f8640 1 -- 172.21.15.177:0/421636148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45f013ce60 con 0x7f45f00ad880 2023-11-28T20:08:09.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.244+0000 7f45e7fff640 1 -- 172.21.15.177:0/421636148 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45e80ef030 con 0x7f45f00ad880 2023-11-28T20:08:09.247 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:09.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.244+0000 7f45f57f8640 1 -- 172.21.15.177:0/421636148 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45d0066470 msgr2=0x7f45d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.244+0000 7f45f57f8640 1 --2- 172.21.15.177:0/421636148 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45d0066470 0x7f45d0068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f45e0011340 tx=0x7f45e000b040 comp rx=0 tx=0).stop 2023-11-28T20:08:09.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.244+0000 7f45f57f8640 1 -- 172.21.15.177:0/421636148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45f00ad880 msgr2=0x7f45f00afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.244+0000 7f45f57f8640 1 --2- 172.21.15.177:0/421636148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45f00ad880 0x7f45f00afad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f45e80ad040 tx=0x7f45e801ac70 comp rx=0 tx=0).stop 2023-11-28T20:08:09.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.244+0000 7f45f57f8640 1 -- 172.21.15.177:0/421636148 shutdown_connections 2023-11-28T20:08:09.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.244+0000 7f45f57f8640 1 --2- 172.21.15.177:0/421636148 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45d0066470 0x7f45d0068930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.244+0000 7f45f57f8640 1 --2- 172.21.15.177:0/421636148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45f00ad880 0x7f45f00afad0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.244+0000 7f45f57f8640 1 --2- 172.21.15.177:0/421636148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45f006e1f0 0x7f45f013aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.244+0000 7f45f57f8640 1 --2- 172.21.15.177:0/421636148 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45f006dd70 0x7f45f013d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.244+0000 7f45f57f8640 1 -- 172.21.15.177:0/421636148 >> 172.21.15.177:0/421636148 conn(0x7f45f00b0920 msgr2=0x7f45f00cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:09.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.244+0000 7f45f57f8640 1 -- 172.21.15.177:0/421636148 shutdown_connections 2023-11-28T20:08:09.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.244+0000 7f45f57f8640 1 -- 172.21.15.177:0/421636148 wait complete. 2023-11-28T20:08:09.268 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:09.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.404+0000 7f8d015d1640 1 Processor -- start 2023-11-28T20:08:09.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.404+0000 7f8d015d1640 1 -- start start 2023-11-28T20:08:09.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8d015d1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8cfc071d90 0x7f8cfc072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8d015d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cfc15adb0 0x7f8cfc13d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8d015d1640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cfc13d2b0 con 0x7f8cfc13f5f0 2023-11-28T20:08:09.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8d015d1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc140520 con 0x7f8cfc071d90 2023-11-28T20:08:09.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8d015d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc0cd7f0 con 0x7f8cfc15adb0 2023-11-28T20:08:09.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfb7fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f8cfc13f5f0 0x7f8cfc0ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36436/0 (socket says 172.21.15.177:36436) 2023-11-28T20:08:09.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfb7fe640 1 -- 172.21.15.177:0/1838832588 learned_addr learned my addr 172.21.15.177:0/1838832588 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:09.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfaffd640 1 --2- 172.21.15.177:0/1838832588 >> v2:172.21.15.195:3300/0 conn(0x7f8cfc071d90 0x7f8cfc072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cf27fc640 1 --2- 172.21.15.177:0/1838832588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cfc15adb0 0x7f8cfc13d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 -- 172.21.15.177:0/1838832588 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081225519 0 0) 0x7f8cfc13d2b0 con 0x7f8cfc13f5f0 2023-11-28T20:08:09.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 -- 172.21.15.177:0/1838832588 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce8003530 con 0x7f8cfc13f5f0 2023-11-28T20:08:09.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 -- 172.21.15.177:0/1838832588 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2849060231 0 0) 0x7f8ce8003530 con 0x7f8cfc13f5f0 2023-11-28T20:08:09.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 -- 172.21.15.177:0/1838832588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cfc15adb0 msgr2=0x7f8cfc13d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:09.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 --2- 172.21.15.177:0/1838832588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cfc15adb0 0x7f8cfc13d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 -- 172.21.15.177:0/1838832588 >> v2:172.21.15.195:3300/0 conn(0x7f8cfc071d90 msgr2=0x7f8cfc072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:09.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 --2- 172.21.15.177:0/1838832588 >> v2:172.21.15.195:3300/0 conn(0x7f8cfc071d90 0x7f8cfc072170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 -- 172.21.15.177:0/1838832588 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc0cdd70 con 0x7f8cfc13f5f0 2023-11-28T20:08:09.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 -- 172.21.15.177:0/1838832588 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f8cf4001a00 con 0x7f8cfc13f5f0 2023-11-28T20:08:09.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 -- 172.21.15.177:0/1838832588 >> v1:172.21.15.177:6789/0 conn(0x7f8cfc13f5f0 legacy=0x7f8cfc0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 --2- 172.21.15.177:0/1838832588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cfc15adb0 0x7f8ce8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 --2- 172.21.15.177:0/1838832588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ce8003f00 0x7f8ce80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 --2- 172.21.15.177:0/1838832588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ce8004d10 0x7f8ce8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 -- 172.21.15.177:0/1838832588 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc140520 con 0x7f8ce8003f00 2023-11-28T20:08:09.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 -- 172.21.15.177:0/1838832588 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc0cd7f0 con 0x7f8ce8004d10 2023-11-28T20:08:09.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfa7fc640 1 -- 172.21.15.177:0/1838832588 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce800dba0 con 0x7f8cfc15adb0 2023-11-28T20:08:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cf27fc640 1 --2- 172.21.15.177:0/1838832588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ce8003f00 0x7f8ce80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfb7fe640 1 --2- 172.21.15.177:0/1838832588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ce8004d10 0x7f8ce8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfaffd640 1 --2- 172.21.15.177:0/1838832588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cfc15adb0 0x7f8ce8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cf27fc640 1 -- 172.21.15.177:0/1838832588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cfc15adb0 msgr2=0x7f8ce8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:09.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cf27fc640 1 --2- 172.21.15.177:0/1838832588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cfc15adb0 0x7f8ce8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cf27fc640 1 -- 172.21.15.177:0/1838832588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ce8004d10 msgr2=0x7f8ce8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:09.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cf27fc640 1 --2- 172.21.15.177:0/1838832588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ce8004d10 0x7f8ce8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cf27fc640 1 -- 172.21.15.177:0/1838832588 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce8003530 con 0x7f8ce8003f00 2023-11-28T20:08:09.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.408+0000 7f8cfaffd640 1 --2- 172.21.15.177:0/1838832588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cfc15adb0 0x7f8ce8003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:09.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.412+0000 7f8cf27fc640 1 --2- 172.21.15.177:0/1838832588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ce8003f00 0x7f8ce80047d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009ae0 tx=0x7f8ce401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adc595dc56daed9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:09.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.412+0000 7f8cfa7fc640 1 -- 172.21.15.177:0/1838832588 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40a5530 con 0x7f8ce8003f00 2023-11-28T20:08:09.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.412+0000 7f8cfa7fc640 1 -- 172.21.15.177:0/1838832588 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce40a5690 con 0x7f8ce8003f00 2023-11-28T20:08:09.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.412+0000 7f8cfa7fc640 1 -- 172.21.15.177:0/1838832588 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40a5a40 con 0x7f8ce8003f00 2023-11-28T20:08:09.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.412+0000 7f8d015d1640 1 -- 172.21.15.177:0/1838832588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ce8003f00 msgr2=0x7f8ce80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.412+0000 7f8d015d1640 1 --2- 172.21.15.177:0/1838832588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ce8003f00 0x7f8ce80047d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009ae0 tx=0x7f8ce401c9f0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.412+0000 7f8cfb7fe640 1 -- 172.21.15.177:0/1838832588 reap_dead start 2023-11-28T20:08:09.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.412+0000 7f8d015d1640 1 -- 172.21.15.177:0/1838832588 shutdown_connections 2023-11-28T20:08:09.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.412+0000 7f8d015d1640 1 -- 172.21.15.177:0/1838832588 >> 172.21.15.177:0/1838832588 conn(0x7f8cfc0b0cc0 msgr2=0x7f8cfc0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:09.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.412+0000 7f8d015d1640 1 -- 172.21.15.177:0/1838832588 shutdown_connections 2023-11-28T20:08:09.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.412+0000 7f8d015d1640 1 -- 172.21.15.177:0/1838832588 wait complete. 2023-11-28T20:08:09.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.412+0000 7f8d015d1640 1 Processor -- start 2023-11-28T20:08:09.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.412+0000 7f8d015d1640 1 -- start start 2023-11-28T20:08:09.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8d015d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ce8003f00 0x7f8cfc0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8d015d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cfc0ac840 0x7f8cfc0acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8d015d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cfc1f62f0 0x7f8cfc1f6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8d015d1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc0ad1c0 con 0x7f8ce8003f00 2023-11-28T20:08:09.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8d015d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc1f6cb0 con 0x7f8cfc1f62f0 2023-11-28T20:08:09.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8d015d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc1f2be0 con 0x7f8cfc0ac840 2023-11-28T20:08:09.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8cfaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ce8003f00 0x7f8cfc0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8cfaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ce8003f00 0x7f8cfc0b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33466/0 (socket says 172.21.15.177:33466) 2023-11-28T20:08:09.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8cfaffd640 1 -- 172.21.15.177:0/3403406949 learned_addr learned my addr 172.21.15.177:0/3403406949 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:09.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8cfb7fe640 1 --2- 172.21.15.177:0/3403406949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cfc1f62f0 0x7f8cfc1f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8cf27fc640 1 --2- 172.21.15.177:0/3403406949 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cfc0ac840 0x7f8cfc0acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8cfaffd640 1 -- 172.21.15.177:0/3403406949 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cfc0ac840 msgr2=0x7f8cfc0acc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8cfaffd640 1 --2- 172.21.15.177:0/3403406949 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cfc0ac840 0x7f8cfc0acc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8cfaffd640 1 -- 172.21.15.177:0/3403406949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cfc1f62f0 msgr2=0x7f8cfc1f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8cfaffd640 1 --2- 172.21.15.177:0/3403406949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cfc1f62f0 0x7f8cfc1f6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8cfaffd640 1 -- 172.21.15.177:0/3403406949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc13eca0 con 0x7f8ce8003f00 2023-11-28T20:08:09.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8cfaffd640 1 --2- 172.21.15.177:0/3403406949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ce8003f00 0x7f8cfc0b4d70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009fd0 tx=0x7f8cec011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:09.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8cf3fff640 1 -- 172.21.15.177:0/3403406949 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec004220 con 0x7f8ce8003f00 2023-11-28T20:08:09.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8cf3fff640 1 -- 172.21.15.177:0/3403406949 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec004380 con 0x7f8ce8003f00 2023-11-28T20:08:09.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8d015d1640 1 -- 172.21.15.177:0/3403406949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cfc0b52b0 con 0x7f8ce8003f00 2023-11-28T20:08:09.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8cf3fff640 1 -- 172.21.15.177:0/3403406949 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec00f9e0 con 0x7f8ce8003f00 2023-11-28T20:08:09.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8d015d1640 1 -- 172.21.15.177:0/3403406949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cfc0ad6a0 con 0x7f8ce8003f00 2023-11-28T20:08:09.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.416+0000 7f8d015d1640 1 -- 172.21.15.177:0/3403406949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cfc0693d0 con 0x7f8ce8003f00 2023-11-28T20:08:09.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.420+0000 7f8cf3fff640 1 -- 172.21.15.177:0/3403406949 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8cec00fb40 con 0x7f8ce8003f00 2023-11-28T20:08:09.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.420+0000 7f8cf3fff640 1 --2- 172.21.15.177:0/3403406949 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8cdc066470 0x7f8cdc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.420+0000 7f8cf3fff640 1 -- 172.21.15.177:0/3403406949 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8cec084420 con 0x7f8ce8003f00 2023-11-28T20:08:09.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.420+0000 7f8cf27fc640 1 --2- 172.21.15.177:0/3403406949 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8cdc066470 0x7f8cdc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.420+0000 7f8cf27fc640 1 --2- 172.21.15.177:0/3403406949 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8cdc066470 0x7f8cdc068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40af000 tx=0x7f8ce40046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:09.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.424+0000 7f8cf3fff640 1 -- 172.21.15.177:0/3403406949 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8cec051930 con 0x7f8ce8003f00 2023-11-28T20:08:09.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.576+0000 7f8d015d1640 1 -- 172.21.15.177:0/3403406949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8cfc06e710 con 0x7f8ce8003f00 2023-11-28T20:08:09.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.576+0000 7f8cf3fff640 1 -- 172.21.15.177:0/3403406949 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8cec054f50 con 0x7f8ce8003f00 2023-11-28T20:08:09.581 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:09.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.576+0000 7f8d015d1640 1 -- 172.21.15.177:0/3403406949 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8cdc066470 msgr2=0x7f8cdc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.576+0000 7f8d015d1640 1 --2- 172.21.15.177:0/3403406949 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8cdc066470 0x7f8cdc068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40af000 tx=0x7f8ce40046d0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.576+0000 7f8d015d1640 1 -- 172.21.15.177:0/3403406949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ce8003f00 msgr2=0x7f8cfc0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.576+0000 7f8d015d1640 1 --2- 172.21.15.177:0/3403406949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ce8003f00 0x7f8cfc0b4d70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009fd0 tx=0x7f8cec011b30 comp rx=0 tx=0).stop 2023-11-28T20:08:09.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.576+0000 7f8d015d1640 1 -- 172.21.15.177:0/3403406949 shutdown_connections 2023-11-28T20:08:09.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.576+0000 7f8d015d1640 1 --2- 172.21.15.177:0/3403406949 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8cdc066470 0x7f8cdc068930 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.576+0000 7f8d015d1640 1 --2- 172.21.15.177:0/3403406949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cfc1f62f0 0x7f8cfc1f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.576+0000 7f8d015d1640 1 --2- 172.21.15.177:0/3403406949 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cfc0ac840 0x7f8cfc0acc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.576+0000 7f8d015d1640 1 --2- 172.21.15.177:0/3403406949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ce8003f00 0x7f8cfc0b4d70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.576+0000 7f8d015d1640 1 -- 172.21.15.177:0/3403406949 >> 172.21.15.177:0/3403406949 conn(0x7f8cfc0b0cc0 msgr2=0x7f8cfc15b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:09.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.576+0000 7f8d015d1640 1 -- 172.21.15.177:0/3403406949 shutdown_connections 2023-11-28T20:08:09.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.576+0000 7f8d015d1640 1 -- 172.21.15.177:0/3403406949 wait complete. 2023-11-28T20:08:09.616 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) That a client who does not have the capability for setting 2023-11-28T20:08:09.617 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-11-28T20:08:09.617 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:09.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.751+0000 7f7b80bb8640 1 Processor -- start 2023-11-28T20:08:09.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.751+0000 7f7b80bb8640 1 -- start start 2023-11-28T20:08:09.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.751+0000 7f7b80bb8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7b7c13cf30 0x7f7b7c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.751+0000 7f7b80bb8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b7c15ad40 0x7f7b7c0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.751+0000 7f7b80bb8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7c15b3a0 con 0x7f7b7c06c800 2023-11-28T20:08:09.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.751+0000 7f7b80bb8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7c13d310 con 0x7f7b7c13cf30 2023-11-28T20:08:09.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.751+0000 7f7b80bb8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c15b1b0 con 0x7f7b7c15ad40 2023-11-28T20:08:09.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.751+0000 7f7b73fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f7b7c06c800 0x7f7b7c15a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36448/0 (socket says 172.21.15.177:36448) 2023-11-28T20:08:09.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.751+0000 7f7b73fff640 1 -- 172.21.15.177:0/4047184394 learned_addr learned my addr 172.21.15.177:0/4047184394 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:09.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b7a59c640 1 --2- 172.21.15.177:0/4047184394 >> v2:172.21.15.195:3300/0 conn(0x7f7b7c13cf30 0x7f7b7c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b7ad9d640 1 --2- 172.21.15.177:0/4047184394 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b7c15ad40 0x7f7b7c0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 -- 172.21.15.177:0/4047184394 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794495475 0 0) 0x7f7b7c15b3a0 con 0x7f7b7c06c800 2023-11-28T20:08:09.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 -- 172.21.15.177:0/4047184394 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b68003530 con 0x7f7b7c06c800 2023-11-28T20:08:09.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 -- 172.21.15.177:0/4047184394 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 654013388 0 0) 0x7f7b68003530 con 0x7f7b7c06c800 2023-11-28T20:08:09.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 -- 172.21.15.177:0/4047184394 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b7c15ad40 msgr2=0x7f7b7c0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:09.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 --2- 172.21.15.177:0/4047184394 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b7c15ad40 0x7f7b7c0cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 -- 172.21.15.177:0/4047184394 >> v2:172.21.15.195:3300/0 conn(0x7f7b7c13cf30 msgr2=0x7f7b7c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 --2- 172.21.15.177:0/4047184394 >> v2:172.21.15.195:3300/0 conn(0x7f7b7c13cf30 0x7f7b7c06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 -- 172.21.15.177:0/4047184394 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c13f720 con 0x7f7b7c06c800 2023-11-28T20:08:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 -- 172.21.15.177:0/4047184394 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f7b64001680 con 0x7f7b7c06c800 2023-11-28T20:08:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b7a59c640 1 --2- 172.21.15.177:0/4047184394 >> v2:172.21.15.195:3300/0 conn(0x7f7b7c13cf30 0x7f7b7c06c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 -- 172.21.15.177:0/4047184394 >> v1:172.21.15.177:6789/0 conn(0x7f7b7c06c800 legacy=0x7f7b7c15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 --2- 172.21.15.177:0/4047184394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b68003980 0x7f7b68003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 --2- 172.21.15.177:0/4047184394 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b7c15ad40 0x7f7b680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 --2- 172.21.15.177:0/4047184394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b68004d10 0x7f7b68005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 -- 172.21.15.177:0/4047184394 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6800dba0 con 0x7f7b68003980 2023-11-28T20:08:09.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 -- 172.21.15.177:0/4047184394 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6800dd10 con 0x7f7b68004d10 2023-11-28T20:08:09.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b79d9b640 1 -- 172.21.15.177:0/4047184394 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6800ded0 con 0x7f7b7c15ad40 2023-11-28T20:08:09.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b7a59c640 1 --2- 172.21.15.177:0/4047184394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b68003980 0x7f7b68003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b7ad9d640 1 --2- 172.21.15.177:0/4047184394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b68004d10 0x7f7b68005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b73fff640 1 --2- 172.21.15.177:0/4047184394 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b7c15ad40 0x7f7b680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b7a59c640 1 -- 172.21.15.177:0/4047184394 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b7c15ad40 msgr2=0x7f7b680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:09.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b7a59c640 1 --2- 172.21.15.177:0/4047184394 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b7c15ad40 0x7f7b680047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b7a59c640 1 -- 172.21.15.177:0/4047184394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b68004d10 msgr2=0x7f7b68005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:09.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b7a59c640 1 --2- 172.21.15.177:0/4047184394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b68004d10 0x7f7b68005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b7a59c640 1 -- 172.21.15.177:0/4047184394 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b68003530 con 0x7f7b68003980 2023-11-28T20:08:09.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.755+0000 7f7b7ad9d640 1 --2- 172.21.15.177:0/4047184394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b68004d10 0x7f7b68005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:09.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b7a59c640 1 --2- 172.21.15.177:0/4047184394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b68003980 0x7f7b68003da0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0098d0 tx=0x7f7b6c01c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1bc043276bf4cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:09.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b79d9b640 1 -- 172.21.15.177:0/4047184394 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0ad660 con 0x7f7b68003980 2023-11-28T20:08:09.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b79d9b640 1 -- 172.21.15.177:0/4047184394 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c0ad7c0 con 0x7f7b68003980 2023-11-28T20:08:09.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b79d9b640 1 -- 172.21.15.177:0/4047184394 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0adb30 con 0x7f7b68003980 2023-11-28T20:08:09.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b80bb8640 1 -- 172.21.15.177:0/4047184394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b68003980 msgr2=0x7f7b68003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b80bb8640 1 --2- 172.21.15.177:0/4047184394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b68003980 0x7f7b68003da0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0098d0 tx=0x7f7b6c01c630 comp rx=0 tx=0).stop 2023-11-28T20:08:09.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b7ad9d640 1 -- 172.21.15.177:0/4047184394 reap_dead start 2023-11-28T20:08:09.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b80bb8640 1 -- 172.21.15.177:0/4047184394 shutdown_connections 2023-11-28T20:08:09.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b80bb8640 1 -- 172.21.15.177:0/4047184394 >> 172.21.15.177:0/4047184394 conn(0x7f7b7c06a530 msgr2=0x7f7b7c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:09.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b80bb8640 1 -- 172.21.15.177:0/4047184394 shutdown_connections 2023-11-28T20:08:09.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b80bb8640 1 -- 172.21.15.177:0/4047184394 wait complete. 2023-11-28T20:08:09.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b80bb8640 1 Processor -- start 2023-11-28T20:08:09.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b80bb8640 1 -- start start 2023-11-28T20:08:09.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b80bb8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b68003980 0x7f7b7c0b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b80bb8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b7c154b30 0x7f7b7c138100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b80bb8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b7c13e900 0x7f7b7c13edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b80bb8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c13f2f0 con 0x7f7b7c154b30 2023-11-28T20:08:09.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b80bb8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c138640 con 0x7f7b7c13e900 2023-11-28T20:08:09.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.759+0000 7f7b80bb8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c155030 con 0x7f7b68003980 2023-11-28T20:08:09.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b73fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b7c154b30 0x7f7b7c138100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b73fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b7c154b30 0x7f7b7c138100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33480/0 (socket says 172.21.15.177:33480) 2023-11-28T20:08:09.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b73fff640 1 -- 172.21.15.177:0/3649480436 learned_addr learned my addr 172.21.15.177:0/3649480436 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:09.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b7a59c640 1 --2- 172.21.15.177:0/3649480436 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b68003980 0x7f7b7c0b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b7ad9d640 1 --2- 172.21.15.177:0/3649480436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b7c13e900 0x7f7b7c13edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b73fff640 1 -- 172.21.15.177:0/3649480436 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b68003980 msgr2=0x7f7b7c0b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b73fff640 1 --2- 172.21.15.177:0/3649480436 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b68003980 0x7f7b7c0b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b73fff640 1 -- 172.21.15.177:0/3649480436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b7c13e900 msgr2=0x7f7b7c13edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b73fff640 1 --2- 172.21.15.177:0/3649480436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b7c13e900 0x7f7b7c13edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b73fff640 1 -- 172.21.15.177:0/3649480436 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c155310 con 0x7f7b7c154b30 2023-11-28T20:08:09.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b73fff640 1 --2- 172.21.15.177:0/3649480436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b7c154b30 0x7f7b7c138100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7b64001ec0 tx=0x7f7b6400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:09.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b72ffd640 1 -- 172.21.15.177:0/3649480436 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400c8d0 con 0x7f7b7c154b30 2023-11-28T20:08:09.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b72ffd640 1 -- 172.21.15.177:0/3649480436 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6400ca50 con 0x7f7b7c154b30 2023-11-28T20:08:09.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b72ffd640 1 -- 172.21.15.177:0/3649480436 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400ce00 con 0x7f7b7c154b30 2023-11-28T20:08:09.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b80bb8640 1 -- 172.21.15.177:0/3649480436 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7c1555f0 con 0x7f7b7c154b30 2023-11-28T20:08:09.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b80bb8640 1 -- 172.21.15.177:0/3649480436 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7c155bb0 con 0x7f7b7c154b30 2023-11-28T20:08:09.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b80bb8640 1 -- 172.21.15.177:0/3649480436 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7c069440 con 0x7f7b7c154b30 2023-11-28T20:08:09.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.763+0000 7f7b72ffd640 1 -- 172.21.15.177:0/3649480436 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b6401d460 con 0x7f7b7c154b30 2023-11-28T20:08:09.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.767+0000 7f7b72ffd640 1 --2- 172.21.15.177:0/3649480436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7b5c0664a0 0x7f7b5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:09.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.767+0000 7f7b72ffd640 1 -- 172.21.15.177:0/3649480436 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b64083f10 con 0x7f7b7c154b30 2023-11-28T20:08:09.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.767+0000 7f7b7a59c640 1 --2- 172.21.15.177:0/3649480436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7b5c0664a0 0x7f7b5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:09.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.767+0000 7f7b7a59c640 1 --2- 172.21.15.177:0/3649480436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7b5c0664a0 0x7f7b5c068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0af000 tx=0x7f7b6c0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:09.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.771+0000 7f7b72ffd640 1 -- 172.21.15.177:0/3649480436 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b64051380 con 0x7f7b7c154b30 2023-11-28T20:08:09.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.919+0000 7f7b80bb8640 1 -- 172.21.15.177:0/3649480436 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b7c155d70 con 0x7f7b7c154b30 2023-11-28T20:08:09.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.919+0000 7f7b72ffd640 1 -- 172.21.15.177:0/3649480436 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f7b640549a0 con 0x7f7b7c154b30 2023-11-28T20:08:09.925 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:09.925 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:09.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.923+0000 7f7b80bb8640 1 -- 172.21.15.177:0/3649480436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7b5c0664a0 msgr2=0x7f7b5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.923+0000 7f7b80bb8640 1 --2- 172.21.15.177:0/3649480436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7b5c0664a0 0x7f7b5c068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0af000 tx=0x7f7b6c0046d0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.923+0000 7f7b80bb8640 1 -- 172.21.15.177:0/3649480436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b7c154b30 msgr2=0x7f7b7c138100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:09.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.923+0000 7f7b80bb8640 1 --2- 172.21.15.177:0/3649480436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b7c154b30 0x7f7b7c138100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7b64001ec0 tx=0x7f7b6400ed50 comp rx=0 tx=0).stop 2023-11-28T20:08:09.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.923+0000 7f7b80bb8640 1 -- 172.21.15.177:0/3649480436 shutdown_connections 2023-11-28T20:08:09.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.923+0000 7f7b80bb8640 1 --2- 172.21.15.177:0/3649480436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7b5c0664a0 0x7f7b5c068960 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.923+0000 7f7b80bb8640 1 --2- 172.21.15.177:0/3649480436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b7c13e900 0x7f7b7c13edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.923+0000 7f7b80bb8640 1 --2- 172.21.15.177:0/3649480436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b7c154b30 0x7f7b7c138100 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.923+0000 7f7b80bb8640 1 --2- 172.21.15.177:0/3649480436 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b68003980 0x7f7b7c0b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:09.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.923+0000 7f7b80bb8640 1 -- 172.21.15.177:0/3649480436 >> 172.21.15.177:0/3649480436 conn(0x7f7b7c06a530 msgr2=0x7f7b7c15be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:09.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.923+0000 7f7b80bb8640 1 -- 172.21.15.177:0/3649480436 shutdown_connections 2023-11-28T20:08:09.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:09.923+0000 7f7b80bb8640 1 -- 172.21.15.177:0/3649480436 wait complete. 2023-11-28T20:08:09.929 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:08:09.934 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:08:09.947 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:09.948 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:10.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.151+0000 7faaaa6dd640 1 Processor -- start 2023-11-28T20:08:10.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.151+0000 7faaaa6dd640 1 -- start start 2023-11-28T20:08:10.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.155+0000 7faaaa6dd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaa4158ca0 0x7faaa415eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.155+0000 7faaaa6dd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faaa40b42d0 0x7faaa40b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.155+0000 7faaaa6dd640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa40b4c40 con 0x7faaa40cba10 2023-11-28T20:08:10.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.155+0000 7faaaa6dd640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa415b670 con 0x7faaa40b42d0 2023-11-28T20:08:10.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.155+0000 7faaaa6dd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415c510 con 0x7faaa4158ca0 2023-11-28T20:08:10.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.155+0000 7faaa3fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaa4158ca0 0x7faaa415eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.155+0000 7faaa8c7a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faaa40b42d0 0x7faaa40b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.155+0000 7faaa3fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaa4158ca0 0x7faaa415eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:60372/0 (socket says 172.21.15.177:60372) 2023-11-28T20:08:10.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.155+0000 7faaa3fff640 1 -- 172.21.15.177:0/3521751209 learned_addr learned my addr 172.21.15.177:0/3521751209 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:10.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.155+0000 7faaa37fe640 1 --1- 172.21.15.177:0/3521751209 >> v1:172.21.15.195:6789/0 conn(0x7faaa40cba10 0x7faaa415be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:43606/0 (socket says 172.21.15.177:43606) 2023-11-28T20:08:10.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.155+0000 7faaa2ffd640 1 -- 172.21.15.177:0/3521751209 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027694515 0 0) 0x7faaa40b4c40 con 0x7faaa40cba10 2023-11-28T20:08:10.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.155+0000 7faaa3fff640 1 -- 172.21.15.177:0/3521751209 >> v2:172.21.15.195:3300/0 conn(0x7faaa40b42d0 msgr2=0x7faaa40b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:10.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.155+0000 7faaa3fff640 1 --2- 172.21.15.177:0/3521751209 >> v2:172.21.15.195:3300/0 conn(0x7faaa40b42d0 0x7faaa40b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.155+0000 7faaa3fff640 1 -- 172.21.15.177:0/3521751209 >> v1:172.21.15.195:6789/0 conn(0x7faaa40cba10 legacy=0x7faaa415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.155+0000 7faaa3fff640 1 -- 172.21.15.177:0/3521751209 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa415f410 con 0x7faaa4158ca0 2023-11-28T20:08:10.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.159+0000 7faaa3fff640 1 --2- 172.21.15.177:0/3521751209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaa4158ca0 0x7faaa415eb50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faa94009870 tx=0x7faa9401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d52632fea9266431 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:10.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.159+0000 7faaa2ffd640 1 -- 172.21.15.177:0/3521751209 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940aa670 con 0x7faaa4158ca0 2023-11-28T20:08:10.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.159+0000 7faaa2ffd640 1 -- 172.21.15.177:0/3521751209 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa940aa7d0 con 0x7faaa4158ca0 2023-11-28T20:08:10.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.159+0000 7faaa2ffd640 1 -- 172.21.15.177:0/3521751209 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940aab60 con 0x7faaa4158ca0 2023-11-28T20:08:10.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.159+0000 7faaaa6dd640 1 -- 172.21.15.177:0/3521751209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaa4158ca0 msgr2=0x7faaa415eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.159+0000 7faaaa6dd640 1 --2- 172.21.15.177:0/3521751209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaa4158ca0 0x7faaa415eb50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faa94009870 tx=0x7faa9401c510 comp rx=0 tx=0).stop 2023-11-28T20:08:10.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.159+0000 7faaaa6dd640 1 -- 172.21.15.177:0/3521751209 shutdown_connections 2023-11-28T20:08:10.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.159+0000 7faaaa6dd640 1 --2- 172.21.15.177:0/3521751209 >> v2:172.21.15.195:3300/0 conn(0x7faaa40b42d0 0x7faaa40b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.159+0000 7faaaa6dd640 1 --2- 172.21.15.177:0/3521751209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaa4158ca0 0x7faaa415eb50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.159+0000 7faaaa6dd640 1 -- 172.21.15.177:0/3521751209 >> 172.21.15.177:0/3521751209 conn(0x7faaa40b0cc0 msgr2=0x7faaa40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:10.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.159+0000 7faaaa6dd640 1 -- 172.21.15.177:0/3521751209 shutdown_connections 2023-11-28T20:08:10.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.159+0000 7faaaa6dd640 1 -- 172.21.15.177:0/3521751209 wait complete. 2023-11-28T20:08:10.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.159+0000 7faaaa6dd640 1 Processor -- start 2023-11-28T20:08:10.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaaa6dd640 1 -- start start 2023-11-28T20:08:10.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaaa6dd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaa40b42d0 0x7faaa40b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaaa6dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaa40cba10 0x7faaa414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaaa6dd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa4158ca0 0x7faaa4151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaaa6dd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa4160230 con 0x7faaa40cba10 2023-11-28T20:08:10.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaaa6dd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415ff50 con 0x7faaa4158ca0 2023-11-28T20:08:10.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaaa6dd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa4150660 con 0x7faaa40b42d0 2023-11-28T20:08:10.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaa37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaa40cba10 0x7faaa414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaa37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaa40cba10 0x7faaa414d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33482/0 (socket says 172.21.15.177:33482) 2023-11-28T20:08:10.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaa37fe640 1 -- 172.21.15.177:0/1504047802 learned_addr learned my addr 172.21.15.177:0/1504047802 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:10.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaa8c7a640 1 --2- 172.21.15.177:0/1504047802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa4158ca0 0x7faaa4151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaa3fff640 1 --2- 172.21.15.177:0/1504047802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaa40b42d0 0x7faaa40b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaa37fe640 1 -- 172.21.15.177:0/1504047802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaa40b42d0 msgr2=0x7faaa40b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaa37fe640 1 --2- 172.21.15.177:0/1504047802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaa40b42d0 0x7faaa40b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaa37fe640 1 -- 172.21.15.177:0/1504047802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa4158ca0 msgr2=0x7faaa4151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaa37fe640 1 --2- 172.21.15.177:0/1504047802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa4158ca0 0x7faaa4151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaa37fe640 1 -- 172.21.15.177:0/1504047802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa940094d0 con 0x7faaa40cba10 2023-11-28T20:08:10.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaa37fe640 1 --2- 172.21.15.177:0/1504047802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaa40cba10 0x7faaa414d0c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faa9800c3e0 tx=0x7faa9800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:10.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaa0ff9640 1 -- 172.21.15.177:0/1504047802 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa980074e0 con 0x7faaa40cba10 2023-11-28T20:08:10.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaa0ff9640 1 -- 172.21.15.177:0/1504047802 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa98007640 con 0x7faaa40cba10 2023-11-28T20:08:10.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaaa6dd640 1 -- 172.21.15.177:0/1504047802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa4150940 con 0x7faaa40cba10 2023-11-28T20:08:10.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaa0ff9640 1 -- 172.21.15.177:0/1504047802 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98004a30 con 0x7faaa40cba10 2023-11-28T20:08:10.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaaa6dd640 1 -- 172.21.15.177:0/1504047802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa415fc20 con 0x7faaa40cba10 2023-11-28T20:08:10.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.163+0000 7faaaa6dd640 1 -- 172.21.15.177:0/1504047802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa41504c0 con 0x7faaa40cba10 2023-11-28T20:08:10.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.167+0000 7faaa0ff9640 1 -- 172.21.15.177:0/1504047802 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa98004b90 con 0x7faaa40cba10 2023-11-28T20:08:10.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.167+0000 7faaa0ff9640 1 --2- 172.21.15.177:0/1504047802 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faa90066470 0x7faa90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.167+0000 7faaa0ff9640 1 -- 172.21.15.177:0/1504047802 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa980838b0 con 0x7faaa40cba10 2023-11-28T20:08:10.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.167+0000 7faaa3fff640 1 --2- 172.21.15.177:0/1504047802 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faa90066470 0x7faa90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.167+0000 7faaa3fff640 1 --2- 172.21.15.177:0/1504047802 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faa90066470 0x7faa90068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faa940ae000 tx=0x7faa940a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:10.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.171+0000 7faaa0ff9640 1 -- 172.21.15.177:0/1504047802 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faaa41504c0 con 0x7faaa40cba10 2023-11-28T20:08:10.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.319+0000 7faaaa6dd640 1 -- 172.21.15.177:0/1504047802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faaa41504c0 con 0x7faaa40cba10 2023-11-28T20:08:10.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.319+0000 7faaa0ff9640 1 -- 172.21.15.177:0/1504047802 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7faaa41504c0 con 0x7faaa40cba10 2023-11-28T20:08:10.326 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:10.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.323+0000 7faaaa6dd640 1 -- 172.21.15.177:0/1504047802 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faa90066470 msgr2=0x7faa90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.323+0000 7faaaa6dd640 1 --2- 172.21.15.177:0/1504047802 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faa90066470 0x7faa90068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faa940ae000 tx=0x7faa940a7000 comp rx=0 tx=0).stop 2023-11-28T20:08:10.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.323+0000 7faaaa6dd640 1 -- 172.21.15.177:0/1504047802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaa40cba10 msgr2=0x7faaa414d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.323+0000 7faaaa6dd640 1 --2- 172.21.15.177:0/1504047802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaa40cba10 0x7faaa414d0c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faa9800c3e0 tx=0x7faa9800c8a0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.323+0000 7faaaa6dd640 1 -- 172.21.15.177:0/1504047802 shutdown_connections 2023-11-28T20:08:10.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.323+0000 7faaaa6dd640 1 --2- 172.21.15.177:0/1504047802 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faa90066470 0x7faa90068930 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.323+0000 7faaaa6dd640 1 --2- 172.21.15.177:0/1504047802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa4158ca0 0x7faaa4151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.323+0000 7faaaa6dd640 1 --2- 172.21.15.177:0/1504047802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaa40cba10 0x7faaa414d0c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.323+0000 7faaaa6dd640 1 --2- 172.21.15.177:0/1504047802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaa40b42d0 0x7faaa40b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.323+0000 7faaaa6dd640 1 -- 172.21.15.177:0/1504047802 >> 172.21.15.177:0/1504047802 conn(0x7faaa40b0cc0 msgr2=0x7faaa4159d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:10.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.323+0000 7faaaa6dd640 1 -- 172.21.15.177:0/1504047802 shutdown_connections 2023-11-28T20:08:10.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.323+0000 7faaaa6dd640 1 -- 172.21.15.177:0/1504047802 wait complete. 2023-11-28T20:08:10.346 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:10.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.487+0000 7f70e3172640 1 Processor -- start 2023-11-28T20:08:10.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.487+0000 7f70e3172640 1 -- start start 2023-11-28T20:08:10.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.487+0000 7f70e3172640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f70dc0ae830 0x7f70dc1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.487+0000 7f70e3172640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70dc071600 con 0x7f70dc0703f0 2023-11-28T20:08:10.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.491+0000 7f70e3172640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70dc0718e0 con 0x7f70dc15d1d0 2023-11-28T20:08:10.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.491+0000 7f70e3172640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70dc071bc0 con 0x7f70dc0ae830 2023-11-28T20:08:10.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.491+0000 7f70e170f640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f70dc0703f0 0x7f70dc070840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36456/0 (socket says 172.21.15.177:36456) 2023-11-28T20:08:10.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.491+0000 7f70e170f640 1 -- 172.21.15.177:0/2539070087 learned_addr learned my addr 172.21.15.177:0/2539070087 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:10.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.491+0000 7f70e0f0e640 1 --2- 172.21.15.177:0/2539070087 >> v2:172.21.15.195:3300/0 conn(0x7f70dc0ae830 0x7f70dc1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.491+0000 7f70d37fe640 1 -- 172.21.15.177:0/2539070087 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498764864 0 0) 0x7f70dc071600 con 0x7f70dc0703f0 2023-11-28T20:08:10.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.491+0000 7f70d37fe640 1 -- 172.21.15.177:0/2539070087 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70c4003530 con 0x7f70dc0703f0 2023-11-28T20:08:10.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.491+0000 7f70e0f0e640 1 -- 172.21.15.177:0/2539070087 >> v1:172.21.15.195:6789/0 conn(0x7f70dc15d1d0 legacy=0x7f70dc15d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.491+0000 7f70e0f0e640 1 -- 172.21.15.177:0/2539070087 >> v1:172.21.15.177:6789/0 conn(0x7f70dc0703f0 legacy=0x7f70dc070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.491+0000 7f70e0f0e640 1 -- 172.21.15.177:0/2539070087 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc071ea0 con 0x7f70dc0ae830 2023-11-28T20:08:10.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.491+0000 7f70e0f0e640 1 --2- 172.21.15.177:0/2539070087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70dc0ae830 0x7f70dc1571d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f70d80097c0 tx=0x7f70d801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f18940cd0dd96c26 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:10.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70d37fe640 1 -- 172.21.15.177:0/2539070087 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d80a8050 con 0x7f70dc0ae830 2023-11-28T20:08:10.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70d37fe640 1 -- 172.21.15.177:0/2539070087 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d80ac5f0 con 0x7f70dc0ae830 2023-11-28T20:08:10.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70d37fe640 1 -- 172.21.15.177:0/2539070087 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d80ac960 con 0x7f70dc0ae830 2023-11-28T20:08:10.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e3172640 1 -- 172.21.15.177:0/2539070087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70dc0ae830 msgr2=0x7f70dc1571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e3172640 1 --2- 172.21.15.177:0/2539070087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70dc0ae830 0x7f70dc1571d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f70d80097c0 tx=0x7f70d801c480 comp rx=0 tx=0).stop 2023-11-28T20:08:10.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e3172640 1 -- 172.21.15.177:0/2539070087 shutdown_connections 2023-11-28T20:08:10.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e3172640 1 --2- 172.21.15.177:0/2539070087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70dc0ae830 0x7f70dc1571d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e3172640 1 -- 172.21.15.177:0/2539070087 >> 172.21.15.177:0/2539070087 conn(0x7f70dc0b0cc0 msgr2=0x7f70dc0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:10.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e3172640 1 -- 172.21.15.177:0/2539070087 shutdown_connections 2023-11-28T20:08:10.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e3172640 1 -- 172.21.15.177:0/2539070087 wait complete. 2023-11-28T20:08:10.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e3172640 1 Processor -- start 2023-11-28T20:08:10.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e3172640 1 -- start start 2023-11-28T20:08:10.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e3172640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70dc0703f0 0x7f70dc141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e3172640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70dc0ae830 0x7f70dc158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e3172640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc15d1d0 0x7f70dc158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e3172640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc0ae180 con 0x7f70dc15d1d0 2023-11-28T20:08:10.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e3172640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc0ad500 con 0x7f70dc0703f0 2023-11-28T20:08:10.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e3172640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc0ad7e0 con 0x7f70dc0ae830 2023-11-28T20:08:10.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e170f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc15d1d0 0x7f70dc158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e170f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc15d1d0 0x7f70dc158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33488/0 (socket says 172.21.15.177:33488) 2023-11-28T20:08:10.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e170f640 1 -- 172.21.15.177:0/1400578975 learned_addr learned my addr 172.21.15.177:0/1400578975 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:10.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70e0f0e640 1 --2- 172.21.15.177:0/1400578975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70dc0703f0 0x7f70dc141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.495+0000 7f70d3fff640 1 --2- 172.21.15.177:0/1400578975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70dc0ae830 0x7f70dc158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70e170f640 1 -- 172.21.15.177:0/1400578975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70dc0ae830 msgr2=0x7f70dc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70e170f640 1 --2- 172.21.15.177:0/1400578975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70dc0ae830 0x7f70dc158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70e170f640 1 -- 172.21.15.177:0/1400578975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70dc0703f0 msgr2=0x7f70dc141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70e170f640 1 --2- 172.21.15.177:0/1400578975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70dc0703f0 0x7f70dc141940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70e170f640 1 -- 172.21.15.177:0/1400578975 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d8009420 con 0x7f70dc15d1d0 2023-11-28T20:08:10.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70e170f640 1 --2- 172.21.15.177:0/1400578975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc15d1d0 0x7f70dc158650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f70d400cb40 tx=0x7f70d400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:10.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70d17fa640 1 -- 172.21.15.177:0/1400578975 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d400aca0 con 0x7f70dc15d1d0 2023-11-28T20:08:10.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70d17fa640 1 -- 172.21.15.177:0/1400578975 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d400ae00 con 0x7f70dc15d1d0 2023-11-28T20:08:10.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70e3172640 1 -- 172.21.15.177:0/1400578975 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70dc0adac0 con 0x7f70dc15d1d0 2023-11-28T20:08:10.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70d17fa640 1 -- 172.21.15.177:0/1400578975 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4012620 con 0x7f70dc15d1d0 2023-11-28T20:08:10.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70e3172640 1 -- 172.21.15.177:0/1400578975 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70dc141e80 con 0x7f70dc15d1d0 2023-11-28T20:08:10.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70e3172640 1 -- 172.21.15.177:0/1400578975 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70dc0693d0 con 0x7f70dc15d1d0 2023-11-28T20:08:10.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70d17fa640 1 -- 172.21.15.177:0/1400578975 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f70d4007070 con 0x7f70dc15d1d0 2023-11-28T20:08:10.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70d17fa640 1 --2- 172.21.15.177:0/1400578975 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70c80664a0 0x7f70c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70d17fa640 1 -- 172.21.15.177:0/1400578975 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70d4083de0 con 0x7f70dc15d1d0 2023-11-28T20:08:10.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.499+0000 7f70e0f0e640 1 --2- 172.21.15.177:0/1400578975 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70c80664a0 0x7f70c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.503+0000 7f70e0f0e640 1 --2- 172.21.15.177:0/1400578975 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70c80664a0 0x7f70c8068960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f70d80ae000 tx=0x7f70d80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:10.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.503+0000 7f70d17fa640 1 -- 172.21.15.177:0/1400578975 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f70d4051310 con 0x7f70dc15d1d0 2023-11-28T20:08:10.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.655+0000 7f70e3172640 1 -- 172.21.15.177:0/1400578975 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70dc157bf0 con 0x7f70dc15d1d0 2023-11-28T20:08:10.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.655+0000 7f70d17fa640 1 -- 172.21.15.177:0/1400578975 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70d4054930 con 0x7f70dc15d1d0 2023-11-28T20:08:10.659 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:10.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.655+0000 7f70e3172640 1 -- 172.21.15.177:0/1400578975 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70c80664a0 msgr2=0x7f70c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.655+0000 7f70e3172640 1 --2- 172.21.15.177:0/1400578975 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70c80664a0 0x7f70c8068960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f70d80ae000 tx=0x7f70d80a7000 comp rx=0 tx=0).stop 2023-11-28T20:08:10.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.655+0000 7f70e3172640 1 -- 172.21.15.177:0/1400578975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc15d1d0 msgr2=0x7f70dc158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.655+0000 7f70e3172640 1 --2- 172.21.15.177:0/1400578975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc15d1d0 0x7f70dc158650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f70d400cb40 tx=0x7f70d400a060 comp rx=0 tx=0).stop 2023-11-28T20:08:10.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.655+0000 7f70e3172640 1 -- 172.21.15.177:0/1400578975 shutdown_connections 2023-11-28T20:08:10.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.655+0000 7f70e3172640 1 --2- 172.21.15.177:0/1400578975 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70c80664a0 0x7f70c8068960 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.655+0000 7f70e3172640 1 --2- 172.21.15.177:0/1400578975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc15d1d0 0x7f70dc158650 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.655+0000 7f70e3172640 1 --2- 172.21.15.177:0/1400578975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70dc0ae830 0x7f70dc158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.655+0000 7f70e3172640 1 --2- 172.21.15.177:0/1400578975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70dc0703f0 0x7f70dc141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.655+0000 7f70e3172640 1 -- 172.21.15.177:0/1400578975 >> 172.21.15.177:0/1400578975 conn(0x7f70dc0b0cc0 msgr2=0x7f70dc15c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:10.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.655+0000 7f70e3172640 1 -- 172.21.15.177:0/1400578975 shutdown_connections 2023-11-28T20:08:10.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.655+0000 7f70e3172640 1 -- 172.21.15.177:0/1400578975 wait complete. 2023-11-28T20:08:10.680 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:10.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f9383f72640 1 Processor -- start 2023-11-28T20:08:10.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f9383f72640 1 -- start start 2023-11-28T20:08:10.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f9383f72640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f937c158ca0 0x7f937c15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f9383f72640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f937c0cba10 0x7f937c15be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f9383f72640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f937c15b670 con 0x7f937c0b42d0 2023-11-28T20:08:10.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f9383f72640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937c15f410 con 0x7f937c0cba10 2023-11-28T20:08:10.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f9383f72640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937c15f6f0 con 0x7f937c158ca0 2023-11-28T20:08:10.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f938150d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f937c0cba10 0x7f937c15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f938150d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f937c0cba10 0x7f937c15be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33490/0 (socket says 172.21.15.177:33490) 2023-11-28T20:08:10.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f938250f640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f937c0b42d0 0x7f937c0703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36472/0 (socket says 172.21.15.177:36472) 2023-11-28T20:08:10.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f938150d640 1 -- 172.21.15.177:0/105332738 learned_addr learned my addr 172.21.15.177:0/105332738 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:10.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f9381d0e640 1 --2- 172.21.15.177:0/105332738 >> v2:172.21.15.195:3300/0 conn(0x7f937c158ca0 0x7f937c15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f938150d640 1 -- 172.21.15.177:0/105332738 >> v2:172.21.15.195:3300/0 conn(0x7f937c158ca0 msgr2=0x7f937c15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:10.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f938150d640 1 --2- 172.21.15.177:0/105332738 >> v2:172.21.15.195:3300/0 conn(0x7f937c158ca0 0x7f937c15eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f938150d640 1 -- 172.21.15.177:0/105332738 >> v1:172.21.15.177:6789/0 conn(0x7f937c0b42d0 legacy=0x7f937c0703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.815+0000 7f938150d640 1 -- 172.21.15.177:0/105332738 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c15b8e0 con 0x7f937c0cba10 2023-11-28T20:08:10.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.819+0000 7f938150d640 1 --2- 172.21.15.177:0/105332738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f937c0cba10 0x7f937c15be00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f937c067f70 tx=0x7f936c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8486a29d345fef4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:10.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.819+0000 7f9380d0c640 1 -- 172.21.15.177:0/105332738 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c0aa680 con 0x7f937c0cba10 2023-11-28T20:08:10.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.819+0000 7f9380d0c640 1 -- 172.21.15.177:0/105332738 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936c0aa7e0 con 0x7f937c0cba10 2023-11-28T20:08:10.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.819+0000 7f9380d0c640 1 -- 172.21.15.177:0/105332738 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c0aab70 con 0x7f937c0cba10 2023-11-28T20:08:10.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.819+0000 7f9383f72640 1 -- 172.21.15.177:0/105332738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f937c0cba10 msgr2=0x7f937c15be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.819+0000 7f9383f72640 1 --2- 172.21.15.177:0/105332738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f937c0cba10 0x7f937c15be00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f937c067f70 tx=0x7f936c01c500 comp rx=0 tx=0).stop 2023-11-28T20:08:10.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.819+0000 7f9383f72640 1 -- 172.21.15.177:0/105332738 shutdown_connections 2023-11-28T20:08:10.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.819+0000 7f9383f72640 1 --2- 172.21.15.177:0/105332738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f937c0cba10 0x7f937c15be00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.819+0000 7f9383f72640 1 --2- 172.21.15.177:0/105332738 >> v2:172.21.15.195:3300/0 conn(0x7f937c158ca0 0x7f937c15eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.819+0000 7f9383f72640 1 -- 172.21.15.177:0/105332738 >> 172.21.15.177:0/105332738 conn(0x7f937c0b0cc0 msgr2=0x7f937c0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:10.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.819+0000 7f9383f72640 1 -- 172.21.15.177:0/105332738 shutdown_connections 2023-11-28T20:08:10.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.819+0000 7f9383f72640 1 -- 172.21.15.177:0/105332738 wait complete. 2023-11-28T20:08:10.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f9383f72640 1 Processor -- start 2023-11-28T20:08:10.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f9383f72640 1 -- start start 2023-11-28T20:08:10.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f9383f72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c0b42d0 0x7f937c14e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f9383f72640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f937c0cba10 0x7f937c165850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f9383f72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f937c158ca0 0x7f937c14de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f9383f72640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c165d90 con 0x7f937c158ca0 2023-11-28T20:08:10.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f9383f72640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c155780 con 0x7f937c0cba10 2023-11-28T20:08:10.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f9383f72640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937c154460 con 0x7f937c0b42d0 2023-11-28T20:08:10.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f938250f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f937c158ca0 0x7f937c14de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f938250f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f937c158ca0 0x7f937c14de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33492/0 (socket says 172.21.15.177:33492) 2023-11-28T20:08:10.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f938250f640 1 -- 172.21.15.177:0/2458735136 learned_addr learned my addr 172.21.15.177:0/2458735136 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:10.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f9381d0e640 1 --2- 172.21.15.177:0/2458735136 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c0b42d0 0x7f937c14e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f938150d640 1 --2- 172.21.15.177:0/2458735136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f937c0cba10 0x7f937c165850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f938250f640 1 -- 172.21.15.177:0/2458735136 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c0b42d0 msgr2=0x7f937c14e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f938250f640 1 --2- 172.21.15.177:0/2458735136 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c0b42d0 0x7f937c14e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f938250f640 1 -- 172.21.15.177:0/2458735136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f937c0cba10 msgr2=0x7f937c165850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f938250f640 1 --2- 172.21.15.177:0/2458735136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f937c0cba10 0x7f937c165850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f938250f640 1 -- 172.21.15.177:0/2458735136 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c0094d0 con 0x7f937c158ca0 2023-11-28T20:08:10.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f938250f640 1 --2- 172.21.15.177:0/2458735136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f937c158ca0 0x7f937c14de20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f937400c7a0 tx=0x7f937400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:10.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f93727fc640 1 -- 172.21.15.177:0/2458735136 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937400a640 con 0x7f937c158ca0 2023-11-28T20:08:10.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f93727fc640 1 -- 172.21.15.177:0/2458735136 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937400a7a0 con 0x7f937c158ca0 2023-11-28T20:08:10.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f9383f72640 1 -- 172.21.15.177:0/2458735136 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f937c1546e0 con 0x7f937c158ca0 2023-11-28T20:08:10.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.823+0000 7f93727fc640 1 -- 172.21.15.177:0/2458735136 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937400ab10 con 0x7f937c158ca0 2023-11-28T20:08:10.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.827+0000 7f9383f72640 1 -- 172.21.15.177:0/2458735136 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f937c154ca0 con 0x7f937c158ca0 2023-11-28T20:08:10.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.827+0000 7f9383f72640 1 -- 172.21.15.177:0/2458735136 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f937c0693d0 con 0x7f937c158ca0 2023-11-28T20:08:10.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.827+0000 7f93727fc640 1 -- 172.21.15.177:0/2458735136 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f937400ac70 con 0x7f937c158ca0 2023-11-28T20:08:10.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.827+0000 7f93727fc640 1 --2- 172.21.15.177:0/2458735136 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9360066470 0x7f9360068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:10.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.827+0000 7f93727fc640 1 -- 172.21.15.177:0/2458735136 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9374083670 con 0x7f937c158ca0 2023-11-28T20:08:10.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.827+0000 7f9381d0e640 1 --2- 172.21.15.177:0/2458735136 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9360066470 0x7f9360068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:10.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.827+0000 7f9381d0e640 1 --2- 172.21.15.177:0/2458735136 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9360066470 0x7f9360068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f937c0b0c90 tx=0x7f9378008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:10.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.831+0000 7f93727fc640 1 -- 172.21.15.177:0/2458735136 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9374050b00 con 0x7f937c158ca0 2023-11-28T20:08:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.983+0000 7f9383f72640 1 -- 172.21.15.177:0/2458735136 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f937c0b1990 con 0x7f937c158ca0 2023-11-28T20:08:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.983+0000 7f93727fc640 1 -- 172.21.15.177:0/2458735136 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9374054120 con 0x7f937c158ca0 2023-11-28T20:08:10.987 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:10.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.983+0000 7f9383f72640 1 -- 172.21.15.177:0/2458735136 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9360066470 msgr2=0x7f9360068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.983+0000 7f9383f72640 1 --2- 172.21.15.177:0/2458735136 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9360066470 0x7f9360068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f937c0b0c90 tx=0x7f9378008040 comp rx=0 tx=0).stop 2023-11-28T20:08:10.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.983+0000 7f9383f72640 1 -- 172.21.15.177:0/2458735136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f937c158ca0 msgr2=0x7f937c14de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:10.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.983+0000 7f9383f72640 1 --2- 172.21.15.177:0/2458735136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f937c158ca0 0x7f937c14de20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f937400c7a0 tx=0x7f937400cc60 comp rx=0 tx=0).stop 2023-11-28T20:08:10.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.983+0000 7f9383f72640 1 -- 172.21.15.177:0/2458735136 shutdown_connections 2023-11-28T20:08:10.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.983+0000 7f9383f72640 1 --2- 172.21.15.177:0/2458735136 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9360066470 0x7f9360068930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.983+0000 7f9383f72640 1 --2- 172.21.15.177:0/2458735136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f937c158ca0 0x7f937c14de20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.983+0000 7f9383f72640 1 --2- 172.21.15.177:0/2458735136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f937c0cba10 0x7f937c165850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.983+0000 7f9383f72640 1 --2- 172.21.15.177:0/2458735136 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c0b42d0 0x7f937c14e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:10.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.983+0000 7f9383f72640 1 -- 172.21.15.177:0/2458735136 >> 172.21.15.177:0/2458735136 conn(0x7f937c0b0cc0 msgr2=0x7f937c071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:10.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.983+0000 7f9383f72640 1 -- 172.21.15.177:0/2458735136 shutdown_connections 2023-11-28T20:08:10.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:10.983+0000 7f9383f72640 1 -- 172.21.15.177:0/2458735136 wait complete. 2023-11-28T20:08:11.008 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-11-28T20:08:11.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc219867640 1 Processor -- start 2023-11-28T20:08:11.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc219867640 1 -- start start 2023-11-28T20:08:11.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc219867640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc21415b000 0x7fc2140cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:11.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc219867640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc21406dd40 0x7fc21406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:11.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc219867640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2140cdf70 con 0x7fc2140cc7a0 2023-11-28T20:08:11.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc219867640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2140ce250 con 0x7fc21406dd40 2023-11-28T20:08:11.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc219867640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140ce530 con 0x7fc21415b000 2023-11-28T20:08:11.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc213fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc21406dd40 0x7fc21406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:11.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc213fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc21406dd40 0x7fc21406e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33496/0 (socket says 172.21.15.177:33496) 2023-11-28T20:08:11.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc213fff640 1 -- 172.21.15.177:0/4265768745 learned_addr learned my addr 172.21.15.177:0/4265768745 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:11.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc218865640 1 --2- 172.21.15.177:0/4265768745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc21415b000 0x7fc2140cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:11.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc213fff640 1 -- 172.21.15.177:0/4265768745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc21415b000 msgr2=0x7fc2140cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:11.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc213fff640 1 --2- 172.21.15.177:0/4265768745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc21415b000 0x7fc2140cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc213fff640 1 -- 172.21.15.177:0/4265768745 >> v1:172.21.15.195:6789/0 conn(0x7fc2140cc7a0 legacy=0x7fc214070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:11.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc213fff640 1 -- 172.21.15.177:0/4265768745 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2140ce810 con 0x7fc21406dd40 2023-11-28T20:08:11.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.143+0000 7fc218865640 1 --2- 172.21.15.177:0/4265768745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc21415b000 0x7fc2140cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:11.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.147+0000 7fc213fff640 1 --2- 172.21.15.177:0/4265768745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc21406dd40 0x7fc21406e1a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc2000098a0 tx=0x7fc20001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd8d6a8a287fd13 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:11.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.147+0000 7fc2137fe640 1 -- 172.21.15.177:0/4265768745 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2000aa5f0 con 0x7fc21406dd40 2023-11-28T20:08:11.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.147+0000 7fc2137fe640 1 -- 172.21.15.177:0/4265768745 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2000aa750 con 0x7fc21406dd40 2023-11-28T20:08:11.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.147+0000 7fc2137fe640 1 -- 172.21.15.177:0/4265768745 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2000aaae0 con 0x7fc21406dd40 2023-11-28T20:08:11.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.147+0000 7fc219867640 1 -- 172.21.15.177:0/4265768745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc21406dd40 msgr2=0x7fc21406e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:11.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.147+0000 7fc219867640 1 --2- 172.21.15.177:0/4265768745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc21406dd40 0x7fc21406e1a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc2000098a0 tx=0x7fc20001c4b0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.147+0000 7fc219867640 1 -- 172.21.15.177:0/4265768745 shutdown_connections 2023-11-28T20:08:11.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.147+0000 7fc219867640 1 --2- 172.21.15.177:0/4265768745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc21406dd40 0x7fc21406e1a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.147+0000 7fc219867640 1 --2- 172.21.15.177:0/4265768745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc21415b000 0x7fc2140cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.147+0000 7fc219867640 1 -- 172.21.15.177:0/4265768745 >> 172.21.15.177:0/4265768745 conn(0x7fc2140b0920 msgr2=0x7fc2140b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:11.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.147+0000 7fc219867640 1 -- 172.21.15.177:0/4265768745 shutdown_connections 2023-11-28T20:08:11.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.147+0000 7fc219867640 1 -- 172.21.15.177:0/4265768745 wait complete. 2023-11-28T20:08:11.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.147+0000 7fc219867640 1 Processor -- start 2023-11-28T20:08:11.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc219867640 1 -- start start 2023-11-28T20:08:11.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc219867640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc21406dd40 0x7fc2141441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:11.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc219867640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2140cc7a0 0x7fc214157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:11.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc219867640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc21415b000 0x7fc214140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:11.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc219867640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140aca60 con 0x7fc21406dd40 2023-11-28T20:08:11.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc219867640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140ac6e0 con 0x7fc2140cc7a0 2023-11-28T20:08:11.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc219867640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21415e020 con 0x7fc21415b000 2023-11-28T20:08:11.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc218865640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc21406dd40 0x7fc2141441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:11.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc218865640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc21406dd40 0x7fc2141441f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33512/0 (socket says 172.21.15.177:33512) 2023-11-28T20:08:11.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc218865640 1 -- 172.21.15.177:0/1997986488 learned_addr learned my addr 172.21.15.177:0/1997986488 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:11.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc213fff640 1 --2- 172.21.15.177:0/1997986488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2140cc7a0 0x7fc214157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:11.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc219066640 1 --2- 172.21.15.177:0/1997986488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc21415b000 0x7fc214140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:11.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc218865640 1 -- 172.21.15.177:0/1997986488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc21415b000 msgr2=0x7fc214140d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:11.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc218865640 1 --2- 172.21.15.177:0/1997986488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc21415b000 0x7fc214140d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc218865640 1 -- 172.21.15.177:0/1997986488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2140cc7a0 msgr2=0x7fc214157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:11.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc218865640 1 --2- 172.21.15.177:0/1997986488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2140cc7a0 0x7fc214157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc218865640 1 -- 172.21.15.177:0/1997986488 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2000094d0 con 0x7fc21406dd40 2023-11-28T20:08:11.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc218865640 1 --2- 172.21.15.177:0/1997986488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc21406dd40 0x7fc2141441f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc20800c7f0 tx=0x7fc20800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:11.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc2117fa640 1 -- 172.21.15.177:0/1997986488 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208007820 con 0x7fc21406dd40 2023-11-28T20:08:11.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc2117fa640 1 -- 172.21.15.177:0/1997986488 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc208007980 con 0x7fc21406dd40 2023-11-28T20:08:11.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc2117fa640 1 -- 172.21.15.177:0/1997986488 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208007d30 con 0x7fc21406dd40 2023-11-28T20:08:11.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc219867640 1 -- 172.21.15.177:0/1997986488 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21415e300 con 0x7fc21406dd40 2023-11-28T20:08:11.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc219867640 1 -- 172.21.15.177:0/1997986488 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc214141260 con 0x7fc21406dd40 2023-11-28T20:08:11.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.151+0000 7fc219867640 1 -- 172.21.15.177:0/1997986488 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21409d080 con 0x7fc21406dd40 2023-11-28T20:08:11.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.155+0000 7fc2117fa640 1 -- 172.21.15.177:0/1997986488 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc2080113f0 con 0x7fc21406dd40 2023-11-28T20:08:11.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.155+0000 7fc2117fa640 1 --2- 172.21.15.177:0/1997986488 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1f8066470 0x7fc1f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:11.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.155+0000 7fc2117fa640 1 -- 172.21.15.177:0/1997986488 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2080841d0 con 0x7fc21406dd40 2023-11-28T20:08:11.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.155+0000 7fc213fff640 1 --2- 172.21.15.177:0/1997986488 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1f8066470 0x7fc1f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:11.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.155+0000 7fc213fff640 1 --2- 172.21.15.177:0/1997986488 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1f8066470 0x7fc1f8068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc2000ae000 tx=0x7fc2000b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:11.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.159+0000 7fc2117fa640 1 -- 172.21.15.177:0/1997986488 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc208051660 con 0x7fc21406dd40 2023-11-28T20:08:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.363+0000 7fc219867640 1 -- 172.21.15.177:0/1997986488 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7fc21409ce30 con 0x7fc21406dd40 2023-11-28T20:08:11.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.391+0000 7fc2117fa640 1 -- 172.21.15.177:0/1997986488 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v55) v1 ==== 150+0+0 (secure 0 0 0) 0x7fc208054c80 con 0x7fc21406dd40 2023-11-28T20:08:11.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.391+0000 7fc219867640 1 -- 172.21.15.177:0/1997986488 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1f8066470 msgr2=0x7fc1f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:11.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.391+0000 7fc219867640 1 --2- 172.21.15.177:0/1997986488 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1f8066470 0x7fc1f8068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc2000ae000 tx=0x7fc2000b5040 comp rx=0 tx=0).stop 2023-11-28T20:08:11.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.391+0000 7fc219867640 1 -- 172.21.15.177:0/1997986488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc21406dd40 msgr2=0x7fc2141441f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:11.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.391+0000 7fc219867640 1 --2- 172.21.15.177:0/1997986488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc21406dd40 0x7fc2141441f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc20800c7f0 tx=0x7fc20800ccb0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.391+0000 7fc219867640 1 -- 172.21.15.177:0/1997986488 shutdown_connections 2023-11-28T20:08:11.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.391+0000 7fc219867640 1 --2- 172.21.15.177:0/1997986488 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1f8066470 0x7fc1f8068930 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.391+0000 7fc219867640 1 --2- 172.21.15.177:0/1997986488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc21415b000 0x7fc214140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.391+0000 7fc219867640 1 --2- 172.21.15.177:0/1997986488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2140cc7a0 0x7fc214157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.391+0000 7fc219867640 1 --2- 172.21.15.177:0/1997986488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc21406dd40 0x7fc2141441f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.391+0000 7fc219867640 1 -- 172.21.15.177:0/1997986488 >> 172.21.15.177:0/1997986488 conn(0x7fc2140b0920 msgr2=0x7fc2141643f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:11.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.395+0000 7fc219867640 1 -- 172.21.15.177:0/1997986488 shutdown_connections 2023-11-28T20:08:11.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.395+0000 7fc219867640 1 -- 172.21.15.177:0/1997986488 wait complete. 2023-11-28T20:08:11.418 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T20:08:11.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67b0957640 1 Processor -- start 2023-11-28T20:08:11.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67b0957640 1 -- start start 2023-11-28T20:08:11.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67b0957640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67ac15adb0 0x7f67ac13d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:11.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67b0957640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f67ac13f5f0 0x7f67ac0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:11.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67b0957640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67ac13d2b0 con 0x7f67ac071d90 2023-11-28T20:08:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67b0957640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ac140520 con 0x7f67ac13f5f0 2023-11-28T20:08:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67b0957640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac0cd7f0 con 0x7f67ac15adb0 2023-11-28T20:08:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67aa59c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f67ac071d90 0x7f67ac072170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36476/0 (socket says 172.21.15.177:36476) 2023-11-28T20:08:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67aa59c640 1 -- 172.21.15.177:0/692130191 learned_addr learned my addr 172.21.15.177:0/692130191 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67aad9d640 1 --2- 172.21.15.177:0/692130191 >> v2:172.21.15.177:3300/0 conn(0x7f67ac13f5f0 0x7f67ac0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:11.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67a1d9b640 1 --2- 172.21.15.177:0/692130191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67ac15adb0 0x7f67ac13d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:11.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67aad9d640 1 -- 172.21.15.177:0/692130191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67ac15adb0 msgr2=0x7f67ac13d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:11.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67a9d9b640 1 -- 172.21.15.177:0/692130191 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388399589 0 0) 0x7f67ac13d2b0 con 0x7f67ac071d90 2023-11-28T20:08:11.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67aad9d640 1 --2- 172.21.15.177:0/692130191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67ac15adb0 0x7f67ac13d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67aad9d640 1 -- 172.21.15.177:0/692130191 >> v1:172.21.15.177:6789/0 conn(0x7f67ac071d90 legacy=0x7f67ac072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:11.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67aad9d640 1 -- 172.21.15.177:0/692130191 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac0cdd70 con 0x7f67ac13f5f0 2023-11-28T20:08:11.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.555+0000 7f67a1d9b640 1 --2- 172.21.15.177:0/692130191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67ac15adb0 0x7f67ac13d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:11.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.559+0000 7f67aad9d640 1 --2- 172.21.15.177:0/692130191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac13f5f0 0x7f67ac0ce200 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f67a40097c0 tx=0x7f67a401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea4e99b1f3835aa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:11.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.559+0000 7f67a9d9b640 1 -- 172.21.15.177:0/692130191 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a40ab650 con 0x7f67ac13f5f0 2023-11-28T20:08:11.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.559+0000 7f67a9d9b640 1 -- 172.21.15.177:0/692130191 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a40ab7b0 con 0x7f67ac13f5f0 2023-11-28T20:08:11.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.559+0000 7f67a9d9b640 1 -- 172.21.15.177:0/692130191 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a40abb40 con 0x7f67ac13f5f0 2023-11-28T20:08:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.559+0000 7f67b0957640 1 -- 172.21.15.177:0/692130191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac13f5f0 msgr2=0x7f67ac0ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.559+0000 7f67b0957640 1 --2- 172.21.15.177:0/692130191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac13f5f0 0x7f67ac0ce200 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f67a40097c0 tx=0x7f67a401c450 comp rx=0 tx=0).stop 2023-11-28T20:08:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.559+0000 7f67b0957640 1 -- 172.21.15.177:0/692130191 shutdown_connections 2023-11-28T20:08:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.559+0000 7f67b0957640 1 --2- 172.21.15.177:0/692130191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac13f5f0 0x7f67ac0ce200 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.559+0000 7f67b0957640 1 --2- 172.21.15.177:0/692130191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67ac15adb0 0x7f67ac13d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.559+0000 7f67b0957640 1 -- 172.21.15.177:0/692130191 >> 172.21.15.177:0/692130191 conn(0x7f67ac0b0cc0 msgr2=0x7f67ac0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:11.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.559+0000 7f67b0957640 1 -- 172.21.15.177:0/692130191 shutdown_connections 2023-11-28T20:08:11.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.559+0000 7f67b0957640 1 -- 172.21.15.177:0/692130191 wait complete. 2023-11-28T20:08:11.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67b0957640 1 Processor -- start 2023-11-28T20:08:11.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67b0957640 1 -- start start 2023-11-28T20:08:11.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67b0957640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac071d90 0x7f67ac1352c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:11.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67b0957640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67ac13f5f0 0x7f67ac169160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:11.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67b0957640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67ac15adb0 0x7f67ac158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:11.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67b0957640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac0b42e0 con 0x7f67ac071d90 2023-11-28T20:08:11.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67b0957640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac1696a0 con 0x7f67ac15adb0 2023-11-28T20:08:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67b0957640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac1543d0 con 0x7f67ac13f5f0 2023-11-28T20:08:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67aa59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac071d90 0x7f67ac1352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67aa59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac071d90 0x7f67ac1352c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33530/0 (socket says 172.21.15.177:33530) 2023-11-28T20:08:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67aa59c640 1 -- 172.21.15.177:0/988388469 learned_addr learned my addr 172.21.15.177:0/988388469 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67a1d9b640 1 --2- 172.21.15.177:0/988388469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67ac13f5f0 0x7f67ac169160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67aad9d640 1 --2- 172.21.15.177:0/988388469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67ac15adb0 0x7f67ac158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67aa59c640 1 -- 172.21.15.177:0/988388469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67ac13f5f0 msgr2=0x7f67ac169160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67aa59c640 1 --2- 172.21.15.177:0/988388469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67ac13f5f0 0x7f67ac169160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67aa59c640 1 -- 172.21.15.177:0/988388469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67ac15adb0 msgr2=0x7f67ac158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67aa59c640 1 --2- 172.21.15.177:0/988388469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67ac15adb0 0x7f67ac158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67aa59c640 1 -- 172.21.15.177:0/988388469 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a4009420 con 0x7f67ac071d90 2023-11-28T20:08:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67aa59c640 1 --2- 172.21.15.177:0/988388469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac071d90 0x7f67ac1352c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f679c00c480 tx=0x7f679c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67a37fe640 1 -- 172.21.15.177:0/988388469 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c0074e0 con 0x7f67ac071d90 2023-11-28T20:08:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67a37fe640 1 -- 172.21.15.177:0/988388469 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c007660 con 0x7f67ac071d90 2023-11-28T20:08:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67b0957640 1 -- 172.21.15.177:0/988388469 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ac0b4700 con 0x7f67ac071d90 2023-11-28T20:08:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67a37fe640 1 -- 172.21.15.177:0/988388469 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c004a30 con 0x7f67ac071d90 2023-11-28T20:08:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.563+0000 7f67b0957640 1 -- 172.21.15.177:0/988388469 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ac0b3c20 con 0x7f67ac071d90 2023-11-28T20:08:11.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.567+0000 7f67b0957640 1 -- 172.21.15.177:0/988388469 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ac0b4550 con 0x7f67ac071d90 2023-11-28T20:08:11.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.567+0000 7f67a37fe640 1 -- 172.21.15.177:0/988388469 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f679c004b90 con 0x7f67ac071d90 2023-11-28T20:08:11.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.567+0000 7f67a37fe640 1 --2- 172.21.15.177:0/988388469 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f678c066470 0x7f678c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:11.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.567+0000 7f67a37fe640 1 -- 172.21.15.177:0/988388469 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f679c083380 con 0x7f67ac071d90 2023-11-28T20:08:11.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.567+0000 7f67a1d9b640 1 --2- 172.21.15.177:0/988388469 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f678c066470 0x7f678c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:11.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.567+0000 7f67a1d9b640 1 --2- 172.21.15.177:0/988388469 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f678c066470 0x7f678c068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f67940075b0 tx=0x7f6794007540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:11.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.571+0000 7f67a37fe640 1 -- 172.21.15.177:0/988388469 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f679c054280 con 0x7f67ac071d90 2023-11-28T20:08:11.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.719+0000 7f67b0957640 1 -- 172.21.15.177:0/988388469 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f67ac0693d0 con 0x7f67ac071d90 2023-11-28T20:08:11.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.723+0000 7f67a37fe640 1 -- 172.21.15.177:0/988388469 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f679c053e10 con 0x7f67ac071d90 2023-11-28T20:08:11.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.727+0000 7f67b0957640 1 -- 172.21.15.177:0/988388469 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f678c066470 msgr2=0x7f678c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:11.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.727+0000 7f67b0957640 1 --2- 172.21.15.177:0/988388469 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f678c066470 0x7f678c068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f67940075b0 tx=0x7f6794007540 comp rx=0 tx=0).stop 2023-11-28T20:08:11.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.727+0000 7f67b0957640 1 -- 172.21.15.177:0/988388469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac071d90 msgr2=0x7f67ac1352c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:11.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.727+0000 7f67b0957640 1 --2- 172.21.15.177:0/988388469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac071d90 0x7f67ac1352c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f679c00c480 tx=0x7f679c00c940 comp rx=0 tx=0).stop 2023-11-28T20:08:11.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.727+0000 7f67b0957640 1 -- 172.21.15.177:0/988388469 shutdown_connections 2023-11-28T20:08:11.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.727+0000 7f67b0957640 1 --2- 172.21.15.177:0/988388469 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f678c066470 0x7f678c068930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.727+0000 7f67b0957640 1 --2- 172.21.15.177:0/988388469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67ac15adb0 0x7f67ac158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.727+0000 7f67b0957640 1 --2- 172.21.15.177:0/988388469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67ac13f5f0 0x7f67ac169160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.727+0000 7f67b0957640 1 --2- 172.21.15.177:0/988388469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac071d90 0x7f67ac1352c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:11.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.727+0000 7f67b0957640 1 -- 172.21.15.177:0/988388469 >> 172.21.15.177:0/988388469 conn(0x7f67ac0b0cc0 msgr2=0x7f67ac13c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:11.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.727+0000 7f67b0957640 1 -- 172.21.15.177:0/988388469 shutdown_connections 2023-11-28T20:08:11.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:11.727+0000 7f67b0957640 1 -- 172.21.15.177:0/988388469 wait complete. 2023-11-28T20:08:11.751 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T20:08:11.751 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:08:11.845 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:08:11.952 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T20:08:11.953 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:08:11.953 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:08:11.962 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:08:11.962 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:08:12.014 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:12.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.191+0000 7ff285e9c640 1 Processor -- start 2023-11-28T20:08:12.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.191+0000 7ff285e9c640 1 -- start start 2023-11-28T20:08:12.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.191+0000 7ff285e9c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff28006cdb0 0x7ff280150250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.191+0000 7ff285e9c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff280070460 con 0x7ff28015a4b0 2023-11-28T20:08:12.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.191+0000 7ff285e9c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28015a890 con 0x7ff28006d190 2023-11-28T20:08:12.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.191+0000 7ff285e9c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28015ab20 con 0x7ff28006cdb0 2023-11-28T20:08:12.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.191+0000 7ff27ffff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ff28015a4b0 0x7ff2800ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36488/0 (socket says 172.21.15.177:36488) 2023-11-28T20:08:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.191+0000 7ff27ffff640 1 -- 172.21.15.177:0/326678515 learned_addr learned my addr 172.21.15.177:0/326678515 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.191+0000 7ff27f7fe640 1 --2- 172.21.15.177:0/326678515 >> v2:172.21.15.195:3300/0 conn(0x7ff28006cdb0 0x7ff280150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.191+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744407841 0 0) 0x7ff280070460 con 0x7ff28015a4b0 2023-11-28T20:08:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.191+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff26c003530 con 0x7ff28015a4b0 2023-11-28T20:08:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362497024 0 0) 0x7ff28015a890 con 0x7ff28006d190 2023-11-28T20:08:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff280070460 con 0x7ff28006d190 2023-11-28T20:08:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 755068437 0 0) 0x7ff26c003530 con 0x7ff28015a4b0 2023-11-28T20:08:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 >> v2:172.21.15.195:3300/0 conn(0x7ff28006cdb0 msgr2=0x7ff280150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27effd640 1 --2- 172.21.15.177:0/326678515 >> v2:172.21.15.195:3300/0 conn(0x7ff28006cdb0 0x7ff280150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 >> v1:172.21.15.195:6789/0 conn(0x7ff28006d190 legacy=0x7ff280159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff280070690 con 0x7ff28015a4b0 2023-11-28T20:08:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7ff278001a00 con 0x7ff28015a4b0 2023-11-28T20:08:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 >> v1:172.21.15.177:6789/0 conn(0x7ff28015a4b0 legacy=0x7ff2800ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27effd640 1 --2- 172.21.15.177:0/326678515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff26c003b60 0x7ff26c003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27effd640 1 --2- 172.21.15.177:0/326678515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff26c0047d0 0x7ff26c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27effd640 1 --2- 172.21.15.177:0/326678515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff26c005190 0x7ff26c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28015ab20 con 0x7ff26c003b60 2023-11-28T20:08:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c00c060 con 0x7ff26c0047d0 2023-11-28T20:08:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c00c220 con 0x7ff26c005190 2023-11-28T20:08:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27f7fe640 1 --2- 172.21.15.177:0/326678515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff26c003b60 0x7ff26c003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff277fff640 1 --2- 172.21.15.177:0/326678515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff26c0047d0 0x7ff26c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27ffff640 1 --2- 172.21.15.177:0/326678515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff26c005190 0x7ff26c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27f7fe640 1 -- 172.21.15.177:0/326678515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff26c005190 msgr2=0x7ff26c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27f7fe640 1 --2- 172.21.15.177:0/326678515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff26c005190 0x7ff26c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27f7fe640 1 -- 172.21.15.177:0/326678515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff26c0047d0 msgr2=0x7ff26c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27f7fe640 1 --2- 172.21.15.177:0/326678515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff26c0047d0 0x7ff26c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27f7fe640 1 -- 172.21.15.177:0/326678515 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c003530 con 0x7ff26c003b60 2023-11-28T20:08:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27ffff640 1 -- 172.21.15.177:0/326678515 reap_dead start 2023-11-28T20:08:12.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.195+0000 7ff27f7fe640 1 --2- 172.21.15.177:0/326678515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff26c003b60 0x7ff26c003f60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff270009ae0 tx=0x7ff27001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4deac7b02a0e1f65 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:12.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2700a6440 con 0x7ff26c003b60 2023-11-28T20:08:12.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2700a65a0 con 0x7ff26c003b60 2023-11-28T20:08:12.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff27effd640 1 -- 172.21.15.177:0/326678515 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2700a6950 con 0x7ff26c003b60 2023-11-28T20:08:12.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff285e9c640 1 -- 172.21.15.177:0/326678515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff26c003b60 msgr2=0x7ff26c003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff285e9c640 1 --2- 172.21.15.177:0/326678515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff26c003b60 0x7ff26c003f60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff270009ae0 tx=0x7ff27001ca50 comp rx=0 tx=0).stop 2023-11-28T20:08:12.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff285e9c640 1 -- 172.21.15.177:0/326678515 shutdown_connections 2023-11-28T20:08:12.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff285e9c640 1 --2- 172.21.15.177:0/326678515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff26c003b60 0x7ff26c003f60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff285e9c640 1 -- 172.21.15.177:0/326678515 >> 172.21.15.177:0/326678515 conn(0x7ff28006a530 msgr2=0x7ff28006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:12.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff285e9c640 1 -- 172.21.15.177:0/326678515 shutdown_connections 2023-11-28T20:08:12.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff285e9c640 1 -- 172.21.15.177:0/326678515 wait complete. 2023-11-28T20:08:12.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff285e9c640 1 Processor -- start 2023-11-28T20:08:12.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff285e9c640 1 -- start start 2023-11-28T20:08:12.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff285e9c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff26c003b60 0x7ff28015b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff285e9c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff28014bfc0 0x7ff280146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff285e9c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2801471f0 0x7ff28013e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff285e9c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28014b5e0 con 0x7ff2801471f0 2023-11-28T20:08:12.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff285e9c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff280147c30 con 0x7ff28014bfc0 2023-11-28T20:08:12.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff285e9c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff280147670 con 0x7ff26c003b60 2023-11-28T20:08:12.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff27ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2801471f0 0x7ff28013e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff27ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2801471f0 0x7ff28013e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33548/0 (socket says 172.21.15.177:33548) 2023-11-28T20:08:12.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff27ffff640 1 -- 172.21.15.177:0/2093356619 learned_addr learned my addr 172.21.15.177:0/2093356619 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:12.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff277fff640 1 --2- 172.21.15.177:0/2093356619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff28014bfc0 0x7ff280146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.199+0000 7ff27f7fe640 1 --2- 172.21.15.177:0/2093356619 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff26c003b60 0x7ff28015b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff27ffff640 1 -- 172.21.15.177:0/2093356619 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff26c003b60 msgr2=0x7ff28015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff27ffff640 1 --2- 172.21.15.177:0/2093356619 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff26c003b60 0x7ff28015b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff27ffff640 1 -- 172.21.15.177:0/2093356619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff28014bfc0 msgr2=0x7ff280146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff27ffff640 1 --2- 172.21.15.177:0/2093356619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff28014bfc0 0x7ff280146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff27ffff640 1 -- 172.21.15.177:0/2093356619 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff280147950 con 0x7ff2801471f0 2023-11-28T20:08:12.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff27ffff640 1 --2- 172.21.15.177:0/2093356619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2801471f0 0x7ff28013e050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff2800cc880 tx=0x7ff278007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:12.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff27cff9640 1 -- 172.21.15.177:0/2093356619 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27800eaa0 con 0x7ff2801471f0 2023-11-28T20:08:12.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff27cff9640 1 -- 172.21.15.177:0/2093356619 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27800ec00 con 0x7ff2801471f0 2023-11-28T20:08:12.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff285e9c640 1 -- 172.21.15.177:0/2093356619 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28014b7c0 con 0x7ff2801471f0 2023-11-28T20:08:12.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff27cff9640 1 -- 172.21.15.177:0/2093356619 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278014430 con 0x7ff2801471f0 2023-11-28T20:08:12.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff285e9c640 1 -- 172.21.15.177:0/2093356619 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28013fc50 con 0x7ff2801471f0 2023-11-28T20:08:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff285e9c640 1 -- 172.21.15.177:0/2093356619 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff280069440 con 0x7ff2801471f0 2023-11-28T20:08:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff27cff9640 1 -- 172.21.15.177:0/2093356619 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff278014590 con 0x7ff2801471f0 2023-11-28T20:08:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff27cff9640 1 --2- 172.21.15.177:0/2093356619 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff260066470 0x7ff260068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff27cff9640 1 -- 172.21.15.177:0/2093356619 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff278083b40 con 0x7ff2801471f0 2023-11-28T20:08:12.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.203+0000 7ff27f7fe640 1 --2- 172.21.15.177:0/2093356619 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff260066470 0x7ff260068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.207+0000 7ff27f7fe640 1 --2- 172.21.15.177:0/2093356619 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff260066470 0x7ff260068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff2700ad000 tx=0x7ff2700b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:12.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.207+0000 7ff27cff9640 1 -- 172.21.15.177:0/2093356619 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff278050fd0 con 0x7ff2801471f0 2023-11-28T20:08:12.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.359+0000 7ff285e9c640 1 -- 172.21.15.177:0/2093356619 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff28014bc70 con 0x7ff2801471f0 2023-11-28T20:08:12.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.359+0000 7ff27cff9640 1 -- 172.21.15.177:0/2093356619 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7ff2780545f0 con 0x7ff2801471f0 2023-11-28T20:08:12.365 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:12.365 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:12.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.363+0000 7ff285e9c640 1 -- 172.21.15.177:0/2093356619 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff260066470 msgr2=0x7ff260068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.363+0000 7ff285e9c640 1 --2- 172.21.15.177:0/2093356619 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff260066470 0x7ff260068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff2700ad000 tx=0x7ff2700b2040 comp rx=0 tx=0).stop 2023-11-28T20:08:12.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.363+0000 7ff285e9c640 1 -- 172.21.15.177:0/2093356619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2801471f0 msgr2=0x7ff28013e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.363+0000 7ff285e9c640 1 --2- 172.21.15.177:0/2093356619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2801471f0 0x7ff28013e050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff2800cc880 tx=0x7ff278007bc0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.363+0000 7ff285e9c640 1 -- 172.21.15.177:0/2093356619 shutdown_connections 2023-11-28T20:08:12.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.363+0000 7ff285e9c640 1 --2- 172.21.15.177:0/2093356619 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff260066470 0x7ff260068930 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.363+0000 7ff285e9c640 1 --2- 172.21.15.177:0/2093356619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2801471f0 0x7ff28013e050 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.363+0000 7ff285e9c640 1 --2- 172.21.15.177:0/2093356619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff28014bfc0 0x7ff280146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.363+0000 7ff285e9c640 1 --2- 172.21.15.177:0/2093356619 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff26c003b60 0x7ff28015b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.363+0000 7ff285e9c640 1 -- 172.21.15.177:0/2093356619 >> 172.21.15.177:0/2093356619 conn(0x7ff28006a530 msgr2=0x7ff2801497c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:12.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.363+0000 7ff285e9c640 1 -- 172.21.15.177:0/2093356619 shutdown_connections 2023-11-28T20:08:12.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.363+0000 7ff285e9c640 1 -- 172.21.15.177:0/2093356619 wait complete. 2023-11-28T20:08:12.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:12.387 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:12.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.523+0000 7f522499c640 1 Processor -- start 2023-11-28T20:08:12.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.523+0000 7f522499c640 1 -- start start 2023-11-28T20:08:12.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.527+0000 7f522499c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f52200b2b80 0x7f52200b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.527+0000 7f522499c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f522006d980 0x7f52200b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.527+0000 7f522499c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52200b34a0 con 0x7f5220071670 2023-11-28T20:08:12.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.527+0000 7f522499c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52200705d0 con 0x7f522006d980 2023-11-28T20:08:12.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.527+0000 7f522499c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52200708b0 con 0x7f52200b2b80 2023-11-28T20:08:12.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.527+0000 7f521e59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f522006d980 0x7f52200b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.527+0000 7f521e59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f522006d980 0x7f52200b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33552/0 (socket says 172.21.15.177:33552) 2023-11-28T20:08:12.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.527+0000 7f521f59e640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5220071670 0x7f52200ac780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36492/0 (socket says 172.21.15.177:36492) 2023-11-28T20:08:12.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.527+0000 7f521e59c640 1 -- 172.21.15.177:0/110314740 learned_addr learned my addr 172.21.15.177:0/110314740 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:12.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.527+0000 7f521ed9d640 1 --2- 172.21.15.177:0/110314740 >> v2:172.21.15.195:3300/0 conn(0x7f52200b2b80 0x7f52200b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.527+0000 7f521e59c640 1 -- 172.21.15.177:0/110314740 >> v2:172.21.15.195:3300/0 conn(0x7f52200b2b80 msgr2=0x7f52200b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:12.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.527+0000 7f521e59c640 1 --2- 172.21.15.177:0/110314740 >> v2:172.21.15.195:3300/0 conn(0x7f52200b2b80 0x7f52200b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.527+0000 7f521e59c640 1 -- 172.21.15.177:0/110314740 >> v1:172.21.15.177:6789/0 conn(0x7f5220071670 legacy=0x7f52200ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.527+0000 7f521e59c640 1 -- 172.21.15.177:0/110314740 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5220070b90 con 0x7f522006d980 2023-11-28T20:08:12.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.527+0000 7f521dd9b640 1 -- 172.21.15.177:0/110314740 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658570110 0 0) 0x7f52200b34a0 con 0x7f5220071670 2023-11-28T20:08:12.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.531+0000 7f521e59c640 1 --2- 172.21.15.177:0/110314740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f522006d980 0x7f52200b2f60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f522006e670 tx=0x7f521401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf2f2f5b09089a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:12.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.531+0000 7f521dd9b640 1 -- 172.21.15.177:0/110314740 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52140aa430 con 0x7f522006d980 2023-11-28T20:08:12.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.531+0000 7f521dd9b640 1 -- 172.21.15.177:0/110314740 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52140aa590 con 0x7f522006d980 2023-11-28T20:08:12.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.531+0000 7f521dd9b640 1 -- 172.21.15.177:0/110314740 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52140aa920 con 0x7f522006d980 2023-11-28T20:08:12.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.531+0000 7f522499c640 1 -- 172.21.15.177:0/110314740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f522006d980 msgr2=0x7f52200b2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.531+0000 7f522499c640 1 --2- 172.21.15.177:0/110314740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f522006d980 0x7f52200b2f60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f522006e670 tx=0x7f521401c4d0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.531+0000 7f522499c640 1 -- 172.21.15.177:0/110314740 shutdown_connections 2023-11-28T20:08:12.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.531+0000 7f522499c640 1 --2- 172.21.15.177:0/110314740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f522006d980 0x7f52200b2f60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.531+0000 7f522499c640 1 --2- 172.21.15.177:0/110314740 >> v2:172.21.15.195:3300/0 conn(0x7f52200b2b80 0x7f52200b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.531+0000 7f522499c640 1 -- 172.21.15.177:0/110314740 >> 172.21.15.177:0/110314740 conn(0x7f52200b0920 msgr2=0x7f52200b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:12.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.531+0000 7f522499c640 1 -- 172.21.15.177:0/110314740 shutdown_connections 2023-11-28T20:08:12.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.531+0000 7f522499c640 1 -- 172.21.15.177:0/110314740 wait complete. 2023-11-28T20:08:12.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.531+0000 7f522499c640 1 Processor -- start 2023-11-28T20:08:12.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.531+0000 7f522499c640 1 -- start start 2023-11-28T20:08:12.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f522499c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f522006d980 0x7f52201495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f522499c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5220071670 0x7f5220151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f522499c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52200b2b80 0x7f5220159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f522499c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52201517e0 con 0x7f52200b2b80 2023-11-28T20:08:12.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f522499c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52201557d0 con 0x7f522006d980 2023-11-28T20:08:12.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f522499c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5220150c60 con 0x7f5220071670 2023-11-28T20:08:12.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f521f59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52200b2b80 0x7f5220159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f521f59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52200b2b80 0x7f5220159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33568/0 (socket says 172.21.15.177:33568) 2023-11-28T20:08:12.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f521f59e640 1 -- 172.21.15.177:0/2468211794 learned_addr learned my addr 172.21.15.177:0/2468211794 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:12.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f521ed9d640 1 --2- 172.21.15.177:0/2468211794 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f522006d980 0x7f52201495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f521e59c640 1 --2- 172.21.15.177:0/2468211794 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5220071670 0x7f5220151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f521f59e640 1 -- 172.21.15.177:0/2468211794 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5220071670 msgr2=0x7f5220151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f521f59e640 1 --2- 172.21.15.177:0/2468211794 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5220071670 0x7f5220151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f521f59e640 1 -- 172.21.15.177:0/2468211794 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f522006d980 msgr2=0x7f52201495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f521f59e640 1 --2- 172.21.15.177:0/2468211794 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f522006d980 0x7f52201495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f521f59e640 1 -- 172.21.15.177:0/2468211794 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52140094d0 con 0x7f52200b2b80 2023-11-28T20:08:12.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f521f59e640 1 --2- 172.21.15.177:0/2468211794 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52200b2b80 0x7f5220159bf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f521800c780 tx=0x7f521800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:12.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f52077fe640 1 -- 172.21.15.177:0/2468211794 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521800ce90 con 0x7f52200b2b80 2023-11-28T20:08:12.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f52077fe640 1 -- 172.21.15.177:0/2468211794 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521800a640 con 0x7f52200b2b80 2023-11-28T20:08:12.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f522499c640 1 -- 172.21.15.177:0/2468211794 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5220150f40 con 0x7f52200b2b80 2023-11-28T20:08:12.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f52077fe640 1 -- 172.21.15.177:0/2468211794 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521800a9d0 con 0x7f52200b2b80 2023-11-28T20:08:12.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f522499c640 1 -- 172.21.15.177:0/2468211794 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5220151500 con 0x7f52200b2b80 2023-11-28T20:08:12.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.535+0000 7f522499c640 1 -- 172.21.15.177:0/2468211794 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52201559b0 con 0x7f52200b2b80 2023-11-28T20:08:12.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.539+0000 7f52077fe640 1 -- 172.21.15.177:0/2468211794 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f521800ab30 con 0x7f52200b2b80 2023-11-28T20:08:12.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.539+0000 7f52077fe640 1 --2- 172.21.15.177:0/2468211794 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f520c066470 0x7f520c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.539+0000 7f52077fe640 1 -- 172.21.15.177:0/2468211794 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52180835b0 con 0x7f52200b2b80 2023-11-28T20:08:12.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.539+0000 7f521ed9d640 1 --2- 172.21.15.177:0/2468211794 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f520c066470 0x7f520c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.539+0000 7f521ed9d640 1 --2- 172.21.15.177:0/2468211794 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f520c066470 0x7f520c068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5210009ac0 tx=0x7f5210009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:12.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.543+0000 7f52077fe640 1 -- 172.21.15.177:0/2468211794 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52201559b0 con 0x7f52200b2b80 2023-11-28T20:08:12.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.695+0000 7f522499c640 1 -- 172.21.15.177:0/2468211794 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52201559b0 con 0x7f52200b2b80 2023-11-28T20:08:12.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.695+0000 7f52077fe640 1 -- 172.21.15.177:0/2468211794 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52201559b0 con 0x7f52200b2b80 2023-11-28T20:08:12.700 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:12.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.695+0000 7f522499c640 1 -- 172.21.15.177:0/2468211794 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f520c066470 msgr2=0x7f520c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.695+0000 7f522499c640 1 --2- 172.21.15.177:0/2468211794 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f520c066470 0x7f520c068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5210009ac0 tx=0x7f5210009190 comp rx=0 tx=0).stop 2023-11-28T20:08:12.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.695+0000 7f522499c640 1 -- 172.21.15.177:0/2468211794 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52200b2b80 msgr2=0x7f5220159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.695+0000 7f522499c640 1 --2- 172.21.15.177:0/2468211794 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52200b2b80 0x7f5220159bf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f521800c780 tx=0x7f521800cc40 comp rx=0 tx=0).stop 2023-11-28T20:08:12.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.695+0000 7f522499c640 1 -- 172.21.15.177:0/2468211794 shutdown_connections 2023-11-28T20:08:12.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.695+0000 7f522499c640 1 --2- 172.21.15.177:0/2468211794 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f520c066470 0x7f520c068930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.695+0000 7f522499c640 1 --2- 172.21.15.177:0/2468211794 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52200b2b80 0x7f5220159bf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.695+0000 7f522499c640 1 --2- 172.21.15.177:0/2468211794 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5220071670 0x7f5220151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.695+0000 7f522499c640 1 --2- 172.21.15.177:0/2468211794 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f522006d980 0x7f52201495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.695+0000 7f522499c640 1 -- 172.21.15.177:0/2468211794 >> 172.21.15.177:0/2468211794 conn(0x7f52200b0920 msgr2=0x7f52200ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:12.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.695+0000 7f522499c640 1 -- 172.21.15.177:0/2468211794 shutdown_connections 2023-11-28T20:08:12.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.695+0000 7f522499c640 1 -- 172.21.15.177:0/2468211794 wait complete. 2023-11-28T20:08:12.721 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:12.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.855+0000 7f31e509c640 1 Processor -- start 2023-11-28T20:08:12.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.855+0000 7f31e509c640 1 -- start start 2023-11-28T20:08:12.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.859+0000 7f31e509c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31e015e590 0x7f31e00ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.859+0000 7f31e509c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f31e00ae010 0x7f31e006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.859+0000 7f31e509c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e00ce330 con 0x7f31e00b3ac0 2023-11-28T20:08:12.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.859+0000 7f31e509c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e015e970 con 0x7f31e00ae010 2023-11-28T20:08:12.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.859+0000 7f31e509c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00b2ca0 con 0x7f31e015e590 2023-11-28T20:08:12.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.859+0000 7f31dffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31e015e590 0x7f31e00ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.859+0000 7f31e489b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f31e00ae010 0x7f31e006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.859+0000 7f31e489b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f31e00ae010 0x7f31e006bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:45332/0 (socket says 172.21.15.177:45332) 2023-11-28T20:08:12.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.859+0000 7f31e489b640 1 -- 172.21.15.177:0/1129142019 learned_addr learned my addr 172.21.15.177:0/1129142019 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:12.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.859+0000 7f31dffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31e015e590 0x7f31e00ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:60482/0 (socket says 172.21.15.177:60482) 2023-11-28T20:08:12.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.859+0000 7f31df7fe640 1 --1- 172.21.15.177:0/1129142019 >> v1:172.21.15.195:6789/0 conn(0x7f31e00b3ac0 0x7f31e00ad900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:43646/0 (socket says 172.21.15.177:43646) 2023-11-28T20:08:12.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.859+0000 7f31e489b640 1 -- 172.21.15.177:0/1129142019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31e015e590 msgr2=0x7f31e00ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:12.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.859+0000 7f31e489b640 1 --2- 172.21.15.177:0/1129142019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31e015e590 0x7f31e00ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.859+0000 7f31e489b640 1 -- 172.21.15.177:0/1129142019 >> v1:172.21.15.195:6789/0 conn(0x7f31e00b3ac0 legacy=0x7f31e00ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.859+0000 7f31e489b640 1 -- 172.21.15.177:0/1129142019 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e00b4080 con 0x7f31e00ae010 2023-11-28T20:08:12.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.863+0000 7f31e489b640 1 --2- 172.21.15.177:0/1129142019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31e00ae010 0x7f31e006bfe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f31d8009e50 tx=0x7f31d801c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa69dcc60e96f63b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:12.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.863+0000 7f31deffd640 1 -- 172.21.15.177:0/1129142019 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d80a55b0 con 0x7f31e00ae010 2023-11-28T20:08:12.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.863+0000 7f31deffd640 1 -- 172.21.15.177:0/1129142019 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d80a5710 con 0x7f31e00ae010 2023-11-28T20:08:12.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.863+0000 7f31deffd640 1 -- 172.21.15.177:0/1129142019 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d80a5aa0 con 0x7f31e00ae010 2023-11-28T20:08:12.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.863+0000 7f31e509c640 1 -- 172.21.15.177:0/1129142019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31e00ae010 msgr2=0x7f31e006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.863+0000 7f31e509c640 1 --2- 172.21.15.177:0/1129142019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31e00ae010 0x7f31e006bfe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f31d8009e50 tx=0x7f31d801c8f0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.863+0000 7f31e509c640 1 -- 172.21.15.177:0/1129142019 shutdown_connections 2023-11-28T20:08:12.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.863+0000 7f31e509c640 1 --2- 172.21.15.177:0/1129142019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31e00ae010 0x7f31e006bfe0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.863+0000 7f31e509c640 1 --2- 172.21.15.177:0/1129142019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31e015e590 0x7f31e00ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.863+0000 7f31e509c640 1 -- 172.21.15.177:0/1129142019 >> 172.21.15.177:0/1129142019 conn(0x7f31e00b0920 msgr2=0x7f31e00b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:12.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.863+0000 7f31e509c640 1 -- 172.21.15.177:0/1129142019 shutdown_connections 2023-11-28T20:08:12.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.863+0000 7f31e509c640 1 -- 172.21.15.177:0/1129142019 wait complete. 2023-11-28T20:08:12.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.863+0000 7f31e509c640 1 Processor -- start 2023-11-28T20:08:12.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.863+0000 7f31e509c640 1 -- start start 2023-11-28T20:08:12.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.863+0000 7f31e509c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31e00ae010 0x7f31e014fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e509c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31e00b3ac0 0x7f31e0159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e509c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e015e590 0x7f31e0148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e509c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0158aa0 con 0x7f31e015e590 2023-11-28T20:08:12.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e509c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0158d80 con 0x7f31e00b3ac0 2023-11-28T20:08:12.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e509c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0159060 con 0x7f31e00ae010 2023-11-28T20:08:12.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e489b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e015e590 0x7f31e0148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e489b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e015e590 0x7f31e0148420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33572/0 (socket says 172.21.15.177:33572) 2023-11-28T20:08:12.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e489b640 1 -- 172.21.15.177:0/1581332869 learned_addr learned my addr 172.21.15.177:0/1581332869 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:12.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31df7fe640 1 --2- 172.21.15.177:0/1581332869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31e00b3ac0 0x7f31e0159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31dffff640 1 --2- 172.21.15.177:0/1581332869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31e00ae010 0x7f31e014fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e489b640 1 -- 172.21.15.177:0/1581332869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31e00ae010 msgr2=0x7f31e014fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e489b640 1 --2- 172.21.15.177:0/1581332869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31e00ae010 0x7f31e014fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e489b640 1 -- 172.21.15.177:0/1581332869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31e00b3ac0 msgr2=0x7f31e0159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:12.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e489b640 1 --2- 172.21.15.177:0/1581332869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31e00b3ac0 0x7f31e0159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:12.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e489b640 1 -- 172.21.15.177:0/1581332869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d8009b30 con 0x7f31e015e590 2023-11-28T20:08:12.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e489b640 1 --2- 172.21.15.177:0/1581332869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e015e590 0x7f31e0148420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f31d801a520 tx=0x7f31d8019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:12.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31dcff9640 1 -- 172.21.15.177:0/1581332869 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d80a55b0 con 0x7f31e015e590 2023-11-28T20:08:12.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31dcff9640 1 -- 172.21.15.177:0/1581332869 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d80b8670 con 0x7f31e015e590 2023-11-28T20:08:12.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e509c640 1 -- 172.21.15.177:0/1581332869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e0159340 con 0x7f31e015e590 2023-11-28T20:08:12.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31dcff9640 1 -- 172.21.15.177:0/1581332869 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d80b89e0 con 0x7f31e015e590 2023-11-28T20:08:12.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e509c640 1 -- 172.21.15.177:0/1581332869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e01586c0 con 0x7f31e015e590 2023-11-28T20:08:12.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31e509c640 1 -- 172.21.15.177:0/1581332869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e0159580 con 0x7f31e015e590 2023-11-28T20:08:12.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.867+0000 7f31dcff9640 1 -- 172.21.15.177:0/1581332869 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f31d80b8b40 con 0x7f31e015e590 2023-11-28T20:08:12.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.871+0000 7f31dcff9640 1 --2- 172.21.15.177:0/1581332869 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f31cc066470 0x7f31cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:12.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.871+0000 7f31dcff9640 1 -- 172.21.15.177:0/1581332869 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31d811f0f0 con 0x7f31e015e590 2023-11-28T20:08:12.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.871+0000 7f31dffff640 1 --2- 172.21.15.177:0/1581332869 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f31cc066470 0x7f31cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:12.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.871+0000 7f31dffff640 1 --2- 172.21.15.177:0/1581332869 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f31cc066470 0x7f31cc068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009ac0 tx=0x7f31d0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:12.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:12.875+0000 7f31dcff9640 1 -- 172.21.15.177:0/1581332869 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f31e0159580 con 0x7f31e015e590 2023-11-28T20:08:13.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.023+0000 7f31e509c640 1 -- 172.21.15.177:0/1581332869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31e0159580 con 0x7f31e015e590 2023-11-28T20:08:13.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.023+0000 7f31dcff9640 1 -- 172.21.15.177:0/1581332869 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f31e0159580 con 0x7f31e015e590 2023-11-28T20:08:13.028 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:13.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.023+0000 7f31e509c640 1 -- 172.21.15.177:0/1581332869 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f31cc066470 msgr2=0x7f31cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.023+0000 7f31e509c640 1 --2- 172.21.15.177:0/1581332869 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f31cc066470 0x7f31cc068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009ac0 tx=0x7f31d0009190 comp rx=0 tx=0).stop 2023-11-28T20:08:13.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.023+0000 7f31e509c640 1 -- 172.21.15.177:0/1581332869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e015e590 msgr2=0x7f31e0148420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.023+0000 7f31e509c640 1 --2- 172.21.15.177:0/1581332869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e015e590 0x7f31e0148420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f31d801a520 tx=0x7f31d8019690 comp rx=0 tx=0).stop 2023-11-28T20:08:13.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.023+0000 7f31e509c640 1 -- 172.21.15.177:0/1581332869 shutdown_connections 2023-11-28T20:08:13.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.023+0000 7f31e509c640 1 --2- 172.21.15.177:0/1581332869 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f31cc066470 0x7f31cc068930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.023+0000 7f31e509c640 1 --2- 172.21.15.177:0/1581332869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e015e590 0x7f31e0148420 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.023+0000 7f31e509c640 1 --2- 172.21.15.177:0/1581332869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31e00b3ac0 0x7f31e0159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.023+0000 7f31e509c640 1 --2- 172.21.15.177:0/1581332869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31e00ae010 0x7f31e014fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.023+0000 7f31e509c640 1 -- 172.21.15.177:0/1581332869 >> 172.21.15.177:0/1581332869 conn(0x7f31e00b0920 msgr2=0x7f31e0164130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:13.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.023+0000 7f31e509c640 1 -- 172.21.15.177:0/1581332869 shutdown_connections 2023-11-28T20:08:13.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.023+0000 7f31e509c640 1 -- 172.21.15.177:0/1581332869 wait complete. 2023-11-28T20:08:13.049 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:13.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d99f80640 1 Processor -- start 2023-11-28T20:08:13.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d99f80640 1 -- start start 2023-11-28T20:08:13.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d99f80640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6d941571d0 0x7f6d94070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d99f80640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6d940ae830 0x7f6d9415d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d99f80640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d9415d710 0x7f6d94159be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d99f80640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9415db80 con 0x7f6d941571d0 2023-11-28T20:08:13.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d99f80640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d941575b0 con 0x7f6d940ae830 2023-11-28T20:08:13.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d99f80640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94071600 con 0x7f6d9415d710 2023-11-28T20:08:13.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d937fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6d941571d0 0x7f6d94070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d937fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6d941571d0 0x7f6d94070c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33574/0 (socket says 172.21.15.177:33574) 2023-11-28T20:08:13.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d937fe640 1 -- 172.21.15.177:0/1991935354 learned_addr learned my addr 172.21.15.177:0/1991935354 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:13.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d92ffd640 1 --2- 172.21.15.177:0/1991935354 >> v2:172.21.15.195:3300/0 conn(0x7f6d940ae830 0x7f6d9415d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d93fff640 1 --2- 172.21.15.177:0/1991935354 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d9415d710 0x7f6d94159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d937fe640 1 -- 172.21.15.177:0/1991935354 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d9415d710 msgr2=0x7f6d94159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:13.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d937fe640 1 --2- 172.21.15.177:0/1991935354 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d9415d710 0x7f6d94159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d937fe640 1 -- 172.21.15.177:0/1991935354 >> v2:172.21.15.195:3300/0 conn(0x7f6d940ae830 msgr2=0x7f6d9415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:13.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d937fe640 1 --2- 172.21.15.177:0/1991935354 >> v2:172.21.15.195:3300/0 conn(0x7f6d940ae830 0x7f6d9415d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d937fe640 1 -- 172.21.15.177:0/1991935354 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d940718e0 con 0x7f6d941571d0 2023-11-28T20:08:13.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.187+0000 7f6d92ffd640 1 --2- 172.21.15.177:0/1991935354 >> v2:172.21.15.195:3300/0 conn(0x7f6d940ae830 0x7f6d9415d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:13.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.191+0000 7f6d937fe640 1 --2- 172.21.15.177:0/1991935354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d941571d0 0x7f6d94070c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6d940b47c0 tx=0x7f6d8401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce33a9de0af9405 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:13.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.191+0000 7f6d927fc640 1 -- 172.21.15.177:0/1991935354 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d840ab640 con 0x7f6d941571d0 2023-11-28T20:08:13.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.191+0000 7f6d927fc640 1 -- 172.21.15.177:0/1991935354 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d840a7070 con 0x7f6d941571d0 2023-11-28T20:08:13.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.191+0000 7f6d927fc640 1 -- 172.21.15.177:0/1991935354 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d840ab9c0 con 0x7f6d941571d0 2023-11-28T20:08:13.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.191+0000 7f6d99f80640 1 -- 172.21.15.177:0/1991935354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d941571d0 msgr2=0x7f6d94070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.191+0000 7f6d99f80640 1 --2- 172.21.15.177:0/1991935354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d941571d0 0x7f6d94070c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6d940b47c0 tx=0x7f6d8401c500 comp rx=0 tx=0).stop 2023-11-28T20:08:13.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.191+0000 7f6d99f80640 1 -- 172.21.15.177:0/1991935354 shutdown_connections 2023-11-28T20:08:13.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.191+0000 7f6d99f80640 1 --2- 172.21.15.177:0/1991935354 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d9415d710 0x7f6d94159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.191+0000 7f6d99f80640 1 --2- 172.21.15.177:0/1991935354 >> v2:172.21.15.195:3300/0 conn(0x7f6d940ae830 0x7f6d9415d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.191+0000 7f6d99f80640 1 --2- 172.21.15.177:0/1991935354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d941571d0 0x7f6d94070c80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.191+0000 7f6d99f80640 1 -- 172.21.15.177:0/1991935354 >> 172.21.15.177:0/1991935354 conn(0x7f6d940b0cc0 msgr2=0x7f6d940b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:13.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.191+0000 7f6d99f80640 1 -- 172.21.15.177:0/1991935354 shutdown_connections 2023-11-28T20:08:13.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.191+0000 7f6d99f80640 1 -- 172.21.15.177:0/1991935354 wait complete. 2023-11-28T20:08:13.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.191+0000 7f6d99f80640 1 Processor -- start 2023-11-28T20:08:13.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d99f80640 1 -- start start 2023-11-28T20:08:13.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d99f80640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d940ae830 0x7f6d94143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d99f80640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d941571d0 0x7f6d94143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d99f80640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d9415d710 0x7f6d94163490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d99f80640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d941641c0 con 0x7f6d940ae830 2023-11-28T20:08:13.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d99f80640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9415b570 con 0x7f6d941571d0 2023-11-28T20:08:13.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d99f80640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94163ee0 con 0x7f6d9415d710 2023-11-28T20:08:13.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d937fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d940ae830 0x7f6d94143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d937fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d940ae830 0x7f6d94143600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33586/0 (socket says 172.21.15.177:33586) 2023-11-28T20:08:13.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d937fe640 1 -- 172.21.15.177:0/3865436413 learned_addr learned my addr 172.21.15.177:0/3865436413 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:13.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d92ffd640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d941571d0 0x7f6d94143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d93fff640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d9415d710 0x7f6d94163490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d937fe640 1 -- 172.21.15.177:0/3865436413 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d9415d710 msgr2=0x7f6d94163490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d937fe640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d9415d710 0x7f6d94163490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d937fe640 1 -- 172.21.15.177:0/3865436413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d941571d0 msgr2=0x7f6d94143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d937fe640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d941571d0 0x7f6d94143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d937fe640 1 -- 172.21.15.177:0/3865436413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d88009420 con 0x7f6d940ae830 2023-11-28T20:08:13.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d92ffd640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d941571d0 0x7f6d94143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:13.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d93fff640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d9415d710 0x7f6d94163490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:13.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d937fe640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d940ae830 0x7f6d94143600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6d8401cda0 tx=0x7f6d8401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:13.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d7bfff640 1 -- 172.21.15.177:0/3865436413 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d840abdd0 con 0x7f6d940ae830 2023-11-28T20:08:13.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d7bfff640 1 -- 172.21.15.177:0/3865436413 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d840be3f0 con 0x7f6d940ae830 2023-11-28T20:08:13.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d7bfff640 1 -- 172.21.15.177:0/3865436413 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d840be7a0 con 0x7f6d940ae830 2023-11-28T20:08:13.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d99f80640 1 -- 172.21.15.177:0/3865436413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d840094d0 con 0x7f6d940ae830 2023-11-28T20:08:13.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d99f80640 1 -- 172.21.15.177:0/3865436413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9415b190 con 0x7f6d940ae830 2023-11-28T20:08:13.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.195+0000 7f6d99f80640 1 -- 172.21.15.177:0/3865436413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9415ad10 con 0x7f6d940ae830 2023-11-28T20:08:13.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.199+0000 7f6d7bfff640 1 -- 172.21.15.177:0/3865436413 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6d840b43f0 con 0x7f6d940ae830 2023-11-28T20:08:13.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.199+0000 7f6d7bfff640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6d80066470 0x7f6d80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.199+0000 7f6d7bfff640 1 -- 172.21.15.177:0/3865436413 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d8411dff0 con 0x7f6d940ae830 2023-11-28T20:08:13.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.199+0000 7f6d92ffd640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6d80066470 0x7f6d80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.199+0000 7f6d92ffd640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6d80066470 0x7f6d80068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6d9415c820 tx=0x7f6d88008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:13.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.203+0000 7f6d7bfff640 1 -- 172.21.15.177:0/3865436413 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d9415ad10 con 0x7f6d940ae830 2023-11-28T20:08:13.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.351+0000 7f6d99f80640 1 -- 172.21.15.177:0/3865436413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6d9415ad10 con 0x7f6d940ae830 2023-11-28T20:08:13.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.351+0000 7f6d7bfff640 1 -- 172.21.15.177:0/3865436413 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d9415ad10 con 0x7f6d940ae830 2023-11-28T20:08:13.356 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:13.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.351+0000 7f6d99f80640 1 -- 172.21.15.177:0/3865436413 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6d80066470 msgr2=0x7f6d80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.351+0000 7f6d99f80640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6d80066470 0x7f6d80068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6d9415c820 tx=0x7f6d88008040 comp rx=0 tx=0).stop 2023-11-28T20:08:13.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.351+0000 7f6d99f80640 1 -- 172.21.15.177:0/3865436413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d940ae830 msgr2=0x7f6d94143600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.351+0000 7f6d99f80640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d940ae830 0x7f6d94143600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6d8401cda0 tx=0x7f6d8401ad40 comp rx=0 tx=0).stop 2023-11-28T20:08:13.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.351+0000 7f6d99f80640 1 -- 172.21.15.177:0/3865436413 shutdown_connections 2023-11-28T20:08:13.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.351+0000 7f6d99f80640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6d80066470 0x7f6d80068930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.351+0000 7f6d99f80640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d9415d710 0x7f6d94163490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.351+0000 7f6d99f80640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d941571d0 0x7f6d94143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.351+0000 7f6d99f80640 1 --2- 172.21.15.177:0/3865436413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d940ae830 0x7f6d94143600 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.351+0000 7f6d99f80640 1 -- 172.21.15.177:0/3865436413 >> 172.21.15.177:0/3865436413 conn(0x7f6d940b0cc0 msgr2=0x7f6d940b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:13.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.351+0000 7f6d99f80640 1 -- 172.21.15.177:0/3865436413 shutdown_connections 2023-11-28T20:08:13.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.351+0000 7f6d99f80640 1 -- 172.21.15.177:0/3865436413 wait complete. 2023-11-28T20:08:13.378 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:08:13.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.511+0000 7f35d4aea640 1 Processor -- start 2023-11-28T20:08:13.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.515+0000 7f35d4aea640 1 -- start start 2023-11-28T20:08:13.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.515+0000 7f35d4aea640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f35d013cf30 0x7f35d006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.515+0000 7f35d4aea640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d015b170 con 0x7f35d006c800 2023-11-28T20:08:13.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.515+0000 7f35d4aea640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d015b3a0 con 0x7f35d015ad40 2023-11-28T20:08:13.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.515+0000 7f35d4aea640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d013d310 con 0x7f35d013cf30 2023-11-28T20:08:13.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.515+0000 7f35ce59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f35d013cf30 0x7f35d006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.515+0000 7f35c7fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f35d006c800 0x7f35d015a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36506/0 (socket says 172.21.15.177:36506) 2023-11-28T20:08:13.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.515+0000 7f35c7fff640 1 -- 172.21.15.177:0/402751671 learned_addr learned my addr 172.21.15.177:0/402751671 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:13.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.515+0000 7f35cdd9b640 1 -- 172.21.15.177:0/402751671 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695663745 0 0) 0x7f35d015b170 con 0x7f35d006c800 2023-11-28T20:08:13.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.515+0000 7f35cdd9b640 1 -- 172.21.15.177:0/402751671 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35bc003530 con 0x7f35d006c800 2023-11-28T20:08:13.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.515+0000 7f35ce59c640 1 -- 172.21.15.177:0/402751671 >> v1:172.21.15.195:6789/0 conn(0x7f35d015ad40 legacy=0x7f35d00cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.515+0000 7f35ce59c640 1 -- 172.21.15.177:0/402751671 >> v1:172.21.15.177:6789/0 conn(0x7f35d006c800 legacy=0x7f35d015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.515+0000 7f35ce59c640 1 -- 172.21.15.177:0/402751671 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d013f720 con 0x7f35d013cf30 2023-11-28T20:08:13.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.519+0000 7f35ce59c640 1 --2- 172.21.15.177:0/402751671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d013cf30 0x7f35d006c2c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f35c00097c0 tx=0x7f35c001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95ea868658ce2a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:13.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.519+0000 7f35cdd9b640 1 -- 172.21.15.177:0/402751671 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c00ab600 con 0x7f35d013cf30 2023-11-28T20:08:13.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.519+0000 7f35cdd9b640 1 -- 172.21.15.177:0/402751671 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c00a7050 con 0x7f35d013cf30 2023-11-28T20:08:13.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.519+0000 7f35cdd9b640 1 -- 172.21.15.177:0/402751671 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c00ab980 con 0x7f35d013cf30 2023-11-28T20:08:13.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.519+0000 7f35d4aea640 1 -- 172.21.15.177:0/402751671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d013cf30 msgr2=0x7f35d006c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.519+0000 7f35d4aea640 1 --2- 172.21.15.177:0/402751671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d013cf30 0x7f35d006c2c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f35c00097c0 tx=0x7f35c001c3f0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.519+0000 7f35d4aea640 1 -- 172.21.15.177:0/402751671 shutdown_connections 2023-11-28T20:08:13.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.519+0000 7f35d4aea640 1 --2- 172.21.15.177:0/402751671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d013cf30 0x7f35d006c2c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.519+0000 7f35d4aea640 1 -- 172.21.15.177:0/402751671 >> 172.21.15.177:0/402751671 conn(0x7f35d006a530 msgr2=0x7f35d006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:13.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.519+0000 7f35d4aea640 1 -- 172.21.15.177:0/402751671 shutdown_connections 2023-11-28T20:08:13.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.519+0000 7f35d4aea640 1 -- 172.21.15.177:0/402751671 wait complete. 2023-11-28T20:08:13.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.519+0000 7f35d4aea640 1 Processor -- start 2023-11-28T20:08:13.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.519+0000 7f35d4aea640 1 -- start start 2023-11-28T20:08:13.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35d4aea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d006c800 0x7f35d01350d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35d4aea640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35d013cf30 0x7f35d0146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35d4aea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35d015ad40 0x7f35d0146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35d4aea640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0148e00 con 0x7f35d006c800 2023-11-28T20:08:13.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35d4aea640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0150570 con 0x7f35d013cf30 2023-11-28T20:08:13.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35d4aea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0135610 con 0x7f35d015ad40 2023-11-28T20:08:13.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35ce59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d006c800 0x7f35d01350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35ce59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d006c800 0x7f35d01350d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33596/0 (socket says 172.21.15.177:33596) 2023-11-28T20:08:13.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35ce59c640 1 -- 172.21.15.177:0/3429340456 learned_addr learned my addr 172.21.15.177:0/3429340456 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:13.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35c7fff640 1 --2- 172.21.15.177:0/3429340456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35d013cf30 0x7f35d0146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35ced9d640 1 --2- 172.21.15.177:0/3429340456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35d015ad40 0x7f35d0146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35ce59c640 1 -- 172.21.15.177:0/3429340456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35d015ad40 msgr2=0x7f35d0146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35ce59c640 1 --2- 172.21.15.177:0/3429340456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35d015ad40 0x7f35d0146950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35ce59c640 1 -- 172.21.15.177:0/3429340456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35d013cf30 msgr2=0x7f35d0146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35ce59c640 1 --2- 172.21.15.177:0/3429340456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35d013cf30 0x7f35d0146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35ce59c640 1 -- 172.21.15.177:0/3429340456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c0009420 con 0x7f35d006c800 2023-11-28T20:08:13.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35ce59c640 1 --2- 172.21.15.177:0/3429340456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d006c800 0x7f35d01350d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f35c0019000 tx=0x7f35c0019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:13.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35c6ffd640 1 -- 172.21.15.177:0/3429340456 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c00b4430 con 0x7f35d006c800 2023-11-28T20:08:13.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35c6ffd640 1 -- 172.21.15.177:0/3429340456 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c00b4590 con 0x7f35d006c800 2023-11-28T20:08:13.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35d4aea640 1 -- 172.21.15.177:0/3429340456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d014ff60 con 0x7f35d006c800 2023-11-28T20:08:13.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35c6ffd640 1 -- 172.21.15.177:0/3429340456 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c00b4940 con 0x7f35d006c800 2023-11-28T20:08:13.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35d4aea640 1 -- 172.21.15.177:0/3429340456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d0150200 con 0x7f35d006c800 2023-11-28T20:08:13.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.523+0000 7f35d4aea640 1 -- 172.21.15.177:0/3429340456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d0070440 con 0x7f35d006c800 2023-11-28T20:08:13.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.527+0000 7f35c6ffd640 1 -- 172.21.15.177:0/3429340456 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f35c00b2040 con 0x7f35d006c800 2023-11-28T20:08:13.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.527+0000 7f35c6ffd640 1 --2- 172.21.15.177:0/3429340456 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f35b0066470 0x7f35b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.527+0000 7f35c6ffd640 1 -- 172.21.15.177:0/3429340456 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35c011dd60 con 0x7f35d006c800 2023-11-28T20:08:13.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.527+0000 7f35c7fff640 1 --2- 172.21.15.177:0/3429340456 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f35b0066470 0x7f35b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.527+0000 7f35c7fff640 1 --2- 172.21.15.177:0/3429340456 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f35b0066470 0x7f35b0068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f35d014fdf0 tx=0x7f35b8007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:13.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.531+0000 7f35c6ffd640 1 -- 172.21.15.177:0/3429340456 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35d0070440 con 0x7f35d006c800 2023-11-28T20:08:13.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.691+0000 7f35d4aea640 1 -- 172.21.15.177:0/3429340456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f35d0070440 con 0x7f35d006c800 2023-11-28T20:08:13.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.691+0000 7f35c6ffd640 1 -- 172.21.15.177:0/3429340456 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f35d0070440 con 0x7f35d006c800 2023-11-28T20:08:13.696 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:08:13.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.691+0000 7f35d4aea640 1 -- 172.21.15.177:0/3429340456 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f35b0066470 msgr2=0x7f35b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.691+0000 7f35d4aea640 1 --2- 172.21.15.177:0/3429340456 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f35b0066470 0x7f35b0068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f35d014fdf0 tx=0x7f35b8007d40 comp rx=0 tx=0).stop 2023-11-28T20:08:13.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.691+0000 7f35d4aea640 1 -- 172.21.15.177:0/3429340456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d006c800 msgr2=0x7f35d01350d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.691+0000 7f35d4aea640 1 --2- 172.21.15.177:0/3429340456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d006c800 0x7f35d01350d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f35c0019000 tx=0x7f35c0019190 comp rx=0 tx=0).stop 2023-11-28T20:08:13.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.691+0000 7f35d4aea640 1 -- 172.21.15.177:0/3429340456 shutdown_connections 2023-11-28T20:08:13.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.691+0000 7f35d4aea640 1 --2- 172.21.15.177:0/3429340456 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f35b0066470 0x7f35b0068930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.691+0000 7f35d4aea640 1 --2- 172.21.15.177:0/3429340456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35d015ad40 0x7f35d0146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.691+0000 7f35d4aea640 1 --2- 172.21.15.177:0/3429340456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35d013cf30 0x7f35d0146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.691+0000 7f35d4aea640 1 --2- 172.21.15.177:0/3429340456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d006c800 0x7f35d01350d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.691+0000 7f35d4aea640 1 -- 172.21.15.177:0/3429340456 >> 172.21.15.177:0/3429340456 conn(0x7f35d006a530 msgr2=0x7f35d013d920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:13.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.695+0000 7f35d4aea640 1 -- 172.21.15.177:0/3429340456 shutdown_connections 2023-11-28T20:08:13.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.695+0000 7f35d4aea640 1 -- 172.21.15.177:0/3429340456 wait complete. 2023-11-28T20:08:13.717 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:08:13.718 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:08:13.727 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:13.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff96d69e640 1 Processor -- start 2023-11-28T20:08:13.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff96d69e640 1 -- start start 2023-11-28T20:08:13.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff96d69e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff968144840 0x7ff96806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff96d69e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff968070b70 0x7ff96806c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff96d69e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9680710e0 con 0x7ff968072180 2023-11-28T20:08:13.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff96d69e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96815f010 con 0x7ff968070b70 2023-11-28T20:08:13.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff96d69e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680713c0 con 0x7ff968144840 2023-11-28T20:08:13.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff966ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff968144840 0x7ff96806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff9677fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff968070b70 0x7ff96806c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff9667fc640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7ff968072180 0x7ff968070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:43654/0 (socket says 172.21.15.177:43654) 2023-11-28T20:08:13.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff9667fc640 1 -- 172.21.15.177:0/2175412444 learned_addr learned my addr 172.21.15.177:0/2175412444 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:13.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff966ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff968144840 0x7ff96806c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:60506/0 (socket says 172.21.15.177:60506) 2023-11-28T20:08:13.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff9677fe640 1 -- 172.21.15.177:0/2175412444 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff968144840 msgr2=0x7ff96806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:13.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff9677fe640 1 --2- 172.21.15.177:0/2175412444 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff968144840 0x7ff96806c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff9677fe640 1 -- 172.21.15.177:0/2175412444 >> v1:172.21.15.195:6789/0 conn(0x7ff968072180 legacy=0x7ff968070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff9677fe640 1 -- 172.21.15.177:0/2175412444 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680716a0 con 0x7ff968070b70 2023-11-28T20:08:13.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.907+0000 7ff965ffb640 1 -- 172.21.15.177:0/2175412444 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635458707 0 0) 0x7ff9680710e0 con 0x7ff968072180 2023-11-28T20:08:13.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.911+0000 7ff9677fe640 1 --2- 172.21.15.177:0/2175412444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff968070b70 0x7ff96806c800 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff960009d90 tx=0x7ff96001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9923182d39bd8f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:13.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.911+0000 7ff965ffb640 1 -- 172.21.15.177:0/2175412444 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9600a59e0 con 0x7ff968070b70 2023-11-28T20:08:13.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.911+0000 7ff965ffb640 1 -- 172.21.15.177:0/2175412444 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9600a5b40 con 0x7ff968070b70 2023-11-28T20:08:13.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.911+0000 7ff965ffb640 1 -- 172.21.15.177:0/2175412444 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9600ad440 con 0x7ff968070b70 2023-11-28T20:08:13.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.911+0000 7ff96d69e640 1 -- 172.21.15.177:0/2175412444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff968070b70 msgr2=0x7ff96806c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.911+0000 7ff96d69e640 1 --2- 172.21.15.177:0/2175412444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff968070b70 0x7ff96806c800 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff960009d90 tx=0x7ff96001c920 comp rx=0 tx=0).stop 2023-11-28T20:08:13.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.911+0000 7ff96d69e640 1 -- 172.21.15.177:0/2175412444 shutdown_connections 2023-11-28T20:08:13.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.911+0000 7ff96d69e640 1 --2- 172.21.15.177:0/2175412444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff968070b70 0x7ff96806c800 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.911+0000 7ff96d69e640 1 --2- 172.21.15.177:0/2175412444 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff968144840 0x7ff96806c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.911+0000 7ff96d69e640 1 -- 172.21.15.177:0/2175412444 >> 172.21.15.177:0/2175412444 conn(0x7ff96806a530 msgr2=0x7ff96806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:13.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.911+0000 7ff96d69e640 1 -- 172.21.15.177:0/2175412444 shutdown_connections 2023-11-28T20:08:13.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.911+0000 7ff96d69e640 1 -- 172.21.15.177:0/2175412444 wait complete. 2023-11-28T20:08:13.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff96d69e640 1 Processor -- start 2023-11-28T20:08:13.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff96d69e640 1 -- start start 2023-11-28T20:08:13.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff96d69e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff968070b70 0x7ff96815a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff96d69e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff968072180 0x7ff968158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff96d69e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff968144840 0x7ff96813caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff96d69e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff968140420 con 0x7ff968144840 2023-11-28T20:08:13.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff96d69e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96813f810 con 0x7ff968070b70 2023-11-28T20:08:13.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff96d69e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96813faf0 con 0x7ff968072180 2023-11-28T20:08:13.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff9677fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff968144840 0x7ff96813caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff9677fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff968144840 0x7ff96813caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33612/0 (socket says 172.21.15.177:33612) 2023-11-28T20:08:13.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff9677fe640 1 -- 172.21.15.177:0/2409632884 learned_addr learned my addr 172.21.15.177:0/2409632884 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:13.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff966ffd640 1 --2- 172.21.15.177:0/2409632884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff968070b70 0x7ff96815a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff9667fc640 1 --2- 172.21.15.177:0/2409632884 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff968072180 0x7ff968158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff9677fe640 1 -- 172.21.15.177:0/2409632884 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff968072180 msgr2=0x7ff968158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff9677fe640 1 --2- 172.21.15.177:0/2409632884 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff968072180 0x7ff968158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff9677fe640 1 -- 172.21.15.177:0/2409632884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff968070b70 msgr2=0x7ff96815a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:13.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff9677fe640 1 --2- 172.21.15.177:0/2409632884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff968070b70 0x7ff96815a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:13.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff9677fe640 1 -- 172.21.15.177:0/2409632884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff960009a70 con 0x7ff968144840 2023-11-28T20:08:13.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff966ffd640 1 --2- 172.21.15.177:0/2409632884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff968070b70 0x7ff96815a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:13.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff9677fe640 1 --2- 172.21.15.177:0/2409632884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff968144840 0x7ff96813caa0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff9600b0040 tx=0x7ff9600196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:13.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff94f7fe640 1 -- 172.21.15.177:0/2409632884 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9600adce0 con 0x7ff968144840 2023-11-28T20:08:13.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff94f7fe640 1 -- 172.21.15.177:0/2409632884 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9600ade40 con 0x7ff968144840 2023-11-28T20:08:13.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff96d69e640 1 -- 172.21.15.177:0/2409632884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96813fdd0 con 0x7ff968144840 2023-11-28T20:08:13.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff94f7fe640 1 -- 172.21.15.177:0/2409632884 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9600b9690 con 0x7ff968144840 2023-11-28T20:08:13.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff96d69e640 1 -- 172.21.15.177:0/2409632884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96813f3c0 con 0x7ff968144840 2023-11-28T20:08:13.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.915+0000 7ff96d69e640 1 -- 172.21.15.177:0/2409632884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff968069440 con 0x7ff968144840 2023-11-28T20:08:13.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.919+0000 7ff94f7fe640 1 -- 172.21.15.177:0/2409632884 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff9600b97f0 con 0x7ff968144840 2023-11-28T20:08:13.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.919+0000 7ff94f7fe640 1 --2- 172.21.15.177:0/2409632884 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff954066470 0x7ff954068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:13.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.919+0000 7ff94f7fe640 1 -- 172.21.15.177:0/2409632884 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff96011f610 con 0x7ff968144840 2023-11-28T20:08:13.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.919+0000 7ff966ffd640 1 --2- 172.21.15.177:0/2409632884 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff954066470 0x7ff954068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:13.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.919+0000 7ff966ffd640 1 --2- 172.21.15.177:0/2409632884 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff954066470 0x7ff954068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff9681f7160 tx=0x7ff958008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:13.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:13.923+0000 7ff94f7fe640 1 -- 172.21.15.177:0/2409632884 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9600ecaa0 con 0x7ff968144840 2023-11-28T20:08:14.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.075+0000 7ff96d69e640 1 -- 172.21.15.177:0/2409632884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff968140560 con 0x7ff968144840 2023-11-28T20:08:14.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.075+0000 7ff94f7fe640 1 -- 172.21.15.177:0/2409632884 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7ff960009450 con 0x7ff968144840 2023-11-28T20:08:14.080 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:14.080 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:14.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.075+0000 7ff96d69e640 1 -- 172.21.15.177:0/2409632884 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff954066470 msgr2=0x7ff954068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.075+0000 7ff96d69e640 1 --2- 172.21.15.177:0/2409632884 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff954066470 0x7ff954068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff9681f7160 tx=0x7ff958008040 comp rx=0 tx=0).stop 2023-11-28T20:08:14.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.075+0000 7ff96d69e640 1 -- 172.21.15.177:0/2409632884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff968144840 msgr2=0x7ff96813caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.075+0000 7ff96d69e640 1 --2- 172.21.15.177:0/2409632884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff968144840 0x7ff96813caa0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff9600b0040 tx=0x7ff9600196c0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.075+0000 7ff96d69e640 1 -- 172.21.15.177:0/2409632884 shutdown_connections 2023-11-28T20:08:14.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.075+0000 7ff96d69e640 1 --2- 172.21.15.177:0/2409632884 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff954066470 0x7ff954068930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.075+0000 7ff96d69e640 1 --2- 172.21.15.177:0/2409632884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff968144840 0x7ff96813caa0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.075+0000 7ff96d69e640 1 --2- 172.21.15.177:0/2409632884 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff968072180 0x7ff968158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.075+0000 7ff96d69e640 1 --2- 172.21.15.177:0/2409632884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff968070b70 0x7ff96815a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.075+0000 7ff96d69e640 1 -- 172.21.15.177:0/2409632884 >> 172.21.15.177:0/2409632884 conn(0x7ff96806a530 msgr2=0x7ff96815c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:14.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.075+0000 7ff96d69e640 1 -- 172.21.15.177:0/2409632884 shutdown_connections 2023-11-28T20:08:14.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.075+0000 7ff96d69e640 1 -- 172.21.15.177:0/2409632884 wait complete. 2023-11-28T20:08:14.101 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:14.102 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:14.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.239+0000 7ff78bb2a640 1 Processor -- start 2023-11-28T20:08:14.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.239+0000 7ff78bb2a640 1 -- start start 2023-11-28T20:08:14.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.239+0000 7ff78bb2a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff784158ca0 0x7ff78415eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.239+0000 7ff78bb2a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff7840cba10 0x7ff78415be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.239+0000 7ff78bb2a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff7840b42d0 0x7ff7840b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.239+0000 7ff78bb2a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7840b4c40 con 0x7ff7840cba10 2023-11-28T20:08:14.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.239+0000 7ff78bb2a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78415b670 con 0x7ff7840b42d0 2023-11-28T20:08:14.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.239+0000 7ff78bb2a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78415f410 con 0x7ff784158ca0 2023-11-28T20:08:14.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff7890c5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff7840cba10 0x7ff78415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff7890c5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff7840cba10 0x7ff78415be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33618/0 (socket says 172.21.15.177:33618) 2023-11-28T20:08:14.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff7890c5640 1 -- 172.21.15.177:0/1086077469 learned_addr learned my addr 172.21.15.177:0/1086077469 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:14.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff78a0c7640 1 --2- 172.21.15.177:0/1086077469 >> v2:172.21.15.195:3300/0 conn(0x7ff7840b42d0 0x7ff7840b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff7898c6640 1 --2- 172.21.15.177:0/1086077469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff784158ca0 0x7ff78415eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff7890c5640 1 -- 172.21.15.177:0/1086077469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff784158ca0 msgr2=0x7ff78415eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:14.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff7890c5640 1 --2- 172.21.15.177:0/1086077469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff784158ca0 0x7ff78415eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff7890c5640 1 -- 172.21.15.177:0/1086077469 >> v2:172.21.15.195:3300/0 conn(0x7ff7840b42d0 msgr2=0x7ff7840b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:14.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff7890c5640 1 --2- 172.21.15.177:0/1086077469 >> v2:172.21.15.195:3300/0 conn(0x7ff7840b42d0 0x7ff7840b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff7890c5640 1 -- 172.21.15.177:0/1086077469 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78415f6f0 con 0x7ff7840cba10 2023-11-28T20:08:14.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff78a0c7640 1 --2- 172.21.15.177:0/1086077469 >> v2:172.21.15.195:3300/0 conn(0x7ff7840b42d0 0x7ff7840b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:14.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff7898c6640 1 --2- 172.21.15.177:0/1086077469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff784158ca0 0x7ff78415eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:14.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff7890c5640 1 --2- 172.21.15.177:0/1086077469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7840cba10 0x7ff78415be00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff7840725c0 tx=0x7ff77401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45175914eb93d4e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:14.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff7888c4640 1 -- 172.21.15.177:0/1086077469 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7740aa610 con 0x7ff7840cba10 2023-11-28T20:08:14.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff7888c4640 1 -- 172.21.15.177:0/1086077469 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7740a6040 con 0x7ff7840cba10 2023-11-28T20:08:14.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.243+0000 7ff7888c4640 1 -- 172.21.15.177:0/1086077469 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7740aa990 con 0x7ff7840cba10 2023-11-28T20:08:14.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 -- 172.21.15.177:0/1086077469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7840cba10 msgr2=0x7ff78415be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 --2- 172.21.15.177:0/1086077469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7840cba10 0x7ff78415be00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff7840725c0 tx=0x7ff77401c4d0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 -- 172.21.15.177:0/1086077469 shutdown_connections 2023-11-28T20:08:14.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 --2- 172.21.15.177:0/1086077469 >> v2:172.21.15.195:3300/0 conn(0x7ff7840b42d0 0x7ff7840b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 --2- 172.21.15.177:0/1086077469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7840cba10 0x7ff78415be00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 --2- 172.21.15.177:0/1086077469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff784158ca0 0x7ff78415eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 -- 172.21.15.177:0/1086077469 >> 172.21.15.177:0/1086077469 conn(0x7ff7840b0cc0 msgr2=0x7ff7840b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:14.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 -- 172.21.15.177:0/1086077469 shutdown_connections 2023-11-28T20:08:14.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 -- 172.21.15.177:0/1086077469 wait complete. 2023-11-28T20:08:14.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 Processor -- start 2023-11-28T20:08:14.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 -- start start 2023-11-28T20:08:14.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7840b42d0 0x7ff784140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7840cba10 0x7ff784141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff784158ca0 0x7ff7841562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff784140db0 con 0x7ff7840cba10 2023-11-28T20:08:14.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7841532a0 con 0x7ff784158ca0 2023-11-28T20:08:14.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78bb2a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff784153580 con 0x7ff7840b42d0 2023-11-28T20:08:14.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff7890c5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7840cba10 0x7ff784141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff7890c5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7840cba10 0x7ff784141140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33620/0 (socket says 172.21.15.177:33620) 2023-11-28T20:08:14.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff7890c5640 1 -- 172.21.15.177:0/2918171044 learned_addr learned my addr 172.21.15.177:0/2918171044 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:14.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff78a0c7640 1 --2- 172.21.15.177:0/2918171044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff784158ca0 0x7ff7841562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff7898c6640 1 --2- 172.21.15.177:0/2918171044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7840b42d0 0x7ff784140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff7890c5640 1 -- 172.21.15.177:0/2918171044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7840b42d0 msgr2=0x7ff784140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff7890c5640 1 --2- 172.21.15.177:0/2918171044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7840b42d0 0x7ff784140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff7890c5640 1 -- 172.21.15.177:0/2918171044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff784158ca0 msgr2=0x7ff7841562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff7890c5640 1 --2- 172.21.15.177:0/2918171044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff784158ca0 0x7ff7841562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.247+0000 7ff7890c5640 1 -- 172.21.15.177:0/2918171044 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7740094d0 con 0x7ff7840cba10 2023-11-28T20:08:14.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.251+0000 7ff7890c5640 1 --2- 172.21.15.177:0/2918171044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7840cba10 0x7ff784141140 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff77401ab80 tx=0x7ff77401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:14.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.251+0000 7ff77a7fc640 1 -- 172.21.15.177:0/2918171044 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7740bd5f0 con 0x7ff7840cba10 2023-11-28T20:08:14.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.251+0000 7ff77a7fc640 1 -- 172.21.15.177:0/2918171044 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7740bd770 con 0x7ff7840cba10 2023-11-28T20:08:14.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.251+0000 7ff77a7fc640 1 -- 172.21.15.177:0/2918171044 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7740bdb20 con 0x7ff7840cba10 2023-11-28T20:08:14.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.251+0000 7ff78bb2a640 1 -- 172.21.15.177:0/2918171044 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff784153860 con 0x7ff7840cba10 2023-11-28T20:08:14.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.251+0000 7ff78bb2a640 1 -- 172.21.15.177:0/2918171044 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff784153e20 con 0x7ff7840cba10 2023-11-28T20:08:14.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.251+0000 7ff78bb2a640 1 -- 172.21.15.177:0/2918171044 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7840693d0 con 0x7ff7840cba10 2023-11-28T20:08:14.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.251+0000 7ff77a7fc640 1 -- 172.21.15.177:0/2918171044 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff7740b33f0 con 0x7ff7840cba10 2023-11-28T20:08:14.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.251+0000 7ff77a7fc640 1 --2- 172.21.15.177:0/2918171044 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff768066470 0x7ff768068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.251+0000 7ff77a7fc640 1 -- 172.21.15.177:0/2918171044 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff77411e440 con 0x7ff7840cba10 2023-11-28T20:08:14.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.251+0000 7ff7898c6640 1 --2- 172.21.15.177:0/2918171044 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff768066470 0x7ff768068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.255+0000 7ff7898c6640 1 --2- 172.21.15.177:0/2918171044 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff768066470 0x7ff768068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff780006fd0 tx=0x7ff780008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:14.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.255+0000 7ff77a7fc640 1 -- 172.21.15.177:0/2918171044 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff7740eb8d0 con 0x7ff7840cba10 2023-11-28T20:08:14.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.407+0000 7ff78bb2a640 1 -- 172.21.15.177:0/2918171044 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7840b1990 con 0x7ff7840cba10 2023-11-28T20:08:14.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.407+0000 7ff77a7fc640 1 -- 172.21.15.177:0/2918171044 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7740eeef0 con 0x7ff7840cba10 2023-11-28T20:08:14.413 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.411+0000 7ff78bb2a640 1 -- 172.21.15.177:0/2918171044 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff768066470 msgr2=0x7ff768068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.411+0000 7ff78bb2a640 1 --2- 172.21.15.177:0/2918171044 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff768066470 0x7ff768068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff780006fd0 tx=0x7ff780008040 comp rx=0 tx=0).stop 2023-11-28T20:08:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.411+0000 7ff78bb2a640 1 -- 172.21.15.177:0/2918171044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7840cba10 msgr2=0x7ff784141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.411+0000 7ff78bb2a640 1 --2- 172.21.15.177:0/2918171044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7840cba10 0x7ff784141140 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff77401ab80 tx=0x7ff77401ad10 comp rx=0 tx=0).stop 2023-11-28T20:08:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.411+0000 7ff78bb2a640 1 -- 172.21.15.177:0/2918171044 shutdown_connections 2023-11-28T20:08:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.411+0000 7ff78bb2a640 1 --2- 172.21.15.177:0/2918171044 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff768066470 0x7ff768068930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.411+0000 7ff78bb2a640 1 --2- 172.21.15.177:0/2918171044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff784158ca0 0x7ff7841562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.411+0000 7ff78bb2a640 1 --2- 172.21.15.177:0/2918171044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7840cba10 0x7ff784141140 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.411+0000 7ff78bb2a640 1 --2- 172.21.15.177:0/2918171044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7840b42d0 0x7ff784140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.411+0000 7ff78bb2a640 1 -- 172.21.15.177:0/2918171044 >> 172.21.15.177:0/2918171044 conn(0x7ff7840b0cc0 msgr2=0x7ff7840cbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:14.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.411+0000 7ff78bb2a640 1 -- 172.21.15.177:0/2918171044 shutdown_connections 2023-11-28T20:08:14.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.411+0000 7ff78bb2a640 1 -- 172.21.15.177:0/2918171044 wait complete. 2023-11-28T20:08:14.434 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:14.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.571+0000 7fb7e4079640 1 Processor -- start 2023-11-28T20:08:14.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.571+0000 7fb7e4079640 1 -- start start 2023-11-28T20:08:14.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.571+0000 7fb7e4079640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7dc145ea0 0x7fb7dc160de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.571+0000 7fb7e4079640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb7dc0ac840 0x7fb7dc161320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.571+0000 7fb7e4079640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc0b2390 con 0x7fb7dc146a60 2023-11-28T20:08:14.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.571+0000 7fb7e4079640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc146510 con 0x7fb7dc0ac840 2023-11-28T20:08:14.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.571+0000 7fb7e4079640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc0b2060 con 0x7fb7dc145ea0 2023-11-28T20:08:14.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.571+0000 7fb7e1e15640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7dc145ea0 0x7fb7dc160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.571+0000 7fb7e1614640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb7dc0ac840 0x7fb7dc161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.571+0000 7fb7e2616640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb7dc146a60 0x7fb7dc070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:43668/0 (socket says 172.21.15.177:43668) 2023-11-28T20:08:14.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.571+0000 7fb7e2616640 1 -- 172.21.15.177:0/939958594 learned_addr learned my addr 172.21.15.177:0/939958594 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:14.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.571+0000 7fb7e1e15640 1 -- 172.21.15.177:0/939958594 >> v2:172.21.15.195:3300/0 conn(0x7fb7dc0ac840 msgr2=0x7fb7dc161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:14.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.571+0000 7fb7e1e15640 1 --2- 172.21.15.177:0/939958594 >> v2:172.21.15.195:3300/0 conn(0x7fb7dc0ac840 0x7fb7dc161320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.571+0000 7fb7e1e15640 1 -- 172.21.15.177:0/939958594 >> v1:172.21.15.195:6789/0 conn(0x7fb7dc146a60 legacy=0x7fb7dc070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.571+0000 7fb7e1e15640 1 -- 172.21.15.177:0/939958594 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc1467b0 con 0x7fb7dc145ea0 2023-11-28T20:08:14.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.575+0000 7fb7e1e15640 1 --2- 172.21.15.177:0/939958594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7dc145ea0 0x7fb7dc160de0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80097c0 tx=0x7fb7d801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3dd5d0f049efd25 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:14.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.575+0000 7fb7e0e13640 1 -- 172.21.15.177:0/939958594 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80ad640 con 0x7fb7dc145ea0 2023-11-28T20:08:14.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.575+0000 7fb7e0e13640 1 -- 172.21.15.177:0/939958594 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d80ad7a0 con 0x7fb7dc145ea0 2023-11-28T20:08:14.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.575+0000 7fb7e0e13640 1 -- 172.21.15.177:0/939958594 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80adb30 con 0x7fb7dc145ea0 2023-11-28T20:08:14.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.575+0000 7fb7e4079640 1 -- 172.21.15.177:0/939958594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7dc145ea0 msgr2=0x7fb7dc160de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.575+0000 7fb7e4079640 1 --2- 172.21.15.177:0/939958594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7dc145ea0 0x7fb7dc160de0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80097c0 tx=0x7fb7d801c480 comp rx=0 tx=0).stop 2023-11-28T20:08:14.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.575+0000 7fb7e4079640 1 -- 172.21.15.177:0/939958594 shutdown_connections 2023-11-28T20:08:14.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.575+0000 7fb7e4079640 1 --2- 172.21.15.177:0/939958594 >> v2:172.21.15.195:3300/0 conn(0x7fb7dc0ac840 0x7fb7dc161320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.575+0000 7fb7e4079640 1 --2- 172.21.15.177:0/939958594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7dc145ea0 0x7fb7dc160de0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.575+0000 7fb7e4079640 1 -- 172.21.15.177:0/939958594 >> 172.21.15.177:0/939958594 conn(0x7fb7dc0b0cc0 msgr2=0x7fb7dc0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:14.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.575+0000 7fb7e4079640 1 -- 172.21.15.177:0/939958594 shutdown_connections 2023-11-28T20:08:14.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.575+0000 7fb7e4079640 1 -- 172.21.15.177:0/939958594 wait complete. 2023-11-28T20:08:14.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e4079640 1 Processor -- start 2023-11-28T20:08:14.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e4079640 1 -- start start 2023-11-28T20:08:14.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e4079640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7dc0ac840 0x7fb7dc13ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e4079640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7dc145ea0 0x7fb7dc141370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e4079640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7dc146a60 0x7fb7dc15c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e4079640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc140f50 con 0x7fb7dc0ac840 2023-11-28T20:08:14.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e4079640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc1402d0 con 0x7fb7dc145ea0 2023-11-28T20:08:14.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e4079640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc1405b0 con 0x7fb7dc146a60 2023-11-28T20:08:14.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e1e15640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7dc0ac840 0x7fb7dc13ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e1e15640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7dc0ac840 0x7fb7dc13ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33634/0 (socket says 172.21.15.177:33634) 2023-11-28T20:08:14.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e1e15640 1 -- 172.21.15.177:0/5464186 learned_addr learned my addr 172.21.15.177:0/5464186 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:14.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e1614640 1 --2- 172.21.15.177:0/5464186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7dc145ea0 0x7fb7dc141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e2616640 1 --2- 172.21.15.177:0/5464186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7dc146a60 0x7fb7dc15c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e1e15640 1 -- 172.21.15.177:0/5464186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7dc146a60 msgr2=0x7fb7dc15c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e1e15640 1 --2- 172.21.15.177:0/5464186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7dc146a60 0x7fb7dc15c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e1e15640 1 -- 172.21.15.177:0/5464186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7dc145ea0 msgr2=0x7fb7dc141370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e1e15640 1 --2- 172.21.15.177:0/5464186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7dc145ea0 0x7fb7dc141370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e1e15640 1 -- 172.21.15.177:0/5464186 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d8009420 con 0x7fb7dc0ac840 2023-11-28T20:08:14.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e1e15640 1 --2- 172.21.15.177:0/5464186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7dc0ac840 0x7fb7dc13ef50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80b0040 tx=0x7fb7d8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:14.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7d27fc640 1 -- 172.21.15.177:0/5464186 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80b6610 con 0x7fb7dc0ac840 2023-11-28T20:08:14.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7d27fc640 1 -- 172.21.15.177:0/5464186 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d80a6040 con 0x7fb7dc0ac840 2023-11-28T20:08:14.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e4079640 1 -- 172.21.15.177:0/5464186 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc140890 con 0x7fb7dc0ac840 2023-11-28T20:08:14.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7d27fc640 1 -- 172.21.15.177:0/5464186 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80b6990 con 0x7fb7dc0ac840 2023-11-28T20:08:14.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.579+0000 7fb7e4079640 1 -- 172.21.15.177:0/5464186 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc15ce70 con 0x7fb7dc0ac840 2023-11-28T20:08:14.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.583+0000 7fb7e4079640 1 -- 172.21.15.177:0/5464186 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc1411c0 con 0x7fb7dc0ac840 2023-11-28T20:08:14.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.583+0000 7fb7d27fc640 1 -- 172.21.15.177:0/5464186 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb7d80b4040 con 0x7fb7dc0ac840 2023-11-28T20:08:14.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.583+0000 7fb7d27fc640 1 --2- 172.21.15.177:0/5464186 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb7c0066470 0x7fb7c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.583+0000 7fb7d27fc640 1 -- 172.21.15.177:0/5464186 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7d811e060 con 0x7fb7dc0ac840 2023-11-28T20:08:14.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.583+0000 7fb7e1614640 1 --2- 172.21.15.177:0/5464186 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb7c0066470 0x7fb7c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.583+0000 7fb7e1614640 1 --2- 172.21.15.177:0/5464186 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb7c0066470 0x7fb7c0068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc13df80 tx=0x7fb7cc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:14.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.587+0000 7fb7d27fc640 1 -- 172.21.15.177:0/5464186 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb7d80eb690 con 0x7fb7dc0ac840 2023-11-28T20:08:14.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.735+0000 7fb7e4079640 1 -- 172.21.15.177:0/5464186 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7dc0693d0 con 0x7fb7dc0ac840 2023-11-28T20:08:14.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.735+0000 7fb7d27fc640 1 -- 172.21.15.177:0/5464186 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7d80b20a0 con 0x7fb7dc0ac840 2023-11-28T20:08:14.741 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:14.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.739+0000 7fb7e4079640 1 -- 172.21.15.177:0/5464186 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb7c0066470 msgr2=0x7fb7c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.739+0000 7fb7e4079640 1 --2- 172.21.15.177:0/5464186 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb7c0066470 0x7fb7c0068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc13df80 tx=0x7fb7cc009190 comp rx=0 tx=0).stop 2023-11-28T20:08:14.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.739+0000 7fb7e4079640 1 -- 172.21.15.177:0/5464186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7dc0ac840 msgr2=0x7fb7dc13ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.739+0000 7fb7e4079640 1 --2- 172.21.15.177:0/5464186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7dc0ac840 0x7fb7dc13ef50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80b0040 tx=0x7fb7d8019220 comp rx=0 tx=0).stop 2023-11-28T20:08:14.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.739+0000 7fb7e4079640 1 -- 172.21.15.177:0/5464186 shutdown_connections 2023-11-28T20:08:14.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.739+0000 7fb7e4079640 1 --2- 172.21.15.177:0/5464186 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb7c0066470 0x7fb7c0068930 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.739+0000 7fb7e4079640 1 --2- 172.21.15.177:0/5464186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7dc146a60 0x7fb7dc15c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.739+0000 7fb7e4079640 1 --2- 172.21.15.177:0/5464186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7dc145ea0 0x7fb7dc141370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.739+0000 7fb7e4079640 1 --2- 172.21.15.177:0/5464186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7dc0ac840 0x7fb7dc13ef50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.739+0000 7fb7e4079640 1 -- 172.21.15.177:0/5464186 >> 172.21.15.177:0/5464186 conn(0x7fb7dc0b0cc0 msgr2=0x7fb7dc15fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:14.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.739+0000 7fb7e4079640 1 -- 172.21.15.177:0/5464186 shutdown_connections 2023-11-28T20:08:14.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.739+0000 7fb7e4079640 1 -- 172.21.15.177:0/5464186 wait complete. 2023-11-28T20:08:14.761 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:14.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.895+0000 7efcac45a640 1 Processor -- start 2023-11-28T20:08:14.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.895+0000 7efcac45a640 1 -- start start 2023-11-28T20:08:14.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.899+0000 7efcac45a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efca41571d0 0x7efca4070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.899+0000 7efcac45a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca41575b0 con 0x7efca415d8e0 2023-11-28T20:08:14.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.899+0000 7efcac45a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca4071600 con 0x7efca40ae830 2023-11-28T20:08:14.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.899+0000 7efcac45a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca40718e0 con 0x7efca41571d0 2023-11-28T20:08:14.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.899+0000 7efcaa1f6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efca41571d0 0x7efca4070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.899+0000 7efcaa9f7640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7efca415d8e0 0x7efca40ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36518/0 (socket says 172.21.15.177:36518) 2023-11-28T20:08:14.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.899+0000 7efcaa9f7640 1 -- 172.21.15.177:0/1874684176 learned_addr learned my addr 172.21.15.177:0/1874684176 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:14.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.899+0000 7efcaa1f6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efca41571d0 0x7efca4070c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33648/0 (socket says 172.21.15.177:33648) 2023-11-28T20:08:14.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.899+0000 7efcaa1f6640 1 -- 172.21.15.177:0/1874684176 >> v1:172.21.15.195:6789/0 conn(0x7efca40ae830 legacy=0x7efca415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.899+0000 7efcaa1f6640 1 -- 172.21.15.177:0/1874684176 >> v1:172.21.15.177:6789/0 conn(0x7efca415d8e0 legacy=0x7efca40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.899+0000 7efcaa1f6640 1 -- 172.21.15.177:0/1874684176 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca4071bc0 con 0x7efca41571d0 2023-11-28T20:08:14.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.899+0000 7efca91f4640 1 -- 172.21.15.177:0/1874684176 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 427036080 0 0) 0x7efca41575b0 con 0x7efca415d8e0 2023-11-28T20:08:14.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.903+0000 7efcaa1f6640 1 --2- 172.21.15.177:0/1874684176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efca41571d0 0x7efca4070c80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efca00097c0 tx=0x7efca001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b80cef33d2485e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:14.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.903+0000 7efca91f4640 1 -- 172.21.15.177:0/1874684176 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00ab5f0 con 0x7efca41571d0 2023-11-28T20:08:14.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.903+0000 7efca91f4640 1 -- 172.21.15.177:0/1874684176 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca00ab750 con 0x7efca41571d0 2023-11-28T20:08:14.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.903+0000 7efca91f4640 1 -- 172.21.15.177:0/1874684176 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00abae0 con 0x7efca41571d0 2023-11-28T20:08:14.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.903+0000 7efcac45a640 1 -- 172.21.15.177:0/1874684176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efca41571d0 msgr2=0x7efca4070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.903+0000 7efcac45a640 1 --2- 172.21.15.177:0/1874684176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efca41571d0 0x7efca4070c80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efca00097c0 tx=0x7efca001c3f0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.903+0000 7efcac45a640 1 -- 172.21.15.177:0/1874684176 shutdown_connections 2023-11-28T20:08:14.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.903+0000 7efcac45a640 1 --2- 172.21.15.177:0/1874684176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efca41571d0 0x7efca4070c80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.903+0000 7efcac45a640 1 -- 172.21.15.177:0/1874684176 >> 172.21.15.177:0/1874684176 conn(0x7efca40b0cc0 msgr2=0x7efca40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:14.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.903+0000 7efcac45a640 1 -- 172.21.15.177:0/1874684176 shutdown_connections 2023-11-28T20:08:14.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.903+0000 7efcac45a640 1 -- 172.21.15.177:0/1874684176 wait complete. 2023-11-28T20:08:14.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.903+0000 7efcac45a640 1 Processor -- start 2023-11-28T20:08:14.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.903+0000 7efcac45a640 1 -- start start 2023-11-28T20:08:14.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcac45a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efca40ae830 0x7efca4146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcac45a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efca41571d0 0x7efca4151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcac45a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efca415d8e0 0x7efca40703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcac45a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca40b2c80 con 0x7efca40ae830 2023-11-28T20:08:14.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcac45a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca4147c10 con 0x7efca415d8e0 2023-11-28T20:08:14.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcac45a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca40b2ed0 con 0x7efca41571d0 2023-11-28T20:08:14.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcaa1f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efca40ae830 0x7efca4146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcaa1f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efca40ae830 0x7efca4146db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33650/0 (socket says 172.21.15.177:33650) 2023-11-28T20:08:14.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcaa1f6640 1 -- 172.21.15.177:0/1092536251 learned_addr learned my addr 172.21.15.177:0/1092536251 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:14.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcaa1f6640 1 -- 172.21.15.177:0/1092536251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efca41571d0 msgr2=0x7efca4151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcaa1f6640 1 --2- 172.21.15.177:0/1092536251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efca41571d0 0x7efca4151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcaa9f7640 1 --2- 172.21.15.177:0/1092536251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efca415d8e0 0x7efca40703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcaa1f6640 1 -- 172.21.15.177:0/1092536251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efca415d8e0 msgr2=0x7efca40703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:14.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcaa1f6640 1 --2- 172.21.15.177:0/1092536251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efca415d8e0 0x7efca40703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:14.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcaa1f6640 1 -- 172.21.15.177:0/1092536251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca0009420 con 0x7efca40ae830 2023-11-28T20:08:14.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcaa9f7640 1 --2- 172.21.15.177:0/1092536251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efca415d8e0 0x7efca40703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:14.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcaa1f6640 1 --2- 172.21.15.177:0/1092536251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efca40ae830 0x7efca4146db0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efca00ad040 tx=0x7efca001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:14.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efc9affd640 1 -- 172.21.15.177:0/1092536251 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00b5810 con 0x7efca40ae830 2023-11-28T20:08:14.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efc9affd640 1 -- 172.21.15.177:0/1092536251 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca00b5990 con 0x7efca40ae830 2023-11-28T20:08:14.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efc9affd640 1 -- 172.21.15.177:0/1092536251 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00b5d40 con 0x7efca40ae830 2023-11-28T20:08:14.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcac45a640 1 -- 172.21.15.177:0/1092536251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca40b31b0 con 0x7efca40ae830 2023-11-28T20:08:14.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcac45a640 1 -- 172.21.15.177:0/1092536251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca4151630 con 0x7efca40ae830 2023-11-28T20:08:14.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efcac45a640 1 -- 172.21.15.177:0/1092536251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca4151820 con 0x7efca40ae830 2023-11-28T20:08:14.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.907+0000 7efc9affd640 1 -- 172.21.15.177:0/1092536251 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efca00c93f0 con 0x7efca40ae830 2023-11-28T20:08:14.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.911+0000 7efc9affd640 1 --2- 172.21.15.177:0/1092536251 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efc88066470 0x7efc88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:14.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.911+0000 7efc9affd640 1 -- 172.21.15.177:0/1092536251 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efca00a8050 con 0x7efca40ae830 2023-11-28T20:08:14.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.911+0000 7efca99f5640 1 --2- 172.21.15.177:0/1092536251 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efc88066470 0x7efc88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:14.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.911+0000 7efca99f5640 1 --2- 172.21.15.177:0/1092536251 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efc88066470 0x7efc88068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efc94000f70 tx=0x7efc940079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:14.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:14.915+0000 7efc9affd640 1 -- 172.21.15.177:0/1092536251 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efca00ebf90 con 0x7efca40ae830 2023-11-28T20:08:15.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.063+0000 7efcac45a640 1 -- 172.21.15.177:0/1092536251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efca40693d0 con 0x7efca40ae830 2023-11-28T20:08:15.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.063+0000 7efc9affd640 1 -- 172.21.15.177:0/1092536251 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7efca00c40a0 con 0x7efca40ae830 2023-11-28T20:08:15.068 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:15.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.063+0000 7efcac45a640 1 -- 172.21.15.177:0/1092536251 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efc88066470 msgr2=0x7efc88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:15.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.063+0000 7efcac45a640 1 --2- 172.21.15.177:0/1092536251 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efc88066470 0x7efc88068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efc94000f70 tx=0x7efc940079c0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.063+0000 7efcac45a640 1 -- 172.21.15.177:0/1092536251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efca40ae830 msgr2=0x7efca4146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:15.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.063+0000 7efcac45a640 1 --2- 172.21.15.177:0/1092536251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efca40ae830 0x7efca4146db0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efca00ad040 tx=0x7efca001ac30 comp rx=0 tx=0).stop 2023-11-28T20:08:15.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.063+0000 7efcac45a640 1 -- 172.21.15.177:0/1092536251 shutdown_connections 2023-11-28T20:08:15.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.063+0000 7efcac45a640 1 --2- 172.21.15.177:0/1092536251 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efc88066470 0x7efc88068930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.063+0000 7efcac45a640 1 --2- 172.21.15.177:0/1092536251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efca415d8e0 0x7efca40703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.063+0000 7efcac45a640 1 --2- 172.21.15.177:0/1092536251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efca41571d0 0x7efca4151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.063+0000 7efcac45a640 1 --2- 172.21.15.177:0/1092536251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efca40ae830 0x7efca4146db0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.063+0000 7efcac45a640 1 -- 172.21.15.177:0/1092536251 >> 172.21.15.177:0/1092536251 conn(0x7efca40b0cc0 msgr2=0x7efca4157770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:15.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.067+0000 7efcac45a640 1 -- 172.21.15.177:0/1092536251 shutdown_connections 2023-11-28T20:08:15.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.067+0000 7efcac45a640 1 -- 172.21.15.177:0/1092536251 wait complete. 2023-11-28T20:08:15.089 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:08:15.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.223+0000 7eff79a9c640 1 Processor -- start 2023-11-28T20:08:15.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.223+0000 7eff79a9c640 1 -- start start 2023-11-28T20:08:15.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.223+0000 7eff79a9c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7eff740cfe90 0x7eff740d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:15.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.223+0000 7eff79a9c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7eff740b3c70 0x7eff7415f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:15.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.223+0000 7eff79a9c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff740d3880 con 0x7eff740b35b0 2023-11-28T20:08:15.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.223+0000 7eff79a9c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff740d4090 con 0x7eff740b3c70 2023-11-28T20:08:15.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.223+0000 7eff79a9c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff740cdc80 con 0x7eff740cfe90 2023-11-28T20:08:15.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.223+0000 7eff73fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7eff740b3c70 0x7eff7415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:15.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.223+0000 7eff73fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7eff740b3c70 0x7eff7415f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33658/0 (socket says 172.21.15.177:33658) 2023-11-28T20:08:15.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.223+0000 7eff73fff640 1 -- 172.21.15.177:0/581319894 learned_addr learned my addr 172.21.15.177:0/581319894 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:15.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.223+0000 7eff72ffd640 1 --2- 172.21.15.177:0/581319894 >> v2:172.21.15.195:3300/0 conn(0x7eff740cfe90 0x7eff740d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:15.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.223+0000 7eff73fff640 1 -- 172.21.15.177:0/581319894 >> v2:172.21.15.195:3300/0 conn(0x7eff740cfe90 msgr2=0x7eff740d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:15.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.223+0000 7eff73fff640 1 --2- 172.21.15.177:0/581319894 >> v2:172.21.15.195:3300/0 conn(0x7eff740cfe90 0x7eff740d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.223+0000 7eff73fff640 1 -- 172.21.15.177:0/581319894 >> v1:172.21.15.177:6789/0 conn(0x7eff740b35b0 legacy=0x7eff740cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:15.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.223+0000 7eff73fff640 1 -- 172.21.15.177:0/581319894 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff740d3ad0 con 0x7eff740b3c70 2023-11-28T20:08:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.227+0000 7eff73fff640 1 --2- 172.21.15.177:0/581319894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff740b3c70 0x7eff7415f060 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7eff7408bde0 tx=0x7eff6c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb56be980aa102c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.227+0000 7eff727fc640 1 -- 172.21.15.177:0/581319894 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c0a5890 con 0x7eff740b3c70 2023-11-28T20:08:15.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.227+0000 7eff727fc640 1 -- 172.21.15.177:0/581319894 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c0a59f0 con 0x7eff740b3c70 2023-11-28T20:08:15.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.227+0000 7eff727fc640 1 -- 172.21.15.177:0/581319894 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c0a5d80 con 0x7eff740b3c70 2023-11-28T20:08:15.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.227+0000 7eff79a9c640 1 -- 172.21.15.177:0/581319894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff740b3c70 msgr2=0x7eff7415f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:15.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.227+0000 7eff79a9c640 1 --2- 172.21.15.177:0/581319894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff740b3c70 0x7eff7415f060 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7eff7408bde0 tx=0x7eff6c01c9d0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.227+0000 7eff79a9c640 1 -- 172.21.15.177:0/581319894 shutdown_connections 2023-11-28T20:08:15.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.227+0000 7eff79a9c640 1 --2- 172.21.15.177:0/581319894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff740b3c70 0x7eff7415f060 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.227+0000 7eff79a9c640 1 --2- 172.21.15.177:0/581319894 >> v2:172.21.15.195:3300/0 conn(0x7eff740cfe90 0x7eff740d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.227+0000 7eff79a9c640 1 -- 172.21.15.177:0/581319894 >> 172.21.15.177:0/581319894 conn(0x7eff7409c4b0 msgr2=0x7eff740d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:15.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.227+0000 7eff79a9c640 1 -- 172.21.15.177:0/581319894 shutdown_connections 2023-11-28T20:08:15.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.227+0000 7eff79a9c640 1 -- 172.21.15.177:0/581319894 wait complete. 2023-11-28T20:08:15.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff79a9c640 1 Processor -- start 2023-11-28T20:08:15.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff79a9c640 1 -- start start 2023-11-28T20:08:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff79a9c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff740b35b0 0x7eff740cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff79a9c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff740b3c70 0x7eff74159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff79a9c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff740cfe90 0x7eff7415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff79a9c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff740b8a40 con 0x7eff740b35b0 2023-11-28T20:08:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff79a9c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff74159fc0 con 0x7eff740cfe90 2023-11-28T20:08:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff79a9c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7415a340 con 0x7eff740b3c70 2023-11-28T20:08:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff737fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff740b35b0 0x7eff740cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff737fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff740b35b0 0x7eff740cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33674/0 (socket says 172.21.15.177:33674) 2023-11-28T20:08:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff737fe640 1 -- 172.21.15.177:0/957937243 learned_addr learned my addr 172.21.15.177:0/957937243 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff73fff640 1 --2- 172.21.15.177:0/957937243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff740cfe90 0x7eff7415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff72ffd640 1 --2- 172.21.15.177:0/957937243 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff740b3c70 0x7eff74159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff737fe640 1 -- 172.21.15.177:0/957937243 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff740b3c70 msgr2=0x7eff74159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff737fe640 1 --2- 172.21.15.177:0/957937243 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff740b3c70 0x7eff74159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff737fe640 1 -- 172.21.15.177:0/957937243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff740cfe90 msgr2=0x7eff7415b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:15.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff737fe640 1 --2- 172.21.15.177:0/957937243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff740cfe90 0x7eff7415b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff737fe640 1 -- 172.21.15.177:0/957937243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c009b30 con 0x7eff740b35b0 2023-11-28T20:08:15.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff737fe640 1 --2- 172.21.15.177:0/957937243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff740b35b0 0x7eff740cd150 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7eff6400c500 tx=0x7eff6400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:15.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff5bfff640 1 -- 172.21.15.177:0/957937243 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64005220 con 0x7eff740b35b0 2023-11-28T20:08:15.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff5bfff640 1 -- 172.21.15.177:0/957937243 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff64005380 con 0x7eff740b35b0 2023-11-28T20:08:15.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff5bfff640 1 -- 172.21.15.177:0/957937243 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64007270 con 0x7eff740b35b0 2023-11-28T20:08:15.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff79a9c640 1 -- 172.21.15.177:0/957937243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff7415a620 con 0x7eff740b35b0 2023-11-28T20:08:15.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.231+0000 7eff79a9c640 1 -- 172.21.15.177:0/957937243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7415abe0 con 0x7eff740b35b0 2023-11-28T20:08:15.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.235+0000 7eff79a9c640 1 -- 172.21.15.177:0/957937243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff74069440 con 0x7eff740b35b0 2023-11-28T20:08:15.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.235+0000 7eff5bfff640 1 -- 172.21.15.177:0/957937243 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff640073d0 con 0x7eff740b35b0 2023-11-28T20:08:15.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.235+0000 7eff5bfff640 1 --2- 172.21.15.177:0/957937243 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7eff60066470 0x7eff60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:15.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.235+0000 7eff5bfff640 1 -- 172.21.15.177:0/957937243 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff64083710 con 0x7eff740b35b0 2023-11-28T20:08:15.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.235+0000 7eff72ffd640 1 --2- 172.21.15.177:0/957937243 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7eff60066470 0x7eff60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:15.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.235+0000 7eff72ffd640 1 --2- 172.21.15.177:0/957937243 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7eff60066470 0x7eff60068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7eff740cd790 tx=0x7eff68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:15.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.239+0000 7eff5bfff640 1 -- 172.21.15.177:0/957937243 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff64050bb0 con 0x7eff740b35b0 2023-11-28T20:08:15.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.399+0000 7eff79a9c640 1 -- 172.21.15.177:0/957937243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7eff7415ec30 con 0x7eff740b35b0 2023-11-28T20:08:15.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.399+0000 7eff5bfff640 1 -- 172.21.15.177:0/957937243 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7eff640541d0 con 0x7eff740b35b0 2023-11-28T20:08:15.405 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:08:15.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.403+0000 7eff79a9c640 1 -- 172.21.15.177:0/957937243 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7eff60066470 msgr2=0x7eff60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:15.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.403+0000 7eff79a9c640 1 --2- 172.21.15.177:0/957937243 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7eff60066470 0x7eff60068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7eff740cd790 tx=0x7eff68008040 comp rx=0 tx=0).stop 2023-11-28T20:08:15.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.403+0000 7eff79a9c640 1 -- 172.21.15.177:0/957937243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff740b35b0 msgr2=0x7eff740cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:15.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.403+0000 7eff79a9c640 1 --2- 172.21.15.177:0/957937243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff740b35b0 0x7eff740cd150 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7eff6400c500 tx=0x7eff6400c9c0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.403+0000 7eff79a9c640 1 -- 172.21.15.177:0/957937243 shutdown_connections 2023-11-28T20:08:15.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.403+0000 7eff79a9c640 1 --2- 172.21.15.177:0/957937243 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7eff60066470 0x7eff60068930 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.403+0000 7eff79a9c640 1 --2- 172.21.15.177:0/957937243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff740cfe90 0x7eff7415b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.403+0000 7eff79a9c640 1 --2- 172.21.15.177:0/957937243 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff740b3c70 0x7eff74159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.403+0000 7eff79a9c640 1 --2- 172.21.15.177:0/957937243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff740b35b0 0x7eff740cd150 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.403+0000 7eff79a9c640 1 -- 172.21.15.177:0/957937243 >> 172.21.15.177:0/957937243 conn(0x7eff7409c4b0 msgr2=0x7eff740b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:15.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.403+0000 7eff79a9c640 1 -- 172.21.15.177:0/957937243 shutdown_connections 2023-11-28T20:08:15.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.403+0000 7eff79a9c640 1 -- 172.21.15.177:0/957937243 wait complete. 2023-11-28T20:08:15.427 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-11-28T20:08:15.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:15.428 DEBUG:teuthology.orchestra.run.smithi177:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T20:08:15.462 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:08:15.462 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:08:15.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:15.463 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T20:08:15.520 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:08:15.521 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:08:15.531 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:08:15.531 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:08:15.583 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:15.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.715+0000 7fbbbb3d8640 1 Processor -- start 2023-11-28T20:08:15.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.715+0000 7fbbbb3d8640 1 -- start start 2023-11-28T20:08:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.715+0000 7fbbbb3d8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb406c9d0 0x7fbbb4070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.715+0000 7fbbbb3d8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbbb4072180 0x7fbbb40709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.715+0000 7fbbbb3d8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb40710e0 con 0x7fbbb4144840 2023-11-28T20:08:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.715+0000 7fbbbb3d8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb415f010 con 0x7fbbb4072180 2023-11-28T20:08:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.715+0000 7fbbbb3d8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb4070ee0 con 0x7fbbb406c9d0 2023-11-28T20:08:15.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.719+0000 7fbbb8973640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb406c9d0 0x7fbbb4070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:15.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.719+0000 7fbbb9174640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fbbb4144840 0x7fbbb406c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:43678/0 (socket says 172.21.15.177:43678) 2023-11-28T20:08:15.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.719+0000 7fbbb9174640 1 -- 172.21.15.177:0/682123745 learned_addr learned my addr 172.21.15.177:0/682123745 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:15.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.719+0000 7fbbb9975640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbbb4072180 0x7fbbb40709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:15.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.719+0000 7fbbb9975640 1 -- 172.21.15.177:0/682123745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb406c9d0 msgr2=0x7fbbb4070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:15.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.719+0000 7fbbb9975640 1 --2- 172.21.15.177:0/682123745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb406c9d0 0x7fbbb4070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.719+0000 7fbbb9975640 1 -- 172.21.15.177:0/682123745 >> v1:172.21.15.195:6789/0 conn(0x7fbbb4144840 legacy=0x7fbbb406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:15.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.719+0000 7fbbb9975640 1 -- 172.21.15.177:0/682123745 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb40713c0 con 0x7fbbb4072180 2023-11-28T20:08:15.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbb9975640 1 --2- 172.21.15.177:0/682123745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbb4072180 0x7fbbb40709a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009d90 tx=0x7fbbac01c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=365925c9d41c0570 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:15.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbabfff640 1 -- 172.21.15.177:0/682123745 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0a57b0 con 0x7fbbb4072180 2023-11-28T20:08:15.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbabfff640 1 -- 172.21.15.177:0/682123745 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac0a5910 con 0x7fbbb4072180 2023-11-28T20:08:15.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbabfff640 1 -- 172.21.15.177:0/682123745 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0a5ca0 con 0x7fbbb4072180 2023-11-28T20:08:15.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 -- 172.21.15.177:0/682123745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbb4072180 msgr2=0x7fbbb40709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:15.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 --2- 172.21.15.177:0/682123745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbb4072180 0x7fbbb40709a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009d90 tx=0x7fbbac01c7b0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 -- 172.21.15.177:0/682123745 shutdown_connections 2023-11-28T20:08:15.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 --2- 172.21.15.177:0/682123745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbb4072180 0x7fbbb40709a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 --2- 172.21.15.177:0/682123745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb406c9d0 0x7fbbb4070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 -- 172.21.15.177:0/682123745 >> 172.21.15.177:0/682123745 conn(0x7fbbb406a530 msgr2=0x7fbbb406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:15.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 -- 172.21.15.177:0/682123745 shutdown_connections 2023-11-28T20:08:15.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 -- 172.21.15.177:0/682123745 wait complete. 2023-11-28T20:08:15.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 Processor -- start 2023-11-28T20:08:15.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 -- start start 2023-11-28T20:08:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbb406c9d0 0x7fbbb415a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbb4072180 0x7fbbb40b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb4144840 0x7fbbb40b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb41f41e0 con 0x7fbbb4072180 2023-11-28T20:08:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb413c970 con 0x7fbbb406c9d0 2023-11-28T20:08:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.723+0000 7fbbbb3d8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb413c690 con 0x7fbbb4144840 2023-11-28T20:08:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbbb8973640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbb4072180 0x7fbbb40b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:15.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbbb8973640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbb4072180 0x7fbbb40b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33690/0 (socket says 172.21.15.177:33690) 2023-11-28T20:08:15.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbbb8973640 1 -- 172.21.15.177:0/3974544954 learned_addr learned my addr 172.21.15.177:0/3974544954 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:15.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbbb9174640 1 --2- 172.21.15.177:0/3974544954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbb406c9d0 0x7fbbb415a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:15.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbbb9975640 1 --2- 172.21.15.177:0/3974544954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb4144840 0x7fbbb40b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:15.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbbb8973640 1 -- 172.21.15.177:0/3974544954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb4144840 msgr2=0x7fbbb40b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:15.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbbb8973640 1 --2- 172.21.15.177:0/3974544954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb4144840 0x7fbbb40b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbbb8973640 1 -- 172.21.15.177:0/3974544954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbb406c9d0 msgr2=0x7fbbb415a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:15.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbbb8973640 1 --2- 172.21.15.177:0/3974544954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbb406c9d0 0x7fbbb415a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbbb8973640 1 -- 172.21.15.177:0/3974544954 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac009a70 con 0x7fbbb4072180 2023-11-28T20:08:15.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbbb8973640 1 --2- 172.21.15.177:0/3974544954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbb4072180 0x7fbbb40b0ca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbba400e900 tx=0x7fbba400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:15.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbba9ffb640 1 -- 172.21.15.177:0/3974544954 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4009690 con 0x7fbbb4072180 2023-11-28T20:08:15.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbba9ffb640 1 -- 172.21.15.177:0/3974544954 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba400ca00 con 0x7fbbb4072180 2023-11-28T20:08:15.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbba9ffb640 1 -- 172.21.15.177:0/3974544954 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba400cdb0 con 0x7fbbb4072180 2023-11-28T20:08:15.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbbbb3d8640 1 -- 172.21.15.177:0/3974544954 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb41617c0 con 0x7fbbb4072180 2023-11-28T20:08:15.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbbbb3d8640 1 -- 172.21.15.177:0/3974544954 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb4161d80 con 0x7fbbb4072180 2023-11-28T20:08:15.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbbbb3d8640 1 -- 172.21.15.177:0/3974544954 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb40cd460 con 0x7fbbb4072180 2023-11-28T20:08:15.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.727+0000 7fbba9ffb640 1 -- 172.21.15.177:0/3974544954 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbba4013470 con 0x7fbbb4072180 2023-11-28T20:08:15.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.731+0000 7fbba9ffb640 1 --2- 172.21.15.177:0/3974544954 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbb980664a0 0x7fbb98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:15.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.731+0000 7fbba9ffb640 1 -- 172.21.15.177:0/3974544954 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbba4083ff0 con 0x7fbbb4072180 2023-11-28T20:08:15.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.731+0000 7fbbb9174640 1 --2- 172.21.15.177:0/3974544954 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbb980664a0 0x7fbb98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:15.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.731+0000 7fbbb9174640 1 --2- 172.21.15.177:0/3974544954 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbb980664a0 0x7fbb98068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0000f70 tx=0x7fbbb0007e10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:15.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.735+0000 7fbba9ffb640 1 -- 172.21.15.177:0/3974544954 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbba40b5280 con 0x7fbbb4072180 2023-11-28T20:08:15.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.883+0000 7fbbbb3d8640 1 -- 172.21.15.177:0/3974544954 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbb406b210 con 0x7fbbb4072180 2023-11-28T20:08:15.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.883+0000 7fbba9ffb640 1 -- 172.21.15.177:0/3974544954 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7fbba40514a0 con 0x7fbbb4072180 2023-11-28T20:08:15.890 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:15.890 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:15.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.887+0000 7fbbbb3d8640 1 -- 172.21.15.177:0/3974544954 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbb980664a0 msgr2=0x7fbb98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:15.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.887+0000 7fbbbb3d8640 1 --2- 172.21.15.177:0/3974544954 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbb980664a0 0x7fbb98068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0000f70 tx=0x7fbbb0007e10 comp rx=0 tx=0).stop 2023-11-28T20:08:15.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.887+0000 7fbbbb3d8640 1 -- 172.21.15.177:0/3974544954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbb4072180 msgr2=0x7fbbb40b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:15.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.887+0000 7fbbbb3d8640 1 --2- 172.21.15.177:0/3974544954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbb4072180 0x7fbbb40b0ca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbba400e900 tx=0x7fbba400edc0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.887+0000 7fbbbb3d8640 1 -- 172.21.15.177:0/3974544954 shutdown_connections 2023-11-28T20:08:15.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.887+0000 7fbbbb3d8640 1 --2- 172.21.15.177:0/3974544954 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fbb980664a0 0x7fbb98068960 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.887+0000 7fbbbb3d8640 1 --2- 172.21.15.177:0/3974544954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb4144840 0x7fbbb40b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.887+0000 7fbbbb3d8640 1 --2- 172.21.15.177:0/3974544954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbb4072180 0x7fbbb40b0ca0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.887+0000 7fbbbb3d8640 1 --2- 172.21.15.177:0/3974544954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbb406c9d0 0x7fbbb415a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:15.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.887+0000 7fbbbb3d8640 1 -- 172.21.15.177:0/3974544954 >> 172.21.15.177:0/3974544954 conn(0x7fbbb406a530 msgr2=0x7fbbb415f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:15.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.887+0000 7fbbbb3d8640 1 -- 172.21.15.177:0/3974544954 shutdown_connections 2023-11-28T20:08:15.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:15.887+0000 7fbbbb3d8640 1 -- 172.21.15.177:0/3974544954 wait complete. 2023-11-28T20:08:15.912 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:15.912 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:16.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.047+0000 7f43e491d640 1 Processor -- start 2023-11-28T20:08:16.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.047+0000 7f43e491d640 1 -- start start 2023-11-28T20:08:16.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.051+0000 7f43e491d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f43e0071d90 0x7f43e0072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.051+0000 7f43e491d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e013d2b0 con 0x7f43e015adb0 2023-11-28T20:08:16.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.051+0000 7f43e491d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e00cdd70 con 0x7f43e013f5f0 2023-11-28T20:08:16.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.051+0000 7f43e491d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e0140520 con 0x7f43e0071d90 2023-11-28T20:08:16.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.051+0000 7f43d5d9b640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f43e015adb0 0x7f43e013d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36532/0 (socket says 172.21.15.177:36532) 2023-11-28T20:08:16.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.051+0000 7f43d5d9b640 1 -- 172.21.15.177:0/988155588 learned_addr learned my addr 172.21.15.177:0/988155588 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:16.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.051+0000 7f43de59c640 1 --2- 172.21.15.177:0/988155588 >> v2:172.21.15.195:3300/0 conn(0x7f43e0071d90 0x7f43e0072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.051+0000 7f43ddd9b640 1 -- 172.21.15.177:0/988155588 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345226135 0 0) 0x7f43e013d2b0 con 0x7f43e015adb0 2023-11-28T20:08:16.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.051+0000 7f43ddd9b640 1 -- 172.21.15.177:0/988155588 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43cc005740 con 0x7f43e015adb0 2023-11-28T20:08:16.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.051+0000 7f43ddd9b640 1 -- 172.21.15.177:0/988155588 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609801407 0 0) 0x7f43e00cdd70 con 0x7f43e013f5f0 2023-11-28T20:08:16.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.051+0000 7f43ddd9b640 1 -- 172.21.15.177:0/988155588 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43e013d2b0 con 0x7f43e013f5f0 2023-11-28T20:08:16.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.051+0000 7f43ddd9b640 1 -- 172.21.15.177:0/988155588 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 930405185 0 0) 0x7f43cc005740 con 0x7f43e015adb0 2023-11-28T20:08:16.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.051+0000 7f43de59c640 1 -- 172.21.15.177:0/988155588 >> v1:172.21.15.195:6789/0 conn(0x7f43e013f5f0 legacy=0x7f43e00ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.051+0000 7f43de59c640 1 -- 172.21.15.177:0/988155588 >> v1:172.21.15.177:6789/0 conn(0x7f43e015adb0 legacy=0x7f43e013d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.051+0000 7f43de59c640 1 -- 172.21.15.177:0/988155588 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e00726b0 con 0x7f43e0071d90 2023-11-28T20:08:16.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.055+0000 7f43de59c640 1 --2- 172.21.15.177:0/988155588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e0071d90 0x7f43e0072170 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f43c80097c0 tx=0x7f43c801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26916adf0fb9ac52 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:16.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.055+0000 7f43ddd9b640 1 -- 172.21.15.177:0/988155588 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d0001680 con 0x7f43e0071d90 2023-11-28T20:08:16.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.055+0000 7f43ddd9b640 1 -- 172.21.15.177:0/988155588 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c80a7050 con 0x7f43e0071d90 2023-11-28T20:08:16.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.055+0000 7f43ddd9b640 1 -- 172.21.15.177:0/988155588 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c80ab620 con 0x7f43e0071d90 2023-11-28T20:08:16.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.055+0000 7f43e491d640 1 -- 172.21.15.177:0/988155588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e0071d90 msgr2=0x7f43e0072170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.055+0000 7f43e491d640 1 --2- 172.21.15.177:0/988155588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e0071d90 0x7f43e0072170 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f43c80097c0 tx=0x7f43c801c3a0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.055+0000 7f43e491d640 1 -- 172.21.15.177:0/988155588 shutdown_connections 2023-11-28T20:08:16.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.055+0000 7f43e491d640 1 --2- 172.21.15.177:0/988155588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e0071d90 0x7f43e0072170 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.055+0000 7f43e491d640 1 -- 172.21.15.177:0/988155588 >> 172.21.15.177:0/988155588 conn(0x7f43e00b0cc0 msgr2=0x7f43e00b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:16.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.055+0000 7f43e491d640 1 -- 172.21.15.177:0/988155588 shutdown_connections 2023-11-28T20:08:16.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.055+0000 7f43e491d640 1 -- 172.21.15.177:0/988155588 wait complete. 2023-11-28T20:08:16.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.055+0000 7f43e491d640 1 Processor -- start 2023-11-28T20:08:16.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.055+0000 7f43e491d640 1 -- start start 2023-11-28T20:08:16.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43e491d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e0071d90 0x7f43e0138f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43e491d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e013f5f0 0x7f43e01348b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43e491d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43e015adb0 0x7f43e013a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43e491d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e0135a60 con 0x7f43e015adb0 2023-11-28T20:08:16.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43e491d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e0135780 con 0x7f43e0071d90 2023-11-28T20:08:16.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43e491d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e01352c0 con 0x7f43e013f5f0 2023-11-28T20:08:16.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43ded9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43e015adb0 0x7f43e013a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43ded9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43e015adb0 0x7f43e013a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33696/0 (socket says 172.21.15.177:33696) 2023-11-28T20:08:16.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43ded9d640 1 -- 172.21.15.177:0/1918796593 learned_addr learned my addr 172.21.15.177:0/1918796593 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:16.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43d5d9b640 1 --2- 172.21.15.177:0/1918796593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e013f5f0 0x7f43e01348b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43de59c640 1 --2- 172.21.15.177:0/1918796593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e0071d90 0x7f43e0138f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43ded9d640 1 -- 172.21.15.177:0/1918796593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e013f5f0 msgr2=0x7f43e01348b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43ded9d640 1 --2- 172.21.15.177:0/1918796593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e013f5f0 0x7f43e01348b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43ded9d640 1 -- 172.21.15.177:0/1918796593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e0071d90 msgr2=0x7f43e0138f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43ded9d640 1 --2- 172.21.15.177:0/1918796593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e0071d90 0x7f43e0138f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43ded9d640 1 -- 172.21.15.177:0/1918796593 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c8009420 con 0x7f43e015adb0 2023-11-28T20:08:16.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43ded9d640 1 --2- 172.21.15.177:0/1918796593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43e015adb0 0x7f43e013a6a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f43d800c790 tx=0x7f43d800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:16.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43d77fe640 1 -- 172.21.15.177:0/1918796593 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d800cea0 con 0x7f43e015adb0 2023-11-28T20:08:16.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43d77fe640 1 -- 172.21.15.177:0/1918796593 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d8003b80 con 0x7f43e015adb0 2023-11-28T20:08:16.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43d77fe640 1 -- 172.21.15.177:0/1918796593 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d800a850 con 0x7f43e015adb0 2023-11-28T20:08:16.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43e491d640 1 -- 172.21.15.177:0/1918796593 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e013df10 con 0x7f43e015adb0 2023-11-28T20:08:16.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43e491d640 1 -- 172.21.15.177:0/1918796593 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e0134fc0 con 0x7f43e015adb0 2023-11-28T20:08:16.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.059+0000 7f43e491d640 1 -- 172.21.15.177:0/1918796593 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e015b1f0 con 0x7f43e015adb0 2023-11-28T20:08:16.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.063+0000 7f43d77fe640 1 -- 172.21.15.177:0/1918796593 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f43d800a9b0 con 0x7f43e015adb0 2023-11-28T20:08:16.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.063+0000 7f43d77fe640 1 --2- 172.21.15.177:0/1918796593 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f43c0066470 0x7f43c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.063+0000 7f43d77fe640 1 -- 172.21.15.177:0/1918796593 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43d8083b20 con 0x7f43e015adb0 2023-11-28T20:08:16.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.063+0000 7f43de59c640 1 --2- 172.21.15.177:0/1918796593 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f43c0066470 0x7f43c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.063+0000 7f43de59c640 1 --2- 172.21.15.177:0/1918796593 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f43c0066470 0x7f43c0068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f43c80ad000 tx=0x7f43c80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:16.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.067+0000 7f43d77fe640 1 -- 172.21.15.177:0/1918796593 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f43d80510e0 con 0x7f43e015adb0 2023-11-28T20:08:16.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.215+0000 7f43e491d640 1 -- 172.21.15.177:0/1918796593 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43e013e100 con 0x7f43e015adb0 2023-11-28T20:08:16.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.215+0000 7f43d77fe640 1 -- 172.21.15.177:0/1918796593 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f43d8054700 con 0x7f43e015adb0 2023-11-28T20:08:16.222 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:16.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.219+0000 7f43e491d640 1 -- 172.21.15.177:0/1918796593 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f43c0066470 msgr2=0x7f43c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.219+0000 7f43e491d640 1 --2- 172.21.15.177:0/1918796593 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f43c0066470 0x7f43c0068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f43c80ad000 tx=0x7f43c80a6000 comp rx=0 tx=0).stop 2023-11-28T20:08:16.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.219+0000 7f43e491d640 1 -- 172.21.15.177:0/1918796593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43e015adb0 msgr2=0x7f43e013a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.219+0000 7f43e491d640 1 --2- 172.21.15.177:0/1918796593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43e015adb0 0x7f43e013a6a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f43d800c790 tx=0x7f43d800cc50 comp rx=0 tx=0).stop 2023-11-28T20:08:16.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.219+0000 7f43e491d640 1 -- 172.21.15.177:0/1918796593 shutdown_connections 2023-11-28T20:08:16.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.219+0000 7f43e491d640 1 --2- 172.21.15.177:0/1918796593 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f43c0066470 0x7f43c0068930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.219+0000 7f43e491d640 1 --2- 172.21.15.177:0/1918796593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43e015adb0 0x7f43e013a6a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.219+0000 7f43e491d640 1 --2- 172.21.15.177:0/1918796593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e013f5f0 0x7f43e01348b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.219+0000 7f43e491d640 1 --2- 172.21.15.177:0/1918796593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e0071d90 0x7f43e0138f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.219+0000 7f43e491d640 1 -- 172.21.15.177:0/1918796593 >> 172.21.15.177:0/1918796593 conn(0x7f43e00b0cc0 msgr2=0x7f43e00aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:16.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.219+0000 7f43e491d640 1 -- 172.21.15.177:0/1918796593 shutdown_connections 2023-11-28T20:08:16.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.219+0000 7f43e491d640 1 -- 172.21.15.177:0/1918796593 wait complete. 2023-11-28T20:08:16.245 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:16.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.379+0000 7f8371bd1640 1 Processor -- start 2023-11-28T20:08:16.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.379+0000 7f8371bd1640 1 -- start start 2023-11-28T20:08:16.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f8371bd1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f836c15d2b0 0x7f836c0d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f8371bd1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f836c0d02f0 0x7f836c0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f8371bd1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836c0aff30 con 0x7f836c0d1cf0 2023-11-28T20:08:16.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f8371bd1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c0b01d0 con 0x7f836c0d02f0 2023-11-28T20:08:16.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f8371bd1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0b04b0 con 0x7f836c15d2b0 2023-11-28T20:08:16.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f836bfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f836c0d02f0 0x7f836c0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f836b7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f836c15d2b0 0x7f836c0d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f836bfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f836c0d02f0 0x7f836c0b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:45476/0 (socket says 172.21.15.177:45476) 2023-11-28T20:08:16.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f836bfff640 1 -- 172.21.15.177:0/629150364 learned_addr learned my addr 172.21.15.177:0/629150364 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:16.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f836b7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f836c15d2b0 0x7f836c0d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:60626/0 (socket says 172.21.15.177:60626) 2023-11-28T20:08:16.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f836bfff640 1 -- 172.21.15.177:0/629150364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f836c15d2b0 msgr2=0x7f836c0d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:16.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f836bfff640 1 --2- 172.21.15.177:0/629150364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f836c15d2b0 0x7f836c0d17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f836bfff640 1 -- 172.21.15.177:0/629150364 >> v1:172.21.15.195:6789/0 conn(0x7f836c0d1cf0 legacy=0x7f836c0cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f836bfff640 1 -- 172.21.15.177:0/629150364 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c0b0790 con 0x7f836c0d02f0 2023-11-28T20:08:16.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f836b7fe640 1 --2- 172.21.15.177:0/629150364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f836c15d2b0 0x7f836c0d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:16.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.383+0000 7f836a7fc640 1 -- 172.21.15.177:0/629150364 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436721560 0 0) 0x7f836c0aff30 con 0x7f836c0d1cf0 2023-11-28T20:08:16.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.387+0000 7f836bfff640 1 --2- 172.21.15.177:0/629150364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f836c0d02f0 0x7f836c0b0cb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8364009e50 tx=0x7f836401ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=914bb150bba014ff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:16.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.387+0000 7f836a7fc640 1 -- 172.21.15.177:0/629150364 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640a5880 con 0x7f836c0d02f0 2023-11-28T20:08:16.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.387+0000 7f836a7fc640 1 -- 172.21.15.177:0/629150364 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83640a59e0 con 0x7f836c0d02f0 2023-11-28T20:08:16.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.387+0000 7f836a7fc640 1 -- 172.21.15.177:0/629150364 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640a5d70 con 0x7f836c0d02f0 2023-11-28T20:08:16.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.387+0000 7f8371bd1640 1 -- 172.21.15.177:0/629150364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f836c0d02f0 msgr2=0x7f836c0b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.387+0000 7f8371bd1640 1 --2- 172.21.15.177:0/629150364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f836c0d02f0 0x7f836c0b0cb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8364009e50 tx=0x7f836401ca10 comp rx=0 tx=0).stop 2023-11-28T20:08:16.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.387+0000 7f8371bd1640 1 -- 172.21.15.177:0/629150364 shutdown_connections 2023-11-28T20:08:16.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.387+0000 7f8371bd1640 1 --2- 172.21.15.177:0/629150364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f836c0d02f0 0x7f836c0b0cb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.387+0000 7f8371bd1640 1 --2- 172.21.15.177:0/629150364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f836c15d2b0 0x7f836c0d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.387+0000 7f8371bd1640 1 -- 172.21.15.177:0/629150364 >> 172.21.15.177:0/629150364 conn(0x7f836c09c510 msgr2=0x7f836c0d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:16.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.387+0000 7f8371bd1640 1 -- 172.21.15.177:0/629150364 shutdown_connections 2023-11-28T20:08:16.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.387+0000 7f8371bd1640 1 -- 172.21.15.177:0/629150364 wait complete. 2023-11-28T20:08:16.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.387+0000 7f8371bd1640 1 Processor -- start 2023-11-28T20:08:16.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.387+0000 7f8371bd1640 1 -- start start 2023-11-28T20:08:16.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f8371bd1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f836c0d02f0 0x7f836c1572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f8371bd1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f836c0d1cf0 0x7f836c0c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f8371bd1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f836c15d2b0 0x7f836c0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f8371bd1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0cb770 con 0x7f836c15d2b0 2023-11-28T20:08:16.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f8371bd1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0c9b60 con 0x7f836c0d02f0 2023-11-28T20:08:16.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f8371bd1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0cb440 con 0x7f836c0d1cf0 2023-11-28T20:08:16.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f836bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f836c15d2b0 0x7f836c0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f836bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f836c15d2b0 0x7f836c0c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33706/0 (socket says 172.21.15.177:33706) 2023-11-28T20:08:16.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f836bfff640 1 -- 172.21.15.177:0/1549013944 learned_addr learned my addr 172.21.15.177:0/1549013944 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:16.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f836b7fe640 1 --2- 172.21.15.177:0/1549013944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f836c0d02f0 0x7f836c1572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f836affd640 1 --2- 172.21.15.177:0/1549013944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f836c0d1cf0 0x7f836c0c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f836bfff640 1 -- 172.21.15.177:0/1549013944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f836c0d1cf0 msgr2=0x7f836c0c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f836bfff640 1 --2- 172.21.15.177:0/1549013944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f836c0d1cf0 0x7f836c0c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f836bfff640 1 -- 172.21.15.177:0/1549013944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f836c0d02f0 msgr2=0x7f836c1572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f836bfff640 1 --2- 172.21.15.177:0/1549013944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f836c0d02f0 0x7f836c1572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f836bfff640 1 -- 172.21.15.177:0/1549013944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c009420 con 0x7f836c15d2b0 2023-11-28T20:08:16.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f836b7fe640 1 --2- 172.21.15.177:0/1549013944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f836c0d02f0 0x7f836c1572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:16.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f836bfff640 1 --2- 172.21.15.177:0/1549013944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f836c15d2b0 0x7f836c0c9620 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f836401a640 tx=0x7f83640197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:16.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f8353fff640 1 -- 172.21.15.177:0/1549013944 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640b8670 con 0x7f836c15d2b0 2023-11-28T20:08:16.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f8353fff640 1 -- 172.21.15.177:0/1549013944 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83640b87d0 con 0x7f836c15d2b0 2023-11-28T20:08:16.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f8371bd1640 1 -- 172.21.15.177:0/1549013944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8364009b30 con 0x7f836c15d2b0 2023-11-28T20:08:16.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f8353fff640 1 -- 172.21.15.177:0/1549013944 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640b8b60 con 0x7f836c15d2b0 2023-11-28T20:08:16.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f8371bd1640 1 -- 172.21.15.177:0/1549013944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c0cb160 con 0x7f836c15d2b0 2023-11-28T20:08:16.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f8371bd1640 1 -- 172.21.15.177:0/1549013944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c0679f0 con 0x7f836c15d2b0 2023-11-28T20:08:16.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.391+0000 7f8353fff640 1 -- 172.21.15.177:0/1549013944 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f83640b8cc0 con 0x7f836c15d2b0 2023-11-28T20:08:16.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.395+0000 7f8353fff640 1 --2- 172.21.15.177:0/1549013944 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8358066470 0x7f8358068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.395+0000 7f8353fff640 1 -- 172.21.15.177:0/1549013944 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f836411f4c0 con 0x7f836c15d2b0 2023-11-28T20:08:16.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.395+0000 7f836b7fe640 1 --2- 172.21.15.177:0/1549013944 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8358066470 0x7f8358068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.395+0000 7f836b7fe640 1 --2- 172.21.15.177:0/1549013944 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8358066470 0x7f8358068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f835c009ca0 tx=0x7f835c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:16.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.399+0000 7f8353fff640 1 -- 172.21.15.177:0/1549013944 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f83640ecb00 con 0x7f836c15d2b0 2023-11-28T20:08:16.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.551+0000 7f8371bd1640 1 -- 172.21.15.177:0/1549013944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f836c0b8860 con 0x7f836c15d2b0 2023-11-28T20:08:16.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.551+0000 7f8353fff640 1 -- 172.21.15.177:0/1549013944 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f83640f0120 con 0x7f836c15d2b0 2023-11-28T20:08:16.556 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:16.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.551+0000 7f8371bd1640 1 -- 172.21.15.177:0/1549013944 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8358066470 msgr2=0x7f8358068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.551+0000 7f8371bd1640 1 --2- 172.21.15.177:0/1549013944 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8358066470 0x7f8358068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f835c009ca0 tx=0x7f835c008040 comp rx=0 tx=0).stop 2023-11-28T20:08:16.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.551+0000 7f8371bd1640 1 -- 172.21.15.177:0/1549013944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f836c15d2b0 msgr2=0x7f836c0c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.551+0000 7f8371bd1640 1 --2- 172.21.15.177:0/1549013944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f836c15d2b0 0x7f836c0c9620 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f836401a640 tx=0x7f83640197b0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.551+0000 7f8371bd1640 1 -- 172.21.15.177:0/1549013944 shutdown_connections 2023-11-28T20:08:16.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.551+0000 7f8371bd1640 1 --2- 172.21.15.177:0/1549013944 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8358066470 0x7f8358068930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.551+0000 7f8371bd1640 1 --2- 172.21.15.177:0/1549013944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f836c15d2b0 0x7f836c0c9620 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.551+0000 7f8371bd1640 1 --2- 172.21.15.177:0/1549013944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f836c0d1cf0 0x7f836c0c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.551+0000 7f8371bd1640 1 --2- 172.21.15.177:0/1549013944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f836c0d02f0 0x7f836c1572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.551+0000 7f8371bd1640 1 -- 172.21.15.177:0/1549013944 >> 172.21.15.177:0/1549013944 conn(0x7f836c09c510 msgr2=0x7f836c0b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:16.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.555+0000 7f8371bd1640 1 -- 172.21.15.177:0/1549013944 shutdown_connections 2023-11-28T20:08:16.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.555+0000 7f8371bd1640 1 -- 172.21.15.177:0/1549013944 wait complete. 2023-11-28T20:08:16.577 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:16.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.711+0000 7f7215e3c640 1 Processor -- start 2023-11-28T20:08:16.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.711+0000 7f7215e3c640 1 -- start start 2023-11-28T20:08:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.715+0000 7f7215e3c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72100ae010 0x7f72100ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.715+0000 7f7215e3c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f72100b3ac0 0x7f721006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.715+0000 7f7215e3c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72100ce330 con 0x7f721015e590 2023-11-28T20:08:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.715+0000 7f7215e3c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721015e970 con 0x7f72100b3ac0 2023-11-28T20:08:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.715+0000 7f7215e3c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72100b2ca0 con 0x7f72100ae010 2023-11-28T20:08:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.715+0000 7f721563b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f72100b3ac0 0x7f721006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.715+0000 7f7214e3a640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f721015e590 0x7f72100ad900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36546/0 (socket says 172.21.15.177:36546) 2023-11-28T20:08:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.715+0000 7f7214e3a640 1 -- 172.21.15.177:0/1362231133 learned_addr learned my addr 172.21.15.177:0/1362231133 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.715+0000 7f7207fff640 1 --2- 172.21.15.177:0/1362231133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72100ae010 0x7f72100ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.715+0000 7f721563b640 1 -- 172.21.15.177:0/1362231133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72100ae010 msgr2=0x7f72100ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.715+0000 7f721563b640 1 --2- 172.21.15.177:0/1362231133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72100ae010 0x7f72100ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.715+0000 7f721563b640 1 -- 172.21.15.177:0/1362231133 >> v1:172.21.15.177:6789/0 conn(0x7f721015e590 legacy=0x7f72100ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.715+0000 7f721563b640 1 -- 172.21.15.177:0/1362231133 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72100b4080 con 0x7f72100b3ac0 2023-11-28T20:08:16.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.715+0000 7f7207fff640 1 --2- 172.21.15.177:0/1362231133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72100ae010 0x7f72100ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:16.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f721563b640 1 --2- 172.21.15.177:0/1362231133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72100b3ac0 0x7f721006bfe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7208009d90 tx=0x7f720801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72f3e63a097bc5a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:16.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f72077fe640 1 -- 172.21.15.177:0/1362231133 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72080a6700 con 0x7f72100b3ac0 2023-11-28T20:08:16.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f72077fe640 1 -- 172.21.15.177:0/1362231133 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72080a6860 con 0x7f72100b3ac0 2023-11-28T20:08:16.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f72077fe640 1 -- 172.21.15.177:0/1362231133 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72080a6bf0 con 0x7f72100b3ac0 2023-11-28T20:08:16.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f7215e3c640 1 -- 172.21.15.177:0/1362231133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72100b3ac0 msgr2=0x7f721006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f7215e3c640 1 --2- 172.21.15.177:0/1362231133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72100b3ac0 0x7f721006bfe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7208009d90 tx=0x7f720801c830 comp rx=0 tx=0).stop 2023-11-28T20:08:16.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f7215e3c640 1 -- 172.21.15.177:0/1362231133 shutdown_connections 2023-11-28T20:08:16.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f7215e3c640 1 --2- 172.21.15.177:0/1362231133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72100b3ac0 0x7f721006bfe0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f7215e3c640 1 --2- 172.21.15.177:0/1362231133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72100ae010 0x7f72100ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f7215e3c640 1 -- 172.21.15.177:0/1362231133 >> 172.21.15.177:0/1362231133 conn(0x7f72100b0920 msgr2=0x7f72100b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:16.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f7215e3c640 1 -- 172.21.15.177:0/1362231133 shutdown_connections 2023-11-28T20:08:16.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f7215e3c640 1 -- 172.21.15.177:0/1362231133 wait complete. 2023-11-28T20:08:16.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f7215e3c640 1 Processor -- start 2023-11-28T20:08:16.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f7215e3c640 1 -- start start 2023-11-28T20:08:16.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f7215e3c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72100ae010 0x7f7210146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f7215e3c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72100b3ac0 0x7f7210165980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.719+0000 7f7215e3c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f721015e590 0x7f7210145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7215e3c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7210146920 con 0x7f72100ae010 2023-11-28T20:08:16.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7215e3c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7210145e90 con 0x7f721015e590 2023-11-28T20:08:16.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7215e3c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721014b870 con 0x7f72100b3ac0 2023-11-28T20:08:16.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7214e3a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72100ae010 0x7f7210146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7214e3a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72100ae010 0x7f7210146010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33732/0 (socket says 172.21.15.177:33732) 2023-11-28T20:08:16.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7214e3a640 1 -- 172.21.15.177:0/2681468014 learned_addr learned my addr 172.21.15.177:0/2681468014 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:16.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f721563b640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f721015e590 0x7f7210145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7207fff640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72100b3ac0 0x7f7210165980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7214e3a640 1 -- 172.21.15.177:0/2681468014 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72100b3ac0 msgr2=0x7f7210165980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7214e3a640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72100b3ac0 0x7f7210165980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7214e3a640 1 -- 172.21.15.177:0/2681468014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f721015e590 msgr2=0x7f7210145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7214e3a640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f721015e590 0x7f7210145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7214e3a640 1 -- 172.21.15.177:0/2681468014 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7208009a70 con 0x7f72100ae010 2023-11-28T20:08:16.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f721563b640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f721015e590 0x7f7210145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:16.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7207fff640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72100b3ac0 0x7f7210165980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:16.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7214e3a640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72100ae010 0x7f7210146010 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f720c00c400 tx=0x7f720c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:16.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f72057fa640 1 -- 172.21.15.177:0/2681468014 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c005cf0 con 0x7f72100ae010 2023-11-28T20:08:16.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f72057fa640 1 -- 172.21.15.177:0/2681468014 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c005e50 con 0x7f72100ae010 2023-11-28T20:08:16.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7215e3c640 1 -- 172.21.15.177:0/2681468014 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721014bb50 con 0x7f72100ae010 2023-11-28T20:08:16.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f72057fa640 1 -- 172.21.15.177:0/2681468014 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c0072d0 con 0x7f72100ae010 2023-11-28T20:08:16.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7215e3c640 1 -- 172.21.15.177:0/2681468014 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721014a6e0 con 0x7f72100ae010 2023-11-28T20:08:16.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f7215e3c640 1 -- 172.21.15.177:0/2681468014 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721014a240 con 0x7f72100ae010 2023-11-28T20:08:16.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f72057fa640 1 -- 172.21.15.177:0/2681468014 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f720c007430 con 0x7f72100ae010 2023-11-28T20:08:16.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.723+0000 7f72057fa640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71fc066470 0x7f71fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:16.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.727+0000 7f72057fa640 1 -- 172.21.15.177:0/2681468014 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f720c083350 con 0x7f72100ae010 2023-11-28T20:08:16.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.727+0000 7f7207fff640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71fc066470 0x7f71fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:16.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.727+0000 7f7207fff640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71fc066470 0x7f71fc068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f72100b04a0 tx=0x7f7200008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:16.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.727+0000 7f72057fa640 1 -- 172.21.15.177:0/2681468014 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f720c050870 con 0x7f72100ae010 2023-11-28T20:08:16.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.879+0000 7f7215e3c640 1 -- 172.21.15.177:0/2681468014 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f721014bd40 con 0x7f72100ae010 2023-11-28T20:08:16.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.879+0000 7f72057fa640 1 -- 172.21.15.177:0/2681468014 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f720c053e90 con 0x7f72100ae010 2023-11-28T20:08:16.886 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:16.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.883+0000 7f7215e3c640 1 -- 172.21.15.177:0/2681468014 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71fc066470 msgr2=0x7f71fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.883+0000 7f7215e3c640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71fc066470 0x7f71fc068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f72100b04a0 tx=0x7f7200008040 comp rx=0 tx=0).stop 2023-11-28T20:08:16.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.883+0000 7f7215e3c640 1 -- 172.21.15.177:0/2681468014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72100ae010 msgr2=0x7f7210146010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:16.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.883+0000 7f7215e3c640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72100ae010 0x7f7210146010 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f720c00c400 tx=0x7f720c00c8c0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.883+0000 7f7215e3c640 1 -- 172.21.15.177:0/2681468014 shutdown_connections 2023-11-28T20:08:16.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.883+0000 7f7215e3c640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71fc066470 0x7f71fc068930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.883+0000 7f7215e3c640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f721015e590 0x7f7210145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.883+0000 7f7215e3c640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72100b3ac0 0x7f7210165980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.883+0000 7f7215e3c640 1 --2- 172.21.15.177:0/2681468014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72100ae010 0x7f7210146010 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:16.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.883+0000 7f7215e3c640 1 -- 172.21.15.177:0/2681468014 >> 172.21.15.177:0/2681468014 conn(0x7f72100b0920 msgr2=0x7f72100b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:16.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.883+0000 7f7215e3c640 1 -- 172.21.15.177:0/2681468014 shutdown_connections 2023-11-28T20:08:16.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:16.883+0000 7f7215e3c640 1 -- 172.21.15.177:0/2681468014 wait complete. 2023-11-28T20:08:16.907 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:08:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.039+0000 7fb086761640 1 Processor -- start 2023-11-28T20:08:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.039+0000 7fb086761640 1 -- start start 2023-11-28T20:08:17.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.043+0000 7fb086761640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb08015ae40 0x7fb0800acd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.043+0000 7fb086761640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0800b4560 0x7fb0800b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.043+0000 7fb086761640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08006a8d0 con 0x7fb0800ad250 2023-11-28T20:08:17.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.043+0000 7fb086761640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0800b4f30 con 0x7fb08015ae40 2023-11-28T20:08:17.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.043+0000 7fb086761640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08006abb0 con 0x7fb0800b4560 2023-11-28T20:08:17.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.043+0000 7fb08575f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb08015ae40 0x7fb0800acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.043+0000 7fb08575f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb08015ae40 0x7fb0800acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33746/0 (socket says 172.21.15.177:33746) 2023-11-28T20:08:17.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.043+0000 7fb08575f640 1 -- 172.21.15.177:0/4068354441 learned_addr learned my addr 172.21.15.177:0/4068354441 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:17.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.043+0000 7fb084f5e640 1 --1- 172.21.15.177:0/4068354441 >> v1:172.21.15.177:6789/0 conn(0x7fb0800ad250 0x7fb080071910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36562/0 (socket says 172.21.15.177:36562) 2023-11-28T20:08:17.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.043+0000 7fb085f60640 1 --2- 172.21.15.177:0/4068354441 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0800b4560 0x7fb0800b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.043+0000 7fb08575f640 1 -- 172.21.15.177:0/4068354441 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0800b4560 msgr2=0x7fb0800b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:17.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.043+0000 7fb08575f640 1 --2- 172.21.15.177:0/4068354441 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0800b4560 0x7fb0800b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.043+0000 7fb08575f640 1 -- 172.21.15.177:0/4068354441 >> v1:172.21.15.177:6789/0 conn(0x7fb0800ad250 legacy=0x7fb080071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.043+0000 7fb08575f640 1 -- 172.21.15.177:0/4068354441 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08006ae90 con 0x7fb08015ae40 2023-11-28T20:08:17.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.047+0000 7fb08575f640 1 --2- 172.21.15.177:0/4068354441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb08015ae40 0x7fb0800acd10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009870 tx=0x7fb07c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a880792a734817d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:17.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.047+0000 7fb077fff640 1 -- 172.21.15.177:0/4068354441 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0ab670 con 0x7fb08015ae40 2023-11-28T20:08:17.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.047+0000 7fb077fff640 1 -- 172.21.15.177:0/4068354441 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c0ab7d0 con 0x7fb08015ae40 2023-11-28T20:08:17.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.047+0000 7fb077fff640 1 -- 172.21.15.177:0/4068354441 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0abb60 con 0x7fb08015ae40 2023-11-28T20:08:17.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.047+0000 7fb086761640 1 -- 172.21.15.177:0/4068354441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb08015ae40 msgr2=0x7fb0800acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.047+0000 7fb086761640 1 --2- 172.21.15.177:0/4068354441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb08015ae40 0x7fb0800acd10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009870 tx=0x7fb07c01c540 comp rx=0 tx=0).stop 2023-11-28T20:08:17.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.047+0000 7fb086761640 1 -- 172.21.15.177:0/4068354441 shutdown_connections 2023-11-28T20:08:17.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.047+0000 7fb086761640 1 --2- 172.21.15.177:0/4068354441 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0800b4560 0x7fb0800b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.047+0000 7fb086761640 1 --2- 172.21.15.177:0/4068354441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb08015ae40 0x7fb0800acd10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.047+0000 7fb086761640 1 -- 172.21.15.177:0/4068354441 >> 172.21.15.177:0/4068354441 conn(0x7fb0800b1a30 msgr2=0x7fb0800b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:17.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.047+0000 7fb086761640 1 -- 172.21.15.177:0/4068354441 shutdown_connections 2023-11-28T20:08:17.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.047+0000 7fb086761640 1 -- 172.21.15.177:0/4068354441 wait complete. 2023-11-28T20:08:17.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.047+0000 7fb086761640 1 Processor -- start 2023-11-28T20:08:17.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.047+0000 7fb086761640 1 -- start start 2023-11-28T20:08:17.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb086761640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0800ad250 0x7fb0801582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb086761640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0800b4560 0x7fb08014a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb086761640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb08015ae40 0x7fb08006eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb086761640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb080159530 con 0x7fb0800ad250 2023-11-28T20:08:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb086761640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08014aa90 con 0x7fb0800b4560 2023-11-28T20:08:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb086761640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb080158920 con 0x7fb08015ae40 2023-11-28T20:08:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb08575f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0800ad250 0x7fb0801582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb08575f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0800ad250 0x7fb0801582d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33750/0 (socket says 172.21.15.177:33750) 2023-11-28T20:08:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb08575f640 1 -- 172.21.15.177:0/227019403 learned_addr learned my addr 172.21.15.177:0/227019403 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb08575f640 1 -- 172.21.15.177:0/227019403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb08015ae40 msgr2=0x7fb08006eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb08575f640 1 --2- 172.21.15.177:0/227019403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb08015ae40 0x7fb08006eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb08575f640 1 -- 172.21.15.177:0/227019403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0800b4560 msgr2=0x7fb08014a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb08575f640 1 --2- 172.21.15.177:0/227019403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0800b4560 0x7fb08014a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb08575f640 1 -- 172.21.15.177:0/227019403 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0094d0 con 0x7fb0800ad250 2023-11-28T20:08:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb08575f640 1 --2- 172.21.15.177:0/227019403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0800ad250 0x7fb0801582d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0ad040 tx=0x7fb07c0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb075ffb640 1 -- 172.21.15.177:0/227019403 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0b4800 con 0x7fb0800ad250 2023-11-28T20:08:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb075ffb640 1 -- 172.21.15.177:0/227019403 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c0b4980 con 0x7fb0800ad250 2023-11-28T20:08:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb086761640 1 -- 172.21.15.177:0/227019403 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb080072230 con 0x7fb0800ad250 2023-11-28T20:08:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb075ffb640 1 -- 172.21.15.177:0/227019403 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0b4d30 con 0x7fb0800ad250 2023-11-28T20:08:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb086761640 1 -- 172.21.15.177:0/227019403 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb080158ee0 con 0x7fb0800ad250 2023-11-28T20:08:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb086761640 1 -- 172.21.15.177:0/227019403 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0800679f0 con 0x7fb0800ad250 2023-11-28T20:08:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.051+0000 7fb075ffb640 1 -- 172.21.15.177:0/227019403 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb07c0be3f0 con 0x7fb0800ad250 2023-11-28T20:08:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.055+0000 7fb075ffb640 1 --2- 172.21.15.177:0/227019403 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb0640664a0 0x7fb064068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.055+0000 7fb075ffb640 1 -- 172.21.15.177:0/227019403 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb07c11e980 con 0x7fb0800ad250 2023-11-28T20:08:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.055+0000 7fb084f5e640 1 --2- 172.21.15.177:0/227019403 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb0640664a0 0x7fb064068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.055+0000 7fb084f5e640 1 --2- 172.21.15.177:0/227019403 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb0640664a0 0x7fb064068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb0801f9320 tx=0x7fb0700079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:17.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.055+0000 7fb075ffb640 1 -- 172.21.15.177:0/227019403 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb07c0ebcd0 con 0x7fb0800ad250 2023-11-28T20:08:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.219+0000 7fb086761640 1 -- 172.21.15.177:0/227019403 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb08009e090 con 0x7fb0800ad250 2023-11-28T20:08:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.219+0000 7fb075ffb640 1 -- 172.21.15.177:0/227019403 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb07c0ef2f0 con 0x7fb0800ad250 2023-11-28T20:08:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:08:17.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.219+0000 7fb086761640 1 -- 172.21.15.177:0/227019403 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb0640664a0 msgr2=0x7fb064068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.219+0000 7fb086761640 1 --2- 172.21.15.177:0/227019403 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb0640664a0 0x7fb064068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb0801f9320 tx=0x7fb0700079d0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.219+0000 7fb086761640 1 -- 172.21.15.177:0/227019403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0800ad250 msgr2=0x7fb0801582d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.219+0000 7fb086761640 1 --2- 172.21.15.177:0/227019403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0800ad250 0x7fb0801582d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0ad040 tx=0x7fb07c0192e0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.219+0000 7fb086761640 1 -- 172.21.15.177:0/227019403 shutdown_connections 2023-11-28T20:08:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.219+0000 7fb086761640 1 --2- 172.21.15.177:0/227019403 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb0640664a0 0x7fb064068960 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.219+0000 7fb086761640 1 --2- 172.21.15.177:0/227019403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb08015ae40 0x7fb08006eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.219+0000 7fb086761640 1 --2- 172.21.15.177:0/227019403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0800b4560 0x7fb08014a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.219+0000 7fb086761640 1 --2- 172.21.15.177:0/227019403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0800ad250 0x7fb0801582d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.219+0000 7fb086761640 1 -- 172.21.15.177:0/227019403 >> 172.21.15.177:0/227019403 conn(0x7fb0800b1a30 msgr2=0x7fb08015c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.219+0000 7fb086761640 1 -- 172.21.15.177:0/227019403 shutdown_connections 2023-11-28T20:08:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.219+0000 7fb086761640 1 -- 172.21.15.177:0/227019403 wait complete. 2023-11-28T20:08:17.244 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:08:17.244 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:08:17.254 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:17.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff560e3640 1 Processor -- start 2023-11-28T20:08:17.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff560e3640 1 -- start start 2023-11-28T20:08:17.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff560e3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff5013cf30 0x7eff5006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff560e3640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7eff5006c800 0x7eff5015a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff560e3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7eff5015ab70 0x7eff50071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff560e3640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5013d310 con 0x7eff5006c800 2023-11-28T20:08:17.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff560e3640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff501404e0 con 0x7eff5015ab70 2023-11-28T20:08:17.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff560e3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5015b3a0 con 0x7eff5013cf30 2023-11-28T20:08:17.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff47fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7eff5006c800 0x7eff5015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff47fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7eff5006c800 0x7eff5015a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33762/0 (socket says 172.21.15.177:33762) 2023-11-28T20:08:17.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff47fff640 1 -- 172.21.15.177:0/3763839957 learned_addr learned my addr 172.21.15.177:0/3763839957 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:17.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff4ffff640 1 --2- 172.21.15.177:0/3763839957 >> v2:172.21.15.195:3300/0 conn(0x7eff5015ab70 0x7eff50071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff4f7fe640 1 --2- 172.21.15.177:0/3763839957 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff5013cf30 0x7eff5006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff47fff640 1 -- 172.21.15.177:0/3763839957 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff5013cf30 msgr2=0x7eff5006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:17.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff47fff640 1 --2- 172.21.15.177:0/3763839957 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff5013cf30 0x7eff5006c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff47fff640 1 -- 172.21.15.177:0/3763839957 >> v2:172.21.15.195:3300/0 conn(0x7eff5015ab70 msgr2=0x7eff50071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:17.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff47fff640 1 --2- 172.21.15.177:0/3763839957 >> v2:172.21.15.195:3300/0 conn(0x7eff5015ab70 0x7eff50071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.387+0000 7eff47fff640 1 -- 172.21.15.177:0/3763839957 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5006cc40 con 0x7eff5006c800 2023-11-28T20:08:17.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.391+0000 7eff47fff640 1 --2- 172.21.15.177:0/3763839957 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5006c800 0x7eff5015a630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7eff5006d630 tx=0x7eff3801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20da1c331b7ae4bd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:17.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.391+0000 7eff4effd640 1 -- 172.21.15.177:0/3763839957 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380ab600 con 0x7eff5006c800 2023-11-28T20:08:17.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.391+0000 7eff4effd640 1 -- 172.21.15.177:0/3763839957 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff380ab760 con 0x7eff5006c800 2023-11-28T20:08:17.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.391+0000 7eff4effd640 1 -- 172.21.15.177:0/3763839957 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380abaf0 con 0x7eff5006c800 2023-11-28T20:08:17.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.391+0000 7eff560e3640 1 -- 172.21.15.177:0/3763839957 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5006c800 msgr2=0x7eff5015a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.391+0000 7eff560e3640 1 --2- 172.21.15.177:0/3763839957 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5006c800 0x7eff5015a630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7eff5006d630 tx=0x7eff3801c440 comp rx=0 tx=0).stop 2023-11-28T20:08:17.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.391+0000 7eff560e3640 1 -- 172.21.15.177:0/3763839957 shutdown_connections 2023-11-28T20:08:17.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.391+0000 7eff560e3640 1 --2- 172.21.15.177:0/3763839957 >> v2:172.21.15.195:3300/0 conn(0x7eff5015ab70 0x7eff50071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.391+0000 7eff560e3640 1 --2- 172.21.15.177:0/3763839957 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5006c800 0x7eff5015a630 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.391+0000 7eff560e3640 1 --2- 172.21.15.177:0/3763839957 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff5013cf30 0x7eff5006c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.391+0000 7eff560e3640 1 -- 172.21.15.177:0/3763839957 >> 172.21.15.177:0/3763839957 conn(0x7eff5006a530 msgr2=0x7eff5006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:17.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.391+0000 7eff560e3640 1 -- 172.21.15.177:0/3763839957 shutdown_connections 2023-11-28T20:08:17.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.391+0000 7eff560e3640 1 -- 172.21.15.177:0/3763839957 wait complete. 2023-11-28T20:08:17.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff560e3640 1 Processor -- start 2023-11-28T20:08:17.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff560e3640 1 -- start start 2023-11-28T20:08:17.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff560e3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff5006c800 0x7eff501585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff560e3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff5013cf30 0x7eff50156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff560e3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5015ab70 0x7eff5014fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff560e3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff50158ae0 con 0x7eff5015ab70 2023-11-28T20:08:17.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff560e3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff50158e30 con 0x7eff5013cf30 2023-11-28T20:08:17.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff560e3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff50159110 con 0x7eff5006c800 2023-11-28T20:08:17.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff4ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5015ab70 0x7eff5014fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff4ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5015ab70 0x7eff5014fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33776/0 (socket says 172.21.15.177:33776) 2023-11-28T20:08:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff4ffff640 1 -- 172.21.15.177:0/2909158372 learned_addr learned my addr 172.21.15.177:0/2909158372 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff4f7fe640 1 --2- 172.21.15.177:0/2909158372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff5006c800 0x7eff501585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff47fff640 1 --2- 172.21.15.177:0/2909158372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff5013cf30 0x7eff50156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff4ffff640 1 -- 172.21.15.177:0/2909158372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff5006c800 msgr2=0x7eff501585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff4ffff640 1 --2- 172.21.15.177:0/2909158372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff5006c800 0x7eff501585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff4ffff640 1 -- 172.21.15.177:0/2909158372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff5013cf30 msgr2=0x7eff50156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff4ffff640 1 --2- 172.21.15.177:0/2909158372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff5013cf30 0x7eff50156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff4ffff640 1 -- 172.21.15.177:0/2909158372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff380094d0 con 0x7eff5015ab70 2023-11-28T20:08:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff47fff640 1 --2- 172.21.15.177:0/2909158372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff5013cf30 0x7eff50156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff4ffff640 1 --2- 172.21.15.177:0/2909158372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5015ab70 0x7eff5014fee0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7eff48007e40 tx=0x7eff4800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff4cff9640 1 -- 172.21.15.177:0/2909158372 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48014620 con 0x7eff5015ab70 2023-11-28T20:08:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff4cff9640 1 -- 172.21.15.177:0/2909158372 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4800ee90 con 0x7eff5015ab70 2023-11-28T20:08:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff560e3640 1 -- 172.21.15.177:0/2909158372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff501593f0 con 0x7eff5015ab70 2023-11-28T20:08:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff4cff9640 1 -- 172.21.15.177:0/2909158372 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff480149e0 con 0x7eff5015ab70 2023-11-28T20:08:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.395+0000 7eff560e3640 1 -- 172.21.15.177:0/2909158372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff501599b0 con 0x7eff5015ab70 2023-11-28T20:08:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.399+0000 7eff560e3640 1 -- 172.21.15.177:0/2909158372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5013ff80 con 0x7eff5015ab70 2023-11-28T20:08:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.399+0000 7eff4cff9640 1 -- 172.21.15.177:0/2909158372 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff48014b40 con 0x7eff5015ab70 2023-11-28T20:08:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.399+0000 7eff4cff9640 1 --2- 172.21.15.177:0/2909158372 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7eff30066470 0x7eff30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.399+0000 7eff4cff9640 1 -- 172.21.15.177:0/2909158372 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff48084740 con 0x7eff5015ab70 2023-11-28T20:08:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.399+0000 7eff4f7fe640 1 --2- 172.21.15.177:0/2909158372 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7eff30066470 0x7eff30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.399+0000 7eff4f7fe640 1 --2- 172.21.15.177:0/2909158372 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7eff30066470 0x7eff30068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7eff400079c0 tx=0x7eff40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:17.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.403+0000 7eff4cff9640 1 -- 172.21.15.177:0/2909158372 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff48051bb0 con 0x7eff5015ab70 2023-11-28T20:08:17.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.555+0000 7eff560e3640 1 -- 172.21.15.177:0/2909158372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff50069440 con 0x7eff5015ab70 2023-11-28T20:08:17.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.559+0000 7eff4cff9640 1 -- 172.21.15.177:0/2909158372 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7eff480551d0 con 0x7eff5015ab70 2023-11-28T20:08:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:17.563 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:17.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.559+0000 7eff560e3640 1 -- 172.21.15.177:0/2909158372 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7eff30066470 msgr2=0x7eff30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.559+0000 7eff560e3640 1 --2- 172.21.15.177:0/2909158372 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7eff30066470 0x7eff30068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7eff400079c0 tx=0x7eff40008040 comp rx=0 tx=0).stop 2023-11-28T20:08:17.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.559+0000 7eff560e3640 1 -- 172.21.15.177:0/2909158372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5015ab70 msgr2=0x7eff5014fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.559+0000 7eff560e3640 1 --2- 172.21.15.177:0/2909158372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5015ab70 0x7eff5014fee0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7eff48007e40 tx=0x7eff4800e4b0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.559+0000 7eff560e3640 1 -- 172.21.15.177:0/2909158372 shutdown_connections 2023-11-28T20:08:17.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.559+0000 7eff560e3640 1 --2- 172.21.15.177:0/2909158372 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7eff30066470 0x7eff30068930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.559+0000 7eff560e3640 1 --2- 172.21.15.177:0/2909158372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5015ab70 0x7eff5014fee0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.559+0000 7eff560e3640 1 --2- 172.21.15.177:0/2909158372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff5013cf30 0x7eff50156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.559+0000 7eff560e3640 1 --2- 172.21.15.177:0/2909158372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff5006c800 0x7eff501585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.559+0000 7eff560e3640 1 -- 172.21.15.177:0/2909158372 >> 172.21.15.177:0/2909158372 conn(0x7eff5006a530 msgr2=0x7eff50070460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:17.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.559+0000 7eff560e3640 1 -- 172.21.15.177:0/2909158372 shutdown_connections 2023-11-28T20:08:17.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.559+0000 7eff560e3640 1 -- 172.21.15.177:0/2909158372 wait complete. 2023-11-28T20:08:17.584 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:17.584 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa57916640 1 Processor -- start 2023-11-28T20:08:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa57916640 1 -- start start 2023-11-28T20:08:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa57916640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa5015d2a0 0x7ffa500b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa57916640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ffa500b5240 0x7ffa500b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa57916640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa500b75f0 con 0x7ffa500b61c0 2023-11-28T20:08:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa57916640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa500b5c10 con 0x7ffa500b5240 2023-11-28T20:08:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa57916640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500b91a0 con 0x7ffa5015d2a0 2023-11-28T20:08:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa55eb3640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ffa500b5240 0x7ffa500b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa54eb1640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ffa500b61c0 0x7ffa500d1500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36570/0 (socket says 172.21.15.177:36570) 2023-11-28T20:08:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa55eb3640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ffa500b5240 0x7ffa500b56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33790/0 (socket says 172.21.15.177:33790) 2023-11-28T20:08:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa54eb1640 1 -- 172.21.15.177:0/2025874224 learned_addr learned my addr 172.21.15.177:0/2025874224 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa556b2640 1 --2- 172.21.15.177:0/2025874224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa5015d2a0 0x7ffa500b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa55eb3640 1 -- 172.21.15.177:0/2025874224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa5015d2a0 msgr2=0x7ffa500b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa55eb3640 1 --2- 172.21.15.177:0/2025874224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa5015d2a0 0x7ffa500b8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa55eb3640 1 -- 172.21.15.177:0/2025874224 >> v1:172.21.15.177:6789/0 conn(0x7ffa500b61c0 legacy=0x7ffa500d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa55eb3640 1 -- 172.21.15.177:0/2025874224 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa500b69e0 con 0x7ffa500b5240 2023-11-28T20:08:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.719+0000 7ffa47fff640 1 -- 172.21.15.177:0/2025874224 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756881570 0 0) 0x7ffa500b75f0 con 0x7ffa500b61c0 2023-11-28T20:08:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.723+0000 7ffa55eb3640 1 --2- 172.21.15.177:0/2025874224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500b5240 0x7ffa500b56d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009d90 tx=0x7ffa4801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6705295b6ba978de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.723+0000 7ffa47fff640 1 -- 172.21.15.177:0/2025874224 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa480af600 con 0x7ffa500b5240 2023-11-28T20:08:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.723+0000 7ffa47fff640 1 -- 172.21.15.177:0/2025874224 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa480ab050 con 0x7ffa500b5240 2023-11-28T20:08:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.723+0000 7ffa47fff640 1 -- 172.21.15.177:0/2025874224 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa480af980 con 0x7ffa500b5240 2023-11-28T20:08:17.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.723+0000 7ffa57916640 1 -- 172.21.15.177:0/2025874224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500b5240 msgr2=0x7ffa500b56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.723+0000 7ffa57916640 1 --2- 172.21.15.177:0/2025874224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500b5240 0x7ffa500b56d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009d90 tx=0x7ffa4801f130 comp rx=0 tx=0).stop 2023-11-28T20:08:17.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.723+0000 7ffa57916640 1 -- 172.21.15.177:0/2025874224 shutdown_connections 2023-11-28T20:08:17.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.723+0000 7ffa57916640 1 --2- 172.21.15.177:0/2025874224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500b5240 0x7ffa500b56d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.723+0000 7ffa57916640 1 --2- 172.21.15.177:0/2025874224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa5015d2a0 0x7ffa500b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.723+0000 7ffa57916640 1 -- 172.21.15.177:0/2025874224 >> 172.21.15.177:0/2025874224 conn(0x7ffa50072060 msgr2=0x7ffa50072470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:17.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.723+0000 7ffa57916640 1 -- 172.21.15.177:0/2025874224 shutdown_connections 2023-11-28T20:08:17.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.723+0000 7ffa57916640 1 -- 172.21.15.177:0/2025874224 wait complete. 2023-11-28T20:08:17.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa57916640 1 Processor -- start 2023-11-28T20:08:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa57916640 1 -- start start 2023-11-28T20:08:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa57916640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500b5240 0x7ffa501f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa57916640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa500b61c0 0x7ffa501538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa57916640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa5015d2a0 0x7ffa50155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa57916640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5015e670 con 0x7ffa500b5240 2023-11-28T20:08:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa57916640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500c8c50 con 0x7ffa500b61c0 2023-11-28T20:08:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa57916640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500c8f30 con 0x7ffa5015d2a0 2023-11-28T20:08:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa556b2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500b5240 0x7ffa501f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa556b2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500b5240 0x7ffa501f5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33796/0 (socket says 172.21.15.177:33796) 2023-11-28T20:08:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa556b2640 1 -- 172.21.15.177:0/3141544519 learned_addr learned my addr 172.21.15.177:0/3141544519 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa54eb1640 1 --2- 172.21.15.177:0/3141544519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa500b61c0 0x7ffa501538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa55eb3640 1 --2- 172.21.15.177:0/3141544519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa5015d2a0 0x7ffa50155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa556b2640 1 -- 172.21.15.177:0/3141544519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa5015d2a0 msgr2=0x7ffa50155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa556b2640 1 --2- 172.21.15.177:0/3141544519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa5015d2a0 0x7ffa50155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa556b2640 1 -- 172.21.15.177:0/3141544519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa500b61c0 msgr2=0x7ffa501538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa556b2640 1 --2- 172.21.15.177:0/3141544519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa500b61c0 0x7ffa501538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa556b2640 1 -- 172.21.15.177:0/3141544519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa48009a70 con 0x7ffa500b5240 2023-11-28T20:08:17.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa556b2640 1 --2- 172.21.15.177:0/3141544519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500b5240 0x7ffa501f5c10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00d5f0 tx=0x7ffa4c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:17.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa45ffb640 1 -- 172.21.15.177:0/3141544519 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0125f0 con 0x7ffa500b5240 2023-11-28T20:08:17.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa45ffb640 1 -- 172.21.15.177:0/3141544519 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c012750 con 0x7ffa500b5240 2023-11-28T20:08:17.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa45ffb640 1 -- 172.21.15.177:0/3141544519 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c012ae0 con 0x7ffa500b5240 2023-11-28T20:08:17.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa57916640 1 -- 172.21.15.177:0/3141544519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa500c9210 con 0x7ffa500b5240 2023-11-28T20:08:17.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.727+0000 7ffa57916640 1 -- 172.21.15.177:0/3141544519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa50153e00 con 0x7ffa500b5240 2023-11-28T20:08:17.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.731+0000 7ffa57916640 1 -- 172.21.15.177:0/3141544519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa50154080 con 0x7ffa500b5240 2023-11-28T20:08:17.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.731+0000 7ffa45ffb640 1 -- 172.21.15.177:0/3141544519 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffa4c012c40 con 0x7ffa500b5240 2023-11-28T20:08:17.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.731+0000 7ffa45ffb640 1 --2- 172.21.15.177:0/3141544519 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ffa34066470 0x7ffa34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:17.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.731+0000 7ffa45ffb640 1 -- 172.21.15.177:0/3141544519 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa4c084330 con 0x7ffa500b5240 2023-11-28T20:08:17.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.731+0000 7ffa54eb1640 1 --2- 172.21.15.177:0/3141544519 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ffa34066470 0x7ffa34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:17.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.731+0000 7ffa54eb1640 1 --2- 172.21.15.177:0/3141544519 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ffa34066470 0x7ffa34068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffa500d08c0 tx=0x7ffa40007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:17.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.735+0000 7ffa45ffb640 1 -- 172.21.15.177:0/3141544519 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffa4c0517a0 con 0x7ffa500b5240 2023-11-28T20:08:17.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.883+0000 7ffa57916640 1 -- 172.21.15.177:0/3141544519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa500693d0 con 0x7ffa500b5240 2023-11-28T20:08:17.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.887+0000 7ffa45ffb640 1 -- 172.21.15.177:0/3141544519 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa4c007380 con 0x7ffa500b5240 2023-11-28T20:08:17.891 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.887+0000 7ffa57916640 1 -- 172.21.15.177:0/3141544519 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ffa34066470 msgr2=0x7ffa34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.887+0000 7ffa57916640 1 --2- 172.21.15.177:0/3141544519 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ffa34066470 0x7ffa34068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffa500d08c0 tx=0x7ffa40007b60 comp rx=0 tx=0).stop 2023-11-28T20:08:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.887+0000 7ffa57916640 1 -- 172.21.15.177:0/3141544519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500b5240 msgr2=0x7ffa501f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.887+0000 7ffa57916640 1 --2- 172.21.15.177:0/3141544519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500b5240 0x7ffa501f5c10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00d5f0 tx=0x7ffa4c00dab0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.887+0000 7ffa57916640 1 -- 172.21.15.177:0/3141544519 shutdown_connections 2023-11-28T20:08:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.887+0000 7ffa57916640 1 --2- 172.21.15.177:0/3141544519 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ffa34066470 0x7ffa34068930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.887+0000 7ffa57916640 1 --2- 172.21.15.177:0/3141544519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa5015d2a0 0x7ffa50155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.887+0000 7ffa57916640 1 --2- 172.21.15.177:0/3141544519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa500b61c0 0x7ffa501538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.887+0000 7ffa57916640 1 --2- 172.21.15.177:0/3141544519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa500b5240 0x7ffa501f5c10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.887+0000 7ffa57916640 1 -- 172.21.15.177:0/3141544519 >> 172.21.15.177:0/3141544519 conn(0x7ffa50072060 msgr2=0x7ffa500b7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.887+0000 7ffa57916640 1 -- 172.21.15.177:0/3141544519 shutdown_connections 2023-11-28T20:08:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:17.887+0000 7ffa57916640 1 -- 172.21.15.177:0/3141544519 wait complete. 2023-11-28T20:08:17.912 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:18.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.047+0000 7fa64bf9d640 1 Processor -- start 2023-11-28T20:08:18.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.047+0000 7fa64bf9d640 1 -- start start 2023-11-28T20:08:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.047+0000 7fa64bf9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa6441571d0 0x7fa644070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.047+0000 7fa64bf9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa6440ae830 0x7fa64415d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.047+0000 7fa64bf9d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6441575b0 con 0x7fa64415d710 2023-11-28T20:08:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.047+0000 7fa64bf9d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64415db40 con 0x7fa6440ae830 2023-11-28T20:08:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.047+0000 7fa64bf9d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa644071600 con 0x7fa6441571d0 2023-11-28T20:08:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.051+0000 7fa64a53a640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fa64415d710 0x7fa644159be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36572/0 (socket says 172.21.15.177:36572) 2023-11-28T20:08:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.051+0000 7fa64a53a640 1 -- 172.21.15.177:0/3706121561 learned_addr learned my addr 172.21.15.177:0/3706121561 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.051+0000 7fa649538640 1 --2- 172.21.15.177:0/3706121561 >> v2:172.21.15.177:3300/0 conn(0x7fa6440ae830 0x7fa64415d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.051+0000 7fa649d39640 1 --2- 172.21.15.177:0/3706121561 >> v2:172.21.15.195:3300/0 conn(0x7fa6441571d0 0x7fa644070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.051+0000 7fa648d37640 1 -- 172.21.15.177:0/3706121561 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747392133 0 0) 0x7fa6441575b0 con 0x7fa64415d710 2023-11-28T20:08:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.051+0000 7fa648d37640 1 -- 172.21.15.177:0/3706121561 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa630003530 con 0x7fa64415d710 2023-11-28T20:08:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.051+0000 7fa649538640 1 -- 172.21.15.177:0/3706121561 >> v2:172.21.15.195:3300/0 conn(0x7fa6441571d0 msgr2=0x7fa644070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.051+0000 7fa649538640 1 --2- 172.21.15.177:0/3706121561 >> v2:172.21.15.195:3300/0 conn(0x7fa6441571d0 0x7fa644070c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.051+0000 7fa649538640 1 -- 172.21.15.177:0/3706121561 >> v1:172.21.15.177:6789/0 conn(0x7fa64415d710 legacy=0x7fa644159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.051+0000 7fa649538640 1 -- 172.21.15.177:0/3706121561 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6440718e0 con 0x7fa6440ae830 2023-11-28T20:08:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.051+0000 7fa649538640 1 --2- 172.21.15.177:0/3706121561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6440ae830 0x7fa64415d1d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa64406bf90 tx=0x7fa63401d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4c17393de4a5fe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.051+0000 7fa648d37640 1 -- 172.21.15.177:0/3706121561 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6340a67d0 con 0x7fa6440ae830 2023-11-28T20:08:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa648d37640 1 -- 172.21.15.177:0/3706121561 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6340a6930 con 0x7fa6440ae830 2023-11-28T20:08:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa648d37640 1 -- 172.21.15.177:0/3706121561 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6340a6cc0 con 0x7fa6440ae830 2023-11-28T20:08:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 -- 172.21.15.177:0/3706121561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6440ae830 msgr2=0x7fa64415d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 --2- 172.21.15.177:0/3706121561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6440ae830 0x7fa64415d1d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa64406bf90 tx=0x7fa63401d7a0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 -- 172.21.15.177:0/3706121561 shutdown_connections 2023-11-28T20:08:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 --2- 172.21.15.177:0/3706121561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6440ae830 0x7fa64415d1d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 --2- 172.21.15.177:0/3706121561 >> v2:172.21.15.195:3300/0 conn(0x7fa6441571d0 0x7fa644070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 -- 172.21.15.177:0/3706121561 >> 172.21.15.177:0/3706121561 conn(0x7fa6440b0cc0 msgr2=0x7fa6440b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:18.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 -- 172.21.15.177:0/3706121561 shutdown_connections 2023-11-28T20:08:18.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 -- 172.21.15.177:0/3706121561 wait complete. 2023-11-28T20:08:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 Processor -- start 2023-11-28T20:08:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 -- start start 2023-11-28T20:08:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6440ae830 0x7fa6441f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6441571d0 0x7fa64415be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa64415d710 0x7fa64415c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64415dd00 con 0x7fa64415d710 2023-11-28T20:08:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64415df50 con 0x7fa6440ae830 2023-11-28T20:08:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64bf9d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64415e230 con 0x7fa6441571d0 2023-11-28T20:08:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64a53a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa64415d710 0x7fa64415c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64a53a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa64415d710 0x7fa64415c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33816/0 (socket says 172.21.15.177:33816) 2023-11-28T20:08:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa64a53a640 1 -- 172.21.15.177:0/2081651425 learned_addr learned my addr 172.21.15.177:0/2081651425 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa649d39640 1 --2- 172.21.15.177:0/2081651425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6440ae830 0x7fa6441f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.055+0000 7fa649538640 1 --2- 172.21.15.177:0/2081651425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6441571d0 0x7fa64415be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa64a53a640 1 -- 172.21.15.177:0/2081651425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6441571d0 msgr2=0x7fa64415be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa64a53a640 1 --2- 172.21.15.177:0/2081651425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6441571d0 0x7fa64415be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa64a53a640 1 -- 172.21.15.177:0/2081651425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6440ae830 msgr2=0x7fa6441f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa64a53a640 1 --2- 172.21.15.177:0/2081651425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6440ae830 0x7fa6441f67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa64a53a640 1 -- 172.21.15.177:0/2081651425 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63400a5c0 con 0x7fa64415d710 2023-11-28T20:08:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa649538640 1 --2- 172.21.15.177:0/2081651425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6441571d0 0x7fa64415be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa64a53a640 1 --2- 172.21.15.177:0/2081651425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa64415d710 0x7fa64415c3d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00caa0 tx=0x7fa63c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa63a7fc640 1 -- 172.21.15.177:0/2081651425 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00ac00 con 0x7fa64415d710 2023-11-28T20:08:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa63a7fc640 1 -- 172.21.15.177:0/2081651425 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c00ad60 con 0x7fa64415d710 2023-11-28T20:08:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa64bf9d640 1 -- 172.21.15.177:0/2081651425 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64415e510 con 0x7fa64415d710 2023-11-28T20:08:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa63a7fc640 1 -- 172.21.15.177:0/2081651425 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c012620 con 0x7fa64415d710 2023-11-28T20:08:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa64bf9d640 1 -- 172.21.15.177:0/2081651425 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6441f6cf0 con 0x7fa64415d710 2023-11-28T20:08:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa64bf9d640 1 -- 172.21.15.177:0/2081651425 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64415ea30 con 0x7fa64415d710 2023-11-28T20:08:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa63a7fc640 1 -- 172.21.15.177:0/2081651425 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa63c007070 con 0x7fa64415d710 2023-11-28T20:08:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa63a7fc640 1 --2- 172.21.15.177:0/2081651425 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa6280664a0 0x7fa628068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa63a7fc640 1 -- 172.21.15.177:0/2081651425 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa63c083d50 con 0x7fa64415d710 2023-11-28T20:08:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.059+0000 7fa649d39640 1 --2- 172.21.15.177:0/2081651425 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa6280664a0 0x7fa628068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.063+0000 7fa649d39640 1 --2- 172.21.15.177:0/2081651425 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa6280664a0 0x7fa628068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa640009b60 tx=0x7fa640009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:18.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.063+0000 7fa63a7fc640 1 -- 172.21.15.177:0/2081651425 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa64415ea30 con 0x7fa64415d710 2023-11-28T20:08:18.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.211+0000 7fa64bf9d640 1 -- 172.21.15.177:0/2081651425 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa64415ea30 con 0x7fa64415d710 2023-11-28T20:08:18.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.211+0000 7fa63a7fc640 1 -- 172.21.15.177:0/2081651425 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa63c017020 con 0x7fa64415d710 2023-11-28T20:08:18.218 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:18.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.215+0000 7fa64bf9d640 1 -- 172.21.15.177:0/2081651425 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa6280664a0 msgr2=0x7fa628068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.215+0000 7fa64bf9d640 1 --2- 172.21.15.177:0/2081651425 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa6280664a0 0x7fa628068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa640009b60 tx=0x7fa640009190 comp rx=0 tx=0).stop 2023-11-28T20:08:18.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.215+0000 7fa64bf9d640 1 -- 172.21.15.177:0/2081651425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa64415d710 msgr2=0x7fa64415c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.215+0000 7fa64bf9d640 1 --2- 172.21.15.177:0/2081651425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa64415d710 0x7fa64415c3d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00caa0 tx=0x7fa63c00cf60 comp rx=0 tx=0).stop 2023-11-28T20:08:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.215+0000 7fa64bf9d640 1 -- 172.21.15.177:0/2081651425 shutdown_connections 2023-11-28T20:08:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.215+0000 7fa64bf9d640 1 --2- 172.21.15.177:0/2081651425 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa6280664a0 0x7fa628068960 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.215+0000 7fa64bf9d640 1 --2- 172.21.15.177:0/2081651425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa64415d710 0x7fa64415c3d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.215+0000 7fa64bf9d640 1 --2- 172.21.15.177:0/2081651425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6441571d0 0x7fa64415be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.215+0000 7fa64bf9d640 1 --2- 172.21.15.177:0/2081651425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6440ae830 0x7fa6441f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.215+0000 7fa64bf9d640 1 -- 172.21.15.177:0/2081651425 >> 172.21.15.177:0/2081651425 conn(0x7fa6440b0cc0 msgr2=0x7fa644158ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.215+0000 7fa64bf9d640 1 -- 172.21.15.177:0/2081651425 shutdown_connections 2023-11-28T20:08:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.215+0000 7fa64bf9d640 1 -- 172.21.15.177:0/2081651425 wait complete. 2023-11-28T20:08:18.238 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:18.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7c21f8640 1 Processor -- start 2023-11-28T20:08:18.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7c21f8640 1 -- start start 2023-11-28T20:08:18.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7c21f8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb7bc0cba10 0x7fb7bc15be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7c21f8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc0b42d0 0x7fb7bc0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7c21f8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7bc0b4c60 con 0x7fb7bc158ca0 2023-11-28T20:08:18.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7c21f8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc15b670 con 0x7fb7bc0cba10 2023-11-28T20:08:18.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7c21f8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc15f410 con 0x7fb7bc0b42d0 2023-11-28T20:08:18.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7b3fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb7bc0cba10 0x7fb7bc15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7b3fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb7bc0cba10 0x7fb7bc15be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33832/0 (socket says 172.21.15.177:33832) 2023-11-28T20:08:18.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7b3fff640 1 -- 172.21.15.177:0/90335046 learned_addr learned my addr 172.21.15.177:0/90335046 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:18.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7bb7fe640 1 --1- 172.21.15.177:0/90335046 >> v1:172.21.15.177:6789/0 conn(0x7fb7bc158ca0 0x7fb7bc15eb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36584/0 (socket says 172.21.15.177:36584) 2023-11-28T20:08:18.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7bbfff640 1 --2- 172.21.15.177:0/90335046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc0b42d0 0x7fb7bc0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7b3fff640 1 -- 172.21.15.177:0/90335046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc0b42d0 msgr2=0x7fb7bc0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:18.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7b3fff640 1 --2- 172.21.15.177:0/90335046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc0b42d0 0x7fb7bc0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7b3fff640 1 -- 172.21.15.177:0/90335046 >> v1:172.21.15.177:6789/0 conn(0x7fb7bc158ca0 legacy=0x7fb7bc15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7b3fff640 1 -- 172.21.15.177:0/90335046 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc15f6f0 con 0x7fb7bc0cba10 2023-11-28T20:08:18.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.375+0000 7fb7baffd640 1 -- 172.21.15.177:0/90335046 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584249133 0 0) 0x7fb7ac001120 con 0x7fb7bc158ca0 2023-11-28T20:08:18.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.379+0000 7fb7b3fff640 1 --2- 172.21.15.177:0/90335046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0cba10 0x7fb7bc15be00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009870 tx=0x7fb7a401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6959db0e6f137200 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:18.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.379+0000 7fb7baffd640 1 -- 172.21.15.177:0/90335046 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40ab650 con 0x7fb7bc0cba10 2023-11-28T20:08:18.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.379+0000 7fb7baffd640 1 -- 172.21.15.177:0/90335046 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a40ab7b0 con 0x7fb7bc0cba10 2023-11-28T20:08:18.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.379+0000 7fb7baffd640 1 -- 172.21.15.177:0/90335046 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40abb40 con 0x7fb7bc0cba10 2023-11-28T20:08:18.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.379+0000 7fb7c21f8640 1 -- 172.21.15.177:0/90335046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0cba10 msgr2=0x7fb7bc15be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.379+0000 7fb7c21f8640 1 --2- 172.21.15.177:0/90335046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0cba10 0x7fb7bc15be00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009870 tx=0x7fb7a401c540 comp rx=0 tx=0).stop 2023-11-28T20:08:18.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.379+0000 7fb7c21f8640 1 -- 172.21.15.177:0/90335046 shutdown_connections 2023-11-28T20:08:18.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.379+0000 7fb7c21f8640 1 --2- 172.21.15.177:0/90335046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0cba10 0x7fb7bc15be00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.379+0000 7fb7c21f8640 1 --2- 172.21.15.177:0/90335046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc0b42d0 0x7fb7bc0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.379+0000 7fb7c21f8640 1 -- 172.21.15.177:0/90335046 >> 172.21.15.177:0/90335046 conn(0x7fb7bc0b0cc0 msgr2=0x7fb7bc0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:18.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.379+0000 7fb7c21f8640 1 -- 172.21.15.177:0/90335046 shutdown_connections 2023-11-28T20:08:18.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.379+0000 7fb7c21f8640 1 -- 172.21.15.177:0/90335046 wait complete. 2023-11-28T20:08:18.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7c21f8640 1 Processor -- start 2023-11-28T20:08:18.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7c21f8640 1 -- start start 2023-11-28T20:08:18.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7c21f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0b42d0 0x7fb7bc1f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7c21f8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc0cba10 0x7fb7bc151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7c21f8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7bc158ca0 0x7fb7bc157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7c21f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc158370 con 0x7fb7bc0b42d0 2023-11-28T20:08:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7c21f8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0b2020 con 0x7fb7bc158ca0 2023-11-28T20:08:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7c21f8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0b40a0 con 0x7fb7bc0cba10 2023-11-28T20:08:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7bb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0b42d0 0x7fb7bc1f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7bb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0b42d0 0x7fb7bc1f66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33848/0 (socket says 172.21.15.177:33848) 2023-11-28T20:08:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7bb7fe640 1 -- 172.21.15.177:0/1536447162 learned_addr learned my addr 172.21.15.177:0/1536447162 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7bbfff640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7bc158ca0 0x7fb7bc157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7b3fff640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc0cba10 0x7fb7bc151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7bb7fe640 1 -- 172.21.15.177:0/1536447162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc0cba10 msgr2=0x7fb7bc151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7bb7fe640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc0cba10 0x7fb7bc151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7bb7fe640 1 -- 172.21.15.177:0/1536447162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7bc158ca0 msgr2=0x7fb7bc157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7bb7fe640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7bc158ca0 0x7fb7bc157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7bb7fe640 1 -- 172.21.15.177:0/1536447162 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a40094d0 con 0x7fb7bc0b42d0 2023-11-28T20:08:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7bbfff640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7bc158ca0 0x7fb7bc157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7b3fff640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc0cba10 0x7fb7bc151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7bb7fe640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0b42d0 0x7fb7bc1f66e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00c780 tx=0x7fb7ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7b8ff9640 1 -- 172.21.15.177:0/1536447162 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0072d0 con 0x7fb7bc0b42d0 2023-11-28T20:08:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7b8ff9640 1 -- 172.21.15.177:0/1536447162 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac007450 con 0x7fb7bc0b42d0 2023-11-28T20:08:18.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7b8ff9640 1 -- 172.21.15.177:0/1536447162 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0047f0 con 0x7fb7bc0b42d0 2023-11-28T20:08:18.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7c21f8640 1 -- 172.21.15.177:0/1536447162 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7bc0b3800 con 0x7fb7bc0b42d0 2023-11-28T20:08:18.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7c21f8640 1 -- 172.21.15.177:0/1536447162 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7bc0b3dc0 con 0x7fb7bc0b42d0 2023-11-28T20:08:18.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.383+0000 7fb7c21f8640 1 -- 172.21.15.177:0/1536447162 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7bc0693d0 con 0x7fb7bc0b42d0 2023-11-28T20:08:18.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.387+0000 7fb7b8ff9640 1 -- 172.21.15.177:0/1536447162 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb7ac004950 con 0x7fb7bc0b42d0 2023-11-28T20:08:18.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.387+0000 7fb7b8ff9640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb79c066470 0x7fb79c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.387+0000 7fb7b8ff9640 1 -- 172.21.15.177:0/1536447162 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7ac082fd0 con 0x7fb7bc0b42d0 2023-11-28T20:08:18.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.387+0000 7fb7b3fff640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb79c066470 0x7fb79c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.387+0000 7fb7b3fff640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb79c066470 0x7fb79c068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40af000 tx=0x7fb7a40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:18.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.391+0000 7fb7b8ff9640 1 -- 172.21.15.177:0/1536447162 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb7ac050440 con 0x7fb7bc0b42d0 2023-11-28T20:08:18.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.547+0000 7fb7c21f8640 1 -- 172.21.15.177:0/1536447162 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7bc0b4c10 con 0x7fb7bc0b42d0 2023-11-28T20:08:18.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.547+0000 7fb7b8ff9640 1 -- 172.21.15.177:0/1536447162 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7ac018020 con 0x7fb7bc0b42d0 2023-11-28T20:08:18.553 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:18.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.551+0000 7fb7c21f8640 1 -- 172.21.15.177:0/1536447162 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb79c066470 msgr2=0x7fb79c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.551+0000 7fb7c21f8640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb79c066470 0x7fb79c068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40af000 tx=0x7fb7a40a7000 comp rx=0 tx=0).stop 2023-11-28T20:08:18.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.551+0000 7fb7c21f8640 1 -- 172.21.15.177:0/1536447162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0b42d0 msgr2=0x7fb7bc1f66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.551+0000 7fb7c21f8640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0b42d0 0x7fb7bc1f66e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00c780 tx=0x7fb7ac00cc40 comp rx=0 tx=0).stop 2023-11-28T20:08:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.551+0000 7fb7c21f8640 1 -- 172.21.15.177:0/1536447162 shutdown_connections 2023-11-28T20:08:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.551+0000 7fb7c21f8640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb79c066470 0x7fb79c068930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.551+0000 7fb7c21f8640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7bc158ca0 0x7fb7bc157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.551+0000 7fb7c21f8640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc0cba10 0x7fb7bc151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.551+0000 7fb7c21f8640 1 --2- 172.21.15.177:0/1536447162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0b42d0 0x7fb7bc1f66e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.551+0000 7fb7c21f8640 1 -- 172.21.15.177:0/1536447162 >> 172.21.15.177:0/1536447162 conn(0x7fb7bc0b0cc0 msgr2=0x7fb7bc165000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.551+0000 7fb7c21f8640 1 -- 172.21.15.177:0/1536447162 shutdown_connections 2023-11-28T20:08:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.551+0000 7fb7c21f8640 1 -- 172.21.15.177:0/1536447162 wait complete. 2023-11-28T20:08:18.574 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:08:18.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.707+0000 7f82de617640 1 Processor -- start 2023-11-28T20:08:18.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.707+0000 7f82de617640 1 -- start start 2023-11-28T20:08:18.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.707+0000 7f82de617640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82d8140180 0x7f82d8071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.707+0000 7f82de617640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f82d806c740 0x7f82d8070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.707+0000 7f82de617640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d81408c0 con 0x7f82d806c2c0 2023-11-28T20:08:18.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.707+0000 7f82de617640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d815db80 con 0x7f82d806c740 2023-11-28T20:08:18.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.707+0000 7f82de617640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d815de60 con 0x7f82d8140180 2023-11-28T20:08:18.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.711+0000 7f82d77fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f82d806c2c0 0x7f82d8070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:36586/0 (socket says 172.21.15.177:36586) 2023-11-28T20:08:18.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.711+0000 7f82d77fe640 1 -- 172.21.15.177:0/2643970549 learned_addr learned my addr 172.21.15.177:0/2643970549 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:18.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.711+0000 7f82d7fff640 1 --2- 172.21.15.177:0/2643970549 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82d8140180 0x7f82d8071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.711+0000 7f82dcbb4640 1 --2- 172.21.15.177:0/2643970549 >> v2:172.21.15.195:3300/0 conn(0x7f82d806c740 0x7f82d8070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.711+0000 7f82d6ffd640 1 -- 172.21.15.177:0/2643970549 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731020490 0 0) 0x7f82d81408c0 con 0x7f82d806c2c0 2023-11-28T20:08:18.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.711+0000 7f82d6ffd640 1 -- 172.21.15.177:0/2643970549 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82c0003530 con 0x7f82d806c2c0 2023-11-28T20:08:18.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.711+0000 7f82d7fff640 1 -- 172.21.15.177:0/2643970549 >> v2:172.21.15.195:3300/0 conn(0x7f82d806c740 msgr2=0x7f82d8070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:18.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.711+0000 7f82d7fff640 1 --2- 172.21.15.177:0/2643970549 >> v2:172.21.15.195:3300/0 conn(0x7f82d806c740 0x7f82d8070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.711+0000 7f82d7fff640 1 -- 172.21.15.177:0/2643970549 >> v1:172.21.15.177:6789/0 conn(0x7f82d806c2c0 legacy=0x7f82d8070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.711+0000 7f82d7fff640 1 -- 172.21.15.177:0/2643970549 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d815e140 con 0x7f82d8140180 2023-11-28T20:08:18.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.711+0000 7f82d7fff640 1 --2- 172.21.15.177:0/2643970549 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82d8140180 0x7f82d8071f20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f82c80097c0 tx=0x7f82c801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e772a6599247a1ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:18.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.711+0000 7f82d6ffd640 1 -- 172.21.15.177:0/2643970549 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80ab650 con 0x7f82d8140180 2023-11-28T20:08:18.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.711+0000 7f82d6ffd640 1 -- 172.21.15.177:0/2643970549 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c80ab7b0 con 0x7f82d8140180 2023-11-28T20:08:18.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.711+0000 7f82d6ffd640 1 -- 172.21.15.177:0/2643970549 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80abb40 con 0x7f82d8140180 2023-11-28T20:08:18.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 -- 172.21.15.177:0/2643970549 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82d8140180 msgr2=0x7f82d8071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 --2- 172.21.15.177:0/2643970549 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82d8140180 0x7f82d8071f20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f82c80097c0 tx=0x7f82c801c450 comp rx=0 tx=0).stop 2023-11-28T20:08:18.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 -- 172.21.15.177:0/2643970549 shutdown_connections 2023-11-28T20:08:18.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 --2- 172.21.15.177:0/2643970549 >> v2:172.21.15.195:3300/0 conn(0x7f82d806c740 0x7f82d8070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 --2- 172.21.15.177:0/2643970549 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82d8140180 0x7f82d8071f20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 -- 172.21.15.177:0/2643970549 >> 172.21.15.177:0/2643970549 conn(0x7f82d806a530 msgr2=0x7f82d806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:18.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 -- 172.21.15.177:0/2643970549 shutdown_connections 2023-11-28T20:08:18.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 -- 172.21.15.177:0/2643970549 wait complete. 2023-11-28T20:08:18.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 Processor -- start 2023-11-28T20:08:18.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 -- start start 2023-11-28T20:08:18.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82d806c2c0 0x7f82d813f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82d806c740 0x7f82d8137320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82d8140180 0x7f82d8137860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d8156e00 con 0x7f82d806c740 2023-11-28T20:08:18.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d81570e0 con 0x7f82d806c2c0 2023-11-28T20:08:18.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82de617640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d80ae1e0 con 0x7f82d8140180 2023-11-28T20:08:18.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82d77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82d806c740 0x7f82d8137320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82d77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82d806c740 0x7f82d8137320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33854/0 (socket says 172.21.15.177:33854) 2023-11-28T20:08:18.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82d77fe640 1 -- 172.21.15.177:0/2089178133 learned_addr learned my addr 172.21.15.177:0/2089178133 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:18.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82d7fff640 1 --2- 172.21.15.177:0/2089178133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82d806c2c0 0x7f82d813f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.715+0000 7f82dcbb4640 1 --2- 172.21.15.177:0/2089178133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82d8140180 0x7f82d8137860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82d77fe640 1 -- 172.21.15.177:0/2089178133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82d8140180 msgr2=0x7f82d8137860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82d77fe640 1 --2- 172.21.15.177:0/2089178133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82d8140180 0x7f82d8137860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82d77fe640 1 -- 172.21.15.177:0/2089178133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82d806c2c0 msgr2=0x7f82d813f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82d77fe640 1 --2- 172.21.15.177:0/2089178133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82d806c2c0 0x7f82d813f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82d77fe640 1 -- 172.21.15.177:0/2089178133 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c8009420 con 0x7f82d806c740 2023-11-28T20:08:18.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82d77fe640 1 --2- 172.21.15.177:0/2089178133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82d806c740 0x7f82d8137320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00c4d0 tx=0x7f82cc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:18.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82d4ff9640 1 -- 172.21.15.177:0/2089178133 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc005cf0 con 0x7f82d806c740 2023-11-28T20:08:18.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82d4ff9640 1 -- 172.21.15.177:0/2089178133 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc005e50 con 0x7f82d806c740 2023-11-28T20:08:18.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82d4ff9640 1 -- 172.21.15.177:0/2089178133 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc007270 con 0x7f82d806c740 2023-11-28T20:08:18.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82de617640 1 -- 172.21.15.177:0/2089178133 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d80ae4c0 con 0x7f82d806c740 2023-11-28T20:08:18.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82de617640 1 -- 172.21.15.177:0/2089178133 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d813fbf0 con 0x7f82d806c740 2023-11-28T20:08:18.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82de617640 1 -- 172.21.15.177:0/2089178133 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d8069440 con 0x7f82d806c740 2023-11-28T20:08:18.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82d4ff9640 1 -- 172.21.15.177:0/2089178133 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f82cc0073d0 con 0x7f82d806c740 2023-11-28T20:08:18.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82d4ff9640 1 --2- 172.21.15.177:0/2089178133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f82c4066470 0x7f82c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:18.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82d4ff9640 1 -- 172.21.15.177:0/2089178133 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82cc083470 con 0x7f82d806c740 2023-11-28T20:08:18.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.719+0000 7f82d7fff640 1 --2- 172.21.15.177:0/2089178133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f82c4066470 0x7f82c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:18.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.723+0000 7f82d7fff640 1 --2- 172.21.15.177:0/2089178133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f82c4066470 0x7f82c4068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f82c80af000 tx=0x7f82c80b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:18.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.723+0000 7f82d4ff9640 1 -- 172.21.15.177:0/2089178133 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f82cc050870 con 0x7f82d806c740 2023-11-28T20:08:18.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.887+0000 7f82de617640 1 -- 172.21.15.177:0/2089178133 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f82d80b3fa0 con 0x7f82d806c740 2023-11-28T20:08:18.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.887+0000 7f82d4ff9640 1 -- 172.21.15.177:0/2089178133 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f82cc017080 con 0x7f82d806c740 2023-11-28T20:08:18.891 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:08:18.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.887+0000 7f82de617640 1 -- 172.21.15.177:0/2089178133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f82c4066470 msgr2=0x7f82c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.887+0000 7f82de617640 1 --2- 172.21.15.177:0/2089178133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f82c4066470 0x7f82c4068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f82c80af000 tx=0x7f82c80b6040 comp rx=0 tx=0).stop 2023-11-28T20:08:18.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.887+0000 7f82de617640 1 -- 172.21.15.177:0/2089178133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82d806c740 msgr2=0x7f82d8137320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:18.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.887+0000 7f82de617640 1 --2- 172.21.15.177:0/2089178133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82d806c740 0x7f82d8137320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00c4d0 tx=0x7f82cc00c990 comp rx=0 tx=0).stop 2023-11-28T20:08:18.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.887+0000 7f82de617640 1 -- 172.21.15.177:0/2089178133 shutdown_connections 2023-11-28T20:08:18.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.887+0000 7f82de617640 1 --2- 172.21.15.177:0/2089178133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f82c4066470 0x7f82c4068930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.887+0000 7f82de617640 1 --2- 172.21.15.177:0/2089178133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82d8140180 0x7f82d8137860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.887+0000 7f82de617640 1 --2- 172.21.15.177:0/2089178133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82d806c740 0x7f82d8137320 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.887+0000 7f82de617640 1 --2- 172.21.15.177:0/2089178133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82d806c2c0 0x7f82d813f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:18.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.887+0000 7f82de617640 1 -- 172.21.15.177:0/2089178133 >> 172.21.15.177:0/2089178133 conn(0x7f82d806a530 msgr2=0x7f82d80b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:18.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.887+0000 7f82de617640 1 -- 172.21.15.177:0/2089178133 shutdown_connections 2023-11-28T20:08:18.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:18.887+0000 7f82de617640 1 -- 172.21.15.177:0/2089178133 wait complete. 2023-11-28T20:08:18.912 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi195.front.sepia.ceph.com... 2023-11-28T20:08:18.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:18.913 DEBUG:teuthology.orchestra.run.smithi195:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-28T20:08:18.955 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:08:18.956 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:08:18.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:18.956 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T20:08:19.016 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:08:19.016 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:08:19.027 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:08:19.027 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:08:19.079 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:19.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.255+0000 7fd950632640 1 Processor -- start 2023-11-28T20:08:19.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.255+0000 7fd950632640 1 -- start start 2023-11-28T20:08:19.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.255+0000 7fd950632640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd94806c9d0 0x7fd948070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.255+0000 7fd950632640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9480710e0 con 0x7fd948144840 2023-11-28T20:08:19.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.255+0000 7fd950632640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9480713c0 con 0x7fd948072180 2023-11-28T20:08:19.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.255+0000 7fd950632640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94815f010 con 0x7fd94806c9d0 2023-11-28T20:08:19.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.255+0000 7fd94dbcd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd94806c9d0 0x7fd948070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.255+0000 7fd94dbcd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd94806c9d0 0x7fd948070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53046/0 (socket says 172.21.15.177:53046) 2023-11-28T20:08:19.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.255+0000 7fd94dbcd640 1 -- 172.21.15.177:0/1671471252 learned_addr learned my addr 172.21.15.177:0/1671471252 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:19.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.255+0000 7fd94dbcd640 1 -- 172.21.15.177:0/1671471252 >> v1:172.21.15.195:6789/0 conn(0x7fd948072180 legacy=0x7fd94815b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:19.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.255+0000 7fd94dbcd640 1 -- 172.21.15.177:0/1671471252 >> v1:172.21.15.177:6789/0 conn(0x7fd948144840 legacy=0x7fd94806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:19.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.255+0000 7fd94dbcd640 1 -- 172.21.15.177:0/1671471252 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9480716a0 con 0x7fd94806c9d0 2023-11-28T20:08:19.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.259+0000 7fd94dbcd640 1 --2- 172.21.15.177:0/1671471252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94806c9d0 0x7fd948070460 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd938009870 tx=0x7fd93801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240b7447c7d0db70 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:19.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.259+0000 7fd94d3cc640 1 -- 172.21.15.177:0/1671471252 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9380aa430 con 0x7fd94806c9d0 2023-11-28T20:08:19.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.259+0000 7fd94d3cc640 1 -- 172.21.15.177:0/1671471252 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9380aa590 con 0x7fd94806c9d0 2023-11-28T20:08:19.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.259+0000 7fd94d3cc640 1 -- 172.21.15.177:0/1671471252 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9380aa920 con 0x7fd94806c9d0 2023-11-28T20:08:19.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.259+0000 7fd950632640 1 -- 172.21.15.177:0/1671471252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94806c9d0 msgr2=0x7fd948070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:19.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.259+0000 7fd950632640 1 --2- 172.21.15.177:0/1671471252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94806c9d0 0x7fd948070460 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd938009870 tx=0x7fd93801c4d0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.259+0000 7fd950632640 1 -- 172.21.15.177:0/1671471252 shutdown_connections 2023-11-28T20:08:19.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.259+0000 7fd950632640 1 --2- 172.21.15.177:0/1671471252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94806c9d0 0x7fd948070460 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.259+0000 7fd950632640 1 -- 172.21.15.177:0/1671471252 >> 172.21.15.177:0/1671471252 conn(0x7fd94806a530 msgr2=0x7fd94806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:19.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.259+0000 7fd950632640 1 -- 172.21.15.177:0/1671471252 shutdown_connections 2023-11-28T20:08:19.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.259+0000 7fd950632640 1 -- 172.21.15.177:0/1671471252 wait complete. 2023-11-28T20:08:19.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd950632640 1 Processor -- start 2023-11-28T20:08:19.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd950632640 1 -- start start 2023-11-28T20:08:19.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd950632640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94806c9d0 0x7fd9480c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd950632640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd948072180 0x7fd9480b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd950632640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd948144840 0x7fd94812df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd950632640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9480c4620 con 0x7fd94806c9d0 2023-11-28T20:08:19.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd950632640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9481419d0 con 0x7fd948144840 2023-11-28T20:08:19.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd950632640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9480c3fd0 con 0x7fd948072180 2023-11-28T20:08:19.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd94e3ce640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94806c9d0 0x7fd9480c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd94e3ce640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94806c9d0 0x7fd9480c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53058/0 (socket says 172.21.15.177:53058) 2023-11-28T20:08:19.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd94e3ce640 1 -- 172.21.15.177:0/3522688389 learned_addr learned my addr 172.21.15.177:0/3522688389 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:19.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd94e3ce640 1 -- 172.21.15.177:0/3522688389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd948072180 msgr2=0x7fd9480b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:19.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd94e3ce640 1 --2- 172.21.15.177:0/3522688389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd948072180 0x7fd9480b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd94e3ce640 1 -- 172.21.15.177:0/3522688389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd948144840 msgr2=0x7fd94812df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:19.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd94e3ce640 1 --2- 172.21.15.177:0/3522688389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd948144840 0x7fd94812df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd94e3ce640 1 -- 172.21.15.177:0/3522688389 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9380094d0 con 0x7fd94806c9d0 2023-11-28T20:08:19.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd94e3ce640 1 --2- 172.21.15.177:0/3522688389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94806c9d0 0x7fd9480c4ab0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd94400c3c0 tx=0x7fd94400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:19.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd93effd640 1 -- 172.21.15.177:0/3522688389 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9440052d0 con 0x7fd94806c9d0 2023-11-28T20:08:19.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd93effd640 1 -- 172.21.15.177:0/3522688389 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd944005430 con 0x7fd94806c9d0 2023-11-28T20:08:19.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd93effd640 1 -- 172.21.15.177:0/3522688389 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944003840 con 0x7fd94806c9d0 2023-11-28T20:08:19.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd950632640 1 -- 172.21.15.177:0/3522688389 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9480c42b0 con 0x7fd94806c9d0 2023-11-28T20:08:19.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd950632640 1 -- 172.21.15.177:0/3522688389 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9480c4ff0 con 0x7fd94806c9d0 2023-11-28T20:08:19.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.263+0000 7fd950632640 1 -- 172.21.15.177:0/3522688389 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd948069440 con 0x7fd94806c9d0 2023-11-28T20:08:19.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.267+0000 7fd93effd640 1 -- 172.21.15.177:0/3522688389 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd9440039a0 con 0x7fd94806c9d0 2023-11-28T20:08:19.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.267+0000 7fd93effd640 1 --2- 172.21.15.177:0/3522688389 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd92c066470 0x7fd92c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.267+0000 7fd93effd640 1 -- 172.21.15.177:0/3522688389 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd944083440 con 0x7fd94806c9d0 2023-11-28T20:08:19.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.267+0000 7fd94dbcd640 1 --2- 172.21.15.177:0/3522688389 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd92c066470 0x7fd92c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.267+0000 7fd94dbcd640 1 --2- 172.21.15.177:0/3522688389 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd92c066470 0x7fd92c068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd9380ae000 tx=0x7fd938008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:19.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.271+0000 7fd93effd640 1 -- 172.21.15.177:0/3522688389 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd944050820 con 0x7fd94806c9d0 2023-11-28T20:08:19.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.419+0000 7fd950632640 1 -- 172.21.15.177:0/3522688389 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd94806d170 con 0x7fd94806c9d0 2023-11-28T20:08:19.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.423+0000 7fd93effd640 1 -- 172.21.15.177:0/3522688389 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7fd944053e40 con 0x7fd94806c9d0 2023-11-28T20:08:19.426 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:19.427 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:19.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.423+0000 7fd950632640 1 -- 172.21.15.177:0/3522688389 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd92c066470 msgr2=0x7fd92c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:19.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.423+0000 7fd950632640 1 --2- 172.21.15.177:0/3522688389 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd92c066470 0x7fd92c068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd9380ae000 tx=0x7fd938008040 comp rx=0 tx=0).stop 2023-11-28T20:08:19.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.423+0000 7fd950632640 1 -- 172.21.15.177:0/3522688389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94806c9d0 msgr2=0x7fd9480c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:19.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.423+0000 7fd950632640 1 --2- 172.21.15.177:0/3522688389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94806c9d0 0x7fd9480c4ab0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd94400c3c0 tx=0x7fd94400c880 comp rx=0 tx=0).stop 2023-11-28T20:08:19.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.423+0000 7fd950632640 1 -- 172.21.15.177:0/3522688389 shutdown_connections 2023-11-28T20:08:19.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.423+0000 7fd950632640 1 --2- 172.21.15.177:0/3522688389 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd92c066470 0x7fd92c068930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.423+0000 7fd950632640 1 --2- 172.21.15.177:0/3522688389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd948144840 0x7fd94812df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.423+0000 7fd950632640 1 --2- 172.21.15.177:0/3522688389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd948072180 0x7fd9480b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.423+0000 7fd950632640 1 --2- 172.21.15.177:0/3522688389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94806c9d0 0x7fd9480c4ab0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.423+0000 7fd950632640 1 -- 172.21.15.177:0/3522688389 >> 172.21.15.177:0/3522688389 conn(0x7fd94806a530 msgr2=0x7fd94806c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:19.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.423+0000 7fd950632640 1 -- 172.21.15.177:0/3522688389 shutdown_connections 2023-11-28T20:08:19.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.423+0000 7fd950632640 1 -- 172.21.15.177:0/3522688389 wait complete. 2023-11-28T20:08:19.449 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:19.450 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:19.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f85772640 1 Processor -- start 2023-11-28T20:08:19.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f85772640 1 -- start start 2023-11-28T20:08:19.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f85772640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3f80158ca0 0x7f3f8015eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f85772640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f800cba10 0x7f3f8015be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f85772640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8015b670 con 0x7f3f800b42d0 2023-11-28T20:08:19.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f85772640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f8015f410 con 0x7f3f80158ca0 2023-11-28T20:08:19.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f85772640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8015f6f0 con 0x7f3f800cba10 2023-11-28T20:08:19.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f7effd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3f80158ca0 0x7f3f8015eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f7e7fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f800cba10 0x7f3f8015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f7f7fe640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f3f800b42d0 0x7f3f800703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:33140/0 (socket says 172.21.15.177:33140) 2023-11-28T20:08:19.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f7f7fe640 1 -- 172.21.15.177:0/3478274077 learned_addr learned my addr 172.21.15.177:0/3478274077 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:19.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f7effd640 1 -- 172.21.15.177:0/3478274077 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f800cba10 msgr2=0x7f3f8015be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:19.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f7effd640 1 --2- 172.21.15.177:0/3478274077 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f800cba10 0x7f3f8015be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f7effd640 1 -- 172.21.15.177:0/3478274077 >> v1:172.21.15.195:6789/0 conn(0x7f3f800b42d0 legacy=0x7f3f800703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:19.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f7effd640 1 -- 172.21.15.177:0/3478274077 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8015b8e0 con 0x7f3f80158ca0 2023-11-28T20:08:19.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.587+0000 7f3f7dffb640 1 -- 172.21.15.177:0/3478274077 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941453100 0 0) 0x7f3f8015b670 con 0x7f3f800b42d0 2023-11-28T20:08:19.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.591+0000 7f3f7effd640 1 --2- 172.21.15.177:0/3478274077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f80158ca0 0x7f3f8015eb50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3f70009d90 tx=0x7f3f7001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db26584378437f4b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:19.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.591+0000 7f3f7dffb640 1 -- 172.21.15.177:0/3478274077 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f700a5a30 con 0x7f3f80158ca0 2023-11-28T20:08:19.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.591+0000 7f3f7dffb640 1 -- 172.21.15.177:0/3478274077 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f700a5b90 con 0x7f3f80158ca0 2023-11-28T20:08:19.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.591+0000 7f3f7dffb640 1 -- 172.21.15.177:0/3478274077 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f700ad440 con 0x7f3f80158ca0 2023-11-28T20:08:19.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.591+0000 7f3f85772640 1 -- 172.21.15.177:0/3478274077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f80158ca0 msgr2=0x7f3f8015eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:19.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.591+0000 7f3f85772640 1 --2- 172.21.15.177:0/3478274077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f80158ca0 0x7f3f8015eb50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3f70009d90 tx=0x7f3f7001c950 comp rx=0 tx=0).stop 2023-11-28T20:08:19.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.591+0000 7f3f85772640 1 -- 172.21.15.177:0/3478274077 shutdown_connections 2023-11-28T20:08:19.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.591+0000 7f3f85772640 1 --2- 172.21.15.177:0/3478274077 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f800cba10 0x7f3f8015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.591+0000 7f3f85772640 1 --2- 172.21.15.177:0/3478274077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f80158ca0 0x7f3f8015eb50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.591+0000 7f3f85772640 1 -- 172.21.15.177:0/3478274077 >> 172.21.15.177:0/3478274077 conn(0x7f3f800b0cc0 msgr2=0x7f3f800b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:19.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.591+0000 7f3f85772640 1 -- 172.21.15.177:0/3478274077 shutdown_connections 2023-11-28T20:08:19.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.591+0000 7f3f85772640 1 -- 172.21.15.177:0/3478274077 wait complete. 2023-11-28T20:08:19.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f85772640 1 Processor -- start 2023-11-28T20:08:19.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f85772640 1 -- start start 2023-11-28T20:08:19.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f85772640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f800b42d0 0x7f3f80145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f85772640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f800cba10 0x7f3f801451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f85772640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f80158ca0 0x7f3f800b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f85772640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f801456f0 con 0x7f3f80158ca0 2023-11-28T20:08:19.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f85772640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f80158070 con 0x7f3f800b42d0 2023-11-28T20:08:19.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f85772640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f80158500 con 0x7f3f800cba10 2023-11-28T20:08:19.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f7f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f80158ca0 0x7f3f800b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f7f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f80158ca0 0x7f3f800b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53060/0 (socket says 172.21.15.177:53060) 2023-11-28T20:08:19.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f7f7fe640 1 -- 172.21.15.177:0/3461304536 learned_addr learned my addr 172.21.15.177:0/3461304536 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:19.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f7e7fc640 1 --2- 172.21.15.177:0/3461304536 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f800cba10 0x7f3f801451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f7effd640 1 --2- 172.21.15.177:0/3461304536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f800b42d0 0x7f3f80145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f7f7fe640 1 -- 172.21.15.177:0/3461304536 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f800cba10 msgr2=0x7f3f801451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:19.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f7f7fe640 1 --2- 172.21.15.177:0/3461304536 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f800cba10 0x7f3f801451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f7f7fe640 1 -- 172.21.15.177:0/3461304536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f800b42d0 msgr2=0x7f3f80145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:19.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f7f7fe640 1 --2- 172.21.15.177:0/3461304536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f800b42d0 0x7f3f80145880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f7f7fe640 1 -- 172.21.15.177:0/3461304536 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f70009a70 con 0x7f3f80158ca0 2023-11-28T20:08:19.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f7f7fe640 1 --2- 172.21.15.177:0/3461304536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f80158ca0 0x7f3f800b3900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800c470 tx=0x7f3f7800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:19.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f677fe640 1 -- 172.21.15.177:0/3461304536 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f780074e0 con 0x7f3f80158ca0 2023-11-28T20:08:19.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f677fe640 1 -- 172.21.15.177:0/3461304536 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f78007640 con 0x7f3f80158ca0 2023-11-28T20:08:19.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f85772640 1 -- 172.21.15.177:0/3461304536 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f80157740 con 0x7f3f80158ca0 2023-11-28T20:08:19.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f677fe640 1 -- 172.21.15.177:0/3461304536 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f78004a30 con 0x7f3f80158ca0 2023-11-28T20:08:19.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.595+0000 7f3f85772640 1 -- 172.21.15.177:0/3461304536 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f80157d00 con 0x7f3f80158ca0 2023-11-28T20:08:19.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.599+0000 7f3f85772640 1 -- 172.21.15.177:0/3461304536 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f80158220 con 0x7f3f80158ca0 2023-11-28T20:08:19.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.599+0000 7f3f677fe640 1 -- 172.21.15.177:0/3461304536 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3f78004b90 con 0x7f3f80158ca0 2023-11-28T20:08:19.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.599+0000 7f3f677fe640 1 --2- 172.21.15.177:0/3461304536 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3f6c0664a0 0x7f3f6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.599+0000 7f3f677fe640 1 -- 172.21.15.177:0/3461304536 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f78082f50 con 0x7f3f80158ca0 2023-11-28T20:08:19.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.599+0000 7f3f7effd640 1 --2- 172.21.15.177:0/3461304536 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3f6c0664a0 0x7f3f6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.599+0000 7f3f7effd640 1 --2- 172.21.15.177:0/3461304536 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3f6c0664a0 0x7f3f6c068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3f700af000 tx=0x7f3f700a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:19.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.603+0000 7f3f677fe640 1 -- 172.21.15.177:0/3461304536 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3f80158220 con 0x7f3f80158ca0 2023-11-28T20:08:19.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.751+0000 7f3f85772640 1 -- 172.21.15.177:0/3461304536 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f800cdf00 con 0x7f3f80158ca0 2023-11-28T20:08:19.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.755+0000 7f3f677fe640 1 -- 172.21.15.177:0/3461304536 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f78018020 con 0x7f3f80158ca0 2023-11-28T20:08:19.759 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:19.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.755+0000 7f3f85772640 1 -- 172.21.15.177:0/3461304536 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3f6c0664a0 msgr2=0x7f3f6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:19.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.755+0000 7f3f85772640 1 --2- 172.21.15.177:0/3461304536 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3f6c0664a0 0x7f3f6c068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3f700af000 tx=0x7f3f700a7070 comp rx=0 tx=0).stop 2023-11-28T20:08:19.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.755+0000 7f3f85772640 1 -- 172.21.15.177:0/3461304536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f80158ca0 msgr2=0x7f3f800b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:19.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.755+0000 7f3f85772640 1 --2- 172.21.15.177:0/3461304536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f80158ca0 0x7f3f800b3900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800c470 tx=0x7f3f7800c930 comp rx=0 tx=0).stop 2023-11-28T20:08:19.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.755+0000 7f3f85772640 1 -- 172.21.15.177:0/3461304536 shutdown_connections 2023-11-28T20:08:19.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.755+0000 7f3f85772640 1 --2- 172.21.15.177:0/3461304536 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3f6c0664a0 0x7f3f6c068960 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.755+0000 7f3f85772640 1 --2- 172.21.15.177:0/3461304536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f80158ca0 0x7f3f800b3900 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.755+0000 7f3f85772640 1 --2- 172.21.15.177:0/3461304536 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f800cba10 0x7f3f801451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.755+0000 7f3f85772640 1 --2- 172.21.15.177:0/3461304536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f800b42d0 0x7f3f80145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.755+0000 7f3f85772640 1 -- 172.21.15.177:0/3461304536 >> 172.21.15.177:0/3461304536 conn(0x7f3f800b0cc0 msgr2=0x7f3f8015d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:19.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.755+0000 7f3f85772640 1 -- 172.21.15.177:0/3461304536 shutdown_connections 2023-11-28T20:08:19.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.755+0000 7f3f85772640 1 -- 172.21.15.177:0/3461304536 wait complete. 2023-11-28T20:08:19.780 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:19.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff673bf5640 1 Processor -- start 2023-11-28T20:08:19.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff673bf5640 1 -- start start 2023-11-28T20:08:19.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff673bf5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff66c071d90 0x7ff66c072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff673bf5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff66c15adb0 0x7ff66c13d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff673bf5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c13f5f0 0x7ff66c0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff673bf5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c140520 con 0x7ff66c15adb0 2023-11-28T20:08:19.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff673bf5640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c0cd7f0 con 0x7ff66c071d90 2023-11-28T20:08:19.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff673bf5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c13d2b0 con 0x7ff66c13f5f0 2023-11-28T20:08:19.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff671190640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff66c15adb0 0x7ff66c13d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff671190640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff66c15adb0 0x7ff66c13d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53074/0 (socket says 172.21.15.177:53074) 2023-11-28T20:08:19.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff671190640 1 -- 172.21.15.177:0/1065279129 learned_addr learned my addr 172.21.15.177:0/1065279129 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:19.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff671190640 1 -- 172.21.15.177:0/1065279129 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c13f5f0 msgr2=0x7ff66c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:19.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff672192640 1 --2- 172.21.15.177:0/1065279129 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c13f5f0 0x7ff66c0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff671991640 1 --2- 172.21.15.177:0/1065279129 >> v2:172.21.15.195:3300/0 conn(0x7ff66c071d90 0x7ff66c072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff671190640 1 --2- 172.21.15.177:0/1065279129 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c13f5f0 0x7ff66c0ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff671190640 1 -- 172.21.15.177:0/1065279129 >> v2:172.21.15.195:3300/0 conn(0x7ff66c071d90 msgr2=0x7ff66c072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:19.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff671190640 1 --2- 172.21.15.177:0/1065279129 >> v2:172.21.15.195:3300/0 conn(0x7ff66c071d90 0x7ff66c072170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff671190640 1 -- 172.21.15.177:0/1065279129 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c0cdd70 con 0x7ff66c15adb0 2023-11-28T20:08:19.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff672192640 1 --2- 172.21.15.177:0/1065279129 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c13f5f0 0x7ff66c0ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:19.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.915+0000 7ff671991640 1 --2- 172.21.15.177:0/1065279129 >> v2:172.21.15.195:3300/0 conn(0x7ff66c071d90 0x7ff66c072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:19.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.919+0000 7ff671190640 1 --2- 172.21.15.177:0/1065279129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff66c15adb0 0x7ff66c13d560 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0b1d80 tx=0x7ff65c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39d2c26d90a844c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:19.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.919+0000 7ff67098f640 1 -- 172.21.15.177:0/1065279129 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c0aa620 con 0x7ff66c15adb0 2023-11-28T20:08:19.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.919+0000 7ff67098f640 1 -- 172.21.15.177:0/1065279129 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c0aa780 con 0x7ff66c15adb0 2023-11-28T20:08:19.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.919+0000 7ff67098f640 1 -- 172.21.15.177:0/1065279129 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c0aab10 con 0x7ff66c15adb0 2023-11-28T20:08:19.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.919+0000 7ff673bf5640 1 -- 172.21.15.177:0/1065279129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff66c15adb0 msgr2=0x7ff66c13d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:19.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.919+0000 7ff673bf5640 1 --2- 172.21.15.177:0/1065279129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff66c15adb0 0x7ff66c13d560 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0b1d80 tx=0x7ff65c01c500 comp rx=0 tx=0).stop 2023-11-28T20:08:19.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.919+0000 7ff673bf5640 1 -- 172.21.15.177:0/1065279129 shutdown_connections 2023-11-28T20:08:19.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.919+0000 7ff673bf5640 1 --2- 172.21.15.177:0/1065279129 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c13f5f0 0x7ff66c0ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.919+0000 7ff673bf5640 1 --2- 172.21.15.177:0/1065279129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff66c15adb0 0x7ff66c13d560 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.919+0000 7ff673bf5640 1 --2- 172.21.15.177:0/1065279129 >> v2:172.21.15.195:3300/0 conn(0x7ff66c071d90 0x7ff66c072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.919+0000 7ff673bf5640 1 -- 172.21.15.177:0/1065279129 >> 172.21.15.177:0/1065279129 conn(0x7ff66c0b0cc0 msgr2=0x7ff66c0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:19.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.919+0000 7ff673bf5640 1 -- 172.21.15.177:0/1065279129 shutdown_connections 2023-11-28T20:08:19.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.919+0000 7ff673bf5640 1 -- 172.21.15.177:0/1065279129 wait complete. 2023-11-28T20:08:19.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff673bf5640 1 Processor -- start 2023-11-28T20:08:19.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff673bf5640 1 -- start start 2023-11-28T20:08:19.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff673bf5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c071d90 0x7ff66c0b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff673bf5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff66c13f5f0 0x7ff66c13a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff673bf5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c15adb0 0x7ff66c1f4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff673bf5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c13c8c0 con 0x7ff66c13f5f0 2023-11-28T20:08:19.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff673bf5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c13cba0 con 0x7ff66c15adb0 2023-11-28T20:08:19.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff673bf5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c153050 con 0x7ff66c071d90 2023-11-28T20:08:19.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff671190640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff66c13f5f0 0x7ff66c13a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff671190640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff66c13f5f0 0x7ff66c13a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53078/0 (socket says 172.21.15.177:53078) 2023-11-28T20:08:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff671190640 1 -- 172.21.15.177:0/4213486252 learned_addr learned my addr 172.21.15.177:0/4213486252 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff671991640 1 --2- 172.21.15.177:0/4213486252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c071d90 0x7ff66c0b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff672192640 1 --2- 172.21.15.177:0/4213486252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c15adb0 0x7ff66c1f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff671190640 1 -- 172.21.15.177:0/4213486252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c071d90 msgr2=0x7ff66c0b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff671190640 1 --2- 172.21.15.177:0/4213486252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c071d90 0x7ff66c0b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff671190640 1 -- 172.21.15.177:0/4213486252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c15adb0 msgr2=0x7ff66c1f4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff671190640 1 --2- 172.21.15.177:0/4213486252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c15adb0 0x7ff66c1f4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff671190640 1 -- 172.21.15.177:0/4213486252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c0094d0 con 0x7ff66c13f5f0 2023-11-28T20:08:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff672192640 1 --2- 172.21.15.177:0/4213486252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c15adb0 0x7ff66c1f4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff671190640 1 --2- 172.21.15.177:0/4213486252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff66c13f5f0 0x7ff66c13a140 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff65c01abb0 tx=0x7ff65c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff6627fc640 1 -- 172.21.15.177:0/4213486252 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c0bd5f0 con 0x7ff66c13f5f0 2023-11-28T20:08:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff6627fc640 1 -- 172.21.15.177:0/4213486252 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c0bd770 con 0x7ff66c13f5f0 2023-11-28T20:08:19.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.923+0000 7ff6627fc640 1 -- 172.21.15.177:0/4213486252 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c0bdb20 con 0x7ff66c13f5f0 2023-11-28T20:08:19.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.927+0000 7ff673bf5640 1 -- 172.21.15.177:0/4213486252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c153330 con 0x7ff66c13f5f0 2023-11-28T20:08:19.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.927+0000 7ff673bf5640 1 -- 172.21.15.177:0/4213486252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c13aa30 con 0x7ff66c13f5f0 2023-11-28T20:08:19.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.927+0000 7ff673bf5640 1 -- 172.21.15.177:0/4213486252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c0693d0 con 0x7ff66c13f5f0 2023-11-28T20:08:19.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.927+0000 7ff6627fc640 1 -- 172.21.15.177:0/4213486252 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff65c0b3600 con 0x7ff66c13f5f0 2023-11-28T20:08:19.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.927+0000 7ff6627fc640 1 --2- 172.21.15.177:0/4213486252 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff650066470 0x7ff650068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:19.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.927+0000 7ff6627fc640 1 -- 172.21.15.177:0/4213486252 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff65c11ed60 con 0x7ff66c13f5f0 2023-11-28T20:08:19.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.927+0000 7ff671991640 1 --2- 172.21.15.177:0/4213486252 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff650066470 0x7ff650068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:19.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.931+0000 7ff671991640 1 --2- 172.21.15.177:0/4213486252 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff650066470 0x7ff650068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff66800ab60 tx=0x7ff668008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:19.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:19.931+0000 7ff6627fc640 1 -- 172.21.15.177:0/4213486252 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff65c0ec1f0 con 0x7ff66c13f5f0 2023-11-28T20:08:20.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.087+0000 7ff673bf5640 1 -- 172.21.15.177:0/4213486252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff66c06e710 con 0x7ff66c13f5f0 2023-11-28T20:08:20.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.087+0000 7ff6627fc640 1 -- 172.21.15.177:0/4213486252 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff65c0ef810 con 0x7ff66c13f5f0 2023-11-28T20:08:20.091 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:20.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.087+0000 7ff673bf5640 1 -- 172.21.15.177:0/4213486252 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff650066470 msgr2=0x7ff650068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.087+0000 7ff673bf5640 1 --2- 172.21.15.177:0/4213486252 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff650066470 0x7ff650068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff66800ab60 tx=0x7ff668008040 comp rx=0 tx=0).stop 2023-11-28T20:08:20.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.087+0000 7ff673bf5640 1 -- 172.21.15.177:0/4213486252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff66c13f5f0 msgr2=0x7ff66c13a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.087+0000 7ff673bf5640 1 --2- 172.21.15.177:0/4213486252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff66c13f5f0 0x7ff66c13a140 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff65c01abb0 tx=0x7ff65c01ad40 comp rx=0 tx=0).stop 2023-11-28T20:08:20.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.087+0000 7ff673bf5640 1 -- 172.21.15.177:0/4213486252 shutdown_connections 2023-11-28T20:08:20.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.087+0000 7ff673bf5640 1 --2- 172.21.15.177:0/4213486252 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff650066470 0x7ff650068930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.087+0000 7ff673bf5640 1 --2- 172.21.15.177:0/4213486252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c15adb0 0x7ff66c1f4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.087+0000 7ff673bf5640 1 --2- 172.21.15.177:0/4213486252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff66c13f5f0 0x7ff66c13a140 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.087+0000 7ff673bf5640 1 --2- 172.21.15.177:0/4213486252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c071d90 0x7ff66c0b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.087+0000 7ff673bf5640 1 -- 172.21.15.177:0/4213486252 >> 172.21.15.177:0/4213486252 conn(0x7ff66c0b0cc0 msgr2=0x7ff66c15cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:20.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.087+0000 7ff673bf5640 1 -- 172.21.15.177:0/4213486252 shutdown_connections 2023-11-28T20:08:20.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.087+0000 7ff673bf5640 1 -- 172.21.15.177:0/4213486252 wait complete. 2023-11-28T20:08:20.112 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:20.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.247+0000 7f37b659d640 1 Processor -- start 2023-11-28T20:08:20.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.247+0000 7f37b659d640 1 -- start start 2023-11-28T20:08:20.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.247+0000 7f37b659d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f37b0158ca0 0x7f37b015eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.247+0000 7f37b659d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37b00cba10 0x7f37b015be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.247+0000 7f37b659d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f37b00b42d0 0x7f37b00b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.247+0000 7f37b659d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b00b4c40 con 0x7f37b00b42d0 2023-11-28T20:08:20.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.247+0000 7f37b659d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b015b670 con 0x7f37b0158ca0 2023-11-28T20:08:20.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.247+0000 7f37b659d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b015f410 con 0x7f37b00cba10 2023-11-28T20:08:20.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.247+0000 7f37b4b3a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f37b00b42d0 0x7f37b00b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.247+0000 7f37b4b3a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f37b00b42d0 0x7f37b00b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53088/0 (socket says 172.21.15.177:53088) 2023-11-28T20:08:20.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.251+0000 7f37b4b3a640 1 -- 172.21.15.177:0/2972345888 learned_addr learned my addr 172.21.15.177:0/2972345888 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:20.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.251+0000 7f37affff640 1 --2- 172.21.15.177:0/2972345888 >> v2:172.21.15.195:3300/0 conn(0x7f37b0158ca0 0x7f37b015eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.251+0000 7f37af7fe640 1 --2- 172.21.15.177:0/2972345888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37b00cba10 0x7f37b015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.251+0000 7f37b4b3a640 1 -- 172.21.15.177:0/2972345888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37b00cba10 msgr2=0x7f37b015be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:20.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.251+0000 7f37b4b3a640 1 --2- 172.21.15.177:0/2972345888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37b00cba10 0x7f37b015be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.251+0000 7f37b4b3a640 1 -- 172.21.15.177:0/2972345888 >> v2:172.21.15.195:3300/0 conn(0x7f37b0158ca0 msgr2=0x7f37b015eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:20.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.251+0000 7f37b4b3a640 1 --2- 172.21.15.177:0/2972345888 >> v2:172.21.15.195:3300/0 conn(0x7f37b0158ca0 0x7f37b015eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.251+0000 7f37b4b3a640 1 -- 172.21.15.177:0/2972345888 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b015f6f0 con 0x7f37b00b42d0 2023-11-28T20:08:20.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.251+0000 7f37affff640 1 --2- 172.21.15.177:0/2972345888 >> v2:172.21.15.195:3300/0 conn(0x7f37b0158ca0 0x7f37b015eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:20.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.251+0000 7f37af7fe640 1 --2- 172.21.15.177:0/2972345888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37b00cba10 0x7f37b015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:20.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.251+0000 7f37b4b3a640 1 --2- 172.21.15.177:0/2972345888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b00b42d0 0x7f37b00b4700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f37b0067f70 tx=0x7f37a801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680db94799c8d825 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:20.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.251+0000 7f37aeffd640 1 -- 172.21.15.177:0/2972345888 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a80a5840 con 0x7f37b00b42d0 2023-11-28T20:08:20.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.251+0000 7f37aeffd640 1 -- 172.21.15.177:0/2972345888 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a80a59a0 con 0x7f37b00b42d0 2023-11-28T20:08:20.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.251+0000 7f37aeffd640 1 -- 172.21.15.177:0/2972345888 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a80a5d30 con 0x7f37b00b42d0 2023-11-28T20:08:20.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 -- 172.21.15.177:0/2972345888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b00b42d0 msgr2=0x7f37b00b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 --2- 172.21.15.177:0/2972345888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b00b42d0 0x7f37b00b4700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f37b0067f70 tx=0x7f37a801c9a0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 -- 172.21.15.177:0/2972345888 shutdown_connections 2023-11-28T20:08:20.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 --2- 172.21.15.177:0/2972345888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b00b42d0 0x7f37b00b4700 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 --2- 172.21.15.177:0/2972345888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37b00cba10 0x7f37b015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 --2- 172.21.15.177:0/2972345888 >> v2:172.21.15.195:3300/0 conn(0x7f37b0158ca0 0x7f37b015eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 -- 172.21.15.177:0/2972345888 >> 172.21.15.177:0/2972345888 conn(0x7f37b00b0cc0 msgr2=0x7f37b00b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:20.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 -- 172.21.15.177:0/2972345888 shutdown_connections 2023-11-28T20:08:20.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 -- 172.21.15.177:0/2972345888 wait complete. 2023-11-28T20:08:20.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 Processor -- start 2023-11-28T20:08:20.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 -- start start 2023-11-28T20:08:20.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37b00b42d0 0x7f37b015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b00cba10 0x7f37b01524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37b0158ca0 0x7f37b0152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b015ea90 con 0x7f37b00cba10 2023-11-28T20:08:20.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b015e600 con 0x7f37b0158ca0 2023-11-28T20:08:20.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b659d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b013e120 con 0x7f37b00b42d0 2023-11-28T20:08:20.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37af7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b00cba10 0x7f37b01524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37af7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b00cba10 0x7f37b01524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53100/0 (socket says 172.21.15.177:53100) 2023-11-28T20:08:20.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37af7fe640 1 -- 172.21.15.177:0/237310224 learned_addr learned my addr 172.21.15.177:0/237310224 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:20.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37affff640 1 --2- 172.21.15.177:0/237310224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37b00b42d0 0x7f37b015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37b4b3a640 1 --2- 172.21.15.177:0/237310224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37b0158ca0 0x7f37b0152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.255+0000 7f37af7fe640 1 -- 172.21.15.177:0/237310224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37b00b42d0 msgr2=0x7f37b015cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.259+0000 7f37af7fe640 1 --2- 172.21.15.177:0/237310224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37b00b42d0 0x7f37b015cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.259+0000 7f37af7fe640 1 -- 172.21.15.177:0/237310224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37b0158ca0 msgr2=0x7f37b0152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.259+0000 7f37af7fe640 1 --2- 172.21.15.177:0/237310224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37b0158ca0 0x7f37b0152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.259+0000 7f37af7fe640 1 -- 172.21.15.177:0/237310224 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a8009b30 con 0x7f37b00cba10 2023-11-28T20:08:20.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.259+0000 7f37af7fe640 1 --2- 172.21.15.177:0/237310224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b00cba10 0x7f37b01524f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f37a400e810 tx=0x7f37a400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:20.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.259+0000 7f37acff9640 1 -- 172.21.15.177:0/237310224 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a400c8d0 con 0x7f37b00cba10 2023-11-28T20:08:20.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.259+0000 7f37acff9640 1 -- 172.21.15.177:0/237310224 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a400ca30 con 0x7f37b00cba10 2023-11-28T20:08:20.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.259+0000 7f37acff9640 1 -- 172.21.15.177:0/237310224 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a400cdc0 con 0x7f37b00cba10 2023-11-28T20:08:20.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.259+0000 7f37b659d640 1 -- 172.21.15.177:0/237310224 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b015d9f0 con 0x7f37b00cba10 2023-11-28T20:08:20.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.259+0000 7f37b659d640 1 -- 172.21.15.177:0/237310224 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b015dfb0 con 0x7f37b00cba10 2023-11-28T20:08:20.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.259+0000 7f37b659d640 1 -- 172.21.15.177:0/237310224 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b00693d0 con 0x7f37b00cba10 2023-11-28T20:08:20.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.259+0000 7f37acff9640 1 -- 172.21.15.177:0/237310224 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f37a4013410 con 0x7f37b00cba10 2023-11-28T20:08:20.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.259+0000 7f37acff9640 1 --2- 172.21.15.177:0/237310224 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f379c0664a0 0x7f379c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.259+0000 7f37acff9640 1 -- 172.21.15.177:0/237310224 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37a4083ac0 con 0x7f37b00cba10 2023-11-28T20:08:20.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.259+0000 7f37affff640 1 --2- 172.21.15.177:0/237310224 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f379c0664a0 0x7f379c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.263+0000 7f37affff640 1 --2- 172.21.15.177:0/237310224 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f379c0664a0 0x7f379c068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f37a0006e90 tx=0x7f37a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:20.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.263+0000 7f37acff9640 1 -- 172.21.15.177:0/237310224 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37a4051080 con 0x7f37b00cba10 2023-11-28T20:08:20.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.415+0000 7f37b659d640 1 -- 172.21.15.177:0/237310224 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37b00b1990 con 0x7f37b00cba10 2023-11-28T20:08:20.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.415+0000 7f37acff9640 1 -- 172.21.15.177:0/237310224 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f37a40546a0 con 0x7f37b00cba10 2023-11-28T20:08:20.419 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:20.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.415+0000 7f37b659d640 1 -- 172.21.15.177:0/237310224 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f379c0664a0 msgr2=0x7f379c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.415+0000 7f37b659d640 1 --2- 172.21.15.177:0/237310224 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f379c0664a0 0x7f379c068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f37a0006e90 tx=0x7f37a0008040 comp rx=0 tx=0).stop 2023-11-28T20:08:20.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.415+0000 7f37b659d640 1 -- 172.21.15.177:0/237310224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b00cba10 msgr2=0x7f37b01524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.415+0000 7f37b659d640 1 --2- 172.21.15.177:0/237310224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b00cba10 0x7f37b01524f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f37a400e810 tx=0x7f37a400ecd0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.415+0000 7f37b659d640 1 -- 172.21.15.177:0/237310224 shutdown_connections 2023-11-28T20:08:20.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.415+0000 7f37b659d640 1 --2- 172.21.15.177:0/237310224 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f379c0664a0 0x7f379c068960 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.415+0000 7f37b659d640 1 --2- 172.21.15.177:0/237310224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37b0158ca0 0x7f37b0152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.415+0000 7f37b659d640 1 --2- 172.21.15.177:0/237310224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b00cba10 0x7f37b01524f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.415+0000 7f37b659d640 1 --2- 172.21.15.177:0/237310224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37b00b42d0 0x7f37b015cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.415+0000 7f37b659d640 1 -- 172.21.15.177:0/237310224 >> 172.21.15.177:0/237310224 conn(0x7f37b00b0cc0 msgr2=0x7f37b015a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:20.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.415+0000 7f37b659d640 1 -- 172.21.15.177:0/237310224 shutdown_connections 2023-11-28T20:08:20.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.415+0000 7f37b659d640 1 -- 172.21.15.177:0/237310224 wait complete. 2023-11-28T20:08:20.441 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:08:20.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.575+0000 7f8a162d6640 1 Processor -- start 2023-11-28T20:08:20.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.575+0000 7f8a162d6640 1 -- start start 2023-11-28T20:08:20.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.575+0000 7f8a162d6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8a1006c9d0 0x7f8a1015a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.575+0000 7f8a162d6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a1015ab70 0x7f8a100cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.575+0000 7f8a162d6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a1015b3a0 con 0x7f8a1013cf30 2023-11-28T20:08:20.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.575+0000 7f8a162d6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1013d310 con 0x7f8a1006c9d0 2023-11-28T20:08:20.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.575+0000 7f8a162d6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a101404e0 con 0x7f8a1015ab70 2023-11-28T20:08:20.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.575+0000 7f8a0f7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8a1006c9d0 0x7f8a1015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.575+0000 7f8a0f7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8a1006c9d0 0x7f8a1015a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53116/0 (socket says 172.21.15.177:53116) 2023-11-28T20:08:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.575+0000 7f8a0f7fe640 1 -- 172.21.15.177:0/970700393 learned_addr learned my addr 172.21.15.177:0/970700393 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.575+0000 7f8a14873640 1 --2- 172.21.15.177:0/970700393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a1015ab70 0x7f8a100cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a0f7fe640 1 -- 172.21.15.177:0/970700393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a1015ab70 msgr2=0x7f8a100cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a0f7fe640 1 --2- 172.21.15.177:0/970700393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a1015ab70 0x7f8a100cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a0f7fe640 1 -- 172.21.15.177:0/970700393 >> v1:172.21.15.195:6789/0 conn(0x7f8a1013cf30 legacy=0x7f8a1006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a0f7fe640 1 -- 172.21.15.177:0/970700393 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1013f720 con 0x7f8a1006c9d0 2023-11-28T20:08:20.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a0f7fe640 1 --2- 172.21.15.177:0/970700393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a1006c9d0 0x7f8a1015a630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8a040098a0 tx=0x7f8a0401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15becc04eb8de067 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:20.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a0effd640 1 -- 172.21.15.177:0/970700393 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a040ab660 con 0x7f8a1006c9d0 2023-11-28T20:08:20.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a0effd640 1 -- 172.21.15.177:0/970700393 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a040ab7c0 con 0x7f8a1006c9d0 2023-11-28T20:08:20.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a0effd640 1 -- 172.21.15.177:0/970700393 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a040abb50 con 0x7f8a1006c9d0 2023-11-28T20:08:20.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a162d6640 1 -- 172.21.15.177:0/970700393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a1006c9d0 msgr2=0x7f8a1015a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a162d6640 1 --2- 172.21.15.177:0/970700393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a1006c9d0 0x7f8a1015a630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8a040098a0 tx=0x7f8a0401c460 comp rx=0 tx=0).stop 2023-11-28T20:08:20.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a162d6640 1 -- 172.21.15.177:0/970700393 shutdown_connections 2023-11-28T20:08:20.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a162d6640 1 --2- 172.21.15.177:0/970700393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a1015ab70 0x7f8a100cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a162d6640 1 --2- 172.21.15.177:0/970700393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a1006c9d0 0x7f8a1015a630 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a162d6640 1 -- 172.21.15.177:0/970700393 >> 172.21.15.177:0/970700393 conn(0x7f8a1006a530 msgr2=0x7f8a1006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:20.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a162d6640 1 -- 172.21.15.177:0/970700393 shutdown_connections 2023-11-28T20:08:20.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.579+0000 7f8a162d6640 1 -- 172.21.15.177:0/970700393 wait complete. 2023-11-28T20:08:20.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a162d6640 1 Processor -- start 2023-11-28T20:08:20.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a162d6640 1 -- start start 2023-11-28T20:08:20.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a162d6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a1006c9d0 0x7f8a1013d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a162d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a1013cf30 0x7f8a10155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a162d6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a1015ab70 0x7f8a10137e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a162d6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1013ed50 con 0x7f8a1013cf30 2023-11-28T20:08:20.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a162d6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1013e140 con 0x7f8a1006c9d0 2023-11-28T20:08:20.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a162d6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1013e420 con 0x7f8a1015ab70 2023-11-28T20:08:20.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a0f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a1013cf30 0x7f8a10155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a0f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a1013cf30 0x7f8a10155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53126/0 (socket says 172.21.15.177:53126) 2023-11-28T20:08:20.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a0f7fe640 1 -- 172.21.15.177:0/874374763 learned_addr learned my addr 172.21.15.177:0/874374763 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:20.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a14873640 1 --2- 172.21.15.177:0/874374763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a1015ab70 0x7f8a10137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a0ffff640 1 --2- 172.21.15.177:0/874374763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a1006c9d0 0x7f8a1013d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a0f7fe640 1 -- 172.21.15.177:0/874374763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a1015ab70 msgr2=0x7f8a10137e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a0f7fe640 1 --2- 172.21.15.177:0/874374763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a1015ab70 0x7f8a10137e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a0f7fe640 1 -- 172.21.15.177:0/874374763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a1006c9d0 msgr2=0x7f8a1013d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a0f7fe640 1 --2- 172.21.15.177:0/874374763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a1006c9d0 0x7f8a1013d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a0f7fe640 1 -- 172.21.15.177:0/874374763 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a040094d0 con 0x7f8a1013cf30 2023-11-28T20:08:20.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.583+0000 7f8a0f7fe640 1 --2- 172.21.15.177:0/874374763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a1013cf30 0x7f8a10155bf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8a040ad040 tx=0x7f8a0401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:20.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.587+0000 7f8a0cff9640 1 -- 172.21.15.177:0/874374763 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a040b4800 con 0x7f8a1013cf30 2023-11-28T20:08:20.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.587+0000 7f8a0cff9640 1 -- 172.21.15.177:0/874374763 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a040b4980 con 0x7f8a1013cf30 2023-11-28T20:08:20.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.587+0000 7f8a0cff9640 1 -- 172.21.15.177:0/874374763 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a040b4d30 con 0x7f8a1013cf30 2023-11-28T20:08:20.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.587+0000 7f8a162d6640 1 -- 172.21.15.177:0/874374763 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1013e700 con 0x7f8a1013cf30 2023-11-28T20:08:20.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.587+0000 7f8a162d6640 1 -- 172.21.15.177:0/874374763 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1013f1e0 con 0x7f8a1013cf30 2023-11-28T20:08:20.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.587+0000 7f8a162d6640 1 -- 172.21.15.177:0/874374763 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a1013eec0 con 0x7f8a1013cf30 2023-11-28T20:08:20.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.587+0000 7f8a0cff9640 1 -- 172.21.15.177:0/874374763 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8a040a9070 con 0x7f8a1013cf30 2023-11-28T20:08:20.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.587+0000 7f8a0cff9640 1 --2- 172.21.15.177:0/874374763 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f89fc066470 0x7f89fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.587+0000 7f8a0cff9640 1 -- 172.21.15.177:0/874374763 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a0411e420 con 0x7f8a1013cf30 2023-11-28T20:08:20.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.587+0000 7f8a0ffff640 1 --2- 172.21.15.177:0/874374763 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f89fc066470 0x7f89fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.587+0000 7f8a0ffff640 1 --2- 172.21.15.177:0/874374763 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f89fc066470 0x7f89fc068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8a00007fd0 tx=0x7f8a00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:20.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.591+0000 7f8a0cff9640 1 -- 172.21.15.177:0/874374763 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a040eb9d0 con 0x7f8a1013cf30 2023-11-28T20:08:20.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.751+0000 7f8a162d6640 1 -- 172.21.15.177:0/874374763 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8a1013e560 con 0x7f8a1013cf30 2023-11-28T20:08:20.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.751+0000 7f8a0cff9640 1 -- 172.21.15.177:0/874374763 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8a1013e560 con 0x7f8a1013cf30 2023-11-28T20:08:20.757 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:08:20.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.755+0000 7f8a162d6640 1 -- 172.21.15.177:0/874374763 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f89fc066470 msgr2=0x7f89fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.755+0000 7f8a162d6640 1 --2- 172.21.15.177:0/874374763 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f89fc066470 0x7f89fc068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8a00007fd0 tx=0x7f8a00009040 comp rx=0 tx=0).stop 2023-11-28T20:08:20.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.755+0000 7f8a162d6640 1 -- 172.21.15.177:0/874374763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a1013cf30 msgr2=0x7f8a10155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.755+0000 7f8a162d6640 1 --2- 172.21.15.177:0/874374763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a1013cf30 0x7f8a10155bf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8a040ad040 tx=0x7f8a0401aca0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.755+0000 7f8a162d6640 1 -- 172.21.15.177:0/874374763 shutdown_connections 2023-11-28T20:08:20.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.755+0000 7f8a162d6640 1 --2- 172.21.15.177:0/874374763 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f89fc066470 0x7f89fc068930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.755+0000 7f8a162d6640 1 --2- 172.21.15.177:0/874374763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a1015ab70 0x7f8a10137e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.755+0000 7f8a162d6640 1 --2- 172.21.15.177:0/874374763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a1013cf30 0x7f8a10155bf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.755+0000 7f8a162d6640 1 --2- 172.21.15.177:0/874374763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a1006c9d0 0x7f8a1013d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.755+0000 7f8a162d6640 1 -- 172.21.15.177:0/874374763 >> 172.21.15.177:0/874374763 conn(0x7f8a1006a530 msgr2=0x7f8a100b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:20.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.755+0000 7f8a162d6640 1 -- 172.21.15.177:0/874374763 shutdown_connections 2023-11-28T20:08:20.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.755+0000 7f8a162d6640 1 -- 172.21.15.177:0/874374763 wait complete. 2023-11-28T20:08:20.778 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:08:20.778 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:08:20.788 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:20.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f6595901640 1 Processor -- start 2023-11-28T20:08:20.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f6595901640 1 -- start start 2023-11-28T20:08:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f6595901640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f659006cdb0 0x7f6590150250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f6595901640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f659015a4b0 0x7f6590150790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f6595901640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6590070460 con 0x7f659006d190 2023-11-28T20:08:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f6595901640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6590150cd0 con 0x7f659015a4b0 2023-11-28T20:08:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f6595901640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659015a890 con 0x7f659006cdb0 2023-11-28T20:08:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f658f7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f659015a4b0 0x7f6590150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f658effd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f659006cdb0 0x7f6590150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f658f7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f659015a4b0 0x7f6590150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53128/0 (socket says 172.21.15.177:53128) 2023-11-28T20:08:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f658f7fe640 1 -- 172.21.15.177:0/1033669921 learned_addr learned my addr 172.21.15.177:0/1033669921 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:20.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f658effd640 1 -- 172.21.15.177:0/1033669921 >> v2:172.21.15.177:3300/0 conn(0x7f659015a4b0 msgr2=0x7f6590150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:20.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f658effd640 1 --2- 172.21.15.177:0/1033669921 >> v2:172.21.15.177:3300/0 conn(0x7f659015a4b0 0x7f6590150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f658effd640 1 -- 172.21.15.177:0/1033669921 >> v1:172.21.15.195:6789/0 conn(0x7f659006d190 legacy=0x7f6590159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f658effd640 1 -- 172.21.15.177:0/1033669921 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659015ab20 con 0x7f659006cdb0 2023-11-28T20:08:20.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.967+0000 7f658f7fe640 1 --2- 172.21.15.177:0/1033669921 >> v2:172.21.15.177:3300/0 conn(0x7f659015a4b0 0x7f6590150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:20.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.971+0000 7f658effd640 1 --2- 172.21.15.177:0/1033669921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f659006cdb0 0x7f6590150250 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6590067390 tx=0x7f658001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6ebba2e406d09e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:20.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.971+0000 7f658e7fc640 1 -- 172.21.15.177:0/1033669921 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800ab600 con 0x7f659006cdb0 2023-11-28T20:08:20.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.971+0000 7f658e7fc640 1 -- 172.21.15.177:0/1033669921 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65800a7050 con 0x7f659006cdb0 2023-11-28T20:08:20.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.971+0000 7f658e7fc640 1 -- 172.21.15.177:0/1033669921 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800ab980 con 0x7f659006cdb0 2023-11-28T20:08:20.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.971+0000 7f6595901640 1 -- 172.21.15.177:0/1033669921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f659006cdb0 msgr2=0x7f6590150250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.971+0000 7f6595901640 1 --2- 172.21.15.177:0/1033669921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f659006cdb0 0x7f6590150250 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6590067390 tx=0x7f658001c460 comp rx=0 tx=0).stop 2023-11-28T20:08:20.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.971+0000 7f6595901640 1 -- 172.21.15.177:0/1033669921 shutdown_connections 2023-11-28T20:08:20.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.971+0000 7f6595901640 1 --2- 172.21.15.177:0/1033669921 >> v2:172.21.15.177:3300/0 conn(0x7f659015a4b0 0x7f6590150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.971+0000 7f6595901640 1 --2- 172.21.15.177:0/1033669921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f659006cdb0 0x7f6590150250 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.971+0000 7f6595901640 1 -- 172.21.15.177:0/1033669921 >> 172.21.15.177:0/1033669921 conn(0x7f659006a530 msgr2=0x7f659006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:20.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.971+0000 7f6595901640 1 -- 172.21.15.177:0/1033669921 shutdown_connections 2023-11-28T20:08:20.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.971+0000 7f6595901640 1 -- 172.21.15.177:0/1033669921 wait complete. 2023-11-28T20:08:20.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6595901640 1 Processor -- start 2023-11-28T20:08:20.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6595901640 1 -- start start 2023-11-28T20:08:20.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6595901640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f659006cdb0 0x7f6590143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6595901640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f659006d190 0x7f6590146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6595901640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f659015a4b0 0x7f65901416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6595901640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65900b3170 con 0x7f659006d190 2023-11-28T20:08:20.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6595901640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6590147150 con 0x7f659015a4b0 2023-11-28T20:08:20.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6595901640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6590146850 con 0x7f659006cdb0 2023-11-28T20:08:20.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6587fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f659006d190 0x7f6590146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6587fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f659006d190 0x7f6590146150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53136/0 (socket says 172.21.15.177:53136) 2023-11-28T20:08:20.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6587fff640 1 -- 172.21.15.177:0/2934406941 learned_addr learned my addr 172.21.15.177:0/2934406941 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:20.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f658effd640 1 --2- 172.21.15.177:0/2934406941 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f659006cdb0 0x7f6590143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f658f7fe640 1 --2- 172.21.15.177:0/2934406941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f659015a4b0 0x7f65901416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6587fff640 1 -- 172.21.15.177:0/2934406941 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f659006cdb0 msgr2=0x7f6590143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6587fff640 1 --2- 172.21.15.177:0/2934406941 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f659006cdb0 0x7f6590143400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6587fff640 1 -- 172.21.15.177:0/2934406941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f659015a4b0 msgr2=0x7f65901416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:20.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6587fff640 1 --2- 172.21.15.177:0/2934406941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f659015a4b0 0x7f65901416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:20.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6587fff640 1 -- 172.21.15.177:0/2934406941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6588009b30 con 0x7f659006d190 2023-11-28T20:08:20.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6587fff640 1 --2- 172.21.15.177:0/2934406941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f659006d190 0x7f6590146150 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f657800c500 tx=0x7f657800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:20.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f658cff9640 1 -- 172.21.15.177:0/2934406941 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578005220 con 0x7f659006d190 2023-11-28T20:08:20.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f658cff9640 1 -- 172.21.15.177:0/2934406941 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6578005380 con 0x7f659006d190 2023-11-28T20:08:20.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f658cff9640 1 -- 172.21.15.177:0/2934406941 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578007270 con 0x7f659006d190 2023-11-28T20:08:20.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6595901640 1 -- 172.21.15.177:0/2934406941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6580009420 con 0x7f659006d190 2023-11-28T20:08:20.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.975+0000 7f6595901640 1 -- 172.21.15.177:0/2934406941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65901473f0 con 0x7f659006d190 2023-11-28T20:08:20.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.979+0000 7f6595901640 1 -- 172.21.15.177:0/2934406941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6590147610 con 0x7f659006d190 2023-11-28T20:08:20.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.979+0000 7f658cff9640 1 -- 172.21.15.177:0/2934406941 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f65780073d0 con 0x7f659006d190 2023-11-28T20:08:20.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.979+0000 7f658cff9640 1 --2- 172.21.15.177:0/2934406941 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6570066470 0x7f6570068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:20.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.979+0000 7f658cff9640 1 -- 172.21.15.177:0/2934406941 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6578083690 con 0x7f659006d190 2023-11-28T20:08:20.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.979+0000 7f658effd640 1 --2- 172.21.15.177:0/2934406941 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6570066470 0x7f6570068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:20.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.979+0000 7f658effd640 1 --2- 172.21.15.177:0/2934406941 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6570066470 0x7f6570068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f65800ad000 tx=0x7f6580008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:20.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:20.983+0000 7f658cff9640 1 -- 172.21.15.177:0/2934406941 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6578050b30 con 0x7f659006d190 2023-11-28T20:08:21.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.139+0000 7f6595901640 1 -- 172.21.15.177:0/2934406941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6590069440 con 0x7f659006d190 2023-11-28T20:08:21.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.139+0000 7f658cff9640 1 -- 172.21.15.177:0/2934406941 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f6578054150 con 0x7f659006d190 2023-11-28T20:08:21.146 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:21.146 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:07:43.099013+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:21.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.143+0000 7f6595901640 1 -- 172.21.15.177:0/2934406941 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6570066470 msgr2=0x7f6570068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.143+0000 7f6595901640 1 --2- 172.21.15.177:0/2934406941 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6570066470 0x7f6570068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f65800ad000 tx=0x7f6580008040 comp rx=0 tx=0).stop 2023-11-28T20:08:21.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.143+0000 7f6595901640 1 -- 172.21.15.177:0/2934406941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f659006d190 msgr2=0x7f6590146150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.143+0000 7f6595901640 1 --2- 172.21.15.177:0/2934406941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f659006d190 0x7f6590146150 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f657800c500 tx=0x7f657800c9c0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.143+0000 7f6595901640 1 -- 172.21.15.177:0/2934406941 shutdown_connections 2023-11-28T20:08:21.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.143+0000 7f6595901640 1 --2- 172.21.15.177:0/2934406941 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6570066470 0x7f6570068930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.143+0000 7f6595901640 1 --2- 172.21.15.177:0/2934406941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f659015a4b0 0x7f65901416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.143+0000 7f6595901640 1 --2- 172.21.15.177:0/2934406941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f659006d190 0x7f6590146150 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.143+0000 7f6595901640 1 --2- 172.21.15.177:0/2934406941 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f659006cdb0 0x7f6590143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.143+0000 7f6595901640 1 -- 172.21.15.177:0/2934406941 >> 172.21.15.177:0/2934406941 conn(0x7f659006a530 msgr2=0x7f65900aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:21.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.143+0000 7f6595901640 1 -- 172.21.15.177:0/2934406941 shutdown_connections 2023-11-28T20:08:21.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.143+0000 7f6595901640 1 -- 172.21.15.177:0/2934406941 wait complete. 2023-11-28T20:08:21.167 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:21.167 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:21.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.303+0000 7fc1d6de4640 1 Processor -- start 2023-11-28T20:08:21.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.303+0000 7fc1d6de4640 1 -- start start 2023-11-28T20:08:21.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d6de4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d006d980 0x7fc1d00b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d6de4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d00705d0 con 0x7fc1d0071670 2023-11-28T20:08:21.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d6de4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d00708b0 con 0x7fc1d00b2b80 2023-11-28T20:08:21.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d6de4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0070b90 con 0x7fc1d006d980 2023-11-28T20:08:21.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d65e3640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc1d0071670 0x7fc1d00ac780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45198/0 (socket says 172.21.15.177:45198) 2023-11-28T20:08:21.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d65e3640 1 -- 172.21.15.177:0/3358784163 learned_addr learned my addr 172.21.15.177:0/3358784163 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:21.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d55e1640 1 --2- 172.21.15.177:0/3358784163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d006d980 0x7fc1d00b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607660497 0 0) 0x7fc1d00705d0 con 0x7fc1d0071670 2023-11-28T20:08:21.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1bc003530 con 0x7fc1d0071670 2023-11-28T20:08:21.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996387211 0 0) 0x7fc1d00708b0 con 0x7fc1d00b2b80 2023-11-28T20:08:21.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d00705d0 con 0x7fc1d00b2b80 2023-11-28T20:08:21.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 335425972 0 0) 0x7fc1bc003530 con 0x7fc1d0071670 2023-11-28T20:08:21.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d006d980 msgr2=0x7fc1d00b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:21.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 --2- 172.21.15.177:0/3358784163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d006d980 0x7fc1d00b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 >> v1:172.21.15.195:6789/0 conn(0x7fc1d00b2b80 legacy=0x7fc1d00b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d0070e70 con 0x7fc1d0071670 2023-11-28T20:08:21.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7fc1c8001a00 con 0x7fc1d0071670 2023-11-28T20:08:21.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 >> v1:172.21.15.177:6789/0 conn(0x7fc1d0071670 legacy=0x7fc1d00ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 --2- 172.21.15.177:0/3358784163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1bc003b40 0x7fc1bc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 --2- 172.21.15.177:0/3358784163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1bc0047d0 0x7fc1bc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 --2- 172.21.15.177:0/3358784163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d006d980 0x7fc1bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0070b90 con 0x7fc1bc0047d0 2023-11-28T20:08:21.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc0045e0 con 0x7fc1bc003b40 2023-11-28T20:08:21.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc00ffd0 con 0x7fc1d006d980 2023-11-28T20:08:21.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d55e1640 1 --2- 172.21.15.177:0/3358784163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1bc0047d0 0x7fc1bc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d5de2640 1 --2- 172.21.15.177:0/3358784163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1bc003b40 0x7fc1bc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d65e3640 1 --2- 172.21.15.177:0/3358784163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d006d980 0x7fc1bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d55e1640 1 -- 172.21.15.177:0/3358784163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d006d980 msgr2=0x7fc1bc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:21.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d55e1640 1 --2- 172.21.15.177:0/3358784163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d006d980 0x7fc1bc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d55e1640 1 -- 172.21.15.177:0/3358784163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1bc003b40 msgr2=0x7fc1bc003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:21.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d55e1640 1 --2- 172.21.15.177:0/3358784163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1bc003b40 0x7fc1bc003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.307+0000 7fc1d55e1640 1 -- 172.21.15.177:0/3358784163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc003530 con 0x7fc1bc0047d0 2023-11-28T20:08:21.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.311+0000 7fc1d55e1640 1 --2- 172.21.15.177:0/3358784163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1bc0047d0 0x7fc1bc004c50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009ae0 tx=0x7fc1c001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23b3cd055421060 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:21.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.311+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00a5640 con 0x7fc1bc0047d0 2023-11-28T20:08:21.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.311+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c00a57a0 con 0x7fc1bc0047d0 2023-11-28T20:08:21.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.311+0000 7fc1d4de0640 1 -- 172.21.15.177:0/3358784163 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00a5b50 con 0x7fc1bc0047d0 2023-11-28T20:08:21.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.311+0000 7fc1d6de4640 1 -- 172.21.15.177:0/3358784163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1bc0047d0 msgr2=0x7fc1bc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.311+0000 7fc1d6de4640 1 --2- 172.21.15.177:0/3358784163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1bc0047d0 0x7fc1bc004c50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009ae0 tx=0x7fc1c001c9f0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.311+0000 7fc1d65e3640 1 -- 172.21.15.177:0/3358784163 reap_dead start 2023-11-28T20:08:21.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.311+0000 7fc1d6de4640 1 -- 172.21.15.177:0/3358784163 shutdown_connections 2023-11-28T20:08:21.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.311+0000 7fc1d6de4640 1 -- 172.21.15.177:0/3358784163 >> 172.21.15.177:0/3358784163 conn(0x7fc1d00b0920 msgr2=0x7fc1d00b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:21.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.311+0000 7fc1d6de4640 1 -- 172.21.15.177:0/3358784163 shutdown_connections 2023-11-28T20:08:21.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.311+0000 7fc1d6de4640 1 -- 172.21.15.177:0/3358784163 wait complete. 2023-11-28T20:08:21.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.311+0000 7fc1d6de4640 1 Processor -- start 2023-11-28T20:08:21.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.311+0000 7fc1d6de4640 1 -- start start 2023-11-28T20:08:21.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d6de4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1bc0047d0 0x7fc1d0154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d6de4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1d009b750 0x7fc1d0150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d6de4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d009bbb0 0x7fc1d01509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d6de4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d015a7e0 con 0x7fc1d009b750 2023-11-28T20:08:21.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d6de4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0150f00 con 0x7fc1bc0047d0 2023-11-28T20:08:21.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d6de4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0159c60 con 0x7fc1d009bbb0 2023-11-28T20:08:21.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d55e1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1d009b750 0x7fc1d0150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d55e1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1d009b750 0x7fc1d0150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53156/0 (socket says 172.21.15.177:53156) 2023-11-28T20:08:21.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d55e1640 1 -- 172.21.15.177:0/2482446775 learned_addr learned my addr 172.21.15.177:0/2482446775 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:21.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d5de2640 1 --2- 172.21.15.177:0/2482446775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1bc0047d0 0x7fc1d0154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d65e3640 1 --2- 172.21.15.177:0/2482446775 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d009bbb0 0x7fc1d01509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d55e1640 1 -- 172.21.15.177:0/2482446775 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d009bbb0 msgr2=0x7fc1d01509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d55e1640 1 --2- 172.21.15.177:0/2482446775 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d009bbb0 0x7fc1d01509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d55e1640 1 -- 172.21.15.177:0/2482446775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1bc0047d0 msgr2=0x7fc1d0154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d55e1640 1 --2- 172.21.15.177:0/2482446775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1bc0047d0 0x7fc1d0154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d55e1640 1 -- 172.21.15.177:0/2482446775 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d0159f40 con 0x7fc1d009b750 2023-11-28T20:08:21.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d55e1640 1 --2- 172.21.15.177:0/2482446775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1d009b750 0x7fc1d0150480 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009ae0 tx=0x7fc1bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:21.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1c67fc640 1 -- 172.21.15.177:0/2482446775 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0004230 con 0x7fc1d009b750 2023-11-28T20:08:21.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1c67fc640 1 -- 172.21.15.177:0/2482446775 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c0004390 con 0x7fc1d009b750 2023-11-28T20:08:21.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1c67fc640 1 -- 172.21.15.177:0/2482446775 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00ad850 con 0x7fc1d009b750 2023-11-28T20:08:21.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d6de4640 1 -- 172.21.15.177:0/2482446775 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d015a220 con 0x7fc1d009b750 2023-11-28T20:08:21.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d6de4640 1 -- 172.21.15.177:0/2482446775 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d01547d0 con 0x7fc1d009b750 2023-11-28T20:08:21.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.315+0000 7fc1d6de4640 1 -- 172.21.15.177:0/2482446775 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d009d080 con 0x7fc1d009b750 2023-11-28T20:08:21.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.319+0000 7fc1c67fc640 1 -- 172.21.15.177:0/2482446775 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc1c00b4040 con 0x7fc1d009b750 2023-11-28T20:08:21.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.319+0000 7fc1c67fc640 1 --2- 172.21.15.177:0/2482446775 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1b4066470 0x7fc1b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.319+0000 7fc1c67fc640 1 -- 172.21.15.177:0/2482446775 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1cc001d30 con 0x7fc1d009b750 2023-11-28T20:08:21.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.319+0000 7fc1d5de2640 1 --2- 172.21.15.177:0/2482446775 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1b4066470 0x7fc1b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.319+0000 7fc1d5de2640 1 --2- 172.21.15.177:0/2482446775 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1b4066470 0x7fc1b4068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc005630 tx=0x7fc1cc001490 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:21.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.323+0000 7fc1c67fc640 1 -- 172.21.15.177:0/2482446775 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc1c00eba00 con 0x7fc1d009b750 2023-11-28T20:08:21.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.479+0000 7fc1d6de4640 1 -- 172.21.15.177:0/2482446775 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1d015b080 con 0x7fc1d009b750 2023-11-28T20:08:21.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.479+0000 7fc1c67fc640 1 -- 172.21.15.177:0/2482446775 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1c00ef020 con 0x7fc1d009b750 2023-11-28T20:08:21.485 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:21.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.483+0000 7fc1d6de4640 1 -- 172.21.15.177:0/2482446775 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1b4066470 msgr2=0x7fc1b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.483+0000 7fc1d6de4640 1 --2- 172.21.15.177:0/2482446775 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1b4066470 0x7fc1b4068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc005630 tx=0x7fc1cc001490 comp rx=0 tx=0).stop 2023-11-28T20:08:21.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.483+0000 7fc1d6de4640 1 -- 172.21.15.177:0/2482446775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1d009b750 msgr2=0x7fc1d0150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.483+0000 7fc1d6de4640 1 --2- 172.21.15.177:0/2482446775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1d009b750 0x7fc1d0150480 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009ae0 tx=0x7fc1bc005800 comp rx=0 tx=0).stop 2023-11-28T20:08:21.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.483+0000 7fc1d6de4640 1 -- 172.21.15.177:0/2482446775 shutdown_connections 2023-11-28T20:08:21.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.483+0000 7fc1d6de4640 1 --2- 172.21.15.177:0/2482446775 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1b4066470 0x7fc1b4068930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.483+0000 7fc1d6de4640 1 --2- 172.21.15.177:0/2482446775 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d009bbb0 0x7fc1d01509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.483+0000 7fc1d6de4640 1 --2- 172.21.15.177:0/2482446775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1d009b750 0x7fc1d0150480 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.483+0000 7fc1d6de4640 1 --2- 172.21.15.177:0/2482446775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1bc0047d0 0x7fc1d0154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.483+0000 7fc1d6de4640 1 -- 172.21.15.177:0/2482446775 >> 172.21.15.177:0/2482446775 conn(0x7fc1d00b0920 msgr2=0x7fc1d00ae6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:21.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.483+0000 7fc1d6de4640 1 -- 172.21.15.177:0/2482446775 shutdown_connections 2023-11-28T20:08:21.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.483+0000 7fc1d6de4640 1 -- 172.21.15.177:0/2482446775 wait complete. 2023-11-28T20:08:21.505 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:21.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.639+0000 7f94d652a640 1 Processor -- start 2023-11-28T20:08:21.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.639+0000 7f94d652a640 1 -- start start 2023-11-28T20:08:21.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94d652a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f94d01571d0 0x7f94d0070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94d652a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94d00ae830 0x7f94d015d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94d652a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d01575b0 con 0x7f94d015d710 2023-11-28T20:08:21.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94d652a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d015dba0 con 0x7f94d01571d0 2023-11-28T20:08:21.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94d652a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d0071600 con 0x7f94d00ae830 2023-11-28T20:08:21.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94d4ac7640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f94d015d710 0x7f94d0159be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45212/0 (socket says 172.21.15.177:45212) 2023-11-28T20:08:21.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94d4ac7640 1 -- 172.21.15.177:0/2091172468 learned_addr learned my addr 172.21.15.177:0/2091172468 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:21.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94cffff640 1 --2- 172.21.15.177:0/2091172468 >> v2:172.21.15.195:3300/0 conn(0x7f94d01571d0 0x7f94d0070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94cf7fe640 1 --2- 172.21.15.177:0/2091172468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94d00ae830 0x7f94d015d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 -- 172.21.15.177:0/2091172468 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208560165 0 0) 0x7f94d01575b0 con 0x7f94d015d710 2023-11-28T20:08:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 -- 172.21.15.177:0/2091172468 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94b8003530 con 0x7f94d015d710 2023-11-28T20:08:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 -- 172.21.15.177:0/2091172468 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2442294139 0 0) 0x7f94b8003530 con 0x7f94d015d710 2023-11-28T20:08:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 -- 172.21.15.177:0/2091172468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94d00ae830 msgr2=0x7f94d015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 --2- 172.21.15.177:0/2091172468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94d00ae830 0x7f94d015d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 -- 172.21.15.177:0/2091172468 >> v2:172.21.15.195:3300/0 conn(0x7f94d01571d0 msgr2=0x7f94d0070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 --2- 172.21.15.177:0/2091172468 >> v2:172.21.15.195:3300/0 conn(0x7f94d01571d0 0x7f94d0070c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 -- 172.21.15.177:0/2091172468 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d00718e0 con 0x7f94d015d710 2023-11-28T20:08:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 -- 172.21.15.177:0/2091172468 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f94c8001a00 con 0x7f94d015d710 2023-11-28T20:08:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 -- 172.21.15.177:0/2091172468 >> v1:172.21.15.177:6789/0 conn(0x7f94d015d710 legacy=0x7f94d0159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 --2- 172.21.15.177:0/2091172468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94b8003980 0x7f94b8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 --2- 172.21.15.177:0/2091172468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94d00ae830 0x7f94b80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 --2- 172.21.15.177:0/2091172468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b8004d10 0x7f94b8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 -- 172.21.15.177:0/2091172468 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d015dba0 con 0x7f94b8004d10 2023-11-28T20:08:21.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 -- 172.21.15.177:0/2091172468 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d0071600 con 0x7f94b8003980 2023-11-28T20:08:21.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94ceffd640 1 -- 172.21.15.177:0/2091172468 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b800b990 con 0x7f94d00ae830 2023-11-28T20:08:21.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94d4ac7640 1 --2- 172.21.15.177:0/2091172468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b8004d10 0x7f94b8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94cffff640 1 --2- 172.21.15.177:0/2091172468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94b8003980 0x7f94b8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94cf7fe640 1 --2- 172.21.15.177:0/2091172468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94d00ae830 0x7f94b80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94d4ac7640 1 -- 172.21.15.177:0/2091172468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94d00ae830 msgr2=0x7f94b80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:21.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94d4ac7640 1 --2- 172.21.15.177:0/2091172468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94d00ae830 0x7f94b80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94d4ac7640 1 -- 172.21.15.177:0/2091172468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94b8003980 msgr2=0x7f94b8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:21.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94d4ac7640 1 --2- 172.21.15.177:0/2091172468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94b8003980 0x7f94b8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.643+0000 7f94d4ac7640 1 -- 172.21.15.177:0/2091172468 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b8003530 con 0x7f94b8004d10 2023-11-28T20:08:21.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.647+0000 7f94d4ac7640 1 --2- 172.21.15.177:0/2091172468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b8004d10 0x7f94b8005190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f94c800a830 tx=0x7f94c801fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2e301153f71f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:21.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.647+0000 7f94ceffd640 1 -- 172.21.15.177:0/2091172468 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c80aa6f0 con 0x7f94b8004d10 2023-11-28T20:08:21.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.647+0000 7f94ceffd640 1 -- 172.21.15.177:0/2091172468 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c80aa850 con 0x7f94b8004d10 2023-11-28T20:08:21.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.647+0000 7f94ceffd640 1 -- 172.21.15.177:0/2091172468 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c80aac20 con 0x7f94b8004d10 2023-11-28T20:08:21.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.647+0000 7f94d652a640 1 -- 172.21.15.177:0/2091172468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b8004d10 msgr2=0x7f94b8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.647+0000 7f94d652a640 1 --2- 172.21.15.177:0/2091172468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b8004d10 0x7f94b8005190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f94c800a830 tx=0x7f94c801fac0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.647+0000 7f94d4ac7640 1 -- 172.21.15.177:0/2091172468 reap_dead start 2023-11-28T20:08:21.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.647+0000 7f94d652a640 1 -- 172.21.15.177:0/2091172468 shutdown_connections 2023-11-28T20:08:21.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.647+0000 7f94d652a640 1 -- 172.21.15.177:0/2091172468 >> 172.21.15.177:0/2091172468 conn(0x7f94d00b0cc0 msgr2=0x7f94d00b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:21.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.647+0000 7f94d652a640 1 -- 172.21.15.177:0/2091172468 shutdown_connections 2023-11-28T20:08:21.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.647+0000 7f94d652a640 1 -- 172.21.15.177:0/2091172468 wait complete. 2023-11-28T20:08:21.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94d652a640 1 Processor -- start 2023-11-28T20:08:21.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94d652a640 1 -- start start 2023-11-28T20:08:21.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94d652a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b8004d10 0x7f94d0155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94d652a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94d015ab00 0x7f94d015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94d652a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94d01444b0 0x7f94d0144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94d652a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d015c1b0 con 0x7f94b8004d10 2023-11-28T20:08:21.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94d652a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d0144e70 con 0x7f94d01444b0 2023-11-28T20:08:21.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94d652a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d015b5a0 con 0x7f94d015ab00 2023-11-28T20:08:21.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94cffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b8004d10 0x7f94d0155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94cffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b8004d10 0x7f94d0155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53184/0 (socket says 172.21.15.177:53184) 2023-11-28T20:08:21.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94cffff640 1 -- 172.21.15.177:0/4112196850 learned_addr learned my addr 172.21.15.177:0/4112196850 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:21.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94cf7fe640 1 --2- 172.21.15.177:0/4112196850 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94d015ab00 0x7f94d015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94d4ac7640 1 --2- 172.21.15.177:0/4112196850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94d01444b0 0x7f94d0144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94cffff640 1 -- 172.21.15.177:0/4112196850 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94d015ab00 msgr2=0x7f94d015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94cffff640 1 --2- 172.21.15.177:0/4112196850 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94d015ab00 0x7f94d015af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94cffff640 1 -- 172.21.15.177:0/4112196850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94d01444b0 msgr2=0x7f94d0144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94cffff640 1 --2- 172.21.15.177:0/4112196850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94d01444b0 0x7f94d0144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94cffff640 1 -- 172.21.15.177:0/4112196850 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d015b880 con 0x7f94b8004d10 2023-11-28T20:08:21.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94cffff640 1 --2- 172.21.15.177:0/4112196850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b8004d10 0x7f94d0155820 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f94c0011a30 tx=0x7f94c0011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:21.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94ccff9640 1 -- 172.21.15.177:0/4112196850 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c000fd30 con 0x7f94b8004d10 2023-11-28T20:08:21.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94ccff9640 1 -- 172.21.15.177:0/4112196850 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c000fe90 con 0x7f94b8004d10 2023-11-28T20:08:21.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94ccff9640 1 -- 172.21.15.177:0/4112196850 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c001c6c0 con 0x7f94b8004d10 2023-11-28T20:08:21.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94d652a640 1 -- 172.21.15.177:0/4112196850 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d015bb60 con 0x7f94b8004d10 2023-11-28T20:08:21.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.651+0000 7f94d652a640 1 -- 172.21.15.177:0/4112196850 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d015cca0 con 0x7f94b8004d10 2023-11-28T20:08:21.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.655+0000 7f94d652a640 1 -- 172.21.15.177:0/4112196850 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d01f27a0 con 0x7f94b8004d10 2023-11-28T20:08:21.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.655+0000 7f94ccff9640 1 -- 172.21.15.177:0/4112196850 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f94c001c820 con 0x7f94b8004d10 2023-11-28T20:08:21.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.655+0000 7f94ccff9640 1 --2- 172.21.15.177:0/4112196850 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f94bc066470 0x7f94bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.655+0000 7f94ccff9640 1 -- 172.21.15.177:0/4112196850 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94c0017070 con 0x7f94b8004d10 2023-11-28T20:08:21.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.655+0000 7f94cf7fe640 1 --2- 172.21.15.177:0/4112196850 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f94bc066470 0x7f94bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.655+0000 7f94cf7fe640 1 --2- 172.21.15.177:0/4112196850 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f94bc066470 0x7f94bc068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f94d00b44f0 tx=0x7f94c4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:21.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.659+0000 7f94ccff9640 1 -- 172.21.15.177:0/4112196850 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f94c0051e60 con 0x7f94b8004d10 2023-11-28T20:08:21.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.807+0000 7f94d652a640 1 -- 172.21.15.177:0/4112196850 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94d00693d0 con 0x7f94b8004d10 2023-11-28T20:08:21.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.807+0000 7f94ccff9640 1 -- 172.21.15.177:0/4112196850 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94c00210a0 con 0x7f94b8004d10 2023-11-28T20:08:21.814 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:21.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.811+0000 7f94d652a640 1 -- 172.21.15.177:0/4112196850 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f94bc066470 msgr2=0x7f94bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.811+0000 7f94d652a640 1 --2- 172.21.15.177:0/4112196850 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f94bc066470 0x7f94bc068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f94d00b44f0 tx=0x7f94c4009190 comp rx=0 tx=0).stop 2023-11-28T20:08:21.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.811+0000 7f94d652a640 1 -- 172.21.15.177:0/4112196850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b8004d10 msgr2=0x7f94d0155820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.811+0000 7f94d652a640 1 --2- 172.21.15.177:0/4112196850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b8004d10 0x7f94d0155820 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f94c0011a30 tx=0x7f94c0011e30 comp rx=0 tx=0).stop 2023-11-28T20:08:21.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.811+0000 7f94d652a640 1 -- 172.21.15.177:0/4112196850 shutdown_connections 2023-11-28T20:08:21.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.811+0000 7f94d652a640 1 --2- 172.21.15.177:0/4112196850 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f94bc066470 0x7f94bc068930 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.811+0000 7f94d652a640 1 --2- 172.21.15.177:0/4112196850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94d01444b0 0x7f94d0144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.811+0000 7f94d652a640 1 --2- 172.21.15.177:0/4112196850 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94d015ab00 0x7f94d015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.811+0000 7f94d652a640 1 --2- 172.21.15.177:0/4112196850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b8004d10 0x7f94d0155820 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.811+0000 7f94d652a640 1 -- 172.21.15.177:0/4112196850 >> 172.21.15.177:0/4112196850 conn(0x7f94d00b0cc0 msgr2=0x7f94d00ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:21.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.811+0000 7f94d652a640 1 -- 172.21.15.177:0/4112196850 shutdown_connections 2023-11-28T20:08:21.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.811+0000 7f94d652a640 1 -- 172.21.15.177:0/4112196850 wait complete. 2023-11-28T20:08:21.834 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:21.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.967+0000 7fb48d89c640 1 Processor -- start 2023-11-28T20:08:21.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.971+0000 7fb48d89c640 1 -- start start 2023-11-28T20:08:21.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.971+0000 7fb48d89c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb488146960 0x7fb48806ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.971+0000 7fb48d89c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48815e900 con 0x7fb48815fda0 2023-11-28T20:08:21.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.971+0000 7fb48d89c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48806f6c0 con 0x7fb4880b4030 2023-11-28T20:08:21.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.971+0000 7fb48d89c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48815dcf0 con 0x7fb488146960 2023-11-28T20:08:21.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.971+0000 7fb486ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb488146960 0x7fb48806ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.971+0000 7fb486ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb488146960 0x7fb48806ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53190/0 (socket says 172.21.15.177:53190) 2023-11-28T20:08:21.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.971+0000 7fb486ffd640 1 -- 172.21.15.177:0/195902044 learned_addr learned my addr 172.21.15.177:0/195902044 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:21.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.971+0000 7fb486ffd640 1 -- 172.21.15.177:0/195902044 >> v1:172.21.15.195:6789/0 conn(0x7fb4880b4030 legacy=0x7fb48806e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:21.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.971+0000 7fb486ffd640 1 -- 172.21.15.177:0/195902044 >> v1:172.21.15.177:6789/0 conn(0x7fb48815fda0 legacy=0x7fb48806efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.971+0000 7fb486ffd640 1 -- 172.21.15.177:0/195902044 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48815dfd0 con 0x7fb488146960 2023-11-28T20:08:21.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.975+0000 7fb486ffd640 1 --2- 172.21.15.177:0/195902044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb488146960 0x7fb48806ca70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb470009870 tx=0x7fb47001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c68644b218105b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:21.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.975+0000 7fb4867fc640 1 -- 172.21.15.177:0/195902044 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700ab5f0 con 0x7fb488146960 2023-11-28T20:08:21.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.975+0000 7fb4867fc640 1 -- 172.21.15.177:0/195902044 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4700ab750 con 0x7fb488146960 2023-11-28T20:08:21.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.975+0000 7fb4867fc640 1 -- 172.21.15.177:0/195902044 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700abae0 con 0x7fb488146960 2023-11-28T20:08:21.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.975+0000 7fb48d89c640 1 -- 172.21.15.177:0/195902044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb488146960 msgr2=0x7fb48806ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.975+0000 7fb48d89c640 1 --2- 172.21.15.177:0/195902044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb488146960 0x7fb48806ca70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb470009870 tx=0x7fb47001c500 comp rx=0 tx=0).stop 2023-11-28T20:08:21.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.975+0000 7fb48d89c640 1 -- 172.21.15.177:0/195902044 shutdown_connections 2023-11-28T20:08:21.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.975+0000 7fb48d89c640 1 --2- 172.21.15.177:0/195902044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb488146960 0x7fb48806ca70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.975+0000 7fb48d89c640 1 -- 172.21.15.177:0/195902044 >> 172.21.15.177:0/195902044 conn(0x7fb488070b40 msgr2=0x7fb488066320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:21.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.975+0000 7fb48d89c640 1 -- 172.21.15.177:0/195902044 shutdown_connections 2023-11-28T20:08:21.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.975+0000 7fb48d89c640 1 -- 172.21.15.177:0/195902044 wait complete. 2023-11-28T20:08:21.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.975+0000 7fb48d89c640 1 Processor -- start 2023-11-28T20:08:21.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.975+0000 7fb48d89c640 1 -- start start 2023-11-28T20:08:21.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb48d89c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4880b4030 0x7fb48814b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb48d89c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb488146960 0x7fb48814b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb48d89c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb48815fda0 0x7fb488141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb48d89c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb488147010 con 0x7fb488146960 2023-11-28T20:08:21.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb48d89c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881390f0 con 0x7fb4880b4030 2023-11-28T20:08:21.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb48d89c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881393d0 con 0x7fb48815fda0 2023-11-28T20:08:21.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb47e7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb488146960 0x7fb48814b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb47e7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb488146960 0x7fb48814b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53194/0 (socket says 172.21.15.177:53194) 2023-11-28T20:08:21.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb47e7fc640 1 -- 172.21.15.177:0/1545635783 learned_addr learned my addr 172.21.15.177:0/1545635783 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:21.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb486ffd640 1 --2- 172.21.15.177:0/1545635783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4880b4030 0x7fb48814b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb4877fe640 1 --2- 172.21.15.177:0/1545635783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb48815fda0 0x7fb488141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb47e7fc640 1 -- 172.21.15.177:0/1545635783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb48815fda0 msgr2=0x7fb488141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb47e7fc640 1 --2- 172.21.15.177:0/1545635783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb48815fda0 0x7fb488141530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb47e7fc640 1 -- 172.21.15.177:0/1545635783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4880b4030 msgr2=0x7fb48814b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:21.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb47e7fc640 1 --2- 172.21.15.177:0/1545635783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4880b4030 0x7fb48814b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:21.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb47e7fc640 1 -- 172.21.15.177:0/1545635783 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4700094d0 con 0x7fb488146960 2023-11-28T20:08:21.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb47e7fc640 1 --2- 172.21.15.177:0/1545635783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb488146960 0x7fb48814b690 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb47800c450 tx=0x7fb47800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:21.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb484ff9640 1 -- 172.21.15.177:0/1545635783 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478012830 con 0x7fb488146960 2023-11-28T20:08:21.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb484ff9640 1 -- 172.21.15.177:0/1545635783 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4780129b0 con 0x7fb488146960 2023-11-28T20:08:21.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb484ff9640 1 -- 172.21.15.177:0/1545635783 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478012d60 con 0x7fb488146960 2023-11-28T20:08:21.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb48d89c640 1 -- 172.21.15.177:0/1545635783 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4881396b0 con 0x7fb488146960 2023-11-28T20:08:21.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb48d89c640 1 -- 172.21.15.177:0/1545635783 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4880d0cd0 con 0x7fb488146960 2023-11-28T20:08:21.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.979+0000 7fb48d89c640 1 -- 172.21.15.177:0/1545635783 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4881471c0 con 0x7fb488146960 2023-11-28T20:08:21.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.983+0000 7fb484ff9640 1 -- 172.21.15.177:0/1545635783 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb47801c460 con 0x7fb488146960 2023-11-28T20:08:21.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.983+0000 7fb484ff9640 1 --2- 172.21.15.177:0/1545635783 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb468066470 0x7fb468068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:21.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.983+0000 7fb484ff9640 1 -- 172.21.15.177:0/1545635783 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb478083b80 con 0x7fb488146960 2023-11-28T20:08:21.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.983+0000 7fb486ffd640 1 --2- 172.21.15.177:0/1545635783 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb468066470 0x7fb468068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:21.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.983+0000 7fb486ffd640 1 --2- 172.21.15.177:0/1545635783 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb468066470 0x7fb468068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4700af000 tx=0x7fb4700b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:21.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:21.987+0000 7fb484ff9640 1 -- 172.21.15.177:0/1545635783 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4881471c0 con 0x7fb488146960 2023-11-28T20:08:22.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.139+0000 7fb48d89c640 1 -- 172.21.15.177:0/1545635783 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4880693d0 con 0x7fb488146960 2023-11-28T20:08:22.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.139+0000 7fb484ff9640 1 -- 172.21.15.177:0/1545635783 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb478083e60 con 0x7fb488146960 2023-11-28T20:08:22.144 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:22.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.139+0000 7fb48d89c640 1 -- 172.21.15.177:0/1545635783 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb468066470 msgr2=0x7fb468068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:22.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.139+0000 7fb48d89c640 1 --2- 172.21.15.177:0/1545635783 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb468066470 0x7fb468068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4700af000 tx=0x7fb4700b6040 comp rx=0 tx=0).stop 2023-11-28T20:08:22.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.139+0000 7fb48d89c640 1 -- 172.21.15.177:0/1545635783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb488146960 msgr2=0x7fb48814b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:22.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.139+0000 7fb48d89c640 1 --2- 172.21.15.177:0/1545635783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb488146960 0x7fb48814b690 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb47800c450 tx=0x7fb47800c910 comp rx=0 tx=0).stop 2023-11-28T20:08:22.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.139+0000 7fb48d89c640 1 -- 172.21.15.177:0/1545635783 shutdown_connections 2023-11-28T20:08:22.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.139+0000 7fb48d89c640 1 --2- 172.21.15.177:0/1545635783 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb468066470 0x7fb468068930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.139+0000 7fb48d89c640 1 --2- 172.21.15.177:0/1545635783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb48815fda0 0x7fb488141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.139+0000 7fb48d89c640 1 --2- 172.21.15.177:0/1545635783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb488146960 0x7fb48814b690 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.139+0000 7fb48d89c640 1 --2- 172.21.15.177:0/1545635783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4880b4030 0x7fb48814b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.139+0000 7fb48d89c640 1 -- 172.21.15.177:0/1545635783 >> 172.21.15.177:0/1545635783 conn(0x7fb488070b40 msgr2=0x7fb4880b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:22.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.143+0000 7fb48d89c640 1 -- 172.21.15.177:0/1545635783 shutdown_connections 2023-11-28T20:08:22.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.143+0000 7fb48d89c640 1 -- 172.21.15.177:0/1545635783 wait complete. 2023-11-28T20:08:22.166 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:08:22.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.303+0000 7fd7ef4bb640 1 Processor -- start 2023-11-28T20:08:22.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.303+0000 7fd7ef4bb640 1 -- start start 2023-11-28T20:08:22.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.303+0000 7fd7ef4bb640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd7e813cf30 0x7fd7e806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:22.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.303+0000 7fd7ef4bb640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7e806c800 0x7fd7e815a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:22.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.303+0000 7fd7ef4bb640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd7e815ab70 0x7fd7e8071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:22.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.303+0000 7fd7ef4bb640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e813d310 con 0x7fd7e813cf30 2023-11-28T20:08:22.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.303+0000 7fd7ef4bb640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e81404e0 con 0x7fd7e815ab70 2023-11-28T20:08:22.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.303+0000 7fd7ef4bb640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e815b3a0 con 0x7fd7e806c800 2023-11-28T20:08:22.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.303+0000 7fd7ed257640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd7e813cf30 0x7fd7e806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:22.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.303+0000 7fd7ed257640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd7e813cf30 0x7fd7e806c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53198/0 (socket says 172.21.15.177:53198) 2023-11-28T20:08:22.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.303+0000 7fd7ed257640 1 -- 172.21.15.177:0/1594057261 learned_addr learned my addr 172.21.15.177:0/1594057261 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:22.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.307+0000 7fd7eda58640 1 --2- 172.21.15.177:0/1594057261 >> v2:172.21.15.195:3300/0 conn(0x7fd7e815ab70 0x7fd7e8071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:22.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.307+0000 7fd7eca56640 1 --2- 172.21.15.177:0/1594057261 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7e806c800 0x7fd7e815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:22.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.307+0000 7fd7ed257640 1 -- 172.21.15.177:0/1594057261 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7e806c800 msgr2=0x7fd7e815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:22.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.307+0000 7fd7ed257640 1 --2- 172.21.15.177:0/1594057261 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7e806c800 0x7fd7e815a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.307+0000 7fd7ed257640 1 -- 172.21.15.177:0/1594057261 >> v2:172.21.15.195:3300/0 conn(0x7fd7e815ab70 msgr2=0x7fd7e8071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:22.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.307+0000 7fd7ed257640 1 --2- 172.21.15.177:0/1594057261 >> v2:172.21.15.195:3300/0 conn(0x7fd7e815ab70 0x7fd7e8071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.307+0000 7fd7ed257640 1 -- 172.21.15.177:0/1594057261 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e806cc40 con 0x7fd7e813cf30 2023-11-28T20:08:22.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.307+0000 7fd7ed257640 1 --2- 172.21.15.177:0/1594057261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e813cf30 0x7fd7e806c2c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd7e806d630 tx=0x7fd7e401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816653afc4694f81 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:22.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.307+0000 7fd7dffff640 1 -- 172.21.15.177:0/1594057261 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40ab600 con 0x7fd7e813cf30 2023-11-28T20:08:22.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.307+0000 7fd7dffff640 1 -- 172.21.15.177:0/1594057261 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e40ab760 con 0x7fd7e813cf30 2023-11-28T20:08:22.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.307+0000 7fd7dffff640 1 -- 172.21.15.177:0/1594057261 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40abaf0 con 0x7fd7e813cf30 2023-11-28T20:08:22.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.307+0000 7fd7ef4bb640 1 -- 172.21.15.177:0/1594057261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e813cf30 msgr2=0x7fd7e806c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:22.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.307+0000 7fd7ef4bb640 1 --2- 172.21.15.177:0/1594057261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e813cf30 0x7fd7e806c2c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd7e806d630 tx=0x7fd7e401c440 comp rx=0 tx=0).stop 2023-11-28T20:08:22.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ef4bb640 1 -- 172.21.15.177:0/1594057261 shutdown_connections 2023-11-28T20:08:22.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ef4bb640 1 --2- 172.21.15.177:0/1594057261 >> v2:172.21.15.195:3300/0 conn(0x7fd7e815ab70 0x7fd7e8071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ef4bb640 1 --2- 172.21.15.177:0/1594057261 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7e806c800 0x7fd7e815a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ef4bb640 1 --2- 172.21.15.177:0/1594057261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e813cf30 0x7fd7e806c2c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ef4bb640 1 -- 172.21.15.177:0/1594057261 >> 172.21.15.177:0/1594057261 conn(0x7fd7e806a530 msgr2=0x7fd7e806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:22.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ef4bb640 1 -- 172.21.15.177:0/1594057261 shutdown_connections 2023-11-28T20:08:22.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ef4bb640 1 -- 172.21.15.177:0/1594057261 wait complete. 2023-11-28T20:08:22.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ef4bb640 1 Processor -- start 2023-11-28T20:08:22.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ef4bb640 1 -- start start 2023-11-28T20:08:22.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ef4bb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e806c800 0x7fd7e813c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:22.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ef4bb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7e813cf30 0x7fd7e813ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:22.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ef4bb640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7e815ab70 0x7fd7e8139420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:22.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ef4bb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e813bdb0 con 0x7fd7e806c800 2023-11-28T20:08:22.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ef4bb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e813b1a0 con 0x7fd7e813cf30 2023-11-28T20:08:22.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ef4bb640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e813b480 con 0x7fd7e815ab70 2023-11-28T20:08:22.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ed257640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e806c800 0x7fd7e813c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:22.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ed257640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e806c800 0x7fd7e813c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53200/0 (socket says 172.21.15.177:53200) 2023-11-28T20:08:22.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ed257640 1 -- 172.21.15.177:0/3831167808 learned_addr learned my addr 172.21.15.177:0/3831167808 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:22.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7eda58640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7e815ab70 0x7fd7e8139420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:22.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7eca56640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7e813cf30 0x7fd7e813ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:22.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ed257640 1 -- 172.21.15.177:0/3831167808 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7e815ab70 msgr2=0x7fd7e8139420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:22.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ed257640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7e815ab70 0x7fd7e8139420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ed257640 1 -- 172.21.15.177:0/3831167808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7e813cf30 msgr2=0x7fd7e813ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:22.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ed257640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7e813cf30 0x7fd7e813ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ed257640 1 -- 172.21.15.177:0/3831167808 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e40094d0 con 0x7fd7e806c800 2023-11-28T20:08:22.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7eda58640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7e815ab70 0x7fd7e8139420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:22.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7eca56640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7e813cf30 0x7fd7e813ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:22.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.311+0000 7fd7ed257640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e806c800 0x7fd7e813c240 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40ad040 tx=0x7fd7e401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:22.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.315+0000 7fd7ddffb640 1 -- 172.21.15.177:0/3831167808 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40b4800 con 0x7fd7e806c800 2023-11-28T20:08:22.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.315+0000 7fd7ddffb640 1 -- 172.21.15.177:0/3831167808 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e40b4980 con 0x7fd7e806c800 2023-11-28T20:08:22.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.315+0000 7fd7ddffb640 1 -- 172.21.15.177:0/3831167808 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40b4d30 con 0x7fd7e806c800 2023-11-28T20:08:22.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.315+0000 7fd7ef4bb640 1 -- 172.21.15.177:0/3831167808 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e813b760 con 0x7fd7e806c800 2023-11-28T20:08:22.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.315+0000 7fd7ef4bb640 1 -- 172.21.15.177:0/3831167808 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e813a040 con 0x7fd7e806c800 2023-11-28T20:08:22.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.315+0000 7fd7ef4bb640 1 -- 172.21.15.177:0/3831167808 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e813b5c0 con 0x7fd7e806c800 2023-11-28T20:08:22.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.315+0000 7fd7ddffb640 1 -- 172.21.15.177:0/3831167808 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd7e40c7440 con 0x7fd7e806c800 2023-11-28T20:08:22.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.315+0000 7fd7ddffb640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd7cc0664a0 0x7fd7cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:22.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.315+0000 7fd7ddffb640 1 -- 172.21.15.177:0/3831167808 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fd7e411e910 con 0x7fd7e806c800 2023-11-28T20:08:22.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.315+0000 7fd7eca56640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd7cc0664a0 0x7fd7cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:22.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.319+0000 7fd7eca56640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd7cc0664a0 0x7fd7cc068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd7e806cf60 tx=0x7fd7d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:22.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.319+0000 7fd7ddffb640 1 -- 172.21.15.177:0/3831167808 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd7e813b5c0 con 0x7fd7e806c800 2023-11-28T20:08:22.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.483+0000 7fd7ef4bb640 1 -- 172.21.15.177:0/3831167808 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd7e813b5c0 con 0x7fd7e806c800 2023-11-28T20:08:22.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.483+0000 7fd7ddffb640 1 -- 172.21.15.177:0/3831167808 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd7e813b5c0 con 0x7fd7e806c800 2023-11-28T20:08:22.487 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:08:22.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.483+0000 7fd7ef4bb640 1 -- 172.21.15.177:0/3831167808 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd7cc0664a0 msgr2=0x7fd7cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:22.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.483+0000 7fd7ef4bb640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd7cc0664a0 0x7fd7cc068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd7e806cf60 tx=0x7fd7d8008040 comp rx=0 tx=0).stop 2023-11-28T20:08:22.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.483+0000 7fd7ef4bb640 1 -- 172.21.15.177:0/3831167808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e806c800 msgr2=0x7fd7e813c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:22.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.483+0000 7fd7ef4bb640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e806c800 0x7fd7e813c240 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40ad040 tx=0x7fd7e401ac80 comp rx=0 tx=0).stop 2023-11-28T20:08:22.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.483+0000 7fd7ef4bb640 1 -- 172.21.15.177:0/3831167808 shutdown_connections 2023-11-28T20:08:22.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.483+0000 7fd7ef4bb640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd7cc0664a0 0x7fd7cc068960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.483+0000 7fd7ef4bb640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7e815ab70 0x7fd7e8139420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.483+0000 7fd7ef4bb640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7e813cf30 0x7fd7e813ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.483+0000 7fd7ef4bb640 1 --2- 172.21.15.177:0/3831167808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e806c800 0x7fd7e813c240 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.483+0000 7fd7ef4bb640 1 -- 172.21.15.177:0/3831167808 >> 172.21.15.177:0/3831167808 conn(0x7fd7e806a530 msgr2=0x7fd7e80b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:22.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.483+0000 7fd7ef4bb640 1 -- 172.21.15.177:0/3831167808 shutdown_connections 2023-11-28T20:08:22.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.483+0000 7fd7ef4bb640 1 -- 172.21.15.177:0/3831167808 wait complete. 2023-11-28T20:08:22.509 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-11-28T20:08:22.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:22.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-28T20:08:22.531 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:08:22.531 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:08:22.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:22.531 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T20:08:22.583 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:08:22.583 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:08:22.594 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:08:22.595 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:08:22.647 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:22.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.779+0000 7ff653c79640 1 Processor -- start 2023-11-28T20:08:22.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.779+0000 7ff653c79640 1 -- start start 2023-11-28T20:08:22.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.779+0000 7ff653c79640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff64c15bc90 0x7ff64c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:22.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.779+0000 7ff653c79640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff64c15c070 0x7ff64c06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:22.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.779+0000 7ff653c79640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64c145fc0 con 0x7ff64c145250 2023-11-28T20:08:22.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.779+0000 7ff653c79640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64c1462a0 con 0x7ff64c15c070 2023-11-28T20:08:22.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.779+0000 7ff653c79640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c146580 con 0x7ff64c15bc90 2023-11-28T20:08:22.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.779+0000 7ff651214640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff64c15c070 0x7ff64c06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:22.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.783+0000 7ff651214640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff64c15c070 0x7ff64c06c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53206/0 (socket says 172.21.15.177:53206) 2023-11-28T20:08:22.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.783+0000 7ff651214640 1 -- 172.21.15.177:0/1657499173 learned_addr learned my addr 172.21.15.177:0/1657499173 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:22.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.783+0000 7ff651a15640 1 --2- 172.21.15.177:0/1657499173 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff64c15bc90 0x7ff64c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:22.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.783+0000 7ff651214640 1 -- 172.21.15.177:0/1657499173 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff64c15bc90 msgr2=0x7ff64c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:22.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.783+0000 7ff651214640 1 --2- 172.21.15.177:0/1657499173 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff64c15bc90 0x7ff64c06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.783+0000 7ff651214640 1 -- 172.21.15.177:0/1657499173 >> v1:172.21.15.195:6789/0 conn(0x7ff64c145250 legacy=0x7ff64c145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:22.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.783+0000 7ff651214640 1 -- 172.21.15.177:0/1657499173 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c146860 con 0x7ff64c15c070 2023-11-28T20:08:22.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.783+0000 7ff651214640 1 --2- 172.21.15.177:0/1657499173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff64c15c070 0x7ff64c06c800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009870 tx=0x7ff63c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65baaf836fc8b71b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:22.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.783+0000 7ff650a13640 1 -- 172.21.15.177:0/1657499173 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0ab650 con 0x7ff64c15c070 2023-11-28T20:08:22.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.783+0000 7ff650a13640 1 -- 172.21.15.177:0/1657499173 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c0ab7b0 con 0x7ff64c15c070 2023-11-28T20:08:22.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.783+0000 7ff650a13640 1 -- 172.21.15.177:0/1657499173 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0abb40 con 0x7ff64c15c070 2023-11-28T20:08:22.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 -- 172.21.15.177:0/1657499173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff64c15c070 msgr2=0x7ff64c06c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:22.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 --2- 172.21.15.177:0/1657499173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff64c15c070 0x7ff64c06c800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009870 tx=0x7ff63c01c540 comp rx=0 tx=0).stop 2023-11-28T20:08:22.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 -- 172.21.15.177:0/1657499173 shutdown_connections 2023-11-28T20:08:22.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 --2- 172.21.15.177:0/1657499173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff64c15c070 0x7ff64c06c800 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 --2- 172.21.15.177:0/1657499173 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff64c15bc90 0x7ff64c06c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 -- 172.21.15.177:0/1657499173 >> 172.21.15.177:0/1657499173 conn(0x7ff64c06a530 msgr2=0x7ff64c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:22.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 -- 172.21.15.177:0/1657499173 shutdown_connections 2023-11-28T20:08:22.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 -- 172.21.15.177:0/1657499173 wait complete. 2023-11-28T20:08:22.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 Processor -- start 2023-11-28T20:08:22.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 -- start start 2023-11-28T20:08:22.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff64c145250 0x7ff64c15e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:22.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff64c15bc90 0x7ff64c164910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:22.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff64c15c070 0x7ff64c160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:22.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c163230 con 0x7ff64c15c070 2023-11-28T20:08:22.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c161460 con 0x7ff64c15bc90 2023-11-28T20:08:22.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff653c79640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c15ea30 con 0x7ff64c145250 2023-11-28T20:08:22.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff652216640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff64c15c070 0x7ff64c160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:22.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff652216640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff64c15c070 0x7ff64c160f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53212/0 (socket says 172.21.15.177:53212) 2023-11-28T20:08:22.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff652216640 1 -- 172.21.15.177:0/2306808927 learned_addr learned my addr 172.21.15.177:0/2306808927 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:22.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff651a15640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff64c145250 0x7ff64c15e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:22.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff651214640 1 --2- 172.21.15.177:0/2306808927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff64c15bc90 0x7ff64c164910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:22.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff652216640 1 -- 172.21.15.177:0/2306808927 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff64c145250 msgr2=0x7ff64c15e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:22.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff652216640 1 --2- 172.21.15.177:0/2306808927 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff64c145250 0x7ff64c15e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff652216640 1 -- 172.21.15.177:0/2306808927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff64c15bc90 msgr2=0x7ff64c164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:22.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff652216640 1 --2- 172.21.15.177:0/2306808927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff64c15bc90 0x7ff64c164910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.787+0000 7ff652216640 1 -- 172.21.15.177:0/2306808927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c0094d0 con 0x7ff64c15c070 2023-11-28T20:08:22.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.791+0000 7ff652216640 1 --2- 172.21.15.177:0/2306808927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff64c15c070 0x7ff64c160f20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff64400c7a0 tx=0x7ff64400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:22.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.791+0000 7ff6427fc640 1 -- 172.21.15.177:0/2306808927 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644003b80 con 0x7ff64c15c070 2023-11-28T20:08:22.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.791+0000 7ff6427fc640 1 -- 172.21.15.177:0/2306808927 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff644003ce0 con 0x7ff64c15c070 2023-11-28T20:08:22.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.791+0000 7ff6427fc640 1 -- 172.21.15.177:0/2306808927 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64400aa90 con 0x7ff64c15c070 2023-11-28T20:08:22.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.791+0000 7ff653c79640 1 -- 172.21.15.177:0/2306808927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c15ed10 con 0x7ff64c15c070 2023-11-28T20:08:22.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.791+0000 7ff653c79640 1 -- 172.21.15.177:0/2306808927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c162e50 con 0x7ff64c15c070 2023-11-28T20:08:22.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.791+0000 7ff653c79640 1 -- 172.21.15.177:0/2306808927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64c163370 con 0x7ff64c15c070 2023-11-28T20:08:22.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.791+0000 7ff6427fc640 1 -- 172.21.15.177:0/2306808927 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff64400abf0 con 0x7ff64c15c070 2023-11-28T20:08:22.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.791+0000 7ff6427fc640 1 --2- 172.21.15.177:0/2306808927 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff630066470 0x7ff630068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:22.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.791+0000 7ff6427fc640 1 -- 172.21.15.177:0/2306808927 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff644083cb0 con 0x7ff64c15c070 2023-11-28T20:08:22.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.791+0000 7ff651a15640 1 --2- 172.21.15.177:0/2306808927 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff630066470 0x7ff630068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:22.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.791+0000 7ff651a15640 1 --2- 172.21.15.177:0/2306808927 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff630066470 0x7ff630068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff648006aa0 tx=0x7ff648008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:22.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.795+0000 7ff6427fc640 1 -- 172.21.15.177:0/2306808927 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff64c163370 con 0x7ff64c15c070 2023-11-28T20:08:22.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.943+0000 7ff653c79640 1 -- 172.21.15.177:0/2306808927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff64c163370 con 0x7ff64c15c070 2023-11-28T20:08:22.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.947+0000 7ff6427fc640 1 -- 172.21.15.177:0/2306808927 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16861 (secure 0 0 0) 0x7ff64c163370 con 0x7ff64c15c070 2023-11-28T20:08:22.951 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:22.951 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:22.241814+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:22.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.947+0000 7ff653c79640 1 -- 172.21.15.177:0/2306808927 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff630066470 msgr2=0x7ff630068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:22.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.947+0000 7ff653c79640 1 --2- 172.21.15.177:0/2306808927 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff630066470 0x7ff630068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff648006aa0 tx=0x7ff648008040 comp rx=0 tx=0).stop 2023-11-28T20:08:22.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.947+0000 7ff653c79640 1 -- 172.21.15.177:0/2306808927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff64c15c070 msgr2=0x7ff64c160f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:22.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.947+0000 7ff653c79640 1 --2- 172.21.15.177:0/2306808927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff64c15c070 0x7ff64c160f20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff64400c7a0 tx=0x7ff64400cc60 comp rx=0 tx=0).stop 2023-11-28T20:08:22.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.947+0000 7ff653c79640 1 -- 172.21.15.177:0/2306808927 shutdown_connections 2023-11-28T20:08:22.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.947+0000 7ff653c79640 1 --2- 172.21.15.177:0/2306808927 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff630066470 0x7ff630068930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.947+0000 7ff653c79640 1 --2- 172.21.15.177:0/2306808927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff64c15c070 0x7ff64c160f20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.947+0000 7ff653c79640 1 --2- 172.21.15.177:0/2306808927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff64c15bc90 0x7ff64c164910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.947+0000 7ff653c79640 1 --2- 172.21.15.177:0/2306808927 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff64c145250 0x7ff64c15e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:22.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.947+0000 7ff653c79640 1 -- 172.21.15.177:0/2306808927 >> 172.21.15.177:0/2306808927 conn(0x7ff64c06a530 msgr2=0x7ff64c143a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:22.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.947+0000 7ff653c79640 1 -- 172.21.15.177:0/2306808927 shutdown_connections 2023-11-28T20:08:22.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:22.947+0000 7ff653c79640 1 -- 172.21.15.177:0/2306808927 wait complete. 2023-11-28T20:08:22.972 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:22.973 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:23.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.107+0000 7fecd0c9c640 1 Processor -- start 2023-11-28T20:08:23.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.107+0000 7fecd0c9c640 1 -- start start 2023-11-28T20:08:23.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.111+0000 7fecd0c9c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7feccc13f5f0 0x7feccc0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.111+0000 7fecd0c9c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feccc13d2b0 con 0x7feccc071d90 2023-11-28T20:08:23.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.111+0000 7fecd0c9c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feccc0cdd70 con 0x7feccc15adb0 2023-11-28T20:08:23.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.111+0000 7fecd0c9c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feccc140520 con 0x7feccc13f5f0 2023-11-28T20:08:23.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.111+0000 7feccad9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7feccc13f5f0 0x7feccc0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.111+0000 7feccad9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7feccc13f5f0 0x7feccc0ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53222/0 (socket says 172.21.15.177:53222) 2023-11-28T20:08:23.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.111+0000 7feccad9d640 1 -- 172.21.15.177:0/4200073720 learned_addr learned my addr 172.21.15.177:0/4200073720 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:23.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.111+0000 7feccad9d640 1 -- 172.21.15.177:0/4200073720 >> v1:172.21.15.195:6789/0 conn(0x7feccc15adb0 legacy=0x7feccc13d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:23.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.111+0000 7feccad9d640 1 -- 172.21.15.177:0/4200073720 >> v1:172.21.15.177:6789/0 conn(0x7feccc071d90 legacy=0x7feccc072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.111+0000 7feccad9d640 1 -- 172.21.15.177:0/4200073720 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc13ff60 con 0x7feccc13f5f0 2023-11-28T20:08:23.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.115+0000 7feccad9d640 1 --2- 172.21.15.177:0/4200073720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feccc13f5f0 0x7feccc0ce200 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009e50 tx=0x7fecc401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbadd02c31c8c6a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:23.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.115+0000 7fecc959a640 1 -- 172.21.15.177:0/4200073720 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40a5780 con 0x7feccc13f5f0 2023-11-28T20:08:23.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.115+0000 7fecc959a640 1 -- 172.21.15.177:0/4200073720 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc40a58e0 con 0x7feccc13f5f0 2023-11-28T20:08:23.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.115+0000 7fecc959a640 1 -- 172.21.15.177:0/4200073720 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40a5c70 con 0x7feccc13f5f0 2023-11-28T20:08:23.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.115+0000 7fecd0c9c640 1 -- 172.21.15.177:0/4200073720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feccc13f5f0 msgr2=0x7feccc0ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.115+0000 7fecd0c9c640 1 --2- 172.21.15.177:0/4200073720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feccc13f5f0 0x7feccc0ce200 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009e50 tx=0x7fecc401c9d0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.115+0000 7fecd0c9c640 1 -- 172.21.15.177:0/4200073720 shutdown_connections 2023-11-28T20:08:23.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.115+0000 7fecd0c9c640 1 --2- 172.21.15.177:0/4200073720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feccc13f5f0 0x7feccc0ce200 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.115+0000 7fecd0c9c640 1 -- 172.21.15.177:0/4200073720 >> 172.21.15.177:0/4200073720 conn(0x7feccc0b0cc0 msgr2=0x7feccc0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:23.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.115+0000 7fecd0c9c640 1 -- 172.21.15.177:0/4200073720 shutdown_connections 2023-11-28T20:08:23.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.115+0000 7fecd0c9c640 1 -- 172.21.15.177:0/4200073720 wait complete. 2023-11-28T20:08:23.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.115+0000 7fecd0c9c640 1 Processor -- start 2023-11-28T20:08:23.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.115+0000 7fecd0c9c640 1 -- start start 2023-11-28T20:08:23.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecd0c9c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feccc071d90 0x7feccc0afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecd0c9c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feccc13f5f0 0x7feccc13c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecd0c9c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feccc15adb0 0x7feccc141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecd0c9c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc136b30 con 0x7feccc071d90 2023-11-28T20:08:23.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecd0c9c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc13ba20 con 0x7feccc15adb0 2023-11-28T20:08:23.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecd0c9c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feccc13bd00 con 0x7feccc13f5f0 2023-11-28T20:08:23.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecca59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feccc071d90 0x7feccc0afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecca59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feccc071d90 0x7feccc0afdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53226/0 (socket says 172.21.15.177:53226) 2023-11-28T20:08:23.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecca59c640 1 -- 172.21.15.177:0/3003576281 learned_addr learned my addr 172.21.15.177:0/3003576281 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:23.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7feccad9d640 1 --2- 172.21.15.177:0/3003576281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feccc15adb0 0x7feccc141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecc9d9b640 1 --2- 172.21.15.177:0/3003576281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feccc13f5f0 0x7feccc13c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecca59c640 1 -- 172.21.15.177:0/3003576281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feccc13f5f0 msgr2=0x7feccc13c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecca59c640 1 --2- 172.21.15.177:0/3003576281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feccc13f5f0 0x7feccc13c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecca59c640 1 -- 172.21.15.177:0/3003576281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feccc15adb0 msgr2=0x7feccc141a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecca59c640 1 --2- 172.21.15.177:0/3003576281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feccc15adb0 0x7feccc141a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecca59c640 1 -- 172.21.15.177:0/3003576281 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc4009b30 con 0x7feccc071d90 2023-11-28T20:08:23.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecca59c640 1 --2- 172.21.15.177:0/3003576281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feccc071d90 0x7feccc0afdf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00c3c0 tx=0x7fecbc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:23.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecbaffd640 1 -- 172.21.15.177:0/3003576281 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0052d0 con 0x7feccc071d90 2023-11-28T20:08:23.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecbaffd640 1 -- 172.21.15.177:0/3003576281 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc005430 con 0x7feccc071d90 2023-11-28T20:08:23.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecd0c9c640 1 -- 172.21.15.177:0/3003576281 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feccc13bfe0 con 0x7feccc071d90 2023-11-28T20:08:23.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecbaffd640 1 -- 172.21.15.177:0/3003576281 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc003840 con 0x7feccc071d90 2023-11-28T20:08:23.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecd0c9c640 1 -- 172.21.15.177:0/3003576281 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc0b03d0 con 0x7feccc071d90 2023-11-28T20:08:23.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecd0c9c640 1 -- 172.21.15.177:0/3003576281 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc13c500 con 0x7feccc071d90 2023-11-28T20:08:23.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.119+0000 7fecbaffd640 1 -- 172.21.15.177:0/3003576281 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fecbc0039a0 con 0x7feccc071d90 2023-11-28T20:08:23.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.123+0000 7fecbaffd640 1 --2- 172.21.15.177:0/3003576281 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fecac066470 0x7fecac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.123+0000 7fecbaffd640 1 -- 172.21.15.177:0/3003576281 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fecbc083440 con 0x7feccc071d90 2023-11-28T20:08:23.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.123+0000 7fecc9d9b640 1 --2- 172.21.15.177:0/3003576281 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fecac066470 0x7fecac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.123+0000 7fecc9d9b640 1 --2- 172.21.15.177:0/3003576281 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fecac066470 0x7fecac068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feccc140b20 tx=0x7fecc0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:23.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.127+0000 7fecbaffd640 1 -- 172.21.15.177:0/3003576281 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feccc13c500 con 0x7feccc071d90 2023-11-28T20:08:23.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.283+0000 7fecd0c9c640 1 -- 172.21.15.177:0/3003576281 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feccc13c500 con 0x7feccc071d90 2023-11-28T20:08:23.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.283+0000 7fecbaffd640 1 -- 172.21.15.177:0/3003576281 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fecbc050820 con 0x7feccc071d90 2023-11-28T20:08:23.287 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:23.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.283+0000 7fecd0c9c640 1 -- 172.21.15.177:0/3003576281 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fecac066470 msgr2=0x7fecac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.283+0000 7fecd0c9c640 1 --2- 172.21.15.177:0/3003576281 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fecac066470 0x7fecac068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feccc140b20 tx=0x7fecc0009040 comp rx=0 tx=0).stop 2023-11-28T20:08:23.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.283+0000 7fecd0c9c640 1 -- 172.21.15.177:0/3003576281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feccc071d90 msgr2=0x7feccc0afdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.283+0000 7fecd0c9c640 1 --2- 172.21.15.177:0/3003576281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feccc071d90 0x7feccc0afdf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00c3c0 tx=0x7fecbc00c880 comp rx=0 tx=0).stop 2023-11-28T20:08:23.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.283+0000 7fecd0c9c640 1 -- 172.21.15.177:0/3003576281 shutdown_connections 2023-11-28T20:08:23.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.283+0000 7fecd0c9c640 1 --2- 172.21.15.177:0/3003576281 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fecac066470 0x7fecac068930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.283+0000 7fecd0c9c640 1 --2- 172.21.15.177:0/3003576281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feccc15adb0 0x7feccc141a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.283+0000 7fecd0c9c640 1 --2- 172.21.15.177:0/3003576281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feccc13f5f0 0x7feccc13c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.283+0000 7fecd0c9c640 1 --2- 172.21.15.177:0/3003576281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feccc071d90 0x7feccc0afdf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.283+0000 7fecd0c9c640 1 -- 172.21.15.177:0/3003576281 >> 172.21.15.177:0/3003576281 conn(0x7feccc0b0cc0 msgr2=0x7feccc070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:23.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.283+0000 7fecd0c9c640 1 -- 172.21.15.177:0/3003576281 shutdown_connections 2023-11-28T20:08:23.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.283+0000 7fecd0c9c640 1 -- 172.21.15.177:0/3003576281 wait complete. 2023-11-28T20:08:23.308 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:23.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.447+0000 7fc28e89e640 1 Processor -- start 2023-11-28T20:08:23.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.447+0000 7fc28e89e640 1 -- start start 2023-11-28T20:08:23.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.447+0000 7fc28e89e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc28815d2b0 0x7fc2880d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.447+0000 7fc28e89e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2880d1cf0 0x7fc2880cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.447+0000 7fc28e89e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2880aff30 con 0x7fc28815d690 2023-11-28T20:08:23.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.447+0000 7fc28e89e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2880b01d0 con 0x7fc28815d2b0 2023-11-28T20:08:23.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.447+0000 7fc28e89e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880b04b0 con 0x7fc2880d1cf0 2023-11-28T20:08:23.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.447+0000 7fc287fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc28815d2b0 0x7fc2880d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.447+0000 7fc287fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc28815d2b0 0x7fc2880d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53232/0 (socket says 172.21.15.177:53232) 2023-11-28T20:08:23.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.447+0000 7fc287fff640 1 -- 172.21.15.177:0/2181159630 learned_addr learned my addr 172.21.15.177:0/2181159630 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:23.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.447+0000 7fc2877fe640 1 --2- 172.21.15.177:0/2181159630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2880d1cf0 0x7fc2880cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.447+0000 7fc287fff640 1 -- 172.21.15.177:0/2181159630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2880d1cf0 msgr2=0x7fc2880cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:23.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.447+0000 7fc287fff640 1 --2- 172.21.15.177:0/2181159630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2880d1cf0 0x7fc2880cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.447+0000 7fc287fff640 1 -- 172.21.15.177:0/2181159630 >> v1:172.21.15.177:6789/0 conn(0x7fc28815d690 legacy=0x7fc2880cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.447+0000 7fc287fff640 1 -- 172.21.15.177:0/2181159630 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880b0790 con 0x7fc28815d2b0 2023-11-28T20:08:23.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.451+0000 7fc287fff640 1 --2- 172.21.15.177:0/2181159630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28815d2b0 0x7fc2880d17b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc278009870 tx=0x7fc27801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50639e863712b86 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:23.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.451+0000 7fc286ffd640 1 -- 172.21.15.177:0/2181159630 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2780aa640 con 0x7fc28815d2b0 2023-11-28T20:08:23.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.451+0000 7fc286ffd640 1 -- 172.21.15.177:0/2181159630 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2780aa7a0 con 0x7fc28815d2b0 2023-11-28T20:08:23.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.451+0000 7fc286ffd640 1 -- 172.21.15.177:0/2181159630 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2780aab30 con 0x7fc28815d2b0 2023-11-28T20:08:23.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.451+0000 7fc28e89e640 1 -- 172.21.15.177:0/2181159630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28815d2b0 msgr2=0x7fc2880d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.451+0000 7fc28e89e640 1 --2- 172.21.15.177:0/2181159630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28815d2b0 0x7fc2880d17b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc278009870 tx=0x7fc27801c540 comp rx=0 tx=0).stop 2023-11-28T20:08:23.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.451+0000 7fc28e89e640 1 -- 172.21.15.177:0/2181159630 shutdown_connections 2023-11-28T20:08:23.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.451+0000 7fc28e89e640 1 --2- 172.21.15.177:0/2181159630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2880d1cf0 0x7fc2880cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.451+0000 7fc28e89e640 1 --2- 172.21.15.177:0/2181159630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28815d2b0 0x7fc2880d17b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.451+0000 7fc28e89e640 1 -- 172.21.15.177:0/2181159630 >> 172.21.15.177:0/2181159630 conn(0x7fc28809c510 msgr2=0x7fc2880d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:23.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.451+0000 7fc28e89e640 1 -- 172.21.15.177:0/2181159630 shutdown_connections 2023-11-28T20:08:23.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.451+0000 7fc28e89e640 1 -- 172.21.15.177:0/2181159630 wait complete. 2023-11-28T20:08:23.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28e89e640 1 Processor -- start 2023-11-28T20:08:23.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28e89e640 1 -- start start 2023-11-28T20:08:23.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28e89e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2880d1cf0 0x7fc2881fa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28e89e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28815d2b0 0x7fc28814efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28e89e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28815d690 0x7fc288155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28e89e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880cd020 con 0x7fc28815d690 2023-11-28T20:08:23.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28e89e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2881fac00 con 0x7fc2880d1cf0 2023-11-28T20:08:23.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28e89e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28814f4e0 con 0x7fc28815d2b0 2023-11-28T20:08:23.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28ce3b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28815d690 0x7fc288155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28ce3b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28815d690 0x7fc288155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53242/0 (socket says 172.21.15.177:53242) 2023-11-28T20:08:23.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28ce3b640 1 -- 172.21.15.177:0/921047670 learned_addr learned my addr 172.21.15.177:0/921047670 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:23.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc287fff640 1 --2- 172.21.15.177:0/921047670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2880d1cf0 0x7fc2881fa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc2877fe640 1 --2- 172.21.15.177:0/921047670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28815d2b0 0x7fc28814efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28ce3b640 1 -- 172.21.15.177:0/921047670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28815d2b0 msgr2=0x7fc28814efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28ce3b640 1 --2- 172.21.15.177:0/921047670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28815d2b0 0x7fc28814efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28ce3b640 1 -- 172.21.15.177:0/921047670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2880d1cf0 msgr2=0x7fc2881fa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28ce3b640 1 --2- 172.21.15.177:0/921047670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2880d1cf0 0x7fc2881fa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28ce3b640 1 -- 172.21.15.177:0/921047670 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2780094d0 con 0x7fc28815d690 2023-11-28T20:08:23.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28ce3b640 1 --2- 172.21.15.177:0/921047670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28815d690 0x7fc288155610 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc28000c730 tx=0x7fc28000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:23.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc284ff9640 1 -- 172.21.15.177:0/921047670 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280003b80 con 0x7fc28815d690 2023-11-28T20:08:23.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc284ff9640 1 -- 172.21.15.177:0/921047670 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc280003ce0 con 0x7fc28815d690 2023-11-28T20:08:23.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc284ff9640 1 -- 172.21.15.177:0/921047670 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28000aa30 con 0x7fc28815d690 2023-11-28T20:08:23.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28e89e640 1 -- 172.21.15.177:0/921047670 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc288152630 con 0x7fc28815d690 2023-11-28T20:08:23.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.455+0000 7fc28e89e640 1 -- 172.21.15.177:0/921047670 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc288152bf0 con 0x7fc28815d690 2023-11-28T20:08:23.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.459+0000 7fc28e89e640 1 -- 172.21.15.177:0/921047670 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2880679f0 con 0x7fc28815d690 2023-11-28T20:08:23.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.459+0000 7fc284ff9640 1 -- 172.21.15.177:0/921047670 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc28000ab90 con 0x7fc28815d690 2023-11-28T20:08:23.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.459+0000 7fc284ff9640 1 --2- 172.21.15.177:0/921047670 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc274066470 0x7fc274068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.459+0000 7fc284ff9640 1 -- 172.21.15.177:0/921047670 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fc280083b10 con 0x7fc28815d690 2023-11-28T20:08:23.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.459+0000 7fc287fff640 1 --2- 172.21.15.177:0/921047670 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc274066470 0x7fc274068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.459+0000 7fc287fff640 1 --2- 172.21.15.177:0/921047670 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc274066470 0x7fc274068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc2780ae000 tx=0x7fc2780b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:23.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.463+0000 7fc284ff9640 1 -- 172.21.15.177:0/921047670 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc280051020 con 0x7fc28815d690 2023-11-28T20:08:23.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.611+0000 7fc28e89e640 1 -- 172.21.15.177:0/921047670 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc2880693d0 con 0x7fc28815d690 2023-11-28T20:08:23.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.611+0000 7fc284ff9640 1 -- 172.21.15.177:0/921047670 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc280054640 con 0x7fc28815d690 2023-11-28T20:08:23.618 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:23.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.615+0000 7fc28e89e640 1 -- 172.21.15.177:0/921047670 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc274066470 msgr2=0x7fc274068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.615+0000 7fc28e89e640 1 --2- 172.21.15.177:0/921047670 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc274066470 0x7fc274068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc2780ae000 tx=0x7fc2780b5040 comp rx=0 tx=0).stop 2023-11-28T20:08:23.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.615+0000 7fc28e89e640 1 -- 172.21.15.177:0/921047670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28815d690 msgr2=0x7fc288155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.615+0000 7fc28e89e640 1 --2- 172.21.15.177:0/921047670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28815d690 0x7fc288155610 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc28000c730 tx=0x7fc28000cbf0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.615+0000 7fc28e89e640 1 -- 172.21.15.177:0/921047670 shutdown_connections 2023-11-28T20:08:23.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.615+0000 7fc28e89e640 1 --2- 172.21.15.177:0/921047670 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc274066470 0x7fc274068930 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.615+0000 7fc28e89e640 1 --2- 172.21.15.177:0/921047670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28815d690 0x7fc288155610 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.615+0000 7fc28e89e640 1 --2- 172.21.15.177:0/921047670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28815d2b0 0x7fc28814efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.615+0000 7fc28e89e640 1 --2- 172.21.15.177:0/921047670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2880d1cf0 0x7fc2881fa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.615+0000 7fc28e89e640 1 -- 172.21.15.177:0/921047670 >> 172.21.15.177:0/921047670 conn(0x7fc28809c510 msgr2=0x7fc2880b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:23.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.615+0000 7fc28e89e640 1 -- 172.21.15.177:0/921047670 shutdown_connections 2023-11-28T20:08:23.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.615+0000 7fc28e89e640 1 -- 172.21.15.177:0/921047670 wait complete. 2023-11-28T20:08:23.639 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:23.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f4411409640 1 Processor -- start 2023-11-28T20:08:23.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f4411409640 1 -- start start 2023-11-28T20:08:23.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f4411409640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f440c158ca0 0x7f440c15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f4411409640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f440c0cba10 0x7f440c15be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f4411409640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f440c0b42d0 0x7f440c0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f4411409640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f440c0b4c40 con 0x7f440c158ca0 2023-11-28T20:08:23.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f4411409640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f440c15b670 con 0x7f440c0b42d0 2023-11-28T20:08:23.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f4411409640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440c15f410 con 0x7f440c0cba10 2023-11-28T20:08:23.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f440affd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f440c158ca0 0x7f440c15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f440affd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f440c158ca0 0x7f440c15eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53246/0 (socket says 172.21.15.177:53246) 2023-11-28T20:08:23.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f440affd640 1 -- 172.21.15.177:0/209529472 learned_addr learned my addr 172.21.15.177:0/209529472 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:23.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f440a7fc640 1 --2- 172.21.15.177:0/209529472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f440c0cba10 0x7f440c15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f440b7fe640 1 --2- 172.21.15.177:0/209529472 >> v2:172.21.15.195:3300/0 conn(0x7f440c0b42d0 0x7f440c0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f440affd640 1 -- 172.21.15.177:0/209529472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f440c0cba10 msgr2=0x7f440c15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:23.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f440affd640 1 --2- 172.21.15.177:0/209529472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f440c0cba10 0x7f440c15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f440affd640 1 -- 172.21.15.177:0/209529472 >> v2:172.21.15.195:3300/0 conn(0x7f440c0b42d0 msgr2=0x7f440c0b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:23.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f440affd640 1 --2- 172.21.15.177:0/209529472 >> v2:172.21.15.195:3300/0 conn(0x7f440c0b42d0 0x7f440c0b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.779+0000 7f440affd640 1 -- 172.21.15.177:0/209529472 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c15f6f0 con 0x7f440c158ca0 2023-11-28T20:08:23.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.783+0000 7f440affd640 1 --2- 172.21.15.177:0/209529472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f440c158ca0 0x7f440c15eb50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f440c0725c0 tx=0x7f43fc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebb0cc1399c39cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:23.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.783+0000 7f4409ffb640 1 -- 172.21.15.177:0/209529472 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc0aa610 con 0x7f440c158ca0 2023-11-28T20:08:23.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.783+0000 7f4409ffb640 1 -- 172.21.15.177:0/209529472 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43fc0a6040 con 0x7f440c158ca0 2023-11-28T20:08:23.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.783+0000 7f4409ffb640 1 -- 172.21.15.177:0/209529472 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc0aa990 con 0x7f440c158ca0 2023-11-28T20:08:23.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.783+0000 7f4411409640 1 -- 172.21.15.177:0/209529472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f440c158ca0 msgr2=0x7f440c15eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.783+0000 7f4411409640 1 --2- 172.21.15.177:0/209529472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f440c158ca0 0x7f440c15eb50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f440c0725c0 tx=0x7f43fc01c4d0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.783+0000 7f4411409640 1 -- 172.21.15.177:0/209529472 shutdown_connections 2023-11-28T20:08:23.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.783+0000 7f4411409640 1 --2- 172.21.15.177:0/209529472 >> v2:172.21.15.195:3300/0 conn(0x7f440c0b42d0 0x7f440c0b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.783+0000 7f4411409640 1 --2- 172.21.15.177:0/209529472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f440c0cba10 0x7f440c15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.783+0000 7f4411409640 1 --2- 172.21.15.177:0/209529472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f440c158ca0 0x7f440c15eb50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.783+0000 7f4411409640 1 -- 172.21.15.177:0/209529472 >> 172.21.15.177:0/209529472 conn(0x7f440c0b0cc0 msgr2=0x7f440c0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:23.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.783+0000 7f4411409640 1 -- 172.21.15.177:0/209529472 shutdown_connections 2023-11-28T20:08:23.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.783+0000 7f4411409640 1 -- 172.21.15.177:0/209529472 wait complete. 2023-11-28T20:08:23.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f4411409640 1 Processor -- start 2023-11-28T20:08:23.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f4411409640 1 -- start start 2023-11-28T20:08:23.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f4411409640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f440c0b42d0 0x7f440c156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f4411409640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f440c0cba10 0x7f440c15d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f4411409640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f440c158ca0 0x7f440c1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f4411409640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c157400 con 0x7f440c0b42d0 2023-11-28T20:08:23.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f4411409640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c1576e0 con 0x7f440c0cba10 2023-11-28T20:08:23.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f4411409640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440c1579c0 con 0x7f440c158ca0 2023-11-28T20:08:23.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f440affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f440c0b42d0 0x7f440c156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f440affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f440c0b42d0 0x7f440c156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53258/0 (socket says 172.21.15.177:53258) 2023-11-28T20:08:23.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f440affd640 1 -- 172.21.15.177:0/1382683063 learned_addr learned my addr 172.21.15.177:0/1382683063 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:23.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f440a7fc640 1 --2- 172.21.15.177:0/1382683063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f440c0cba10 0x7f440c15d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f440b7fe640 1 --2- 172.21.15.177:0/1382683063 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f440c158ca0 0x7f440c1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f440affd640 1 -- 172.21.15.177:0/1382683063 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f440c158ca0 msgr2=0x7f440c1545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f440affd640 1 --2- 172.21.15.177:0/1382683063 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f440c158ca0 0x7f440c1545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f440affd640 1 -- 172.21.15.177:0/1382683063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f440c0cba10 msgr2=0x7f440c15d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f440affd640 1 --2- 172.21.15.177:0/1382683063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f440c0cba10 0x7f440c15d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f440affd640 1 -- 172.21.15.177:0/1382683063 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc0094d0 con 0x7f440c0b42d0 2023-11-28T20:08:23.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f440affd640 1 --2- 172.21.15.177:0/1382683063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f440c0b42d0 0x7f440c156b20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f43fc01ab80 tx=0x7f43fc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:23.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f43f37fe640 1 -- 172.21.15.177:0/1382683063 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc0bd5f0 con 0x7f440c0b42d0 2023-11-28T20:08:23.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f43f37fe640 1 -- 172.21.15.177:0/1382683063 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43fc0bd750 con 0x7f440c0b42d0 2023-11-28T20:08:23.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f43f37fe640 1 -- 172.21.15.177:0/1382683063 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc0bdb00 con 0x7f440c0b42d0 2023-11-28T20:08:23.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f4411409640 1 -- 172.21.15.177:0/1382683063 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440c157ca0 con 0x7f440c0b42d0 2023-11-28T20:08:23.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f4411409640 1 -- 172.21.15.177:0/1382683063 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440c15de30 con 0x7f440c0b42d0 2023-11-28T20:08:23.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.787+0000 7f4411409640 1 -- 172.21.15.177:0/1382683063 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f440c15e020 con 0x7f440c0b42d0 2023-11-28T20:08:23.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.791+0000 7f43f37fe640 1 -- 172.21.15.177:0/1382683063 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f43fc0b33f0 con 0x7f440c0b42d0 2023-11-28T20:08:23.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.791+0000 7f43f37fe640 1 --2- 172.21.15.177:0/1382683063 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f43f8066470 0x7f43f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:23.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.791+0000 7f43f37fe640 1 -- 172.21.15.177:0/1382683063 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f43fc11ea10 con 0x7f440c0b42d0 2023-11-28T20:08:23.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.791+0000 7f440a7fc640 1 --2- 172.21.15.177:0/1382683063 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f43f8066470 0x7f43f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:23.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.791+0000 7f440a7fc640 1 --2- 172.21.15.177:0/1382683063 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f43f8066470 0x7f43f8068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f440c0cd590 tx=0x7f4400008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:23.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.795+0000 7f43f37fe640 1 -- 172.21.15.177:0/1382683063 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f440c15e020 con 0x7f440c0b42d0 2023-11-28T20:08:23.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.943+0000 7f4411409640 1 -- 172.21.15.177:0/1382683063 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f440c15e020 con 0x7f440c0b42d0 2023-11-28T20:08:23.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.947+0000 7f43f37fe640 1 -- 172.21.15.177:0/1382683063 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f440c15e020 con 0x7f440c0b42d0 2023-11-28T20:08:23.951 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:23.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.947+0000 7f4411409640 1 -- 172.21.15.177:0/1382683063 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f43f8066470 msgr2=0x7f43f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.947+0000 7f4411409640 1 --2- 172.21.15.177:0/1382683063 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f43f8066470 0x7f43f8068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f440c0cd590 tx=0x7f4400008040 comp rx=0 tx=0).stop 2023-11-28T20:08:23.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.947+0000 7f4411409640 1 -- 172.21.15.177:0/1382683063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f440c0b42d0 msgr2=0x7f440c156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:23.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.947+0000 7f4411409640 1 --2- 172.21.15.177:0/1382683063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f440c0b42d0 0x7f440c156b20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f43fc01ab80 tx=0x7f43fc01ad10 comp rx=0 tx=0).stop 2023-11-28T20:08:23.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.947+0000 7f4411409640 1 -- 172.21.15.177:0/1382683063 shutdown_connections 2023-11-28T20:08:23.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.947+0000 7f4411409640 1 --2- 172.21.15.177:0/1382683063 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f43f8066470 0x7f43f8068930 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.947+0000 7f4411409640 1 --2- 172.21.15.177:0/1382683063 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f440c158ca0 0x7f440c1545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.947+0000 7f4411409640 1 --2- 172.21.15.177:0/1382683063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f440c0cba10 0x7f440c15d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.947+0000 7f4411409640 1 --2- 172.21.15.177:0/1382683063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f440c0b42d0 0x7f440c156b20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:23.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.947+0000 7f4411409640 1 -- 172.21.15.177:0/1382683063 >> 172.21.15.177:0/1382683063 conn(0x7f440c0b0cc0 msgr2=0x7f440c0b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:23.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.947+0000 7f4411409640 1 -- 172.21.15.177:0/1382683063 shutdown_connections 2023-11-28T20:08:23.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:23.947+0000 7f4411409640 1 -- 172.21.15.177:0/1382683063 wait complete. 2023-11-28T20:08:23.972 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:08:24.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9b1aea640 1 Processor -- start 2023-11-28T20:08:24.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9b1aea640 1 -- start start 2023-11-28T20:08:24.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9b1aea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9ac13cf30 0x7fa9ac06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9b1aea640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa9ac15ad40 0x7fa9ac0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9b1aea640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9ac15b3a0 con 0x7fa9ac06c800 2023-11-28T20:08:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9b1aea640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9ac13d310 con 0x7fa9ac15ad40 2023-11-28T20:08:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9b1aea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ac15b1b0 con 0x7fa9ac13cf30 2023-11-28T20:08:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9abfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa9ac15ad40 0x7fa9ac0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9abfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa9ac15ad40 0x7fa9ac0cd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53260/0 (socket says 172.21.15.177:53260) 2023-11-28T20:08:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9abfff640 1 -- 172.21.15.177:0/903320012 learned_addr learned my addr 172.21.15.177:0/903320012 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9aaffd640 1 --1- 172.21.15.177:0/903320012 >> v1:172.21.15.177:6789/0 conn(0x7fa9ac06c800 0x7fa9ac15a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45264/0 (socket says 172.21.15.177:45264) 2023-11-28T20:08:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9ab7fe640 1 --2- 172.21.15.177:0/903320012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9ac13cf30 0x7fa9ac06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9abfff640 1 -- 172.21.15.177:0/903320012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9ac13cf30 msgr2=0x7fa9ac06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9abfff640 1 --2- 172.21.15.177:0/903320012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9ac13cf30 0x7fa9ac06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9abfff640 1 -- 172.21.15.177:0/903320012 >> v1:172.21.15.177:6789/0 conn(0x7fa9ac06c800 legacy=0x7fa9ac15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9abfff640 1 -- 172.21.15.177:0/903320012 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ac06cc40 con 0x7fa9ac15ad40 2023-11-28T20:08:24.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.107+0000 7fa9ab7fe640 1 --2- 172.21.15.177:0/903320012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9ac13cf30 0x7fa9ac06c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:24.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.111+0000 7fa9abfff640 1 --2- 172.21.15.177:0/903320012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9ac15ad40 0x7fa9ac0cd880 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4009e50 tx=0x7fa9a401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f94e59e128b3fd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:24.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.111+0000 7fa9aa7fc640 1 -- 172.21.15.177:0/903320012 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40a5730 con 0x7fa9ac15ad40 2023-11-28T20:08:24.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.111+0000 7fa9aa7fc640 1 -- 172.21.15.177:0/903320012 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a40a5890 con 0x7fa9ac15ad40 2023-11-28T20:08:24.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.111+0000 7fa9aa7fc640 1 -- 172.21.15.177:0/903320012 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40a5c20 con 0x7fa9ac15ad40 2023-11-28T20:08:24.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.111+0000 7fa9b1aea640 1 -- 172.21.15.177:0/903320012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9ac15ad40 msgr2=0x7fa9ac0cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.111+0000 7fa9b1aea640 1 --2- 172.21.15.177:0/903320012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9ac15ad40 0x7fa9ac0cd880 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4009e50 tx=0x7fa9a401c980 comp rx=0 tx=0).stop 2023-11-28T20:08:24.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.111+0000 7fa9b1aea640 1 -- 172.21.15.177:0/903320012 shutdown_connections 2023-11-28T20:08:24.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.111+0000 7fa9b1aea640 1 --2- 172.21.15.177:0/903320012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9ac15ad40 0x7fa9ac0cd880 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.111+0000 7fa9b1aea640 1 --2- 172.21.15.177:0/903320012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9ac13cf30 0x7fa9ac06c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.111+0000 7fa9b1aea640 1 -- 172.21.15.177:0/903320012 >> 172.21.15.177:0/903320012 conn(0x7fa9ac06a530 msgr2=0x7fa9ac06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:24.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.111+0000 7fa9b1aea640 1 -- 172.21.15.177:0/903320012 shutdown_connections 2023-11-28T20:08:24.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.111+0000 7fa9b1aea640 1 -- 172.21.15.177:0/903320012 wait complete. 2023-11-28T20:08:24.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.111+0000 7fa9b1aea640 1 Processor -- start 2023-11-28T20:08:24.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9b1aea640 1 -- start start 2023-11-28T20:08:24.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9b1aea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9ac06c800 0x7fa9ac14be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9b1aea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9ac13cf30 0x7fa9ac146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9b1aea640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9ac15ad40 0x7fa9ac167740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9b1aea640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ac13b6c0 con 0x7fa9ac06c800 2023-11-28T20:08:24.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9b1aea640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ac147460 con 0x7fa9ac15ad40 2023-11-28T20:08:24.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9b1aea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ac14c6e0 con 0x7fa9ac13cf30 2023-11-28T20:08:24.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9ab7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9ac06c800 0x7fa9ac14be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9ab7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9ac06c800 0x7fa9ac14be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53264/0 (socket says 172.21.15.177:53264) 2023-11-28T20:08:24.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9ab7fe640 1 -- 172.21.15.177:0/3994327012 learned_addr learned my addr 172.21.15.177:0/3994327012 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:24.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9aaffd640 1 --2- 172.21.15.177:0/3994327012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9ac13cf30 0x7fa9ac146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9abfff640 1 --2- 172.21.15.177:0/3994327012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9ac15ad40 0x7fa9ac167740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9ab7fe640 1 -- 172.21.15.177:0/3994327012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9ac13cf30 msgr2=0x7fa9ac146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9ab7fe640 1 --2- 172.21.15.177:0/3994327012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9ac13cf30 0x7fa9ac146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9ab7fe640 1 -- 172.21.15.177:0/3994327012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9ac15ad40 msgr2=0x7fa9ac167740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9ab7fe640 1 --2- 172.21.15.177:0/3994327012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9ac15ad40 0x7fa9ac167740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9ab7fe640 1 -- 172.21.15.177:0/3994327012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a4009b30 con 0x7fa9ac06c800 2023-11-28T20:08:24.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9abfff640 1 --2- 172.21.15.177:0/3994327012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9ac15ad40 0x7fa9ac167740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:24.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9ab7fe640 1 --2- 172.21.15.177:0/3994327012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9ac06c800 0x7fa9ac14be00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00c7c0 tx=0x7fa99c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:24.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa993fff640 1 -- 172.21.15.177:0/3994327012 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c007a30 con 0x7fa9ac06c800 2023-11-28T20:08:24.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa993fff640 1 -- 172.21.15.177:0/3994327012 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99c007b90 con 0x7fa9ac06c800 2023-11-28T20:08:24.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9b1aea640 1 -- 172.21.15.177:0/3994327012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9ac14c400 con 0x7fa9ac06c800 2023-11-28T20:08:24.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa993fff640 1 -- 172.21.15.177:0/3994327012 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c00ce70 con 0x7fa9ac06c800 2023-11-28T20:08:24.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9b1aea640 1 -- 172.21.15.177:0/3994327012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ac13b350 con 0x7fa9ac06c800 2023-11-28T20:08:24.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.115+0000 7fa9b1aea640 1 -- 172.21.15.177:0/3994327012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ac073d60 con 0x7fa9ac06c800 2023-11-28T20:08:24.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.119+0000 7fa993fff640 1 -- 172.21.15.177:0/3994327012 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa99c0113f0 con 0x7fa9ac06c800 2023-11-28T20:08:24.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.119+0000 7fa993fff640 1 --2- 172.21.15.177:0/3994327012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa9980664a0 0x7fa998068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.119+0000 7fa993fff640 1 -- 172.21.15.177:0/3994327012 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fa99c084440 con 0x7fa9ac06c800 2023-11-28T20:08:24.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.119+0000 7fa9aaffd640 1 --2- 172.21.15.177:0/3994327012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa9980664a0 0x7fa998068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.119+0000 7fa9aaffd640 1 --2- 172.21.15.177:0/3994327012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa9980664a0 0x7fa998068960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac0b3ce0 tx=0x7fa9a0007cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:24.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.123+0000 7fa993fff640 1 -- 172.21.15.177:0/3994327012 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa99c051780 con 0x7fa9ac06c800 2023-11-28T20:08:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.283+0000 7fa9b1aea640 1 -- 172.21.15.177:0/3994327012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa9ac06d1e0 con 0x7fa9ac06c800 2023-11-28T20:08:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.283+0000 7fa993fff640 1 -- 172.21.15.177:0/3994327012 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa99c054da0 con 0x7fa9ac06c800 2023-11-28T20:08:24.289 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:08:24.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.287+0000 7fa9b1aea640 1 -- 172.21.15.177:0/3994327012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa9980664a0 msgr2=0x7fa998068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.287+0000 7fa9b1aea640 1 --2- 172.21.15.177:0/3994327012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa9980664a0 0x7fa998068960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac0b3ce0 tx=0x7fa9a0007cb0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.287+0000 7fa9b1aea640 1 -- 172.21.15.177:0/3994327012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9ac06c800 msgr2=0x7fa9ac14be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.287+0000 7fa9b1aea640 1 --2- 172.21.15.177:0/3994327012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9ac06c800 0x7fa9ac14be00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00c7c0 tx=0x7fa99c00cc80 comp rx=0 tx=0).stop 2023-11-28T20:08:24.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.287+0000 7fa9b1aea640 1 -- 172.21.15.177:0/3994327012 shutdown_connections 2023-11-28T20:08:24.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.287+0000 7fa9b1aea640 1 --2- 172.21.15.177:0/3994327012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa9980664a0 0x7fa998068960 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.287+0000 7fa9b1aea640 1 --2- 172.21.15.177:0/3994327012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9ac15ad40 0x7fa9ac167740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.287+0000 7fa9b1aea640 1 --2- 172.21.15.177:0/3994327012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9ac13cf30 0x7fa9ac146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.287+0000 7fa9b1aea640 1 --2- 172.21.15.177:0/3994327012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9ac06c800 0x7fa9ac14be00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.287+0000 7fa9b1aea640 1 -- 172.21.15.177:0/3994327012 >> 172.21.15.177:0/3994327012 conn(0x7fa9ac06a530 msgr2=0x7fa9ac15b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:24.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.287+0000 7fa9b1aea640 1 -- 172.21.15.177:0/3994327012 shutdown_connections 2023-11-28T20:08:24.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.287+0000 7fa9b1aea640 1 -- 172.21.15.177:0/3994327012 wait complete. 2023-11-28T20:08:24.310 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:08:24.311 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:08:24.322 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:24.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.455+0000 7fa8850c9640 1 Processor -- start 2023-11-28T20:08:24.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.455+0000 7fa8850c9640 1 -- start start 2023-11-28T20:08:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.455+0000 7fa8850c9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa88006c9d0 0x7fa88015a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.455+0000 7fa8850c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa88015ab70 0x7fa8800cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.459+0000 7fa8850c9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88015b3a0 con 0x7fa88013cf30 2023-11-28T20:08:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.459+0000 7fa8850c9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88013d310 con 0x7fa88006c9d0 2023-11-28T20:08:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.459+0000 7fa8850c9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8801404e0 con 0x7fa88015ab70 2023-11-28T20:08:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.459+0000 7fa87e59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa88006c9d0 0x7fa88015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.459+0000 7fa87e59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa88006c9d0 0x7fa88015a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53280/0 (socket says 172.21.15.177:53280) 2023-11-28T20:08:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.459+0000 7fa87e59c640 1 -- 172.21.15.177:0/3015426051 learned_addr learned my addr 172.21.15.177:0/3015426051 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.459+0000 7fa87f59e640 1 --2- 172.21.15.177:0/3015426051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa88015ab70 0x7fa8800cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.459+0000 7fa87e59c640 1 -- 172.21.15.177:0/3015426051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa88015ab70 msgr2=0x7fa8800cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:24.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.459+0000 7fa87e59c640 1 --2- 172.21.15.177:0/3015426051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa88015ab70 0x7fa8800cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.459+0000 7fa87e59c640 1 -- 172.21.15.177:0/3015426051 >> v1:172.21.15.195:6789/0 conn(0x7fa88013cf30 legacy=0x7fa88006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.459+0000 7fa87e59c640 1 -- 172.21.15.177:0/3015426051 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88013f720 con 0x7fa88006c9d0 2023-11-28T20:08:24.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.459+0000 7fa87e59c640 1 --2- 172.21.15.177:0/3015426051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88006c9d0 0x7fa88015a630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa8740098a0 tx=0x7fa87401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f2000157f7dfd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:24.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.459+0000 7fa87dd9b640 1 -- 172.21.15.177:0/3015426051 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740ab660 con 0x7fa88006c9d0 2023-11-28T20:08:24.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.459+0000 7fa87dd9b640 1 -- 172.21.15.177:0/3015426051 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8740ab7c0 con 0x7fa88006c9d0 2023-11-28T20:08:24.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.459+0000 7fa87dd9b640 1 -- 172.21.15.177:0/3015426051 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740abb50 con 0x7fa88006c9d0 2023-11-28T20:08:24.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 -- 172.21.15.177:0/3015426051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88006c9d0 msgr2=0x7fa88015a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 --2- 172.21.15.177:0/3015426051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88006c9d0 0x7fa88015a630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa8740098a0 tx=0x7fa87401c460 comp rx=0 tx=0).stop 2023-11-28T20:08:24.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 -- 172.21.15.177:0/3015426051 shutdown_connections 2023-11-28T20:08:24.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 --2- 172.21.15.177:0/3015426051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa88015ab70 0x7fa8800cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 --2- 172.21.15.177:0/3015426051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88006c9d0 0x7fa88015a630 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 -- 172.21.15.177:0/3015426051 >> 172.21.15.177:0/3015426051 conn(0x7fa88006a530 msgr2=0x7fa88006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:24.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 -- 172.21.15.177:0/3015426051 shutdown_connections 2023-11-28T20:08:24.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 -- 172.21.15.177:0/3015426051 wait complete. 2023-11-28T20:08:24.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 Processor -- start 2023-11-28T20:08:24.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 -- start start 2023-11-28T20:08:24.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88006c9d0 0x7fa8800cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa88013cf30 0x7fa8801362d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa88015ab70 0x7fa880135c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88014d0c0 con 0x7fa88006c9d0 2023-11-28T20:08:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88014b2e0 con 0x7fa88015ab70 2023-11-28T20:08:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa8850c9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88014b5c0 con 0x7fa88013cf30 2023-11-28T20:08:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa87ed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88006c9d0 0x7fa8800cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa87ed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88006c9d0 0x7fa8800cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53294/0 (socket says 172.21.15.177:53294) 2023-11-28T20:08:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa87ed9d640 1 -- 172.21.15.177:0/1094128225 learned_addr learned my addr 172.21.15.177:0/1094128225 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.463+0000 7fa87e59c640 1 --2- 172.21.15.177:0/1094128225 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa88013cf30 0x7fa8801362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa87f59e640 1 --2- 172.21.15.177:0/1094128225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa88015ab70 0x7fa880135c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa87ed9d640 1 -- 172.21.15.177:0/1094128225 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa88013cf30 msgr2=0x7fa8801362d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa87ed9d640 1 --2- 172.21.15.177:0/1094128225 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa88013cf30 0x7fa8801362d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa87ed9d640 1 -- 172.21.15.177:0/1094128225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa88015ab70 msgr2=0x7fa880135c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa87ed9d640 1 --2- 172.21.15.177:0/1094128225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa88015ab70 0x7fa880135c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa87ed9d640 1 -- 172.21.15.177:0/1094128225 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8740094d0 con 0x7fa88006c9d0 2023-11-28T20:08:24.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa87ed9d640 1 --2- 172.21.15.177:0/1094128225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88006c9d0 0x7fa8800cc1c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa87000c500 tx=0x7fa87000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:24.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa8677fe640 1 -- 172.21.15.177:0/1094128225 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870005220 con 0x7fa88006c9d0 2023-11-28T20:08:24.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa8677fe640 1 -- 172.21.15.177:0/1094128225 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa870005380 con 0x7fa88006c9d0 2023-11-28T20:08:24.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa8677fe640 1 -- 172.21.15.177:0/1094128225 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870007270 con 0x7fa88006c9d0 2023-11-28T20:08:24.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa8850c9640 1 -- 172.21.15.177:0/1094128225 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa880136ab0 con 0x7fa88006c9d0 2023-11-28T20:08:24.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa8850c9640 1 -- 172.21.15.177:0/1094128225 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa880138000 con 0x7fa88006c9d0 2023-11-28T20:08:24.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa8850c9640 1 -- 172.21.15.177:0/1094128225 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88014b120 con 0x7fa88006c9d0 2023-11-28T20:08:24.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa8677fe640 1 -- 172.21.15.177:0/1094128225 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8700073d0 con 0x7fa88006c9d0 2023-11-28T20:08:24.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa8677fe640 1 --2- 172.21.15.177:0/1094128225 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa86c066470 0x7fa86c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa8677fe640 1 -- 172.21.15.177:0/1094128225 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fa870083760 con 0x7fa88006c9d0 2023-11-28T20:08:24.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.467+0000 7fa87e59c640 1 --2- 172.21.15.177:0/1094128225 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa86c066470 0x7fa86c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.471+0000 7fa87e59c640 1 --2- 172.21.15.177:0/1094128225 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa86c066470 0x7fa86c068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa8740af000 tx=0x7fa8740b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:24.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.471+0000 7fa8677fe640 1 -- 172.21.15.177:0/1094128225 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa870050b70 con 0x7fa88006c9d0 2023-11-28T20:08:24.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.623+0000 7fa8850c9640 1 -- 172.21.15.177:0/1094128225 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa880069440 con 0x7fa88006c9d0 2023-11-28T20:08:24.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.623+0000 7fa8677fe640 1 -- 172.21.15.177:0/1094128225 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16861 (secure 0 0 0) 0x7fa870054190 con 0x7fa88006c9d0 2023-11-28T20:08:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:24.630 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":22,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:23.248475+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:24.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.627+0000 7fa8850c9640 1 -- 172.21.15.177:0/1094128225 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa86c066470 msgr2=0x7fa86c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.627+0000 7fa8850c9640 1 --2- 172.21.15.177:0/1094128225 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa86c066470 0x7fa86c068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa8740af000 tx=0x7fa8740b6040 comp rx=0 tx=0).stop 2023-11-28T20:08:24.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.627+0000 7fa8850c9640 1 -- 172.21.15.177:0/1094128225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88006c9d0 msgr2=0x7fa8800cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.627+0000 7fa8850c9640 1 --2- 172.21.15.177:0/1094128225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88006c9d0 0x7fa8800cc1c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa87000c500 tx=0x7fa87000c9c0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.627+0000 7fa8850c9640 1 -- 172.21.15.177:0/1094128225 shutdown_connections 2023-11-28T20:08:24.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.627+0000 7fa8850c9640 1 --2- 172.21.15.177:0/1094128225 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa86c066470 0x7fa86c068930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.627+0000 7fa8850c9640 1 --2- 172.21.15.177:0/1094128225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa88015ab70 0x7fa880135c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.627+0000 7fa8850c9640 1 --2- 172.21.15.177:0/1094128225 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa88013cf30 0x7fa8801362d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.627+0000 7fa8850c9640 1 --2- 172.21.15.177:0/1094128225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88006c9d0 0x7fa8800cc1c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.627+0000 7fa8850c9640 1 -- 172.21.15.177:0/1094128225 >> 172.21.15.177:0/1094128225 conn(0x7fa88006a530 msgr2=0x7fa8800b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:24.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.627+0000 7fa8850c9640 1 -- 172.21.15.177:0/1094128225 shutdown_connections 2023-11-28T20:08:24.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.627+0000 7fa8850c9640 1 -- 172.21.15.177:0/1094128225 wait complete. 2023-11-28T20:08:24.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:24.653 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:24.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.787+0000 7f27ff7f5640 1 Processor -- start 2023-11-28T20:08:24.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.787+0000 7f27ff7f5640 1 -- start start 2023-11-28T20:08:24.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.787+0000 7f27ff7f5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f27f814b1e0 0x7f27f80b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.787+0000 7f27ff7f5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27f80b4350 0x7f27f80703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.787+0000 7f27ff7f5640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f80b1fc0 con 0x7f27f814abe0 2023-11-28T20:08:24.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.787+0000 7f27ff7f5640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f8166130 con 0x7f27f814b1e0 2023-11-28T20:08:24.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.787+0000 7f27ff7f5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80b47c0 con 0x7f27f80b4350 2023-11-28T20:08:24.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.791+0000 7f27fcd90640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f27f814b1e0 0x7f27f80b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.791+0000 7f27fdd92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27f80b4350 0x7f27f80703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.791+0000 7f27fcd90640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f27f814b1e0 0x7f27f80b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:47848/0 (socket says 172.21.15.177:47848) 2023-11-28T20:08:24.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.791+0000 7f27fcd90640 1 -- 172.21.15.177:0/132902946 learned_addr learned my addr 172.21.15.177:0/132902946 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:24.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.791+0000 7f27fcd90640 1 -- 172.21.15.177:0/132902946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27f80b4350 msgr2=0x7f27f80703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:24.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.791+0000 7f27fcd90640 1 --2- 172.21.15.177:0/132902946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27f80b4350 0x7f27f80703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.791+0000 7f27fcd90640 1 -- 172.21.15.177:0/132902946 >> v1:172.21.15.195:6789/0 conn(0x7f27f814abe0 legacy=0x7f27f8165a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.791+0000 7f27fcd90640 1 -- 172.21.15.177:0/132902946 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f80b2260 con 0x7f27f814b1e0 2023-11-28T20:08:24.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.791+0000 7f27fcd90640 1 --2- 172.21.15.177:0/132902946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27f814b1e0 0x7f27f80b3e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f27e80098a0 tx=0x7f27e801c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=638c4d6292297454 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:24.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.791+0000 7f27effff640 1 -- 172.21.15.177:0/132902946 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80aa650 con 0x7f27f814b1e0 2023-11-28T20:08:24.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.791+0000 7f27effff640 1 -- 172.21.15.177:0/132902946 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e80aa7b0 con 0x7f27f814b1e0 2023-11-28T20:08:24.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.791+0000 7f27effff640 1 -- 172.21.15.177:0/132902946 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80aab40 con 0x7f27f814b1e0 2023-11-28T20:08:24.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 -- 172.21.15.177:0/132902946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27f814b1e0 msgr2=0x7f27f80b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 --2- 172.21.15.177:0/132902946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27f814b1e0 0x7f27f80b3e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f27e80098a0 tx=0x7f27e801c4f0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 -- 172.21.15.177:0/132902946 shutdown_connections 2023-11-28T20:08:24.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 --2- 172.21.15.177:0/132902946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27f80b4350 0x7f27f80703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 --2- 172.21.15.177:0/132902946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27f814b1e0 0x7f27f80b3e10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 -- 172.21.15.177:0/132902946 >> 172.21.15.177:0/132902946 conn(0x7f27f80b0cc0 msgr2=0x7f27f80b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:24.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 -- 172.21.15.177:0/132902946 shutdown_connections 2023-11-28T20:08:24.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 -- 172.21.15.177:0/132902946 wait complete. 2023-11-28T20:08:24.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 Processor -- start 2023-11-28T20:08:24.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 -- start start 2023-11-28T20:08:24.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27f80b4350 0x7f27f8166ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27f814abe0 0x7f27f815eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f8163250 0x7f27f815f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f8163aa0 con 0x7f27f8163250 2023-11-28T20:08:24.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f8148610 con 0x7f27f80b4350 2023-11-28T20:08:24.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27ff7f5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f81637c0 con 0x7f27f814abe0 2023-11-28T20:08:24.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27fdd92640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f8163250 0x7f27f815f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27fdd92640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f8163250 0x7f27f815f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53296/0 (socket says 172.21.15.177:53296) 2023-11-28T20:08:24.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.795+0000 7f27fdd92640 1 -- 172.21.15.177:0/2550685050 learned_addr learned my addr 172.21.15.177:0/2550685050 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:24.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27fd591640 1 --2- 172.21.15.177:0/2550685050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27f80b4350 0x7f27f8166ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27fcd90640 1 --2- 172.21.15.177:0/2550685050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27f814abe0 0x7f27f815eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27fdd92640 1 -- 172.21.15.177:0/2550685050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27f814abe0 msgr2=0x7f27f815eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27fdd92640 1 --2- 172.21.15.177:0/2550685050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27f814abe0 0x7f27f815eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27fdd92640 1 -- 172.21.15.177:0/2550685050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27f80b4350 msgr2=0x7f27f8166ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27fdd92640 1 --2- 172.21.15.177:0/2550685050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27f80b4350 0x7f27f8166ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27fdd92640 1 -- 172.21.15.177:0/2550685050 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80094d0 con 0x7f27f8163250 2023-11-28T20:08:24.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27fcd90640 1 --2- 172.21.15.177:0/2550685050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27f814abe0 0x7f27f815eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:24.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27fdd92640 1 --2- 172.21.15.177:0/2550685050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f8163250 0x7f27f815f400 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f27f000efc0 tx=0x7f27f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:24.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27edffb640 1 -- 172.21.15.177:0/2550685050 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000ced0 con 0x7f27f8163250 2023-11-28T20:08:24.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27edffb640 1 -- 172.21.15.177:0/2550685050 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f000f040 con 0x7f27f8163250 2023-11-28T20:08:24.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27edffb640 1 -- 172.21.15.177:0/2550685050 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00146c0 con 0x7f27f8163250 2023-11-28T20:08:24.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27ff7f5640 1 -- 172.21.15.177:0/2550685050 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f8147fc0 con 0x7f27f8163250 2023-11-28T20:08:24.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27ff7f5640 1 -- 172.21.15.177:0/2550685050 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f8160c20 con 0x7f27f8163250 2023-11-28T20:08:24.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27ff7f5640 1 -- 172.21.15.177:0/2550685050 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f80693d0 con 0x7f27f8163250 2023-11-28T20:08:24.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.799+0000 7f27edffb640 1 -- 172.21.15.177:0/2550685050 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27f0014820 con 0x7f27f8163250 2023-11-28T20:08:24.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.803+0000 7f27edffb640 1 --2- 172.21.15.177:0/2550685050 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f27dc066470 0x7f27dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:24.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.803+0000 7f27edffb640 1 -- 172.21.15.177:0/2550685050 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f27f00849f0 con 0x7f27f8163250 2023-11-28T20:08:24.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.803+0000 7f27fd591640 1 --2- 172.21.15.177:0/2550685050 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f27dc066470 0x7f27dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:24.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.803+0000 7f27fd591640 1 --2- 172.21.15.177:0/2550685050 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f27dc066470 0x7f27dc068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f27f4000f70 tx=0x7f27f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:24.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.803+0000 7f27edffb640 1 -- 172.21.15.177:0/2550685050 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27f0051e70 con 0x7f27f8163250 2023-11-28T20:08:24.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.955+0000 7f27ff7f5640 1 -- 172.21.15.177:0/2550685050 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27f8148750 con 0x7f27f8163250 2023-11-28T20:08:24.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.955+0000 7f27edffb640 1 -- 172.21.15.177:0/2550685050 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27f0018020 con 0x7f27f8163250 2023-11-28T20:08:24.962 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.959+0000 7f27ff7f5640 1 -- 172.21.15.177:0/2550685050 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f27dc066470 msgr2=0x7f27dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.959+0000 7f27ff7f5640 1 --2- 172.21.15.177:0/2550685050 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f27dc066470 0x7f27dc068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f27f4000f70 tx=0x7f27f4009040 comp rx=0 tx=0).stop 2023-11-28T20:08:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.959+0000 7f27ff7f5640 1 -- 172.21.15.177:0/2550685050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f8163250 msgr2=0x7f27f815f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.959+0000 7f27ff7f5640 1 --2- 172.21.15.177:0/2550685050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f8163250 0x7f27f815f400 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f27f000efc0 tx=0x7f27f000c490 comp rx=0 tx=0).stop 2023-11-28T20:08:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.959+0000 7f27ff7f5640 1 -- 172.21.15.177:0/2550685050 shutdown_connections 2023-11-28T20:08:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.959+0000 7f27ff7f5640 1 --2- 172.21.15.177:0/2550685050 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f27dc066470 0x7f27dc068930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.959+0000 7f27ff7f5640 1 --2- 172.21.15.177:0/2550685050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f8163250 0x7f27f815f400 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.959+0000 7f27ff7f5640 1 --2- 172.21.15.177:0/2550685050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27f814abe0 0x7f27f815eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.959+0000 7f27ff7f5640 1 --2- 172.21.15.177:0/2550685050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27f80b4350 0x7f27f8166ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:24.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.959+0000 7f27ff7f5640 1 -- 172.21.15.177:0/2550685050 >> 172.21.15.177:0/2550685050 conn(0x7f27f80b0cc0 msgr2=0x7f27f80afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:24.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.959+0000 7f27ff7f5640 1 -- 172.21.15.177:0/2550685050 shutdown_connections 2023-11-28T20:08:24.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:24.959+0000 7f27ff7f5640 1 -- 172.21.15.177:0/2550685050 wait complete. 2023-11-28T20:08:24.986 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:25.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.123+0000 7fe2b870f640 1 Processor -- start 2023-11-28T20:08:25.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.123+0000 7fe2b870f640 1 -- start start 2023-11-28T20:08:25.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.123+0000 7fe2b870f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2b00cba10 0x7fe2b015be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.123+0000 7fe2b870f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe2b00b42d0 0x7fe2b00b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.123+0000 7fe2b870f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b00b4c40 con 0x7fe2b0158ca0 2023-11-28T20:08:25.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.123+0000 7fe2b870f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b015b670 con 0x7fe2b00b42d0 2023-11-28T20:08:25.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.123+0000 7fe2b870f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b015f410 con 0x7fe2b00cba10 2023-11-28T20:08:25.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.123+0000 7fe2b6cac640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe2b00b42d0 0x7fe2b00b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.123+0000 7fe2b6cac640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe2b00b42d0 0x7fe2b00b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53302/0 (socket says 172.21.15.177:53302) 2023-11-28T20:08:25.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.123+0000 7fe2b6cac640 1 -- 172.21.15.177:0/3960576005 learned_addr learned my addr 172.21.15.177:0/3960576005 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:25.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.123+0000 7fe2b5caa640 1 --2- 172.21.15.177:0/3960576005 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2b00cba10 0x7fe2b015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.123+0000 7fe2b6cac640 1 -- 172.21.15.177:0/3960576005 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2b00cba10 msgr2=0x7fe2b015be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:25.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.123+0000 7fe2b6cac640 1 --2- 172.21.15.177:0/3960576005 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2b00cba10 0x7fe2b015be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.123+0000 7fe2b6cac640 1 -- 172.21.15.177:0/3960576005 >> v1:172.21.15.195:6789/0 conn(0x7fe2b0158ca0 legacy=0x7fe2b015eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.123+0000 7fe2b6cac640 1 -- 172.21.15.177:0/3960576005 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b015f6f0 con 0x7fe2b00b42d0 2023-11-28T20:08:25.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.127+0000 7fe2b6cac640 1 --2- 172.21.15.177:0/3960576005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b00b42d0 0x7fe2b00b4700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009e50 tx=0x7fe2a801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9df0f12bf4a1f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:25.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.127+0000 7fe2b54a9640 1 -- 172.21.15.177:0/3960576005 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80a57f0 con 0x7fe2b00b42d0 2023-11-28T20:08:25.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.127+0000 7fe2b54a9640 1 -- 172.21.15.177:0/3960576005 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a80a5950 con 0x7fe2b00b42d0 2023-11-28T20:08:25.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.127+0000 7fe2b54a9640 1 -- 172.21.15.177:0/3960576005 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80a5ce0 con 0x7fe2b00b42d0 2023-11-28T20:08:25.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.127+0000 7fe2b870f640 1 -- 172.21.15.177:0/3960576005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b00b42d0 msgr2=0x7fe2b00b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.127+0000 7fe2b870f640 1 --2- 172.21.15.177:0/3960576005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b00b42d0 0x7fe2b00b4700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009e50 tx=0x7fe2a801ca10 comp rx=0 tx=0).stop 2023-11-28T20:08:25.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.127+0000 7fe2b870f640 1 -- 172.21.15.177:0/3960576005 shutdown_connections 2023-11-28T20:08:25.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.127+0000 7fe2b870f640 1 --2- 172.21.15.177:0/3960576005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b00b42d0 0x7fe2b00b4700 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.127+0000 7fe2b870f640 1 --2- 172.21.15.177:0/3960576005 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2b00cba10 0x7fe2b015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.127+0000 7fe2b870f640 1 -- 172.21.15.177:0/3960576005 >> 172.21.15.177:0/3960576005 conn(0x7fe2b00b0cc0 msgr2=0x7fe2b00b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:25.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.127+0000 7fe2b870f640 1 -- 172.21.15.177:0/3960576005 shutdown_connections 2023-11-28T20:08:25.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.127+0000 7fe2b870f640 1 -- 172.21.15.177:0/3960576005 wait complete. 2023-11-28T20:08:25.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.127+0000 7fe2b870f640 1 Processor -- start 2023-11-28T20:08:25.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b870f640 1 -- start start 2023-11-28T20:08:25.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b870f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2b00b42d0 0x7fe2b00b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b870f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2b00cba10 0x7fe2b0153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b870f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b0158ca0 0x7fe2b0157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b870f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b01f6320 con 0x7fe2b0158ca0 2023-11-28T20:08:25.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b870f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b0154190 con 0x7fe2b00b42d0 2023-11-28T20:08:25.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b870f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b0154410 con 0x7fe2b00cba10 2023-11-28T20:08:25.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b6cac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b0158ca0 0x7fe2b0157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b6cac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b0158ca0 0x7fe2b0157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53318/0 (socket says 172.21.15.177:53318) 2023-11-28T20:08:25.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b6cac640 1 -- 172.21.15.177:0/52149468 learned_addr learned my addr 172.21.15.177:0/52149468 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:25.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b64ab640 1 --2- 172.21.15.177:0/52149468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2b00b42d0 0x7fe2b00b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b5caa640 1 --2- 172.21.15.177:0/52149468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2b00cba10 0x7fe2b0153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b6cac640 1 -- 172.21.15.177:0/52149468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2b00cba10 msgr2=0x7fe2b0153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b6cac640 1 --2- 172.21.15.177:0/52149468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2b00cba10 0x7fe2b0153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b6cac640 1 -- 172.21.15.177:0/52149468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2b00b42d0 msgr2=0x7fe2b00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b6cac640 1 --2- 172.21.15.177:0/52149468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2b00b42d0 0x7fe2b00b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b6cac640 1 -- 172.21.15.177:0/52149468 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a8009b30 con 0x7fe2b0158ca0 2023-11-28T20:08:25.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b6cac640 1 --2- 172.21.15.177:0/52149468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b0158ca0 0x7fe2b0157550 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe2a801a640 tx=0x7fe2a80197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:25.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2a6ffd640 1 -- 172.21.15.177:0/52149468 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80b8670 con 0x7fe2b0158ca0 2023-11-28T20:08:25.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2a6ffd640 1 -- 172.21.15.177:0/52149468 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a80b87d0 con 0x7fe2b0158ca0 2023-11-28T20:08:25.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2a6ffd640 1 -- 172.21.15.177:0/52149468 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80b8b80 con 0x7fe2b0158ca0 2023-11-28T20:08:25.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b870f640 1 -- 172.21.15.177:0/52149468 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b01517b0 con 0x7fe2b0158ca0 2023-11-28T20:08:25.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b870f640 1 -- 172.21.15.177:0/52149468 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b0151d70 con 0x7fe2b0158ca0 2023-11-28T20:08:25.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.131+0000 7fe2b870f640 1 -- 172.21.15.177:0/52149468 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b0151f60 con 0x7fe2b0158ca0 2023-11-28T20:08:25.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.135+0000 7fe2a6ffd640 1 -- 172.21.15.177:0/52149468 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe2a80b8ce0 con 0x7fe2b0158ca0 2023-11-28T20:08:25.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.135+0000 7fe2a6ffd640 1 --2- 172.21.15.177:0/52149468 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe2940664a0 0x7fe294068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.135+0000 7fe2a6ffd640 1 -- 172.21.15.177:0/52149468 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fe2a811f4e0 con 0x7fe2b0158ca0 2023-11-28T20:08:25.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.135+0000 7fe2b64ab640 1 --2- 172.21.15.177:0/52149468 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe2940664a0 0x7fe294068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.135+0000 7fe2b64ab640 1 --2- 172.21.15.177:0/52149468 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe2940664a0 0x7fe294068960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac007fd0 tx=0x7fe2ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:25.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.139+0000 7fe2a6ffd640 1 -- 172.21.15.177:0/52149468 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe2a80eca30 con 0x7fe2b0158ca0 2023-11-28T20:08:25.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.287+0000 7fe2b870f640 1 -- 172.21.15.177:0/52149468 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe2b00693d0 con 0x7fe2b0158ca0 2023-11-28T20:08:25.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.287+0000 7fe2a6ffd640 1 -- 172.21.15.177:0/52149468 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe2a80f0050 con 0x7fe2b0158ca0 2023-11-28T20:08:25.293 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:25.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.287+0000 7fe2b870f640 1 -- 172.21.15.177:0/52149468 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe2940664a0 msgr2=0x7fe294068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.291+0000 7fe2b870f640 1 --2- 172.21.15.177:0/52149468 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe2940664a0 0x7fe294068960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac007fd0 tx=0x7fe2ac009040 comp rx=0 tx=0).stop 2023-11-28T20:08:25.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.291+0000 7fe2b870f640 1 -- 172.21.15.177:0/52149468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b0158ca0 msgr2=0x7fe2b0157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.291+0000 7fe2b870f640 1 --2- 172.21.15.177:0/52149468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b0158ca0 0x7fe2b0157550 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe2a801a640 tx=0x7fe2a80197b0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.291+0000 7fe2b870f640 1 -- 172.21.15.177:0/52149468 shutdown_connections 2023-11-28T20:08:25.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.291+0000 7fe2b870f640 1 --2- 172.21.15.177:0/52149468 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe2940664a0 0x7fe294068960 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.291+0000 7fe2b870f640 1 --2- 172.21.15.177:0/52149468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b0158ca0 0x7fe2b0157550 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.291+0000 7fe2b870f640 1 --2- 172.21.15.177:0/52149468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2b00cba10 0x7fe2b0153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.291+0000 7fe2b870f640 1 --2- 172.21.15.177:0/52149468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2b00b42d0 0x7fe2b00b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.291+0000 7fe2b870f640 1 -- 172.21.15.177:0/52149468 >> 172.21.15.177:0/52149468 conn(0x7fe2b00b0cc0 msgr2=0x7fe2b0165460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:25.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.291+0000 7fe2b870f640 1 -- 172.21.15.177:0/52149468 shutdown_connections 2023-11-28T20:08:25.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.291+0000 7fe2b870f640 1 -- 172.21.15.177:0/52149468 wait complete. 2023-11-28T20:08:25.313 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:25.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f8943c640 1 Processor -- start 2023-11-28T20:08:25.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f8943c640 1 -- start start 2023-11-28T20:08:25.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f8943c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f840cfae0 0x7f7f840b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f8943c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7f840b4270 0x7f7f840d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f8943c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7f840cfec0 0x7f7f840d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f8943c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f840b3d00 con 0x7f7f840cfec0 2023-11-28T20:08:25.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f8943c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f840d0450 con 0x7f7f840b4270 2023-11-28T20:08:25.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f8943c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840d0730 con 0x7f7f840cfae0 2023-11-28T20:08:25.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f88c3b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7f840cfec0 0x7f7f840d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f88c3b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7f840cfec0 0x7f7f840d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53332/0 (socket says 172.21.15.177:53332) 2023-11-28T20:08:25.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f83fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f840cfae0 0x7f7f840b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f88c3b640 1 -- 172.21.15.177:0/427851513 learned_addr learned my addr 172.21.15.177:0/427851513 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:25.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f837fe640 1 --2- 172.21.15.177:0/427851513 >> v2:172.21.15.195:3300/0 conn(0x7f7f840b4270 0x7f7f840d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f88c3b640 1 -- 172.21.15.177:0/427851513 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f840cfae0 msgr2=0x7f7f840b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:25.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f88c3b640 1 --2- 172.21.15.177:0/427851513 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f840cfae0 0x7f7f840b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f88c3b640 1 -- 172.21.15.177:0/427851513 >> v2:172.21.15.195:3300/0 conn(0x7f7f840b4270 msgr2=0x7f7f840d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:25.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f88c3b640 1 --2- 172.21.15.177:0/427851513 >> v2:172.21.15.195:3300/0 conn(0x7f7f840b4270 0x7f7f840d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.451+0000 7f7f88c3b640 1 -- 172.21.15.177:0/427851513 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f840b3200 con 0x7f7f840cfec0 2023-11-28T20:08:25.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.455+0000 7f7f88c3b640 1 --2- 172.21.15.177:0/427851513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f840cfec0 0x7f7f840d10a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7f8408bbd0 tx=0x7f7f7c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbe452a62682fad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:25.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.455+0000 7f7f82ffd640 1 -- 172.21.15.177:0/427851513 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c0a5750 con 0x7f7f840cfec0 2023-11-28T20:08:25.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.455+0000 7f7f82ffd640 1 -- 172.21.15.177:0/427851513 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c0a58b0 con 0x7f7f840cfec0 2023-11-28T20:08:25.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.455+0000 7f7f82ffd640 1 -- 172.21.15.177:0/427851513 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c0a5c40 con 0x7f7f840cfec0 2023-11-28T20:08:25.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.455+0000 7f7f8943c640 1 -- 172.21.15.177:0/427851513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f840cfec0 msgr2=0x7f7f840d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.455+0000 7f7f8943c640 1 --2- 172.21.15.177:0/427851513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f840cfec0 0x7f7f840d10a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7f8408bbd0 tx=0x7f7f7c01c8b0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.455+0000 7f7f8943c640 1 -- 172.21.15.177:0/427851513 shutdown_connections 2023-11-28T20:08:25.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.455+0000 7f7f8943c640 1 --2- 172.21.15.177:0/427851513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f840cfec0 0x7f7f840d10a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.455+0000 7f7f8943c640 1 --2- 172.21.15.177:0/427851513 >> v2:172.21.15.195:3300/0 conn(0x7f7f840b4270 0x7f7f840d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.455+0000 7f7f8943c640 1 --2- 172.21.15.177:0/427851513 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f840cfae0 0x7f7f840b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.455+0000 7f7f8943c640 1 -- 172.21.15.177:0/427851513 >> 172.21.15.177:0/427851513 conn(0x7f7f840d2f90 msgr2=0x7f7f840d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:25.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.455+0000 7f7f8943c640 1 -- 172.21.15.177:0/427851513 shutdown_connections 2023-11-28T20:08:25.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.455+0000 7f7f8943c640 1 -- 172.21.15.177:0/427851513 wait complete. 2023-11-28T20:08:25.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f8943c640 1 Processor -- start 2023-11-28T20:08:25.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f8943c640 1 -- start start 2023-11-28T20:08:25.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f8943c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f840b4270 0x7f7f840b8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f8943c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f840cfae0 0x7f7f840b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f8943c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f840cfec0 0x7f7f840ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f8943c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840b2aa0 con 0x7f7f840b4270 2023-11-28T20:08:25.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f8943c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84150a10 con 0x7f7f840cfae0 2023-11-28T20:08:25.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f8943c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840b1f20 con 0x7f7f840cfec0 2023-11-28T20:08:25.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f83fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f840b4270 0x7f7f840b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f83fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f840b4270 0x7f7f840b8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53346/0 (socket says 172.21.15.177:53346) 2023-11-28T20:08:25.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f83fff640 1 -- 172.21.15.177:0/139976178 learned_addr learned my addr 172.21.15.177:0/139976178 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:25.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f83fff640 1 -- 172.21.15.177:0/139976178 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f840cfec0 msgr2=0x7f7f840ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f83fff640 1 --2- 172.21.15.177:0/139976178 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f840cfec0 0x7f7f840ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f83fff640 1 -- 172.21.15.177:0/139976178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f840cfae0 msgr2=0x7f7f840b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f83fff640 1 --2- 172.21.15.177:0/139976178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f840cfae0 0x7f7f840b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f83fff640 1 -- 172.21.15.177:0/139976178 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c009b30 con 0x7f7f840b4270 2023-11-28T20:08:25.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f83fff640 1 --2- 172.21.15.177:0/139976178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f840b4270 0x7f7f840b8350 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400e870 tx=0x7f7f7400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:25.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f80ff9640 1 -- 172.21.15.177:0/139976178 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74009510 con 0x7f7f840b4270 2023-11-28T20:08:25.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f80ff9640 1 -- 172.21.15.177:0/139976178 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7400eec0 con 0x7f7f840b4270 2023-11-28T20:08:25.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f8943c640 1 -- 172.21.15.177:0/139976178 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f840b2200 con 0x7f7f840b4270 2023-11-28T20:08:25.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f80ff9640 1 -- 172.21.15.177:0/139976178 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400cb40 con 0x7f7f840b4270 2023-11-28T20:08:25.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.459+0000 7f7f8943c640 1 -- 172.21.15.177:0/139976178 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f840b27c0 con 0x7f7f840b4270 2023-11-28T20:08:25.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.463+0000 7f7f8943c640 1 -- 172.21.15.177:0/139976178 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f840679f0 con 0x7f7f840b4270 2023-11-28T20:08:25.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.463+0000 7f7f80ff9640 1 -- 172.21.15.177:0/139976178 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7f7400cca0 con 0x7f7f840b4270 2023-11-28T20:08:25.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.463+0000 7f7f80ff9640 1 --2- 172.21.15.177:0/139976178 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7f700664a0 0x7f7f70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.463+0000 7f7f80ff9640 1 -- 172.21.15.177:0/139976178 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f7f74083fe0 con 0x7f7f840b4270 2023-11-28T20:08:25.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.463+0000 7f7f837fe640 1 --2- 172.21.15.177:0/139976178 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7f700664a0 0x7f7f70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.463+0000 7f7f837fe640 1 --2- 172.21.15.177:0/139976178 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7f700664a0 0x7f7f70068960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7f84150f90 tx=0x7f7f78009480 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:25.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.467+0000 7f7f80ff9640 1 -- 172.21.15.177:0/139976178 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7f74051420 con 0x7f7f840b4270 2023-11-28T20:08:25.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.619+0000 7f7f8943c640 1 -- 172.21.15.177:0/139976178 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7f8414f1c0 con 0x7f7f840b4270 2023-11-28T20:08:25.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.619+0000 7f7f80ff9640 1 -- 172.21.15.177:0/139976178 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7f74054a40 con 0x7f7f840b4270 2023-11-28T20:08:25.623 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:25.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.619+0000 7f7f8943c640 1 -- 172.21.15.177:0/139976178 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7f700664a0 msgr2=0x7f7f70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.619+0000 7f7f8943c640 1 --2- 172.21.15.177:0/139976178 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7f700664a0 0x7f7f70068960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7f84150f90 tx=0x7f7f78009480 comp rx=0 tx=0).stop 2023-11-28T20:08:25.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.619+0000 7f7f8943c640 1 -- 172.21.15.177:0/139976178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f840b4270 msgr2=0x7f7f840b8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.619+0000 7f7f8943c640 1 --2- 172.21.15.177:0/139976178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f840b4270 0x7f7f840b8350 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400e870 tx=0x7f7f7400ec70 comp rx=0 tx=0).stop 2023-11-28T20:08:25.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.619+0000 7f7f8943c640 1 -- 172.21.15.177:0/139976178 shutdown_connections 2023-11-28T20:08:25.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.619+0000 7f7f8943c640 1 --2- 172.21.15.177:0/139976178 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7f700664a0 0x7f7f70068960 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.619+0000 7f7f8943c640 1 --2- 172.21.15.177:0/139976178 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f840cfec0 0x7f7f840ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.619+0000 7f7f8943c640 1 --2- 172.21.15.177:0/139976178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f840cfae0 0x7f7f840b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.619+0000 7f7f8943c640 1 --2- 172.21.15.177:0/139976178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f840b4270 0x7f7f840b8350 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.619+0000 7f7f8943c640 1 -- 172.21.15.177:0/139976178 >> 172.21.15.177:0/139976178 conn(0x7f7f840d2f90 msgr2=0x7f7f840c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:25.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.619+0000 7f7f8943c640 1 -- 172.21.15.177:0/139976178 shutdown_connections 2023-11-28T20:08:25.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.619+0000 7f7f8943c640 1 -- 172.21.15.177:0/139976178 wait complete. 2023-11-28T20:08:25.645 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:08:25.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.779+0000 7fb9059c4640 1 Processor -- start 2023-11-28T20:08:25.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.779+0000 7fb9059c4640 1 -- start start 2023-11-28T20:08:25.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.779+0000 7fb9059c4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb90006c9d0 0x7fb900070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.779+0000 7fb9059c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb900072180 0x7fb9000709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.779+0000 7fb9059c4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9000710e0 con 0x7fb900144840 2023-11-28T20:08:25.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.779+0000 7fb9059c4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90015f010 con 0x7fb90006c9d0 2023-11-28T20:08:25.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.779+0000 7fb9059c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb900070ee0 con 0x7fb900072180 2023-11-28T20:08:25.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.779+0000 7fb8f67fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb90006c9d0 0x7fb900070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.779+0000 7fb8f67fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb90006c9d0 0x7fb900070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53356/0 (socket says 172.21.15.177:53356) 2023-11-28T20:08:25.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.779+0000 7fb8f67fc640 1 -- 172.21.15.177:0/2779486279 learned_addr learned my addr 172.21.15.177:0/2779486279 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:25.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.779+0000 7fb8ff7fe640 1 --2- 172.21.15.177:0/2779486279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb900072180 0x7fb9000709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb8f67fc640 1 -- 172.21.15.177:0/2779486279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb900072180 msgr2=0x7fb9000709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:25.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb8f67fc640 1 --2- 172.21.15.177:0/2779486279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb900072180 0x7fb9000709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb8f67fc640 1 -- 172.21.15.177:0/2779486279 >> v1:172.21.15.177:6789/0 conn(0x7fb900144840 legacy=0x7fb90006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb8f67fc640 1 -- 172.21.15.177:0/2779486279 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9000713c0 con 0x7fb90006c9d0 2023-11-28T20:08:25.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb8f67fc640 1 --2- 172.21.15.177:0/2779486279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb90006c9d0 0x7fb900070460 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009870 tx=0x7fb8f001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f40162ab419b5e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:25.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb8fe7fc640 1 -- 172.21.15.177:0/2779486279 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f00aa670 con 0x7fb90006c9d0 2023-11-28T20:08:25.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb8fe7fc640 1 -- 172.21.15.177:0/2779486279 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f00aa7d0 con 0x7fb90006c9d0 2023-11-28T20:08:25.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb8fe7fc640 1 -- 172.21.15.177:0/2779486279 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f00aab60 con 0x7fb90006c9d0 2023-11-28T20:08:25.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb9059c4640 1 -- 172.21.15.177:0/2779486279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb90006c9d0 msgr2=0x7fb900070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb9059c4640 1 --2- 172.21.15.177:0/2779486279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb90006c9d0 0x7fb900070460 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009870 tx=0x7fb8f001c510 comp rx=0 tx=0).stop 2023-11-28T20:08:25.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb9059c4640 1 -- 172.21.15.177:0/2779486279 shutdown_connections 2023-11-28T20:08:25.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb9059c4640 1 --2- 172.21.15.177:0/2779486279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb90006c9d0 0x7fb900070460 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb9059c4640 1 --2- 172.21.15.177:0/2779486279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb900072180 0x7fb9000709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb9059c4640 1 -- 172.21.15.177:0/2779486279 >> 172.21.15.177:0/2779486279 conn(0x7fb90006a530 msgr2=0x7fb90006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:25.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb9059c4640 1 -- 172.21.15.177:0/2779486279 shutdown_connections 2023-11-28T20:08:25.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.783+0000 7fb9059c4640 1 -- 172.21.15.177:0/2779486279 wait complete. 2023-11-28T20:08:25.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb9059c4640 1 Processor -- start 2023-11-28T20:08:25.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb9059c4640 1 -- start start 2023-11-28T20:08:25.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb9059c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb90006c9d0 0x7fb900159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb9059c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb900072180 0x7fb900142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb9059c4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb900144840 0x7fb900142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb9059c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9001f5b80 con 0x7fb900072180 2023-11-28T20:08:25.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb9059c4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9001f4f70 con 0x7fb900144840 2023-11-28T20:08:25.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb9059c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9001f5250 con 0x7fb90006c9d0 2023-11-28T20:08:25.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb8f67fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb900072180 0x7fb900142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb8f67fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb900072180 0x7fb900142780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53368/0 (socket says 172.21.15.177:53368) 2023-11-28T20:08:25.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb8f67fc640 1 -- 172.21.15.177:0/2295253015 learned_addr learned my addr 172.21.15.177:0/2295253015 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:25.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb8ff7fe640 1 --2- 172.21.15.177:0/2295253015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb900144840 0x7fb900142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb8feffd640 1 --2- 172.21.15.177:0/2295253015 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb90006c9d0 0x7fb900159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb8f67fc640 1 -- 172.21.15.177:0/2295253015 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb90006c9d0 msgr2=0x7fb900159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb8f67fc640 1 --2- 172.21.15.177:0/2295253015 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb90006c9d0 0x7fb900159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb8f67fc640 1 -- 172.21.15.177:0/2295253015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb900144840 msgr2=0x7fb900142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb8f67fc640 1 --2- 172.21.15.177:0/2295253015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb900144840 0x7fb900142cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.787+0000 7fb8f67fc640 1 -- 172.21.15.177:0/2295253015 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f00094d0 con 0x7fb900072180 2023-11-28T20:08:25.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.791+0000 7fb8f67fc640 1 --2- 172.21.15.177:0/2295253015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb900072180 0x7fb900142780 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb8f001a140 tx=0x7fb8f001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:25.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.791+0000 7fb8fcff9640 1 -- 172.21.15.177:0/2295253015 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f00aa670 con 0x7fb900072180 2023-11-28T20:08:25.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.791+0000 7fb8fcff9640 1 -- 172.21.15.177:0/2295253015 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f00b3800 con 0x7fb900072180 2023-11-28T20:08:25.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.791+0000 7fb9059c4640 1 -- 172.21.15.177:0/2295253015 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9001f5530 con 0x7fb900072180 2023-11-28T20:08:25.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.791+0000 7fb8fcff9640 1 -- 172.21.15.177:0/2295253015 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f00b3bb0 con 0x7fb900072180 2023-11-28T20:08:25.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.791+0000 7fb9059c4640 1 -- 172.21.15.177:0/2295253015 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90013c530 con 0x7fb900072180 2023-11-28T20:08:25.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.791+0000 7fb9059c4640 1 -- 172.21.15.177:0/2295253015 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9001f5cf0 con 0x7fb900072180 2023-11-28T20:08:25.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.791+0000 7fb8fcff9640 1 -- 172.21.15.177:0/2295253015 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb8f00b3d10 con 0x7fb900072180 2023-11-28T20:08:25.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.791+0000 7fb8fcff9640 1 --2- 172.21.15.177:0/2295253015 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb8e0066470 0x7fb8e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:25.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.791+0000 7fb8fcff9640 1 -- 172.21.15.177:0/2295253015 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fb8f011e7a0 con 0x7fb900072180 2023-11-28T20:08:25.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.791+0000 7fb8feffd640 1 --2- 172.21.15.177:0/2295253015 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb8e0066470 0x7fb8e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:25.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.795+0000 7fb8feffd640 1 --2- 172.21.15.177:0/2295253015 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb8e0066470 0x7fb8e0068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb9000b1850 tx=0x7fb8e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:25.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.795+0000 7fb8fcff9640 1 -- 172.21.15.177:0/2295253015 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb8f00ebc30 con 0x7fb900072180 2023-11-28T20:08:25.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.955+0000 7fb9059c4640 1 -- 172.21.15.177:0/2295253015 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb9001f5390 con 0x7fb900072180 2023-11-28T20:08:25.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.955+0000 7fb8fcff9640 1 -- 172.21.15.177:0/2295253015 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb9001f5390 con 0x7fb900072180 2023-11-28T20:08:25.961 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:08:25.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.959+0000 7fb9059c4640 1 -- 172.21.15.177:0/2295253015 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb8e0066470 msgr2=0x7fb8e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.959+0000 7fb9059c4640 1 --2- 172.21.15.177:0/2295253015 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb8e0066470 0x7fb8e0068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb9000b1850 tx=0x7fb8e8009040 comp rx=0 tx=0).stop 2023-11-28T20:08:25.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.959+0000 7fb9059c4640 1 -- 172.21.15.177:0/2295253015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb900072180 msgr2=0x7fb900142780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:25.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.959+0000 7fb9059c4640 1 --2- 172.21.15.177:0/2295253015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb900072180 0x7fb900142780 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb8f001a140 tx=0x7fb8f001ad50 comp rx=0 tx=0).stop 2023-11-28T20:08:25.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.959+0000 7fb9059c4640 1 -- 172.21.15.177:0/2295253015 shutdown_connections 2023-11-28T20:08:25.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.959+0000 7fb9059c4640 1 --2- 172.21.15.177:0/2295253015 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb8e0066470 0x7fb8e0068930 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.959+0000 7fb9059c4640 1 --2- 172.21.15.177:0/2295253015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb900144840 0x7fb900142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.959+0000 7fb9059c4640 1 --2- 172.21.15.177:0/2295253015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb900072180 0x7fb900142780 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.959+0000 7fb9059c4640 1 --2- 172.21.15.177:0/2295253015 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb90006c9d0 0x7fb900159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:25.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.959+0000 7fb9059c4640 1 -- 172.21.15.177:0/2295253015 >> 172.21.15.177:0/2295253015 conn(0x7fb90006a530 msgr2=0x7fb90015c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:25.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.959+0000 7fb9059c4640 1 -- 172.21.15.177:0/2295253015 shutdown_connections 2023-11-28T20:08:25.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:25.959+0000 7fb9059c4640 1 -- 172.21.15.177:0/2295253015 wait complete. 2023-11-28T20:08:25.982 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi195.front.sepia.ceph.com... 2023-11-28T20:08:25.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:25.982 DEBUG:teuthology.orchestra.run.smithi195:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-28T20:08:26.006 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:08:26.006 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:08:26.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:26.006 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T20:08:26.059 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T20:08:26.060 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:08:26.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.191+0000 7f7e36bd1640 1 Processor -- start 2023-11-28T20:08:26.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.191+0000 7f7e36bd1640 1 -- start start 2023-11-28T20:08:26.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.195+0000 7f7e36bd1640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7e3006c9d0 0x7f7e30070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.195+0000 7f7e36bd1640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e300710e0 con 0x7f7e30144840 2023-11-28T20:08:26.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.195+0000 7f7e36bd1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e300713c0 con 0x7f7e30072180 2023-11-28T20:08:26.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.195+0000 7f7e36bd1640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3015f010 con 0x7f7e3006c9d0 2023-11-28T20:08:26.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.195+0000 7f7e27fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7e3006c9d0 0x7f7e30070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.195+0000 7f7e27fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7e3006c9d0 0x7f7e30070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53370/0 (socket says 172.21.15.177:53370) 2023-11-28T20:08:26.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.195+0000 7f7e27fff640 1 -- 172.21.15.177:0/2397126609 learned_addr learned my addr 172.21.15.177:0/2397126609 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:26.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.195+0000 7f7e27fff640 1 -- 172.21.15.177:0/2397126609 >> v1:172.21.15.195:6789/0 conn(0x7f7e30072180 legacy=0x7f7e3015b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:26.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.195+0000 7f7e27fff640 1 -- 172.21.15.177:0/2397126609 >> v1:172.21.15.177:6789/0 conn(0x7f7e30144840 legacy=0x7f7e3006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.195+0000 7f7e27fff640 1 -- 172.21.15.177:0/2397126609 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e300716a0 con 0x7f7e3006c9d0 2023-11-28T20:08:26.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.195+0000 7f7e27fff640 1 --2- 172.21.15.177:0/2397126609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e3006c9d0 0x7f7e30070460 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009870 tx=0x7f7e2001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f58b861761a3df server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:26.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e277fe640 1 -- 172.21.15.177:0/2397126609 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e200aa430 con 0x7f7e3006c9d0 2023-11-28T20:08:26.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e277fe640 1 -- 172.21.15.177:0/2397126609 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e200aa590 con 0x7f7e3006c9d0 2023-11-28T20:08:26.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e277fe640 1 -- 172.21.15.177:0/2397126609 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e200aa920 con 0x7f7e3006c9d0 2023-11-28T20:08:26.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e36bd1640 1 -- 172.21.15.177:0/2397126609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e3006c9d0 msgr2=0x7f7e30070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e36bd1640 1 --2- 172.21.15.177:0/2397126609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e3006c9d0 0x7f7e30070460 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009870 tx=0x7f7e2001c4d0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e36bd1640 1 -- 172.21.15.177:0/2397126609 shutdown_connections 2023-11-28T20:08:26.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e36bd1640 1 --2- 172.21.15.177:0/2397126609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e3006c9d0 0x7f7e30070460 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e36bd1640 1 -- 172.21.15.177:0/2397126609 >> 172.21.15.177:0/2397126609 conn(0x7f7e3006a530 msgr2=0x7f7e3006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:26.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e36bd1640 1 -- 172.21.15.177:0/2397126609 shutdown_connections 2023-11-28T20:08:26.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e36bd1640 1 -- 172.21.15.177:0/2397126609 wait complete. 2023-11-28T20:08:26.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e36bd1640 1 Processor -- start 2023-11-28T20:08:26.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e36bd1640 1 -- start start 2023-11-28T20:08:26.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e36bd1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e3006c9d0 0x7f7e30159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e36bd1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e30072180 0x7f7e3013e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e36bd1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e30144840 0x7f7e3015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e36bd1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3013dac0 con 0x7f7e3006c9d0 2023-11-28T20:08:26.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e36bd1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3013f630 con 0x7f7e30144840 2023-11-28T20:08:26.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e36bd1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3013f910 con 0x7f7e30072180 2023-11-28T20:08:26.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e3496d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e3006c9d0 0x7f7e30159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e3496d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e3006c9d0 0x7f7e30159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53380/0 (socket says 172.21.15.177:53380) 2023-11-28T20:08:26.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.199+0000 7f7e3496d640 1 -- 172.21.15.177:0/862542404 learned_addr learned my addr 172.21.15.177:0/862542404 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:26.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e27fff640 1 --2- 172.21.15.177:0/862542404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e30072180 0x7f7e3013e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e3516e640 1 --2- 172.21.15.177:0/862542404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e30144840 0x7f7e3015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e3496d640 1 -- 172.21.15.177:0/862542404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e30072180 msgr2=0x7f7e3013e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e3496d640 1 --2- 172.21.15.177:0/862542404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e30072180 0x7f7e3013e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e3496d640 1 -- 172.21.15.177:0/862542404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e30144840 msgr2=0x7f7e3015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e3496d640 1 --2- 172.21.15.177:0/862542404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e30144840 0x7f7e3015a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e3496d640 1 -- 172.21.15.177:0/862542404 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e200094d0 con 0x7f7e3006c9d0 2023-11-28T20:08:26.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e27fff640 1 --2- 172.21.15.177:0/862542404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e30072180 0x7f7e3013e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:26.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e3496d640 1 --2- 172.21.15.177:0/862542404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e3006c9d0 0x7f7e30159c40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00c3c0 tx=0x7f7e2c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:26.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e257fa640 1 -- 172.21.15.177:0/862542404 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c0052d0 con 0x7f7e3006c9d0 2023-11-28T20:08:26.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e257fa640 1 -- 172.21.15.177:0/862542404 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2c005430 con 0x7f7e3006c9d0 2023-11-28T20:08:26.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e257fa640 1 -- 172.21.15.177:0/862542404 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c003840 con 0x7f7e3006c9d0 2023-11-28T20:08:26.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e36bd1640 1 -- 172.21.15.177:0/862542404 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3013dd60 con 0x7f7e3006c9d0 2023-11-28T20:08:26.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e36bd1640 1 -- 172.21.15.177:0/862542404 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3013fbf0 con 0x7f7e3006c9d0 2023-11-28T20:08:26.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e36bd1640 1 -- 172.21.15.177:0/862542404 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3013df50 con 0x7f7e3006c9d0 2023-11-28T20:08:26.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e257fa640 1 -- 172.21.15.177:0/862542404 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7e2c0039a0 con 0x7f7e3006c9d0 2023-11-28T20:08:26.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e257fa640 1 --2- 172.21.15.177:0/862542404 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7e1c066470 0x7f7e1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e257fa640 1 -- 172.21.15.177:0/862542404 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f7e2c0833d0 con 0x7f7e3006c9d0 2023-11-28T20:08:26.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.203+0000 7f7e27fff640 1 --2- 172.21.15.177:0/862542404 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7e1c066470 0x7f7e1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.207+0000 7f7e27fff640 1 --2- 172.21.15.177:0/862542404 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7e1c066470 0x7f7e1c068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7e200ae000 tx=0x7f7e200a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:26.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.207+0000 7f7e257fa640 1 -- 172.21.15.177:0/862542404 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e2c050850 con 0x7f7e3006c9d0 2023-11-28T20:08:26.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.391+0000 7f7e36bd1640 1 -- 172.21.15.177:0/862542404 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e30069440 con 0x7f7e3006c9d0 2023-11-28T20:08:26.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.391+0000 7f7e257fa640 1 -- 172.21.15.177:0/862542404 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f7e2c053e70 con 0x7f7e3006c9d0 2023-11-28T20:08:26.397 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:26.397 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2688190991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2688190991},{"type":"v1","addr":"172.21.15.177:6835","nonce":2688190991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/17424302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":17424302},{"type":"v1","addr":"172.21.15.177:6837","nonce":17424302}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3833908165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3833908165},{"type":"v1","addr":"172.21.15.195:6834","nonce":3833908165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:07:41.477909+0000","modified":"2023-11-28T20:07:44.615409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6835/1726998944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1726998944},{"type":"v1","addr":"172.21.15.195:6835","nonce":1726998944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T20:08:26.397 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-28T20:08:26.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.395+0000 7f7e36bd1640 1 -- 172.21.15.177:0/862542404 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7e1c066470 msgr2=0x7f7e1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.395+0000 7f7e36bd1640 1 --2- 172.21.15.177:0/862542404 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7e1c066470 0x7f7e1c068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7e200ae000 tx=0x7f7e200a7000 comp rx=0 tx=0).stop 2023-11-28T20:08:26.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.395+0000 7f7e36bd1640 1 -- 172.21.15.177:0/862542404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e3006c9d0 msgr2=0x7f7e30159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.395+0000 7f7e36bd1640 1 --2- 172.21.15.177:0/862542404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e3006c9d0 0x7f7e30159c40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00c3c0 tx=0x7f7e2c00c880 comp rx=0 tx=0).stop 2023-11-28T20:08:26.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.395+0000 7f7e36bd1640 1 -- 172.21.15.177:0/862542404 shutdown_connections 2023-11-28T20:08:26.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.395+0000 7f7e36bd1640 1 --2- 172.21.15.177:0/862542404 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7e1c066470 0x7f7e1c068930 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.395+0000 7f7e36bd1640 1 --2- 172.21.15.177:0/862542404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e30144840 0x7f7e3015a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.395+0000 7f7e36bd1640 1 --2- 172.21.15.177:0/862542404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e30072180 0x7f7e3013e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.395+0000 7f7e36bd1640 1 --2- 172.21.15.177:0/862542404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e3006c9d0 0x7f7e30159c40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.395+0000 7f7e36bd1640 1 -- 172.21.15.177:0/862542404 >> 172.21.15.177:0/862542404 conn(0x7f7e3006a530 msgr2=0x7f7e30143510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:26.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.395+0000 7f7e36bd1640 1 -- 172.21.15.177:0/862542404 shutdown_connections 2023-11-28T20:08:26.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.395+0000 7f7e36bd1640 1 -- 172.21.15.177:0/862542404 wait complete. 2023-11-28T20:08:26.418 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:26.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.551+0000 7ff8fbc32640 1 Processor -- start 2023-11-28T20:08:26.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.551+0000 7ff8fbc32640 1 -- start start 2023-11-28T20:08:26.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8fbc32640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff8f40b35b0 0x7ff8f40d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8fbc32640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f40d3880 con 0x7ff8f40b3c70 2023-11-28T20:08:26.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8fbc32640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f40cdc80 con 0x7ff8f40cfe90 2023-11-28T20:08:26.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8fbc32640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f40d4090 con 0x7ff8f40b35b0 2023-11-28T20:08:26.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f91cd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ff8f40b3c70 0x7ff8f40cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45296/0 (socket says 172.21.15.177:45296) 2023-11-28T20:08:26.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f91cd640 1 -- 172.21.15.177:0/2038632084 learned_addr learned my addr 172.21.15.177:0/2038632084 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:26.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f99ce640 1 --2- 172.21.15.177:0/2038632084 >> v2:172.21.15.195:3300/0 conn(0x7ff8f40b35b0 0x7ff8f40d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f89cc640 1 -- 172.21.15.177:0/2038632084 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787381119 0 0) 0x7ff8f40d3880 con 0x7ff8f40b3c70 2023-11-28T20:08:26.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f89cc640 1 -- 172.21.15.177:0/2038632084 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8e0003530 con 0x7ff8f40b3c70 2023-11-28T20:08:26.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f89cc640 1 -- 172.21.15.177:0/2038632084 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1656692061 0 0) 0x7ff8e0003530 con 0x7ff8f40b3c70 2023-11-28T20:08:26.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f89cc640 1 -- 172.21.15.177:0/2038632084 >> v2:172.21.15.195:3300/0 conn(0x7ff8f40b35b0 msgr2=0x7ff8f40d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:26.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f89cc640 1 --2- 172.21.15.177:0/2038632084 >> v2:172.21.15.195:3300/0 conn(0x7ff8f40b35b0 0x7ff8f40d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f89cc640 1 -- 172.21.15.177:0/2038632084 >> v1:172.21.15.195:6789/0 conn(0x7ff8f40cfe90 legacy=0x7ff8f40ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f89cc640 1 -- 172.21.15.177:0/2038632084 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f40d3ad0 con 0x7ff8f40b3c70 2023-11-28T20:08:26.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f89cc640 1 -- 172.21.15.177:0/2038632084 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7ff8e4001680 con 0x7ff8f40b3c70 2023-11-28T20:08:26.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f89cc640 1 -- 172.21.15.177:0/2038632084 >> v1:172.21.15.177:6789/0 conn(0x7ff8f40b3c70 legacy=0x7ff8f40cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f89cc640 1 --2- 172.21.15.177:0/2038632084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e0003980 0x7ff8e0003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f89cc640 1 --2- 172.21.15.177:0/2038632084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0004380 0x7ff8e0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f89cc640 1 --2- 172.21.15.177:0/2038632084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e0005050 0x7ff8e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f89cc640 1 -- 172.21.15.177:0/2038632084 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40d4090 con 0x7ff8e0003980 2023-11-28T20:08:26.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f89cc640 1 -- 172.21.15.177:0/2038632084 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e000bfb0 con 0x7ff8e0004380 2023-11-28T20:08:26.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f89cc640 1 -- 172.21.15.177:0/2038632084 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e000c170 con 0x7ff8e0005050 2023-11-28T20:08:26.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f99ce640 1 --2- 172.21.15.177:0/2038632084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e0003980 0x7ff8e0003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f91cd640 1 --2- 172.21.15.177:0/2038632084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0004380 0x7ff8e0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8fa1cf640 1 --2- 172.21.15.177:0/2038632084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e0005050 0x7ff8e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f99ce640 1 -- 172.21.15.177:0/2038632084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e0005050 msgr2=0x7ff8e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:26.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f99ce640 1 --2- 172.21.15.177:0/2038632084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e0005050 0x7ff8e000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f99ce640 1 -- 172.21.15.177:0/2038632084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0004380 msgr2=0x7ff8e0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:26.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f99ce640 1 --2- 172.21.15.177:0/2038632084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0004380 0x7ff8e0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8f99ce640 1 -- 172.21.15.177:0/2038632084 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e0003530 con 0x7ff8e0003980 2023-11-28T20:08:26.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.555+0000 7ff8fa1cf640 1 -- 172.21.15.177:0/2038632084 reap_dead start 2023-11-28T20:08:26.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.559+0000 7ff8f99ce640 1 --2- 172.21.15.177:0/2038632084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e0003980 0x7ff8e0003d60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009ae0 tx=0x7ff8f001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c130aff1c26861 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:26.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.559+0000 7ff8f89cc640 1 -- 172.21.15.177:0/2038632084 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00a5640 con 0x7ff8e0003980 2023-11-28T20:08:26.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.559+0000 7ff8f89cc640 1 -- 172.21.15.177:0/2038632084 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f00a57a0 con 0x7ff8e0003980 2023-11-28T20:08:26.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.559+0000 7ff8f89cc640 1 -- 172.21.15.177:0/2038632084 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00a5b50 con 0x7ff8e0003980 2023-11-28T20:08:26.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.559+0000 7ff8fbc32640 1 -- 172.21.15.177:0/2038632084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e0003980 msgr2=0x7ff8e0003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.559+0000 7ff8fbc32640 1 --2- 172.21.15.177:0/2038632084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e0003980 0x7ff8e0003d60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009ae0 tx=0x7ff8f001ca50 comp rx=0 tx=0).stop 2023-11-28T20:08:26.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.559+0000 7ff8fbc32640 1 -- 172.21.15.177:0/2038632084 shutdown_connections 2023-11-28T20:08:26.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.559+0000 7ff8fbc32640 1 --2- 172.21.15.177:0/2038632084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e0003980 0x7ff8e0003d60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.559+0000 7ff8fbc32640 1 -- 172.21.15.177:0/2038632084 >> 172.21.15.177:0/2038632084 conn(0x7ff8f409c4b0 msgr2=0x7ff8f40d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:26.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.559+0000 7ff8fbc32640 1 -- 172.21.15.177:0/2038632084 shutdown_connections 2023-11-28T20:08:26.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.559+0000 7ff8fbc32640 1 -- 172.21.15.177:0/2038632084 wait complete. 2023-11-28T20:08:26.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.559+0000 7ff8fbc32640 1 Processor -- start 2023-11-28T20:08:26.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.559+0000 7ff8fbc32640 1 -- start start 2023-11-28T20:08:26.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8fbc32640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e0003980 0x7ff8f40b84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8fbc32640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8f414f130 0x7ff8f414e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8fbc32640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8f40b64b0 0x7ff8f40b6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8fbc32640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40b0590 con 0x7ff8e0003980 2023-11-28T20:08:26.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8fbc32640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40b6e70 con 0x7ff8f414f130 2023-11-28T20:08:26.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8fbc32640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40b6160 con 0x7ff8f40b64b0 2023-11-28T20:08:26.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8fa1cf640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8f40b64b0 0x7ff8f40b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8f91cd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8f414f130 0x7ff8f414e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8f99ce640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e0003980 0x7ff8f40b84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8f91cd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8f414f130 0x7ff8f414e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:47932/0 (socket says 172.21.15.177:47932) 2023-11-28T20:08:26.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8f91cd640 1 -- 172.21.15.177:0/2912618112 learned_addr learned my addr 172.21.15.177:0/2912618112 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:26.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8f99ce640 1 -- 172.21.15.177:0/2912618112 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8f40b64b0 msgr2=0x7ff8f40b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8f99ce640 1 --2- 172.21.15.177:0/2912618112 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8f40b64b0 0x7ff8f40b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8f99ce640 1 -- 172.21.15.177:0/2912618112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8f414f130 msgr2=0x7ff8f414e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8f99ce640 1 --2- 172.21.15.177:0/2912618112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8f414f130 0x7ff8f414e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8f99ce640 1 -- 172.21.15.177:0/2912618112 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f40b5e80 con 0x7ff8e0003980 2023-11-28T20:08:26.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8f91cd640 1 --2- 172.21.15.177:0/2912618112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8f414f130 0x7ff8f414e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:26.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8f99ce640 1 --2- 172.21.15.177:0/2912618112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e0003980 0x7ff8f40b84e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00ac000 tx=0x7ff8f00197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:26.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8ea7fc640 1 -- 172.21.15.177:0/2912618112 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0004020 con 0x7ff8e0003980 2023-11-28T20:08:26.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8ea7fc640 1 -- 172.21.15.177:0/2912618112 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f00041a0 con 0x7ff8e0003980 2023-11-28T20:08:26.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8fbc32640 1 -- 172.21.15.177:0/2912618112 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f40afed0 con 0x7ff8e0003980 2023-11-28T20:08:26.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8ea7fc640 1 -- 172.21.15.177:0/2912618112 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00b8660 con 0x7ff8e0003980 2023-11-28T20:08:26.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8fbc32640 1 -- 172.21.15.177:0/2912618112 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f40b8a20 con 0x7ff8e0003980 2023-11-28T20:08:26.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.563+0000 7ff8fbc32640 1 -- 172.21.15.177:0/2912618112 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f4069440 con 0x7ff8e0003980 2023-11-28T20:08:26.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.567+0000 7ff8ea7fc640 1 -- 172.21.15.177:0/2912618112 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff8f00b4070 con 0x7ff8e0003980 2023-11-28T20:08:26.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.567+0000 7ff8ea7fc640 1 --2- 172.21.15.177:0/2912618112 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff8d80664a0 0x7ff8d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.567+0000 7ff8ea7fc640 1 -- 172.21.15.177:0/2912618112 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff8f011e770 con 0x7ff8e0003980 2023-11-28T20:08:26.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.567+0000 7ff8f91cd640 1 --2- 172.21.15.177:0/2912618112 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff8d80664a0 0x7ff8d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.567+0000 7ff8f91cd640 1 --2- 172.21.15.177:0/2912618112 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff8d80664a0 0x7ff8d8068960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4007fd0 tx=0x7ff8e4001180 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:26.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.571+0000 7ff8ea7fc640 1 -- 172.21.15.177:0/2912618112 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff8f00ebc00 con 0x7ff8e0003980 2023-11-28T20:08:26.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.723+0000 7ff8fbc32640 1 -- 172.21.15.177:0/2912618112 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8f409c9f0 con 0x7ff8e0003980 2023-11-28T20:08:26.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.727+0000 7ff8ea7fc640 1 -- 172.21.15.177:0/2912618112 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16861 (secure 0 0 0) 0x7ff8f00ef220 con 0x7ff8e0003980 2023-11-28T20:08:26.730 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:26.731 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":22,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:23.248475+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:26.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.727+0000 7ff8fbc32640 1 -- 172.21.15.177:0/2912618112 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff8d80664a0 msgr2=0x7ff8d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.727+0000 7ff8fbc32640 1 --2- 172.21.15.177:0/2912618112 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff8d80664a0 0x7ff8d8068960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4007fd0 tx=0x7ff8e4001180 comp rx=0 tx=0).stop 2023-11-28T20:08:26.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.727+0000 7ff8fbc32640 1 -- 172.21.15.177:0/2912618112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e0003980 msgr2=0x7ff8f40b84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.727+0000 7ff8fbc32640 1 --2- 172.21.15.177:0/2912618112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e0003980 0x7ff8f40b84e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00ac000 tx=0x7ff8f00197f0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.727+0000 7ff8fbc32640 1 -- 172.21.15.177:0/2912618112 shutdown_connections 2023-11-28T20:08:26.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.727+0000 7ff8fbc32640 1 --2- 172.21.15.177:0/2912618112 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff8d80664a0 0x7ff8d8068960 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.727+0000 7ff8fbc32640 1 --2- 172.21.15.177:0/2912618112 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8f40b64b0 0x7ff8f40b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.727+0000 7ff8fbc32640 1 --2- 172.21.15.177:0/2912618112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8f414f130 0x7ff8f414e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.727+0000 7ff8fbc32640 1 --2- 172.21.15.177:0/2912618112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e0003980 0x7ff8f40b84e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.727+0000 7ff8fbc32640 1 -- 172.21.15.177:0/2912618112 >> 172.21.15.177:0/2912618112 conn(0x7ff8f409c4b0 msgr2=0x7ff8f40cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:26.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.727+0000 7ff8fbc32640 1 -- 172.21.15.177:0/2912618112 shutdown_connections 2023-11-28T20:08:26.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.727+0000 7ff8fbc32640 1 -- 172.21.15.177:0/2912618112 wait complete. 2023-11-28T20:08:26.752 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:07:39.694738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:07:40.472040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:26.753 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:26.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.887+0000 7fee84a3c640 1 Processor -- start 2023-11-28T20:08:26.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.887+0000 7fee84a3c640 1 -- start start 2023-11-28T20:08:26.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.891+0000 7fee84a3c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fee8015d050 0x7fee800cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.891+0000 7fee84a3c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee8015d430 0x7fee800cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.891+0000 7fee84a3c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee800ce370 con 0x7fee8006c6e0 2023-11-28T20:08:26.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.891+0000 7fee84a3c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8006b640 con 0x7fee8015d050 2023-11-28T20:08:26.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.891+0000 7fee84a3c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8006b920 con 0x7fee8015d430 2023-11-28T20:08:26.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.891+0000 7fee7f7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fee8015d050 0x7fee800cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.891+0000 7fee7f7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fee8015d050 0x7fee800cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53414/0 (socket says 172.21.15.177:53414) 2023-11-28T20:08:26.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.891+0000 7fee7f7fe640 1 -- 172.21.15.177:0/3614894923 learned_addr learned my addr 172.21.15.177:0/3614894923 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:26.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.891+0000 7fee7effd640 1 --2- 172.21.15.177:0/3614894923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee8015d430 0x7fee800cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.891+0000 7fee7f7fe640 1 -- 172.21.15.177:0/3614894923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee8015d430 msgr2=0x7fee800cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:26.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.891+0000 7fee7f7fe640 1 --2- 172.21.15.177:0/3614894923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee8015d430 0x7fee800cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.891+0000 7fee7f7fe640 1 -- 172.21.15.177:0/3614894923 >> v1:172.21.15.195:6789/0 conn(0x7fee8006c6e0 legacy=0x7fee80160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:26.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.891+0000 7fee7f7fe640 1 -- 172.21.15.177:0/3614894923 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8006bc00 con 0x7fee8015d050 2023-11-28T20:08:26.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.891+0000 7fee7effd640 1 --2- 172.21.15.177:0/3614894923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee8015d430 0x7fee800cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:26.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.895+0000 7fee7f7fe640 1 --2- 172.21.15.177:0/3614894923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee8015d050 0x7fee800cfa80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fee70009870 tx=0x7fee7001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24ae00cda4e2ed5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:26.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.895+0000 7fee7e7fc640 1 -- 172.21.15.177:0/3614894923 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee700a89b0 con 0x7fee8015d050 2023-11-28T20:08:26.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.895+0000 7fee7e7fc640 1 -- 172.21.15.177:0/3614894923 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee700a8b10 con 0x7fee8015d050 2023-11-28T20:08:26.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.895+0000 7fee7e7fc640 1 -- 172.21.15.177:0/3614894923 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee700a8ea0 con 0x7fee8015d050 2023-11-28T20:08:26.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.895+0000 7fee84a3c640 1 -- 172.21.15.177:0/3614894923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee8015d050 msgr2=0x7fee800cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.895+0000 7fee84a3c640 1 --2- 172.21.15.177:0/3614894923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee8015d050 0x7fee800cfa80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fee70009870 tx=0x7fee7001ecf0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.895+0000 7fee84a3c640 1 -- 172.21.15.177:0/3614894923 shutdown_connections 2023-11-28T20:08:26.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.895+0000 7fee84a3c640 1 --2- 172.21.15.177:0/3614894923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee8015d430 0x7fee800cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.895+0000 7fee84a3c640 1 --2- 172.21.15.177:0/3614894923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee8015d050 0x7fee800cfa80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.895+0000 7fee84a3c640 1 -- 172.21.15.177:0/3614894923 >> 172.21.15.177:0/3614894923 conn(0x7fee800b2860 msgr2=0x7fee800b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:26.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.895+0000 7fee84a3c640 1 -- 172.21.15.177:0/3614894923 shutdown_connections 2023-11-28T20:08:26.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.895+0000 7fee84a3c640 1 -- 172.21.15.177:0/3614894923 wait complete. 2023-11-28T20:08:26.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.895+0000 7fee84a3c640 1 Processor -- start 2023-11-28T20:08:26.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.895+0000 7fee84a3c640 1 -- start start 2023-11-28T20:08:26.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.895+0000 7fee84a3c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee8006c6e0 0x7fee8014d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee84a3c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee8015d050 0x7fee800b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee84a3c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee8015d430 0x7fee800b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee84a3c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee800b3ce0 con 0x7fee8015d430 2023-11-28T20:08:26.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee84a3c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee801f4360 con 0x7fee8006c6e0 2023-11-28T20:08:26.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee84a3c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee801f4640 con 0x7fee8015d050 2023-11-28T20:08:26.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee7ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee8015d430 0x7fee800b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee7ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee8015d430 0x7fee800b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53428/0 (socket says 172.21.15.177:53428) 2023-11-28T20:08:26.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee7ffff640 1 -- 172.21.15.177:0/3710398335 learned_addr learned my addr 172.21.15.177:0/3710398335 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:26.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee7effd640 1 --2- 172.21.15.177:0/3710398335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee8015d050 0x7fee800b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee7f7fe640 1 --2- 172.21.15.177:0/3710398335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee8006c6e0 0x7fee8014d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee7ffff640 1 -- 172.21.15.177:0/3710398335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee8015d050 msgr2=0x7fee800b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee7ffff640 1 --2- 172.21.15.177:0/3710398335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee8015d050 0x7fee800b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee7ffff640 1 -- 172.21.15.177:0/3710398335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee8006c6e0 msgr2=0x7fee8014d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:26.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee7ffff640 1 --2- 172.21.15.177:0/3710398335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee8006c6e0 0x7fee8014d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:26.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee7ffff640 1 -- 172.21.15.177:0/3710398335 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee700094d0 con 0x7fee8015d430 2023-11-28T20:08:26.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee7ffff640 1 --2- 172.21.15.177:0/3710398335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee8015d430 0x7fee800b49c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fee7800c780 tx=0x7fee7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:26.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee67fff640 1 -- 172.21.15.177:0/3710398335 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78004b70 con 0x7fee8015d430 2023-11-28T20:08:26.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee67fff640 1 -- 172.21.15.177:0/3710398335 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7800ce90 con 0x7fee8015d430 2023-11-28T20:08:26.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee84a3c640 1 -- 172.21.15.177:0/3710398335 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8015eb40 con 0x7fee8015d430 2023-11-28T20:08:26.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee67fff640 1 -- 172.21.15.177:0/3710398335 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7800a850 con 0x7fee8015d430 2023-11-28T20:08:26.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee84a3c640 1 -- 172.21.15.177:0/3710398335 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8015f100 con 0x7fee8015d430 2023-11-28T20:08:26.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee84a3c640 1 -- 172.21.15.177:0/3710398335 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8006d2b0 con 0x7fee8015d430 2023-11-28T20:08:26.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.899+0000 7fee67fff640 1 -- 172.21.15.177:0/3710398335 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fee7800a9b0 con 0x7fee8015d430 2023-11-28T20:08:26.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.903+0000 7fee67fff640 1 --2- 172.21.15.177:0/3710398335 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee6c0664a0 0x7fee6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:26.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.903+0000 7fee67fff640 1 -- 172.21.15.177:0/3710398335 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fee78083e70 con 0x7fee8015d430 2023-11-28T20:08:26.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.903+0000 7fee7f7fe640 1 --2- 172.21.15.177:0/3710398335 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee6c0664a0 0x7fee6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:26.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.903+0000 7fee7f7fe640 1 --2- 172.21.15.177:0/3710398335 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee6c0664a0 0x7fee6c068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fee700b2000 tx=0x7fee70009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:26.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:26.903+0000 7fee67fff640 1 -- 172.21.15.177:0/3710398335 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fee780513a0 con 0x7fee8015d430 2023-11-28T20:08:27.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.055+0000 7fee84a3c640 1 -- 172.21.15.177:0/3710398335 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee800b0000 con 0x7fee8015d430 2023-11-28T20:08:27.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.055+0000 7fee67fff640 1 -- 172.21.15.177:0/3710398335 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee780549c0 con 0x7fee8015d430 2023-11-28T20:08:27.062 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:27.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.059+0000 7fee84a3c640 1 -- 172.21.15.177:0/3710398335 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee6c0664a0 msgr2=0x7fee6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.059+0000 7fee84a3c640 1 --2- 172.21.15.177:0/3710398335 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee6c0664a0 0x7fee6c068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fee700b2000 tx=0x7fee70009040 comp rx=0 tx=0).stop 2023-11-28T20:08:27.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.059+0000 7fee84a3c640 1 -- 172.21.15.177:0/3710398335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee8015d430 msgr2=0x7fee800b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.059+0000 7fee84a3c640 1 --2- 172.21.15.177:0/3710398335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee8015d430 0x7fee800b49c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fee7800c780 tx=0x7fee7800cc40 comp rx=0 tx=0).stop 2023-11-28T20:08:27.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.059+0000 7fee84a3c640 1 -- 172.21.15.177:0/3710398335 shutdown_connections 2023-11-28T20:08:27.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.059+0000 7fee84a3c640 1 --2- 172.21.15.177:0/3710398335 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee6c0664a0 0x7fee6c068960 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.059+0000 7fee84a3c640 1 --2- 172.21.15.177:0/3710398335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee8015d430 0x7fee800b49c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.059+0000 7fee84a3c640 1 --2- 172.21.15.177:0/3710398335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee8015d050 0x7fee800b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.059+0000 7fee84a3c640 1 --2- 172.21.15.177:0/3710398335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee8006c6e0 0x7fee8014d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.059+0000 7fee84a3c640 1 -- 172.21.15.177:0/3710398335 >> 172.21.15.177:0/3710398335 conn(0x7fee800b2860 msgr2=0x7fee801563d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:27.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.059+0000 7fee84a3c640 1 -- 172.21.15.177:0/3710398335 shutdown_connections 2023-11-28T20:08:27.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.059+0000 7fee84a3c640 1 -- 172.21.15.177:0/3710398335 wait complete. 2023-11-28T20:08:27.084 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:27.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8104491640 1 Processor -- start 2023-11-28T20:08:27.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8104491640 1 -- start start 2023-11-28T20:08:27.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8104491640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f80fc143a10 0x7f80fc06f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8104491640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f80fc146760 0x7f80fc06a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8104491640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80fc06aa70 0x7f80fc071500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8104491640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80fc1619d0 con 0x7f80fc146760 2023-11-28T20:08:27.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8104491640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80fc147060 con 0x7f80fc143a10 2023-11-28T20:08:27.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8104491640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc06aec0 con 0x7f80fc06aa70 2023-11-28T20:08:27.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8101a2c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f80fc146760 0x7f80fc06a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8101a2c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f80fc146760 0x7f80fc06a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53430/0 (socket says 172.21.15.177:53430) 2023-11-28T20:08:27.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8101a2c640 1 -- 172.21.15.177:0/2767316949 learned_addr learned my addr 172.21.15.177:0/2767316949 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:27.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f810222d640 1 --2- 172.21.15.177:0/2767316949 >> v2:172.21.15.195:3300/0 conn(0x7f80fc143a10 0x7f80fc06f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8102a2e640 1 --2- 172.21.15.177:0/2767316949 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80fc06aa70 0x7f80fc071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8101a2c640 1 -- 172.21.15.177:0/2767316949 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80fc06aa70 msgr2=0x7f80fc071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:27.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8101a2c640 1 --2- 172.21.15.177:0/2767316949 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80fc06aa70 0x7f80fc071500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8101a2c640 1 -- 172.21.15.177:0/2767316949 >> v2:172.21.15.195:3300/0 conn(0x7f80fc143a10 msgr2=0x7f80fc06f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:27.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8101a2c640 1 --2- 172.21.15.177:0/2767316949 >> v2:172.21.15.195:3300/0 conn(0x7f80fc143a10 0x7f80fc06f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.219+0000 7f8101a2c640 1 -- 172.21.15.177:0/2767316949 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc06f940 con 0x7f80fc146760 2023-11-28T20:08:27.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.223+0000 7f8101a2c640 1 --2- 172.21.15.177:0/2767316949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80fc146760 0x7f80fc06a530 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f80fc06b180 tx=0x7f80ec01c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4eb383689c5e034 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:27.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.223+0000 7f810122b640 1 -- 172.21.15.177:0/2767316949 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0ab600 con 0x7f80fc146760 2023-11-28T20:08:27.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.223+0000 7f810122b640 1 -- 172.21.15.177:0/2767316949 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec0a7050 con 0x7f80fc146760 2023-11-28T20:08:27.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.223+0000 7f810122b640 1 -- 172.21.15.177:0/2767316949 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0ab980 con 0x7f80fc146760 2023-11-28T20:08:27.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.223+0000 7f8104491640 1 -- 172.21.15.177:0/2767316949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80fc146760 msgr2=0x7f80fc06a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.223+0000 7f8104491640 1 --2- 172.21.15.177:0/2767316949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80fc146760 0x7f80fc06a530 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f80fc06b180 tx=0x7f80ec01c180 comp rx=0 tx=0).stop 2023-11-28T20:08:27.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.223+0000 7f8104491640 1 -- 172.21.15.177:0/2767316949 shutdown_connections 2023-11-28T20:08:27.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.223+0000 7f8104491640 1 --2- 172.21.15.177:0/2767316949 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80fc06aa70 0x7f80fc071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.223+0000 7f8104491640 1 --2- 172.21.15.177:0/2767316949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80fc146760 0x7f80fc06a530 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.223+0000 7f8104491640 1 --2- 172.21.15.177:0/2767316949 >> v2:172.21.15.195:3300/0 conn(0x7f80fc143a10 0x7f80fc06f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.223+0000 7f8104491640 1 -- 172.21.15.177:0/2767316949 >> 172.21.15.177:0/2767316949 conn(0x7f80fc0b1db0 msgr2=0x7f80fc0b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:27.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.223+0000 7f8104491640 1 -- 172.21.15.177:0/2767316949 shutdown_connections 2023-11-28T20:08:27.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.223+0000 7f8104491640 1 -- 172.21.15.177:0/2767316949 wait complete. 2023-11-28T20:08:27.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8104491640 1 Processor -- start 2023-11-28T20:08:27.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8104491640 1 -- start start 2023-11-28T20:08:27.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8104491640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80fc06aa70 0x7f80fc141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8104491640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80fc143a10 0x7f80fc15ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8104491640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80fc146760 0x7f80fc15f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8104491640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc13b450 con 0x7f80fc146760 2023-11-28T20:08:27.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8104491640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc1349c0 con 0x7f80fc06aa70 2023-11-28T20:08:27.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8104491640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc13b8b0 con 0x7f80fc143a10 2023-11-28T20:08:27.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8102a2e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80fc146760 0x7f80fc15f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8102a2e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80fc146760 0x7f80fc15f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53438/0 (socket says 172.21.15.177:53438) 2023-11-28T20:08:27.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8102a2e640 1 -- 172.21.15.177:0/1644971107 learned_addr learned my addr 172.21.15.177:0/1644971107 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:27.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f810222d640 1 --2- 172.21.15.177:0/1644971107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80fc06aa70 0x7f80fc141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8101a2c640 1 --2- 172.21.15.177:0/1644971107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80fc143a10 0x7f80fc15ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8102a2e640 1 -- 172.21.15.177:0/1644971107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80fc143a10 msgr2=0x7f80fc15ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8102a2e640 1 --2- 172.21.15.177:0/1644971107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80fc143a10 0x7f80fc15ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8102a2e640 1 -- 172.21.15.177:0/1644971107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80fc06aa70 msgr2=0x7f80fc141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8102a2e640 1 --2- 172.21.15.177:0/1644971107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80fc06aa70 0x7f80fc141f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8102a2e640 1 -- 172.21.15.177:0/1644971107 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0094d0 con 0x7f80fc146760 2023-11-28T20:08:27.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8102a2e640 1 --2- 172.21.15.177:0/1644971107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80fc146760 0x7f80fc15f470 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f80f4007e60 tx=0x7f80f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:27.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f80f2ffd640 1 -- 172.21.15.177:0/1644971107 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4014620 con 0x7f80fc146760 2023-11-28T20:08:27.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f80f2ffd640 1 -- 172.21.15.177:0/1644971107 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f400ee90 con 0x7f80fc146760 2023-11-28T20:08:27.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8104491640 1 -- 172.21.15.177:0/1644971107 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80fc13bb90 con 0x7f80fc146760 2023-11-28T20:08:27.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f80f2ffd640 1 -- 172.21.15.177:0/1644971107 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f40149e0 con 0x7f80fc146760 2023-11-28T20:08:27.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.227+0000 7f8104491640 1 -- 172.21.15.177:0/1644971107 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80fc13c150 con 0x7f80fc146760 2023-11-28T20:08:27.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.231+0000 7f8104491640 1 -- 172.21.15.177:0/1644971107 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80fc13c340 con 0x7f80fc146760 2023-11-28T20:08:27.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.231+0000 7f80f2ffd640 1 -- 172.21.15.177:0/1644971107 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80f4014b40 con 0x7f80fc146760 2023-11-28T20:08:27.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.231+0000 7f80f2ffd640 1 --2- 172.21.15.177:0/1644971107 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f80e0066470 0x7f80e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.231+0000 7f80f2ffd640 1 -- 172.21.15.177:0/1644971107 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f80f4084840 con 0x7f80fc146760 2023-11-28T20:08:27.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.231+0000 7f810222d640 1 --2- 172.21.15.177:0/1644971107 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f80e0066470 0x7f80e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.231+0000 7f810222d640 1 --2- 172.21.15.177:0/1644971107 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f80e0066470 0x7f80e0068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f80f8009b60 tx=0x7f80f8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:27.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.235+0000 7f80f2ffd640 1 -- 172.21.15.177:0/1644971107 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f80f4051c40 con 0x7f80fc146760 2023-11-28T20:08:27.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.383+0000 7f8104491640 1 -- 172.21.15.177:0/1644971107 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80fc0693d0 con 0x7f80fc146760 2023-11-28T20:08:27.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.383+0000 7f80f2ffd640 1 -- 172.21.15.177:0/1644971107 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80f4055260 con 0x7f80fc146760 2023-11-28T20:08:27.390 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:27.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.387+0000 7f8104491640 1 -- 172.21.15.177:0/1644971107 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f80e0066470 msgr2=0x7f80e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.387+0000 7f8104491640 1 --2- 172.21.15.177:0/1644971107 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f80e0066470 0x7f80e0068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f80f8009b60 tx=0x7f80f8009190 comp rx=0 tx=0).stop 2023-11-28T20:08:27.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.387+0000 7f8104491640 1 -- 172.21.15.177:0/1644971107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80fc146760 msgr2=0x7f80fc15f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.387+0000 7f8104491640 1 --2- 172.21.15.177:0/1644971107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80fc146760 0x7f80fc15f470 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f80f4007e60 tx=0x7f80f400e4b0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.387+0000 7f8104491640 1 -- 172.21.15.177:0/1644971107 shutdown_connections 2023-11-28T20:08:27.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.387+0000 7f8104491640 1 --2- 172.21.15.177:0/1644971107 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f80e0066470 0x7f80e0068930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.387+0000 7f8104491640 1 --2- 172.21.15.177:0/1644971107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80fc146760 0x7f80fc15f470 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.387+0000 7f8104491640 1 --2- 172.21.15.177:0/1644971107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80fc143a10 0x7f80fc15ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.387+0000 7f8104491640 1 --2- 172.21.15.177:0/1644971107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80fc06aa70 0x7f80fc141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.387+0000 7f8104491640 1 -- 172.21.15.177:0/1644971107 >> 172.21.15.177:0/1644971107 conn(0x7f80fc0b1db0 msgr2=0x7f80fc15d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:27.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.387+0000 7f8104491640 1 -- 172.21.15.177:0/1644971107 shutdown_connections 2023-11-28T20:08:27.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.387+0000 7f8104491640 1 -- 172.21.15.177:0/1644971107 wait complete. 2023-11-28T20:08:27.411 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:27.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.547+0000 7f91225c4640 1 Processor -- start 2023-11-28T20:08:27.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.547+0000 7f91225c4640 1 -- start start 2023-11-28T20:08:27.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.547+0000 7f91225c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f911c13f5f0 0x7f911c0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.547+0000 7f91225c4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911c13d2b0 con 0x7f911c071d90 2023-11-28T20:08:27.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.547+0000 7f91225c4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911c0cdd70 con 0x7f911c15adb0 2023-11-28T20:08:27.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.547+0000 7f91225c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c140520 con 0x7f911c13f5f0 2023-11-28T20:08:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.551+0000 7f911bfff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f911c071d90 0x7f911c072170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45300/0 (socket says 172.21.15.177:45300) 2023-11-28T20:08:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.551+0000 7f911bfff640 1 -- 172.21.15.177:0/1373092690 learned_addr learned my addr 172.21.15.177:0/1373092690 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.551+0000 7f9120b61640 1 --2- 172.21.15.177:0/1373092690 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f911c13f5f0 0x7f911c0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.551+0000 7f911affd640 1 -- 172.21.15.177:0/1373092690 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310025098 0 0) 0x7f911c13d2b0 con 0x7f911c071d90 2023-11-28T20:08:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.551+0000 7f911affd640 1 -- 172.21.15.177:0/1373092690 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9104003530 con 0x7f911c071d90 2023-11-28T20:08:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.551+0000 7f9120b61640 1 -- 172.21.15.177:0/1373092690 >> v1:172.21.15.195:6789/0 conn(0x7f911c15adb0 legacy=0x7f911c13d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.551+0000 7f911affd640 1 -- 172.21.15.177:0/1373092690 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277384656 0 0) 0x7f911c0cdd70 con 0x7f911c15adb0 2023-11-28T20:08:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.551+0000 7f9120b61640 1 -- 172.21.15.177:0/1373092690 >> v1:172.21.15.177:6789/0 conn(0x7f911c071d90 legacy=0x7f911c072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.551+0000 7f9120b61640 1 -- 172.21.15.177:0/1373092690 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c13ff60 con 0x7f911c13f5f0 2023-11-28T20:08:27.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.551+0000 7f9120b61640 1 --2- 172.21.15.177:0/1373092690 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f911c13f5f0 0x7f911c0ce200 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9114009dc0 tx=0x7f911401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da5d70006f56121f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:27.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.551+0000 7f911affd640 1 -- 172.21.15.177:0/1373092690 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140a5920 con 0x7f911c13f5f0 2023-11-28T20:08:27.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f911affd640 1 -- 172.21.15.177:0/1373092690 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91140a5a80 con 0x7f911c13f5f0 2023-11-28T20:08:27.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f911affd640 1 -- 172.21.15.177:0/1373092690 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140a5e10 con 0x7f911c13f5f0 2023-11-28T20:08:27.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f91225c4640 1 -- 172.21.15.177:0/1373092690 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f911c13f5f0 msgr2=0x7f911c0ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f91225c4640 1 --2- 172.21.15.177:0/1373092690 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f911c13f5f0 0x7f911c0ce200 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9114009dc0 tx=0x7f911401c970 comp rx=0 tx=0).stop 2023-11-28T20:08:27.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f91225c4640 1 -- 172.21.15.177:0/1373092690 shutdown_connections 2023-11-28T20:08:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f91225c4640 1 --2- 172.21.15.177:0/1373092690 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f911c13f5f0 0x7f911c0ce200 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f91225c4640 1 -- 172.21.15.177:0/1373092690 >> 172.21.15.177:0/1373092690 conn(0x7f911c0b0cc0 msgr2=0x7f911c0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f91225c4640 1 -- 172.21.15.177:0/1373092690 shutdown_connections 2023-11-28T20:08:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f91225c4640 1 -- 172.21.15.177:0/1373092690 wait complete. 2023-11-28T20:08:27.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f91225c4640 1 Processor -- start 2023-11-28T20:08:27.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f91225c4640 1 -- start start 2023-11-28T20:08:27.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f91225c4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f911c071d90 0x7f911c13b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f91225c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f911c13f5f0 0x7f911c142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f91225c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f911c15adb0 0x7f911c142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f91225c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c153a30 con 0x7f911c15adb0 2023-11-28T20:08:27.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f91225c4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c13b8a0 con 0x7f911c071d90 2023-11-28T20:08:27.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f91225c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c1426f0 con 0x7f911c13f5f0 2023-11-28T20:08:27.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f9120b61640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f911c15adb0 0x7f911c142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f9120b61640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f911c15adb0 0x7f911c142ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53444/0 (socket says 172.21.15.177:53444) 2023-11-28T20:08:27.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f9120b61640 1 -- 172.21.15.177:0/788639622 learned_addr learned my addr 172.21.15.177:0/788639622 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:27.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f911bfff640 1 --2- 172.21.15.177:0/788639622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f911c071d90 0x7f911c13b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.555+0000 7f911b7fe640 1 --2- 172.21.15.177:0/788639622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f911c13f5f0 0x7f911c142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f9120b61640 1 -- 172.21.15.177:0/788639622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f911c13f5f0 msgr2=0x7f911c142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f9120b61640 1 --2- 172.21.15.177:0/788639622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f911c13f5f0 0x7f911c142ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f9120b61640 1 -- 172.21.15.177:0/788639622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f911c071d90 msgr2=0x7f911c13b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f9120b61640 1 --2- 172.21.15.177:0/788639622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f911c071d90 0x7f911c13b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f9120b61640 1 -- 172.21.15.177:0/788639622 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114009a70 con 0x7f911c15adb0 2023-11-28T20:08:27.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f9120b61640 1 --2- 172.21.15.177:0/788639622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f911c15adb0 0x7f911c142ff0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9114098440 tx=0x7f9114019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:27.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f9118ff9640 1 -- 172.21.15.177:0/788639622 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140adcd0 con 0x7f911c15adb0 2023-11-28T20:08:27.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f9118ff9640 1 -- 172.21.15.177:0/788639622 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91140ade30 con 0x7f911c15adb0 2023-11-28T20:08:27.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f91225c4640 1 -- 172.21.15.177:0/788639622 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911c1fa8a0 con 0x7f911c15adb0 2023-11-28T20:08:27.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f9118ff9640 1 -- 172.21.15.177:0/788639622 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140b9670 con 0x7f911c15adb0 2023-11-28T20:08:27.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f91225c4640 1 -- 172.21.15.177:0/788639622 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911c1f9dc0 con 0x7f911c15adb0 2023-11-28T20:08:27.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f91225c4640 1 -- 172.21.15.177:0/788639622 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911c0693d0 con 0x7f911c15adb0 2023-11-28T20:08:27.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f9118ff9640 1 -- 172.21.15.177:0/788639622 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91140b97d0 con 0x7f911c15adb0 2023-11-28T20:08:27.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f9118ff9640 1 --2- 172.21.15.177:0/788639622 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9108066470 0x7f9108068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f9118ff9640 1 -- 172.21.15.177:0/788639622 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f911411f600 con 0x7f911c15adb0 2023-11-28T20:08:27.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.559+0000 7f911bfff640 1 --2- 172.21.15.177:0/788639622 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9108066470 0x7f9108068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.563+0000 7f911bfff640 1 --2- 172.21.15.177:0/788639622 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9108066470 0x7f9108068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f910c007fd0 tx=0x7f910c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:27.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.563+0000 7f9118ff9640 1 -- 172.21.15.177:0/788639622 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91140eca00 con 0x7f911c15adb0 2023-11-28T20:08:27.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.715+0000 7f91225c4640 1 -- 172.21.15.177:0/788639622 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f911c06e710 con 0x7f911c15adb0 2023-11-28T20:08:27.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.715+0000 7f9118ff9640 1 -- 172.21.15.177:0/788639622 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91140f0020 con 0x7f911c15adb0 2023-11-28T20:08:27.722 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:27.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.719+0000 7f91225c4640 1 -- 172.21.15.177:0/788639622 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9108066470 msgr2=0x7f9108068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.719+0000 7f91225c4640 1 --2- 172.21.15.177:0/788639622 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9108066470 0x7f9108068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f910c007fd0 tx=0x7f910c009040 comp rx=0 tx=0).stop 2023-11-28T20:08:27.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.719+0000 7f91225c4640 1 -- 172.21.15.177:0/788639622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f911c15adb0 msgr2=0x7f911c142ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.719+0000 7f91225c4640 1 --2- 172.21.15.177:0/788639622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f911c15adb0 0x7f911c142ff0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9114098440 tx=0x7f9114019710 comp rx=0 tx=0).stop 2023-11-28T20:08:27.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.719+0000 7f91225c4640 1 -- 172.21.15.177:0/788639622 shutdown_connections 2023-11-28T20:08:27.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.719+0000 7f91225c4640 1 --2- 172.21.15.177:0/788639622 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9108066470 0x7f9108068930 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.719+0000 7f91225c4640 1 --2- 172.21.15.177:0/788639622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f911c15adb0 0x7f911c142ff0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.719+0000 7f91225c4640 1 --2- 172.21.15.177:0/788639622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f911c13f5f0 0x7f911c142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.719+0000 7f91225c4640 1 --2- 172.21.15.177:0/788639622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f911c071d90 0x7f911c13b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.719+0000 7f91225c4640 1 -- 172.21.15.177:0/788639622 >> 172.21.15.177:0/788639622 conn(0x7f911c0b0cc0 msgr2=0x7f911c158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:27.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.719+0000 7f91225c4640 1 -- 172.21.15.177:0/788639622 shutdown_connections 2023-11-28T20:08:27.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.719+0000 7f91225c4640 1 -- 172.21.15.177:0/788639622 wait complete. 2023-11-28T20:08:27.743 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:08:27.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.875+0000 7f2948009640 1 Processor -- start 2023-11-28T20:08:27.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.879+0000 7f2948009640 1 -- start start 2023-11-28T20:08:27.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.879+0000 7f2948009640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f294015ad40 0x7f2940164df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.879+0000 7f2948009640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294015b170 con 0x7f294013cf30 2023-11-28T20:08:27.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.879+0000 7f2948009640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294015b3a0 con 0x7f294006c9d0 2023-11-28T20:08:27.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.879+0000 7f2948009640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294013d310 con 0x7f294015ad40 2023-11-28T20:08:27.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.879+0000 7f2945da5640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f294013cf30 0x7f294006c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45302/0 (socket says 172.21.15.177:45302) 2023-11-28T20:08:27.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.879+0000 7f2945da5640 1 -- 172.21.15.177:0/3148121375 learned_addr learned my addr 172.21.15.177:0/3148121375 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:27.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.879+0000 7f29465a6640 1 --2- 172.21.15.177:0/3148121375 >> v2:172.21.15.177:3300/0 conn(0x7f294015ad40 0x7f2940164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.879+0000 7f29465a6640 1 -- 172.21.15.177:0/3148121375 >> v1:172.21.15.195:6789/0 conn(0x7f294006c9d0 legacy=0x7f294015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.879+0000 7f29465a6640 1 -- 172.21.15.177:0/3148121375 >> v1:172.21.15.177:6789/0 conn(0x7f294013cf30 legacy=0x7f294006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.879+0000 7f29465a6640 1 -- 172.21.15.177:0/3148121375 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294013f720 con 0x7f294015ad40 2023-11-28T20:08:27.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.883+0000 7f29465a6640 1 --2- 172.21.15.177:0/3148121375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f294015ad40 0x7f2940164df0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2938009d90 tx=0x7f293801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cce2c35b45fb30 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:27.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.883+0000 7f2944da3640 1 -- 172.21.15.177:0/3148121375 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29380a5870 con 0x7f294015ad40 2023-11-28T20:08:27.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.883+0000 7f2944da3640 1 -- 172.21.15.177:0/3148121375 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29380a59d0 con 0x7f294015ad40 2023-11-28T20:08:27.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.883+0000 7f2944da3640 1 -- 172.21.15.177:0/3148121375 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29380a5d60 con 0x7f294015ad40 2023-11-28T20:08:27.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.883+0000 7f2948009640 1 -- 172.21.15.177:0/3148121375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f294015ad40 msgr2=0x7f2940164df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.883+0000 7f2948009640 1 --2- 172.21.15.177:0/3148121375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f294015ad40 0x7f2940164df0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2938009d90 tx=0x7f293801c8c0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.883+0000 7f2948009640 1 -- 172.21.15.177:0/3148121375 shutdown_connections 2023-11-28T20:08:27.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.883+0000 7f2948009640 1 --2- 172.21.15.177:0/3148121375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f294015ad40 0x7f2940164df0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.883+0000 7f2948009640 1 -- 172.21.15.177:0/3148121375 >> 172.21.15.177:0/3148121375 conn(0x7f294006a530 msgr2=0x7f294006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:27.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.883+0000 7f2948009640 1 -- 172.21.15.177:0/3148121375 shutdown_connections 2023-11-28T20:08:27.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.883+0000 7f2948009640 1 -- 172.21.15.177:0/3148121375 wait complete. 2023-11-28T20:08:27.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.883+0000 7f2948009640 1 Processor -- start 2023-11-28T20:08:27.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.883+0000 7f2948009640 1 -- start start 2023-11-28T20:08:27.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f2948009640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f294006c9d0 0x7f2940136960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f2948009640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f294013cf30 0x7f2940151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f2948009640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f294015ad40 0x7f294013e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f2948009640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2940151ad0 con 0x7f294015ad40 2023-11-28T20:08:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f2948009640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294014f450 con 0x7f294006c9d0 2023-11-28T20:08:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f2948009640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294014f730 con 0x7f294013cf30 2023-11-28T20:08:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f29465a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f294015ad40 0x7f294013e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f2945da5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f294006c9d0 0x7f2940136960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f29465a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f294015ad40 0x7f294013e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53460/0 (socket says 172.21.15.177:53460) 2023-11-28T20:08:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f29465a6640 1 -- 172.21.15.177:0/3910789872 learned_addr learned my addr 172.21.15.177:0/3910789872 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f29455a4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f294013cf30 0x7f2940151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f29465a6640 1 -- 172.21.15.177:0/3910789872 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f294013cf30 msgr2=0x7f2940151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f29465a6640 1 --2- 172.21.15.177:0/3910789872 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f294013cf30 0x7f2940151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f29465a6640 1 -- 172.21.15.177:0/3910789872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f294006c9d0 msgr2=0x7f2940136960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f29465a6640 1 --2- 172.21.15.177:0/3910789872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f294006c9d0 0x7f2940136960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f29465a6640 1 -- 172.21.15.177:0/3910789872 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2938009a70 con 0x7f294015ad40 2023-11-28T20:08:27.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f29465a6640 1 --2- 172.21.15.177:0/3910789872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f294015ad40 0x7f294013e5e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f29380b0040 tx=0x7f2938019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:27.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f29367fc640 1 -- 172.21.15.177:0/3910789872 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29380b9860 con 0x7f294015ad40 2023-11-28T20:08:27.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f29367fc640 1 -- 172.21.15.177:0/3910789872 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29380b99c0 con 0x7f294015ad40 2023-11-28T20:08:27.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f29367fc640 1 -- 172.21.15.177:0/3910789872 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29380b9d50 con 0x7f294015ad40 2023-11-28T20:08:27.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f2948009640 1 -- 172.21.15.177:0/3910789872 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294014fa10 con 0x7f294015ad40 2023-11-28T20:08:27.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f2948009640 1 -- 172.21.15.177:0/3910789872 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294014ffd0 con 0x7f294015ad40 2023-11-28T20:08:27.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.887+0000 7f2948009640 1 -- 172.21.15.177:0/3910789872 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294006cfe0 con 0x7f294015ad40 2023-11-28T20:08:27.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.891+0000 7f29367fc640 1 -- 172.21.15.177:0/3910789872 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f29380ad440 con 0x7f294015ad40 2023-11-28T20:08:27.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.891+0000 7f29367fc640 1 --2- 172.21.15.177:0/3910789872 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2924066470 0x7f2924068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:27.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.891+0000 7f29367fc640 1 -- 172.21.15.177:0/3910789872 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f293811f200 con 0x7f294015ad40 2023-11-28T20:08:27.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.891+0000 7f2945da5640 1 --2- 172.21.15.177:0/3910789872 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2924066470 0x7f2924068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:27.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.891+0000 7f2945da5640 1 --2- 172.21.15.177:0/3910789872 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2924066470 0x7f2924068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f293c005890 tx=0x7f293c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:27.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:27.895+0000 7f29367fc640 1 -- 172.21.15.177:0/3910789872 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f29380ec7d0 con 0x7f294015ad40 2023-11-28T20:08:28.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.075+0000 7f2948009640 1 -- 172.21.15.177:0/3910789872 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2940069440 con 0x7f294015ad40 2023-11-28T20:08:28.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.075+0000 7f29367fc640 1 -- 172.21.15.177:0/3910789872 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f29380efdf0 con 0x7f294015ad40 2023-11-28T20:08:28.080 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:28.080 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2688190991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2688190991},{"type":"v1","addr":"172.21.15.177:6835","nonce":2688190991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/17424302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":17424302},{"type":"v1","addr":"172.21.15.177:6837","nonce":17424302}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3833908165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3833908165},{"type":"v1","addr":"172.21.15.195:6834","nonce":3833908165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:07:41.477909+0000","modified":"2023-11-28T20:07:44.615409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6835/1726998944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1726998944},{"type":"v1","addr":"172.21.15.195:6835","nonce":1726998944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T20:08:28.080 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-28T20:08:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.075+0000 7f2948009640 1 -- 172.21.15.177:0/3910789872 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2924066470 msgr2=0x7f2924068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.075+0000 7f2948009640 1 --2- 172.21.15.177:0/3910789872 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2924066470 0x7f2924068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f293c005890 tx=0x7f293c009040 comp rx=0 tx=0).stop 2023-11-28T20:08:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.075+0000 7f2948009640 1 -- 172.21.15.177:0/3910789872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f294015ad40 msgr2=0x7f294013e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.075+0000 7f2948009640 1 --2- 172.21.15.177:0/3910789872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f294015ad40 0x7f294013e5e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f29380b0040 tx=0x7f2938019660 comp rx=0 tx=0).stop 2023-11-28T20:08:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.075+0000 7f2948009640 1 -- 172.21.15.177:0/3910789872 shutdown_connections 2023-11-28T20:08:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.075+0000 7f2948009640 1 --2- 172.21.15.177:0/3910789872 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2924066470 0x7f2924068930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.075+0000 7f2948009640 1 --2- 172.21.15.177:0/3910789872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f294015ad40 0x7f294013e5e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.075+0000 7f2948009640 1 --2- 172.21.15.177:0/3910789872 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f294013cf30 0x7f2940151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.075+0000 7f2948009640 1 --2- 172.21.15.177:0/3910789872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f294006c9d0 0x7f2940136960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.075+0000 7f2948009640 1 -- 172.21.15.177:0/3910789872 >> 172.21.15.177:0/3910789872 conn(0x7f294006a530 msgr2=0x7f2940071df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.075+0000 7f2948009640 1 -- 172.21.15.177:0/3910789872 shutdown_connections 2023-11-28T20:08:28.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.075+0000 7f2948009640 1 -- 172.21.15.177:0/3910789872 wait complete. 2023-11-28T20:08:28.101 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:28.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.231+0000 7f70bf2bb640 1 Processor -- start 2023-11-28T20:08:28.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.235+0000 7f70bf2bb640 1 -- start start 2023-11-28T20:08:28.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.235+0000 7f70bf2bb640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f70b8144840 0x7f70b806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.235+0000 7f70bf2bb640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f70b8070b70 0x7f70b806c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.235+0000 7f70bf2bb640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b80710e0 con 0x7f70b8072180 2023-11-28T20:08:28.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.235+0000 7f70bf2bb640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b815f010 con 0x7f70b8070b70 2023-11-28T20:08:28.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.235+0000 7f70bf2bb640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b80713c0 con 0x7f70b8144840 2023-11-28T20:08:28.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.235+0000 7f70bd858640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f70b8070b70 0x7f70b806c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.235+0000 7f70bd858640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f70b8070b70 0x7f70b806c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53468/0 (socket says 172.21.15.177:53468) 2023-11-28T20:08:28.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.235+0000 7f70bd858640 1 -- 172.21.15.177:0/2123346055 learned_addr learned my addr 172.21.15.177:0/2123346055 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:28.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.235+0000 7f70bd057640 1 --2- 172.21.15.177:0/2123346055 >> v2:172.21.15.195:3300/0 conn(0x7f70b8144840 0x7f70b806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.235+0000 7f70bd858640 1 -- 172.21.15.177:0/2123346055 >> v2:172.21.15.195:3300/0 conn(0x7f70b8144840 msgr2=0x7f70b806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:28.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.235+0000 7f70bd858640 1 --2- 172.21.15.177:0/2123346055 >> v2:172.21.15.195:3300/0 conn(0x7f70b8144840 0x7f70b806c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.235+0000 7f70bd858640 1 -- 172.21.15.177:0/2123346055 >> v1:172.21.15.177:6789/0 conn(0x7f70b8072180 legacy=0x7f70b8070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.235+0000 7f70bd858640 1 -- 172.21.15.177:0/2123346055 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b80716a0 con 0x7f70b8070b70 2023-11-28T20:08:28.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.239+0000 7f70bd858640 1 --2- 172.21.15.177:0/2123346055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70b8070b70 0x7f70b806c800 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f70b8068020 tx=0x7f70b001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4620b05effb4e6fe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:28.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.239+0000 7f70affff640 1 -- 172.21.15.177:0/2123346055 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b00a5860 con 0x7f70b8070b70 2023-11-28T20:08:28.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.239+0000 7f70affff640 1 -- 172.21.15.177:0/2123346055 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b00a59c0 con 0x7f70b8070b70 2023-11-28T20:08:28.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.239+0000 7f70affff640 1 -- 172.21.15.177:0/2123346055 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b00a5d50 con 0x7f70b8070b70 2023-11-28T20:08:28.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.239+0000 7f70bf2bb640 1 -- 172.21.15.177:0/2123346055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70b8070b70 msgr2=0x7f70b806c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.239+0000 7f70bf2bb640 1 --2- 172.21.15.177:0/2123346055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70b8070b70 0x7f70b806c800 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f70b8068020 tx=0x7f70b001c9a0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.239+0000 7f70bf2bb640 1 -- 172.21.15.177:0/2123346055 shutdown_connections 2023-11-28T20:08:28.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.239+0000 7f70bf2bb640 1 --2- 172.21.15.177:0/2123346055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70b8070b70 0x7f70b806c800 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.239+0000 7f70bf2bb640 1 --2- 172.21.15.177:0/2123346055 >> v2:172.21.15.195:3300/0 conn(0x7f70b8144840 0x7f70b806c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.239+0000 7f70bf2bb640 1 -- 172.21.15.177:0/2123346055 >> 172.21.15.177:0/2123346055 conn(0x7f70b806a530 msgr2=0x7f70b806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:28.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.239+0000 7f70bf2bb640 1 -- 172.21.15.177:0/2123346055 shutdown_connections 2023-11-28T20:08:28.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.239+0000 7f70bf2bb640 1 -- 172.21.15.177:0/2123346055 wait complete. 2023-11-28T20:08:28.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.239+0000 7f70bf2bb640 1 Processor -- start 2023-11-28T20:08:28.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.239+0000 7f70bf2bb640 1 -- start start 2023-11-28T20:08:28.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bf2bb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70b8070b70 0x7f70b8143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bf2bb640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70b8072180 0x7f70b8159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bf2bb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70b8144840 0x7f70b80b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bf2bb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b815a4b0 con 0x7f70b8070b70 2023-11-28T20:08:28.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bf2bb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80b3e40 con 0x7f70b8144840 2023-11-28T20:08:28.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bf2bb640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8165050 con 0x7f70b8072180 2023-11-28T20:08:28.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bd057640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70b8070b70 0x7f70b8143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bd057640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70b8070b70 0x7f70b8143220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53480/0 (socket says 172.21.15.177:53480) 2023-11-28T20:08:28.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bd057640 1 -- 172.21.15.177:0/2001322292 learned_addr learned my addr 172.21.15.177:0/2001322292 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:28.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bd858640 1 --2- 172.21.15.177:0/2001322292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70b8144840 0x7f70b80b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bd057640 1 -- 172.21.15.177:0/2001322292 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70b8072180 msgr2=0x7f70b8159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bd057640 1 --2- 172.21.15.177:0/2001322292 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70b8072180 0x7f70b8159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bd057640 1 -- 172.21.15.177:0/2001322292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70b8144840 msgr2=0x7f70b80b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bd057640 1 --2- 172.21.15.177:0/2001322292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70b8144840 0x7f70b80b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bd057640 1 -- 172.21.15.177:0/2001322292 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b0009b30 con 0x7f70b8070b70 2023-11-28T20:08:28.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bd057640 1 --2- 172.21.15.177:0/2001322292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70b8070b70 0x7f70b8143220 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f70b400d5f0 tx=0x7f70b400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:28.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70adffb640 1 -- 172.21.15.177:0/2001322292 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b40125f0 con 0x7f70b8070b70 2023-11-28T20:08:28.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70adffb640 1 -- 172.21.15.177:0/2001322292 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b4012750 con 0x7f70b8070b70 2023-11-28T20:08:28.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70adffb640 1 -- 172.21.15.177:0/2001322292 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4012ae0 con 0x7f70b8070b70 2023-11-28T20:08:28.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bf2bb640 1 -- 172.21.15.177:0/2001322292 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b8165330 con 0x7f70b8070b70 2023-11-28T20:08:28.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bf2bb640 1 -- 172.21.15.177:0/2001322292 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b8164d10 con 0x7f70b8070b70 2023-11-28T20:08:28.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70bf2bb640 1 -- 172.21.15.177:0/2001322292 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b8069440 con 0x7f70b8070b70 2023-11-28T20:08:28.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.243+0000 7f70adffb640 1 -- 172.21.15.177:0/2001322292 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f70b4012c40 con 0x7f70b8070b70 2023-11-28T20:08:28.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.247+0000 7f70adffb640 1 --2- 172.21.15.177:0/2001322292 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f709c0664a0 0x7f709c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.247+0000 7f70adffb640 1 -- 172.21.15.177:0/2001322292 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f70b40843f0 con 0x7f70b8070b70 2023-11-28T20:08:28.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.247+0000 7f70bc856640 1 --2- 172.21.15.177:0/2001322292 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f709c0664a0 0x7f709c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.247+0000 7f70bc856640 1 --2- 172.21.15.177:0/2001322292 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f709c0664a0 0x7f709c068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f70a8000f70 tx=0x7f70a80079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:28.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.251+0000 7f70adffb640 1 -- 172.21.15.177:0/2001322292 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f70b40517e0 con 0x7f70b8070b70 2023-11-28T20:08:28.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.403+0000 7f70bf2bb640 1 -- 172.21.15.177:0/2001322292 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70b806d170 con 0x7f70b8070b70 2023-11-28T20:08:28.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.403+0000 7f70adffb640 1 -- 172.21.15.177:0/2001322292 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16861 (secure 0 0 0) 0x7f70b4004650 con 0x7f70b8070b70 2023-11-28T20:08:28.408 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:28.408 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":22,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:23.248475+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:28.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.403+0000 7f70bf2bb640 1 -- 172.21.15.177:0/2001322292 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f709c0664a0 msgr2=0x7f709c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.403+0000 7f70bf2bb640 1 --2- 172.21.15.177:0/2001322292 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f709c0664a0 0x7f709c068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f70a8000f70 tx=0x7f70a80079c0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.403+0000 7f70bf2bb640 1 -- 172.21.15.177:0/2001322292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70b8070b70 msgr2=0x7f70b8143220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.403+0000 7f70bf2bb640 1 --2- 172.21.15.177:0/2001322292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70b8070b70 0x7f70b8143220 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f70b400d5f0 tx=0x7f70b400dab0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.407+0000 7f70bf2bb640 1 -- 172.21.15.177:0/2001322292 shutdown_connections 2023-11-28T20:08:28.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.407+0000 7f70bf2bb640 1 --2- 172.21.15.177:0/2001322292 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f709c0664a0 0x7f709c068960 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.407+0000 7f70bf2bb640 1 --2- 172.21.15.177:0/2001322292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70b8144840 0x7f70b80b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.407+0000 7f70bf2bb640 1 --2- 172.21.15.177:0/2001322292 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70b8072180 0x7f70b8159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.407+0000 7f70bf2bb640 1 --2- 172.21.15.177:0/2001322292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70b8070b70 0x7f70b8143220 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.407+0000 7f70bf2bb640 1 -- 172.21.15.177:0/2001322292 >> 172.21.15.177:0/2001322292 conn(0x7f70b806a530 msgr2=0x7f70b806c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:28.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.407+0000 7f70bf2bb640 1 -- 172.21.15.177:0/2001322292 shutdown_connections 2023-11-28T20:08:28.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.407+0000 7f70bf2bb640 1 -- 172.21.15.177:0/2001322292 wait complete. 2023-11-28T20:08:28.430 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T20:08:28.430 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:08:28.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269f1c4640 1 Processor -- start 2023-11-28T20:08:28.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269f1c4640 1 -- start start 2023-11-28T20:08:28.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269f1c4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2698144840 0x7f269806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269f1c4640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2698072180 0x7f269806c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269f1c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2698070460 0x7f26980708e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269f1c4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f269815f010 con 0x7f2698144840 2023-11-28T20:08:28.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269f1c4640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2698070e20 con 0x7f2698072180 2023-11-28T20:08:28.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269f1c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26980710e0 con 0x7f2698070460 2023-11-28T20:08:28.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269cf60640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2698144840 0x7f269806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269cf60640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2698144840 0x7f269806c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53486/0 (socket says 172.21.15.177:53486) 2023-11-28T20:08:28.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269cf60640 1 -- 172.21.15.177:0/1909211237 learned_addr learned my addr 172.21.15.177:0/1909211237 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:28.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269d761640 1 --2- 172.21.15.177:0/1909211237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2698070460 0x7f26980708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f268ffff640 1 --2- 172.21.15.177:0/1909211237 >> v2:172.21.15.195:3300/0 conn(0x7f2698072180 0x7f269806c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269cf60640 1 -- 172.21.15.177:0/1909211237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2698070460 msgr2=0x7f26980708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:28.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269cf60640 1 --2- 172.21.15.177:0/1909211237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2698070460 0x7f26980708e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269cf60640 1 -- 172.21.15.177:0/1909211237 >> v2:172.21.15.195:3300/0 conn(0x7f2698072180 msgr2=0x7f269806c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:28.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269cf60640 1 --2- 172.21.15.177:0/1909211237 >> v2:172.21.15.195:3300/0 conn(0x7f2698072180 0x7f269806c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.567+0000 7f269cf60640 1 -- 172.21.15.177:0/1909211237 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26980713c0 con 0x7f2698144840 2023-11-28T20:08:28.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.571+0000 7f269cf60640 1 --2- 172.21.15.177:0/1909211237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2698144840 0x7f269806c2c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f269806d140 tx=0x7f269401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec7d62e88611989 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:28.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.571+0000 7f268f7fe640 1 -- 172.21.15.177:0/1909211237 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26940aa5f0 con 0x7f2698144840 2023-11-28T20:08:28.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.571+0000 7f268f7fe640 1 -- 172.21.15.177:0/1909211237 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26940aa750 con 0x7f2698144840 2023-11-28T20:08:28.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.571+0000 7f268f7fe640 1 -- 172.21.15.177:0/1909211237 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26940aaae0 con 0x7f2698144840 2023-11-28T20:08:28.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.571+0000 7f269f1c4640 1 -- 172.21.15.177:0/1909211237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2698144840 msgr2=0x7f269806c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.571+0000 7f269f1c4640 1 --2- 172.21.15.177:0/1909211237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2698144840 0x7f269806c2c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f269806d140 tx=0x7f269401c4d0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.571+0000 7f269f1c4640 1 -- 172.21.15.177:0/1909211237 shutdown_connections 2023-11-28T20:08:28.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.571+0000 7f269f1c4640 1 --2- 172.21.15.177:0/1909211237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2698070460 0x7f26980708e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.571+0000 7f269f1c4640 1 --2- 172.21.15.177:0/1909211237 >> v2:172.21.15.195:3300/0 conn(0x7f2698072180 0x7f269806c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.571+0000 7f269f1c4640 1 --2- 172.21.15.177:0/1909211237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2698144840 0x7f269806c2c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.571+0000 7f269f1c4640 1 -- 172.21.15.177:0/1909211237 >> 172.21.15.177:0/1909211237 conn(0x7f269806a530 msgr2=0x7f269806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:28.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.571+0000 7f269f1c4640 1 -- 172.21.15.177:0/1909211237 shutdown_connections 2023-11-28T20:08:28.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.571+0000 7f269f1c4640 1 -- 172.21.15.177:0/1909211237 wait complete. 2023-11-28T20:08:28.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269f1c4640 1 Processor -- start 2023-11-28T20:08:28.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269f1c4640 1 -- start start 2023-11-28T20:08:28.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269f1c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2698070460 0x7f2698158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269f1c4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2698072180 0x7f26981408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269f1c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2698144840 0x7f269815fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269f1c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2698159940 con 0x7f2698070460 2023-11-28T20:08:28.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269f1c4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2698158cc0 con 0x7f2698072180 2023-11-28T20:08:28.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269f1c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2698158fa0 con 0x7f2698144840 2023-11-28T20:08:28.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269cf60640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2698070460 0x7f2698158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269cf60640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2698070460 0x7f2698158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53502/0 (socket says 172.21.15.177:53502) 2023-11-28T20:08:28.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269cf60640 1 -- 172.21.15.177:0/3350298700 learned_addr learned my addr 172.21.15.177:0/3350298700 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:28.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f268ffff640 1 --2- 172.21.15.177:0/3350298700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2698072180 0x7f26981408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269d761640 1 --2- 172.21.15.177:0/3350298700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2698144840 0x7f269815fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269cf60640 1 -- 172.21.15.177:0/3350298700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2698144840 msgr2=0x7f269815fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269cf60640 1 --2- 172.21.15.177:0/3350298700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2698144840 0x7f269815fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269cf60640 1 -- 172.21.15.177:0/3350298700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2698072180 msgr2=0x7f26981408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269cf60640 1 --2- 172.21.15.177:0/3350298700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2698072180 0x7f26981408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269cf60640 1 -- 172.21.15.177:0/3350298700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26940094d0 con 0x7f2698070460 2023-11-28T20:08:28.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269d761640 1 --2- 172.21.15.177:0/3350298700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2698144840 0x7f269815fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:28.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269cf60640 1 --2- 172.21.15.177:0/3350298700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2698070460 0x7f2698158460 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f269401ab80 tx=0x7f269401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:28.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f268d7fa640 1 -- 172.21.15.177:0/3350298700 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26940b3800 con 0x7f2698070460 2023-11-28T20:08:28.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f268d7fa640 1 -- 172.21.15.177:0/3350298700 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26940b3980 con 0x7f2698070460 2023-11-28T20:08:28.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f268d7fa640 1 -- 172.21.15.177:0/3350298700 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26940b3d30 con 0x7f2698070460 2023-11-28T20:08:28.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269f1c4640 1 -- 172.21.15.177:0/3350298700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2698159280 con 0x7f2698070460 2023-11-28T20:08:28.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.575+0000 7f269f1c4640 1 -- 172.21.15.177:0/3350298700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26981589a0 con 0x7f2698070460 2023-11-28T20:08:28.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.579+0000 7f269f1c4640 1 -- 172.21.15.177:0/3350298700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26981590e0 con 0x7f2698070460 2023-11-28T20:08:28.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.579+0000 7f268d7fa640 1 -- 172.21.15.177:0/3350298700 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f26940b2380 con 0x7f2698070460 2023-11-28T20:08:28.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.579+0000 7f268d7fa640 1 --2- 172.21.15.177:0/3350298700 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2684066470 0x7f2684068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.579+0000 7f268d7fa640 1 -- 172.21.15.177:0/3350298700 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f26940a7070 con 0x7f2698070460 2023-11-28T20:08:28.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.579+0000 7f268ffff640 1 --2- 172.21.15.177:0/3350298700 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2684066470 0x7f2684068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.579+0000 7f268ffff640 1 --2- 172.21.15.177:0/3350298700 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2684066470 0x7f2684068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f26981406b0 tx=0x7f2688008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:28.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.583+0000 7f268d7fa640 1 -- 172.21.15.177:0/3350298700 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f26981590e0 con 0x7f2698070460 2023-11-28T20:08:28.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.763+0000 7f269f1c4640 1 -- 172.21.15.177:0/3350298700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26981590e0 con 0x7f2698070460 2023-11-28T20:08:28.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.763+0000 7f268d7fa640 1 -- 172.21.15.177:0/3350298700 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f26981590e0 con 0x7f2698070460 2023-11-28T20:08:28.769 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:28.769 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2688190991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2688190991},{"type":"v1","addr":"172.21.15.177:6835","nonce":2688190991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/17424302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":17424302},{"type":"v1","addr":"172.21.15.177:6837","nonce":17424302}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3833908165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3833908165},{"type":"v1","addr":"172.21.15.195:6834","nonce":3833908165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:07:41.477909+0000","modified":"2023-11-28T20:07:44.615409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6835/1726998944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1726998944},{"type":"v1","addr":"172.21.15.195:6835","nonce":1726998944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T20:08:28.769 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-28T20:08:28.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.763+0000 7f269f1c4640 1 -- 172.21.15.177:0/3350298700 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2684066470 msgr2=0x7f2684068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.763+0000 7f269f1c4640 1 --2- 172.21.15.177:0/3350298700 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2684066470 0x7f2684068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f26981406b0 tx=0x7f2688008040 comp rx=0 tx=0).stop 2023-11-28T20:08:28.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.763+0000 7f269f1c4640 1 -- 172.21.15.177:0/3350298700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2698070460 msgr2=0x7f2698158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.763+0000 7f269f1c4640 1 --2- 172.21.15.177:0/3350298700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2698070460 0x7f2698158460 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f269401ab80 tx=0x7f269401ad10 comp rx=0 tx=0).stop 2023-11-28T20:08:28.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.767+0000 7f269f1c4640 1 -- 172.21.15.177:0/3350298700 shutdown_connections 2023-11-28T20:08:28.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.767+0000 7f269f1c4640 1 --2- 172.21.15.177:0/3350298700 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2684066470 0x7f2684068930 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.767+0000 7f269f1c4640 1 --2- 172.21.15.177:0/3350298700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2698144840 0x7f269815fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.767+0000 7f269f1c4640 1 --2- 172.21.15.177:0/3350298700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2698072180 0x7f26981408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.767+0000 7f269f1c4640 1 --2- 172.21.15.177:0/3350298700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2698070460 0x7f2698158460 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.767+0000 7f269f1c4640 1 -- 172.21.15.177:0/3350298700 >> 172.21.15.177:0/3350298700 conn(0x7f269806a530 msgr2=0x7f2698143ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:28.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.767+0000 7f269f1c4640 1 -- 172.21.15.177:0/3350298700 shutdown_connections 2023-11-28T20:08:28.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.767+0000 7f269f1c4640 1 -- 172.21.15.177:0/3350298700 wait complete. 2023-11-28T20:08:28.790 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:08:28.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.923+0000 7f72d3ff8640 1 Processor -- start 2023-11-28T20:08:28.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.923+0000 7f72d3ff8640 1 -- start start 2023-11-28T20:08:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.923+0000 7f72d3ff8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f72cc06c9d0 0x7f72cc145250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.923+0000 7f72d3ff8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc145fc0 con 0x7f72cc15bc90 2023-11-28T20:08:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.923+0000 7f72d3ff8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc1462a0 con 0x7f72cc15c070 2023-11-28T20:08:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.923+0000 7f72d3ff8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc146580 con 0x7f72cc06c9d0 2023-11-28T20:08:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.923+0000 7f72d1593640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f72cc06c9d0 0x7f72cc145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.923+0000 7f72d1593640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f72cc06c9d0 0x7f72cc145250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34798/0 (socket says 172.21.15.177:34798) 2023-11-28T20:08:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.923+0000 7f72d1593640 1 -- 172.21.15.177:0/3312876885 learned_addr learned my addr 172.21.15.177:0/3312876885 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.923+0000 7f72d1d94640 1 --1- 172.21.15.177:0/3312876885 >> v1:172.21.15.177:6789/0 conn(0x7f72cc15bc90 0x7f72cc06c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44320/0 (socket says 172.21.15.177:44320) 2023-11-28T20:08:28.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.927+0000 7f72d1593640 1 -- 172.21.15.177:0/3312876885 >> v1:172.21.15.195:6789/0 conn(0x7f72cc15c070 legacy=0x7f72cc145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:28.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.927+0000 7f72d1593640 1 -- 172.21.15.177:0/3312876885 >> v1:172.21.15.177:6789/0 conn(0x7f72cc15bc90 legacy=0x7f72cc06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.927+0000 7f72d1593640 1 -- 172.21.15.177:0/3312876885 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc146860 con 0x7f72cc06c9d0 2023-11-28T20:08:28.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.927+0000 7f72d1593640 1 --2- 172.21.15.177:0/3312876885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72cc06c9d0 0x7f72cc145250 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0098a0 tx=0x7f72bc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c235a1b11541a7dd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:28.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.927+0000 7f72d0d92640 1 -- 172.21.15.177:0/3312876885 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0ab640 con 0x7f72cc06c9d0 2023-11-28T20:08:28.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.927+0000 7f72d0d92640 1 -- 172.21.15.177:0/3312876885 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc0a7070 con 0x7f72cc06c9d0 2023-11-28T20:08:28.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.927+0000 7f72d0d92640 1 -- 172.21.15.177:0/3312876885 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0ab9c0 con 0x7f72cc06c9d0 2023-11-28T20:08:28.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.927+0000 7f72d3ff8640 1 -- 172.21.15.177:0/3312876885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72cc06c9d0 msgr2=0x7f72cc145250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.927+0000 7f72d3ff8640 1 --2- 172.21.15.177:0/3312876885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72cc06c9d0 0x7f72cc145250 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0098a0 tx=0x7f72bc01c420 comp rx=0 tx=0).stop 2023-11-28T20:08:28.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.927+0000 7f72d3ff8640 1 -- 172.21.15.177:0/3312876885 shutdown_connections 2023-11-28T20:08:28.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.927+0000 7f72d3ff8640 1 --2- 172.21.15.177:0/3312876885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72cc06c9d0 0x7f72cc145250 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.927+0000 7f72d3ff8640 1 -- 172.21.15.177:0/3312876885 >> 172.21.15.177:0/3312876885 conn(0x7f72cc06a530 msgr2=0x7f72cc06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:28.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d3ff8640 1 -- 172.21.15.177:0/3312876885 shutdown_connections 2023-11-28T20:08:28.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d3ff8640 1 -- 172.21.15.177:0/3312876885 wait complete. 2023-11-28T20:08:28.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d3ff8640 1 Processor -- start 2023-11-28T20:08:28.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d3ff8640 1 -- start start 2023-11-28T20:08:28.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d3ff8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc06c9d0 0x7f72cc1fd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d3ff8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72cc15bc90 0x7f72cc13ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d3ff8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72cc15c070 0x7f72cc13ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d3ff8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc1fd720 con 0x7f72cc15bc90 2023-11-28T20:08:28.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d3ff8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc162820 con 0x7f72cc15c070 2023-11-28T20:08:28.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d3ff8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc13f4b0 con 0x7f72cc06c9d0 2023-11-28T20:08:28.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d1593640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72cc15bc90 0x7f72cc13ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d1593640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72cc15bc90 0x7f72cc13ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34812/0 (socket says 172.21.15.177:34812) 2023-11-28T20:08:28.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d1593640 1 -- 172.21.15.177:0/3900017295 learned_addr learned my addr 172.21.15.177:0/3900017295 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:28.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d1d94640 1 --2- 172.21.15.177:0/3900017295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc06c9d0 0x7f72cc1fd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d2595640 1 --2- 172.21.15.177:0/3900017295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72cc15c070 0x7f72cc13ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d1593640 1 -- 172.21.15.177:0/3900017295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc06c9d0 msgr2=0x7f72cc1fd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d1593640 1 --2- 172.21.15.177:0/3900017295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc06c9d0 0x7f72cc1fd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d1593640 1 -- 172.21.15.177:0/3900017295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72cc15c070 msgr2=0x7f72cc13ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:28.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d1593640 1 --2- 172.21.15.177:0/3900017295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72cc15c070 0x7f72cc13ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:28.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d1593640 1 -- 172.21.15.177:0/3900017295 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc0094d0 con 0x7f72cc15bc90 2023-11-28T20:08:28.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d2595640 1 --2- 172.21.15.177:0/3900017295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72cc15c070 0x7f72cc13ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:28.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.931+0000 7f72d1593640 1 --2- 172.21.15.177:0/3900017295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72cc15bc90 0x7f72cc13ea30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0ad040 tx=0x7f72bc01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:28.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.935+0000 7f72c27fc640 1 -- 172.21.15.177:0/3900017295 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0b4800 con 0x7f72cc15bc90 2023-11-28T20:08:28.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.935+0000 7f72c27fc640 1 -- 172.21.15.177:0/3900017295 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc0b49a0 con 0x7f72cc15bc90 2023-11-28T20:08:28.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.935+0000 7f72d3ff8640 1 -- 172.21.15.177:0/3900017295 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc164980 con 0x7f72cc15bc90 2023-11-28T20:08:28.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.935+0000 7f72c27fc640 1 -- 172.21.15.177:0/3900017295 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0b4d50 con 0x7f72cc15bc90 2023-11-28T20:08:28.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.935+0000 7f72d3ff8640 1 -- 172.21.15.177:0/3900017295 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72cc162ac0 con 0x7f72cc15bc90 2023-11-28T20:08:28.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.935+0000 7f72d3ff8640 1 -- 172.21.15.177:0/3900017295 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72cc073d60 con 0x7f72cc15bc90 2023-11-28T20:08:28.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.935+0000 7f72c27fc640 1 -- 172.21.15.177:0/3900017295 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f72bc0b3380 con 0x7f72cc15bc90 2023-11-28T20:08:28.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.935+0000 7f72c27fc640 1 --2- 172.21.15.177:0/3900017295 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f72b0066470 0x7f72b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:28.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.935+0000 7f72c27fc640 1 -- 172.21.15.177:0/3900017295 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f72bc11e6d0 con 0x7f72cc15bc90 2023-11-28T20:08:28.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.935+0000 7f72d1d94640 1 --2- 172.21.15.177:0/3900017295 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f72b0066470 0x7f72b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:28.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.935+0000 7f72d1d94640 1 --2- 172.21.15.177:0/3900017295 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f72b0066470 0x7f72b0068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f72c8000f70 tx=0x7f72c8007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:28.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:28.939+0000 7f72c27fc640 1 -- 172.21.15.177:0/3900017295 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f72bc0ebad0 con 0x7f72cc15bc90 2023-11-28T20:08:29.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.123+0000 7f72d3ff8640 1 -- 172.21.15.177:0/3900017295 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72cc069440 con 0x7f72cc15bc90 2023-11-28T20:08:29.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.123+0000 7f72c27fc640 1 -- 172.21.15.177:0/3900017295 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f72bc0ef0f0 con 0x7f72cc15bc90 2023-11-28T20:08:29.127 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:29.128 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2688190991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2688190991},{"type":"v1","addr":"172.21.15.177:6835","nonce":2688190991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/17424302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":17424302},{"type":"v1","addr":"172.21.15.177:6837","nonce":17424302}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3833908165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3833908165},{"type":"v1","addr":"172.21.15.195:6834","nonce":3833908165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:07:41.477909+0000","modified":"2023-11-28T20:07:44.615409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6835/1726998944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1726998944},{"type":"v1","addr":"172.21.15.195:6835","nonce":1726998944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T20:08:29.128 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-28T20:08:29.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.123+0000 7f72d3ff8640 1 -- 172.21.15.177:0/3900017295 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f72b0066470 msgr2=0x7f72b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.123+0000 7f72d3ff8640 1 --2- 172.21.15.177:0/3900017295 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f72b0066470 0x7f72b0068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f72c8000f70 tx=0x7f72c8007e50 comp rx=0 tx=0).stop 2023-11-28T20:08:29.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.123+0000 7f72d3ff8640 1 -- 172.21.15.177:0/3900017295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72cc15bc90 msgr2=0x7f72cc13ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.123+0000 7f72d3ff8640 1 --2- 172.21.15.177:0/3900017295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72cc15bc90 0x7f72cc13ea30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0ad040 tx=0x7f72bc01ac60 comp rx=0 tx=0).stop 2023-11-28T20:08:29.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.123+0000 7f72d3ff8640 1 -- 172.21.15.177:0/3900017295 shutdown_connections 2023-11-28T20:08:29.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.123+0000 7f72d3ff8640 1 --2- 172.21.15.177:0/3900017295 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f72b0066470 0x7f72b0068930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.123+0000 7f72d3ff8640 1 --2- 172.21.15.177:0/3900017295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72cc15c070 0x7f72cc13ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.123+0000 7f72d3ff8640 1 --2- 172.21.15.177:0/3900017295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72cc15bc90 0x7f72cc13ea30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.123+0000 7f72d3ff8640 1 --2- 172.21.15.177:0/3900017295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc06c9d0 0x7f72cc1fd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.123+0000 7f72d3ff8640 1 -- 172.21.15.177:0/3900017295 >> 172.21.15.177:0/3900017295 conn(0x7f72cc06a530 msgr2=0x7f72cc071b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:29.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.123+0000 7f72d3ff8640 1 -- 172.21.15.177:0/3900017295 shutdown_connections 2023-11-28T20:08:29.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.123+0000 7f72d3ff8640 1 -- 172.21.15.177:0/3900017295 wait complete. 2023-11-28T20:08:29.148 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:29.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.279+0000 7fe596a9e640 1 Processor -- start 2023-11-28T20:08:29.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe596a9e640 1 -- start start 2023-11-28T20:08:29.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe596a9e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe59015d3b0 0x7fe5900ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe596a9e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5900adfb0 con 0x7fe5900af8b0 2023-11-28T20:08:29.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe596a9e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5900ae290 con 0x7fe590071fd0 2023-11-28T20:08:29.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe596a9e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900aeb30 con 0x7fe59015d3b0 2023-11-28T20:08:29.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe59503b640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe5900af8b0 0x7fe5900b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44332/0 (socket says 172.21.15.177:44332) 2023-11-28T20:08:29.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe59503b640 1 -- 172.21.15.177:0/3936589004 learned_addr learned my addr 172.21.15.177:0/3936589004 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:29.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe59483a640 1 --2- 172.21.15.177:0/3936589004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe59015d3b0 0x7fe5900ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166647045 0 0) 0x7fe5900adfb0 con 0x7fe5900af8b0 2023-11-28T20:08:29.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe578003530 con 0x7fe5900af8b0 2023-11-28T20:08:29.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496115304 0 0) 0x7fe5900ae290 con 0x7fe590071fd0 2023-11-28T20:08:29.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5900adfb0 con 0x7fe590071fd0 2023-11-28T20:08:29.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4091669606 0 0) 0x7fe578003530 con 0x7fe5900af8b0 2023-11-28T20:08:29.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe59015d3b0 msgr2=0x7fe5900ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:29.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 --2- 172.21.15.177:0/3936589004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe59015d3b0 0x7fe5900ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 >> v1:172.21.15.195:6789/0 conn(0x7fe590071fd0 legacy=0x7fe5900af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5900ae570 con 0x7fe5900af8b0 2023-11-28T20:08:29.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7fe588001a00 con 0x7fe5900af8b0 2023-11-28T20:08:29.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 >> v1:172.21.15.177:6789/0 conn(0x7fe5900af8b0 legacy=0x7fe5900b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 --2- 172.21.15.177:0/3936589004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe578003b40 0x7fe578003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 --2- 172.21.15.177:0/3936589004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe59015d3b0 0x7fe5780047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 --2- 172.21.15.177:0/3936589004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe578004d10 0x7fe578005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900aeb30 con 0x7fe578004d10 2023-11-28T20:08:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57800ba40 con 0x7fe578003b40 2023-11-28T20:08:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57800bbb0 con 0x7fe59015d3b0 2023-11-28T20:08:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe59503b640 1 --2- 172.21.15.177:0/3936589004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe578004d10 0x7fe578005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe59483a640 1 --2- 172.21.15.177:0/3936589004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe578003b40 0x7fe578003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe587fff640 1 --2- 172.21.15.177:0/3936589004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe59015d3b0 0x7fe5780047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe59503b640 1 -- 172.21.15.177:0/3936589004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe59015d3b0 msgr2=0x7fe5780047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe59503b640 1 --2- 172.21.15.177:0/3936589004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe59015d3b0 0x7fe5780047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe59503b640 1 -- 172.21.15.177:0/3936589004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe578003b40 msgr2=0x7fe578003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe59503b640 1 --2- 172.21.15.177:0/3936589004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe578003b40 0x7fe578003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.283+0000 7fe59503b640 1 -- 172.21.15.177:0/3936589004 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe578003530 con 0x7fe578004d10 2023-11-28T20:08:29.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.287+0000 7fe59503b640 1 --2- 172.21.15.177:0/3936589004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe578004d10 0x7fe578005190 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe5900ac8f0 tx=0x7fe58801d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7237bdd70a43a28d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:29.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.287+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5880ad630 con 0x7fe578004d10 2023-11-28T20:08:29.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.287+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5880a8070 con 0x7fe578004d10 2023-11-28T20:08:29.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.287+0000 7fe5877fe640 1 -- 172.21.15.177:0/3936589004 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5880ad9f0 con 0x7fe578004d10 2023-11-28T20:08:29.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.287+0000 7fe596a9e640 1 -- 172.21.15.177:0/3936589004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe578004d10 msgr2=0x7fe578005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.287+0000 7fe596a9e640 1 --2- 172.21.15.177:0/3936589004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe578004d10 0x7fe578005190 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe5900ac8f0 tx=0x7fe58801d280 comp rx=0 tx=0).stop 2023-11-28T20:08:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.287+0000 7fe59503b640 1 -- 172.21.15.177:0/3936589004 reap_dead start 2023-11-28T20:08:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.287+0000 7fe596a9e640 1 -- 172.21.15.177:0/3936589004 shutdown_connections 2023-11-28T20:08:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.287+0000 7fe596a9e640 1 -- 172.21.15.177:0/3936589004 >> 172.21.15.177:0/3936589004 conn(0x7fe59006b640 msgr2=0x7fe59006ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.287+0000 7fe596a9e640 1 -- 172.21.15.177:0/3936589004 shutdown_connections 2023-11-28T20:08:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.287+0000 7fe596a9e640 1 -- 172.21.15.177:0/3936589004 wait complete. 2023-11-28T20:08:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe596a9e640 1 Processor -- start 2023-11-28T20:08:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe596a9e640 1 -- start start 2023-11-28T20:08:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe596a9e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe578004d10 0x7fe5901f2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe596a9e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe59014d320 0x7fe59015d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe596a9e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe590160140 0x7fe5901605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe596a9e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59015ef00 con 0x7fe590160140 2023-11-28T20:08:29.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe596a9e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe590160b10 con 0x7fe59014d320 2023-11-28T20:08:29.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe596a9e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59015e280 con 0x7fe578004d10 2023-11-28T20:08:29.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe59503b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe590160140 0x7fe5901605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe59503b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe590160140 0x7fe5901605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34832/0 (socket says 172.21.15.177:34832) 2023-11-28T20:08:29.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe59503b640 1 -- 172.21.15.177:0/3542448399 learned_addr learned my addr 172.21.15.177:0/3542448399 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:29.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe59483a640 1 --2- 172.21.15.177:0/3542448399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe578004d10 0x7fe5901f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe587fff640 1 --2- 172.21.15.177:0/3542448399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe59014d320 0x7fe59015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe59503b640 1 -- 172.21.15.177:0/3542448399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe578004d10 msgr2=0x7fe5901f2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe59503b640 1 --2- 172.21.15.177:0/3542448399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe578004d10 0x7fe5901f2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe59503b640 1 -- 172.21.15.177:0/3542448399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe59014d320 msgr2=0x7fe59015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe59503b640 1 --2- 172.21.15.177:0/3542448399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe59014d320 0x7fe59015d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe59503b640 1 -- 172.21.15.177:0/3542448399 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59015e560 con 0x7fe590160140 2023-11-28T20:08:29.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe59503b640 1 --2- 172.21.15.177:0/3542448399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe590160140 0x7fe5901605d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe58801d0b0 tx=0x7fe578005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:29.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe5857fa640 1 -- 172.21.15.177:0/3542448399 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588001800 con 0x7fe590160140 2023-11-28T20:08:29.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe5857fa640 1 -- 172.21.15.177:0/3542448399 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe588001960 con 0x7fe590160140 2023-11-28T20:08:29.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe5857fa640 1 -- 172.21.15.177:0/3542448399 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588004d70 con 0x7fe590160140 2023-11-28T20:08:29.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe596a9e640 1 -- 172.21.15.177:0/3542448399 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59015e840 con 0x7fe590160140 2023-11-28T20:08:29.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.291+0000 7fe596a9e640 1 -- 172.21.15.177:0/3542448399 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5901f2890 con 0x7fe590160140 2023-11-28T20:08:29.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.295+0000 7fe596a9e640 1 -- 172.21.15.177:0/3542448399 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59015f040 con 0x7fe590160140 2023-11-28T20:08:29.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.295+0000 7fe5857fa640 1 -- 172.21.15.177:0/3542448399 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe5880aa030 con 0x7fe590160140 2023-11-28T20:08:29.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.295+0000 7fe5857fa640 1 --2- 172.21.15.177:0/3542448399 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe57c066470 0x7fe57c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.295+0000 7fe5857fa640 1 -- 172.21.15.177:0/3542448399 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fe58811d9d0 con 0x7fe590160140 2023-11-28T20:08:29.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.295+0000 7fe59483a640 1 --2- 172.21.15.177:0/3542448399 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe57c066470 0x7fe57c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.295+0000 7fe59483a640 1 --2- 172.21.15.177:0/3542448399 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe57c066470 0x7fe57c068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe58c009be0 tx=0x7fe58c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:29.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.299+0000 7fe5857fa640 1 -- 172.21.15.177:0/3542448399 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe59015f040 con 0x7fe590160140 2023-11-28T20:08:29.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.451+0000 7fe596a9e640 1 -- 172.21.15.177:0/3542448399 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe59015f040 con 0x7fe590160140 2023-11-28T20:08:29.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.451+0000 7fe5857fa640 1 -- 172.21.15.177:0/3542448399 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16861 (secure 0 0 0) 0x7fe59015f040 con 0x7fe590160140 2023-11-28T20:08:29.457 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:29.457 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":22,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:23.248475+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:07:39.694738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:07:40.472040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:29.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.455+0000 7fe596a9e640 1 -- 172.21.15.177:0/3542448399 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe57c066470 msgr2=0x7fe57c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.455+0000 7fe596a9e640 1 --2- 172.21.15.177:0/3542448399 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe57c066470 0x7fe57c068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe58c009be0 tx=0x7fe58c009190 comp rx=0 tx=0).stop 2023-11-28T20:08:29.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.455+0000 7fe596a9e640 1 -- 172.21.15.177:0/3542448399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe590160140 msgr2=0x7fe5901605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.455+0000 7fe596a9e640 1 --2- 172.21.15.177:0/3542448399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe590160140 0x7fe5901605d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe58801d0b0 tx=0x7fe578005800 comp rx=0 tx=0).stop 2023-11-28T20:08:29.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.455+0000 7fe596a9e640 1 -- 172.21.15.177:0/3542448399 shutdown_connections 2023-11-28T20:08:29.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.455+0000 7fe596a9e640 1 --2- 172.21.15.177:0/3542448399 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe57c066470 0x7fe57c068930 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.455+0000 7fe596a9e640 1 --2- 172.21.15.177:0/3542448399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe590160140 0x7fe5901605d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.455+0000 7fe596a9e640 1 --2- 172.21.15.177:0/3542448399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe59014d320 0x7fe59015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.455+0000 7fe596a9e640 1 --2- 172.21.15.177:0/3542448399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe578004d10 0x7fe5901f2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.455+0000 7fe596a9e640 1 -- 172.21.15.177:0/3542448399 >> 172.21.15.177:0/3542448399 conn(0x7fe59006b640 msgr2=0x7fe5900cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:29.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.455+0000 7fe596a9e640 1 -- 172.21.15.177:0/3542448399 shutdown_connections 2023-11-28T20:08:29.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.455+0000 7fe596a9e640 1 -- 172.21.15.177:0/3542448399 wait complete. 2023-11-28T20:08:29.480 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T20:08:29.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.611+0000 7f5344301640 1 Processor -- start 2023-11-28T20:08:29.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f5344301640 1 -- start start 2023-11-28T20:08:29.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f5344301640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f533c06c9d0 0x7f533c15a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f5344301640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f533c15ab70 0x7f533c0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f5344301640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533c15b3a0 con 0x7f533c13cf30 2023-11-28T20:08:29.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f5344301640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533c13d310 con 0x7f533c06c9d0 2023-11-28T20:08:29.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f5344301640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533c1404e0 con 0x7f533c15ab70 2023-11-28T20:08:29.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f534289e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f533c15ab70 0x7f533c0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f534189c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f533c06c9d0 0x7f533c15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f534189c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f533c06c9d0 0x7f533c15a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:49534/0 (socket says 172.21.15.177:49534) 2023-11-28T20:08:29.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f534189c640 1 -- 172.21.15.177:0/2967467230 learned_addr learned my addr 172.21.15.177:0/2967467230 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:29.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f534289e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f533c15ab70 0x7f533c0cd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:40040/0 (socket says 172.21.15.177:40040) 2023-11-28T20:08:29.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f534189c640 1 -- 172.21.15.177:0/2967467230 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f533c15ab70 msgr2=0x7f533c0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:29.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f534189c640 1 --2- 172.21.15.177:0/2967467230 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f533c15ab70 0x7f533c0cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f534189c640 1 -- 172.21.15.177:0/2967467230 >> v1:172.21.15.195:6789/0 conn(0x7f533c13cf30 legacy=0x7f533c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f534189c640 1 -- 172.21.15.177:0/2967467230 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c13f720 con 0x7f533c06c9d0 2023-11-28T20:08:29.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.615+0000 7f534289e640 1 --2- 172.21.15.177:0/2967467230 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f533c15ab70 0x7f533c0cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:29.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.619+0000 7f534189c640 1 --2- 172.21.15.177:0/2967467230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f533c06c9d0 0x7f533c15a630 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f532c0098a0 tx=0x7f532c01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30e144e1675e031f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:29.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.619+0000 7f534109b640 1 -- 172.21.15.177:0/2967467230 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c0ab660 con 0x7f533c06c9d0 2023-11-28T20:08:29.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.619+0000 7f534109b640 1 -- 172.21.15.177:0/2967467230 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c0ab7c0 con 0x7f533c06c9d0 2023-11-28T20:08:29.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.619+0000 7f534109b640 1 -- 172.21.15.177:0/2967467230 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c0abb50 con 0x7f533c06c9d0 2023-11-28T20:08:29.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.619+0000 7f5344301640 1 -- 172.21.15.177:0/2967467230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f533c06c9d0 msgr2=0x7f533c15a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.619+0000 7f5344301640 1 --2- 172.21.15.177:0/2967467230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f533c06c9d0 0x7f533c15a630 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f532c0098a0 tx=0x7f532c01c460 comp rx=0 tx=0).stop 2023-11-28T20:08:29.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.619+0000 7f5344301640 1 -- 172.21.15.177:0/2967467230 shutdown_connections 2023-11-28T20:08:29.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.619+0000 7f5344301640 1 --2- 172.21.15.177:0/2967467230 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f533c15ab70 0x7f533c0cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.619+0000 7f5344301640 1 --2- 172.21.15.177:0/2967467230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f533c06c9d0 0x7f533c15a630 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.619+0000 7f5344301640 1 -- 172.21.15.177:0/2967467230 >> 172.21.15.177:0/2967467230 conn(0x7f533c06a530 msgr2=0x7f533c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:29.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.619+0000 7f5344301640 1 -- 172.21.15.177:0/2967467230 shutdown_connections 2023-11-28T20:08:29.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.619+0000 7f5344301640 1 -- 172.21.15.177:0/2967467230 wait complete. 2023-11-28T20:08:29.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f5344301640 1 Processor -- start 2023-11-28T20:08:29.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f5344301640 1 -- start start 2023-11-28T20:08:29.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f5344301640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f533c06c9d0 0x7f533c1f52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f5344301640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f533c13cf30 0x7f533c1379c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f5344301640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f533c15ab70 0x7f533c159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f5344301640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c139020 con 0x7f533c06c9d0 2023-11-28T20:08:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f5344301640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c138410 con 0x7f533c15ab70 2023-11-28T20:08:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f5344301640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533c1386f0 con 0x7f533c13cf30 2023-11-28T20:08:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f534209d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f533c06c9d0 0x7f533c1f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f534209d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f533c06c9d0 0x7f533c1f52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34836/0 (socket says 172.21.15.177:34836) 2023-11-28T20:08:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f534209d640 1 -- 172.21.15.177:0/773285035 learned_addr learned my addr 172.21.15.177:0/773285035 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f534189c640 1 --2- 172.21.15.177:0/773285035 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f533c13cf30 0x7f533c1379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f534289e640 1 --2- 172.21.15.177:0/773285035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f533c15ab70 0x7f533c159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f534209d640 1 -- 172.21.15.177:0/773285035 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f533c13cf30 msgr2=0x7f533c1379c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f534209d640 1 --2- 172.21.15.177:0/773285035 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f533c13cf30 0x7f533c1379c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f534209d640 1 -- 172.21.15.177:0/773285035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f533c15ab70 msgr2=0x7f533c159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f534209d640 1 --2- 172.21.15.177:0/773285035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f533c15ab70 0x7f533c159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f534209d640 1 -- 172.21.15.177:0/773285035 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5334009a70 con 0x7f533c06c9d0 2023-11-28T20:08:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f534209d640 1 --2- 172.21.15.177:0/773285035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f533c06c9d0 0x7f533c1f52f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f533800c420 tx=0x7f533800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f5332ffd640 1 -- 172.21.15.177:0/773285035 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53380052d0 con 0x7f533c06c9d0 2023-11-28T20:08:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f5332ffd640 1 -- 172.21.15.177:0/773285035 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5338005430 con 0x7f533c06c9d0 2023-11-28T20:08:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f5332ffd640 1 -- 172.21.15.177:0/773285035 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338007260 con 0x7f533c06c9d0 2023-11-28T20:08:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f5344301640 1 -- 172.21.15.177:0/773285035 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532c0094d0 con 0x7f533c06c9d0 2023-11-28T20:08:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.623+0000 7f5344301640 1 -- 172.21.15.177:0/773285035 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533c138cb0 con 0x7f533c06c9d0 2023-11-28T20:08:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.627+0000 7f5344301640 1 -- 172.21.15.177:0/773285035 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f533c069440 con 0x7f533c06c9d0 2023-11-28T20:08:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.627+0000 7f5332ffd640 1 -- 172.21.15.177:0/773285035 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f53380073c0 con 0x7f533c06c9d0 2023-11-28T20:08:29.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.627+0000 7f5332ffd640 1 --2- 172.21.15.177:0/773285035 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5320066470 0x7f5320068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.627+0000 7f5332ffd640 1 -- 172.21.15.177:0/773285035 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f53380832b0 con 0x7f533c06c9d0 2023-11-28T20:08:29.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.627+0000 7f534189c640 1 --2- 172.21.15.177:0/773285035 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5320066470 0x7f5320068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.627+0000 7f534189c640 1 --2- 172.21.15.177:0/773285035 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5320066470 0x7f5320068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f532c0af000 tx=0x7f532c0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.631+0000 7f5332ffd640 1 -- 172.21.15.177:0/773285035 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53380506b0 con 0x7f533c06c9d0 2023-11-28T20:08:29.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.811+0000 7f5344301640 1 -- 172.21.15.177:0/773285035 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f533c139f80 con 0x7f533c06c9d0 2023-11-28T20:08:29.816 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-11-28T20:08:29.811+0000 7f79a8741640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T20:08:29.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.815+0000 7f5332ffd640 1 -- 172.21.15.177:0/773285035 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5338053cd0 con 0x7f533c06c9d0 2023-11-28T20:08:29.819 INFO:teuthology.orchestra.run.smithi177.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T20:08:29.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.815+0000 7f5344301640 1 -- 172.21.15.177:0/773285035 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5320066470 msgr2=0x7f5320068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.815+0000 7f5344301640 1 --2- 172.21.15.177:0/773285035 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5320066470 0x7f5320068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f532c0af000 tx=0x7f532c0b6040 comp rx=0 tx=0).stop 2023-11-28T20:08:29.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.815+0000 7f5344301640 1 -- 172.21.15.177:0/773285035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f533c06c9d0 msgr2=0x7f533c1f52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.815+0000 7f5344301640 1 --2- 172.21.15.177:0/773285035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f533c06c9d0 0x7f533c1f52f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f533800c420 tx=0x7f533800c820 comp rx=0 tx=0).stop 2023-11-28T20:08:29.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.815+0000 7f5344301640 1 -- 172.21.15.177:0/773285035 shutdown_connections 2023-11-28T20:08:29.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.815+0000 7f5344301640 1 --2- 172.21.15.177:0/773285035 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5320066470 0x7f5320068930 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.815+0000 7f5344301640 1 --2- 172.21.15.177:0/773285035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f533c15ab70 0x7f533c159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.815+0000 7f5344301640 1 --2- 172.21.15.177:0/773285035 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f533c13cf30 0x7f533c1379c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.815+0000 7f5344301640 1 --2- 172.21.15.177:0/773285035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f533c06c9d0 0x7f533c1f52f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.815+0000 7f5344301640 1 -- 172.21.15.177:0/773285035 >> 172.21.15.177:0/773285035 conn(0x7f533c06a530 msgr2=0x7f533c15d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:29.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.815+0000 7f5344301640 1 -- 172.21.15.177:0/773285035 shutdown_connections 2023-11-28T20:08:29.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.815+0000 7f5344301640 1 -- 172.21.15.177:0/773285035 wait complete. 2023-11-28T20:08:29.829 INFO:tasks.ceph.mds.d.smithi195.stderr: -2742> 2023-11-28T20:07:46.074+0000 7f0a1e67e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:08:29.841 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T20:08:29.877 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2023-11-28T20:08:29.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.975+0000 7ff703ed6640 1 Processor -- start 2023-11-28T20:08:29.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.975+0000 7ff703ed6640 1 -- start start 2023-11-28T20:08:29.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.975+0000 7ff703ed6640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff6fc0b42d0 0x7ff6fc0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.975+0000 7ff703ed6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc0b4c60 con 0x7ff6fc0cba10 2023-11-28T20:08:29.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.975+0000 7ff703ed6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc15b670 con 0x7ff6fc158ca0 2023-11-28T20:08:29.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.975+0000 7ff703ed6640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc15c510 con 0x7ff6fc0b42d0 2023-11-28T20:08:29.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.975+0000 7ff701471640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ff6fc0cba10 0x7ff6fc15be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44344/0 (socket says 172.21.15.177:44344) 2023-11-28T20:08:29.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.975+0000 7ff701471640 1 -- 172.21.15.177:0/1248084860 learned_addr learned my addr 172.21.15.177:0/1248084860 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:29.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.975+0000 7ff702473640 1 --2- 172.21.15.177:0/1248084860 >> v2:172.21.15.195:3300/0 conn(0x7ff6fc0b42d0 0x7ff6fc0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.975+0000 7ff700c70640 1 -- 172.21.15.177:0/1248084860 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594328253 0 0) 0x7ff6ec001120 con 0x7ff6fc0cba10 2023-11-28T20:08:29.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.975+0000 7ff700c70640 1 -- 172.21.15.177:0/1248084860 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e8003530 con 0x7ff6fc0cba10 2023-11-28T20:08:29.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff700c70640 1 -- 172.21.15.177:0/1248084860 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 36950842 0 0) 0x7ff6e8003530 con 0x7ff6fc0cba10 2023-11-28T20:08:29.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff700c70640 1 -- 172.21.15.177:0/1248084860 >> v2:172.21.15.195:3300/0 conn(0x7ff6fc0b42d0 msgr2=0x7ff6fc0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:29.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff700c70640 1 --2- 172.21.15.177:0/1248084860 >> v2:172.21.15.195:3300/0 conn(0x7ff6fc0b42d0 0x7ff6fc0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff700c70640 1 -- 172.21.15.177:0/1248084860 >> v1:172.21.15.195:6789/0 conn(0x7ff6fc158ca0 legacy=0x7ff6fc15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff700c70640 1 -- 172.21.15.177:0/1248084860 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc15f410 con 0x7ff6fc0cba10 2023-11-28T20:08:29.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff700c70640 1 -- 172.21.15.177:0/1248084860 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7ff6ec001810 con 0x7ff6fc0cba10 2023-11-28T20:08:29.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff700c70640 1 -- 172.21.15.177:0/1248084860 >> v1:172.21.15.177:6789/0 conn(0x7ff6fc0cba10 legacy=0x7ff6fc15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff700c70640 1 --2- 172.21.15.177:0/1248084860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6e80039d0 0x7ff6e8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff700c70640 1 --2- 172.21.15.177:0/1248084860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6e80047d0 0x7ff6e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff700c70640 1 --2- 172.21.15.177:0/1248084860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6e8005190 0x7ff6e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff700c70640 1 -- 172.21.15.177:0/1248084860 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc15c510 con 0x7ff6e80047d0 2023-11-28T20:08:29.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff700c70640 1 -- 172.21.15.177:0/1248084860 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e800c090 con 0x7ff6e80039d0 2023-11-28T20:08:29.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff700c70640 1 -- 172.21.15.177:0/1248084860 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e800c250 con 0x7ff6e8005190 2023-11-28T20:08:29.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff701471640 1 --2- 172.21.15.177:0/1248084860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6e80047d0 0x7ff6e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff701c72640 1 --2- 172.21.15.177:0/1248084860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6e80039d0 0x7ff6e8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff702473640 1 --2- 172.21.15.177:0/1248084860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6e8005190 0x7ff6e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff701471640 1 -- 172.21.15.177:0/1248084860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6e8005190 msgr2=0x7ff6e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:29.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff701471640 1 --2- 172.21.15.177:0/1248084860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6e8005190 0x7ff6e800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff701471640 1 -- 172.21.15.177:0/1248084860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6e80039d0 msgr2=0x7ff6e8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:29.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff701471640 1 --2- 172.21.15.177:0/1248084860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6e80039d0 0x7ff6e8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff701471640 1 -- 172.21.15.177:0/1248084860 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e8003530 con 0x7ff6e80047d0 2023-11-28T20:08:29.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff702473640 1 --2- 172.21.15.177:0/1248084860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6e8005190 0x7ff6e800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:29.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff702473640 1 -- 172.21.15.177:0/1248084860 reap_dead start 2023-11-28T20:08:29.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.979+0000 7ff701471640 1 --2- 172.21.15.177:0/1248084860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6e80047d0 0x7ff6e8004c50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0cc1e0 tx=0x7ff6ec01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74cf2a8146a44dff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:29.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff700c70640 1 -- 172.21.15.177:0/1248084860 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec0a8e30 con 0x7ff6e80047d0 2023-11-28T20:08:29.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff700c70640 1 -- 172.21.15.177:0/1248084860 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec0058e0 con 0x7ff6e80047d0 2023-11-28T20:08:29.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff700c70640 1 -- 172.21.15.177:0/1248084860 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec005cd0 con 0x7ff6e80047d0 2023-11-28T20:08:29.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff703ed6640 1 -- 172.21.15.177:0/1248084860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6e80047d0 msgr2=0x7ff6e8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff703ed6640 1 --2- 172.21.15.177:0/1248084860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6e80047d0 0x7ff6e8004c50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0cc1e0 tx=0x7ff6ec01f210 comp rx=0 tx=0).stop 2023-11-28T20:08:29.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff703ed6640 1 -- 172.21.15.177:0/1248084860 shutdown_connections 2023-11-28T20:08:29.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff703ed6640 1 --2- 172.21.15.177:0/1248084860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6e80047d0 0x7ff6e8004c50 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff703ed6640 1 -- 172.21.15.177:0/1248084860 >> 172.21.15.177:0/1248084860 conn(0x7ff6fc0b0cc0 msgr2=0x7ff6fc0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:29.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff703ed6640 1 -- 172.21.15.177:0/1248084860 shutdown_connections 2023-11-28T20:08:29.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff703ed6640 1 -- 172.21.15.177:0/1248084860 wait complete. 2023-11-28T20:08:29.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff703ed6640 1 Processor -- start 2023-11-28T20:08:29.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff703ed6640 1 -- start start 2023-11-28T20:08:29.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff703ed6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6e80047d0 0x7ff6fc1547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff703ed6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6fc1e6a80 0x7ff6fc1e5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff703ed6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6fc1e6f00 0x7ff6fc1e6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff703ed6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc157bb0 con 0x7ff6fc1e6a80 2023-11-28T20:08:29.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff703ed6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc154d30 con 0x7ff6fc1e6f00 2023-11-28T20:08:29.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff703ed6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc1575f0 con 0x7ff6e80047d0 2023-11-28T20:08:29.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff701471640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6fc1e6a80 0x7ff6fc1e5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff701c72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6e80047d0 0x7ff6fc1547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff701471640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6fc1e6a80 0x7ff6fc1e5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34856/0 (socket says 172.21.15.177:34856) 2023-11-28T20:08:29.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff701471640 1 -- 172.21.15.177:0/4271380047 learned_addr learned my addr 172.21.15.177:0/4271380047 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:29.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.983+0000 7ff702473640 1 --2- 172.21.15.177:0/4271380047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6fc1e6f00 0x7ff6fc1e6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.987+0000 7ff701471640 1 -- 172.21.15.177:0/4271380047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6e80047d0 msgr2=0x7ff6fc1547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.987+0000 7ff701471640 1 --2- 172.21.15.177:0/4271380047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6e80047d0 0x7ff6fc1547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.987+0000 7ff701471640 1 -- 172.21.15.177:0/4271380047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6fc1e6f00 msgr2=0x7ff6fc1e6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:29.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.987+0000 7ff701471640 1 --2- 172.21.15.177:0/4271380047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6fc1e6f00 0x7ff6fc1e6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:29.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.987+0000 7ff701471640 1 -- 172.21.15.177:0/4271380047 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc1578d0 con 0x7ff6fc1e6a80 2023-11-28T20:08:29.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.987+0000 7ff702473640 1 --2- 172.21.15.177:0/4271380047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6fc1e6f00 0x7ff6fc1e6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:29.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.987+0000 7ff701471640 1 --2- 172.21.15.177:0/4271380047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6fc1e6a80 0x7ff6fc1e5dc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec01f250 tx=0x7ff6e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:29.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.987+0000 7ff6f27fc640 1 -- 172.21.15.177:0/4271380047 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec0b7070 con 0x7ff6fc1e6a80 2023-11-28T20:08:29.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.987+0000 7ff6f27fc640 1 -- 172.21.15.177:0/4271380047 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec000ee0 con 0x7ff6fc1e6a80 2023-11-28T20:08:29.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.987+0000 7ff703ed6640 1 -- 172.21.15.177:0/4271380047 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc0aab60 con 0x7ff6fc1e6a80 2023-11-28T20:08:29.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.987+0000 7ff6f27fc640 1 -- 172.21.15.177:0/4271380047 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec001120 con 0x7ff6fc1e6a80 2023-11-28T20:08:29.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.987+0000 7ff703ed6640 1 -- 172.21.15.177:0/4271380047 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc156150 con 0x7ff6fc1e6a80 2023-11-28T20:08:29.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.987+0000 7ff703ed6640 1 -- 172.21.15.177:0/4271380047 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc15c1c0 con 0x7ff6fc1e6a80 2023-11-28T20:08:29.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.987+0000 7ff6f27fc640 1 -- 172.21.15.177:0/4271380047 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff6ec0b2af0 con 0x7ff6fc1e6a80 2023-11-28T20:08:29.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.991+0000 7ff6f27fc640 1 --2- 172.21.15.177:0/4271380047 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff6e00664a0 0x7ff6e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:29.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.991+0000 7ff6f27fc640 1 -- 172.21.15.177:0/4271380047 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5940+0+0 (secure 0 0 0) 0x7ff6ec120ec0 con 0x7ff6fc1e6a80 2023-11-28T20:08:29.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.991+0000 7ff701c72640 1 --2- 172.21.15.177:0/4271380047 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff6e00664a0 0x7ff6e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:29.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.991+0000 7ff701c72640 1 --2- 172.21.15.177:0/4271380047 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff6e00664a0 0x7ff6e0068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8000c10 tx=0x7ff6f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:29.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:29.991+0000 7ff6f27fc640 1 -- 172.21.15.177:0/4271380047 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff6ec0ee330 con 0x7ff6fc1e6a80 2023-11-28T20:08:30.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.179+0000 7ff703ed6640 1 -- 172.21.15.177:0/4271380047 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff6fc0b4c60 con 0x7ff6fc1e6a80 2023-11-28T20:08:30.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.815+0000 7ff6f27fc640 1 -- 172.21.15.177:0/4271380047 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff6fc0b4c60 con 0x7ff6fc1e6a80 2023-11-28T20:08:30.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.819+0000 7ff703ed6640 1 -- 172.21.15.177:0/4271380047 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff6e00664a0 msgr2=0x7ff6e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:30.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.819+0000 7ff703ed6640 1 --2- 172.21.15.177:0/4271380047 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff6e00664a0 0x7ff6e0068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8000c10 tx=0x7ff6f8009040 comp rx=0 tx=0).stop 2023-11-28T20:08:30.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.819+0000 7ff703ed6640 1 -- 172.21.15.177:0/4271380047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6fc1e6a80 msgr2=0x7ff6fc1e5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:30.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.819+0000 7ff703ed6640 1 --2- 172.21.15.177:0/4271380047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6fc1e6a80 0x7ff6fc1e5dc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec01f250 tx=0x7ff6e8005800 comp rx=0 tx=0).stop 2023-11-28T20:08:30.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.819+0000 7ff703ed6640 1 -- 172.21.15.177:0/4271380047 shutdown_connections 2023-11-28T20:08:30.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.819+0000 7ff703ed6640 1 --2- 172.21.15.177:0/4271380047 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff6e00664a0 0x7ff6e0068960 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:30.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.819+0000 7ff703ed6640 1 --2- 172.21.15.177:0/4271380047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6fc1e6f00 0x7ff6fc1e6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:30.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.819+0000 7ff703ed6640 1 --2- 172.21.15.177:0/4271380047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6fc1e6a80 0x7ff6fc1e5dc0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:30.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.819+0000 7ff703ed6640 1 --2- 172.21.15.177:0/4271380047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6e80047d0 0x7ff6fc1547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:30.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.819+0000 7ff703ed6640 1 -- 172.21.15.177:0/4271380047 >> 172.21.15.177:0/4271380047 conn(0x7ff6fc0b0cc0 msgr2=0x7ff6fc0b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:30.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.819+0000 7ff703ed6640 1 -- 172.21.15.177:0/4271380047 shutdown_connections 2023-11-28T20:08:30.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.819+0000 7ff703ed6640 1 -- 172.21.15.177:0/4271380047 wait complete. 2023-11-28T20:08:30.845 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T20:08:30.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f74539d8640 1 Processor -- start 2023-11-28T20:08:30.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f74539d8640 1 -- start start 2023-11-28T20:08:30.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f74539d8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f744c0cce60 0x7f744c0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:30.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f74539d8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744c0cea20 con 0x7f744c164e70 2023-11-28T20:08:30.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f74539d8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744c165250 con 0x7f744c1654f0 2023-11-28T20:08:30.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f74539d8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c0cd440 con 0x7f744c0cce60 2023-11-28T20:08:30.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7451774640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f744c164e70 0x7f744c0b3970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44358/0 (socket says 172.21.15.177:44358) 2023-11-28T20:08:30.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7451774640 1 -- 172.21.15.177:0/3940000820 learned_addr learned my addr 172.21.15.177:0/3940000820 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:30.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7450f73640 1 --2- 172.21.15.177:0/3940000820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f744c0cce60 0x7f744c0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:30.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7443fff640 1 -- 172.21.15.177:0/3940000820 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949932214 0 0) 0x7f7448001120 con 0x7f744c164e70 2023-11-28T20:08:30.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7443fff640 1 -- 172.21.15.177:0/3940000820 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7438003530 con 0x7f744c164e70 2023-11-28T20:08:30.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7443fff640 1 -- 172.21.15.177:0/3940000820 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1418862061 0 0) 0x7f7438003530 con 0x7f744c164e70 2023-11-28T20:08:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7443fff640 1 -- 172.21.15.177:0/3940000820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f744c0cce60 msgr2=0x7f744c0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7443fff640 1 --2- 172.21.15.177:0/3940000820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f744c0cce60 0x7f744c0ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7443fff640 1 -- 172.21.15.177:0/3940000820 >> v1:172.21.15.195:6789/0 conn(0x7f744c1654f0 legacy=0x7f744c070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7443fff640 1 -- 172.21.15.177:0/3940000820 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c0cd720 con 0x7f744c164e70 2023-11-28T20:08:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7443fff640 1 -- 172.21.15.177:0/3940000820 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f7448001810 con 0x7f744c164e70 2023-11-28T20:08:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7450f73640 1 --2- 172.21.15.177:0/3940000820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f744c0cce60 0x7f744c0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7443fff640 1 -- 172.21.15.177:0/3940000820 >> v1:172.21.15.177:6789/0 conn(0x7f744c164e70 legacy=0x7f744c0b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7443fff640 1 --2- 172.21.15.177:0/3940000820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74380039b0 0x7f7438003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7443fff640 1 --2- 172.21.15.177:0/3940000820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f744c0cce60 0x7f74380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7443fff640 1 --2- 172.21.15.177:0/3940000820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7438004d10 0x7f7438005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7443fff640 1 -- 172.21.15.177:0/3940000820 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c0cd440 con 0x7f74380039b0 2023-11-28T20:08:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7443fff640 1 -- 172.21.15.177:0/3940000820 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743800ba40 con 0x7f7438004d10 2023-11-28T20:08:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7443fff640 1 -- 172.21.15.177:0/3940000820 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743800bbb0 con 0x7f744c0cce60 2023-11-28T20:08:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7451774640 1 --2- 172.21.15.177:0/3940000820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74380039b0 0x7f7438003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7450f73640 1 --2- 172.21.15.177:0/3940000820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f744c0cce60 0x7f74380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7451f75640 1 --2- 172.21.15.177:0/3940000820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7438004d10 0x7f7438005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7451774640 1 -- 172.21.15.177:0/3940000820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f744c0cce60 msgr2=0x7f74380047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7451774640 1 --2- 172.21.15.177:0/3940000820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f744c0cce60 0x7f74380047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7451774640 1 -- 172.21.15.177:0/3940000820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7438004d10 msgr2=0x7f7438005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7451774640 1 --2- 172.21.15.177:0/3940000820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7438004d10 0x7f7438005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7451774640 1 -- 172.21.15.177:0/3940000820 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c009420 con 0x7f74380039b0 2023-11-28T20:08:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.983+0000 7f7451f75640 1 --2- 172.21.15.177:0/3940000820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7438004d10 0x7f7438005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:30.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.987+0000 7f7451774640 1 --2- 172.21.15.177:0/3940000820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74380039b0 0x7f7438003dd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f744800c240 tx=0x7f744801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3bf90d05c863ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:30.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.987+0000 7f7443fff640 1 -- 172.21.15.177:0/3940000820 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448005ae0 con 0x7f74380039b0 2023-11-28T20:08:30.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.987+0000 7f7443fff640 1 -- 172.21.15.177:0/3940000820 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7448005c60 con 0x7f74380039b0 2023-11-28T20:08:30.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.987+0000 7f7443fff640 1 -- 172.21.15.177:0/3940000820 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74480a5800 con 0x7f74380039b0 2023-11-28T20:08:30.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.987+0000 7f74539d8640 1 -- 172.21.15.177:0/3940000820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74380039b0 msgr2=0x7f7438003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:30.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.987+0000 7f74539d8640 1 --2- 172.21.15.177:0/3940000820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74380039b0 0x7f7438003dd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f744800c240 tx=0x7f744801cc10 comp rx=0 tx=0).stop 2023-11-28T20:08:30.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.987+0000 7f7451f75640 1 -- 172.21.15.177:0/3940000820 reap_dead start 2023-11-28T20:08:30.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.987+0000 7f74539d8640 1 -- 172.21.15.177:0/3940000820 shutdown_connections 2023-11-28T20:08:30.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.987+0000 7f74539d8640 1 -- 172.21.15.177:0/3940000820 >> 172.21.15.177:0/3940000820 conn(0x7f744c0b0c50 msgr2=0x7f744c0b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:30.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.987+0000 7f74539d8640 1 -- 172.21.15.177:0/3940000820 shutdown_connections 2023-11-28T20:08:30.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.987+0000 7f74539d8640 1 -- 172.21.15.177:0/3940000820 wait complete. 2023-11-28T20:08:30.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f74539d8640 1 Processor -- start 2023-11-28T20:08:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f74539d8640 1 -- start start 2023-11-28T20:08:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f74539d8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74380039b0 0x7f744c0acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f74539d8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f744c0cc090 0x7f744c09b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f74539d8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f744c0cc510 0x7f744c09bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f74539d8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c09c7f0 con 0x7f74380039b0 2023-11-28T20:08:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f74539d8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c0ac060 con 0x7f744c0cc090 2023-11-28T20:08:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f74539d8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c09c510 con 0x7f744c0cc510 2023-11-28T20:08:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f7451774640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74380039b0 0x7f744c0acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f7451774640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74380039b0 0x7f744c0acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34868/0 (socket says 172.21.15.177:34868) 2023-11-28T20:08:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f7451774640 1 -- 172.21.15.177:0/3721882448 learned_addr learned my addr 172.21.15.177:0/3721882448 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f7450f73640 1 --2- 172.21.15.177:0/3721882448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f744c0cc090 0x7f744c09b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f7451f75640 1 --2- 172.21.15.177:0/3721882448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f744c0cc510 0x7f744c09bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f7451774640 1 -- 172.21.15.177:0/3721882448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f744c0cc510 msgr2=0x7f744c09bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f7451774640 1 --2- 172.21.15.177:0/3721882448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f744c0cc510 0x7f744c09bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f7451774640 1 -- 172.21.15.177:0/3721882448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f744c0cc090 msgr2=0x7f744c09b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f7451774640 1 --2- 172.21.15.177:0/3721882448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f744c0cc090 0x7f744c09b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f7451774640 1 -- 172.21.15.177:0/3721882448 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c165e90 con 0x7f74380039b0 2023-11-28T20:08:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f7451f75640 1 --2- 172.21.15.177:0/3721882448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f744c0cc510 0x7f744c09bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f7451774640 1 --2- 172.21.15.177:0/3721882448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74380039b0 0x7f744c0acb00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7448001ad0 tx=0x7f7438005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f7441ffb640 1 -- 172.21.15.177:0/3721882448 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74480b4070 con 0x7f74380039b0 2023-11-28T20:08:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f7441ffb640 1 -- 172.21.15.177:0/3721882448 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7448000ee0 con 0x7f74380039b0 2023-11-28T20:08:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f7441ffb640 1 -- 172.21.15.177:0/3721882448 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74480015d0 con 0x7f74380039b0 2023-11-28T20:08:31.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f74539d8640 1 -- 172.21.15.177:0/3721882448 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744c0ac300 con 0x7f74380039b0 2023-11-28T20:08:31.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.991+0000 7f74539d8640 1 -- 172.21.15.177:0/3721882448 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744c164120 con 0x7f74380039b0 2023-11-28T20:08:31.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.995+0000 7f74539d8640 1 -- 172.21.15.177:0/3721882448 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744c04e850 con 0x7f74380039b0 2023-11-28T20:08:31.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.995+0000 7f7441ffb640 1 -- 172.21.15.177:0/3721882448 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f74480a5800 con 0x7f74380039b0 2023-11-28T20:08:31.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.995+0000 7f7441ffb640 1 --2- 172.21.15.177:0/3721882448 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f74300664a0 0x7f7430068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:31.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.995+0000 7f7441ffb640 1 -- 172.21.15.177:0/3721882448 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f744811d6e0 con 0x7f74380039b0 2023-11-28T20:08:31.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.995+0000 7f7450f73640 1 --2- 172.21.15.177:0/3721882448 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f74300664a0 0x7f7430068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:31.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.995+0000 7f7450f73640 1 --2- 172.21.15.177:0/3721882448 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f74300664a0 0x7f7430068960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f744c1fe2a0 tx=0x7f743c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:31.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:30.999+0000 7f7441ffb640 1 -- 172.21.15.177:0/3721882448 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74480eab00 con 0x7f74380039b0 2023-11-28T20:08:31.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:31.151+0000 7f74539d8640 1 -- 172.21.15.177:0/3721882448 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f744c0cf1e0 con 0x7f74380039b0 2023-11-28T20:08:31.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:31.819+0000 7f7441ffb640 1 -- 172.21.15.177:0/3721882448 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f744c0cf1e0 con 0x7f74380039b0 2023-11-28T20:08:31.823 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' removed 2023-11-28T20:08:31.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:31.819+0000 7f74539d8640 1 -- 172.21.15.177:0/3721882448 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f74300664a0 msgr2=0x7f7430068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:31.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:31.819+0000 7f74539d8640 1 --2- 172.21.15.177:0/3721882448 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f74300664a0 0x7f7430068960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f744c1fe2a0 tx=0x7f743c009190 comp rx=0 tx=0).stop 2023-11-28T20:08:31.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:31.819+0000 7f74539d8640 1 -- 172.21.15.177:0/3721882448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74380039b0 msgr2=0x7f744c0acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:31.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:31.819+0000 7f74539d8640 1 --2- 172.21.15.177:0/3721882448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74380039b0 0x7f744c0acb00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7448001ad0 tx=0x7f7438005800 comp rx=0 tx=0).stop 2023-11-28T20:08:31.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:31.823+0000 7f74539d8640 1 -- 172.21.15.177:0/3721882448 shutdown_connections 2023-11-28T20:08:31.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:31.823+0000 7f74539d8640 1 --2- 172.21.15.177:0/3721882448 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f74300664a0 0x7f7430068960 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:31.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:31.823+0000 7f74539d8640 1 --2- 172.21.15.177:0/3721882448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f744c0cc510 0x7f744c09bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:31.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:31.823+0000 7f74539d8640 1 --2- 172.21.15.177:0/3721882448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f744c0cc090 0x7f744c09b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:31.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:31.823+0000 7f74539d8640 1 --2- 172.21.15.177:0/3721882448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74380039b0 0x7f744c0acb00 secure :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7448001ad0 tx=0x7f7438005800 comp rx=0 tx=0).stop 2023-11-28T20:08:31.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:31.823+0000 7f74539d8640 1 -- 172.21.15.177:0/3721882448 >> 172.21.15.177:0/3721882448 conn(0x7f744c0b0c50 msgr2=0x7f744c0b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:31.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:31.823+0000 7f74539d8640 1 -- 172.21.15.177:0/3721882448 shutdown_connections 2023-11-28T20:08:31.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:31.823+0000 7f74539d8640 1 -- 172.21.15.177:0/3721882448 wait complete. 2023-11-28T20:08:31.850 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T20:08:32.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.003+0000 7f5217209640 1 Processor -- start 2023-11-28T20:08:32.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.003+0000 7f5217209640 1 -- start start 2023-11-28T20:08:32.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.007+0000 7f5217209640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f521015a480 0x7f52100ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:32.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.007+0000 7f5217209640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f52100ae620 0x7f52100cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:32.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.007+0000 7f5217209640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52100ce370 con 0x7f521006d6f0 2023-11-28T20:08:32.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.007+0000 7f5217209640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52100cd760 con 0x7f521015a480 2023-11-28T20:08:32.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.007+0000 7f5217209640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52100cda40 con 0x7f52100ae620 2023-11-28T20:08:32.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.007+0000 7f5214fa5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f521015a480 0x7f52100ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:32.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.007+0000 7f52157a6640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f521006d6f0 0x7f52100abf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44368/0 (socket says 172.21.15.177:44368) 2023-11-28T20:08:32.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.007+0000 7f52157a6640 1 -- 172.21.15.177:0/1573603932 learned_addr learned my addr 172.21.15.177:0/1573603932 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:32.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.007+0000 7f5214fa5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f521015a480 0x7f52100ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34870/0 (socket says 172.21.15.177:34870) 2023-11-28T20:08:32.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.007+0000 7f520ffff640 1 --2- 172.21.15.177:0/1573603932 >> v2:172.21.15.195:3300/0 conn(0x7f52100ae620 0x7f52100cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:32.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.007+0000 7f5214fa5640 1 -- 172.21.15.177:0/1573603932 >> v2:172.21.15.195:3300/0 conn(0x7f52100ae620 msgr2=0x7f52100cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:32.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.007+0000 7f5214fa5640 1 --2- 172.21.15.177:0/1573603932 >> v2:172.21.15.195:3300/0 conn(0x7f52100ae620 0x7f52100cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:32.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.007+0000 7f5214fa5640 1 -- 172.21.15.177:0/1573603932 >> v1:172.21.15.177:6789/0 conn(0x7f521006d6f0 legacy=0x7f52100abf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:32.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.007+0000 7f5214fa5640 1 -- 172.21.15.177:0/1573603932 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52100cdd20 con 0x7f521015a480 2023-11-28T20:08:32.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.007+0000 7f520f7fe640 1 -- 172.21.15.177:0/1573603932 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774632950 0 0) 0x7f52100ce370 con 0x7f521006d6f0 2023-11-28T20:08:32.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.011+0000 7f5214fa5640 1 --2- 172.21.15.177:0/1573603932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521015a480 0x7f52100ce800 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f521006e610 tx=0x7f520401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58a848fbbe276f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:32.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.011+0000 7f520f7fe640 1 -- 172.21.15.177:0/1573603932 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040ad680 con 0x7f521015a480 2023-11-28T20:08:32.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.011+0000 7f520f7fe640 1 -- 172.21.15.177:0/1573603932 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52040ad7e0 con 0x7f521015a480 2023-11-28T20:08:32.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.011+0000 7f520f7fe640 1 -- 172.21.15.177:0/1573603932 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040adb70 con 0x7f521015a480 2023-11-28T20:08:32.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.011+0000 7f5217209640 1 -- 172.21.15.177:0/1573603932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521015a480 msgr2=0x7f52100ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:32.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.011+0000 7f5217209640 1 --2- 172.21.15.177:0/1573603932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521015a480 0x7f52100ce800 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f521006e610 tx=0x7f520401c460 comp rx=0 tx=0).stop 2023-11-28T20:08:32.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.011+0000 7f5217209640 1 -- 172.21.15.177:0/1573603932 shutdown_connections 2023-11-28T20:08:32.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.011+0000 7f5217209640 1 --2- 172.21.15.177:0/1573603932 >> v2:172.21.15.195:3300/0 conn(0x7f52100ae620 0x7f52100cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:32.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.011+0000 7f5217209640 1 --2- 172.21.15.177:0/1573603932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521015a480 0x7f52100ce800 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:32.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.011+0000 7f5217209640 1 -- 172.21.15.177:0/1573603932 >> 172.21.15.177:0/1573603932 conn(0x7f52100b0c50 msgr2=0x7f52100b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:32.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.011+0000 7f5217209640 1 -- 172.21.15.177:0/1573603932 shutdown_connections 2023-11-28T20:08:32.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.011+0000 7f5217209640 1 -- 172.21.15.177:0/1573603932 wait complete. 2023-11-28T20:08:32.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.011+0000 7f5217209640 1 Processor -- start 2023-11-28T20:08:32.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.011+0000 7f5217209640 1 -- start start 2023-11-28T20:08:32.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f5217209640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f521006d6f0 0x7f52101fa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:32.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f5217209640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52100ae620 0x7f521009a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:32.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f5217209640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521015a480 0x7f5210164620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:32.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f5217209640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5210164b60 con 0x7f521015a480 2023-11-28T20:08:32.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f5217209640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521009b9a0 con 0x7f521006d6f0 2023-11-28T20:08:32.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f5217209640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521009b6c0 con 0x7f52100ae620 2023-11-28T20:08:32.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f52157a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521015a480 0x7f5210164620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:32.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f52157a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521015a480 0x7f5210164620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34886/0 (socket says 172.21.15.177:34886) 2023-11-28T20:08:32.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f52157a6640 1 -- 172.21.15.177:0/1052649110 learned_addr learned my addr 172.21.15.177:0/1052649110 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:32.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f5214fa5640 1 --2- 172.21.15.177:0/1052649110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f521006d6f0 0x7f52101fa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:32.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f520ffff640 1 --2- 172.21.15.177:0/1052649110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52100ae620 0x7f521009a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:32.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f52157a6640 1 -- 172.21.15.177:0/1052649110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52100ae620 msgr2=0x7f521009a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:32.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f52157a6640 1 --2- 172.21.15.177:0/1052649110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52100ae620 0x7f521009a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:32.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f52157a6640 1 -- 172.21.15.177:0/1052649110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f521006d6f0 msgr2=0x7f52101fa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:32.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f52157a6640 1 --2- 172.21.15.177:0/1052649110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f521006d6f0 0x7f52101fa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:32.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f52157a6640 1 -- 172.21.15.177:0/1052649110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5204009420 con 0x7f521015a480 2023-11-28T20:08:32.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f52157a6640 1 --2- 172.21.15.177:0/1052649110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521015a480 0x7f5210164620 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f520800c7b0 tx=0x7f520800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:32.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f520d7fa640 1 -- 172.21.15.177:0/1052649110 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520800ce60 con 0x7f521015a480 2023-11-28T20:08:32.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f520d7fa640 1 -- 172.21.15.177:0/1052649110 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520800a640 con 0x7f521015a480 2023-11-28T20:08:32.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f5217209640 1 -- 172.21.15.177:0/1052649110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5210099b00 con 0x7f521015a480 2023-11-28T20:08:32.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f520d7fa640 1 -- 172.21.15.177:0/1052649110 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520800a9d0 con 0x7f521015a480 2023-11-28T20:08:32.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f5217209640 1 -- 172.21.15.177:0/1052649110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521009a0c0 con 0x7f521015a480 2023-11-28T20:08:32.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f5217209640 1 -- 172.21.15.177:0/1052649110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521004e850 con 0x7f521015a480 2023-11-28T20:08:32.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.015+0000 7f520d7fa640 1 -- 172.21.15.177:0/1052649110 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f520800ab30 con 0x7f521015a480 2023-11-28T20:08:32.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.019+0000 7f520d7fa640 1 --2- 172.21.15.177:0/1052649110 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f51f4066470 0x7f51f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:32.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.019+0000 7f520d7fa640 1 -- 172.21.15.177:0/1052649110 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5502+0+0 (secure 0 0 0) 0x7f5208082ff0 con 0x7f521015a480 2023-11-28T20:08:32.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.019+0000 7f5214fa5640 1 --2- 172.21.15.177:0/1052649110 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f51f4066470 0x7f51f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:32.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.019+0000 7f5214fa5640 1 --2- 172.21.15.177:0/1052649110 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f51f4066470 0x7f51f4068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f52040af000 tx=0x7f52040a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:32.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.023+0000 7f520d7fa640 1 -- 172.21.15.177:0/1052649110 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5208050680 con 0x7f521015a480 2023-11-28T20:08:32.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.171+0000 7f5217209640 1 -- 172.21.15.177:0/1052649110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f521009a2e0 con 0x7f521015a480 2023-11-28T20:08:32.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.823+0000 7f520d7fa640 1 -- 172.21.15.177:0/1052649110 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f52080180d0 con 0x7f521015a480 2023-11-28T20:08:32.826 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' removed 2023-11-28T20:08:32.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.823+0000 7f5217209640 1 -- 172.21.15.177:0/1052649110 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f51f4066470 msgr2=0x7f51f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:32.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.823+0000 7f5217209640 1 --2- 172.21.15.177:0/1052649110 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f51f4066470 0x7f51f4068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f52040af000 tx=0x7f52040a7000 comp rx=0 tx=0).stop 2023-11-28T20:08:32.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.823+0000 7f5217209640 1 -- 172.21.15.177:0/1052649110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521015a480 msgr2=0x7f5210164620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:32.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.823+0000 7f5217209640 1 --2- 172.21.15.177:0/1052649110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521015a480 0x7f5210164620 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f520800c7b0 tx=0x7f520800cc70 comp rx=0 tx=0).stop 2023-11-28T20:08:32.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.823+0000 7f5217209640 1 -- 172.21.15.177:0/1052649110 shutdown_connections 2023-11-28T20:08:32.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.823+0000 7f5217209640 1 --2- 172.21.15.177:0/1052649110 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f51f4066470 0x7f51f4068930 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:32.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.823+0000 7f5217209640 1 --2- 172.21.15.177:0/1052649110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521015a480 0x7f5210164620 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:32.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.823+0000 7f5217209640 1 --2- 172.21.15.177:0/1052649110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52100ae620 0x7f521009a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:32.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.823+0000 7f5217209640 1 --2- 172.21.15.177:0/1052649110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f521006d6f0 0x7f52101fa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:32.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.823+0000 7f5217209640 1 -- 172.21.15.177:0/1052649110 >> 172.21.15.177:0/1052649110 conn(0x7f52100b0c50 msgr2=0x7f52100abf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:32.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.823+0000 7f5217209640 1 -- 172.21.15.177:0/1052649110 shutdown_connections 2023-11-28T20:08:32.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:32.823+0000 7f5217209640 1 -- 172.21.15.177:0/1052649110 wait complete. 2023-11-28T20:08:32.856 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T20:08:32.856 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T20:08:32.856 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T20:08:32.856 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:08:32.857 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T20:08:32.857 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T20:08:32.857 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T20:08:32.857 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:08:32.857 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T20:08:32.857 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T20:08:32.858 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T20:08:32.858 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:08:32.858 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T20:08:32.858 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T20:08:32.858 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T20:08:32.858 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:08:32.870 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T20:08:32.871 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T20:08:32.871 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T20:08:32.872 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T20:08:32.879 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T20:08:32.879 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T20:08:32.880 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T20:08:32.880 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T20:08:32.921 INFO:tasks.ceph.mds.a:Started 2023-11-28T20:08:32.921 DEBUG:teuthology.parallel:result is None 2023-11-28T20:08:32.923 INFO:tasks.ceph.mds.c:Started 2023-11-28T20:08:32.923 DEBUG:teuthology.parallel:result is None 2023-11-28T20:08:32.925 INFO:tasks.ceph.mds.b:Started 2023-11-28T20:08:32.925 DEBUG:teuthology.parallel:result is None 2023-11-28T20:08:32.927 INFO:tasks.ceph.mds.d:Started 2023-11-28T20:08:32.928 DEBUG:teuthology.parallel:result is None 2023-11-28T20:08:32.928 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T20:08:33.012 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-11-28T20:08:33.014 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2023-11-28T20:08:33.014 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2023-11-28T20:08:33.015 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-11-28T20:08:33.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.087+0000 7f44aaba7640 1 Processor -- start 2023-11-28T20:08:33.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.091+0000 7f44aaba7640 1 -- start start 2023-11-28T20:08:33.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.091+0000 7f44aaba7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44a40d0400 0x7f44a4161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:33.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.091+0000 7f44aaba7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44a4161750 0x7f44a4161ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:33.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.091+0000 7f44aaba7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a40c6fc0 con 0x7f44a40cf910 2023-11-28T20:08:33.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.091+0000 7f44aaba7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a40cf060 con 0x7f44a40d0400 2023-11-28T20:08:33.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.091+0000 7f44aaba7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a41620e0 con 0x7f44a4161750 2023-11-28T20:08:33.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.091+0000 7f44a93a4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44a40d0400 0x7f44a4161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:33.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.091+0000 7f44a93a4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44a40d0400 0x7f44a4161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34938/0 (socket says 172.21.15.177:34938) 2023-11-28T20:08:33.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.091+0000 7f44a93a4640 1 -- 172.21.15.177:0/228135097 learned_addr learned my addr 172.21.15.177:0/228135097 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:33.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.091+0000 7f44aa3a6640 1 --2- 172.21.15.177:0/228135097 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44a4161750 0x7f44a4161ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:33.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.091+0000 7f44a93a4640 1 -- 172.21.15.177:0/228135097 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44a4161750 msgr2=0x7f44a4161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:33.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.091+0000 7f44a93a4640 1 --2- 172.21.15.177:0/228135097 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44a4161750 0x7f44a4161ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:33.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.091+0000 7f44a93a4640 1 -- 172.21.15.177:0/228135097 >> v1:172.21.15.195:6789/0 conn(0x7f44a40cf910 legacy=0x7f44a40cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:33.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.091+0000 7f44a93a4640 1 -- 172.21.15.177:0/228135097 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a40d0890 con 0x7f44a40d0400 2023-11-28T20:08:33.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.095+0000 7f44a93a4640 1 --2- 172.21.15.177:0/228135097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a40d0400 0x7f44a4161210 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f44940098a0 tx=0x7f449401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16685e7e628664b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:33.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.095+0000 7f44a8ba3640 1 -- 172.21.15.177:0/228135097 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44940ab660 con 0x7f44a40d0400 2023-11-28T20:08:33.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.095+0000 7f44a8ba3640 1 -- 172.21.15.177:0/228135097 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44940ab7c0 con 0x7f44a40d0400 2023-11-28T20:08:33.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.095+0000 7f44a8ba3640 1 -- 172.21.15.177:0/228135097 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44940abb50 con 0x7f44a40d0400 2023-11-28T20:08:33.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.095+0000 7f44aaba7640 1 -- 172.21.15.177:0/228135097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a40d0400 msgr2=0x7f44a4161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:33.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.095+0000 7f44aaba7640 1 --2- 172.21.15.177:0/228135097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a40d0400 0x7f44a4161210 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f44940098a0 tx=0x7f449401c460 comp rx=0 tx=0).stop 2023-11-28T20:08:33.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.095+0000 7f44aaba7640 1 -- 172.21.15.177:0/228135097 shutdown_connections 2023-11-28T20:08:33.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.095+0000 7f44aaba7640 1 --2- 172.21.15.177:0/228135097 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44a4161750 0x7f44a4161ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:33.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.095+0000 7f44aaba7640 1 --2- 172.21.15.177:0/228135097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a40d0400 0x7f44a4161210 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:33.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.095+0000 7f44aaba7640 1 -- 172.21.15.177:0/228135097 >> 172.21.15.177:0/228135097 conn(0x7f44a40d2f60 msgr2=0x7f44a40d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:33.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.095+0000 7f44aaba7640 1 -- 172.21.15.177:0/228135097 shutdown_connections 2023-11-28T20:08:33.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.095+0000 7f44aaba7640 1 -- 172.21.15.177:0/228135097 wait complete. 2023-11-28T20:08:33.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aaba7640 1 Processor -- start 2023-11-28T20:08:33.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aaba7640 1 -- start start 2023-11-28T20:08:33.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aaba7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44a40cf910 0x7f44a415dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:33.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aaba7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44a40d0400 0x7f44a415e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:33.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aaba7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a4161750 0x7f44a415f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:33.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aaba7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a41593f0 con 0x7f44a4161750 2023-11-28T20:08:33.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aaba7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4159c90 con 0x7f44a40d0400 2023-11-28T20:08:33.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aaba7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40cc930 con 0x7f44a40cf910 2023-11-28T20:08:33.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aa3a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a4161750 0x7f44a415f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:33.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44a9ba5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44a40cf910 0x7f44a415dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:33.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aa3a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a4161750 0x7f44a415f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34950/0 (socket says 172.21.15.177:34950) 2023-11-28T20:08:33.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44a93a4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44a40d0400 0x7f44a415e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:33.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44a9ba5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44a40cf910 0x7f44a415dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:40140/0 (socket says 172.21.15.177:40140) 2023-11-28T20:08:33.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44a9ba5640 1 -- 172.21.15.177:0/1968441362 learned_addr learned my addr 172.21.15.177:0/1968441362 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:33.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aa3a6640 1 -- 172.21.15.177:0/1968441362 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44a40cf910 msgr2=0x7f44a415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:33.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aa3a6640 1 --2- 172.21.15.177:0/1968441362 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44a40cf910 0x7f44a415dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:33.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aa3a6640 1 -- 172.21.15.177:0/1968441362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44a40d0400 msgr2=0x7f44a415e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:33.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aa3a6640 1 --2- 172.21.15.177:0/1968441362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44a40d0400 0x7f44a415e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:33.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aa3a6640 1 -- 172.21.15.177:0/1968441362 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940094d0 con 0x7f44a4161750 2023-11-28T20:08:33.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44a9ba5640 1 --2- 172.21.15.177:0/1968441362 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44a40cf910 0x7f44a415dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:33.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44a93a4640 1 --2- 172.21.15.177:0/1968441362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44a40d0400 0x7f44a415e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:33.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aa3a6640 1 --2- 172.21.15.177:0/1968441362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a4161750 0x7f44a415f1e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f449c007d20 tx=0x7f449c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:33.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f449a7fc640 1 -- 172.21.15.177:0/1968441362 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c018070 con 0x7f44a4161750 2023-11-28T20:08:33.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f449a7fc640 1 -- 172.21.15.177:0/1968441362 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c00edd0 con 0x7f44a4161750 2023-11-28T20:08:33.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f449a7fc640 1 -- 172.21.15.177:0/1968441362 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c003bc0 con 0x7f44a4161750 2023-11-28T20:08:33.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aaba7640 1 -- 172.21.15.177:0/1968441362 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a4159640 con 0x7f44a4161750 2023-11-28T20:08:33.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aaba7640 1 -- 172.21.15.177:0/1968441362 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a41603b0 con 0x7f44a4161750 2023-11-28T20:08:33.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.099+0000 7f44aaba7640 1 -- 172.21.15.177:0/1968441362 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a4160600 con 0x7f44a4161750 2023-11-28T20:08:33.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.103+0000 7f449a7fc640 1 -- 172.21.15.177:0/1968441362 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f449c014420 con 0x7f44a4161750 2023-11-28T20:08:33.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.103+0000 7f449a7fc640 1 --2- 172.21.15.177:0/1968441362 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4488066470 0x7f4488068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:33.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.103+0000 7f449a7fc640 1 -- 172.21.15.177:0/1968441362 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f449c083cd0 con 0x7f44a4161750 2023-11-28T20:08:33.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.103+0000 7f44a9ba5640 1 --2- 172.21.15.177:0/1968441362 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4488066470 0x7f4488068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:33.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.103+0000 7f44a9ba5640 1 --2- 172.21.15.177:0/1968441362 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4488066470 0x7f4488068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f44a0001ca0 tx=0x7f44a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:33.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.107+0000 7f449a7fc640 1 -- 172.21.15.177:0/1968441362 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f449c0514f0 con 0x7f44a4161750 2023-11-28T20:08:33.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.267+0000 7f44aaba7640 1 -- 172.21.15.177:0/1968441362 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f44a40a0f30 con 0x7f44a4161750 2023-11-28T20:08:33.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.831+0000 7f449a7fc640 1 -- 172.21.15.177:0/1968441362 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f449c054b10 con 0x7f44a4161750 2023-11-28T20:08:33.838 INFO:teuthology.orchestra.run.smithi177.stderr: removed all blocklist entries 2023-11-28T20:08:33.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.835+0000 7f44aaba7640 1 -- 172.21.15.177:0/1968441362 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4488066470 msgr2=0x7f4488068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:33.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.835+0000 7f44aaba7640 1 --2- 172.21.15.177:0/1968441362 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4488066470 0x7f4488068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f44a0001ca0 tx=0x7f44a0009040 comp rx=0 tx=0).stop 2023-11-28T20:08:33.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.835+0000 7f44aaba7640 1 -- 172.21.15.177:0/1968441362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a4161750 msgr2=0x7f44a415f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:33.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.835+0000 7f44aaba7640 1 --2- 172.21.15.177:0/1968441362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a4161750 0x7f44a415f1e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f449c007d20 tx=0x7f449c00e4b0 comp rx=0 tx=0).stop 2023-11-28T20:08:33.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.835+0000 7f44aaba7640 1 -- 172.21.15.177:0/1968441362 shutdown_connections 2023-11-28T20:08:33.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.835+0000 7f44aaba7640 1 --2- 172.21.15.177:0/1968441362 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4488066470 0x7f4488068930 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:33.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.835+0000 7f44aaba7640 1 --2- 172.21.15.177:0/1968441362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a4161750 0x7f44a415f1e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:33.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.835+0000 7f44aaba7640 1 --2- 172.21.15.177:0/1968441362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44a40d0400 0x7f44a415e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:33.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.835+0000 7f44aaba7640 1 --2- 172.21.15.177:0/1968441362 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44a40cf910 0x7f44a415dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:33.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.835+0000 7f44aaba7640 1 -- 172.21.15.177:0/1968441362 >> 172.21.15.177:0/1968441362 conn(0x7f44a40d2f60 msgr2=0x7f44a40d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:33.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.835+0000 7f44aaba7640 1 -- 172.21.15.177:0/1968441362 shutdown_connections 2023-11-28T20:08:33.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.835+0000 7f44aaba7640 1 -- 172.21.15.177:0/1968441362 wait complete. 2023-11-28T20:08:33.866 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T20:08:34.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9c1b16640 1 Processor -- start 2023-11-28T20:08:34.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9c1b16640 1 -- start start 2023-11-28T20:08:34.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9c1b16640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa9bc144840 0x7fa9bc06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9c1b16640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9bc070b70 0x7fa9bc06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9c1b16640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9bc0710e0 con 0x7fa9bc072180 2023-11-28T20:08:34.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9c1b16640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9bc15f010 con 0x7fa9bc144840 2023-11-28T20:08:34.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9c1b16640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc0713c0 con 0x7fa9bc070b70 2023-11-28T20:08:34.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9bb7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa9bc144840 0x7fa9bc06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9bb7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa9bc144840 0x7fa9bc06c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34952/0 (socket says 172.21.15.177:34952) 2023-11-28T20:08:34.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9bb7fe640 1 -- 172.21.15.177:0/665882304 learned_addr learned my addr 172.21.15.177:0/665882304 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:34.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9bbfff640 1 --2- 172.21.15.177:0/665882304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9bc070b70 0x7fa9bc06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9bb7fe640 1 -- 172.21.15.177:0/665882304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9bc070b70 msgr2=0x7fa9bc06c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:34.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9bb7fe640 1 --2- 172.21.15.177:0/665882304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9bc070b70 0x7fa9bc06c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9bb7fe640 1 -- 172.21.15.177:0/665882304 >> v1:172.21.15.195:6789/0 conn(0x7fa9bc072180 legacy=0x7fa9bc070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9bb7fe640 1 -- 172.21.15.177:0/665882304 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc0716a0 con 0x7fa9bc144840 2023-11-28T20:08:34.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:33.999+0000 7fa9bbfff640 1 --2- 172.21.15.177:0/665882304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9bc070b70 0x7fa9bc06c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.003+0000 7fa9bb7fe640 1 --2- 172.21.15.177:0/665882304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc144840 0x7fa9bc06c2c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009870 tx=0x7fa9ac01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93b8acb833f0c84 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.003+0000 7fa9ba7fc640 1 -- 172.21.15.177:0/665882304 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac0aa670 con 0x7fa9bc144840 2023-11-28T20:08:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.003+0000 7fa9ba7fc640 1 -- 172.21.15.177:0/665882304 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ac0aa7d0 con 0x7fa9bc144840 2023-11-28T20:08:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.003+0000 7fa9ba7fc640 1 -- 172.21.15.177:0/665882304 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac0aab60 con 0x7fa9bc144840 2023-11-28T20:08:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.003+0000 7fa9c1b16640 1 -- 172.21.15.177:0/665882304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc144840 msgr2=0x7fa9bc06c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.003+0000 7fa9c1b16640 1 --2- 172.21.15.177:0/665882304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc144840 0x7fa9bc06c2c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009870 tx=0x7fa9ac01c510 comp rx=0 tx=0).stop 2023-11-28T20:08:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.003+0000 7fa9c1b16640 1 -- 172.21.15.177:0/665882304 shutdown_connections 2023-11-28T20:08:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.003+0000 7fa9c1b16640 1 --2- 172.21.15.177:0/665882304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9bc070b70 0x7fa9bc06c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.003+0000 7fa9c1b16640 1 --2- 172.21.15.177:0/665882304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc144840 0x7fa9bc06c2c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.003+0000 7fa9c1b16640 1 -- 172.21.15.177:0/665882304 >> 172.21.15.177:0/665882304 conn(0x7fa9bc06a530 msgr2=0x7fa9bc06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:34.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.003+0000 7fa9c1b16640 1 -- 172.21.15.177:0/665882304 shutdown_connections 2023-11-28T20:08:34.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.003+0000 7fa9c1b16640 1 -- 172.21.15.177:0/665882304 wait complete. 2023-11-28T20:08:34.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9c1b16640 1 Processor -- start 2023-11-28T20:08:34.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9c1b16640 1 -- start start 2023-11-28T20:08:34.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9c1b16640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9bc070b70 0x7fa9bc13be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9c1b16640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9bc072180 0x7fa9bc13d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9c1b16640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc144840 0x7fa9bc15a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9c1b16640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc164ad0 con 0x7fa9bc144840 2023-11-28T20:08:34.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9c1b16640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc13c370 con 0x7fa9bc072180 2023-11-28T20:08:34.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9c1b16640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc13d660 con 0x7fa9bc070b70 2023-11-28T20:08:34.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc144840 0x7fa9bc15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc144840 0x7fa9bc15a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34956/0 (socket says 172.21.15.177:34956) 2023-11-28T20:08:34.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9bbfff640 1 -- 172.21.15.177:0/171507617 learned_addr learned my addr 172.21.15.177:0/171507617 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:34.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9bb7fe640 1 --2- 172.21.15.177:0/171507617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9bc070b70 0x7fa9bc13be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9baffd640 1 --2- 172.21.15.177:0/171507617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9bc072180 0x7fa9bc13d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9bbfff640 1 -- 172.21.15.177:0/171507617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9bc070b70 msgr2=0x7fa9bc13be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9bbfff640 1 --2- 172.21.15.177:0/171507617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9bc070b70 0x7fa9bc13be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9bbfff640 1 -- 172.21.15.177:0/171507617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9bc072180 msgr2=0x7fa9bc13d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9bbfff640 1 --2- 172.21.15.177:0/171507617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9bc072180 0x7fa9bc13d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9bbfff640 1 -- 172.21.15.177:0/171507617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ac0094d0 con 0x7fa9bc144840 2023-11-28T20:08:34.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9baffd640 1 --2- 172.21.15.177:0/171507617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9bc072180 0x7fa9bc13d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:34.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9bbfff640 1 --2- 172.21.15.177:0/171507617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc144840 0x7fa9bc15a930 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400cef0 tx=0x7fa9b400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:34.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9a3fff640 1 -- 172.21.15.177:0/171507617 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b400d840 con 0x7fa9bc144840 2023-11-28T20:08:34.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9a3fff640 1 -- 172.21.15.177:0/171507617 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b400d9c0 con 0x7fa9bc144840 2023-11-28T20:08:34.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9a3fff640 1 -- 172.21.15.177:0/171507617 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b400dd70 con 0x7fa9bc144840 2023-11-28T20:08:34.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9c1b16640 1 -- 172.21.15.177:0/171507617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9bc13c5a0 con 0x7fa9bc144840 2023-11-28T20:08:34.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.007+0000 7fa9c1b16640 1 -- 172.21.15.177:0/171507617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9bc13cb60 con 0x7fa9bc144840 2023-11-28T20:08:34.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.011+0000 7fa9c1b16640 1 -- 172.21.15.177:0/171507617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9bc161010 con 0x7fa9bc144840 2023-11-28T20:08:34.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.011+0000 7fa9a3fff640 1 -- 172.21.15.177:0/171507617 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa9b401e3b0 con 0x7fa9bc144840 2023-11-28T20:08:34.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.011+0000 7fa9a3fff640 1 --2- 172.21.15.177:0/171507617 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa9a80664a0 0x7fa9a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.011+0000 7fa9a3fff640 1 -- 172.21.15.177:0/171507617 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa9b4084590 con 0x7fa9bc144840 2023-11-28T20:08:34.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.011+0000 7fa9bb7fe640 1 --2- 172.21.15.177:0/171507617 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa9a80664a0 0x7fa9a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.011+0000 7fa9bb7fe640 1 --2- 172.21.15.177:0/171507617 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa9a80664a0 0x7fa9a8068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac0ae000 tx=0x7fa9ac0b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.015+0000 7fa9a3fff640 1 -- 172.21.15.177:0/171507617 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa9b4051e30 con 0x7fa9bc144840 2023-11-28T20:08:34.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.219+0000 7fa9c1b16640 1 -- 172.21.15.177:0/171507617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa9bc0b1e10 con 0x7fa9bc144840 2023-11-28T20:08:34.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.219+0000 7fa9a3fff640 1 -- 172.21.15.177:0/171507617 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fa9b401a090 con 0x7fa9bc144840 2023-11-28T20:08:34.226 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:34.226 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:08:34.226 INFO:teuthology.orchestra.run.smithi177.stdout: "auth_dump": [ 2023-11-28T20:08:34.226 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.226 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.a", 2023-11-28T20:08:34.226 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlT2itExAAiboY3RykwKkdHHvSX89FMg==", 2023-11-28T20:08:34.226 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.226 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:08:34.227 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-11-28T20:08:34.227 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-11-28T20:08:34.227 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:08:34.227 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.227 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.227 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.227 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.b", 2023-11-28T20:08:34.227 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlXOfvHxAAxtE7/5YjkCT81r/R33CimA==", 2023-11-28T20:08:34.227 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.227 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:08:34.227 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-11-28T20:08:34.227 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-11-28T20:08:34.228 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:08:34.228 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.228 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.228 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.228 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.c", 2023-11-28T20:08:34.228 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZllwEQGxAAIZbBHVfQ7S698b34X58EoQ==", 2023-11-28T20:08:34.228 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.228 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:08:34.228 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-11-28T20:08:34.228 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-11-28T20:08:34.228 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:08:34.228 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.229 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.229 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.229 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.d", 2023-11-28T20:08:34.229 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlQ3phJxAAO3C3l75cY24gpt5A4fkNzw==", 2023-11-28T20:08:34.229 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.229 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:08:34.229 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-11-28T20:08:34.229 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-11-28T20:08:34.229 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:08:34.229 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.229 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.229 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.230 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.0", 2023-11-28T20:08:34.230 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBWSGZl6J/iBRAAaHtCcQTA4eByPVZs3gabUA==", 2023-11-28T20:08:34.230 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.230 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:08:34.230 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:08:34.230 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:08:34.230 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.230 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.230 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.230 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.1", 2023-11-28T20:08:34.230 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBZSGZlsadjDBAAzMr5eUjea1EK53hskbXjnA==", 2023-11-28T20:08:34.230 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.231 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:08:34.231 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:08:34.231 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:08:34.231 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.231 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.231 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.231 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.2", 2023-11-28T20:08:34.231 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBdSGZloPsrKBAAGjlzPhk/tJwOSjuWQkePaA==", 2023-11-28T20:08:34.231 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.231 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:08:34.231 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:08:34.231 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:08:34.231 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.232 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.232 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.232 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.3", 2023-11-28T20:08:34.232 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBgSGZlm8hhMBAAlJNZgd37p89WH4x/64TEmg==", 2023-11-28T20:08:34.232 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.232 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:08:34.232 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:08:34.232 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:08:34.233 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.233 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.233 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.233 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.4", 2023-11-28T20:08:34.233 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBlSGZlFVMqAxAAT/EhE4C6jEDYQewJ//aUyg==", 2023-11-28T20:08:34.233 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.233 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:08:34.233 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:08:34.233 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:08:34.233 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.233 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.234 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.234 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.5", 2023-11-28T20:08:34.234 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBoSGZlwv67CRAArT/ZRS25JQ6UrtviY01mqA==", 2023-11-28T20:08:34.234 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.234 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:08:34.234 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:08:34.234 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:08:34.234 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.234 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.234 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.234 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.6", 2023-11-28T20:08:34.234 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBrSGZlKNlhEBAAV+M35LEhu8Gam1Rf0rekxQ==", 2023-11-28T20:08:34.235 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.235 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:08:34.235 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:08:34.235 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:08:34.235 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.235 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.235 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.235 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.7", 2023-11-28T20:08:34.235 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBuSGZl5kj9FhAA3+3ARqIw80zr9Tkv+hQMNA==", 2023-11-28T20:08:34.236 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.236 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:08:34.236 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:08:34.236 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:08:34.236 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.236 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.236 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.236 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.0", 2023-11-28T20:08:34.236 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZl+2t5KxAAc/J7x+fjSQR4IkIQJ/X8sw==", 2023-11-28T20:08:34.236 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.236 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:08:34.236 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-11-28T20:08:34.237 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-11-28T20:08:34.237 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-11-28T20:08:34.237 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.237 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.237 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.237 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.1", 2023-11-28T20:08:34.237 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlOyYqNRAAPICNuyLDmazDLHBbbNJH2w==", 2023-11-28T20:08:34.237 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.237 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:08:34.237 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-11-28T20:08:34.237 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-11-28T20:08:34.237 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-11-28T20:08:34.238 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.238 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.238 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.238 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.2", 2023-11-28T20:08:34.238 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlkxWhMRAAWgwPbTkk7I2652ytEyZhMQ==", 2023-11-28T20:08:34.238 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.238 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:08:34.238 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-11-28T20:08:34.238 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-11-28T20:08:34.239 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-11-28T20:08:34.239 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.239 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.239 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.239 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.3", 2023-11-28T20:08:34.239 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlcbtmOxAA/IaYtuh4NdUQ+WVwAGmD+w==", 2023-11-28T20:08:34.239 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.239 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:08:34.239 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-11-28T20:08:34.239 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-11-28T20:08:34.240 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-11-28T20:08:34.240 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.240 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.240 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.240 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.admin", 2023-11-28T20:08:34.240 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBRSGZlj3FoLhAAmuuH/X0zkO/oeN6Ypa0Wmw==", 2023-11-28T20:08:34.240 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.240 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-11-28T20:08:34.240 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-11-28T20:08:34.240 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-11-28T20:08:34.240 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:08:34.240 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.241 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.241 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.241 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-mds", 2023-11-28T20:08:34.241 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB0SGZlpfMyGhAAxE5GjLlYuXMQUURw9qnIkw==", 2023-11-28T20:08:34.241 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.241 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-mds" 2023-11-28T20:08:34.241 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.241 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.241 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.241 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-mgr", 2023-11-28T20:08:34.241 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB0SGZliQMzGhAAELL7aRicXH7lAgRIPjCjPg==", 2023-11-28T20:08:34.241 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.241 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-28T20:08:34.242 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.242 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.242 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.242 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-osd", 2023-11-28T20:08:34.242 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB0SGZlaxEzGhAA6Q3+AxN4E3kyGXVv/MwWNg==", 2023-11-28T20:08:34.242 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.242 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-osd" 2023-11-28T20:08:34.242 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.242 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.242 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.242 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-rbd", 2023-11-28T20:08:34.243 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB0SGZl+R4zGhAACCfm2+9F/HijcIW0/1UXQg==", 2023-11-28T20:08:34.243 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.243 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-28T20:08:34.243 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.243 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.243 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.243 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-28T20:08:34.244 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB0SGZlbi0zGhAAP7V16Qr26M/YHgAqwYtYFA==", 2023-11-28T20:08:34.244 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.244 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-28T20:08:34.244 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.244 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.244 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.244 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-rgw", 2023-11-28T20:08:34.244 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB0SGZlmzszGhAAl4yhvjhOt2ecehlw+oxWNw==", 2023-11-28T20:08:34.244 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.244 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-28T20:08:34.244 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.244 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.245 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.245 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.x", 2023-11-28T20:08:34.245 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlx9l8CxAAZ3ZNX9zYEgw8kzA5dLPB5A==", 2023-11-28T20:08:34.245 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.245 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-11-28T20:08:34.245 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-11-28T20:08:34.245 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:08:34.245 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.245 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:34.245 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:34.245 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.y", 2023-11-28T20:08:34.245 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlR0mhBxAAvFcVR6gwEEezMfUCJfsFwg==", 2023-11-28T20:08:34.246 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:08:34.246 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-11-28T20:08:34.246 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-11-28T20:08:34.246 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:08:34.246 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.246 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:34.246 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-11-28T20:08:34.246 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:08:34.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.223+0000 7fa9c1b16640 1 -- 172.21.15.177:0/171507617 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa9a80664a0 msgr2=0x7fa9a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.223+0000 7fa9c1b16640 1 --2- 172.21.15.177:0/171507617 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa9a80664a0 0x7fa9a8068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac0ae000 tx=0x7fa9ac0b5040 comp rx=0 tx=0).stop 2023-11-28T20:08:34.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.223+0000 7fa9c1b16640 1 -- 172.21.15.177:0/171507617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc144840 msgr2=0x7fa9bc15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.223+0000 7fa9c1b16640 1 --2- 172.21.15.177:0/171507617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc144840 0x7fa9bc15a930 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400cef0 tx=0x7fa9b400a710 comp rx=0 tx=0).stop 2023-11-28T20:08:34.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.223+0000 7fa9c1b16640 1 -- 172.21.15.177:0/171507617 shutdown_connections 2023-11-28T20:08:34.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.223+0000 7fa9c1b16640 1 --2- 172.21.15.177:0/171507617 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa9a80664a0 0x7fa9a8068960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.223+0000 7fa9c1b16640 1 --2- 172.21.15.177:0/171507617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc144840 0x7fa9bc15a930 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.223+0000 7fa9c1b16640 1 --2- 172.21.15.177:0/171507617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9bc072180 0x7fa9bc13d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.223+0000 7fa9c1b16640 1 --2- 172.21.15.177:0/171507617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9bc070b70 0x7fa9bc13be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.223+0000 7fa9c1b16640 1 -- 172.21.15.177:0/171507617 >> 172.21.15.177:0/171507617 conn(0x7fa9bc06a530 msgr2=0x7fa9bc13faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:34.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.223+0000 7fa9c1b16640 1 -- 172.21.15.177:0/171507617 shutdown_connections 2023-11-28T20:08:34.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.223+0000 7fa9c1b16640 1 -- 172.21.15.177:0/171507617 wait complete. 2023-11-28T20:08:34.249 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-28T20:08:34.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.383+0000 7f6c0de17640 1 Processor -- start 2023-11-28T20:08:34.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.383+0000 7f6c0de17640 1 -- start start 2023-11-28T20:08:34.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.383+0000 7f6c0de17640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6c0813cf30 0x7f6c0806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.383+0000 7f6c0de17640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6c0806c800 0x7f6c0815a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.383+0000 7f6c0de17640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0815b3a0 con 0x7f6c0815ab70 2023-11-28T20:08:34.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.383+0000 7f6c0de17640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0813d310 con 0x7f6c0813cf30 2023-11-28T20:08:34.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.383+0000 7f6c0de17640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c081404e0 con 0x7f6c0806c800 2023-11-28T20:08:34.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.383+0000 7f6c07fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f6c0815ab70 0x7f6c08071570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44378/0 (socket says 172.21.15.177:44378) 2023-11-28T20:08:34.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.383+0000 7f6c07fff640 1 -- 172.21.15.177:0/807317958 learned_addr learned my addr 172.21.15.177:0/807317958 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:34.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.383+0000 7f6c077fe640 1 --2- 172.21.15.177:0/807317958 >> v2:172.21.15.177:3300/0 conn(0x7f6c0813cf30 0x7f6c0806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.383+0000 7f6bfffff640 1 --2- 172.21.15.177:0/807317958 >> v2:172.21.15.195:3300/0 conn(0x7f6c0806c800 0x7f6c0815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.383+0000 7f6c077fe640 1 -- 172.21.15.177:0/807317958 >> v2:172.21.15.195:3300/0 conn(0x7f6c0806c800 msgr2=0x7f6c0815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:34.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.383+0000 7f6c077fe640 1 --2- 172.21.15.177:0/807317958 >> v2:172.21.15.195:3300/0 conn(0x7f6c0806c800 0x7f6c0815a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.383+0000 7f6c077fe640 1 -- 172.21.15.177:0/807317958 >> v1:172.21.15.177:6789/0 conn(0x7f6c0815ab70 legacy=0x7f6c08071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.383+0000 7f6c077fe640 1 -- 172.21.15.177:0/807317958 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0813f720 con 0x7f6c0813cf30 2023-11-28T20:08:34.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.387+0000 7f6c077fe640 1 --2- 172.21.15.177:0/807317958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c0813cf30 0x7f6c0806c2c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6c080cc790 tx=0x7f6bf801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831a0469b5c99504 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:34.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.387+0000 7f6c06ffd640 1 -- 172.21.15.177:0/807317958 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf80ab600 con 0x7f6c0813cf30 2023-11-28T20:08:34.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.387+0000 7f6c06ffd640 1 -- 172.21.15.177:0/807317958 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf80a7050 con 0x7f6c0813cf30 2023-11-28T20:08:34.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.387+0000 7f6c06ffd640 1 -- 172.21.15.177:0/807317958 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf80ab980 con 0x7f6c0813cf30 2023-11-28T20:08:34.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.387+0000 7f6c0de17640 1 -- 172.21.15.177:0/807317958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c0813cf30 msgr2=0x7f6c0806c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.387+0000 7f6c0de17640 1 --2- 172.21.15.177:0/807317958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c0813cf30 0x7f6c0806c2c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6c080cc790 tx=0x7f6bf801c3b0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.387+0000 7f6c0de17640 1 -- 172.21.15.177:0/807317958 shutdown_connections 2023-11-28T20:08:34.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.387+0000 7f6c0de17640 1 --2- 172.21.15.177:0/807317958 >> v2:172.21.15.195:3300/0 conn(0x7f6c0806c800 0x7f6c0815a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.387+0000 7f6c0de17640 1 --2- 172.21.15.177:0/807317958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c0813cf30 0x7f6c0806c2c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.387+0000 7f6c0de17640 1 -- 172.21.15.177:0/807317958 >> 172.21.15.177:0/807317958 conn(0x7f6c0806a530 msgr2=0x7f6c0806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:34.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.387+0000 7f6c0de17640 1 -- 172.21.15.177:0/807317958 shutdown_connections 2023-11-28T20:08:34.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.387+0000 7f6c0de17640 1 -- 172.21.15.177:0/807317958 wait complete. 2023-11-28T20:08:34.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c0de17640 1 Processor -- start 2023-11-28T20:08:34.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c0de17640 1 -- start start 2023-11-28T20:08:34.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c0de17640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c0806c800 0x7f6c081f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c0de17640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c0813cf30 0x7f6c081f9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c0de17640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c0815ab70 0x7f6c081f9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c0de17640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c080b29d0 con 0x7f6c0815ab70 2023-11-28T20:08:34.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c0de17640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c080b3d90 con 0x7f6c0813cf30 2023-11-28T20:08:34.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c0de17640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c080b3210 con 0x7f6c0806c800 2023-11-28T20:08:34.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c07fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c0815ab70 0x7f6c081f9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c07fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c0815ab70 0x7f6c081f9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34976/0 (socket says 172.21.15.177:34976) 2023-11-28T20:08:34.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c07fff640 1 -- 172.21.15.177:0/4274350793 learned_addr learned my addr 172.21.15.177:0/4274350793 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:34.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c077fe640 1 --2- 172.21.15.177:0/4274350793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c0806c800 0x7f6c081f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6bfffff640 1 --2- 172.21.15.177:0/4274350793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c0813cf30 0x7f6c081f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c07fff640 1 -- 172.21.15.177:0/4274350793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c0806c800 msgr2=0x7f6c081f92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c07fff640 1 --2- 172.21.15.177:0/4274350793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c0806c800 0x7f6c081f92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c07fff640 1 -- 172.21.15.177:0/4274350793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c0813cf30 msgr2=0x7f6c081f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c07fff640 1 --2- 172.21.15.177:0/4274350793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c0813cf30 0x7f6c081f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c07fff640 1 -- 172.21.15.177:0/4274350793 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf8009420 con 0x7f6c0815ab70 2023-11-28T20:08:34.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6bfffff640 1 --2- 172.21.15.177:0/4274350793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c0813cf30 0x7f6c081f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:34.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c07fff640 1 --2- 172.21.15.177:0/4274350793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c0815ab70 0x7f6c081f9d70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000cbc0 tx=0x7f6c0000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:34.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c04ff9640 1 -- 172.21.15.177:0/4274350793 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000ace0 con 0x7f6c0815ab70 2023-11-28T20:08:34.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c04ff9640 1 -- 172.21.15.177:0/4274350793 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0000ae40 con 0x7f6c0815ab70 2023-11-28T20:08:34.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c0de17640 1 -- 172.21.15.177:0/4274350793 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c080b3ab0 con 0x7f6c0815ab70 2023-11-28T20:08:34.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c04ff9640 1 -- 172.21.15.177:0/4274350793 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00012600 con 0x7f6c0815ab70 2023-11-28T20:08:34.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.391+0000 7f6c0de17640 1 -- 172.21.15.177:0/4274350793 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c080b2ea0 con 0x7f6c0815ab70 2023-11-28T20:08:34.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.395+0000 7f6c0de17640 1 -- 172.21.15.177:0/4274350793 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c08069440 con 0x7f6c0815ab70 2023-11-28T20:08:34.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.395+0000 7f6c04ff9640 1 -- 172.21.15.177:0/4274350793 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c00007070 con 0x7f6c0815ab70 2023-11-28T20:08:34.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.395+0000 7f6c04ff9640 1 --2- 172.21.15.177:0/4274350793 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bec066470 0x7f6bec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.395+0000 7f6c04ff9640 1 -- 172.21.15.177:0/4274350793 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6c000838e0 con 0x7f6c0815ab70 2023-11-28T20:08:34.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.395+0000 7f6c077fe640 1 --2- 172.21.15.177:0/4274350793 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bec066470 0x7f6bec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.399+0000 7f6c077fe640 1 --2- 172.21.15.177:0/4274350793 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bec066470 0x7f6bec068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80ad000 tx=0x7f6bf8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:34.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.399+0000 7f6c04ff9640 1 -- 172.21.15.177:0/4274350793 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c00051150 con 0x7f6c0815ab70 2023-11-28T20:08:34.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.603+0000 7f6c0de17640 1 -- 172.21.15.177:0/4274350793 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f6c0814c690 con 0x7f6c0815ab70 2023-11-28T20:08:34.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.607+0000 7f6c04ff9640 1 -- 172.21.15.177:0/4274350793 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6c000170a0 con 0x7f6c0815ab70 2023-11-28T20:08:34.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.611+0000 7f6c0de17640 1 -- 172.21.15.177:0/4274350793 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bec066470 msgr2=0x7f6bec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.611+0000 7f6c0de17640 1 --2- 172.21.15.177:0/4274350793 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bec066470 0x7f6bec068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80ad000 tx=0x7f6bf8008040 comp rx=0 tx=0).stop 2023-11-28T20:08:34.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.611+0000 7f6c0de17640 1 -- 172.21.15.177:0/4274350793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c0815ab70 msgr2=0x7f6c081f9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.611+0000 7f6c0de17640 1 --2- 172.21.15.177:0/4274350793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c0815ab70 0x7f6c081f9d70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000cbc0 tx=0x7f6c0000a430 comp rx=0 tx=0).stop 2023-11-28T20:08:34.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.611+0000 7f6c0de17640 1 -- 172.21.15.177:0/4274350793 shutdown_connections 2023-11-28T20:08:34.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.611+0000 7f6c0de17640 1 --2- 172.21.15.177:0/4274350793 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bec066470 0x7f6bec068930 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.611+0000 7f6c0de17640 1 --2- 172.21.15.177:0/4274350793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c0815ab70 0x7f6c081f9d70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.611+0000 7f6c0de17640 1 --2- 172.21.15.177:0/4274350793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c0813cf30 0x7f6c081f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.611+0000 7f6c0de17640 1 --2- 172.21.15.177:0/4274350793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c0806c800 0x7f6c081f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.611+0000 7f6c0de17640 1 -- 172.21.15.177:0/4274350793 >> 172.21.15.177:0/4274350793 conn(0x7f6c0806a530 msgr2=0x7f6c0813c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:34.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.611+0000 7f6c0de17640 1 -- 172.21.15.177:0/4274350793 shutdown_connections 2023-11-28T20:08:34.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.611+0000 7f6c0de17640 1 -- 172.21.15.177:0/4274350793 wait complete. 2023-11-28T20:08:34.635 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-28T20:08:34.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.767+0000 7f5eed232640 1 Processor -- start 2023-11-28T20:08:34.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.767+0000 7f5eed232640 1 -- start start 2023-11-28T20:08:34.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.771+0000 7f5eed232640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ee815ad40 0x7f5ee8164df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.771+0000 7f5eed232640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee815b170 con 0x7f5ee806c9d0 2023-11-28T20:08:34.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.771+0000 7f5eed232640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee815b3a0 con 0x7f5ee813cf30 2023-11-28T20:08:34.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.771+0000 7f5eed232640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee813d310 con 0x7f5ee815ad40 2023-11-28T20:08:34.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.771+0000 7f5ee659c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5ee806c9d0 0x7f5ee815a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44392/0 (socket says 172.21.15.177:44392) 2023-11-28T20:08:34.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.771+0000 7f5ee759e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ee815ad40 0x7f5ee8164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.771+0000 7f5ee659c640 1 -- 172.21.15.177:0/354071267 learned_addr learned my addr 172.21.15.177:0/354071267 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:34.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.771+0000 7f5ee759e640 1 -- 172.21.15.177:0/354071267 >> v1:172.21.15.195:6789/0 conn(0x7f5ee813cf30 legacy=0x7f5ee806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.771+0000 7f5ee759e640 1 -- 172.21.15.177:0/354071267 >> v1:172.21.15.177:6789/0 conn(0x7f5ee806c9d0 legacy=0x7f5ee815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.771+0000 7f5ee759e640 1 -- 172.21.15.177:0/354071267 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee813f720 con 0x7f5ee815ad40 2023-11-28T20:08:34.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.775+0000 7f5ee759e640 1 --2- 172.21.15.177:0/354071267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee815ad40 0x7f5ee8164df0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009d90 tx=0x7f5ee001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb98276cb62b4c30 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:34.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.775+0000 7f5ee5d9b640 1 -- 172.21.15.177:0/354071267 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee00a5770 con 0x7f5ee815ad40 2023-11-28T20:08:34.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.775+0000 7f5ee5d9b640 1 -- 172.21.15.177:0/354071267 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee00a58d0 con 0x7f5ee815ad40 2023-11-28T20:08:34.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.775+0000 7f5ee5d9b640 1 -- 172.21.15.177:0/354071267 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee00a5c60 con 0x7f5ee815ad40 2023-11-28T20:08:34.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.775+0000 7f5eed232640 1 -- 172.21.15.177:0/354071267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee815ad40 msgr2=0x7f5ee8164df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.775+0000 7f5eed232640 1 --2- 172.21.15.177:0/354071267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee815ad40 0x7f5ee8164df0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009d90 tx=0x7f5ee001c8c0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.775+0000 7f5eed232640 1 -- 172.21.15.177:0/354071267 shutdown_connections 2023-11-28T20:08:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.775+0000 7f5eed232640 1 --2- 172.21.15.177:0/354071267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee815ad40 0x7f5ee8164df0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.775+0000 7f5eed232640 1 -- 172.21.15.177:0/354071267 >> 172.21.15.177:0/354071267 conn(0x7f5ee806a530 msgr2=0x7f5ee806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.775+0000 7f5eed232640 1 -- 172.21.15.177:0/354071267 shutdown_connections 2023-11-28T20:08:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.775+0000 7f5eed232640 1 -- 172.21.15.177:0/354071267 wait complete. 2023-11-28T20:08:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.775+0000 7f5eed232640 1 Processor -- start 2023-11-28T20:08:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.775+0000 7f5eed232640 1 -- start start 2023-11-28T20:08:34.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.775+0000 7f5eed232640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ee806c9d0 0x7f5ee8147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.775+0000 7f5eed232640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee813cf30 0x7f5ee80b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5eed232640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ee815ad40 0x7f5ee80b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5eed232640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80b3cf0 con 0x7f5ee813cf30 2023-11-28T20:08:34.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5eed232640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee81467d0 con 0x7f5ee806c9d0 2023-11-28T20:08:34.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5eed232640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee81366b0 con 0x7f5ee815ad40 2023-11-28T20:08:34.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5ee659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee813cf30 0x7f5ee80b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5ee659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee813cf30 0x7f5ee80b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35008/0 (socket says 172.21.15.177:35008) 2023-11-28T20:08:34.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5ee659c640 1 -- 172.21.15.177:0/2203175021 learned_addr learned my addr 172.21.15.177:0/2203175021 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:34.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5ee759e640 1 --2- 172.21.15.177:0/2203175021 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ee815ad40 0x7f5ee80b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5ee6d9d640 1 --2- 172.21.15.177:0/2203175021 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ee806c9d0 0x7f5ee8147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5ee659c640 1 -- 172.21.15.177:0/2203175021 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ee815ad40 msgr2=0x7f5ee80b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5ee659c640 1 --2- 172.21.15.177:0/2203175021 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ee815ad40 0x7f5ee80b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5ee659c640 1 -- 172.21.15.177:0/2203175021 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ee806c9d0 msgr2=0x7f5ee8147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5ee659c640 1 --2- 172.21.15.177:0/2203175021 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ee806c9d0 0x7f5ee8147ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5ee659c640 1 -- 172.21.15.177:0/2203175021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee0009a70 con 0x7f5ee813cf30 2023-11-28T20:08:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5ee659c640 1 --2- 172.21.15.177:0/2203175021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee813cf30 0x7f5ee80b3270 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00c500 tx=0x7f5edc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5ecf7fe640 1 -- 172.21.15.177:0/2203175021 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc005cf0 con 0x7f5ee813cf30 2023-11-28T20:08:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5ecf7fe640 1 -- 172.21.15.177:0/2203175021 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc005e50 con 0x7f5ee813cf30 2023-11-28T20:08:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5ecf7fe640 1 -- 172.21.15.177:0/2203175021 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0072f0 con 0x7f5ee813cf30 2023-11-28T20:08:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5eed232640 1 -- 172.21.15.177:0/2203175021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee8146a20 con 0x7f5ee813cf30 2023-11-28T20:08:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5eed232640 1 -- 172.21.15.177:0/2203175021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee8146fe0 con 0x7f5ee813cf30 2023-11-28T20:08:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5eed232640 1 -- 172.21.15.177:0/2203175021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee8069440 con 0x7f5ee813cf30 2023-11-28T20:08:34.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.779+0000 7f5ecf7fe640 1 -- 172.21.15.177:0/2203175021 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5edc007450 con 0x7f5ee813cf30 2023-11-28T20:08:34.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.782+0000 7f5ecf7fe640 1 --2- 172.21.15.177:0/2203175021 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5ed4066470 0x7f5ed4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:34.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.782+0000 7f5ecf7fe640 1 -- 172.21.15.177:0/2203175021 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5edc082fc0 con 0x7f5ee813cf30 2023-11-28T20:08:34.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.782+0000 7f5ee6d9d640 1 --2- 172.21.15.177:0/2203175021 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5ed4066470 0x7f5ed4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:34.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.782+0000 7f5ee6d9d640 1 --2- 172.21.15.177:0/2203175021 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5ed4066470 0x7f5ed4068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5ee814cb40 tx=0x7f5ed8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:34.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.786+0000 7f5ecf7fe640 1 -- 172.21.15.177:0/2203175021 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5edc0b4280 con 0x7f5ee813cf30 2023-11-28T20:08:34.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.990+0000 7f5eed232640 1 -- 172.21.15.177:0/2203175021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f5ee806d1e0 con 0x7f5ee813cf30 2023-11-28T20:08:35.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.994+0000 7f5ecf7fe640 1 -- 172.21.15.177:0/2203175021 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5edc017020 con 0x7f5ee813cf30 2023-11-28T20:08:35.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.994+0000 7f5eed232640 1 -- 172.21.15.177:0/2203175021 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5ed4066470 msgr2=0x7f5ed4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.994+0000 7f5eed232640 1 --2- 172.21.15.177:0/2203175021 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5ed4066470 0x7f5ed4068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5ee814cb40 tx=0x7f5ed8009040 comp rx=0 tx=0).stop 2023-11-28T20:08:35.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.994+0000 7f5eed232640 1 -- 172.21.15.177:0/2203175021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee813cf30 msgr2=0x7f5ee80b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.994+0000 7f5eed232640 1 --2- 172.21.15.177:0/2203175021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee813cf30 0x7f5ee80b3270 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00c500 tx=0x7f5edc00c9c0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.994+0000 7f5eed232640 1 -- 172.21.15.177:0/2203175021 shutdown_connections 2023-11-28T20:08:35.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.994+0000 7f5eed232640 1 --2- 172.21.15.177:0/2203175021 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5ed4066470 0x7f5ed4068930 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.994+0000 7f5eed232640 1 --2- 172.21.15.177:0/2203175021 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ee815ad40 0x7f5ee80b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.994+0000 7f5eed232640 1 --2- 172.21.15.177:0/2203175021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee813cf30 0x7f5ee80b3270 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.994+0000 7f5eed232640 1 --2- 172.21.15.177:0/2203175021 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ee806c9d0 0x7f5ee8147ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.994+0000 7f5eed232640 1 -- 172.21.15.177:0/2203175021 >> 172.21.15.177:0/2203175021 conn(0x7f5ee806a530 msgr2=0x7f5ee813e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:35.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.994+0000 7f5eed232640 1 -- 172.21.15.177:0/2203175021 shutdown_connections 2023-11-28T20:08:35.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:34.994+0000 7f5eed232640 1 -- 172.21.15.177:0/2203175021 wait complete. 2023-11-28T20:08:35.073 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-28T20:08:35.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.206+0000 7f0562e9c640 1 Processor -- start 2023-11-28T20:08:35.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.206+0000 7f0562e9c640 1 -- start start 2023-11-28T20:08:35.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.206+0000 7f0562e9c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c06c2c0 0x7f055c06cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.206+0000 7f0562e9c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f055c06c6a0 0x7f055c150250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.206+0000 7f0562e9c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c070460 con 0x7f055c150790 2023-11-28T20:08:35.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.206+0000 7f0562e9c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c15ab20 con 0x7f055c06c6a0 2023-11-28T20:08:35.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.206+0000 7f0562e9c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c070690 con 0x7f055c06c2c0 2023-11-28T20:08:35.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.206+0000 7f0553fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f055c06c6a0 0x7f055c150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:35.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.206+0000 7f0553fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f055c06c6a0 0x7f055c150250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35020/0 (socket says 172.21.15.177:35020) 2023-11-28T20:08:35.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.206+0000 7f0553fff640 1 -- 172.21.15.177:0/899015736 learned_addr learned my addr 172.21.15.177:0/899015736 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:35.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.206+0000 7f0560c38640 1 --2- 172.21.15.177:0/899015736 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c06c2c0 0x7f055c06cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:35.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f0553fff640 1 -- 172.21.15.177:0/899015736 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c06c2c0 msgr2=0x7f055c06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:35.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f0553fff640 1 --2- 172.21.15.177:0/899015736 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c06c2c0 0x7f055c06cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f0553fff640 1 -- 172.21.15.177:0/899015736 >> v1:172.21.15.195:6789/0 conn(0x7f055c150790 legacy=0x7f055c159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f0553fff640 1 -- 172.21.15.177:0/899015736 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c070970 con 0x7f055c06c6a0 2023-11-28T20:08:35.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f0553fff640 1 --2- 172.21.15.177:0/899015736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f055c06c6a0 0x7f055c150250 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f054c009870 tx=0x7f054c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd01a79b1b4226a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:35.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f05537fe640 1 -- 172.21.15.177:0/899015736 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c0ab600 con 0x7f055c06c6a0 2023-11-28T20:08:35.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f05537fe640 1 -- 172.21.15.177:0/899015736 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c0a7050 con 0x7f055c06c6a0 2023-11-28T20:08:35.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f05537fe640 1 -- 172.21.15.177:0/899015736 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c0ab980 con 0x7f055c06c6a0 2023-11-28T20:08:35.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f0562e9c640 1 -- 172.21.15.177:0/899015736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f055c06c6a0 msgr2=0x7f055c150250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f0562e9c640 1 --2- 172.21.15.177:0/899015736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f055c06c6a0 0x7f055c150250 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f054c009870 tx=0x7f054c01c540 comp rx=0 tx=0).stop 2023-11-28T20:08:35.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f0562e9c640 1 -- 172.21.15.177:0/899015736 shutdown_connections 2023-11-28T20:08:35.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f0562e9c640 1 --2- 172.21.15.177:0/899015736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f055c06c6a0 0x7f055c150250 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f0562e9c640 1 --2- 172.21.15.177:0/899015736 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c06c2c0 0x7f055c06cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f0562e9c640 1 -- 172.21.15.177:0/899015736 >> 172.21.15.177:0/899015736 conn(0x7f055c06a530 msgr2=0x7f055c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:35.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f0562e9c640 1 -- 172.21.15.177:0/899015736 shutdown_connections 2023-11-28T20:08:35.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.210+0000 7f0562e9c640 1 -- 172.21.15.177:0/899015736 wait complete. 2023-11-28T20:08:35.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0562e9c640 1 Processor -- start 2023-11-28T20:08:35.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0562e9c640 1 -- start start 2023-11-28T20:08:35.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0562e9c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c06c2c0 0x7f055c136310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0562e9c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c06c6a0 0x7f055c14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0562e9c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f055c150790 0x7f055c136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0562e9c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1540e0 con 0x7f055c150790 2023-11-28T20:08:35.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0562e9c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c14b4c0 con 0x7f055c06c6a0 2023-11-28T20:08:35.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0562e9c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c136850 con 0x7f055c06c2c0 2023-11-28T20:08:35.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0561439640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f055c150790 0x7f055c136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:35.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0553fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c06c6a0 0x7f055c14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:35.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0560c38640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c06c2c0 0x7f055c136310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:35.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0561439640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f055c150790 0x7f055c136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35026/0 (socket says 172.21.15.177:35026) 2023-11-28T20:08:35.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0561439640 1 -- 172.21.15.177:0/3274064527 learned_addr learned my addr 172.21.15.177:0/3274064527 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:35.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0561439640 1 -- 172.21.15.177:0/3274064527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c06c2c0 msgr2=0x7f055c136310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0561439640 1 --2- 172.21.15.177:0/3274064527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c06c2c0 0x7f055c136310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0561439640 1 -- 172.21.15.177:0/3274064527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c06c6a0 msgr2=0x7f055c14e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0561439640 1 --2- 172.21.15.177:0/3274064527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c06c6a0 0x7f055c14e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0561439640 1 -- 172.21.15.177:0/3274064527 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c0094d0 con 0x7f055c150790 2023-11-28T20:08:35.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0553fff640 1 --2- 172.21.15.177:0/3274064527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c06c6a0 0x7f055c14e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:35.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.214+0000 7f0561439640 1 --2- 172.21.15.177:0/3274064527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f055c150790 0x7f055c136ad0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f055400c790 tx=0x7f055400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:35.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.218+0000 7f05517fa640 1 -- 172.21.15.177:0/3274064527 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400cea0 con 0x7f055c150790 2023-11-28T20:08:35.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.218+0000 7f05517fa640 1 -- 172.21.15.177:0/3274064527 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0554003b80 con 0x7f055c150790 2023-11-28T20:08:35.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.218+0000 7f05517fa640 1 -- 172.21.15.177:0/3274064527 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400a7f0 con 0x7f055c150790 2023-11-28T20:08:35.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.218+0000 7f0562e9c640 1 -- 172.21.15.177:0/3274064527 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c15ac60 con 0x7f055c150790 2023-11-28T20:08:35.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.218+0000 7f0562e9c640 1 -- 172.21.15.177:0/3274064527 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c14ed00 con 0x7f055c150790 2023-11-28T20:08:35.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.218+0000 7f0562e9c640 1 -- 172.21.15.177:0/3274064527 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055c069440 con 0x7f055c150790 2023-11-28T20:08:35.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.218+0000 7f05517fa640 1 -- 172.21.15.177:0/3274064527 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f055400a950 con 0x7f055c150790 2023-11-28T20:08:35.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.218+0000 7f05517fa640 1 --2- 172.21.15.177:0/3274064527 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0548066470 0x7f0548068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.218+0000 7f05517fa640 1 -- 172.21.15.177:0/3274064527 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f05540837d0 con 0x7f055c150790 2023-11-28T20:08:35.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.218+0000 7f0560c38640 1 --2- 172.21.15.177:0/3274064527 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0548066470 0x7f0548068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:35.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.218+0000 7f0560c38640 1 --2- 172.21.15.177:0/3274064527 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0548066470 0x7f0548068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0558007a60 tx=0x7f0558008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:35.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.222+0000 7f05517fa640 1 -- 172.21.15.177:0/3274064527 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0554050fb0 con 0x7f055c150790 2023-11-28T20:08:35.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.422+0000 7f0562e9c640 1 -- 172.21.15.177:0/3274064527 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f055c071c10 con 0x7f055c150790 2023-11-28T20:08:35.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.426+0000 7f05517fa640 1 -- 172.21.15.177:0/3274064527 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f05540545d0 con 0x7f055c150790 2023-11-28T20:08:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.430+0000 7f0562e9c640 1 -- 172.21.15.177:0/3274064527 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0548066470 msgr2=0x7f0548068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.430+0000 7f0562e9c640 1 --2- 172.21.15.177:0/3274064527 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0548066470 0x7f0548068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0558007a60 tx=0x7f0558008040 comp rx=0 tx=0).stop 2023-11-28T20:08:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.430+0000 7f0562e9c640 1 -- 172.21.15.177:0/3274064527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f055c150790 msgr2=0x7f055c136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.430+0000 7f0562e9c640 1 --2- 172.21.15.177:0/3274064527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f055c150790 0x7f055c136ad0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f055400c790 tx=0x7f055400cc50 comp rx=0 tx=0).stop 2023-11-28T20:08:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.430+0000 7f0562e9c640 1 -- 172.21.15.177:0/3274064527 shutdown_connections 2023-11-28T20:08:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.430+0000 7f0562e9c640 1 --2- 172.21.15.177:0/3274064527 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0548066470 0x7f0548068930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.430+0000 7f0562e9c640 1 --2- 172.21.15.177:0/3274064527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f055c150790 0x7f055c136ad0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.430+0000 7f0562e9c640 1 --2- 172.21.15.177:0/3274064527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c06c6a0 0x7f055c14e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.430+0000 7f0562e9c640 1 --2- 172.21.15.177:0/3274064527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c06c2c0 0x7f055c136310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.430+0000 7f0562e9c640 1 -- 172.21.15.177:0/3274064527 >> 172.21.15.177:0/3274064527 conn(0x7f055c06a530 msgr2=0x7f055c0aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.430+0000 7f0562e9c640 1 -- 172.21.15.177:0/3274064527 shutdown_connections 2023-11-28T20:08:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.430+0000 7f0562e9c640 1 -- 172.21.15.177:0/3274064527 wait complete. 2023-11-28T20:08:35.455 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-28T20:08:35.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.586+0000 7fc953be6640 1 Processor -- start 2023-11-28T20:08:35.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.586+0000 7fc953be6640 1 -- start start 2023-11-28T20:08:35.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.590+0000 7fc953be6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc94c06c9d0 0x7fc94c15a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.590+0000 7fc953be6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c15b3a0 con 0x7fc94c15ab70 2023-11-28T20:08:35.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.590+0000 7fc953be6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c13f720 con 0x7fc94c13cf30 2023-11-28T20:08:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.590+0000 7fc953be6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c13d310 con 0x7fc94c06c9d0 2023-11-28T20:08:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.590+0000 7fc951181640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc94c06c9d0 0x7fc94c15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.590+0000 7fc951181640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc94c06c9d0 0x7fc94c15a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35028/0 (socket says 172.21.15.177:35028) 2023-11-28T20:08:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.590+0000 7fc952183640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc94c15ab70 0x7fc94c0cd880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44406/0 (socket says 172.21.15.177:44406) 2023-11-28T20:08:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.590+0000 7fc951181640 1 -- 172.21.15.177:0/665406701 learned_addr learned my addr 172.21.15.177:0/665406701 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:35.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.590+0000 7fc951181640 1 -- 172.21.15.177:0/665406701 >> v1:172.21.15.195:6789/0 conn(0x7fc94c13cf30 legacy=0x7fc94c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:35.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.590+0000 7fc951181640 1 -- 172.21.15.177:0/665406701 >> v1:172.21.15.177:6789/0 conn(0x7fc94c15ab70 legacy=0x7fc94c0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.590+0000 7fc951181640 1 -- 172.21.15.177:0/665406701 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c13fa00 con 0x7fc94c06c9d0 2023-11-28T20:08:35.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.594+0000 7fc951181640 1 --2- 172.21.15.177:0/665406701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94c06c9d0 0x7fc94c15a630 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009870 tx=0x7fc93c01e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2b4875d697c104 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.594+0000 7fc950980640 1 -- 172.21.15.177:0/665406701 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0ab640 con 0x7fc94c06c9d0 2023-11-28T20:08:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.594+0000 7fc950980640 1 -- 172.21.15.177:0/665406701 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c0ab7a0 con 0x7fc94c06c9d0 2023-11-28T20:08:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.594+0000 7fc950980640 1 -- 172.21.15.177:0/665406701 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0abb30 con 0x7fc94c06c9d0 2023-11-28T20:08:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.594+0000 7fc953be6640 1 -- 172.21.15.177:0/665406701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94c06c9d0 msgr2=0x7fc94c15a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.594+0000 7fc953be6640 1 --2- 172.21.15.177:0/665406701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94c06c9d0 0x7fc94c15a630 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009870 tx=0x7fc93c01e680 comp rx=0 tx=0).stop 2023-11-28T20:08:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.594+0000 7fc953be6640 1 -- 172.21.15.177:0/665406701 shutdown_connections 2023-11-28T20:08:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.594+0000 7fc953be6640 1 --2- 172.21.15.177:0/665406701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94c06c9d0 0x7fc94c15a630 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.594+0000 7fc953be6640 1 -- 172.21.15.177:0/665406701 >> 172.21.15.177:0/665406701 conn(0x7fc94c06a530 msgr2=0x7fc94c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.594+0000 7fc953be6640 1 -- 172.21.15.177:0/665406701 shutdown_connections 2023-11-28T20:08:35.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.594+0000 7fc953be6640 1 -- 172.21.15.177:0/665406701 wait complete. 2023-11-28T20:08:35.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.594+0000 7fc953be6640 1 Processor -- start 2023-11-28T20:08:35.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.594+0000 7fc953be6640 1 -- start start 2023-11-28T20:08:35.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc953be6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94c06c9d0 0x7fc94c14b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc953be6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc94c13cf30 0x7fc94c13b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc953be6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc94c15ab70 0x7fc94c071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc953be6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c14bae0 con 0x7fc94c06c9d0 2023-11-28T20:08:35.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc953be6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c14bdc0 con 0x7fc94c15ab70 2023-11-28T20:08:35.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc953be6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c14c0a0 con 0x7fc94c13cf30 2023-11-28T20:08:35.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc951982640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94c06c9d0 0x7fc94c14b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:35.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc951982640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94c06c9d0 0x7fc94c14b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35038/0 (socket says 172.21.15.177:35038) 2023-11-28T20:08:35.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc951982640 1 -- 172.21.15.177:0/2504410904 learned_addr learned my addr 172.21.15.177:0/2504410904 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:35.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc951982640 1 -- 172.21.15.177:0/2504410904 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc94c13cf30 msgr2=0x7fc94c13b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc951982640 1 --2- 172.21.15.177:0/2504410904 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc94c13cf30 0x7fc94c13b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc951982640 1 -- 172.21.15.177:0/2504410904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc94c15ab70 msgr2=0x7fc94c071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc951982640 1 --2- 172.21.15.177:0/2504410904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc94c15ab70 0x7fc94c071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc951982640 1 -- 172.21.15.177:0/2504410904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c0094d0 con 0x7fc94c06c9d0 2023-11-28T20:08:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc951982640 1 --2- 172.21.15.177:0/2504410904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94c06c9d0 0x7fc94c14b440 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc94800c450 tx=0x7fc94800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc9427fc640 1 -- 172.21.15.177:0/2504410904 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc948012830 con 0x7fc94c06c9d0 2023-11-28T20:08:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc9427fc640 1 -- 172.21.15.177:0/2504410904 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9480129b0 con 0x7fc94c06c9d0 2023-11-28T20:08:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc9427fc640 1 -- 172.21.15.177:0/2504410904 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc948012d60 con 0x7fc94c06c9d0 2023-11-28T20:08:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc953be6640 1 -- 172.21.15.177:0/2504410904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94c14c380 con 0x7fc94c06c9d0 2023-11-28T20:08:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc953be6640 1 -- 172.21.15.177:0/2504410904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c13b560 con 0x7fc94c06c9d0 2023-11-28T20:08:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc953be6640 1 -- 172.21.15.177:0/2504410904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c070440 con 0x7fc94c06c9d0 2023-11-28T20:08:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.598+0000 7fc9427fc640 1 -- 172.21.15.177:0/2504410904 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc94801c460 con 0x7fc94c06c9d0 2023-11-28T20:08:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.602+0000 7fc9427fc640 1 --2- 172.21.15.177:0/2504410904 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc930066470 0x7fc930068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.602+0000 7fc9427fc640 1 -- 172.21.15.177:0/2504410904 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc948083a80 con 0x7fc94c06c9d0 2023-11-28T20:08:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.602+0000 7fc951181640 1 --2- 172.21.15.177:0/2504410904 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc930066470 0x7fc930068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.602+0000 7fc951181640 1 --2- 172.21.15.177:0/2504410904 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc930066470 0x7fc930068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0b0000 tx=0x7fc93c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.602+0000 7fc9427fc640 1 -- 172.21.15.177:0/2504410904 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc94c070440 con 0x7fc94c06c9d0 2023-11-28T20:08:35.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.806+0000 7fc953be6640 1 -- 172.21.15.177:0/2504410904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fc94c070440 con 0x7fc94c06c9d0 2023-11-28T20:08:35.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.810+0000 7fc9427fc640 1 -- 172.21.15.177:0/2504410904 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc94c070440 con 0x7fc94c06c9d0 2023-11-28T20:08:35.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.814+0000 7fc953be6640 1 -- 172.21.15.177:0/2504410904 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc930066470 msgr2=0x7fc930068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.814+0000 7fc953be6640 1 --2- 172.21.15.177:0/2504410904 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc930066470 0x7fc930068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0b0000 tx=0x7fc93c008040 comp rx=0 tx=0).stop 2023-11-28T20:08:35.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.814+0000 7fc953be6640 1 -- 172.21.15.177:0/2504410904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94c06c9d0 msgr2=0x7fc94c14b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.814+0000 7fc953be6640 1 --2- 172.21.15.177:0/2504410904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94c06c9d0 0x7fc94c14b440 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc94800c450 tx=0x7fc94800c910 comp rx=0 tx=0).stop 2023-11-28T20:08:35.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.814+0000 7fc953be6640 1 -- 172.21.15.177:0/2504410904 shutdown_connections 2023-11-28T20:08:35.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.814+0000 7fc953be6640 1 --2- 172.21.15.177:0/2504410904 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc930066470 0x7fc930068930 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.814+0000 7fc953be6640 1 --2- 172.21.15.177:0/2504410904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc94c15ab70 0x7fc94c071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.814+0000 7fc953be6640 1 --2- 172.21.15.177:0/2504410904 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc94c13cf30 0x7fc94c13b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.814+0000 7fc953be6640 1 --2- 172.21.15.177:0/2504410904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc94c06c9d0 0x7fc94c14b440 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.814+0000 7fc953be6640 1 -- 172.21.15.177:0/2504410904 >> 172.21.15.177:0/2504410904 conn(0x7fc94c06a530 msgr2=0x7fc94c14ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:35.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.814+0000 7fc953be6640 1 -- 172.21.15.177:0/2504410904 shutdown_connections 2023-11-28T20:08:35.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.814+0000 7fc953be6640 1 -- 172.21.15.177:0/2504410904 wait complete. 2023-11-28T20:08:35.838 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-28T20:08:35.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.970+0000 7f26bc6d6640 1 Processor -- start 2023-11-28T20:08:35.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.970+0000 7f26bc6d6640 1 -- start start 2023-11-28T20:08:35.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.970+0000 7f26bc6d6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f26b413cf30 0x7f26b406c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.970+0000 7f26bc6d6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b406c800 0x7f26b415a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.970+0000 7f26bc6d6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b415b3a0 con 0x7f26b415ab70 2023-11-28T20:08:35.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.970+0000 7f26bc6d6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b413d310 con 0x7f26b413cf30 2023-11-28T20:08:35.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.970+0000 7f26bc6d6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b41404e0 con 0x7f26b406c800 2023-11-28T20:08:35.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.970+0000 7f26ba472640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f26b413cf30 0x7f26b406c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:35.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.970+0000 7f26ba472640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f26b413cf30 0x7f26b406c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35042/0 (socket says 172.21.15.177:35042) 2023-11-28T20:08:35.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.970+0000 7f26ba472640 1 -- 172.21.15.177:0/2264637446 learned_addr learned my addr 172.21.15.177:0/2264637446 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:35.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.974+0000 7f26b9c71640 1 --2- 172.21.15.177:0/2264637446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b406c800 0x7f26b415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:35.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.974+0000 7f26ba472640 1 -- 172.21.15.177:0/2264637446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b406c800 msgr2=0x7f26b415a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:35.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.974+0000 7f26ba472640 1 --2- 172.21.15.177:0/2264637446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b406c800 0x7f26b415a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.974+0000 7f26ba472640 1 -- 172.21.15.177:0/2264637446 >> v1:172.21.15.195:6789/0 conn(0x7f26b415ab70 legacy=0x7f26b4071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.974+0000 7f26ba472640 1 -- 172.21.15.177:0/2264637446 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b406cc40 con 0x7f26b413cf30 2023-11-28T20:08:35.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.974+0000 7f26b9c71640 1 --2- 172.21.15.177:0/2264637446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b406c800 0x7f26b415a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:35.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.974+0000 7f26ba472640 1 --2- 172.21.15.177:0/2264637446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b413cf30 0x7f26b406c2c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f26b00098a0 tx=0x7f26b001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efb50010e96465e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:35.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.974+0000 7f26b9470640 1 -- 172.21.15.177:0/2264637446 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b00ab660 con 0x7f26b413cf30 2023-11-28T20:08:35.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.974+0000 7f26b9470640 1 -- 172.21.15.177:0/2264637446 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b00ab7c0 con 0x7f26b413cf30 2023-11-28T20:08:35.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.974+0000 7f26b9470640 1 -- 172.21.15.177:0/2264637446 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b00abb50 con 0x7f26b413cf30 2023-11-28T20:08:35.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.974+0000 7f26bc6d6640 1 -- 172.21.15.177:0/2264637446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b413cf30 msgr2=0x7f26b406c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.974+0000 7f26bc6d6640 1 --2- 172.21.15.177:0/2264637446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b413cf30 0x7f26b406c2c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f26b00098a0 tx=0x7f26b001c460 comp rx=0 tx=0).stop 2023-11-28T20:08:35.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bc6d6640 1 -- 172.21.15.177:0/2264637446 shutdown_connections 2023-11-28T20:08:35.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bc6d6640 1 --2- 172.21.15.177:0/2264637446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b406c800 0x7f26b415a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bc6d6640 1 --2- 172.21.15.177:0/2264637446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b413cf30 0x7f26b406c2c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bc6d6640 1 -- 172.21.15.177:0/2264637446 >> 172.21.15.177:0/2264637446 conn(0x7f26b406a530 msgr2=0x7f26b406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:35.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bc6d6640 1 -- 172.21.15.177:0/2264637446 shutdown_connections 2023-11-28T20:08:35.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bc6d6640 1 -- 172.21.15.177:0/2264637446 wait complete. 2023-11-28T20:08:35.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bc6d6640 1 Processor -- start 2023-11-28T20:08:35.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bc6d6640 1 -- start start 2023-11-28T20:08:35.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bc6d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b406c800 0x7f26b413c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bc6d6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b413cf30 0x7f26b4139a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bc6d6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26b415ab70 0x7f26b4159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bc6d6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b413c800 con 0x7f26b406c800 2023-11-28T20:08:35.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bc6d6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b413be30 con 0x7f26b415ab70 2023-11-28T20:08:35.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bc6d6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b413b220 con 0x7f26b413cf30 2023-11-28T20:08:35.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26ba472640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b406c800 0x7f26b413c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:35.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26ba472640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b406c800 0x7f26b413c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35054/0 (socket says 172.21.15.177:35054) 2023-11-28T20:08:35.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26ba472640 1 -- 172.21.15.177:0/3234400788 learned_addr learned my addr 172.21.15.177:0/3234400788 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:35.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26ba472640 1 -- 172.21.15.177:0/3234400788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b413cf30 msgr2=0x7f26b4139a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26b9c71640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b413cf30 0x7f26b4139a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:35.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bac73640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26b415ab70 0x7f26b4159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:35.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26ba472640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b413cf30 0x7f26b4139a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26ba472640 1 -- 172.21.15.177:0/3234400788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26b415ab70 msgr2=0x7f26b4159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:35.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26ba472640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26b415ab70 0x7f26b4159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:35.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26ba472640 1 -- 172.21.15.177:0/3234400788 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b00094d0 con 0x7f26b406c800 2023-11-28T20:08:35.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26b9c71640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b413cf30 0x7f26b4139a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:35.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.978+0000 7f26bac73640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26b415ab70 0x7f26b4159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:35.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.982+0000 7f26ba472640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b406c800 0x7f26b413c2c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f26b001a090 tx=0x7f26b001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:35.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.982+0000 7f26aaffd640 1 -- 172.21.15.177:0/3234400788 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b00b4800 con 0x7f26b406c800 2023-11-28T20:08:35.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.982+0000 7f26aaffd640 1 -- 172.21.15.177:0/3234400788 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b00b4980 con 0x7f26b406c800 2023-11-28T20:08:35.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.982+0000 7f26bc6d6640 1 -- 172.21.15.177:0/3234400788 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b413b500 con 0x7f26b406c800 2023-11-28T20:08:35.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.982+0000 7f26aaffd640 1 -- 172.21.15.177:0/3234400788 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b00b4d30 con 0x7f26b406c800 2023-11-28T20:08:35.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.982+0000 7f26bc6d6640 1 -- 172.21.15.177:0/3234400788 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b413bac0 con 0x7f26b406c800 2023-11-28T20:08:35.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.982+0000 7f26bc6d6640 1 -- 172.21.15.177:0/3234400788 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b415a230 con 0x7f26b406c800 2023-11-28T20:08:35.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.982+0000 7f26aaffd640 1 -- 172.21.15.177:0/3234400788 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f26b00a9070 con 0x7f26b406c800 2023-11-28T20:08:35.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.982+0000 7f26aaffd640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f26980664a0 0x7f2698068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:35.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.982+0000 7f26aaffd640 1 -- 172.21.15.177:0/3234400788 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f26b011e3d0 con 0x7f26b406c800 2023-11-28T20:08:35.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.982+0000 7f26b9c71640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f26980664a0 0x7f2698068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:35.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.982+0000 7f26b9c71640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f26980664a0 0x7f2698068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f26b41f9550 tx=0x7f26a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:35.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:35.986+0000 7f26aaffd640 1 -- 172.21.15.177:0/3234400788 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f26b00ebc20 con 0x7f26b406c800 2023-11-28T20:08:36.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.190+0000 7f26bc6d6640 1 -- 172.21.15.177:0/3234400788 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f26b4069440 con 0x7f26b406c800 2023-11-28T20:08:36.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.194+0000 7f26aaffd640 1 -- 172.21.15.177:0/3234400788 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f26b00ef240 con 0x7f26b406c800 2023-11-28T20:08:36.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.194+0000 7f26bc6d6640 1 -- 172.21.15.177:0/3234400788 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f26980664a0 msgr2=0x7f2698068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.194+0000 7f26bc6d6640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f26980664a0 0x7f2698068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f26b41f9550 tx=0x7f26a4008040 comp rx=0 tx=0).stop 2023-11-28T20:08:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.194+0000 7f26bc6d6640 1 -- 172.21.15.177:0/3234400788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b406c800 msgr2=0x7f26b413c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.194+0000 7f26bc6d6640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b406c800 0x7f26b413c2c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f26b001a090 tx=0x7f26b001aca0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.194+0000 7f26bc6d6640 1 -- 172.21.15.177:0/3234400788 shutdown_connections 2023-11-28T20:08:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.194+0000 7f26bc6d6640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f26980664a0 0x7f2698068960 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.194+0000 7f26bc6d6640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26b415ab70 0x7f26b4159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.194+0000 7f26bc6d6640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b413cf30 0x7f26b4139a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.194+0000 7f26bc6d6640 1 --2- 172.21.15.177:0/3234400788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26b406c800 0x7f26b413c2c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.194+0000 7f26bc6d6640 1 -- 172.21.15.177:0/3234400788 >> 172.21.15.177:0/3234400788 conn(0x7f26b406a530 msgr2=0x7f26b415b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.194+0000 7f26bc6d6640 1 -- 172.21.15.177:0/3234400788 shutdown_connections 2023-11-28T20:08:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.194+0000 7f26bc6d6640 1 -- 172.21.15.177:0/3234400788 wait complete. 2023-11-28T20:08:36.219 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-28T20:08:36.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.350+0000 7f92fd99d640 1 Processor -- start 2023-11-28T20:08:36.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.350+0000 7f92fd99d640 1 -- start start 2023-11-28T20:08:36.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.354+0000 7f92fd99d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f92f80b4760 0x7f92f80d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:36.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.354+0000 7f92fd99d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92f80b4b40 0x7f92f80d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:36.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.354+0000 7f92fd99d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f8143780 con 0x7f92f8142c00 2023-11-28T20:08:36.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.354+0000 7f92fd99d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f8161dc0 con 0x7f92f80b4760 2023-11-28T20:08:36.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.354+0000 7f92fd99d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f815d7c0 con 0x7f92f80b4b40 2023-11-28T20:08:36.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.354+0000 7f92f6ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f92f80b4760 0x7f92f80d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:36.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.354+0000 7f92f6ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f92f80b4760 0x7f92f80d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35062/0 (socket says 172.21.15.177:35062) 2023-11-28T20:08:36.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.354+0000 7f92f6ffd640 1 -- 172.21.15.177:0/3452047133 learned_addr learned my addr 172.21.15.177:0/3452047133 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:36.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.354+0000 7f92ee7fc640 1 --2- 172.21.15.177:0/3452047133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92f80b4b40 0x7f92f80d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:36.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.354+0000 7f92f6ffd640 1 -- 172.21.15.177:0/3452047133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92f80b4b40 msgr2=0x7f92f80d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:36.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.354+0000 7f92f6ffd640 1 --2- 172.21.15.177:0/3452047133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92f80b4b40 0x7f92f80d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.354+0000 7f92f6ffd640 1 -- 172.21.15.177:0/3452047133 >> v1:172.21.15.195:6789/0 conn(0x7f92f8142c00 legacy=0x7f92f8143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:36.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.354+0000 7f92f6ffd640 1 -- 172.21.15.177:0/3452047133 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f8140930 con 0x7f92f80b4760 2023-11-28T20:08:36.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.358+0000 7f92f6ffd640 1 --2- 172.21.15.177:0/3452047133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f80b4760 0x7f92f80d10a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f92e0009870 tx=0x7f92e001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0aa53dc5a2927b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:36.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.358+0000 7f92f67fc640 1 -- 172.21.15.177:0/3452047133 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e00ab600 con 0x7f92f80b4760 2023-11-28T20:08:36.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.358+0000 7f92f67fc640 1 -- 172.21.15.177:0/3452047133 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e00a7050 con 0x7f92f80b4760 2023-11-28T20:08:36.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.358+0000 7f92f67fc640 1 -- 172.21.15.177:0/3452047133 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e00ab980 con 0x7f92f80b4760 2023-11-28T20:08:36.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.358+0000 7f92fd99d640 1 -- 172.21.15.177:0/3452047133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f80b4760 msgr2=0x7f92f80d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:36.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.358+0000 7f92fd99d640 1 --2- 172.21.15.177:0/3452047133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f80b4760 0x7f92f80d10a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f92e0009870 tx=0x7f92e001c540 comp rx=0 tx=0).stop 2023-11-28T20:08:36.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.358+0000 7f92fd99d640 1 -- 172.21.15.177:0/3452047133 shutdown_connections 2023-11-28T20:08:36.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.358+0000 7f92fd99d640 1 --2- 172.21.15.177:0/3452047133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92f80b4b40 0x7f92f80d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.358+0000 7f92fd99d640 1 --2- 172.21.15.177:0/3452047133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f80b4760 0x7f92f80d10a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.358+0000 7f92fd99d640 1 -- 172.21.15.177:0/3452047133 >> 172.21.15.177:0/3452047133 conn(0x7f92f806a530 msgr2=0x7f92f806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:36.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.358+0000 7f92fd99d640 1 -- 172.21.15.177:0/3452047133 shutdown_connections 2023-11-28T20:08:36.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.358+0000 7f92fd99d640 1 -- 172.21.15.177:0/3452047133 wait complete. 2023-11-28T20:08:36.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.358+0000 7f92fd99d640 1 Processor -- start 2023-11-28T20:08:36.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.358+0000 7f92fd99d640 1 -- start start 2023-11-28T20:08:36.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92fd99d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f80b4760 0x7f92f8137650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:36.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92fd99d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92f80b4b40 0x7f92f8154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:36.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92fd99d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92f8142c00 0x7f92f815a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:36.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92fd99d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f8137b90 con 0x7f92f80b4760 2023-11-28T20:08:36.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92fd99d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f8156530 con 0x7f92f8142c00 2023-11-28T20:08:36.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92fd99d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f815c800 con 0x7f92f80b4b40 2023-11-28T20:08:36.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92f6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f80b4760 0x7f92f8137650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:36.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92f6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f80b4760 0x7f92f8137650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35064/0 (socket says 172.21.15.177:35064) 2023-11-28T20:08:36.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92f6ffd640 1 -- 172.21.15.177:0/1828039401 learned_addr learned my addr 172.21.15.177:0/1828039401 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:36.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92ee7fc640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92f80b4b40 0x7f92f8154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:36.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92f77fe640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92f8142c00 0x7f92f815a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:36.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92f6ffd640 1 -- 172.21.15.177:0/1828039401 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92f80b4b40 msgr2=0x7f92f8154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:36.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92f6ffd640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92f80b4b40 0x7f92f8154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92f6ffd640 1 -- 172.21.15.177:0/1828039401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92f8142c00 msgr2=0x7f92f815a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92f6ffd640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92f8142c00 0x7f92f815a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92f6ffd640 1 -- 172.21.15.177:0/1828039401 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e00094d0 con 0x7f92f80b4760 2023-11-28T20:08:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92ee7fc640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92f80b4b40 0x7f92f8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92f77fe640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92f8142c00 0x7f92f815a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92f6ffd640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f80b4760 0x7f92f8137650 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f92e001abf0 tx=0x7f92e00192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92f4ff9640 1 -- 172.21.15.177:0/1828039401 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e00b37d0 con 0x7f92f80b4760 2023-11-28T20:08:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92f4ff9640 1 -- 172.21.15.177:0/1828039401 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e00b3930 con 0x7f92f80b4760 2023-11-28T20:08:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92f4ff9640 1 -- 172.21.15.177:0/1828039401 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e00b3ce0 con 0x7f92f80b4760 2023-11-28T20:08:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92fd99d640 1 -- 172.21.15.177:0/1828039401 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f815cae0 con 0x7f92f80b4760 2023-11-28T20:08:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92fd99d640 1 -- 172.21.15.177:0/1828039401 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f8154b80 con 0x7f92f80b4760 2023-11-28T20:08:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92fd99d640 1 -- 172.21.15.177:0/1828039401 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f80b3b40 con 0x7f92f80b4760 2023-11-28T20:08:36.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.362+0000 7f92f4ff9640 1 -- 172.21.15.177:0/1828039401 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92e00b2070 con 0x7f92f80b4760 2023-11-28T20:08:36.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.366+0000 7f92f4ff9640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f92d8066470 0x7f92d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:36.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.366+0000 7f92f4ff9640 1 -- 172.21.15.177:0/1828039401 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f92e011dde0 con 0x7f92f80b4760 2023-11-28T20:08:36.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.366+0000 7f92ee7fc640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f92d8066470 0x7f92d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:36.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.366+0000 7f92ee7fc640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f92d8066470 0x7f92d8068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f92e8007a70 tx=0x7f92e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:36.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.370+0000 7f92f4ff9640 1 -- 172.21.15.177:0/1828039401 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92e00eb640 con 0x7f92f80b4760 2023-11-28T20:08:36.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.570+0000 7f92fd99d640 1 -- 172.21.15.177:0/1828039401 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f92f8069440 con 0x7f92f80b4760 2023-11-28T20:08:36.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.574+0000 7f92f4ff9640 1 -- 172.21.15.177:0/1828039401 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f92e00b0020 con 0x7f92f80b4760 2023-11-28T20:08:36.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.574+0000 7f92fd99d640 1 -- 172.21.15.177:0/1828039401 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f92d8066470 msgr2=0x7f92d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:36.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.574+0000 7f92fd99d640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f92d8066470 0x7f92d8068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f92e8007a70 tx=0x7f92e8008040 comp rx=0 tx=0).stop 2023-11-28T20:08:36.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.574+0000 7f92fd99d640 1 -- 172.21.15.177:0/1828039401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f80b4760 msgr2=0x7f92f8137650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:36.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.574+0000 7f92fd99d640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f80b4760 0x7f92f8137650 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f92e001abf0 tx=0x7f92e00192e0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.574+0000 7f92fd99d640 1 -- 172.21.15.177:0/1828039401 shutdown_connections 2023-11-28T20:08:36.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.574+0000 7f92fd99d640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f92d8066470 0x7f92d8068930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.574+0000 7f92fd99d640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92f8142c00 0x7f92f815a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.574+0000 7f92fd99d640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92f80b4b40 0x7f92f8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.574+0000 7f92fd99d640 1 --2- 172.21.15.177:0/1828039401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f80b4760 0x7f92f8137650 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.574+0000 7f92fd99d640 1 -- 172.21.15.177:0/1828039401 >> 172.21.15.177:0/1828039401 conn(0x7f92f806a530 msgr2=0x7f92f8141230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:36.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.574+0000 7f92fd99d640 1 -- 172.21.15.177:0/1828039401 shutdown_connections 2023-11-28T20:08:36.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.574+0000 7f92fd99d640 1 -- 172.21.15.177:0/1828039401 wait complete. 2023-11-28T20:08:36.601 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:36.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.734+0000 7fc8ca046640 1 Processor -- start 2023-11-28T20:08:36.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.734+0000 7fc8ca046640 1 -- start start 2023-11-28T20:08:36.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.734+0000 7fc8ca046640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc8c4071fd0 0x7fc8c40af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:36.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.734+0000 7fc8ca046640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c40afb20 con 0x7fc8c415d3b0 2023-11-28T20:08:36.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.734+0000 7fc8ca046640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c40adfb0 con 0x7fc8c40af6e0 2023-11-28T20:08:36.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.734+0000 7fc8ca046640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c40aeb30 con 0x7fc8c4071fd0 2023-11-28T20:08:36.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.734+0000 7fc8c37fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc8c415d3b0 0x7fc8c40ad6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44414/0 (socket says 172.21.15.177:44414) 2023-11-28T20:08:36.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.734+0000 7fc8c37fe640 1 -- 172.21.15.177:0/3518540686 learned_addr learned my addr 172.21.15.177:0/3518540686 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:36.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.734+0000 7fc8bbfff640 1 --2- 172.21.15.177:0/3518540686 >> v2:172.21.15.177:3300/0 conn(0x7fc8c4071fd0 0x7fc8c40af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:36.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.734+0000 7fc8bbfff640 1 -- 172.21.15.177:0/3518540686 >> v1:172.21.15.195:6789/0 conn(0x7fc8c40af6e0 legacy=0x7fc8c40b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:36.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.734+0000 7fc8bbfff640 1 -- 172.21.15.177:0/3518540686 >> v1:172.21.15.177:6789/0 conn(0x7fc8c415d3b0 legacy=0x7fc8c40ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:36.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.734+0000 7fc8bbfff640 1 -- 172.21.15.177:0/3518540686 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c40ae290 con 0x7fc8c4071fd0 2023-11-28T20:08:36.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.734+0000 7fc8c2ffd640 1 -- 172.21.15.177:0/3518540686 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451973800 0 0) 0x7fc8c40afb20 con 0x7fc8c415d3b0 2023-11-28T20:08:36.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.738+0000 7fc8bbfff640 1 --2- 172.21.15.177:0/3518540686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8c4071fd0 0x7fc8c40af1a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0097c0 tx=0x7fc8ac01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40639428919ad5da server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:36.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.738+0000 7fc8c2ffd640 1 -- 172.21.15.177:0/3518540686 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac0a8970 con 0x7fc8c4071fd0 2023-11-28T20:08:36.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.738+0000 7fc8c2ffd640 1 -- 172.21.15.177:0/3518540686 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac0a8ad0 con 0x7fc8c4071fd0 2023-11-28T20:08:36.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.738+0000 7fc8c2ffd640 1 -- 172.21.15.177:0/3518540686 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac0a8e60 con 0x7fc8c4071fd0 2023-11-28T20:08:36.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.738+0000 7fc8ca046640 1 -- 172.21.15.177:0/3518540686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8c4071fd0 msgr2=0x7fc8c40af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:36.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.738+0000 7fc8ca046640 1 --2- 172.21.15.177:0/3518540686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8c4071fd0 0x7fc8c40af1a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0097c0 tx=0x7fc8ac01ec70 comp rx=0 tx=0).stop 2023-11-28T20:08:36.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.738+0000 7fc8ca046640 1 -- 172.21.15.177:0/3518540686 shutdown_connections 2023-11-28T20:08:36.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.738+0000 7fc8ca046640 1 --2- 172.21.15.177:0/3518540686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8c4071fd0 0x7fc8c40af1a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.738+0000 7fc8ca046640 1 -- 172.21.15.177:0/3518540686 >> 172.21.15.177:0/3518540686 conn(0x7fc8c406b640 msgr2=0x7fc8c406ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:36.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.738+0000 7fc8ca046640 1 -- 172.21.15.177:0/3518540686 shutdown_connections 2023-11-28T20:08:36.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.738+0000 7fc8ca046640 1 -- 172.21.15.177:0/3518540686 wait complete. 2023-11-28T20:08:36.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8ca046640 1 Processor -- start 2023-11-28T20:08:36.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8ca046640 1 -- start start 2023-11-28T20:08:36.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8ca046640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8c4071fd0 0x7fc8c414a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:36.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8ca046640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8c40af6e0 0x7fc8c40b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:36.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8ca046640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c415d3b0 0x7fc8c40b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:36.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8ca046640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c414ad90 con 0x7fc8c40af6e0 2023-11-28T20:08:36.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8ca046640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c414a910 con 0x7fc8c4071fd0 2023-11-28T20:08:36.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8ca046640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c4160260 con 0x7fc8c415d3b0 2023-11-28T20:08:36.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8c40af6e0 0x7fc8c40b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:36.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8c40af6e0 0x7fc8c40b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35088/0 (socket says 172.21.15.177:35088) 2023-11-28T20:08:36.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8bbfff640 1 -- 172.21.15.177:0/3080666819 learned_addr learned my addr 172.21.15.177:0/3080666819 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:36.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8c37fe640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8c4071fd0 0x7fc8c414a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:36.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8bbfff640 1 -- 172.21.15.177:0/3080666819 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c415d3b0 msgr2=0x7fc8c40b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:36.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8c3fff640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c415d3b0 0x7fc8c40b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:36.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8bbfff640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c415d3b0 0x7fc8c40b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8bbfff640 1 -- 172.21.15.177:0/3080666819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8c4071fd0 msgr2=0x7fc8c414a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:36.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8bbfff640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8c4071fd0 0x7fc8c414a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8bbfff640 1 -- 172.21.15.177:0/3080666819 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac009420 con 0x7fc8c40af6e0 2023-11-28T20:08:36.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8c37fe640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8c4071fd0 0x7fc8c414a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:36.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8c3fff640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c415d3b0 0x7fc8c40b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:36.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8bbfff640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8c40af6e0 0x7fc8c40b1f20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac01b880 tx=0x7fc8ac01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:36.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8c0ff9640 1 -- 172.21.15.177:0/3080666819 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac0a8970 con 0x7fc8c40af6e0 2023-11-28T20:08:36.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8c0ff9640 1 -- 172.21.15.177:0/3080666819 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac0b9410 con 0x7fc8c40af6e0 2023-11-28T20:08:36.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8c0ff9640 1 -- 172.21.15.177:0/3080666819 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac0b97a0 con 0x7fc8c40af6e0 2023-11-28T20:08:36.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8ca046640 1 -- 172.21.15.177:0/3080666819 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c415f370 con 0x7fc8c40af6e0 2023-11-28T20:08:36.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.742+0000 7fc8ca046640 1 -- 172.21.15.177:0/3080666819 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c415f930 con 0x7fc8c40af6e0 2023-11-28T20:08:36.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.746+0000 7fc8ca046640 1 -- 172.21.15.177:0/3080666819 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c41f2d70 con 0x7fc8c40af6e0 2023-11-28T20:08:36.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.746+0000 7fc8c0ff9640 1 -- 172.21.15.177:0/3080666819 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc8ac0b7040 con 0x7fc8c40af6e0 2023-11-28T20:08:36.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.746+0000 7fc8c0ff9640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc8a40664a0 0x7fc8a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:36.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.746+0000 7fc8c0ff9640 1 -- 172.21.15.177:0/3080666819 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc8ac121830 con 0x7fc8c40af6e0 2023-11-28T20:08:36.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.746+0000 7fc8c37fe640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc8a40664a0 0x7fc8a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:36.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.746+0000 7fc8c37fe640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc8a40664a0 0x7fc8a4068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4000f70 tx=0x7fc8b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:36.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.750+0000 7fc8c0ff9640 1 -- 172.21.15.177:0/3080666819 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8ac0eeff0 con 0x7fc8c40af6e0 2023-11-28T20:08:36.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.898+0000 7fc8ca046640 1 -- 172.21.15.177:0/3080666819 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8c4069440 con 0x7fc8c40af6e0 2023-11-28T20:08:36.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.902+0000 7fc8c0ff9640 1 -- 172.21.15.177:0/3080666819 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12917 (secure 0 0 0) 0x7fc8ac0b5020 con 0x7fc8c40af6e0 2023-11-28T20:08:36.907 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:36.907 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":29,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:33.847526+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:36.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.902+0000 7fc8ca046640 1 -- 172.21.15.177:0/3080666819 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc8a40664a0 msgr2=0x7fc8a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:36.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.902+0000 7fc8ca046640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc8a40664a0 0x7fc8a4068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4000f70 tx=0x7fc8b4009040 comp rx=0 tx=0).stop 2023-11-28T20:08:36.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.902+0000 7fc8ca046640 1 -- 172.21.15.177:0/3080666819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8c40af6e0 msgr2=0x7fc8c40b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:36.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.902+0000 7fc8ca046640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8c40af6e0 0x7fc8c40b1f20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac01b880 tx=0x7fc8ac01ba10 comp rx=0 tx=0).stop 2023-11-28T20:08:36.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.902+0000 7fc8ca046640 1 -- 172.21.15.177:0/3080666819 shutdown_connections 2023-11-28T20:08:36.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.902+0000 7fc8ca046640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc8a40664a0 0x7fc8a4068960 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.902+0000 7fc8ca046640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c415d3b0 0x7fc8c40b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.902+0000 7fc8ca046640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8c40af6e0 0x7fc8c40b1f20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.902+0000 7fc8ca046640 1 --2- 172.21.15.177:0/3080666819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8c4071fd0 0x7fc8c414a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:36.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.902+0000 7fc8ca046640 1 -- 172.21.15.177:0/3080666819 >> 172.21.15.177:0/3080666819 conn(0x7fc8c406b640 msgr2=0x7fc8c415c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:36.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.902+0000 7fc8ca046640 1 -- 172.21.15.177:0/3080666819 shutdown_connections 2023-11-28T20:08:36.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:36.902+0000 7fc8ca046640 1 -- 172.21.15.177:0/3080666819 wait complete. 2023-11-28T20:08:36.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:36.928 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:37.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.062+0000 7fc19cf34640 1 Processor -- start 2023-11-28T20:08:37.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.062+0000 7fc19cf34640 1 -- start start 2023-11-28T20:08:37.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.066+0000 7fc19cf34640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1980b2b80 0x7fc1980b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.066+0000 7fc19cf34640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1980705d0 con 0x7fc19806d980 2023-11-28T20:08:37.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.066+0000 7fc19cf34640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1980708b0 con 0x7fc198071670 2023-11-28T20:08:37.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.066+0000 7fc19cf34640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc198070b90 con 0x7fc1980b2b80 2023-11-28T20:08:37.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.066+0000 7fc196ffd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc19806d980 0x7fc1980b2f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44430/0 (socket says 172.21.15.177:44430) 2023-11-28T20:08:37.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.066+0000 7fc196ffd640 1 -- 172.21.15.177:0/722452281 learned_addr learned my addr 172.21.15.177:0/722452281 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:37.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.066+0000 7fc1977fe640 1 --2- 172.21.15.177:0/722452281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1980b2b80 0x7fc1980b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.066+0000 7fc1967fc640 1 -- 172.21.15.177:0/722452281 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282609576 0 0) 0x7fc1980705d0 con 0x7fc19806d980 2023-11-28T20:08:37.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.066+0000 7fc1967fc640 1 -- 172.21.15.177:0/722452281 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc180003530 con 0x7fc19806d980 2023-11-28T20:08:37.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.066+0000 7fc1967fc640 1 -- 172.21.15.177:0/722452281 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495363409 0 0) 0x7fc1980708b0 con 0x7fc198071670 2023-11-28T20:08:37.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.066+0000 7fc1967fc640 1 -- 172.21.15.177:0/722452281 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1980705d0 con 0x7fc198071670 2023-11-28T20:08:37.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.066+0000 7fc1977fe640 1 -- 172.21.15.177:0/722452281 >> v1:172.21.15.195:6789/0 conn(0x7fc198071670 legacy=0x7fc1980ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.066+0000 7fc1977fe640 1 -- 172.21.15.177:0/722452281 >> v1:172.21.15.177:6789/0 conn(0x7fc19806d980 legacy=0x7fc1980b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.066+0000 7fc1967fc640 1 -- 172.21.15.177:0/722452281 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2479142667 0 0) 0x7fc180003530 con 0x7fc19806d980 2023-11-28T20:08:37.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.066+0000 7fc1977fe640 1 -- 172.21.15.177:0/722452281 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc198070e70 con 0x7fc1980b2b80 2023-11-28T20:08:37.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.070+0000 7fc1977fe640 1 --2- 172.21.15.177:0/722452281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1980b2b80 0x7fc1980b25e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc1880097f0 tx=0x7fc18801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5ab4fda8d65a261 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:37.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.070+0000 7fc1967fc640 1 -- 172.21.15.177:0/722452281 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c001680 con 0x7fc1980b2b80 2023-11-28T20:08:37.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.070+0000 7fc1967fc640 1 -- 172.21.15.177:0/722452281 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1880a7050 con 0x7fc1980b2b80 2023-11-28T20:08:37.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.070+0000 7fc1967fc640 1 -- 172.21.15.177:0/722452281 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1880ab620 con 0x7fc1980b2b80 2023-11-28T20:08:37.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.070+0000 7fc19cf34640 1 -- 172.21.15.177:0/722452281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1980b2b80 msgr2=0x7fc1980b25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.070+0000 7fc19cf34640 1 --2- 172.21.15.177:0/722452281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1980b2b80 0x7fc1980b25e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc1880097f0 tx=0x7fc18801c3b0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.070+0000 7fc19cf34640 1 -- 172.21.15.177:0/722452281 shutdown_connections 2023-11-28T20:08:37.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.070+0000 7fc19cf34640 1 --2- 172.21.15.177:0/722452281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1980b2b80 0x7fc1980b25e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.070+0000 7fc19cf34640 1 -- 172.21.15.177:0/722452281 >> 172.21.15.177:0/722452281 conn(0x7fc1980b0920 msgr2=0x7fc1980b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:37.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.070+0000 7fc19cf34640 1 -- 172.21.15.177:0/722452281 shutdown_connections 2023-11-28T20:08:37.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.070+0000 7fc19cf34640 1 -- 172.21.15.177:0/722452281 wait complete. 2023-11-28T20:08:37.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.070+0000 7fc19cf34640 1 Processor -- start 2023-11-28T20:08:37.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.070+0000 7fc19cf34640 1 -- start start 2023-11-28T20:08:37.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc19cf34640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc19806d980 0x7fc19809b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc19cf34640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc198071670 0x7fc19813e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc19cf34640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1980b2b80 0x7fc19815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc19cf34640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19809b2a0 con 0x7fc198071670 2023-11-28T20:08:37.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc19cf34640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19809a690 con 0x7fc19806d980 2023-11-28T20:08:37.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc19cf34640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19809a970 con 0x7fc1980b2b80 2023-11-28T20:08:37.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc196ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc198071670 0x7fc19813e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc196ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc198071670 0x7fc19813e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35094/0 (socket says 172.21.15.177:35094) 2023-11-28T20:08:37.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc196ffd640 1 -- 172.21.15.177:0/3720885861 learned_addr learned my addr 172.21.15.177:0/3720885861 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:37.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc197fff640 1 --2- 172.21.15.177:0/3720885861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1980b2b80 0x7fc19815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc1977fe640 1 --2- 172.21.15.177:0/3720885861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc19806d980 0x7fc19809b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc196ffd640 1 -- 172.21.15.177:0/3720885861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1980b2b80 msgr2=0x7fc19815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc196ffd640 1 --2- 172.21.15.177:0/3720885861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1980b2b80 0x7fc19815bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc196ffd640 1 -- 172.21.15.177:0/3720885861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc19806d980 msgr2=0x7fc19809b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc196ffd640 1 --2- 172.21.15.177:0/3720885861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc19806d980 0x7fc19809b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc196ffd640 1 -- 172.21.15.177:0/3720885861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188009420 con 0x7fc198071670 2023-11-28T20:08:37.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc196ffd640 1 --2- 172.21.15.177:0/3720885861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc198071670 0x7fc19813e4e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00c750 tx=0x7fc18c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:37.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc17ffff640 1 -- 172.21.15.177:0/3720885861 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c005ae0 con 0x7fc198071670 2023-11-28T20:08:37.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc17ffff640 1 -- 172.21.15.177:0/3720885861 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18c005c40 con 0x7fc198071670 2023-11-28T20:08:37.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc19cf34640 1 -- 172.21.15.177:0/3720885861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19809ac50 con 0x7fc198071670 2023-11-28T20:08:37.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc17ffff640 1 -- 172.21.15.177:0/3720885861 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c007070 con 0x7fc198071670 2023-11-28T20:08:37.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc19cf34640 1 -- 172.21.15.177:0/3720885861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19813ea20 con 0x7fc198071670 2023-11-28T20:08:37.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc19cf34640 1 -- 172.21.15.177:0/3720885861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc19809b450 con 0x7fc198071670 2023-11-28T20:08:37.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.074+0000 7fc17ffff640 1 -- 172.21.15.177:0/3720885861 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc18c0071d0 con 0x7fc198071670 2023-11-28T20:08:37.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.078+0000 7fc17ffff640 1 --2- 172.21.15.177:0/3720885861 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1840664a0 0x7fc184068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.078+0000 7fc17ffff640 1 -- 172.21.15.177:0/3720885861 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc18c083730 con 0x7fc198071670 2023-11-28T20:08:37.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.078+0000 7fc1977fe640 1 --2- 172.21.15.177:0/3720885861 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1840664a0 0x7fc184068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.078+0000 7fc1977fe640 1 --2- 172.21.15.177:0/3720885861 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1840664a0 0x7fc184068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1880ad000 tx=0x7fc188008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:37.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.082+0000 7fc17ffff640 1 -- 172.21.15.177:0/3720885861 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc19809b450 con 0x7fc198071670 2023-11-28T20:08:37.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.230+0000 7fc19cf34640 1 -- 172.21.15.177:0/3720885861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc19809d080 con 0x7fc198071670 2023-11-28T20:08:37.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.230+0000 7fc17ffff640 1 -- 172.21.15.177:0/3720885861 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc18c050f20 con 0x7fc198071670 2023-11-28T20:08:37.237 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:37.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.234+0000 7fc19cf34640 1 -- 172.21.15.177:0/3720885861 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1840664a0 msgr2=0x7fc184068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.234+0000 7fc19cf34640 1 --2- 172.21.15.177:0/3720885861 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1840664a0 0x7fc184068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1880ad000 tx=0x7fc188008040 comp rx=0 tx=0).stop 2023-11-28T20:08:37.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.234+0000 7fc19cf34640 1 -- 172.21.15.177:0/3720885861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc198071670 msgr2=0x7fc19813e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.234+0000 7fc19cf34640 1 --2- 172.21.15.177:0/3720885861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc198071670 0x7fc19813e4e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00c750 tx=0x7fc18c00cc10 comp rx=0 tx=0).stop 2023-11-28T20:08:37.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.234+0000 7fc19cf34640 1 -- 172.21.15.177:0/3720885861 shutdown_connections 2023-11-28T20:08:37.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.234+0000 7fc19cf34640 1 --2- 172.21.15.177:0/3720885861 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1840664a0 0x7fc184068960 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.234+0000 7fc19cf34640 1 --2- 172.21.15.177:0/3720885861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1980b2b80 0x7fc19815bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.234+0000 7fc19cf34640 1 --2- 172.21.15.177:0/3720885861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc198071670 0x7fc19813e4e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.234+0000 7fc19cf34640 1 --2- 172.21.15.177:0/3720885861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc19806d980 0x7fc19809b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.234+0000 7fc19cf34640 1 -- 172.21.15.177:0/3720885861 >> 172.21.15.177:0/3720885861 conn(0x7fc1980b0920 msgr2=0x7fc1980b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:37.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.234+0000 7fc19cf34640 1 -- 172.21.15.177:0/3720885861 shutdown_connections 2023-11-28T20:08:37.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.234+0000 7fc19cf34640 1 -- 172.21.15.177:0/3720885861 wait complete. 2023-11-28T20:08:37.259 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T20:08:37.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.390+0000 7fe9591e6640 1 Processor -- start 2023-11-28T20:08:37.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.390+0000 7fe9591e6640 1 -- start start 2023-11-28T20:08:37.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.390+0000 7fe9591e6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe95415ad40 0x7fe954164df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.390+0000 7fe9591e6640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95415b3a0 con 0x7fe95406c9d0 2023-11-28T20:08:37.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.390+0000 7fe9591e6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95413f720 con 0x7fe95413cf30 2023-11-28T20:08:37.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.390+0000 7fe9591e6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95413d310 con 0x7fe95415ad40 2023-11-28T20:08:37.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.390+0000 7fe95259c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe95406c9d0 0x7fe95415a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44436/0 (socket says 172.21.15.177:44436) 2023-11-28T20:08:37.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.390+0000 7fe95259c640 1 -- 172.21.15.177:0/1873998135 learned_addr learned my addr 172.21.15.177:0/1873998135 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:37.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe95359e640 1 --2- 172.21.15.177:0/1873998135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe95415ad40 0x7fe954164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901568357 0 0) 0x7fe95415b3a0 con 0x7fe95406c9d0 2023-11-28T20:08:37.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe93c005740 con 0x7fe95406c9d0 2023-11-28T20:08:37.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 996738414 0 0) 0x7fe95413f720 con 0x7fe95413cf30 2023-11-28T20:08:37.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe95415b3a0 con 0x7fe95413cf30 2023-11-28T20:08:37.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1631553474 0 0) 0x7fe93c005740 con 0x7fe95406c9d0 2023-11-28T20:08:37.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe95415ad40 msgr2=0x7fe954164df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:37.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 --2- 172.21.15.177:0/1873998135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe95415ad40 0x7fe954164df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 >> v1:172.21.15.195:6789/0 conn(0x7fe95413cf30 legacy=0x7fe95406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95413fa00 con 0x7fe95406c9d0 2023-11-28T20:08:37.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7fe948001600 con 0x7fe95406c9d0 2023-11-28T20:08:37.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 >> v1:172.21.15.177:6789/0 conn(0x7fe95406c9d0 legacy=0x7fe95415a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 --2- 172.21.15.177:0/1873998135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe93c005d50 0x7fe93c006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 --2- 172.21.15.177:0/1873998135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe93c0069e0 0x7fe93c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 --2- 172.21.15.177:0/1873998135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe95415ad40 0x7fe93c007400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c00dd30 con 0x7fe93c005d50 2023-11-28T20:08:37.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c00de70 con 0x7fe93c0069e0 2023-11-28T20:08:37.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c00e000 con 0x7fe95415ad40 2023-11-28T20:08:37.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe952d9d640 1 --2- 172.21.15.177:0/1873998135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe93c005d50 0x7fe93c006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe95259c640 1 --2- 172.21.15.177:0/1873998135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe93c0069e0 0x7fe93c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe95359e640 1 --2- 172.21.15.177:0/1873998135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe95415ad40 0x7fe93c007400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe952d9d640 1 -- 172.21.15.177:0/1873998135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe95415ad40 msgr2=0x7fe93c007400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:37.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe952d9d640 1 --2- 172.21.15.177:0/1873998135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe95415ad40 0x7fe93c007400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe952d9d640 1 -- 172.21.15.177:0/1873998135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe93c0069e0 msgr2=0x7fe93c006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:37.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe952d9d640 1 --2- 172.21.15.177:0/1873998135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe93c0069e0 0x7fe93c006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.394+0000 7fe952d9d640 1 -- 172.21.15.177:0/1873998135 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c005740 con 0x7fe93c005d50 2023-11-28T20:08:37.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.398+0000 7fe952d9d640 1 --2- 172.21.15.177:0/1873998135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe93c005d50 0x7fe93c006150 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe944001900 tx=0x7fe94401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee88c740f18a8f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:37.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.398+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9440052d0 con 0x7fe93c005d50 2023-11-28T20:08:37.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.398+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9440a7050 con 0x7fe93c005d50 2023-11-28T20:08:37.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.398+0000 7fe951d9b640 1 -- 172.21.15.177:0/1873998135 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944003600 con 0x7fe93c005d50 2023-11-28T20:08:37.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.398+0000 7fe9591e6640 1 -- 172.21.15.177:0/1873998135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe93c005d50 msgr2=0x7fe93c006150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.398+0000 7fe9591e6640 1 --2- 172.21.15.177:0/1873998135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe93c005d50 0x7fe93c006150 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe944001900 tx=0x7fe94401c560 comp rx=0 tx=0).stop 2023-11-28T20:08:37.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.398+0000 7fe95359e640 1 -- 172.21.15.177:0/1873998135 reap_dead start 2023-11-28T20:08:37.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.398+0000 7fe9591e6640 1 -- 172.21.15.177:0/1873998135 shutdown_connections 2023-11-28T20:08:37.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.398+0000 7fe9591e6640 1 -- 172.21.15.177:0/1873998135 >> 172.21.15.177:0/1873998135 conn(0x7fe95406a530 msgr2=0x7fe95406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:37.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.398+0000 7fe9591e6640 1 -- 172.21.15.177:0/1873998135 shutdown_connections 2023-11-28T20:08:37.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.398+0000 7fe9591e6640 1 -- 172.21.15.177:0/1873998135 wait complete. 2023-11-28T20:08:37.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.398+0000 7fe9591e6640 1 Processor -- start 2023-11-28T20:08:37.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.398+0000 7fe9591e6640 1 -- start start 2023-11-28T20:08:37.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe9591e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe93c005d50 0x7fe954150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe9591e6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe95413b9f0 0x7fe954159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe9591e6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe954154b30 0x7fe954154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe9591e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe954150660 con 0x7fe93c005d50 2023-11-28T20:08:37.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe9591e6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95413c730 con 0x7fe954154b30 2023-11-28T20:08:37.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe9591e6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95413be90 con 0x7fe95413b9f0 2023-11-28T20:08:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe952d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe93c005d50 0x7fe954150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe952d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe93c005d50 0x7fe954150120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35120/0 (socket says 172.21.15.177:35120) 2023-11-28T20:08:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe952d9d640 1 -- 172.21.15.177:0/3371842863 learned_addr learned my addr 172.21.15.177:0/3371842863 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe95259c640 1 --2- 172.21.15.177:0/3371842863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe95413b9f0 0x7fe954159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe95359e640 1 --2- 172.21.15.177:0/3371842863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe954154b30 0x7fe954154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe952d9d640 1 -- 172.21.15.177:0/3371842863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe95413b9f0 msgr2=0x7fe954159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe952d9d640 1 --2- 172.21.15.177:0/3371842863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe95413b9f0 0x7fe954159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe952d9d640 1 -- 172.21.15.177:0/3371842863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe954154b30 msgr2=0x7fe954154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe952d9d640 1 --2- 172.21.15.177:0/3371842863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe954154b30 0x7fe954154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe952d9d640 1 -- 172.21.15.177:0/3371842863 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95413c170 con 0x7fe93c005d50 2023-11-28T20:08:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe952d9d640 1 --2- 172.21.15.177:0/3371842863 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe93c005d50 0x7fe954150120 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe9440ad040 tx=0x7fe93c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:37.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe93b7fe640 1 -- 172.21.15.177:0/3371842863 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9440069e0 con 0x7fe93c005d50 2023-11-28T20:08:37.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe93b7fe640 1 -- 172.21.15.177:0/3371842863 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe944006b40 con 0x7fe93c005d50 2023-11-28T20:08:37.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe93b7fe640 1 -- 172.21.15.177:0/3371842863 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944007030 con 0x7fe93c005d50 2023-11-28T20:08:37.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe9591e6640 1 -- 172.21.15.177:0/3371842863 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95413c450 con 0x7fe93c005d50 2023-11-28T20:08:37.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe9591e6640 1 -- 172.21.15.177:0/3371842863 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95415a100 con 0x7fe93c005d50 2023-11-28T20:08:37.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe9591e6640 1 -- 172.21.15.177:0/3371842863 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe954069440 con 0x7fe93c005d50 2023-11-28T20:08:37.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.402+0000 7fe93b7fe640 1 -- 172.21.15.177:0/3371842863 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe944007190 con 0x7fe93c005d50 2023-11-28T20:08:37.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.406+0000 7fe93b7fe640 1 --2- 172.21.15.177:0/3371842863 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe940066470 0x7fe940068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.406+0000 7fe93b7fe640 1 -- 172.21.15.177:0/3371842863 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe94411d6d0 con 0x7fe93c005d50 2023-11-28T20:08:37.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.406+0000 7fe95259c640 1 --2- 172.21.15.177:0/3371842863 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe940066470 0x7fe940068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.406+0000 7fe95259c640 1 --2- 172.21.15.177:0/3371842863 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe940066470 0x7fe940068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe954133e20 tx=0x7fe948009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:37.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.410+0000 7fe93b7fe640 1 -- 172.21.15.177:0/3371842863 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe9440eae00 con 0x7fe93c005d50 2023-11-28T20:08:37.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.562+0000 7fe9591e6640 1 -- 172.21.15.177:0/3371842863 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe95406d1e0 con 0x7fe93c005d50 2023-11-28T20:08:37.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.562+0000 7fe93b7fe640 1 -- 172.21.15.177:0/3371842863 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe9440ee420 con 0x7fe93c005d50 2023-11-28T20:08:37.569 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:37.569 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-11-28T20:08:37.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:08:37.570 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-11-28T20:08:37.570 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-11-28T20:08:37.570 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:37.570 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-11-28T20:08:37.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.562+0000 7fe9591e6640 1 -- 172.21.15.177:0/3371842863 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe940066470 msgr2=0x7fe940068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.562+0000 7fe9591e6640 1 --2- 172.21.15.177:0/3371842863 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe940066470 0x7fe940068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe954133e20 tx=0x7fe948009040 comp rx=0 tx=0).stop 2023-11-28T20:08:37.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.562+0000 7fe9591e6640 1 -- 172.21.15.177:0/3371842863 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe93c005d50 msgr2=0x7fe954150120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.562+0000 7fe9591e6640 1 --2- 172.21.15.177:0/3371842863 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe93c005d50 0x7fe954150120 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe9440ad040 tx=0x7fe93c007a10 comp rx=0 tx=0).stop 2023-11-28T20:08:37.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.562+0000 7fe9591e6640 1 -- 172.21.15.177:0/3371842863 shutdown_connections 2023-11-28T20:08:37.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.562+0000 7fe9591e6640 1 --2- 172.21.15.177:0/3371842863 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe940066470 0x7fe940068930 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.562+0000 7fe9591e6640 1 --2- 172.21.15.177:0/3371842863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe954154b30 0x7fe954154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.562+0000 7fe9591e6640 1 --2- 172.21.15.177:0/3371842863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe95413b9f0 0x7fe954159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.562+0000 7fe9591e6640 1 --2- 172.21.15.177:0/3371842863 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe93c005d50 0x7fe954150120 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.562+0000 7fe9591e6640 1 -- 172.21.15.177:0/3371842863 >> 172.21.15.177:0/3371842863 conn(0x7fe95406a530 msgr2=0x7fe9541331f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:37.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.562+0000 7fe9591e6640 1 -- 172.21.15.177:0/3371842863 shutdown_connections 2023-11-28T20:08:37.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.562+0000 7fe9591e6640 1 -- 172.21.15.177:0/3371842863 wait complete. 2023-11-28T20:08:37.591 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T20:08:37.591 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T20:08:37.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.726+0000 7fcfea957640 1 Processor -- start 2023-11-28T20:08:37.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.726+0000 7fcfea957640 1 -- start start 2023-11-28T20:08:37.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.726+0000 7fcfea957640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcfe40ae620 0x7fcfe40ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.726+0000 7fcfea957640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe406d6f0 0x7fcfe406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.726+0000 7fcfea957640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe40ce370 con 0x7fcfe415a480 2023-11-28T20:08:37.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.726+0000 7fcfea957640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe40cd570 con 0x7fcfe40ae620 2023-11-28T20:08:37.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.726+0000 7fcfea957640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe406e0a0 con 0x7fcfe406d6f0 2023-11-28T20:08:37.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.726+0000 7fcfe37fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcfe40ae620 0x7fcfe40ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.726+0000 7fcfe37fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcfe40ae620 0x7fcfe40ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35132/0 (socket says 172.21.15.177:35132) 2023-11-28T20:08:37.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.726+0000 7fcfe37fe640 1 -- 172.21.15.177:0/1414148775 learned_addr learned my addr 172.21.15.177:0/1414148775 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:37.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.726+0000 7fcfe3fff640 1 --1- 172.21.15.177:0/1414148775 >> v1:172.21.15.195:6789/0 conn(0x7fcfe415a480 0x7fcfe40cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:53564/0 (socket says 172.21.15.177:53564) 2023-11-28T20:08:37.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.726+0000 7fcfe8ef4640 1 --2- 172.21.15.177:0/1414148775 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe406d6f0 0x7fcfe406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.730+0000 7fcfe37fe640 1 -- 172.21.15.177:0/1414148775 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe406d6f0 msgr2=0x7fcfe406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:37.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.730+0000 7fcfe37fe640 1 --2- 172.21.15.177:0/1414148775 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe406d6f0 0x7fcfe406db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.730+0000 7fcfe37fe640 1 -- 172.21.15.177:0/1414148775 >> v1:172.21.15.195:6789/0 conn(0x7fcfe415a480 legacy=0x7fcfe40cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.730+0000 7fcfe37fe640 1 -- 172.21.15.177:0/1414148775 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe40cd760 con 0x7fcfe40ae620 2023-11-28T20:08:37.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.730+0000 7fcfe2ffd640 1 -- 172.21.15.177:0/1414148775 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948868540 0 0) 0x7fcfe40ce370 con 0x7fcfe415a480 2023-11-28T20:08:37.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.730+0000 7fcfe37fe640 1 --2- 172.21.15.177:0/1414148775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe40ae620 0x7fcfe40ce800 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80098a0 tx=0x7fcfd801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4791ba9c429f151a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:37.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.730+0000 7fcfe2ffd640 1 -- 172.21.15.177:0/1414148775 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80aa680 con 0x7fcfe40ae620 2023-11-28T20:08:37.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.730+0000 7fcfe2ffd640 1 -- 172.21.15.177:0/1414148775 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd80aa7e0 con 0x7fcfe40ae620 2023-11-28T20:08:37.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.730+0000 7fcfe2ffd640 1 -- 172.21.15.177:0/1414148775 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80aab70 con 0x7fcfe40ae620 2023-11-28T20:08:37.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.730+0000 7fcfea957640 1 -- 172.21.15.177:0/1414148775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe40ae620 msgr2=0x7fcfe40ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.730+0000 7fcfea957640 1 --2- 172.21.15.177:0/1414148775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe40ae620 0x7fcfe40ce800 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80098a0 tx=0x7fcfd801c520 comp rx=0 tx=0).stop 2023-11-28T20:08:37.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfea957640 1 -- 172.21.15.177:0/1414148775 shutdown_connections 2023-11-28T20:08:37.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfea957640 1 --2- 172.21.15.177:0/1414148775 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe406d6f0 0x7fcfe406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfea957640 1 --2- 172.21.15.177:0/1414148775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe40ae620 0x7fcfe40ce800 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfea957640 1 -- 172.21.15.177:0/1414148775 >> 172.21.15.177:0/1414148775 conn(0x7fcfe40b0c50 msgr2=0x7fcfe40b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:37.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfea957640 1 -- 172.21.15.177:0/1414148775 shutdown_connections 2023-11-28T20:08:37.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfea957640 1 -- 172.21.15.177:0/1414148775 wait complete. 2023-11-28T20:08:37.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfea957640 1 Processor -- start 2023-11-28T20:08:37.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfea957640 1 -- start start 2023-11-28T20:08:37.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfea957640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe406d6f0 0x7fcfe414d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfea957640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe40ae620 0x7fcfe40c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfea957640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfe415a480 0x7fcfe40c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfea957640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe414dbd0 con 0x7fcfe406d6f0 2023-11-28T20:08:37.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfea957640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe415ad30 con 0x7fcfe415a480 2023-11-28T20:08:37.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfea957640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe415a9e0 con 0x7fcfe40ae620 2023-11-28T20:08:37.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfe3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe406d6f0 0x7fcfe414d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfe3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe406d6f0 0x7fcfe414d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35140/0 (socket says 172.21.15.177:35140) 2023-11-28T20:08:37.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfe3fff640 1 -- 172.21.15.177:0/3170435973 learned_addr learned my addr 172.21.15.177:0/3170435973 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:37.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfe37fe640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe40ae620 0x7fcfe40c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfe3fff640 1 -- 172.21.15.177:0/3170435973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe40ae620 msgr2=0x7fcfe40c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfe3fff640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe40ae620 0x7fcfe40c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfe3fff640 1 -- 172.21.15.177:0/3170435973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfe415a480 msgr2=0x7fcfe40c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:37.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfe8ef4640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfe415a480 0x7fcfe40c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfe3fff640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfe415a480 0x7fcfe40c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:37.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfe3fff640 1 -- 172.21.15.177:0/3170435973 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd80094d0 con 0x7fcfe406d6f0 2023-11-28T20:08:37.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfe37fe640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe40ae620 0x7fcfe40c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:37.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.734+0000 7fcfe8ef4640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfe415a480 0x7fcfe40c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:37.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.738+0000 7fcfe3fff640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe406d6f0 0x7fcfe414d690 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c4b0 tx=0x7fcfd400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:37.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.738+0000 7fcfe0ff9640 1 -- 172.21.15.177:0/3170435973 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd40074e0 con 0x7fcfe406d6f0 2023-11-28T20:08:37.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.738+0000 7fcfe0ff9640 1 -- 172.21.15.177:0/3170435973 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd4007660 con 0x7fcfe406d6f0 2023-11-28T20:08:37.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.738+0000 7fcfe0ff9640 1 -- 172.21.15.177:0/3170435973 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4004a30 con 0x7fcfe406d6f0 2023-11-28T20:08:37.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.738+0000 7fcfea957640 1 -- 172.21.15.177:0/3170435973 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe4151d30 con 0x7fcfe406d6f0 2023-11-28T20:08:37.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.738+0000 7fcfea957640 1 -- 172.21.15.177:0/3170435973 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe4151000 con 0x7fcfe406d6f0 2023-11-28T20:08:37.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.738+0000 7fcfea957640 1 -- 172.21.15.177:0/3170435973 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe404e850 con 0x7fcfe406d6f0 2023-11-28T20:08:37.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.738+0000 7fcfe0ff9640 1 -- 172.21.15.177:0/3170435973 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcfd4004b90 con 0x7fcfe406d6f0 2023-11-28T20:08:37.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.738+0000 7fcfe0ff9640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfd00664c0 0x7fcfd0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:37.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.738+0000 7fcfe0ff9640 1 -- 172.21.15.177:0/3170435973 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcfd4083070 con 0x7fcfe406d6f0 2023-11-28T20:08:37.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.738+0000 7fcfe37fe640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfd00664c0 0x7fcfd0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:37.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.738+0000 7fcfe37fe640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfd00664c0 0x7fcfd0068980 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80ae000 tx=0x7fcfd8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:37.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.742+0000 7fcfe0ff9640 1 -- 172.21.15.177:0/3170435973 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcfd40543b0 con 0x7fcfe406d6f0 2023-11-28T20:08:37.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:37.894+0000 7fcfea957640 1 -- 172.21.15.177:0/3170435973 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcfe40693d0 con 0x7fcfe406d6f0 2023-11-28T20:08:38.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.006+0000 7fcfe0ff9640 1 -- 172.21.15.177:0/3170435973 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcfd4018020 con 0x7fcfe406d6f0 2023-11-28T20:08:38.012 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-11-28T20:08:38.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.006+0000 7fcfea957640 1 -- 172.21.15.177:0/3170435973 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfd00664c0 msgr2=0x7fcfd0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:38.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.006+0000 7fcfea957640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfd00664c0 0x7fcfd0068980 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80ae000 tx=0x7fcfd8008040 comp rx=0 tx=0).stop 2023-11-28T20:08:38.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.006+0000 7fcfea957640 1 -- 172.21.15.177:0/3170435973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe406d6f0 msgr2=0x7fcfe414d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:38.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.006+0000 7fcfea957640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe406d6f0 0x7fcfe414d690 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c4b0 tx=0x7fcfd400c970 comp rx=0 tx=0).stop 2023-11-28T20:08:38.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.006+0000 7fcfea957640 1 -- 172.21.15.177:0/3170435973 shutdown_connections 2023-11-28T20:08:38.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.006+0000 7fcfea957640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfd00664c0 0x7fcfd0068980 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:38.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.006+0000 7fcfea957640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfe415a480 0x7fcfe40c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:38.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.006+0000 7fcfea957640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe40ae620 0x7fcfe40c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:38.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.006+0000 7fcfea957640 1 --2- 172.21.15.177:0/3170435973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe406d6f0 0x7fcfe414d690 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:38.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.006+0000 7fcfea957640 1 -- 172.21.15.177:0/3170435973 >> 172.21.15.177:0/3170435973 conn(0x7fcfe40b0c50 msgr2=0x7fcfe406c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:38.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.010+0000 7fcfea957640 1 -- 172.21.15.177:0/3170435973 shutdown_connections 2023-11-28T20:08:38.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.010+0000 7fcfea957640 1 -- 172.21.15.177:0/3170435973 wait complete. 2023-11-28T20:08:38.038 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T20:08:38.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.178+0000 7f981032a640 1 Processor -- start 2023-11-28T20:08:38.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.178+0000 7f981032a640 1 -- start start 2023-11-28T20:08:38.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f981032a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f980815e400 0x7f980815d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:38.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f981032a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98080acce0 0x7f980806b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:38.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f981032a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f980806ba80 0x7f9808160df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:38.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f981032a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98080b26f0 con 0x7f980815e400 2023-11-28T20:08:38.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f981032a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980815e7e0 con 0x7f980806ba80 2023-11-28T20:08:38.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f981032a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980806beb0 con 0x7f98080acce0 2023-11-28T20:08:38.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f980e0c6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f980815e400 0x7f980815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:38.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f980e0c6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f980815e400 0x7f980815d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35146/0 (socket says 172.21.15.177:35146) 2023-11-28T20:08:38.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f980e0c6640 1 -- 172.21.15.177:0/204538121 learned_addr learned my addr 172.21.15.177:0/204538121 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:38.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f980e8c7640 1 --2- 172.21.15.177:0/204538121 >> v2:172.21.15.195:3300/0 conn(0x7f980806ba80 0x7f9808160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:38.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f980d8c5640 1 --2- 172.21.15.177:0/204538121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98080acce0 0x7f980806b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:38.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f980e0c6640 1 -- 172.21.15.177:0/204538121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98080acce0 msgr2=0x7f980806b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:38.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f980e0c6640 1 --2- 172.21.15.177:0/204538121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98080acce0 0x7f980806b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:38.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f980e0c6640 1 -- 172.21.15.177:0/204538121 >> v2:172.21.15.195:3300/0 conn(0x7f980806ba80 msgr2=0x7f9808160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:38.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f980e0c6640 1 --2- 172.21.15.177:0/204538121 >> v2:172.21.15.195:3300/0 conn(0x7f980806ba80 0x7f9808160df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:38.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f980e0c6640 1 -- 172.21.15.177:0/204538121 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98080ad4c0 con 0x7f980815e400 2023-11-28T20:08:38.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.182+0000 7f980e0c6640 1 --2- 172.21.15.177:0/204538121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f980815e400 0x7f980815d800 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f98080aca80 tx=0x7f980401c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c134659ba927481e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:38.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f980d0c4640 1 -- 172.21.15.177:0/204538121 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98040ab600 con 0x7f980815e400 2023-11-28T20:08:38.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f980d0c4640 1 -- 172.21.15.177:0/204538121 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98040a7050 con 0x7f980815e400 2023-11-28T20:08:38.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f980d0c4640 1 -- 172.21.15.177:0/204538121 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98040ab980 con 0x7f980815e400 2023-11-28T20:08:38.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 -- 172.21.15.177:0/204538121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f980815e400 msgr2=0x7f980815d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:38.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 --2- 172.21.15.177:0/204538121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f980815e400 0x7f980815d800 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f98080aca80 tx=0x7f980401c0f0 comp rx=0 tx=0).stop 2023-11-28T20:08:38.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 -- 172.21.15.177:0/204538121 shutdown_connections 2023-11-28T20:08:38.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 --2- 172.21.15.177:0/204538121 >> v2:172.21.15.195:3300/0 conn(0x7f980806ba80 0x7f9808160df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:38.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 --2- 172.21.15.177:0/204538121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98080acce0 0x7f980806b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:38.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 --2- 172.21.15.177:0/204538121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f980815e400 0x7f980815d800 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:38.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 -- 172.21.15.177:0/204538121 >> 172.21.15.177:0/204538121 conn(0x7f9808070d20 msgr2=0x7f9808071130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:38.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 -- 172.21.15.177:0/204538121 shutdown_connections 2023-11-28T20:08:38.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 -- 172.21.15.177:0/204538121 wait complete. 2023-11-28T20:08:38.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 Processor -- start 2023-11-28T20:08:38.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 -- start start 2023-11-28T20:08:38.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f980806ba80 0x7f98081472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:38.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98080acce0 0x7f9808156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:38.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f980815e400 0x7f9808156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:38.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9808157bc0 con 0x7f980806ba80 2023-11-28T20:08:38.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98081477f0 con 0x7f98080acce0 2023-11-28T20:08:38.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f981032a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9808156fb0 con 0x7f980815e400 2023-11-28T20:08:38.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f980e0c6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f980806ba80 0x7f98081472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:38.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f980e0c6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f980806ba80 0x7f98081472b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35148/0 (socket says 172.21.15.177:35148) 2023-11-28T20:08:38.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.186+0000 7f980e0c6640 1 -- 172.21.15.177:0/2761105117 learned_addr learned my addr 172.21.15.177:0/2761105117 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:38.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f980e8c7640 1 --2- 172.21.15.177:0/2761105117 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f980815e400 0x7f9808156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:38.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f980d8c5640 1 --2- 172.21.15.177:0/2761105117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98080acce0 0x7f9808156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:38.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f980e0c6640 1 -- 172.21.15.177:0/2761105117 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f980815e400 msgr2=0x7f9808156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:38.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f980e0c6640 1 --2- 172.21.15.177:0/2761105117 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f980815e400 0x7f9808156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:38.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f980e0c6640 1 -- 172.21.15.177:0/2761105117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98080acce0 msgr2=0x7f9808156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:38.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f980e0c6640 1 --2- 172.21.15.177:0/2761105117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98080acce0 0x7f9808156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:38.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f980e0c6640 1 -- 172.21.15.177:0/2761105117 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040094d0 con 0x7f980806ba80 2023-11-28T20:08:38.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f980d8c5640 1 --2- 172.21.15.177:0/2761105117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98080acce0 0x7f9808156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:38.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f980e0c6640 1 --2- 172.21.15.177:0/2761105117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f980806ba80 0x7f98081472b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f980401a7a0 tx=0x7f9804018e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:38.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f97feffd640 1 -- 172.21.15.177:0/2761105117 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98040b4420 con 0x7f980806ba80 2023-11-28T20:08:38.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f97feffd640 1 -- 172.21.15.177:0/2761105117 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98040b4580 con 0x7f980806ba80 2023-11-28T20:08:38.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f97feffd640 1 -- 172.21.15.177:0/2761105117 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98040b4930 con 0x7f980806ba80 2023-11-28T20:08:38.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f981032a640 1 -- 172.21.15.177:0/2761105117 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9808157290 con 0x7f980806ba80 2023-11-28T20:08:38.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f981032a640 1 -- 172.21.15.177:0/2761105117 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9808157850 con 0x7f980806ba80 2023-11-28T20:08:38.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f981032a640 1 -- 172.21.15.177:0/2761105117 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9808069440 con 0x7f980806ba80 2023-11-28T20:08:38.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f97feffd640 1 -- 172.21.15.177:0/2761105117 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f98040b2070 con 0x7f980806ba80 2023-11-28T20:08:38.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.190+0000 7f97feffd640 1 --2- 172.21.15.177:0/2761105117 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97ec066470 0x7f97ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:38.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.194+0000 7f97feffd640 1 -- 172.21.15.177:0/2761105117 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f980411e2d0 con 0x7f980806ba80 2023-11-28T20:08:38.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.194+0000 7f980d8c5640 1 --2- 172.21.15.177:0/2761105117 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97ec066470 0x7f97ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:38.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.194+0000 7f980d8c5640 1 --2- 172.21.15.177:0/2761105117 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97ec066470 0x7f97ec068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f98081680c0 tx=0x7f97f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:38.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.194+0000 7f97feffd640 1 -- 172.21.15.177:0/2761105117 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f98040eb910 con 0x7f980806ba80 2023-11-28T20:08:38.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:38.346+0000 7f981032a640 1 -- 172.21.15.177:0/2761105117 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f980815d0a0 con 0x7f980806ba80 2023-11-28T20:08:39.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.018+0000 7f97feffd640 1 -- 172.21.15.177:0/2761105117 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f98040eef30 con 0x7f980806ba80 2023-11-28T20:08:39.023 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-11-28T20:08:39.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.018+0000 7f981032a640 1 -- 172.21.15.177:0/2761105117 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97ec066470 msgr2=0x7f97ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:39.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.018+0000 7f981032a640 1 --2- 172.21.15.177:0/2761105117 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97ec066470 0x7f97ec068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f98081680c0 tx=0x7f97f8008040 comp rx=0 tx=0).stop 2023-11-28T20:08:39.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.018+0000 7f981032a640 1 -- 172.21.15.177:0/2761105117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f980806ba80 msgr2=0x7f98081472b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:39.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.018+0000 7f981032a640 1 --2- 172.21.15.177:0/2761105117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f980806ba80 0x7f98081472b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f980401a7a0 tx=0x7f9804018e90 comp rx=0 tx=0).stop 2023-11-28T20:08:39.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.022+0000 7f981032a640 1 -- 172.21.15.177:0/2761105117 shutdown_connections 2023-11-28T20:08:39.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.022+0000 7f981032a640 1 --2- 172.21.15.177:0/2761105117 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97ec066470 0x7f97ec068930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:39.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.022+0000 7f981032a640 1 --2- 172.21.15.177:0/2761105117 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f980815e400 0x7f9808156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:39.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.022+0000 7f981032a640 1 --2- 172.21.15.177:0/2761105117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98080acce0 0x7f9808156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:39.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.022+0000 7f981032a640 1 --2- 172.21.15.177:0/2761105117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f980806ba80 0x7f98081472b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:39.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.022+0000 7f981032a640 1 -- 172.21.15.177:0/2761105117 >> 172.21.15.177:0/2761105117 conn(0x7f9808070d20 msgr2=0x7f98081601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:39.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.026+0000 7f981032a640 1 -- 172.21.15.177:0/2761105117 shutdown_connections 2023-11-28T20:08:39.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.026+0000 7f981032a640 1 -- 172.21.15.177:0/2761105117 wait complete. 2023-11-28T20:08:39.067 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T20:08:39.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e23e17640 1 Processor -- start 2023-11-28T20:08:39.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e23e17640 1 -- start start 2023-11-28T20:08:39.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e23e17640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7e1c15adb0 0x7f7e1c13d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:39.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e23e17640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1c13f5f0 0x7f7e1c0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:39.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e23e17640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1c13d2b0 con 0x7f7e1c071d90 2023-11-28T20:08:39.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e23e17640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c140520 con 0x7f7e1c15adb0 2023-11-28T20:08:39.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e23e17640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0cd7f0 con 0x7f7e1c13f5f0 2023-11-28T20:08:39.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e21bb3640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f7e1c071d90 0x7f7e1c072170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:57218/0 (socket says 172.21.15.177:57218) 2023-11-28T20:08:39.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e21bb3640 1 -- 172.21.15.177:0/570411494 learned_addr learned my addr 172.21.15.177:0/570411494 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:39.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e213b2640 1 --2- 172.21.15.177:0/570411494 >> v2:172.21.15.195:3300/0 conn(0x7f7e1c15adb0 0x7f7e1c13d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:39.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e223b4640 1 --2- 172.21.15.177:0/570411494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1c13f5f0 0x7f7e1c0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:39.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e20bb1640 1 -- 172.21.15.177:0/570411494 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097701654 0 0) 0x7f7e1c13d2b0 con 0x7f7e1c071d90 2023-11-28T20:08:39.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e20bb1640 1 -- 172.21.15.177:0/570411494 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e08003530 con 0x7f7e1c071d90 2023-11-28T20:08:39.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e213b2640 1 -- 172.21.15.177:0/570411494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1c13f5f0 msgr2=0x7f7e1c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:39.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e20bb1640 1 -- 172.21.15.177:0/570411494 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 199050602 0 0) 0x7f7e08003530 con 0x7f7e1c071d90 2023-11-28T20:08:39.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e213b2640 1 --2- 172.21.15.177:0/570411494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1c13f5f0 0x7f7e1c0ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:39.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e213b2640 1 -- 172.21.15.177:0/570411494 >> v1:172.21.15.177:6789/0 conn(0x7f7e1c071d90 legacy=0x7f7e1c072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:39.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e213b2640 1 -- 172.21.15.177:0/570411494 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c0cdd70 con 0x7f7e1c15adb0 2023-11-28T20:08:39.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.202+0000 7f7e223b4640 1 --2- 172.21.15.177:0/570411494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1c13f5f0 0x7f7e1c0ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:39.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.206+0000 7f7e213b2640 1 --2- 172.21.15.177:0/570411494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e1c15adb0 0x7f7e1c13d560 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0097c0 tx=0x7f7e0c01e580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ceac0f9dc9e125b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:39.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.206+0000 7f7e20bb1640 1 -- 172.21.15.177:0/570411494 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18001680 con 0x7f7e1c15adb0 2023-11-28T20:08:39.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.206+0000 7f7e20bb1640 1 -- 172.21.15.177:0/570411494 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c0ae430 con 0x7f7e1c15adb0 2023-11-28T20:08:39.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.206+0000 7f7e20bb1640 1 -- 172.21.15.177:0/570411494 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0ae7c0 con 0x7f7e1c15adb0 2023-11-28T20:08:39.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.206+0000 7f7e23e17640 1 -- 172.21.15.177:0/570411494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e1c15adb0 msgr2=0x7f7e1c13d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:39.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.206+0000 7f7e23e17640 1 --2- 172.21.15.177:0/570411494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e1c15adb0 0x7f7e1c13d560 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0097c0 tx=0x7f7e0c01e580 comp rx=0 tx=0).stop 2023-11-28T20:08:39.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.206+0000 7f7e23e17640 1 -- 172.21.15.177:0/570411494 shutdown_connections 2023-11-28T20:08:39.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.206+0000 7f7e23e17640 1 --2- 172.21.15.177:0/570411494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e1c15adb0 0x7f7e1c13d560 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:39.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.206+0000 7f7e23e17640 1 --2- 172.21.15.177:0/570411494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1c13f5f0 0x7f7e1c0ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:39.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.206+0000 7f7e23e17640 1 -- 172.21.15.177:0/570411494 >> 172.21.15.177:0/570411494 conn(0x7f7e1c0b0cc0 msgr2=0x7f7e1c0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:39.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.206+0000 7f7e23e17640 1 -- 172.21.15.177:0/570411494 shutdown_connections 2023-11-28T20:08:39.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.206+0000 7f7e23e17640 1 -- 172.21.15.177:0/570411494 wait complete. 2023-11-28T20:08:39.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e23e17640 1 Processor -- start 2023-11-28T20:08:39.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e23e17640 1 -- start start 2023-11-28T20:08:39.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e23e17640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1c071d90 0x7f7e1c151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:39.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e23e17640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e1c13f5f0 0x7f7e1c151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:39.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e23e17640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e1c15adb0 0x7f7e1c153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:39.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e23e17640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c13abe0 con 0x7f7e1c13f5f0 2023-11-28T20:08:39.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e23e17640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0b0240 con 0x7f7e1c15adb0 2023-11-28T20:08:39.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e23e17640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0b0520 con 0x7f7e1c071d90 2023-11-28T20:08:39.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e213b2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e1c13f5f0 0x7f7e1c151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:39.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e213b2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e1c13f5f0 0x7f7e1c151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48064/0 (socket says 172.21.15.177:48064) 2023-11-28T20:08:39.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e213b2640 1 -- 172.21.15.177:0/1899988466 learned_addr learned my addr 172.21.15.177:0/1899988466 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:39.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e21bb3640 1 --2- 172.21.15.177:0/1899988466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1c071d90 0x7f7e1c151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:39.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e223b4640 1 --2- 172.21.15.177:0/1899988466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e1c15adb0 0x7f7e1c153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:39.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e213b2640 1 -- 172.21.15.177:0/1899988466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1c071d90 msgr2=0x7f7e1c151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:39.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e213b2640 1 --2- 172.21.15.177:0/1899988466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1c071d90 0x7f7e1c151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:39.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e213b2640 1 -- 172.21.15.177:0/1899988466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e1c15adb0 msgr2=0x7f7e1c153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:39.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e213b2640 1 --2- 172.21.15.177:0/1899988466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e1c15adb0 0x7f7e1c153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:39.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e213b2640 1 -- 172.21.15.177:0/1899988466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e14009a70 con 0x7f7e1c13f5f0 2023-11-28T20:08:39.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e213b2640 1 --2- 172.21.15.177:0/1899988466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e1c13f5f0 0x7f7e1c151ad0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c01cc30 tx=0x7f7e0c01cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:39.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e127fc640 1 -- 172.21.15.177:0/1899988466 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0b9670 con 0x7f7e1c13f5f0 2023-11-28T20:08:39.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e127fc640 1 -- 172.21.15.177:0/1899988466 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c0b97f0 con 0x7f7e1c13f5f0 2023-11-28T20:08:39.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e127fc640 1 -- 172.21.15.177:0/1899988466 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0b9ba0 con 0x7f7e1c13f5f0 2023-11-28T20:08:39.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e23e17640 1 -- 172.21.15.177:0/1899988466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c009420 con 0x7f7e1c13f5f0 2023-11-28T20:08:39.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e23e17640 1 -- 172.21.15.177:0/1899988466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c0b29e0 con 0x7f7e1c13f5f0 2023-11-28T20:08:39.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e23e17640 1 -- 172.21.15.177:0/1899988466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1c0693d0 con 0x7f7e1c13f5f0 2023-11-28T20:08:39.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e127fc640 1 -- 172.21.15.177:0/1899988466 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7e0c0b5070 con 0x7f7e1c13f5f0 2023-11-28T20:08:39.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e127fc640 1 --2- 172.21.15.177:0/1899988466 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7e00066470 0x7f7e00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:39.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e127fc640 1 -- 172.21.15.177:0/1899988466 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7e0c11f140 con 0x7f7e1c13f5f0 2023-11-28T20:08:39.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e21bb3640 1 --2- 172.21.15.177:0/1899988466 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7e00066470 0x7f7e00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:39.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.214+0000 7f7e21bb3640 1 --2- 172.21.15.177:0/1899988466 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7e00066470 0x7f7e00068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7e180011f0 tx=0x7f7e18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:39.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.218+0000 7f7e127fc640 1 -- 172.21.15.177:0/1899988466 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e0c0ec600 con 0x7f7e1c13f5f0 2023-11-28T20:08:39.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:39.398+0000 7f7e23e17640 1 -- 172.21.15.177:0/1899988466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7e1c06e710 con 0x7f7e1c13f5f0 2023-11-28T20:08:39.994 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:08:39.998 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:08:40.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.034+0000 7f7e127fc640 1 -- 172.21.15.177:0/1899988466 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7e0c0aa0c0 con 0x7f7e1c13f5f0 2023-11-28T20:08:40.042 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 4 and data pool 5 2023-11-28T20:08:40.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.042+0000 7f7e23e17640 1 -- 172.21.15.177:0/1899988466 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7e00066470 msgr2=0x7f7e00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.042+0000 7f7e23e17640 1 --2- 172.21.15.177:0/1899988466 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7e00066470 0x7f7e00068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7e180011f0 tx=0x7f7e18009040 comp rx=0 tx=0).stop 2023-11-28T20:08:40.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.042+0000 7f7e23e17640 1 -- 172.21.15.177:0/1899988466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e1c13f5f0 msgr2=0x7f7e1c151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.042+0000 7f7e23e17640 1 --2- 172.21.15.177:0/1899988466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e1c13f5f0 0x7f7e1c151ad0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c01cc30 tx=0x7f7e0c01cdc0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.046+0000 7f7e23e17640 1 -- 172.21.15.177:0/1899988466 shutdown_connections 2023-11-28T20:08:40.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.046+0000 7f7e23e17640 1 --2- 172.21.15.177:0/1899988466 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7e00066470 0x7f7e00068930 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.046+0000 7f7e23e17640 1 --2- 172.21.15.177:0/1899988466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e1c15adb0 0x7f7e1c153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.046+0000 7f7e23e17640 1 --2- 172.21.15.177:0/1899988466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e1c13f5f0 0x7f7e1c151ad0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.046+0000 7f7e23e17640 1 --2- 172.21.15.177:0/1899988466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1c071d90 0x7f7e1c151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.046+0000 7f7e23e17640 1 -- 172.21.15.177:0/1899988466 >> 172.21.15.177:0/1899988466 conn(0x7f7e1c0b0cc0 msgr2=0x7f7e1c13c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:40.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.050+0000 7f7e23e17640 1 -- 172.21.15.177:0/1899988466 shutdown_connections 2023-11-28T20:08:40.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.050+0000 7f7e23e17640 1 -- 172.21.15.177:0/1899988466 wait complete. 2023-11-28T20:08:40.085 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:40.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d643c4640 1 Processor -- start 2023-11-28T20:08:40.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d643c4640 1 -- start start 2023-11-28T20:08:40.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d643c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d5c140180 0x7f7d5c071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d643c4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5c071280 con 0x7f7d5c06c2c0 2023-11-28T20:08:40.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d643c4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5c1408c0 con 0x7f7d5c06c740 2023-11-28T20:08:40.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d643c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c15db80 con 0x7f7d5c140180 2023-11-28T20:08:40.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6195f640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f7d5c06c2c0 0x7f7d5c070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:57232/0 (socket says 172.21.15.177:57232) 2023-11-28T20:08:40.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6195f640 1 -- 172.21.15.177:0/2711090185 learned_addr learned my addr 172.21.15.177:0/2711090185 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d62160640 1 --2- 172.21.15.177:0/2711090185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d5c140180 0x7f7d5c071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6115e640 1 -- 172.21.15.177:0/2711090185 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330851909 0 0) 0x7f7d5c071280 con 0x7f7d5c06c2c0 2023-11-28T20:08:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6115e640 1 -- 172.21.15.177:0/2711090185 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d48003530 con 0x7f7d5c06c2c0 2023-11-28T20:08:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6115e640 1 -- 172.21.15.177:0/2711090185 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1134375016 0 0) 0x7f7d48003530 con 0x7f7d5c06c2c0 2023-11-28T20:08:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6115e640 1 -- 172.21.15.177:0/2711090185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d5c140180 msgr2=0x7f7d5c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6115e640 1 --2- 172.21.15.177:0/2711090185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d5c140180 0x7f7d5c071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6115e640 1 -- 172.21.15.177:0/2711090185 >> v1:172.21.15.195:6789/0 conn(0x7f7d5c06c740 legacy=0x7f7d5c070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6115e640 1 -- 172.21.15.177:0/2711090185 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c15de60 con 0x7f7d5c06c2c0 2023-11-28T20:08:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6115e640 1 -- 172.21.15.177:0/2711090185 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f7d4c001680 con 0x7f7d5c06c2c0 2023-11-28T20:08:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6115e640 1 -- 172.21.15.177:0/2711090185 >> v1:172.21.15.177:6789/0 conn(0x7f7d5c06c2c0 legacy=0x7f7d5c070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6115e640 1 --2- 172.21.15.177:0/2711090185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d5c140180 0x7f7d480039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6115e640 1 --2- 172.21.15.177:0/2711090185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d48003ef0 0x7f7d480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6115e640 1 --2- 172.21.15.177:0/2711090185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d48004d10 0x7f7d48005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6115e640 1 -- 172.21.15.177:0/2711090185 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c15db80 con 0x7f7d48003ef0 2023-11-28T20:08:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6115e640 1 -- 172.21.15.177:0/2711090185 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4800ba40 con 0x7f7d48004d10 2023-11-28T20:08:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6115e640 1 -- 172.21.15.177:0/2711090185 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4800bc00 con 0x7f7d5c140180 2023-11-28T20:08:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d6195f640 1 --2- 172.21.15.177:0/2711090185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d48003ef0 0x7f7d480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d62160640 1 --2- 172.21.15.177:0/2711090185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d5c140180 0x7f7d480039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.266+0000 7f7d62961640 1 --2- 172.21.15.177:0/2711090185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d48004d10 0x7f7d48005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.270+0000 7f7d6195f640 1 -- 172.21.15.177:0/2711090185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d5c140180 msgr2=0x7f7d480039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.270+0000 7f7d6195f640 1 --2- 172.21.15.177:0/2711090185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d5c140180 0x7f7d480039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.270+0000 7f7d6195f640 1 -- 172.21.15.177:0/2711090185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d48004d10 msgr2=0x7f7d48005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.270+0000 7f7d6195f640 1 --2- 172.21.15.177:0/2711090185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d48004d10 0x7f7d48005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.270+0000 7f7d6195f640 1 -- 172.21.15.177:0/2711090185 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d48003530 con 0x7f7d48003ef0 2023-11-28T20:08:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.270+0000 7f7d6195f640 1 --2- 172.21.15.177:0/2711090185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d48003ef0 0x7f7d480047d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00c190 tx=0x7f7d4c01cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a8249d63593fff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.270+0000 7f7d6115e640 1 -- 172.21.15.177:0/2711090185 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c005ae0 con 0x7f7d48003ef0 2023-11-28T20:08:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.270+0000 7f7d6115e640 1 -- 172.21.15.177:0/2711090185 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c005c40 con 0x7f7d48003ef0 2023-11-28T20:08:40.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.270+0000 7f7d6115e640 1 -- 172.21.15.177:0/2711090185 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c007070 con 0x7f7d48003ef0 2023-11-28T20:08:40.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.270+0000 7f7d643c4640 1 -- 172.21.15.177:0/2711090185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d48003ef0 msgr2=0x7f7d480047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.270+0000 7f7d643c4640 1 --2- 172.21.15.177:0/2711090185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d48003ef0 0x7f7d480047d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00c190 tx=0x7f7d4c01cbd0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.270+0000 7f7d62961640 1 -- 172.21.15.177:0/2711090185 reap_dead start 2023-11-28T20:08:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.270+0000 7f7d643c4640 1 -- 172.21.15.177:0/2711090185 shutdown_connections 2023-11-28T20:08:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.270+0000 7f7d643c4640 1 -- 172.21.15.177:0/2711090185 >> 172.21.15.177:0/2711090185 conn(0x7f7d5c06a530 msgr2=0x7f7d5c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d643c4640 1 -- 172.21.15.177:0/2711090185 shutdown_connections 2023-11-28T20:08:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d643c4640 1 -- 172.21.15.177:0/2711090185 wait complete. 2023-11-28T20:08:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d643c4640 1 Processor -- start 2023-11-28T20:08:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d643c4640 1 -- start start 2023-11-28T20:08:40.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d643c4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d48003ef0 0x7f7d5c0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d643c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d5c13dd90 0x7f7d5c160dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d643c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d5c161310 0x7f7d5c164f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d643c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c161790 con 0x7f7d5c13dd90 2023-11-28T20:08:40.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d643c4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c13fd70 con 0x7f7d48003ef0 2023-11-28T20:08:40.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d643c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c164ad0 con 0x7f7d5c161310 2023-11-28T20:08:40.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d6195f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d5c13dd90 0x7f7d5c160dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d6195f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d5c13dd90 0x7f7d5c160dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48074/0 (socket says 172.21.15.177:48074) 2023-11-28T20:08:40.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d6195f640 1 -- 172.21.15.177:0/2631755376 learned_addr learned my addr 172.21.15.177:0/2631755376 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:40.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d62160640 1 --2- 172.21.15.177:0/2631755376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d48003ef0 0x7f7d5c0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d62961640 1 --2- 172.21.15.177:0/2631755376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d5c161310 0x7f7d5c164f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d6195f640 1 -- 172.21.15.177:0/2631755376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d5c161310 msgr2=0x7f7d5c164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d6195f640 1 --2- 172.21.15.177:0/2631755376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d5c161310 0x7f7d5c164f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d6195f640 1 -- 172.21.15.177:0/2631755376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d48003ef0 msgr2=0x7f7d5c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d6195f640 1 --2- 172.21.15.177:0/2631755376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d48003ef0 0x7f7d5c0b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d6195f640 1 -- 172.21.15.177:0/2631755376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c0b06b0 con 0x7f7d5c13dd90 2023-11-28T20:08:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.274+0000 7f7d6195f640 1 --2- 172.21.15.177:0/2631755376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d5c13dd90 0x7f7d5c160dd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00c190 tx=0x7f7d48005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.278+0000 7f7d52ffd640 1 -- 172.21.15.177:0/2631755376 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0b4070 con 0x7f7d5c13dd90 2023-11-28T20:08:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.278+0000 7f7d52ffd640 1 -- 172.21.15.177:0/2631755376 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c0047f0 con 0x7f7d5c13dd90 2023-11-28T20:08:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.278+0000 7f7d643c4640 1 -- 172.21.15.177:0/2631755376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c163f00 con 0x7f7d5c13dd90 2023-11-28T20:08:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.278+0000 7f7d52ffd640 1 -- 172.21.15.177:0/2631755376 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c004ba0 con 0x7f7d5c13dd90 2023-11-28T20:08:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.278+0000 7f7d643c4640 1 -- 172.21.15.177:0/2631755376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c164480 con 0x7f7d5c13dd90 2023-11-28T20:08:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.278+0000 7f7d643c4640 1 -- 172.21.15.177:0/2631755376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c164c60 con 0x7f7d5c13dd90 2023-11-28T20:08:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.278+0000 7f7d52ffd640 1 -- 172.21.15.177:0/2631755376 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7d4c004d00 con 0x7f7d5c13dd90 2023-11-28T20:08:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.278+0000 7f7d52ffd640 1 --2- 172.21.15.177:0/2631755376 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7d40066470 0x7f7d40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.278+0000 7f7d52ffd640 1 -- 172.21.15.177:0/2631755376 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d4c11d270 con 0x7f7d5c13dd90 2023-11-28T20:08:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.278+0000 7f7d62160640 1 --2- 172.21.15.177:0/2631755376 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7d40066470 0x7f7d40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.278+0000 7f7d62160640 1 --2- 172.21.15.177:0/2631755376 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7d40066470 0x7f7d40068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009be0 tx=0x7f7d58009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:40.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.282+0000 7f7d52ffd640 1 -- 172.21.15.177:0/2631755376 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7d4c0ea650 con 0x7f7d5c13dd90 2023-11-28T20:08:40.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.434+0000 7f7d643c4640 1 -- 172.21.15.177:0/2631755376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d5c069440 con 0x7f7d5c13dd90 2023-11-28T20:08:40.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.438+0000 7f7d52ffd640 1 -- 172.21.15.177:0/2631755376 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16642 (secure 0 0 0) 0x7f7d4c0edc70 con 0x7f7d5c13dd90 2023-11-28T20:08:40.439 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:40.439 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":32,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:39.404876+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:08:37.943771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T20:08:38.396895+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:40.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.438+0000 7f7d643c4640 1 -- 172.21.15.177:0/2631755376 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7d40066470 msgr2=0x7f7d40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.438+0000 7f7d643c4640 1 --2- 172.21.15.177:0/2631755376 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7d40066470 0x7f7d40068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009be0 tx=0x7f7d58009190 comp rx=0 tx=0).stop 2023-11-28T20:08:40.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.438+0000 7f7d643c4640 1 -- 172.21.15.177:0/2631755376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d5c13dd90 msgr2=0x7f7d5c160dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.438+0000 7f7d643c4640 1 --2- 172.21.15.177:0/2631755376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d5c13dd90 0x7f7d5c160dd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00c190 tx=0x7f7d48005800 comp rx=0 tx=0).stop 2023-11-28T20:08:40.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.438+0000 7f7d643c4640 1 -- 172.21.15.177:0/2631755376 shutdown_connections 2023-11-28T20:08:40.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.438+0000 7f7d643c4640 1 --2- 172.21.15.177:0/2631755376 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7d40066470 0x7f7d40068930 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.438+0000 7f7d643c4640 1 --2- 172.21.15.177:0/2631755376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d5c161310 0x7f7d5c164f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.438+0000 7f7d643c4640 1 --2- 172.21.15.177:0/2631755376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d5c13dd90 0x7f7d5c160dd0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.438+0000 7f7d643c4640 1 --2- 172.21.15.177:0/2631755376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d48003ef0 0x7f7d5c0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.438+0000 7f7d643c4640 1 -- 172.21.15.177:0/2631755376 >> 172.21.15.177:0/2631755376 conn(0x7f7d5c06a530 msgr2=0x7f7d5c15f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:40.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.438+0000 7f7d643c4640 1 -- 172.21.15.177:0/2631755376 shutdown_connections 2023-11-28T20:08:40.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.438+0000 7f7d643c4640 1 -- 172.21.15.177:0/2631755376 wait complete. 2023-11-28T20:08:40.460 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:40.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe42099d640 1 Processor -- start 2023-11-28T20:08:40.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe42099d640 1 -- start start 2023-11-28T20:08:40.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe42099d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe41c13cf30 0x7fe41c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe42099d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe41c06c800 0x7fe41c15a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe42099d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe41c15ab70 0x7fe41c071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe42099d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c13d310 con 0x7fe41c13cf30 2023-11-28T20:08:40.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe42099d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c1404e0 con 0x7fe41c15ab70 2023-11-28T20:08:40.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe42099d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c15b3a0 con 0x7fe41c06c800 2023-11-28T20:08:40.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe41a59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe41c13cf30 0x7fe41c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe41a59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe41c13cf30 0x7fe41c06c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48080/0 (socket says 172.21.15.177:48080) 2023-11-28T20:08:40.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe41a59c640 1 -- 172.21.15.177:0/3749201514 learned_addr learned my addr 172.21.15.177:0/3749201514 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:40.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe41ad9d640 1 --2- 172.21.15.177:0/3749201514 >> v2:172.21.15.195:3300/0 conn(0x7fe41c15ab70 0x7fe41c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe419d9b640 1 --2- 172.21.15.177:0/3749201514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe41c06c800 0x7fe41c15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe41a59c640 1 -- 172.21.15.177:0/3749201514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe41c06c800 msgr2=0x7fe41c15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:40.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe41a59c640 1 --2- 172.21.15.177:0/3749201514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe41c06c800 0x7fe41c15a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe41a59c640 1 -- 172.21.15.177:0/3749201514 >> v2:172.21.15.195:3300/0 conn(0x7fe41c15ab70 msgr2=0x7fe41c071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:40.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe41a59c640 1 --2- 172.21.15.177:0/3749201514 >> v2:172.21.15.195:3300/0 conn(0x7fe41c15ab70 0x7fe41c071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.598+0000 7fe41a59c640 1 -- 172.21.15.177:0/3749201514 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c06cc40 con 0x7fe41c13cf30 2023-11-28T20:08:40.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.602+0000 7fe41a59c640 1 --2- 172.21.15.177:0/3749201514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe41c13cf30 0x7fe41c06c2c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe41c06d630 tx=0x7fe40c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c51b527bf7e70a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:40.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.602+0000 7fe41959a640 1 -- 172.21.15.177:0/3749201514 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0ab600 con 0x7fe41c13cf30 2023-11-28T20:08:40.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.602+0000 7fe41959a640 1 -- 172.21.15.177:0/3749201514 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c0ab760 con 0x7fe41c13cf30 2023-11-28T20:08:40.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.602+0000 7fe41959a640 1 -- 172.21.15.177:0/3749201514 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0abaf0 con 0x7fe41c13cf30 2023-11-28T20:08:40.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.602+0000 7fe42099d640 1 -- 172.21.15.177:0/3749201514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe41c13cf30 msgr2=0x7fe41c06c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.602+0000 7fe42099d640 1 --2- 172.21.15.177:0/3749201514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe41c13cf30 0x7fe41c06c2c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe41c06d630 tx=0x7fe40c01c440 comp rx=0 tx=0).stop 2023-11-28T20:08:40.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.602+0000 7fe42099d640 1 -- 172.21.15.177:0/3749201514 shutdown_connections 2023-11-28T20:08:40.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.602+0000 7fe42099d640 1 --2- 172.21.15.177:0/3749201514 >> v2:172.21.15.195:3300/0 conn(0x7fe41c15ab70 0x7fe41c071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.602+0000 7fe42099d640 1 --2- 172.21.15.177:0/3749201514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe41c06c800 0x7fe41c15a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.602+0000 7fe42099d640 1 --2- 172.21.15.177:0/3749201514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe41c13cf30 0x7fe41c06c2c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.602+0000 7fe42099d640 1 -- 172.21.15.177:0/3749201514 >> 172.21.15.177:0/3749201514 conn(0x7fe41c06a530 msgr2=0x7fe41c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:40.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.602+0000 7fe42099d640 1 -- 172.21.15.177:0/3749201514 shutdown_connections 2023-11-28T20:08:40.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.602+0000 7fe42099d640 1 -- 172.21.15.177:0/3749201514 wait complete. 2023-11-28T20:08:40.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe42099d640 1 Processor -- start 2023-11-28T20:08:40.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe42099d640 1 -- start start 2023-11-28T20:08:40.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe42099d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe41c06c800 0x7fe41c1532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe42099d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe41c13cf30 0x7fe41c1507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe42099d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe41c15ab70 0x7fe41c13b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe42099d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c1537f0 con 0x7fe41c13cf30 2023-11-28T20:08:40.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe42099d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c14fa70 con 0x7fe41c15ab70 2023-11-28T20:08:40.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe42099d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c14f660 con 0x7fe41c06c800 2023-11-28T20:08:40.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe419d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe41c13cf30 0x7fe41c1507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe419d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe41c13cf30 0x7fe41c1507f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48088/0 (socket says 172.21.15.177:48088) 2023-11-28T20:08:40.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe419d9b640 1 -- 172.21.15.177:0/3491800995 learned_addr learned my addr 172.21.15.177:0/3491800995 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:40.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe41ad9d640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe41c15ab70 0x7fe41c13b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe419d9b640 1 -- 172.21.15.177:0/3491800995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe41c06c800 msgr2=0x7fe41c1532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe41a59c640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe41c06c800 0x7fe41c1532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe419d9b640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe41c06c800 0x7fe41c1532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe419d9b640 1 -- 172.21.15.177:0/3491800995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe41c15ab70 msgr2=0x7fe41c13b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe419d9b640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe41c15ab70 0x7fe41c13b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe419d9b640 1 -- 172.21.15.177:0/3491800995 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c0094d0 con 0x7fe41c13cf30 2023-11-28T20:08:40.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe41ad9d640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe41c15ab70 0x7fe41c13b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:40.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe41a59c640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe41c06c800 0x7fe41c1532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:40.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe419d9b640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe41c13cf30 0x7fe41c1507f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe41000d5f0 tx=0x7fe41000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:40.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe40affd640 1 -- 172.21.15.177:0/3491800995 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4100125f0 con 0x7fe41c13cf30 2023-11-28T20:08:40.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe40affd640 1 -- 172.21.15.177:0/3491800995 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe410012750 con 0x7fe41c13cf30 2023-11-28T20:08:40.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe40affd640 1 -- 172.21.15.177:0/3491800995 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410012ae0 con 0x7fe41c13cf30 2023-11-28T20:08:40.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe42099d640 1 -- 172.21.15.177:0/3491800995 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c14fd10 con 0x7fe41c13cf30 2023-11-28T20:08:40.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.606+0000 7fe42099d640 1 -- 172.21.15.177:0/3491800995 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c1502d0 con 0x7fe41c13cf30 2023-11-28T20:08:40.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.610+0000 7fe42099d640 1 -- 172.21.15.177:0/3491800995 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c150490 con 0x7fe41c13cf30 2023-11-28T20:08:40.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.610+0000 7fe40affd640 1 -- 172.21.15.177:0/3491800995 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe410012c40 con 0x7fe41c13cf30 2023-11-28T20:08:40.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.610+0000 7fe40affd640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe3fc066470 0x7fe3fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.610+0000 7fe40affd640 1 -- 172.21.15.177:0/3491800995 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe410084310 con 0x7fe41c13cf30 2023-11-28T20:08:40.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.610+0000 7fe41a59c640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe3fc066470 0x7fe3fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.610+0000 7fe41a59c640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe3fc066470 0x7fe3fc068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0af000 tx=0x7fe40c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:40.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.614+0000 7fe40affd640 1 -- 172.21.15.177:0/3491800995 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe410051780 con 0x7fe41c13cf30 2023-11-28T20:08:40.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.766+0000 7fe42099d640 1 -- 172.21.15.177:0/3491800995 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe41c069440 con 0x7fe41c13cf30 2023-11-28T20:08:40.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.766+0000 7fe40affd640 1 -- 172.21.15.177:0/3491800995 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16642 (secure 0 0 0) 0x7fe410054da0 con 0x7fe41c13cf30 2023-11-28T20:08:40.768 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:40.768 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":32,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:39.404876+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:08:37.943771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T20:08:38.396895+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:40.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.766+0000 7fe42099d640 1 -- 172.21.15.177:0/3491800995 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe3fc066470 msgr2=0x7fe3fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.766+0000 7fe42099d640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe3fc066470 0x7fe3fc068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0af000 tx=0x7fe40c008040 comp rx=0 tx=0).stop 2023-11-28T20:08:40.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.766+0000 7fe42099d640 1 -- 172.21.15.177:0/3491800995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe41c13cf30 msgr2=0x7fe41c1507f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.766+0000 7fe42099d640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe41c13cf30 0x7fe41c1507f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe41000d5f0 tx=0x7fe41000dab0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.766+0000 7fe42099d640 1 -- 172.21.15.177:0/3491800995 shutdown_connections 2023-11-28T20:08:40.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.766+0000 7fe42099d640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe3fc066470 0x7fe3fc068930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.766+0000 7fe42099d640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe41c15ab70 0x7fe41c13b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.766+0000 7fe42099d640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe41c13cf30 0x7fe41c1507f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.766+0000 7fe42099d640 1 --2- 172.21.15.177:0/3491800995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe41c06c800 0x7fe41c1532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.766+0000 7fe42099d640 1 -- 172.21.15.177:0/3491800995 >> 172.21.15.177:0/3491800995 conn(0x7fe41c06a530 msgr2=0x7fe41c0b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:40.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.766+0000 7fe42099d640 1 -- 172.21.15.177:0/3491800995 shutdown_connections 2023-11-28T20:08:40.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.766+0000 7fe42099d640 1 -- 172.21.15.177:0/3491800995 wait complete. 2023-11-28T20:08:40.789 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T20:08:40.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.930+0000 7f0db132a640 1 Processor -- start 2023-11-28T20:08:40.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.930+0000 7f0db132a640 1 -- start start 2023-11-28T20:08:40.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.930+0000 7f0db132a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0dac071d90 0x7f0dac072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.930+0000 7f0db132a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac13d2b0 con 0x7f0dac13f5f0 2023-11-28T20:08:40.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.930+0000 7f0db132a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac0cdd70 con 0x7f0dac15adb0 2023-11-28T20:08:40.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.930+0000 7f0db132a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dac140520 con 0x7f0dac071d90 2023-11-28T20:08:40.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.930+0000 7f0daaffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0dac071d90 0x7f0dac072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.930+0000 7f0daaffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0dac071d90 0x7f0dac072170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48102/0 (socket says 172.21.15.177:48102) 2023-11-28T20:08:40.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.930+0000 7f0dab7fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f0dac13f5f0 0x7f0dac0ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:57234/0 (socket says 172.21.15.177:57234) 2023-11-28T20:08:40.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.930+0000 7f0daaffd640 1 -- 172.21.15.177:0/2696943341 learned_addr learned my addr 172.21.15.177:0/2696943341 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:40.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.930+0000 7f0daaffd640 1 -- 172.21.15.177:0/2696943341 >> v1:172.21.15.195:6789/0 conn(0x7f0dac15adb0 legacy=0x7f0dac13d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.930+0000 7f0daaffd640 1 -- 172.21.15.177:0/2696943341 >> v1:172.21.15.177:6789/0 conn(0x7f0dac13f5f0 legacy=0x7f0dac0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.930+0000 7f0daaffd640 1 -- 172.21.15.177:0/2696943341 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac0726b0 con 0x7f0dac071d90 2023-11-28T20:08:40.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.934+0000 7f0daaffd640 1 --2- 172.21.15.177:0/2696943341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dac071d90 0x7f0dac072170 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c009e50 tx=0x7f0d9c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d7fed60bd8de9f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:40.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.934+0000 7f0daa7fc640 1 -- 172.21.15.177:0/2696943341 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0a57d0 con 0x7f0dac071d90 2023-11-28T20:08:40.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.934+0000 7f0daa7fc640 1 -- 172.21.15.177:0/2696943341 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c0a5930 con 0x7f0dac071d90 2023-11-28T20:08:40.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.934+0000 7f0daa7fc640 1 -- 172.21.15.177:0/2696943341 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0a5cc0 con 0x7f0dac071d90 2023-11-28T20:08:40.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.934+0000 7f0db132a640 1 -- 172.21.15.177:0/2696943341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dac071d90 msgr2=0x7f0dac072170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.934+0000 7f0db132a640 1 --2- 172.21.15.177:0/2696943341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dac071d90 0x7f0dac072170 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c009e50 tx=0x7f0d9c01ca10 comp rx=0 tx=0).stop 2023-11-28T20:08:40.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.934+0000 7f0db132a640 1 -- 172.21.15.177:0/2696943341 shutdown_connections 2023-11-28T20:08:40.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.934+0000 7f0db132a640 1 --2- 172.21.15.177:0/2696943341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dac071d90 0x7f0dac072170 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.934+0000 7f0db132a640 1 -- 172.21.15.177:0/2696943341 >> 172.21.15.177:0/2696943341 conn(0x7f0dac0b0cc0 msgr2=0x7f0dac0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:40.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.934+0000 7f0db132a640 1 -- 172.21.15.177:0/2696943341 shutdown_connections 2023-11-28T20:08:40.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.934+0000 7f0db132a640 1 -- 172.21.15.177:0/2696943341 wait complete. 2023-11-28T20:08:40.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.934+0000 7f0db132a640 1 Processor -- start 2023-11-28T20:08:40.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.934+0000 7f0db132a640 1 -- start start 2023-11-28T20:08:40.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0db132a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dac071d90 0x7f0dac0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0db132a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dac13f5f0 0x7f0dac14e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0db132a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0dac15adb0 0x7f0dac0b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0db132a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0b22a0 con 0x7f0dac13f5f0 2023-11-28T20:08:40.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0db132a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac13adf0 con 0x7f0dac071d90 2023-11-28T20:08:40.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0db132a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac150140 con 0x7f0dac15adb0 2023-11-28T20:08:40.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0da27fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dac13f5f0 0x7f0dac14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0da27fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dac13f5f0 0x7f0dac14e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48118/0 (socket says 172.21.15.177:48118) 2023-11-28T20:08:40.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0da27fc640 1 -- 172.21.15.177:0/2352854123 learned_addr learned my addr 172.21.15.177:0/2352854123 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:40.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0daaffd640 1 --2- 172.21.15.177:0/2352854123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dac071d90 0x7f0dac0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0dab7fe640 1 --2- 172.21.15.177:0/2352854123 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0dac15adb0 0x7f0dac0b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0da27fc640 1 -- 172.21.15.177:0/2352854123 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0dac15adb0 msgr2=0x7f0dac0b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0da27fc640 1 --2- 172.21.15.177:0/2352854123 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0dac15adb0 0x7f0dac0b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0da27fc640 1 -- 172.21.15.177:0/2352854123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dac071d90 msgr2=0x7f0dac0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:40.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0da27fc640 1 --2- 172.21.15.177:0/2352854123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dac071d90 0x7f0dac0b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:40.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0da27fc640 1 -- 172.21.15.177:0/2352854123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c009b30 con 0x7f0dac13f5f0 2023-11-28T20:08:40.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0da27fc640 1 --2- 172.21.15.177:0/2352854123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dac13f5f0 0x7f0dac14e910 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400c500 tx=0x7f0d9400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:40.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0da3fff640 1 -- 172.21.15.177:0/2352854123 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94005220 con 0x7f0dac13f5f0 2023-11-28T20:08:40.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0da3fff640 1 -- 172.21.15.177:0/2352854123 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d94005380 con 0x7f0dac13f5f0 2023-11-28T20:08:40.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0db132a640 1 -- 172.21.15.177:0/2352854123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dac150420 con 0x7f0dac13f5f0 2023-11-28T20:08:40.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0da3fff640 1 -- 172.21.15.177:0/2352854123 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94007270 con 0x7f0dac13f5f0 2023-11-28T20:08:40.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0db132a640 1 -- 172.21.15.177:0/2352854123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac13b390 con 0x7f0dac13f5f0 2023-11-28T20:08:40.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.938+0000 7f0db132a640 1 -- 172.21.15.177:0/2352854123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac13b5b0 con 0x7f0dac13f5f0 2023-11-28T20:08:40.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.942+0000 7f0da3fff640 1 -- 172.21.15.177:0/2352854123 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0d940073d0 con 0x7f0dac13f5f0 2023-11-28T20:08:40.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.942+0000 7f0da3fff640 1 --2- 172.21.15.177:0/2352854123 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d8c066470 0x7f0d8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:40.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.942+0000 7f0da3fff640 1 -- 172.21.15.177:0/2352854123 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d94083780 con 0x7f0dac13f5f0 2023-11-28T20:08:40.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.942+0000 7f0daaffd640 1 --2- 172.21.15.177:0/2352854123 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d8c066470 0x7f0d8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:40.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.942+0000 7f0daaffd640 1 --2- 172.21.15.177:0/2352854123 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d8c066470 0x7f0d8c068930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0ae000 tx=0x7f0d9c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:40.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:40.946+0000 7f0da3fff640 1 -- 172.21.15.177:0/2352854123 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0d94050b70 con 0x7f0dac13f5f0 2023-11-28T20:08:41.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:41.134+0000 7f0db132a640 1 -- 172.21.15.177:0/2352854123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0dac0693d0 con 0x7f0dac13f5f0 2023-11-28T20:08:42.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.050+0000 7f0da3fff640 1 -- 172.21.15.177:0/2352854123 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0d94054190 con 0x7f0dac13f5f0 2023-11-28T20:08:42.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.050+0000 7f0db132a640 1 -- 172.21.15.177:0/2352854123 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d8c066470 msgr2=0x7f0d8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:42.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.050+0000 7f0db132a640 1 --2- 172.21.15.177:0/2352854123 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d8c066470 0x7f0d8c068930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0ae000 tx=0x7f0d9c0a7070 comp rx=0 tx=0).stop 2023-11-28T20:08:42.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.050+0000 7f0db132a640 1 -- 172.21.15.177:0/2352854123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dac13f5f0 msgr2=0x7f0dac14e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:42.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.050+0000 7f0db132a640 1 --2- 172.21.15.177:0/2352854123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dac13f5f0 0x7f0dac14e910 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400c500 tx=0x7f0d9400c9c0 comp rx=0 tx=0).stop 2023-11-28T20:08:42.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.054+0000 7f0db132a640 1 -- 172.21.15.177:0/2352854123 shutdown_connections 2023-11-28T20:08:42.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.054+0000 7f0db132a640 1 --2- 172.21.15.177:0/2352854123 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d8c066470 0x7f0d8c068930 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:42.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.054+0000 7f0db132a640 1 --2- 172.21.15.177:0/2352854123 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0dac15adb0 0x7f0dac0b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:42.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.054+0000 7f0db132a640 1 --2- 172.21.15.177:0/2352854123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dac13f5f0 0x7f0dac14e910 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:42.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.054+0000 7f0db132a640 1 --2- 172.21.15.177:0/2352854123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dac071d90 0x7f0dac0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:42.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.054+0000 7f0db132a640 1 -- 172.21.15.177:0/2352854123 >> 172.21.15.177:0/2352854123 conn(0x7f0dac0b0cc0 msgr2=0x7f0dac136b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:42.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.054+0000 7f0db132a640 1 -- 172.21.15.177:0/2352854123 shutdown_connections 2023-11-28T20:08:42.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.054+0000 7f0db132a640 1 -- 172.21.15.177:0/2352854123 wait complete. 2023-11-28T20:08:42.077 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T20:08:42.077 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T20:08:42.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.218+0000 7fb25e854640 1 Processor -- start 2023-11-28T20:08:42.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.218+0000 7fb25e854640 1 -- start start 2023-11-28T20:08:42.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb25e854640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb258158ca0 0x7fb25815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:42.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb25e854640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb2580cba10 0x7fb25815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:42.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb25e854640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb25815b670 con 0x7fb2580b42d0 2023-11-28T20:08:42.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb25e854640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25815f410 con 0x7fb2580cba10 2023-11-28T20:08:42.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb25e854640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25815f6f0 con 0x7fb258158ca0 2023-11-28T20:08:42.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb25cdf1640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fb2580b42d0 0x7fb2580703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:57250/0 (socket says 172.21.15.177:57250) 2023-11-28T20:08:42.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb2577fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb2580cba10 0x7fb25815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:42.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb25cdf1640 1 -- 172.21.15.177:0/1997296215 learned_addr learned my addr 172.21.15.177:0/1997296215 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:42.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb257fff640 1 --2- 172.21.15.177:0/1997296215 >> v2:172.21.15.195:3300/0 conn(0x7fb258158ca0 0x7fb25815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:42.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb2577fe640 1 -- 172.21.15.177:0/1997296215 >> v2:172.21.15.195:3300/0 conn(0x7fb258158ca0 msgr2=0x7fb25815eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:42.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb2577fe640 1 --2- 172.21.15.177:0/1997296215 >> v2:172.21.15.195:3300/0 conn(0x7fb258158ca0 0x7fb25815eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:42.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb2577fe640 1 -- 172.21.15.177:0/1997296215 >> v1:172.21.15.177:6789/0 conn(0x7fb2580b42d0 legacy=0x7fb2580703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:42.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb2577fe640 1 -- 172.21.15.177:0/1997296215 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25815b8e0 con 0x7fb2580cba10 2023-11-28T20:08:42.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb256ffd640 1 -- 172.21.15.177:0/1997296215 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042346755 0 0) 0x7fb25815b670 con 0x7fb2580b42d0 2023-11-28T20:08:42.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb2577fe640 1 --2- 172.21.15.177:0/1997296215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2580cba10 0x7fb25815be00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb258067f70 tx=0x7fb24c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d44cdba6b43cb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:42.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb256ffd640 1 -- 172.21.15.177:0/1997296215 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c0ab680 con 0x7fb2580cba10 2023-11-28T20:08:42.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb256ffd640 1 -- 172.21.15.177:0/1997296215 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c0ab7e0 con 0x7fb2580cba10 2023-11-28T20:08:42.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.222+0000 7fb256ffd640 1 -- 172.21.15.177:0/1997296215 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c0abb70 con 0x7fb2580cba10 2023-11-28T20:08:42.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 -- 172.21.15.177:0/1997296215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2580cba10 msgr2=0x7fb25815be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:42.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 --2- 172.21.15.177:0/1997296215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2580cba10 0x7fb25815be00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb258067f70 tx=0x7fb24c01c460 comp rx=0 tx=0).stop 2023-11-28T20:08:42.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 -- 172.21.15.177:0/1997296215 shutdown_connections 2023-11-28T20:08:42.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 --2- 172.21.15.177:0/1997296215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2580cba10 0x7fb25815be00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:42.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 --2- 172.21.15.177:0/1997296215 >> v2:172.21.15.195:3300/0 conn(0x7fb258158ca0 0x7fb25815eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:42.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 -- 172.21.15.177:0/1997296215 >> 172.21.15.177:0/1997296215 conn(0x7fb2580b0cc0 msgr2=0x7fb2580b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:42.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 -- 172.21.15.177:0/1997296215 shutdown_connections 2023-11-28T20:08:42.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 -- 172.21.15.177:0/1997296215 wait complete. 2023-11-28T20:08:42.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 Processor -- start 2023-11-28T20:08:42.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 -- start start 2023-11-28T20:08:42.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2580b42d0 0x7fb258148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:42.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2580cba10 0x7fb25814a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:42.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb258158ca0 0x7fb258164090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:42.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25814b4e0 con 0x7fb2580b42d0 2023-11-28T20:08:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25815afd0 con 0x7fb2580cba10 2023-11-28T20:08:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb25e854640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb258159cf0 con 0x7fb258158ca0 2023-11-28T20:08:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb257fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2580b42d0 0x7fb258148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb257fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2580b42d0 0x7fb258148b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48144/0 (socket says 172.21.15.177:48144) 2023-11-28T20:08:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.226+0000 7fb257fff640 1 -- 172.21.15.177:0/1117471947 learned_addr learned my addr 172.21.15.177:0/1117471947 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb2577fe640 1 --2- 172.21.15.177:0/1117471947 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2580cba10 0x7fb25814a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb25cdf1640 1 --2- 172.21.15.177:0/1117471947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb258158ca0 0x7fb258164090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb257fff640 1 -- 172.21.15.177:0/1117471947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb258158ca0 msgr2=0x7fb258164090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb257fff640 1 --2- 172.21.15.177:0/1117471947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb258158ca0 0x7fb258164090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb257fff640 1 -- 172.21.15.177:0/1117471947 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2580cba10 msgr2=0x7fb25814a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb257fff640 1 --2- 172.21.15.177:0/1117471947 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2580cba10 0x7fb25814a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb257fff640 1 -- 172.21.15.177:0/1117471947 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c009420 con 0x7fb2580b42d0 2023-11-28T20:08:42.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb25cdf1640 1 --2- 172.21.15.177:0/1117471947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb258158ca0 0x7fb258164090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:42.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb257fff640 1 --2- 172.21.15.177:0/1117471947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2580b42d0 0x7fb258148b10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb24800d5f0 tx=0x7fb24800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:42.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb254ff9640 1 -- 172.21.15.177:0/1117471947 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2480125f0 con 0x7fb2580b42d0 2023-11-28T20:08:42.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb254ff9640 1 -- 172.21.15.177:0/1117471947 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb248012750 con 0x7fb2580b42d0 2023-11-28T20:08:42.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb25e854640 1 -- 172.21.15.177:0/1117471947 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb258149da0 con 0x7fb2580b42d0 2023-11-28T20:08:42.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb254ff9640 1 -- 172.21.15.177:0/1117471947 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248012ae0 con 0x7fb2580b42d0 2023-11-28T20:08:42.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb25e854640 1 -- 172.21.15.177:0/1117471947 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25815a270 con 0x7fb2580b42d0 2023-11-28T20:08:42.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb25e854640 1 -- 172.21.15.177:0/1117471947 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2580693d0 con 0x7fb2580b42d0 2023-11-28T20:08:42.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb254ff9640 1 -- 172.21.15.177:0/1117471947 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb248012c40 con 0x7fb2580b42d0 2023-11-28T20:08:42.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb254ff9640 1 --2- 172.21.15.177:0/1117471947 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb244066470 0x7fb244068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:42.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb254ff9640 1 -- 172.21.15.177:0/1117471947 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2480842d0 con 0x7fb2580b42d0 2023-11-28T20:08:42.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.230+0000 7fb2577fe640 1 --2- 172.21.15.177:0/1117471947 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb244066470 0x7fb244068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:42.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.234+0000 7fb2577fe640 1 --2- 172.21.15.177:0/1117471947 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb244066470 0x7fb244068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0af000 tx=0x7fb24c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:42.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.234+0000 7fb254ff9640 1 -- 172.21.15.177:0/1117471947 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb248051740 con 0x7fb2580b42d0 2023-11-28T20:08:42.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:42.418+0000 7fb25e854640 1 -- 172.21.15.177:0/1117471947 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb2580674d0 con 0x7fb2580b42d0 2023-11-28T20:08:43.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.250+0000 7fb254ff9640 1 -- 172.21.15.177:0/1117471947 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb248007380 con 0x7fb2580b42d0 2023-11-28T20:08:43.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.250+0000 7fb25e854640 1 -- 172.21.15.177:0/1117471947 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb244066470 msgr2=0x7fb244068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:43.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.250+0000 7fb25e854640 1 --2- 172.21.15.177:0/1117471947 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb244066470 0x7fb244068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0af000 tx=0x7fb24c0a7000 comp rx=0 tx=0).stop 2023-11-28T20:08:43.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.250+0000 7fb25e854640 1 -- 172.21.15.177:0/1117471947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2580b42d0 msgr2=0x7fb258148b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:43.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.250+0000 7fb25e854640 1 --2- 172.21.15.177:0/1117471947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2580b42d0 0x7fb258148b10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb24800d5f0 tx=0x7fb24800dab0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.250+0000 7fb25e854640 1 -- 172.21.15.177:0/1117471947 shutdown_connections 2023-11-28T20:08:43.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.250+0000 7fb25e854640 1 --2- 172.21.15.177:0/1117471947 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb244066470 0x7fb244068930 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.250+0000 7fb25e854640 1 --2- 172.21.15.177:0/1117471947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb258158ca0 0x7fb258164090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.250+0000 7fb25e854640 1 --2- 172.21.15.177:0/1117471947 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2580cba10 0x7fb25814a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.250+0000 7fb25e854640 1 --2- 172.21.15.177:0/1117471947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2580b42d0 0x7fb258148b10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.250+0000 7fb25e854640 1 -- 172.21.15.177:0/1117471947 >> 172.21.15.177:0/1117471947 conn(0x7fb2580b0cc0 msgr2=0x7fb2580b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:43.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.250+0000 7fb25e854640 1 -- 172.21.15.177:0/1117471947 shutdown_connections 2023-11-28T20:08:43.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.250+0000 7fb25e854640 1 -- 172.21.15.177:0/1117471947 wait complete. 2023-11-28T20:08:43.274 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T20:08:43.274 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:08:43.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.410+0000 7fea00217640 1 Processor -- start 2023-11-28T20:08:43.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.410+0000 7fea00217640 1 -- start start 2023-11-28T20:08:43.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.410+0000 7fea00217640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe9f806c9d0 0x7fe9f8145250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:43.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.410+0000 7fea00217640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f8145fc0 con 0x7fe9f815c070 2023-11-28T20:08:43.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.410+0000 7fea00217640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f81462a0 con 0x7fe9f815bc90 2023-11-28T20:08:43.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.410+0000 7fea00217640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f8146580 con 0x7fe9f806c9d0 2023-11-28T20:08:43.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.410+0000 7fe9fe7b4640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe9f815c070 0x7fe9f8145790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:57266/0 (socket says 172.21.15.177:57266) 2023-11-28T20:08:43.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.410+0000 7fe9fe7b4640 1 -- 172.21.15.177:0/475334372 learned_addr learned my addr 172.21.15.177:0/475334372 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:43.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.414+0000 7fe9fd7b2640 1 --2- 172.21.15.177:0/475334372 >> v2:172.21.15.195:3300/0 conn(0x7fe9f806c9d0 0x7fe9f8145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:43.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.414+0000 7fe9fcfb1640 1 -- 172.21.15.177:0/475334372 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644475867 0 0) 0x7fe9f8145fc0 con 0x7fe9f815c070 2023-11-28T20:08:43.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.414+0000 7fe9fcfb1640 1 -- 172.21.15.177:0/475334372 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e4003530 con 0x7fe9f815c070 2023-11-28T20:08:43.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.414+0000 7fe9fcfb1640 1 -- 172.21.15.177:0/475334372 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991790228 0 0) 0x7fe9f81462a0 con 0x7fe9f815bc90 2023-11-28T20:08:43.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.414+0000 7fe9fcfb1640 1 -- 172.21.15.177:0/475334372 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f8145fc0 con 0x7fe9f815bc90 2023-11-28T20:08:43.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.414+0000 7fe9fd7b2640 1 -- 172.21.15.177:0/475334372 >> v1:172.21.15.195:6789/0 conn(0x7fe9f815bc90 legacy=0x7fe9f806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:43.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.414+0000 7fe9fd7b2640 1 -- 172.21.15.177:0/475334372 >> v1:172.21.15.177:6789/0 conn(0x7fe9f815c070 legacy=0x7fe9f8145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:43.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.414+0000 7fe9fd7b2640 1 -- 172.21.15.177:0/475334372 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8146860 con 0x7fe9f806c9d0 2023-11-28T20:08:43.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.414+0000 7fe9fd7b2640 1 --2- 172.21.15.177:0/475334372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9f806c9d0 0x7fe9f8145250 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80097f0 tx=0x7fe9e801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=156a0f53f680c1e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:43.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fe9fcfb1640 1 -- 172.21.15.177:0/475334372 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80ac640 con 0x7fe9f806c9d0 2023-11-28T20:08:43.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fe9fcfb1640 1 -- 172.21.15.177:0/475334372 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e80ac7a0 con 0x7fe9f806c9d0 2023-11-28T20:08:43.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fe9fcfb1640 1 -- 172.21.15.177:0/475334372 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80acb30 con 0x7fe9f806c9d0 2023-11-28T20:08:43.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fea00217640 1 -- 172.21.15.177:0/475334372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9f806c9d0 msgr2=0x7fe9f8145250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:43.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fea00217640 1 --2- 172.21.15.177:0/475334372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9f806c9d0 0x7fe9f8145250 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80097f0 tx=0x7fe9e801c3c0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fea00217640 1 -- 172.21.15.177:0/475334372 shutdown_connections 2023-11-28T20:08:43.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fea00217640 1 --2- 172.21.15.177:0/475334372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9f806c9d0 0x7fe9f8145250 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fea00217640 1 -- 172.21.15.177:0/475334372 >> 172.21.15.177:0/475334372 conn(0x7fe9f806a530 msgr2=0x7fe9f806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:43.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fea00217640 1 -- 172.21.15.177:0/475334372 shutdown_connections 2023-11-28T20:08:43.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fea00217640 1 -- 172.21.15.177:0/475334372 wait complete. 2023-11-28T20:08:43.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fea00217640 1 Processor -- start 2023-11-28T20:08:43.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fea00217640 1 -- start start 2023-11-28T20:08:43.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fea00217640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9f806c9d0 0x7fe9f813cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:43.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fea00217640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9f815bc90 0x7fe9f8143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:43.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fea00217640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9f815c070 0x7fe9f80aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:43.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fea00217640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f815b020 con 0x7fe9f806c9d0 2023-11-28T20:08:43.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fea00217640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f815aa90 con 0x7fe9f815c070 2023-11-28T20:08:43.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.418+0000 7fea00217640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f81599f0 con 0x7fe9f815bc90 2023-11-28T20:08:43.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fe9fdfb3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9f806c9d0 0x7fe9f813cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:43.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fe9fdfb3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9f806c9d0 0x7fe9f813cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48154/0 (socket says 172.21.15.177:48154) 2023-11-28T20:08:43.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fe9fdfb3640 1 -- 172.21.15.177:0/1084448934 learned_addr learned my addr 172.21.15.177:0/1084448934 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:43.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fe9fe7b4640 1 --2- 172.21.15.177:0/1084448934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9f815c070 0x7fe9f80aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:43.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fe9fd7b2640 1 --2- 172.21.15.177:0/1084448934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9f815bc90 0x7fe9f8143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:43.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fe9fdfb3640 1 -- 172.21.15.177:0/1084448934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9f815bc90 msgr2=0x7fe9f8143530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:43.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fe9fdfb3640 1 --2- 172.21.15.177:0/1084448934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9f815bc90 0x7fe9f8143530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fe9fdfb3640 1 -- 172.21.15.177:0/1084448934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9f815c070 msgr2=0x7fe9f80aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:43.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fe9fdfb3640 1 --2- 172.21.15.177:0/1084448934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9f815c070 0x7fe9f80aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fe9fdfb3640 1 -- 172.21.15.177:0/1084448934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e8009420 con 0x7fe9f806c9d0 2023-11-28T20:08:43.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fe9fdfb3640 1 --2- 172.21.15.177:0/1084448934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9f806c9d0 0x7fe9f813cfc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400c490 tx=0x7fe9f400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:43.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fe9ee7fc640 1 -- 172.21.15.177:0/1084448934 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40052d0 con 0x7fe9f806c9d0 2023-11-28T20:08:43.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fe9ee7fc640 1 -- 172.21.15.177:0/1084448934 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f4005430 con 0x7fe9f806c9d0 2023-11-28T20:08:43.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fe9ee7fc640 1 -- 172.21.15.177:0/1084448934 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4012870 con 0x7fe9f806c9d0 2023-11-28T20:08:43.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fea00217640 1 -- 172.21.15.177:0/1084448934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f8159cd0 con 0x7fe9f806c9d0 2023-11-28T20:08:43.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fea00217640 1 -- 172.21.15.177:0/1084448934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f815a290 con 0x7fe9f806c9d0 2023-11-28T20:08:43.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fea00217640 1 -- 172.21.15.177:0/1084448934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f8069440 con 0x7fe9f806c9d0 2023-11-28T20:08:43.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.422+0000 7fe9ee7fc640 1 -- 172.21.15.177:0/1084448934 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe9f40129d0 con 0x7fe9f806c9d0 2023-11-28T20:08:43.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.426+0000 7fe9ee7fc640 1 --2- 172.21.15.177:0/1084448934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe9dc0664a0 0x7fe9dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:43.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.426+0000 7fe9ee7fc640 1 -- 172.21.15.177:0/1084448934 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9f4083990 con 0x7fe9f806c9d0 2023-11-28T20:08:43.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.426+0000 7fe9fd7b2640 1 --2- 172.21.15.177:0/1084448934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe9dc0664a0 0x7fe9dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:43.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.426+0000 7fe9fd7b2640 1 --2- 172.21.15.177:0/1084448934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe9dc0664a0 0x7fe9dc068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80ae000 tx=0x7fe9e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:43.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.430+0000 7fe9ee7fc640 1 -- 172.21.15.177:0/1084448934 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe9f4050e20 con 0x7fe9f806c9d0 2023-11-28T20:08:43.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.614+0000 7fea00217640 1 -- 172.21.15.177:0/1084448934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9f8140b50 con 0x7fe9f806c9d0 2023-11-28T20:08:43.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.614+0000 7fe9ee7fc640 1 -- 172.21.15.177:0/1084448934 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fe9f4054440 con 0x7fe9f806c9d0 2023-11-28T20:08:43.616 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:43.616 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2829857708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2829857708},{"type":"v1","addr":"172.21.15.177:6836","nonce":2829857708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5101,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/916709103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":916709103},{"type":"v1","addr":"172.21.15.195:6834","nonce":916709103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1987123637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1987123637},{"type":"v1","addr":"172.21.15.195:6835","nonce":1987123637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:08:39.405256+0000","modified":"2023-11-28T20:08:42.420072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/3143070912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":3143070912},{"type":"v1","addr":"172.21.15.177:6837","nonce":3143070912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T20:08:43.616 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 17 2023-11-28T20:08:43.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.614+0000 7fea00217640 1 -- 172.21.15.177:0/1084448934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe9dc0664a0 msgr2=0x7fe9dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:43.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.614+0000 7fea00217640 1 --2- 172.21.15.177:0/1084448934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe9dc0664a0 0x7fe9dc068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80ae000 tx=0x7fe9e8008040 comp rx=0 tx=0).stop 2023-11-28T20:08:43.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.614+0000 7fea00217640 1 -- 172.21.15.177:0/1084448934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9f806c9d0 msgr2=0x7fe9f813cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:43.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.614+0000 7fea00217640 1 --2- 172.21.15.177:0/1084448934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9f806c9d0 0x7fe9f813cfc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400c490 tx=0x7fe9f400c950 comp rx=0 tx=0).stop 2023-11-28T20:08:43.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.614+0000 7fea00217640 1 -- 172.21.15.177:0/1084448934 shutdown_connections 2023-11-28T20:08:43.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.614+0000 7fea00217640 1 --2- 172.21.15.177:0/1084448934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe9dc0664a0 0x7fe9dc068960 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.614+0000 7fea00217640 1 --2- 172.21.15.177:0/1084448934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9f815c070 0x7fe9f80aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.614+0000 7fea00217640 1 --2- 172.21.15.177:0/1084448934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9f815bc90 0x7fe9f8143530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.614+0000 7fea00217640 1 --2- 172.21.15.177:0/1084448934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9f806c9d0 0x7fe9f813cfc0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.614+0000 7fea00217640 1 -- 172.21.15.177:0/1084448934 >> 172.21.15.177:0/1084448934 conn(0x7fe9f806a530 msgr2=0x7fe9f80af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:43.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.614+0000 7fea00217640 1 -- 172.21.15.177:0/1084448934 shutdown_connections 2023-11-28T20:08:43.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.614+0000 7fea00217640 1 -- 172.21.15.177:0/1084448934 wait complete. 2023-11-28T20:08:43.638 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:43.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc932f9d640 1 Processor -- start 2023-11-28T20:08:43.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc932f9d640 1 -- start start 2023-11-28T20:08:43.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc932f9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc92c0b35b0 0x7fc92c0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:43.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc932f9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92c0cfe90 0x7fc92c15f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:43.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc932f9d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92c0d3880 con 0x7fc92c0b3c70 2023-11-28T20:08:43.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc932f9d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92c0d4090 con 0x7fc92c0b35b0 2023-11-28T20:08:43.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc932f9d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c0cdc80 con 0x7fc92c0cfe90 2023-11-28T20:08:43.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc93153a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92c0cfe90 0x7fc92c15f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:43.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc923fff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fc92c0b3c70 0x7fc92c0cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:57806/0 (socket says 172.21.15.177:57806) 2023-11-28T20:08:43.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc923fff640 1 -- 172.21.15.177:0/3037929378 learned_addr learned my addr 172.21.15.177:0/3037929378 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:43.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc930d39640 1 --2- 172.21.15.177:0/3037929378 >> v2:172.21.15.195:3300/0 conn(0x7fc92c0b35b0 0x7fc92c0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:43.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc93153a640 1 -- 172.21.15.177:0/3037929378 >> v2:172.21.15.195:3300/0 conn(0x7fc92c0b35b0 msgr2=0x7fc92c0d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:43.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc93153a640 1 --2- 172.21.15.177:0/3037929378 >> v2:172.21.15.195:3300/0 conn(0x7fc92c0b35b0 0x7fc92c0d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc93153a640 1 -- 172.21.15.177:0/3037929378 >> v1:172.21.15.195:6789/0 conn(0x7fc92c0b3c70 legacy=0x7fc92c0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:43.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc9237fe640 1 -- 172.21.15.177:0/3037929378 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110148030 0 0) 0x7fc92c0d3880 con 0x7fc92c0b3c70 2023-11-28T20:08:43.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.774+0000 7fc93153a640 1 -- 172.21.15.177:0/3037929378 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c0d3ad0 con 0x7fc92c0cfe90 2023-11-28T20:08:43.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.778+0000 7fc93153a640 1 --2- 172.21.15.177:0/3037929378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92c0cfe90 0x7fc92c15f060 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc924009d90 tx=0x7fc92401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c6028326c5ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:43.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.778+0000 7fc9237fe640 1 -- 172.21.15.177:0/3037929378 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9240a5a10 con 0x7fc92c0cfe90 2023-11-28T20:08:43.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.778+0000 7fc9237fe640 1 -- 172.21.15.177:0/3037929378 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9240a5b70 con 0x7fc92c0cfe90 2023-11-28T20:08:43.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.778+0000 7fc9237fe640 1 -- 172.21.15.177:0/3037929378 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9240ad440 con 0x7fc92c0cfe90 2023-11-28T20:08:43.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.778+0000 7fc932f9d640 1 -- 172.21.15.177:0/3037929378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92c0cfe90 msgr2=0x7fc92c15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:43.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.778+0000 7fc932f9d640 1 --2- 172.21.15.177:0/3037929378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92c0cfe90 0x7fc92c15f060 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc924009d90 tx=0x7fc92401c950 comp rx=0 tx=0).stop 2023-11-28T20:08:43.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.778+0000 7fc932f9d640 1 -- 172.21.15.177:0/3037929378 shutdown_connections 2023-11-28T20:08:43.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.778+0000 7fc932f9d640 1 --2- 172.21.15.177:0/3037929378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92c0cfe90 0x7fc92c15f060 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.778+0000 7fc932f9d640 1 --2- 172.21.15.177:0/3037929378 >> v2:172.21.15.195:3300/0 conn(0x7fc92c0b35b0 0x7fc92c0d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.778+0000 7fc932f9d640 1 -- 172.21.15.177:0/3037929378 >> 172.21.15.177:0/3037929378 conn(0x7fc92c09c4b0 msgr2=0x7fc92c0d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:43.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.778+0000 7fc932f9d640 1 -- 172.21.15.177:0/3037929378 shutdown_connections 2023-11-28T20:08:43.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.778+0000 7fc932f9d640 1 -- 172.21.15.177:0/3037929378 wait complete. 2023-11-28T20:08:43.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc932f9d640 1 Processor -- start 2023-11-28T20:08:43.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc932f9d640 1 -- start start 2023-11-28T20:08:43.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc932f9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc92c0b35b0 0x7fc92c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:43.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc932f9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92c0b3c70 0x7fc92c154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:43.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc932f9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc92c0cfe90 0x7fc92c06be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:43.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc932f9d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c156230 con 0x7fc92c0cfe90 2023-11-28T20:08:43.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc932f9d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c15b500 con 0x7fc92c0b35b0 2023-11-28T20:08:43.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc932f9d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c15b7e0 con 0x7fc92c0b3c70 2023-11-28T20:08:43.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc93153a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc92c0cfe90 0x7fc92c06be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:43.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc93153a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc92c0cfe90 0x7fc92c06be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48158/0 (socket says 172.21.15.177:48158) 2023-11-28T20:08:43.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc93153a640 1 -- 172.21.15.177:0/1913348614 learned_addr learned my addr 172.21.15.177:0/1913348614 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:43.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc930d39640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc92c0b35b0 0x7fc92c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:43.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc923fff640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92c0b3c70 0x7fc92c154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:43.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc93153a640 1 -- 172.21.15.177:0/1913348614 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92c0b3c70 msgr2=0x7fc92c154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:43.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc93153a640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92c0b3c70 0x7fc92c154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc93153a640 1 -- 172.21.15.177:0/1913348614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc92c0b35b0 msgr2=0x7fc92c15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:43.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc93153a640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc92c0b35b0 0x7fc92c15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc93153a640 1 -- 172.21.15.177:0/1913348614 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc924009a70 con 0x7fc92c0cfe90 2023-11-28T20:08:43.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc930d39640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc92c0b35b0 0x7fc92c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:43.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc923fff640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92c0b3c70 0x7fc92c154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:43.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc93153a640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc92c0cfe90 0x7fc92c06be90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc92401b000 tx=0x7fc9240196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:43.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc9217fa640 1 -- 172.21.15.177:0/1913348614 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9240adc60 con 0x7fc92c0cfe90 2023-11-28T20:08:43.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc9217fa640 1 -- 172.21.15.177:0/1913348614 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9240addc0 con 0x7fc92c0cfe90 2023-11-28T20:08:43.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc932f9d640 1 -- 172.21.15.177:0/1913348614 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92c15bac0 con 0x7fc92c0cfe90 2023-11-28T20:08:43.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc9217fa640 1 -- 172.21.15.177:0/1913348614 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9240b7610 con 0x7fc92c0cfe90 2023-11-28T20:08:43.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.782+0000 7fc932f9d640 1 -- 172.21.15.177:0/1913348614 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92c154a90 con 0x7fc92c0cfe90 2023-11-28T20:08:43.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.786+0000 7fc932f9d640 1 -- 172.21.15.177:0/1913348614 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92c1566c0 con 0x7fc92c0cfe90 2023-11-28T20:08:43.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.786+0000 7fc9217fa640 1 -- 172.21.15.177:0/1913348614 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc9240b4050 con 0x7fc92c0cfe90 2023-11-28T20:08:43.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.786+0000 7fc9217fa640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc918066470 0x7fc918068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:43.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.786+0000 7fc9217fa640 1 -- 172.21.15.177:0/1913348614 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc92411efd0 con 0x7fc92c0cfe90 2023-11-28T20:08:43.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.786+0000 7fc930d39640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc918066470 0x7fc918068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:43.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.786+0000 7fc930d39640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc918066470 0x7fc918068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc928009ae0 tx=0x7fc928008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:43.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.790+0000 7fc9217fa640 1 -- 172.21.15.177:0/1913348614 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc92c1566c0 con 0x7fc92c0cfe90 2023-11-28T20:08:43.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.942+0000 7fc932f9d640 1 -- 172.21.15.177:0/1913348614 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc92c1566c0 con 0x7fc92c0cfe90 2023-11-28T20:08:43.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.942+0000 7fc9217fa640 1 -- 172.21.15.177:0/1913348614 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fc92c1566c0 con 0x7fc92c0cfe90 2023-11-28T20:08:43.945 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:43.945 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":33,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:41.035379+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:08:37.943771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T20:08:38.396895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:43.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.946+0000 7fc932f9d640 1 -- 172.21.15.177:0/1913348614 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc918066470 msgr2=0x7fc918068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:43.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.946+0000 7fc932f9d640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc918066470 0x7fc918068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc928009ae0 tx=0x7fc928008040 comp rx=0 tx=0).stop 2023-11-28T20:08:43.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.946+0000 7fc932f9d640 1 -- 172.21.15.177:0/1913348614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc92c0cfe90 msgr2=0x7fc92c06be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:43.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.946+0000 7fc932f9d640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc92c0cfe90 0x7fc92c06be90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc92401b000 tx=0x7fc9240196f0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.946+0000 7fc932f9d640 1 -- 172.21.15.177:0/1913348614 shutdown_connections 2023-11-28T20:08:43.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.946+0000 7fc932f9d640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc918066470 0x7fc918068930 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.946+0000 7fc932f9d640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc92c0cfe90 0x7fc92c06be90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.946+0000 7fc932f9d640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92c0b3c70 0x7fc92c154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.946+0000 7fc932f9d640 1 --2- 172.21.15.177:0/1913348614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc92c0b35b0 0x7fc92c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:43.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.946+0000 7fc932f9d640 1 -- 172.21.15.177:0/1913348614 >> 172.21.15.177:0/1913348614 conn(0x7fc92c09c4b0 msgr2=0x7fc92c0d20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:43.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.946+0000 7fc932f9d640 1 -- 172.21.15.177:0/1913348614 shutdown_connections 2023-11-28T20:08:43.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:43.946+0000 7fc932f9d640 1 -- 172.21.15.177:0/1913348614 wait complete. 2023-11-28T20:08:43.966 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T20:08:43.967 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:08:44.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.102+0000 7ff39aa91640 1 Processor -- start 2023-11-28T20:08:44.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.102+0000 7ff39aa91640 1 -- start start 2023-11-28T20:08:44.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.102+0000 7ff39aa91640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff394144840 0x7ff39406c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.102+0000 7ff39aa91640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394070b70 0x7ff39406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.102+0000 7ff39aa91640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3940710e0 con 0x7ff394072180 2023-11-28T20:08:44.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.102+0000 7ff39aa91640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39415f010 con 0x7ff394144840 2023-11-28T20:08:44.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.102+0000 7ff39aa91640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940713c0 con 0x7ff394070b70 2023-11-28T20:08:44.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.102+0000 7ff38bfff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ff394072180 0x7ff394070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:57280/0 (socket says 172.21.15.177:57280) 2023-11-28T20:08:44.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.102+0000 7ff38bfff640 1 -- 172.21.15.177:0/3026396712 learned_addr learned my addr 172.21.15.177:0/3026396712 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:44.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff39902e640 1 --2- 172.21.15.177:0/3026396712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394070b70 0x7ff39406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff39882d640 1 --2- 172.21.15.177:0/3026396712 >> v2:172.21.15.195:3300/0 conn(0x7ff394144840 0x7ff39406c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 -- 172.21.15.177:0/3026396712 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758730775 0 0) 0x7ff3940710e0 con 0x7ff394072180 2023-11-28T20:08:44.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 -- 172.21.15.177:0/3026396712 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff37c003530 con 0x7ff394072180 2023-11-28T20:08:44.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 -- 172.21.15.177:0/3026396712 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 426268422 0 0) 0x7ff37c003530 con 0x7ff394072180 2023-11-28T20:08:44.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 -- 172.21.15.177:0/3026396712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394070b70 msgr2=0x7ff39406c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:44.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 --2- 172.21.15.177:0/3026396712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394070b70 0x7ff39406c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 -- 172.21.15.177:0/3026396712 >> v2:172.21.15.195:3300/0 conn(0x7ff394144840 msgr2=0x7ff39406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:44.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 --2- 172.21.15.177:0/3026396712 >> v2:172.21.15.195:3300/0 conn(0x7ff394144840 0x7ff39406c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 -- 172.21.15.177:0/3026396712 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3940716a0 con 0x7ff394072180 2023-11-28T20:08:44.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 -- 172.21.15.177:0/3026396712 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7ff384001680 con 0x7ff394072180 2023-11-28T20:08:44.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 -- 172.21.15.177:0/3026396712 >> v1:172.21.15.177:6789/0 conn(0x7ff394072180 legacy=0x7ff394070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 --2- 172.21.15.177:0/3026396712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394070b70 0x7ff37c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 --2- 172.21.15.177:0/3026396712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff37c003f00 0x7ff37c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 --2- 172.21.15.177:0/3026396712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff37c004d10 0x7ff37c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 -- 172.21.15.177:0/3026396712 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940713c0 con 0x7ff37c004d10 2023-11-28T20:08:44.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 -- 172.21.15.177:0/3026396712 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c00b990 con 0x7ff37c003f00 2023-11-28T20:08:44.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38b7fe640 1 -- 172.21.15.177:0/3026396712 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c00bad0 con 0x7ff394070b70 2023-11-28T20:08:44.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff39902e640 1 --2- 172.21.15.177:0/3026396712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff37c004d10 0x7ff37c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff39882d640 1 --2- 172.21.15.177:0/3026396712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394070b70 0x7ff37c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff38bfff640 1 --2- 172.21.15.177:0/3026396712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff37c003f00 0x7ff37c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff39902e640 1 -- 172.21.15.177:0/3026396712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394070b70 msgr2=0x7ff37c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:44.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff39902e640 1 --2- 172.21.15.177:0/3026396712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394070b70 0x7ff37c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff39902e640 1 -- 172.21.15.177:0/3026396712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff37c003f00 msgr2=0x7ff37c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:44.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff39902e640 1 --2- 172.21.15.177:0/3026396712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff37c003f00 0x7ff37c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.106+0000 7ff39902e640 1 -- 172.21.15.177:0/3026396712 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c003530 con 0x7ff37c004d10 2023-11-28T20:08:44.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.110+0000 7ff39902e640 1 --2- 172.21.15.177:0/3026396712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff37c004d10 0x7ff37c005190 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009fc0 tx=0x7ff38c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261c9111227e4c4e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:44.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.110+0000 7ff38b7fe640 1 -- 172.21.15.177:0/3026396712 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c0a5c70 con 0x7ff37c004d10 2023-11-28T20:08:44.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.110+0000 7ff38b7fe640 1 -- 172.21.15.177:0/3026396712 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c00f040 con 0x7ff37c004d10 2023-11-28T20:08:44.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.110+0000 7ff38b7fe640 1 -- 172.21.15.177:0/3026396712 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c0ad440 con 0x7ff37c004d10 2023-11-28T20:08:44.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.110+0000 7ff39aa91640 1 -- 172.21.15.177:0/3026396712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff37c004d10 msgr2=0x7ff37c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.110+0000 7ff39aa91640 1 --2- 172.21.15.177:0/3026396712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff37c004d10 0x7ff37c005190 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009fc0 tx=0x7ff38c01cc00 comp rx=0 tx=0).stop 2023-11-28T20:08:44.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.110+0000 7ff39902e640 1 -- 172.21.15.177:0/3026396712 reap_dead start 2023-11-28T20:08:44.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.110+0000 7ff39aa91640 1 -- 172.21.15.177:0/3026396712 shutdown_connections 2023-11-28T20:08:44.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.110+0000 7ff39aa91640 1 -- 172.21.15.177:0/3026396712 >> 172.21.15.177:0/3026396712 conn(0x7ff39406a530 msgr2=0x7ff39406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:44.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.110+0000 7ff39aa91640 1 -- 172.21.15.177:0/3026396712 shutdown_connections 2023-11-28T20:08:44.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.110+0000 7ff39aa91640 1 -- 172.21.15.177:0/3026396712 wait complete. 2023-11-28T20:08:44.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.110+0000 7ff39aa91640 1 Processor -- start 2023-11-28T20:08:44.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.110+0000 7ff39aa91640 1 -- start start 2023-11-28T20:08:44.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39aa91640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff37c004d10 0x7ff3940a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39aa91640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3941f1660 0x7ff3941f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39aa91640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff394141c10 0x7ff3940ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39aa91640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3941e5490 con 0x7ff394141c10 2023-11-28T20:08:44.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39aa91640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940a99c0 con 0x7ff3941f1660 2023-11-28T20:08:44.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39aa91640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3941f4a50 con 0x7ff37c004d10 2023-11-28T20:08:44.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39902e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff394141c10 0x7ff3940ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39902e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff394141c10 0x7ff3940ad190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48174/0 (socket says 172.21.15.177:48174) 2023-11-28T20:08:44.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39902e640 1 -- 172.21.15.177:0/2945299436 learned_addr learned my addr 172.21.15.177:0/2945299436 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:44.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39882d640 1 --2- 172.21.15.177:0/2945299436 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff37c004d10 0x7ff3940a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff38bfff640 1 --2- 172.21.15.177:0/2945299436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3941f1660 0x7ff3941f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39902e640 1 -- 172.21.15.177:0/2945299436 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff37c004d10 msgr2=0x7ff3940a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39902e640 1 --2- 172.21.15.177:0/2945299436 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff37c004d10 0x7ff3940a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39902e640 1 -- 172.21.15.177:0/2945299436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3941f1660 msgr2=0x7ff3941f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39902e640 1 --2- 172.21.15.177:0/2945299436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3941f1660 0x7ff3941f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39902e640 1 -- 172.21.15.177:0/2945299436 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3941f1bf0 con 0x7ff394141c10 2023-11-28T20:08:44.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39902e640 1 --2- 172.21.15.177:0/2945299436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff394141c10 0x7ff3940ad190 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0b0040 tx=0x7ff38c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:44.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff3897fa640 1 -- 172.21.15.177:0/2945299436 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c0bc070 con 0x7ff394141c10 2023-11-28T20:08:44.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff3897fa640 1 -- 172.21.15.177:0/2945299436 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c0039a0 con 0x7ff394141c10 2023-11-28T20:08:44.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff3897fa640 1 -- 172.21.15.177:0/2945299436 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c003b30 con 0x7ff394141c10 2023-11-28T20:08:44.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39aa91640 1 -- 172.21.15.177:0/2945299436 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3941f1ed0 con 0x7ff394141c10 2023-11-28T20:08:44.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39aa91640 1 -- 172.21.15.177:0/2945299436 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3941f2490 con 0x7ff394141c10 2023-11-28T20:08:44.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff39aa91640 1 -- 172.21.15.177:0/2945299436 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff394069440 con 0x7ff394141c10 2023-11-28T20:08:44.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.114+0000 7ff3897fa640 1 -- 172.21.15.177:0/2945299436 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff38c0b4040 con 0x7ff394141c10 2023-11-28T20:08:44.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.118+0000 7ff3897fa640 1 --2- 172.21.15.177:0/2945299436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff3800664a0 0x7ff380068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.118+0000 7ff3897fa640 1 -- 172.21.15.177:0/2945299436 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff38c11e110 con 0x7ff394141c10 2023-11-28T20:08:44.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.118+0000 7ff39882d640 1 --2- 172.21.15.177:0/2945299436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff3800664a0 0x7ff380068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.118+0000 7ff39882d640 1 --2- 172.21.15.177:0/2945299436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff3800664a0 0x7ff380068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff390009ba0 tx=0x7ff390008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:44.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.118+0000 7ff3897fa640 1 -- 172.21.15.177:0/2945299436 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff38c0eb580 con 0x7ff394141c10 2023-11-28T20:08:44.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.266+0000 7ff39aa91640 1 -- 172.21.15.177:0/2945299436 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff394144c20 con 0x7ff3800664a0 2023-11-28T20:08:44.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.274+0000 7ff3897fa640 1 -- 172.21.15.177:0/2945299436 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276903 (secure 0 0 0) 0x7ff3900097f0 con 0x7ff3800664a0 2023-11-28T20:08:44.281 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:44.283 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:08:44.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.278+0000 7ff39aa91640 1 -- 172.21.15.177:0/2945299436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff3800664a0 msgr2=0x7ff380068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.278+0000 7ff39aa91640 1 --2- 172.21.15.177:0/2945299436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff3800664a0 0x7ff380068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff390009ba0 tx=0x7ff390008040 comp rx=0 tx=0).stop 2023-11-28T20:08:44.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.278+0000 7ff39aa91640 1 -- 172.21.15.177:0/2945299436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff394141c10 msgr2=0x7ff3940ad190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.278+0000 7ff39aa91640 1 --2- 172.21.15.177:0/2945299436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff394141c10 0x7ff3940ad190 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0b0040 tx=0x7ff38c009750 comp rx=0 tx=0).stop 2023-11-28T20:08:44.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.278+0000 7ff39aa91640 1 -- 172.21.15.177:0/2945299436 shutdown_connections 2023-11-28T20:08:44.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.278+0000 7ff39aa91640 1 --2- 172.21.15.177:0/2945299436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff3800664a0 0x7ff380068960 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.278+0000 7ff39aa91640 1 --2- 172.21.15.177:0/2945299436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff394141c10 0x7ff3940ad190 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.278+0000 7ff39aa91640 1 --2- 172.21.15.177:0/2945299436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3941f1660 0x7ff3941f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.278+0000 7ff39aa91640 1 --2- 172.21.15.177:0/2945299436 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff37c004d10 0x7ff3940a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.278+0000 7ff39aa91640 1 -- 172.21.15.177:0/2945299436 >> 172.21.15.177:0/2945299436 conn(0x7ff39406a530 msgr2=0x7ff394142570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:44.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.278+0000 7ff39aa91640 1 -- 172.21.15.177:0/2945299436 shutdown_connections 2023-11-28T20:08:44.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.278+0000 7ff39aa91640 1 -- 172.21.15.177:0/2945299436 wait complete. 2023-11-28T20:08:44.301 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-11-28T20:08:43.430027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232400,"kb_used_data":3724,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742320,"statfs":{"total":773094113280,"available":772856135680,"internally_reserved":0,"allocated":3813376,"data_stored":2171011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.415481"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.020417+0000","last_change":"2023-11-28T20:08:38.020417+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.020417+0000","last_undegraded":"2023-11-28T20:08:38.020417+0000","last_fullsized":"2023-11-28T20:08:38.020417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.095136+0000","last_change":"2023-11-28T20:08:38.095136+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.095136+0000","last_undegraded":"2023-11-28T20:08:38.095136+0000","last_fullsized":"2023-11-28T20:08:38.095136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016002+0000","last_change":"2023-11-28T20:08:38.016002+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016002+0000","last_undegraded":"2023-11-28T20:08:38.016002+0000","last_fullsized":"2023-11-28T20:08:38.016002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.020169+0000","last_change":"2023-11-28T20:08:38.020169+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.020169+0000","last_undegraded":"2023-11-28T20:08:38.020169+0000","last_fullsized":"2023-11-28T20:08:38.020169+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.017458+0000","last_change":"2023-11-28T20:08:38.017458+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.017458+0000","last_undegraded":"2023-11-28T20:08:38.017458+0000","last_fullsized":"2023-11-28T20:08:38.017458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016491+0000","last_change":"2023-11-28T20:08:38.016491+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016491+0000","last_undegraded":"2023-11-28T20:08:38.016491+0000","last_fullsized":"2023-11-28T20:08:38.016491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016431+0000","last_change":"2023-11-28T20:08:38.016431+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016431+0000","last_undegraded":"2023-11-28T20:08:38.016431+0000","last_fullsized":"2023-11-28T20:08:38.016431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015178+0000","last_change":"2023-11-28T20:08:38.015178+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015178+0000","last_undegraded":"2023-11-28T20:08:38.015178+0000","last_fullsized":"2023-11-28T20:08:38.015178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015498+0000","last_change":"2023-11-28T20:08:38.015498+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015498+0000","last_undegraded":"2023-11-28T20:08:38.015498+0000","last_fullsized":"2023-11-28T20:08:38.015498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.094691+0000","last_change":"2023-11-28T20:08:38.094691+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.094691+0000","last_undegraded":"2023-11-28T20:08:38.094691+0000","last_fullsized":"2023-11-28T20:08:38.094691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.019916+0000","last_change":"2023-11-28T20:08:38.019916+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.019916+0000","last_undegraded":"2023-11-28T20:08:38.019916+0000","last_fullsized":"2023-11-28T20:08:38.019916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015773+0000","last_change":"2023-11-28T20:08:38.015773+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015773+0000","last_undegraded":"2023-11-28T20:08:38.015773+0000","last_fullsized":"2023-11-28T20:08:38.015773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015256+0000","last_change":"2023-11-28T20:08:38.015256+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015256+0000","last_undegraded":"2023-11-28T20:08:38.015256+0000","last_fullsized":"2023-11-28T20:08:38.015256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.019098+0000","last_change":"2023-11-28T20:08:38.019098+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.019098+0000","last_undegraded":"2023-11-28T20:08:38.019098+0000","last_fullsized":"2023-11-28T20:08:38.019098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015515+0000","last_change":"2023-11-28T20:08:38.015515+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015515+0000","last_undegraded":"2023-11-28T20:08:38.015515+0000","last_fullsized":"2023-11-28T20:08:38.015515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016083+0000","last_change":"2023-11-28T20:08:38.016083+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016083+0000","last_undegraded":"2023-11-28T20:08:38.016083+0000","last_fullsized":"2023-11-28T20:08:38.016083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.018965+0000","last_change":"2023-11-28T20:08:38.018965+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.018965+0000","last_undegraded":"2023-11-28T20:08:38.018965+0000","last_fullsized":"2023-11-28T20:08:38.018965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015320+0000","last_change":"2023-11-28T20:08:38.015320+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015320+0000","last_undegraded":"2023-11-28T20:08:38.015320+0000","last_fullsized":"2023-11-28T20:08:38.015320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016267+0000","last_change":"2023-11-28T20:08:38.016267+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016267+0000","last_undegraded":"2023-11-28T20:08:38.016267+0000","last_fullsized":"2023-11-28T20:08:38.016267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015359+0000","last_change":"2023-11-28T20:08:38.015359+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015359+0000","last_undegraded":"2023-11-28T20:08:38.015359+0000","last_fullsized":"2023-11-28T20:08:38.015359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.094614+0000","last_change":"2023-11-28T20:08:38.094614+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.094614+0000","last_undegraded":"2023-11-28T20:08:38.094614+0000","last_fullsized":"2023-11-28T20:08:38.094614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.019909+0000","last_change":"2023-11-28T20:08:38.019909+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.019909+0000","last_undegraded":"2023-11-28T20:08:38.019909+0000","last_fullsized":"2023-11-28T20:08:38.019909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016599+0000","last_change":"2023-11-28T20:08:38.016599+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016599+0000","last_undegraded":"2023-11-28T20:08:38.016599+0000","last_fullsized":"2023-11-28T20:08:38.016599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.020475+0000","last_change":"2023-11-28T20:08:38.020475+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.020475+0000","last_undegraded":"2023-11-28T20:08:38.020475+0000","last_fullsized":"2023-11-28T20:08:38.020475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.018493+0000","last_change":"2023-11-28T20:08:38.018493+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.018493+0000","last_undegraded":"2023-11-28T20:08:38.018493+0000","last_fullsized":"2023-11-28T20:08:38.018493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.094035+0000","last_change":"2023-11-28T20:08:38.094035+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.094035+0000","last_undegraded":"2023-11-28T20:08:38.094035+0000","last_fullsized":"2023-11-28T20:08:38.094035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.018441+0000","last_change":"2023-11-28T20:08:38.018441+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.018441+0000","last_undegraded":"2023-11-28T20:08:38.018441+0000","last_fullsized":"2023-11-28T20:08:38.018441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.094040+0000","last_change":"2023-11-28T20:08:38.094040+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.094040+0000","last_undegraded":"2023-11-28T20:08:38.094040+0000","last_fullsized":"2023-11-28T20:08:38.094040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.018471+0000","last_change":"2023-11-28T20:08:38.018471+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.018471+0000","last_undegraded":"2023-11-28T20:08:38.018471+0000","last_fullsized":"2023-11-28T20:08:38.018471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015983+0000","last_change":"2023-11-28T20:08:38.015983+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015983+0000","last_undegraded":"2023-11-28T20:08:38.015983+0000","last_fullsized":"2023-11-28T20:08:38.015983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015472+0000","last_change":"2023-11-28T20:08:38.015472+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015472+0000","last_undegraded":"2023-11-28T20:08:38.015472+0000","last_fullsized":"2023-11-28T20:08:38.015472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.019978+0000","last_change":"2023-11-28T20:08:38.019978+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.019978+0000","last_undegraded":"2023-11-28T20:08:38.019978+0000","last_fullsized":"2023-11-28T20:08:38.019978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T20:08:34.285246+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:08:34.285246+0000","last_peered":"2023-11-28T20:08:34.285246+0000","last_clean":"2023-11-28T20:08:34.285246+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:08:34.285246+0000","last_undegraded":"2023-11-28T20:08:34.285246+0000","last_fullsized":"2023-11-28T20:08:34.285246+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":711971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.59099999999999997}]},{"osd":1,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.55100000000000005}]},{"osd":2,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.62}]},{"osd":3,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.78100000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.76200000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.495}]},{"osd":6,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.64400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":323584,"data_stored":121603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68999999999999995}]},{"osd":2,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.71399999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.78200000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.73999999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.86599999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.93700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":127420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.69299999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.622},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.63400000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.495},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.76200000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.66100000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.46800000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.51500000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.57699999999999996}]},{"osd":2,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65400000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.55300000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.436}]},{"osd":6,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":121603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.249},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":6.016,"5min":6.016,"15min":6.016},"last":0.36899999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.33600000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.39200000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":5.8810000000000002,"5min":5.8810000000000002,"15min":5.8810000000000002},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.745}]},{"osd":5,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.9349999999999996,"5min":5.9349999999999996,"15min":5.9349999999999996},"last":0.80100000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.66700000000000004}]},{"osd":7,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.9740000000000002,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.81999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":121603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.443},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.46300000000000002}]},{"osd":1,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.497}]},{"osd":3,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.82499999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.80800000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.81899999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.79700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":121603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.42399999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.9909999999999997,"5min":4.9909999999999997,"15min":4.9909999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.9109999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.44900000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":4.8239999999999998,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.56200000000000006}]},{"osd":4,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.503},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":4.5890000000000004,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.59899999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.7889999999999997,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":0.627},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.57699999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.7069999999999999,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.7539999999999996,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.34100000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38400000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.437},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.48899999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.57499999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.66400000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.61299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:08:44.307 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:08:44.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f5027b80640 1 Processor -- start 2023-11-28T20:08:44.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f5027b80640 1 -- start start 2023-11-28T20:08:44.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f5027b80640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f50200ce500 0x7f5020167e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f5027b80640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50200b29f0 con 0x7f502015d200 2023-11-28T20:08:44.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f5027b80640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50200d1870 con 0x7f50200d2ba0 2023-11-28T20:08:44.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f5027b80640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50200d2fe0 con 0x7f50200ce500 2023-11-28T20:08:44.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502591c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f502015d200 0x7f50200d1160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:57296/0 (socket says 172.21.15.177:57296) 2023-11-28T20:08:44.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502591c640 1 -- 172.21.15.177:0/1783828926 learned_addr learned my addr 172.21.15.177:0/1783828926 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:44.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502491a640 1 -- 172.21.15.177:0/1783828926 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201959204 0 0) 0x7f50200b29f0 con 0x7f502015d200 2023-11-28T20:08:44.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502491a640 1 -- 172.21.15.177:0/1783828926 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f500c003530 con 0x7f502015d200 2023-11-28T20:08:44.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502611d640 1 --2- 172.21.15.177:0/1783828926 >> v2:172.21.15.195:3300/0 conn(0x7f50200ce500 0x7f5020167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502491a640 1 -- 172.21.15.177:0/1783828926 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1606129746 0 0) 0x7f500c003530 con 0x7f502015d200 2023-11-28T20:08:44.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502491a640 1 -- 172.21.15.177:0/1783828926 >> v2:172.21.15.195:3300/0 conn(0x7f50200ce500 msgr2=0x7f5020167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:44.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502491a640 1 --2- 172.21.15.177:0/1783828926 >> v2:172.21.15.195:3300/0 conn(0x7f50200ce500 0x7f5020167e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502491a640 1 -- 172.21.15.177:0/1783828926 >> v1:172.21.15.195:6789/0 conn(0x7f50200d2ba0 legacy=0x7f50200cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502491a640 1 -- 172.21.15.177:0/1783828926 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50200d1b00 con 0x7f502015d200 2023-11-28T20:08:44.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502491a640 1 -- 172.21.15.177:0/1783828926 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f501c001680 con 0x7f502015d200 2023-11-28T20:08:44.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502491a640 1 -- 172.21.15.177:0/1783828926 >> v1:172.21.15.177:6789/0 conn(0x7f502015d200 legacy=0x7f50200d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502491a640 1 --2- 172.21.15.177:0/1783828926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f500c003980 0x7f500c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502491a640 1 --2- 172.21.15.177:0/1783828926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f500c0047d0 0x7f500c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502491a640 1 --2- 172.21.15.177:0/1783828926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f500c005190 0x7f500c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502491a640 1 -- 172.21.15.177:0/1783828926 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50200d2fe0 con 0x7f500c0047d0 2023-11-28T20:08:44.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502491a640 1 -- 172.21.15.177:0/1783828926 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c00c0c0 con 0x7f500c005190 2023-11-28T20:08:44.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502491a640 1 -- 172.21.15.177:0/1783828926 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c00c280 con 0x7f500c003980 2023-11-28T20:08:44.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502511b640 1 --2- 172.21.15.177:0/1783828926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f500c0047d0 0x7f500c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502591c640 1 --2- 172.21.15.177:0/1783828926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f500c003980 0x7f500c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502611d640 1 --2- 172.21.15.177:0/1783828926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f500c005190 0x7f500c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502511b640 1 -- 172.21.15.177:0/1783828926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f500c003980 msgr2=0x7f500c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:44.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502511b640 1 --2- 172.21.15.177:0/1783828926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f500c003980 0x7f500c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.478+0000 7f502511b640 1 -- 172.21.15.177:0/1783828926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f500c005190 msgr2=0x7f500c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:44.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.482+0000 7f502511b640 1 --2- 172.21.15.177:0/1783828926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f500c005190 0x7f500c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.482+0000 7f502511b640 1 -- 172.21.15.177:0/1783828926 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c003530 con 0x7f500c0047d0 2023-11-28T20:08:44.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.482+0000 7f502611d640 1 -- 172.21.15.177:0/1783828926 reap_dead start 2023-11-28T20:08:44.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.482+0000 7f502511b640 1 --2- 172.21.15.177:0/1783828926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f500c0047d0 0x7f500c004c50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5010001780 tx=0x7f501001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2a748889e94e83 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:44.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.482+0000 7f502491a640 1 -- 172.21.15.177:0/1783828926 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50100052d0 con 0x7f500c0047d0 2023-11-28T20:08:44.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.482+0000 7f502491a640 1 -- 172.21.15.177:0/1783828926 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50100a7050 con 0x7f500c0047d0 2023-11-28T20:08:44.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.482+0000 7f502491a640 1 -- 172.21.15.177:0/1783828926 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010003600 con 0x7f500c0047d0 2023-11-28T20:08:44.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.482+0000 7f5027b80640 1 -- 172.21.15.177:0/1783828926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f500c0047d0 msgr2=0x7f500c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.482+0000 7f5027b80640 1 --2- 172.21.15.177:0/1783828926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f500c0047d0 0x7f500c004c50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5010001780 tx=0x7f501001c3e0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.482+0000 7f5027b80640 1 -- 172.21.15.177:0/1783828926 shutdown_connections 2023-11-28T20:08:44.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.482+0000 7f5027b80640 1 --2- 172.21.15.177:0/1783828926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f500c0047d0 0x7f500c004c50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.482+0000 7f5027b80640 1 -- 172.21.15.177:0/1783828926 >> 172.21.15.177:0/1783828926 conn(0x7f5020072260 msgr2=0x7f50200cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:44.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.482+0000 7f5027b80640 1 -- 172.21.15.177:0/1783828926 shutdown_connections 2023-11-28T20:08:44.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.482+0000 7f5027b80640 1 -- 172.21.15.177:0/1783828926 wait complete. 2023-11-28T20:08:44.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f5027b80640 1 Processor -- start 2023-11-28T20:08:44.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f5027b80640 1 -- start start 2023-11-28T20:08:44.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f5027b80640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f500c0047d0 0x7f5020158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f5027b80640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50200c7b10 0x7f50201600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f5027b80640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50200c9100 0x7f502015de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f5027b80640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50200c8ce0 con 0x7f50200c7b10 2023-11-28T20:08:44.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f5027b80640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50200c8060 con 0x7f50200c9100 2023-11-28T20:08:44.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f5027b80640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50200c8340 con 0x7f500c0047d0 2023-11-28T20:08:44.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f502511b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50200c7b10 0x7f50201600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f502591c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f500c0047d0 0x7f5020158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f502511b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50200c7b10 0x7f50201600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48194/0 (socket says 172.21.15.177:48194) 2023-11-28T20:08:44.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f502511b640 1 -- 172.21.15.177:0/3945825436 learned_addr learned my addr 172.21.15.177:0/3945825436 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:44.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f502611d640 1 --2- 172.21.15.177:0/3945825436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50200c9100 0x7f502015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f502511b640 1 -- 172.21.15.177:0/3945825436 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f500c0047d0 msgr2=0x7f5020158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f502511b640 1 --2- 172.21.15.177:0/3945825436 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f500c0047d0 0x7f5020158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f502511b640 1 -- 172.21.15.177:0/3945825436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50200c9100 msgr2=0x7f502015de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f502511b640 1 --2- 172.21.15.177:0/3945825436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50200c9100 0x7f502015de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f502511b640 1 -- 172.21.15.177:0/3945825436 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50200c8620 con 0x7f50200c7b10 2023-11-28T20:08:44.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f502511b640 1 --2- 172.21.15.177:0/3945825436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50200c7b10 0x7f50201600d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f501001c210 tx=0x7f500c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:44.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f50167fc640 1 -- 172.21.15.177:0/3945825436 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010007440 con 0x7f50200c7b10 2023-11-28T20:08:44.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f50167fc640 1 -- 172.21.15.177:0/3945825436 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50100075a0 con 0x7f50200c7b10 2023-11-28T20:08:44.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f50167fc640 1 -- 172.21.15.177:0/3945825436 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010006a20 con 0x7f50200c7b10 2023-11-28T20:08:44.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.486+0000 7f5027b80640 1 -- 172.21.15.177:0/3945825436 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50200c8900 con 0x7f50200c7b10 2023-11-28T20:08:44.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.490+0000 7f5027b80640 1 -- 172.21.15.177:0/3945825436 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5020160610 con 0x7f50200c7b10 2023-11-28T20:08:44.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.490+0000 7f5027b80640 1 -- 172.21.15.177:0/3945825436 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5020069440 con 0x7f50200c7b10 2023-11-28T20:08:44.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.490+0000 7f50167fc640 1 -- 172.21.15.177:0/3945825436 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5010006b80 con 0x7f50200c7b10 2023-11-28T20:08:44.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.490+0000 7f50167fc640 1 --2- 172.21.15.177:0/3945825436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5004066470 0x7f5004068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.490+0000 7f50167fc640 1 -- 172.21.15.177:0/3945825436 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f501011de10 con 0x7f50200c7b10 2023-11-28T20:08:44.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.490+0000 7f502591c640 1 --2- 172.21.15.177:0/3945825436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5004066470 0x7f5004068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.490+0000 7f502591c640 1 --2- 172.21.15.177:0/3945825436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5004066470 0x7f5004068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f501c000c10 tx=0x7f501c000fd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:44.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.494+0000 7f50167fc640 1 -- 172.21.15.177:0/3945825436 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50100eb3d0 con 0x7f50200c7b10 2023-11-28T20:08:44.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.642+0000 7f5027b80640 1 -- 172.21.15.177:0/3945825436 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50200b5f10 con 0x7f5004066470 2023-11-28T20:08:44.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.650+0000 7f50167fc640 1 -- 172.21.15.177:0/3945825436 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276903 (secure 0 0 0) 0x7f50200b5f10 con 0x7f5004066470 2023-11-28T20:08:44.655 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:44.657 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:08:44.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.654+0000 7f5027b80640 1 -- 172.21.15.177:0/3945825436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5004066470 msgr2=0x7f5004068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.654+0000 7f5027b80640 1 --2- 172.21.15.177:0/3945825436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5004066470 0x7f5004068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f501c000c10 tx=0x7f501c000fd0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.654+0000 7f5027b80640 1 -- 172.21.15.177:0/3945825436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50200c7b10 msgr2=0x7f50201600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.654+0000 7f5027b80640 1 --2- 172.21.15.177:0/3945825436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50200c7b10 0x7f50201600d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f501001c210 tx=0x7f500c005800 comp rx=0 tx=0).stop 2023-11-28T20:08:44.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.654+0000 7f5027b80640 1 -- 172.21.15.177:0/3945825436 shutdown_connections 2023-11-28T20:08:44.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.654+0000 7f5027b80640 1 --2- 172.21.15.177:0/3945825436 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5004066470 0x7f5004068930 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.654+0000 7f5027b80640 1 --2- 172.21.15.177:0/3945825436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50200c9100 0x7f502015de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.654+0000 7f5027b80640 1 --2- 172.21.15.177:0/3945825436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50200c7b10 0x7f50201600d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.654+0000 7f5027b80640 1 --2- 172.21.15.177:0/3945825436 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f500c0047d0 0x7f5020158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.654+0000 7f5027b80640 1 -- 172.21.15.177:0/3945825436 >> 172.21.15.177:0/3945825436 conn(0x7f5020072260 msgr2=0x7f50200b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:44.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.654+0000 7f5027b80640 1 -- 172.21.15.177:0/3945825436 shutdown_connections 2023-11-28T20:08:44.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.654+0000 7f5027b80640 1 -- 172.21.15.177:0/3945825436 wait complete. 2023-11-28T20:08:44.679 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-11-28T20:08:43.430027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232400,"kb_used_data":3724,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742320,"statfs":{"total":773094113280,"available":772856135680,"internally_reserved":0,"allocated":3813376,"data_stored":2171011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.415481"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.020417+0000","last_change":"2023-11-28T20:08:38.020417+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.020417+0000","last_undegraded":"2023-11-28T20:08:38.020417+0000","last_fullsized":"2023-11-28T20:08:38.020417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.095136+0000","last_change":"2023-11-28T20:08:38.095136+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.095136+0000","last_undegraded":"2023-11-28T20:08:38.095136+0000","last_fullsized":"2023-11-28T20:08:38.095136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016002+0000","last_change":"2023-11-28T20:08:38.016002+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016002+0000","last_undegraded":"2023-11-28T20:08:38.016002+0000","last_fullsized":"2023-11-28T20:08:38.016002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.020169+0000","last_change":"2023-11-28T20:08:38.020169+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.020169+0000","last_undegraded":"2023-11-28T20:08:38.020169+0000","last_fullsized":"2023-11-28T20:08:38.020169+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.017458+0000","last_change":"2023-11-28T20:08:38.017458+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.017458+0000","last_undegraded":"2023-11-28T20:08:38.017458+0000","last_fullsized":"2023-11-28T20:08:38.017458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016491+0000","last_change":"2023-11-28T20:08:38.016491+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016491+0000","last_undegraded":"2023-11-28T20:08:38.016491+0000","last_fullsized":"2023-11-28T20:08:38.016491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016431+0000","last_change":"2023-11-28T20:08:38.016431+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016431+0000","last_undegraded":"2023-11-28T20:08:38.016431+0000","last_fullsized":"2023-11-28T20:08:38.016431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015178+0000","last_change":"2023-11-28T20:08:38.015178+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015178+0000","last_undegraded":"2023-11-28T20:08:38.015178+0000","last_fullsized":"2023-11-28T20:08:38.015178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015498+0000","last_change":"2023-11-28T20:08:38.015498+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015498+0000","last_undegraded":"2023-11-28T20:08:38.015498+0000","last_fullsized":"2023-11-28T20:08:38.015498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.094691+0000","last_change":"2023-11-28T20:08:38.094691+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.094691+0000","last_undegraded":"2023-11-28T20:08:38.094691+0000","last_fullsized":"2023-11-28T20:08:38.094691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.019916+0000","last_change":"2023-11-28T20:08:38.019916+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.019916+0000","last_undegraded":"2023-11-28T20:08:38.019916+0000","last_fullsized":"2023-11-28T20:08:38.019916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015773+0000","last_change":"2023-11-28T20:08:38.015773+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015773+0000","last_undegraded":"2023-11-28T20:08:38.015773+0000","last_fullsized":"2023-11-28T20:08:38.015773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015256+0000","last_change":"2023-11-28T20:08:38.015256+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015256+0000","last_undegraded":"2023-11-28T20:08:38.015256+0000","last_fullsized":"2023-11-28T20:08:38.015256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.019098+0000","last_change":"2023-11-28T20:08:38.019098+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.019098+0000","last_undegraded":"2023-11-28T20:08:38.019098+0000","last_fullsized":"2023-11-28T20:08:38.019098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015515+0000","last_change":"2023-11-28T20:08:38.015515+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015515+0000","last_undegraded":"2023-11-28T20:08:38.015515+0000","last_fullsized":"2023-11-28T20:08:38.015515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016083+0000","last_change":"2023-11-28T20:08:38.016083+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016083+0000","last_undegraded":"2023-11-28T20:08:38.016083+0000","last_fullsized":"2023-11-28T20:08:38.016083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.018965+0000","last_change":"2023-11-28T20:08:38.018965+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.018965+0000","last_undegraded":"2023-11-28T20:08:38.018965+0000","last_fullsized":"2023-11-28T20:08:38.018965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015320+0000","last_change":"2023-11-28T20:08:38.015320+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015320+0000","last_undegraded":"2023-11-28T20:08:38.015320+0000","last_fullsized":"2023-11-28T20:08:38.015320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016267+0000","last_change":"2023-11-28T20:08:38.016267+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016267+0000","last_undegraded":"2023-11-28T20:08:38.016267+0000","last_fullsized":"2023-11-28T20:08:38.016267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015359+0000","last_change":"2023-11-28T20:08:38.015359+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015359+0000","last_undegraded":"2023-11-28T20:08:38.015359+0000","last_fullsized":"2023-11-28T20:08:38.015359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.094614+0000","last_change":"2023-11-28T20:08:38.094614+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.094614+0000","last_undegraded":"2023-11-28T20:08:38.094614+0000","last_fullsized":"2023-11-28T20:08:38.094614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.019909+0000","last_change":"2023-11-28T20:08:38.019909+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.019909+0000","last_undegraded":"2023-11-28T20:08:38.019909+0000","last_fullsized":"2023-11-28T20:08:38.019909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016599+0000","last_change":"2023-11-28T20:08:38.016599+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016599+0000","last_undegraded":"2023-11-28T20:08:38.016599+0000","last_fullsized":"2023-11-28T20:08:38.016599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.020475+0000","last_change":"2023-11-28T20:08:38.020475+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.020475+0000","last_undegraded":"2023-11-28T20:08:38.020475+0000","last_fullsized":"2023-11-28T20:08:38.020475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.018493+0000","last_change":"2023-11-28T20:08:38.018493+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.018493+0000","last_undegraded":"2023-11-28T20:08:38.018493+0000","last_fullsized":"2023-11-28T20:08:38.018493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.094035+0000","last_change":"2023-11-28T20:08:38.094035+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.094035+0000","last_undegraded":"2023-11-28T20:08:38.094035+0000","last_fullsized":"2023-11-28T20:08:38.094035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.018441+0000","last_change":"2023-11-28T20:08:38.018441+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.018441+0000","last_undegraded":"2023-11-28T20:08:38.018441+0000","last_fullsized":"2023-11-28T20:08:38.018441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.094040+0000","last_change":"2023-11-28T20:08:38.094040+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.094040+0000","last_undegraded":"2023-11-28T20:08:38.094040+0000","last_fullsized":"2023-11-28T20:08:38.094040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.018471+0000","last_change":"2023-11-28T20:08:38.018471+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.018471+0000","last_undegraded":"2023-11-28T20:08:38.018471+0000","last_fullsized":"2023-11-28T20:08:38.018471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015983+0000","last_change":"2023-11-28T20:08:38.015983+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015983+0000","last_undegraded":"2023-11-28T20:08:38.015983+0000","last_fullsized":"2023-11-28T20:08:38.015983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015472+0000","last_change":"2023-11-28T20:08:38.015472+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015472+0000","last_undegraded":"2023-11-28T20:08:38.015472+0000","last_fullsized":"2023-11-28T20:08:38.015472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.019978+0000","last_change":"2023-11-28T20:08:38.019978+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.019978+0000","last_undegraded":"2023-11-28T20:08:38.019978+0000","last_fullsized":"2023-11-28T20:08:38.019978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T20:08:34.285246+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:08:34.285246+0000","last_peered":"2023-11-28T20:08:34.285246+0000","last_clean":"2023-11-28T20:08:34.285246+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:08:34.285246+0000","last_undegraded":"2023-11-28T20:08:34.285246+0000","last_fullsized":"2023-11-28T20:08:34.285246+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":711971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.59099999999999997}]},{"osd":1,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.55100000000000005}]},{"osd":2,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.62}]},{"osd":3,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.78100000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.76200000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.495}]},{"osd":6,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.64400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":323584,"data_stored":121603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68999999999999995}]},{"osd":2,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.71399999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.78200000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.73999999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.86599999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.93700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":127420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.69299999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.622},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.63400000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.495},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.76200000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.66100000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.46800000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.51500000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.57699999999999996}]},{"osd":2,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65400000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.55300000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.436}]},{"osd":6,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":121603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.249},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":6.016,"5min":6.016,"15min":6.016},"last":0.36899999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.33600000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.39200000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":5.8810000000000002,"5min":5.8810000000000002,"15min":5.8810000000000002},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.745}]},{"osd":5,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.9349999999999996,"5min":5.9349999999999996,"15min":5.9349999999999996},"last":0.80100000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.66700000000000004}]},{"osd":7,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.9740000000000002,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.81999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":121603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.443},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.46300000000000002}]},{"osd":1,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.497}]},{"osd":3,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.82499999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.80800000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.81899999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.79700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":121603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.42399999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.9909999999999997,"5min":4.9909999999999997,"15min":4.9909999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.9109999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.44900000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":4.8239999999999998,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.56200000000000006}]},{"osd":4,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.503},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":4.5890000000000004,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.59899999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.7889999999999997,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":0.627},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.57699999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.7069999999999999,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.7539999999999996,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.34100000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38400000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.437},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.48899999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.57499999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.66400000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.61299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:08:44.686 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:08:44.848 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-28T20:08:44.846+0000 7fa6e40ab640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:08:44.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.854+0000 7f32d2674640 1 Processor -- start 2023-11-28T20:08:44.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d2674640 1 -- start start 2023-11-28T20:08:44.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d2674640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32cc160850 0x7f32cc0d3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d2674640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f32cc0cdb70 0x7f32cc0d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d2674640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f32cc0d1af0 0x7f32cc0cf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d2674640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32cc0d1f80 con 0x7f32cc0cdb70 2023-11-28T20:08:44.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d2674640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32cc0cefb0 con 0x7f32cc0d1af0 2023-11-28T20:08:44.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d2674640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc0ce430 con 0x7f32cc160850 2023-11-28T20:08:44.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d0e71640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f32cc0cdb70 0x7f32cc0d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d0e71640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f32cc0cdb70 0x7f32cc0d15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48210/0 (socket says 172.21.15.177:48210) 2023-11-28T20:08:44.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d0e71640 1 -- 172.21.15.177:0/3986544823 learned_addr learned my addr 172.21.15.177:0/3986544823 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:44.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d1672640 1 --2- 172.21.15.177:0/3986544823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32cc160850 0x7f32cc0d3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d1e73640 1 --2- 172.21.15.177:0/3986544823 >> v2:172.21.15.195:3300/0 conn(0x7f32cc0d1af0 0x7f32cc0cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d0e71640 1 -- 172.21.15.177:0/3986544823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32cc160850 msgr2=0x7f32cc0d3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:44.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d0e71640 1 --2- 172.21.15.177:0/3986544823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32cc160850 0x7f32cc0d3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d0e71640 1 -- 172.21.15.177:0/3986544823 >> v2:172.21.15.195:3300/0 conn(0x7f32cc0d1af0 msgr2=0x7f32cc0cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:44.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d0e71640 1 --2- 172.21.15.177:0/3986544823 >> v2:172.21.15.195:3300/0 conn(0x7f32cc0d1af0 0x7f32cc0cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.858+0000 7f32d0e71640 1 -- 172.21.15.177:0/3986544823 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc0ce710 con 0x7f32cc0cdb70 2023-11-28T20:08:44.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.862+0000 7f32d0e71640 1 --2- 172.21.15.177:0/3986544823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc0cdb70 0x7f32cc0d15b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f32cc08c7d0 tx=0x7f32bc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ba934e635328d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:44.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.862+0000 7f32c3fff640 1 -- 172.21.15.177:0/3986544823 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0aa5f0 con 0x7f32cc0cdb70 2023-11-28T20:08:44.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.862+0000 7f32c3fff640 1 -- 172.21.15.177:0/3986544823 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32bc0aa750 con 0x7f32cc0cdb70 2023-11-28T20:08:44.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.862+0000 7f32c3fff640 1 -- 172.21.15.177:0/3986544823 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0aaae0 con 0x7f32cc0cdb70 2023-11-28T20:08:44.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.862+0000 7f32d2674640 1 -- 172.21.15.177:0/3986544823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc0cdb70 msgr2=0x7f32cc0d15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.862+0000 7f32d2674640 1 --2- 172.21.15.177:0/3986544823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc0cdb70 0x7f32cc0d15b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f32cc08c7d0 tx=0x7f32bc01c4d0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.862+0000 7f32d2674640 1 -- 172.21.15.177:0/3986544823 shutdown_connections 2023-11-28T20:08:44.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.862+0000 7f32d2674640 1 --2- 172.21.15.177:0/3986544823 >> v2:172.21.15.195:3300/0 conn(0x7f32cc0d1af0 0x7f32cc0cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.862+0000 7f32d2674640 1 --2- 172.21.15.177:0/3986544823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc0cdb70 0x7f32cc0d15b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.862+0000 7f32d2674640 1 --2- 172.21.15.177:0/3986544823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32cc160850 0x7f32cc0d3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.862+0000 7f32d2674640 1 -- 172.21.15.177:0/3986544823 >> 172.21.15.177:0/3986544823 conn(0x7f32cc0d2fd0 msgr2=0x7f32cc0d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:44.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.862+0000 7f32d2674640 1 -- 172.21.15.177:0/3986544823 shutdown_connections 2023-11-28T20:08:44.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.862+0000 7f32d2674640 1 -- 172.21.15.177:0/3986544823 wait complete. 2023-11-28T20:08:44.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.862+0000 7f32d2674640 1 Processor -- start 2023-11-28T20:08:44.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.862+0000 7f32d2674640 1 -- start start 2023-11-28T20:08:44.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d2674640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc0cdb70 0x7f32cc1f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d2674640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32cc0d1af0 0x7f32cc0cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d2674640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32cc160850 0x7f32cc0cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d2674640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc1f5e90 con 0x7f32cc0cdb70 2023-11-28T20:08:44.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d2674640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc0c97c0 con 0x7f32cc0d1af0 2023-11-28T20:08:44.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d2674640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc0c9aa0 con 0x7f32cc160850 2023-11-28T20:08:44.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d1672640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc0cdb70 0x7f32cc1f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d1672640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc0cdb70 0x7f32cc1f6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48216/0 (socket says 172.21.15.177:48216) 2023-11-28T20:08:44.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d1672640 1 -- 172.21.15.177:0/2397017314 learned_addr learned my addr 172.21.15.177:0/2397017314 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:44.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d1e73640 1 --2- 172.21.15.177:0/2397017314 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32cc160850 0x7f32cc0cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d0e71640 1 --2- 172.21.15.177:0/2397017314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32cc0d1af0 0x7f32cc0cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d1672640 1 -- 172.21.15.177:0/2397017314 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32cc160850 msgr2=0x7f32cc0cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d1672640 1 --2- 172.21.15.177:0/2397017314 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32cc160850 0x7f32cc0cca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d1672640 1 -- 172.21.15.177:0/2397017314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32cc0d1af0 msgr2=0x7f32cc0cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:44.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d1672640 1 --2- 172.21.15.177:0/2397017314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32cc0d1af0 0x7f32cc0cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:44.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d1672640 1 -- 172.21.15.177:0/2397017314 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc0094d0 con 0x7f32cc0cdb70 2023-11-28T20:08:44.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d1672640 1 --2- 172.21.15.177:0/2397017314 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc0cdb70 0x7f32cc1f6950 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f32c800e870 tx=0x7f32c800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:44.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32c1ffb640 1 -- 172.21.15.177:0/2397017314 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8009510 con 0x7f32cc0cdb70 2023-11-28T20:08:44.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32c1ffb640 1 -- 172.21.15.177:0/2397017314 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c800eec0 con 0x7f32cc0cdb70 2023-11-28T20:08:44.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d2674640 1 -- 172.21.15.177:0/2397017314 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32cc0ce200 con 0x7f32cc0cdb70 2023-11-28T20:08:44.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32c1ffb640 1 -- 172.21.15.177:0/2397017314 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800cb40 con 0x7f32cc0cdb70 2023-11-28T20:08:44.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d2674640 1 -- 172.21.15.177:0/2397017314 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32cc1f6430 con 0x7f32cc0cdb70 2023-11-28T20:08:44.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.866+0000 7f32d2674640 1 -- 172.21.15.177:0/2397017314 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32cc0a0f80 con 0x7f32cc0cdb70 2023-11-28T20:08:44.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.870+0000 7f32c1ffb640 1 -- 172.21.15.177:0/2397017314 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f32c800cca0 con 0x7f32cc0cdb70 2023-11-28T20:08:44.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.870+0000 7f32c1ffb640 1 --2- 172.21.15.177:0/2397017314 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f32b0066470 0x7f32b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:44.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.870+0000 7f32c1ffb640 1 -- 172.21.15.177:0/2397017314 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32c8083e70 con 0x7f32cc0cdb70 2023-11-28T20:08:44.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.870+0000 7f32d0e71640 1 --2- 172.21.15.177:0/2397017314 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f32b0066470 0x7f32b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:44.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.870+0000 7f32d0e71640 1 --2- 172.21.15.177:0/2397017314 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f32b0066470 0x7f32b0068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0ae000 tx=0x7f32bc0b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:44.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:44.874+0000 7f32c1ffb640 1 -- 172.21.15.177:0/2397017314 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f32c8051430 con 0x7f32cc0cdb70 2023-11-28T20:08:45.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.022+0000 7f32d2674640 1 -- 172.21.15.177:0/2397017314 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32cc0b6100 con 0x7f32b0066470 2023-11-28T20:08:45.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.026+0000 7f32c1ffb640 1 -- 172.21.15.177:0/2397017314 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276903 (secure 0 0 0) 0x7f32bc0aa8c0 con 0x7f32b0066470 2023-11-28T20:08:45.032 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:45.034 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:08:45.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.030+0000 7f32d2674640 1 -- 172.21.15.177:0/2397017314 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f32b0066470 msgr2=0x7f32b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.030+0000 7f32d2674640 1 --2- 172.21.15.177:0/2397017314 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f32b0066470 0x7f32b0068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0ae000 tx=0x7f32bc0b5040 comp rx=0 tx=0).stop 2023-11-28T20:08:45.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.030+0000 7f32d2674640 1 -- 172.21.15.177:0/2397017314 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc0cdb70 msgr2=0x7f32cc1f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.030+0000 7f32d2674640 1 --2- 172.21.15.177:0/2397017314 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc0cdb70 0x7f32cc1f6950 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f32c800e870 tx=0x7f32c800ec70 comp rx=0 tx=0).stop 2023-11-28T20:08:45.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.030+0000 7f32d2674640 1 -- 172.21.15.177:0/2397017314 shutdown_connections 2023-11-28T20:08:45.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.030+0000 7f32d2674640 1 --2- 172.21.15.177:0/2397017314 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f32b0066470 0x7f32b0068930 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.030+0000 7f32d2674640 1 --2- 172.21.15.177:0/2397017314 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32cc160850 0x7f32cc0cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.030+0000 7f32d2674640 1 --2- 172.21.15.177:0/2397017314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32cc0d1af0 0x7f32cc0cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.030+0000 7f32d2674640 1 --2- 172.21.15.177:0/2397017314 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc0cdb70 0x7f32cc1f6950 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.030+0000 7f32d2674640 1 -- 172.21.15.177:0/2397017314 >> 172.21.15.177:0/2397017314 conn(0x7f32cc0d2fd0 msgr2=0x7f32cc15ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:45.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.030+0000 7f32d2674640 1 -- 172.21.15.177:0/2397017314 shutdown_connections 2023-11-28T20:08:45.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.030+0000 7f32d2674640 1 -- 172.21.15.177:0/2397017314 wait complete. 2023-11-28T20:08:45.053 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-11-28T20:08:43.430027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232400,"kb_used_data":3724,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742320,"statfs":{"total":773094113280,"available":772856135680,"internally_reserved":0,"allocated":3813376,"data_stored":2171011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.415481"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.020417+0000","last_change":"2023-11-28T20:08:38.020417+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.020417+0000","last_undegraded":"2023-11-28T20:08:38.020417+0000","last_fullsized":"2023-11-28T20:08:38.020417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.095136+0000","last_change":"2023-11-28T20:08:38.095136+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.095136+0000","last_undegraded":"2023-11-28T20:08:38.095136+0000","last_fullsized":"2023-11-28T20:08:38.095136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016002+0000","last_change":"2023-11-28T20:08:38.016002+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016002+0000","last_undegraded":"2023-11-28T20:08:38.016002+0000","last_fullsized":"2023-11-28T20:08:38.016002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.020169+0000","last_change":"2023-11-28T20:08:38.020169+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.020169+0000","last_undegraded":"2023-11-28T20:08:38.020169+0000","last_fullsized":"2023-11-28T20:08:38.020169+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.017458+0000","last_change":"2023-11-28T20:08:38.017458+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.017458+0000","last_undegraded":"2023-11-28T20:08:38.017458+0000","last_fullsized":"2023-11-28T20:08:38.017458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016491+0000","last_change":"2023-11-28T20:08:38.016491+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016491+0000","last_undegraded":"2023-11-28T20:08:38.016491+0000","last_fullsized":"2023-11-28T20:08:38.016491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016431+0000","last_change":"2023-11-28T20:08:38.016431+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016431+0000","last_undegraded":"2023-11-28T20:08:38.016431+0000","last_fullsized":"2023-11-28T20:08:38.016431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015178+0000","last_change":"2023-11-28T20:08:38.015178+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015178+0000","last_undegraded":"2023-11-28T20:08:38.015178+0000","last_fullsized":"2023-11-28T20:08:38.015178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015498+0000","last_change":"2023-11-28T20:08:38.015498+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015498+0000","last_undegraded":"2023-11-28T20:08:38.015498+0000","last_fullsized":"2023-11-28T20:08:38.015498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.094691+0000","last_change":"2023-11-28T20:08:38.094691+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.094691+0000","last_undegraded":"2023-11-28T20:08:38.094691+0000","last_fullsized":"2023-11-28T20:08:38.094691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.019916+0000","last_change":"2023-11-28T20:08:38.019916+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.019916+0000","last_undegraded":"2023-11-28T20:08:38.019916+0000","last_fullsized":"2023-11-28T20:08:38.019916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015773+0000","last_change":"2023-11-28T20:08:38.015773+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015773+0000","last_undegraded":"2023-11-28T20:08:38.015773+0000","last_fullsized":"2023-11-28T20:08:38.015773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015256+0000","last_change":"2023-11-28T20:08:38.015256+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015256+0000","last_undegraded":"2023-11-28T20:08:38.015256+0000","last_fullsized":"2023-11-28T20:08:38.015256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.019098+0000","last_change":"2023-11-28T20:08:38.019098+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.019098+0000","last_undegraded":"2023-11-28T20:08:38.019098+0000","last_fullsized":"2023-11-28T20:08:38.019098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015515+0000","last_change":"2023-11-28T20:08:38.015515+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015515+0000","last_undegraded":"2023-11-28T20:08:38.015515+0000","last_fullsized":"2023-11-28T20:08:38.015515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016083+0000","last_change":"2023-11-28T20:08:38.016083+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016083+0000","last_undegraded":"2023-11-28T20:08:38.016083+0000","last_fullsized":"2023-11-28T20:08:38.016083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.018965+0000","last_change":"2023-11-28T20:08:38.018965+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.018965+0000","last_undegraded":"2023-11-28T20:08:38.018965+0000","last_fullsized":"2023-11-28T20:08:38.018965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015320+0000","last_change":"2023-11-28T20:08:38.015320+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015320+0000","last_undegraded":"2023-11-28T20:08:38.015320+0000","last_fullsized":"2023-11-28T20:08:38.015320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016267+0000","last_change":"2023-11-28T20:08:38.016267+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016267+0000","last_undegraded":"2023-11-28T20:08:38.016267+0000","last_fullsized":"2023-11-28T20:08:38.016267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015359+0000","last_change":"2023-11-28T20:08:38.015359+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015359+0000","last_undegraded":"2023-11-28T20:08:38.015359+0000","last_fullsized":"2023-11-28T20:08:38.015359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.094614+0000","last_change":"2023-11-28T20:08:38.094614+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.094614+0000","last_undegraded":"2023-11-28T20:08:38.094614+0000","last_fullsized":"2023-11-28T20:08:38.094614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.019909+0000","last_change":"2023-11-28T20:08:38.019909+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.019909+0000","last_undegraded":"2023-11-28T20:08:38.019909+0000","last_fullsized":"2023-11-28T20:08:38.019909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.016599+0000","last_change":"2023-11-28T20:08:38.016599+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.016599+0000","last_undegraded":"2023-11-28T20:08:38.016599+0000","last_fullsized":"2023-11-28T20:08:38.016599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.020475+0000","last_change":"2023-11-28T20:08:38.020475+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.020475+0000","last_undegraded":"2023-11-28T20:08:38.020475+0000","last_fullsized":"2023-11-28T20:08:38.020475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.018493+0000","last_change":"2023-11-28T20:08:38.018493+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.018493+0000","last_undegraded":"2023-11-28T20:08:38.018493+0000","last_fullsized":"2023-11-28T20:08:38.018493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.094035+0000","last_change":"2023-11-28T20:08:38.094035+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.094035+0000","last_undegraded":"2023-11-28T20:08:38.094035+0000","last_fullsized":"2023-11-28T20:08:38.094035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.018441+0000","last_change":"2023-11-28T20:08:38.018441+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.018441+0000","last_undegraded":"2023-11-28T20:08:38.018441+0000","last_fullsized":"2023-11-28T20:08:38.018441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.094040+0000","last_change":"2023-11-28T20:08:38.094040+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.094040+0000","last_undegraded":"2023-11-28T20:08:38.094040+0000","last_fullsized":"2023-11-28T20:08:38.094040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.018471+0000","last_change":"2023-11-28T20:08:38.018471+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.018471+0000","last_undegraded":"2023-11-28T20:08:38.018471+0000","last_fullsized":"2023-11-28T20:08:38.018471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015983+0000","last_change":"2023-11-28T20:08:38.015983+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015983+0000","last_undegraded":"2023-11-28T20:08:38.015983+0000","last_fullsized":"2023-11-28T20:08:38.015983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.015472+0000","last_change":"2023-11-28T20:08:38.015472+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.015472+0000","last_undegraded":"2023-11-28T20:08:38.015472+0000","last_fullsized":"2023-11-28T20:08:38.015472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:08:39.012458+0000","last_change":"2023-11-28T20:08:39.012458+0000","last_active":"2023-11-28T20:08:39.012458+0000","last_peered":"2023-11-28T20:08:39.012458+0000","last_clean":"2023-11-28T20:08:39.012458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:39.012458+0000","last_undegraded":"2023-11-28T20:08:39.012458+0000","last_fullsized":"2023-11-28T20:08:39.012458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-28T20:08:38.019978+0000","last_change":"2023-11-28T20:08:38.019978+0000","last_active":"2023-11-28T20:08:38.004282+0000","last_peered":"2023-11-28T20:08:38.004282+0000","last_clean":"2023-11-28T20:08:38.004282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:08:38.019978+0000","last_undegraded":"2023-11-28T20:08:38.019978+0000","last_fullsized":"2023-11-28T20:08:38.019978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T20:08:34.285246+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:08:34.285246+0000","last_peered":"2023-11-28T20:08:34.285246+0000","last_clean":"2023-11-28T20:08:34.285246+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:08:34.285246+0000","last_undegraded":"2023-11-28T20:08:34.285246+0000","last_fullsized":"2023-11-28T20:08:34.285246+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":711971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.59099999999999997}]},{"osd":1,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.55100000000000005}]},{"osd":2,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.62}]},{"osd":3,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.78100000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.76200000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.495}]},{"osd":6,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.64400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":323584,"data_stored":121603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68999999999999995}]},{"osd":2,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.71399999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.78200000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.73999999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.86599999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.93700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":127420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.69299999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.622},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.63400000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.495},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.76200000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.66100000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.46800000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.51500000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.57699999999999996}]},{"osd":2,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65400000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.55300000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.436}]},{"osd":6,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":121603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.249},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":6.016,"5min":6.016,"15min":6.016},"last":0.36899999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.33600000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.39200000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":5.8810000000000002,"5min":5.8810000000000002,"15min":5.8810000000000002},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.745}]},{"osd":5,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.9349999999999996,"5min":5.9349999999999996,"15min":5.9349999999999996},"last":0.80100000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.66700000000000004}]},{"osd":7,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.9740000000000002,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.81999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":121603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.443},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.46300000000000002}]},{"osd":1,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.497}]},{"osd":3,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.82499999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.80800000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.81899999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.79700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":121603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.42399999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.9909999999999997,"5min":4.9909999999999997,"15min":4.9909999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.9109999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.44900000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":4.8239999999999998,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.56200000000000006}]},{"osd":4,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.503},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":4.5890000000000004,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.59899999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.7889999999999997,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":0.627},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.57699999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.7069999999999999,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.7539999999999996,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.34100000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38400000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.437},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.48899999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.57499999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.66400000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.61299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:08:45.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-11-28T20:08:45.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-11-28T20:08:45.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-11-28T20:08:45.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-11-28T20:08:45.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-11-28T20:08:45.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-11-28T20:08:45.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-11-28T20:08:45.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-11-28T20:08:45.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-11-28T20:08:45.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-11-28T20:08:45.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-11-28T20:08:45.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-11-28T20:08:45.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-11-28T20:08:45.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-11-28T20:08:45.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-11-28T20:08:45.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-11-28T20:08:45.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-11-28T20:08:45.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-11-28T20:08:45.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-11-28T20:08:45.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-11-28T20:08:45.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-11-28T20:08:45.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-11-28T20:08:45.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-11-28T20:08:45.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-11-28T20:08:45.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-11-28T20:08:45.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-11-28T20:08:45.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-11-28T20:08:45.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-11-28T20:08:45.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-11-28T20:08:45.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-11-28T20:08:45.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-11-28T20:08:45.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-11-28T20:08:45.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-11-28T20:08:45.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-11-28T20:08:45.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.020417+0000', 'last_change': '2023-11-28T20:08:38.020417+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.020417+0000', 'last_undegraded': '2023-11-28T20:08:38.020417+0000', 'last_fullsized': '2023-11-28T20:08:38.020417+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:08:45.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-11-28T20:08:45.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-11-28T20:08:45.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.095136+0000', 'last_change': '2023-11-28T20:08:38.095136+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.095136+0000', 'last_undegraded': '2023-11-28T20:08:38.095136+0000', 'last_fullsized': '2023-11-28T20:08:38.095136+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:08:45.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-11-28T20:08:45.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-11-28T20:08:45.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.016002+0000', 'last_change': '2023-11-28T20:08:38.016002+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.016002+0000', 'last_undegraded': '2023-11-28T20:08:38.016002+0000', 'last_fullsized': '2023-11-28T20:08:38.016002+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:08:45.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-11-28T20:08:45.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-11-28T20:08:45.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.020169+0000', 'last_change': '2023-11-28T20:08:38.020169+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.020169+0000', 'last_undegraded': '2023-11-28T20:08:38.020169+0000', 'last_fullsized': '2023-11-28T20:08:38.020169+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:08:45.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-11-28T20:08:45.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-11-28T20:08:45.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.017458+0000', 'last_change': '2023-11-28T20:08:38.017458+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.017458+0000', 'last_undegraded': '2023-11-28T20:08:38.017458+0000', 'last_fullsized': '2023-11-28T20:08:38.017458+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:08:45.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-11-28T20:08:45.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-11-28T20:08:45.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.016491+0000', 'last_change': '2023-11-28T20:08:38.016491+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.016491+0000', 'last_undegraded': '2023-11-28T20:08:38.016491+0000', 'last_fullsized': '2023-11-28T20:08:38.016491+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:08:45.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-11-28T20:08:45.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-11-28T20:08:45.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.016431+0000', 'last_change': '2023-11-28T20:08:38.016431+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.016431+0000', 'last_undegraded': '2023-11-28T20:08:38.016431+0000', 'last_fullsized': '2023-11-28T20:08:38.016431+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:08:45.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-11-28T20:08:45.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-11-28T20:08:45.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.015178+0000', 'last_change': '2023-11-28T20:08:38.015178+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.015178+0000', 'last_undegraded': '2023-11-28T20:08:38.015178+0000', 'last_fullsized': '2023-11-28T20:08:38.015178+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:08:45.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-11-28T20:08:45.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-11-28T20:08:45.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.015498+0000', 'last_change': '2023-11-28T20:08:38.015498+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.015498+0000', 'last_undegraded': '2023-11-28T20:08:38.015498+0000', 'last_fullsized': '2023-11-28T20:08:38.015498+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:08:45.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-11-28T20:08:45.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-11-28T20:08:45.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.094691+0000', 'last_change': '2023-11-28T20:08:38.094691+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.094691+0000', 'last_undegraded': '2023-11-28T20:08:38.094691+0000', 'last_fullsized': '2023-11-28T20:08:38.094691+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:08:45.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-11-28T20:08:45.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-11-28T20:08:45.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.019916+0000', 'last_change': '2023-11-28T20:08:38.019916+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.019916+0000', 'last_undegraded': '2023-11-28T20:08:38.019916+0000', 'last_fullsized': '2023-11-28T20:08:38.019916+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:08:45.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-11-28T20:08:45.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-11-28T20:08:45.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.015773+0000', 'last_change': '2023-11-28T20:08:38.015773+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.015773+0000', 'last_undegraded': '2023-11-28T20:08:38.015773+0000', 'last_fullsized': '2023-11-28T20:08:38.015773+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:08:45.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-11-28T20:08:45.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-11-28T20:08:45.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.015256+0000', 'last_change': '2023-11-28T20:08:38.015256+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.015256+0000', 'last_undegraded': '2023-11-28T20:08:38.015256+0000', 'last_fullsized': '2023-11-28T20:08:38.015256+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:08:45.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-11-28T20:08:45.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-11-28T20:08:45.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.019098+0000', 'last_change': '2023-11-28T20:08:38.019098+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.019098+0000', 'last_undegraded': '2023-11-28T20:08:38.019098+0000', 'last_fullsized': '2023-11-28T20:08:38.019098+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:08:45.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-11-28T20:08:45.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-11-28T20:08:45.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.015515+0000', 'last_change': '2023-11-28T20:08:38.015515+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.015515+0000', 'last_undegraded': '2023-11-28T20:08:38.015515+0000', 'last_fullsized': '2023-11-28T20:08:38.015515+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:08:45.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-11-28T20:08:45.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-11-28T20:08:45.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.016083+0000', 'last_change': '2023-11-28T20:08:38.016083+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.016083+0000', 'last_undegraded': '2023-11-28T20:08:38.016083+0000', 'last_fullsized': '2023-11-28T20:08:38.016083+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:08:45.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-11-28T20:08:45.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-11-28T20:08:45.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.018965+0000', 'last_change': '2023-11-28T20:08:38.018965+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.018965+0000', 'last_undegraded': '2023-11-28T20:08:38.018965+0000', 'last_fullsized': '2023-11-28T20:08:38.018965+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:08:45.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-11-28T20:08:45.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-11-28T20:08:45.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.015320+0000', 'last_change': '2023-11-28T20:08:38.015320+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.015320+0000', 'last_undegraded': '2023-11-28T20:08:38.015320+0000', 'last_fullsized': '2023-11-28T20:08:38.015320+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:08:45.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-11-28T20:08:45.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-11-28T20:08:45.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.016267+0000', 'last_change': '2023-11-28T20:08:38.016267+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.016267+0000', 'last_undegraded': '2023-11-28T20:08:38.016267+0000', 'last_fullsized': '2023-11-28T20:08:38.016267+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:08:45.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-11-28T20:08:45.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-11-28T20:08:45.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.015359+0000', 'last_change': '2023-11-28T20:08:38.015359+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.015359+0000', 'last_undegraded': '2023-11-28T20:08:38.015359+0000', 'last_fullsized': '2023-11-28T20:08:38.015359+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:08:45.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-11-28T20:08:45.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-11-28T20:08:45.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.094614+0000', 'last_change': '2023-11-28T20:08:38.094614+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.094614+0000', 'last_undegraded': '2023-11-28T20:08:38.094614+0000', 'last_fullsized': '2023-11-28T20:08:38.094614+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:08:45.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-11-28T20:08:45.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-11-28T20:08:45.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.019909+0000', 'last_change': '2023-11-28T20:08:38.019909+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.019909+0000', 'last_undegraded': '2023-11-28T20:08:38.019909+0000', 'last_fullsized': '2023-11-28T20:08:38.019909+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:08:45.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-11-28T20:08:45.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-11-28T20:08:45.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.016599+0000', 'last_change': '2023-11-28T20:08:38.016599+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.016599+0000', 'last_undegraded': '2023-11-28T20:08:38.016599+0000', 'last_fullsized': '2023-11-28T20:08:38.016599+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:08:45.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-11-28T20:08:45.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-11-28T20:08:45.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.020475+0000', 'last_change': '2023-11-28T20:08:38.020475+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.020475+0000', 'last_undegraded': '2023-11-28T20:08:38.020475+0000', 'last_fullsized': '2023-11-28T20:08:38.020475+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:08:45.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-11-28T20:08:45.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-11-28T20:08:45.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.018493+0000', 'last_change': '2023-11-28T20:08:38.018493+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.018493+0000', 'last_undegraded': '2023-11-28T20:08:38.018493+0000', 'last_fullsized': '2023-11-28T20:08:38.018493+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:08:45.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-11-28T20:08:45.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-11-28T20:08:45.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.094035+0000', 'last_change': '2023-11-28T20:08:38.094035+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.094035+0000', 'last_undegraded': '2023-11-28T20:08:38.094035+0000', 'last_fullsized': '2023-11-28T20:08:38.094035+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:08:45.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-11-28T20:08:45.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-11-28T20:08:45.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.018441+0000', 'last_change': '2023-11-28T20:08:38.018441+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.018441+0000', 'last_undegraded': '2023-11-28T20:08:38.018441+0000', 'last_fullsized': '2023-11-28T20:08:38.018441+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:08:45.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-11-28T20:08:45.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-11-28T20:08:45.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.094040+0000', 'last_change': '2023-11-28T20:08:38.094040+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.094040+0000', 'last_undegraded': '2023-11-28T20:08:38.094040+0000', 'last_fullsized': '2023-11-28T20:08:38.094040+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:08:45.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-11-28T20:08:45.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-11-28T20:08:45.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.018471+0000', 'last_change': '2023-11-28T20:08:38.018471+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.018471+0000', 'last_undegraded': '2023-11-28T20:08:38.018471+0000', 'last_fullsized': '2023-11-28T20:08:38.018471+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:08:45.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-11-28T20:08:45.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-11-28T20:08:45.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.015983+0000', 'last_change': '2023-11-28T20:08:38.015983+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.015983+0000', 'last_undegraded': '2023-11-28T20:08:38.015983+0000', 'last_fullsized': '2023-11-28T20:08:38.015983+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:08:45.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-11-28T20:08:45.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-11-28T20:08:45.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.015472+0000', 'last_change': '2023-11-28T20:08:38.015472+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.015472+0000', 'last_undegraded': '2023-11-28T20:08:38.015472+0000', 'last_fullsized': '2023-11-28T20:08:38.015472+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:08:45.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-11-28T20:08:45.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T20:08:39.012458+0000', 'last_change': '2023-11-28T20:08:39.012458+0000', 'last_active': '2023-11-28T20:08:39.012458+0000', 'last_peered': '2023-11-28T20:08:39.012458+0000', 'last_clean': '2023-11-28T20:08:39.012458+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:39.012458+0000', 'last_undegraded': '2023-11-28T20:08:39.012458+0000', 'last_fullsized': '2023-11-28T20:08:39.012458+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:39.012458+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T20:08:45.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-11-28T20:08:45.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:08:38.019978+0000', 'last_change': '2023-11-28T20:08:38.019978+0000', 'last_active': '2023-11-28T20:08:38.004282+0000', 'last_peered': '2023-11-28T20:08:38.004282+0000', 'last_clean': '2023-11-28T20:08:38.004282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:08:38.019978+0000', 'last_undegraded': '2023-11-28T20:08:38.019978+0000', 'last_fullsized': '2023-11-28T20:08:38.019978+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'last_clean_scrub_stamp': '2023-11-28T20:08:38.004282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:08:45.081 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T20:08:45.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.230+0000 7fcc461c4640 1 Processor -- start 2023-11-28T20:08:45.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.230+0000 7fcc461c4640 1 -- start start 2023-11-28T20:08:45.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.230+0000 7fcc461c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4015ad40 0x7fcc40164df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:45.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.230+0000 7fcc461c4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4015b3a0 con 0x7fcc4006c9d0 2023-11-28T20:08:45.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.230+0000 7fcc461c4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4013f720 con 0x7fcc4013cf30 2023-11-28T20:08:45.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.230+0000 7fcc461c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4013d310 con 0x7fcc4015ad40 2023-11-28T20:08:45.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.230+0000 7fcc3effd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fcc4006c9d0 0x7fcc4015a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:57308/0 (socket says 172.21.15.177:57308) 2023-11-28T20:08:45.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.230+0000 7fcc3effd640 1 -- 172.21.15.177:0/3565087994 learned_addr learned my addr 172.21.15.177:0/3565087994 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:45.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.230+0000 7fcc3ffff640 1 --2- 172.21.15.177:0/3565087994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4015ad40 0x7fcc40164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:45.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.230+0000 7fcc3e7fc640 1 -- 172.21.15.177:0/3565087994 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301041662 0 0) 0x7fcc4015b3a0 con 0x7fcc4006c9d0 2023-11-28T20:08:45.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.230+0000 7fcc3e7fc640 1 -- 172.21.15.177:0/3565087994 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc28003530 con 0x7fcc4006c9d0 2023-11-28T20:08:45.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.230+0000 7fcc3ffff640 1 -- 172.21.15.177:0/3565087994 >> v1:172.21.15.195:6789/0 conn(0x7fcc4013cf30 legacy=0x7fcc4006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.230+0000 7fcc3e7fc640 1 -- 172.21.15.177:0/3565087994 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962308355 0 0) 0x7fcc4013f720 con 0x7fcc4013cf30 2023-11-28T20:08:45.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.230+0000 7fcc3ffff640 1 -- 172.21.15.177:0/3565087994 >> v1:172.21.15.177:6789/0 conn(0x7fcc4006c9d0 legacy=0x7fcc4015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.230+0000 7fcc3ffff640 1 -- 172.21.15.177:0/3565087994 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4013fa00 con 0x7fcc4015ad40 2023-11-28T20:08:45.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.234+0000 7fcc3ffff640 1 --2- 172.21.15.177:0/3565087994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4015ad40 0x7fcc40164df0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcc38009dc0 tx=0x7fcc3801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d10e9b84e7ec15d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:45.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.234+0000 7fcc3e7fc640 1 -- 172.21.15.177:0/3565087994 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc380a57a0 con 0x7fcc4015ad40 2023-11-28T20:08:45.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.234+0000 7fcc3e7fc640 1 -- 172.21.15.177:0/3565087994 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc380a5900 con 0x7fcc4015ad40 2023-11-28T20:08:45.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.234+0000 7fcc3e7fc640 1 -- 172.21.15.177:0/3565087994 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc380a5c90 con 0x7fcc4015ad40 2023-11-28T20:08:45.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.234+0000 7fcc461c4640 1 -- 172.21.15.177:0/3565087994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4015ad40 msgr2=0x7fcc40164df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.234+0000 7fcc461c4640 1 --2- 172.21.15.177:0/3565087994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4015ad40 0x7fcc40164df0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcc38009dc0 tx=0x7fcc3801c8e0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.234+0000 7fcc461c4640 1 -- 172.21.15.177:0/3565087994 shutdown_connections 2023-11-28T20:08:45.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.234+0000 7fcc461c4640 1 --2- 172.21.15.177:0/3565087994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4015ad40 0x7fcc40164df0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.234+0000 7fcc461c4640 1 -- 172.21.15.177:0/3565087994 >> 172.21.15.177:0/3565087994 conn(0x7fcc4006a530 msgr2=0x7fcc4006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:45.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.234+0000 7fcc461c4640 1 -- 172.21.15.177:0/3565087994 shutdown_connections 2023-11-28T20:08:45.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.234+0000 7fcc461c4640 1 -- 172.21.15.177:0/3565087994 wait complete. 2023-11-28T20:08:45.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc461c4640 1 Processor -- start 2023-11-28T20:08:45.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc461c4640 1 -- start start 2023-11-28T20:08:45.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc461c4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc4006c9d0 0x7fcc400b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:45.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc461c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4013cf30 0x7fcc40159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:45.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc461c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc4015ad40 0x7fcc401596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:45.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc461c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4013bf00 con 0x7fcc4015ad40 2023-11-28T20:08:45.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc461c4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4013a530 con 0x7fcc4006c9d0 2023-11-28T20:08:45.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc461c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4013c170 con 0x7fcc4013cf30 2023-11-28T20:08:45.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc3ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc4015ad40 0x7fcc401596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:45.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc3ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc4015ad40 0x7fcc401596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48224/0 (socket says 172.21.15.177:48224) 2023-11-28T20:08:45.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc3ffff640 1 -- 172.21.15.177:0/3357812244 learned_addr learned my addr 172.21.15.177:0/3357812244 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:45.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc3effd640 1 --2- 172.21.15.177:0/3357812244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4013cf30 0x7fcc40159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:45.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc3f7fe640 1 --2- 172.21.15.177:0/3357812244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc4006c9d0 0x7fcc400b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:45.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc3ffff640 1 -- 172.21.15.177:0/3357812244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4013cf30 msgr2=0x7fcc40159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc3ffff640 1 --2- 172.21.15.177:0/3357812244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4013cf30 0x7fcc40159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc3ffff640 1 -- 172.21.15.177:0/3357812244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc4006c9d0 msgr2=0x7fcc400b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc3ffff640 1 --2- 172.21.15.177:0/3357812244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc4006c9d0 0x7fcc400b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc3ffff640 1 -- 172.21.15.177:0/3357812244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc38009a70 con 0x7fcc4015ad40 2023-11-28T20:08:45.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc3ffff640 1 --2- 172.21.15.177:0/3357812244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc4015ad40 0x7fcc401596c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcc380194f0 tx=0x7fcc38019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:45.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc27fff640 1 -- 172.21.15.177:0/3357812244 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc380ad640 con 0x7fcc4015ad40 2023-11-28T20:08:45.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc27fff640 1 -- 172.21.15.177:0/3357812244 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc380ad7a0 con 0x7fcc4015ad40 2023-11-28T20:08:45.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc461c4640 1 -- 172.21.15.177:0/3357812244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4013c450 con 0x7fcc4015ad40 2023-11-28T20:08:45.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc27fff640 1 -- 172.21.15.177:0/3357812244 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc380adb30 con 0x7fcc4015ad40 2023-11-28T20:08:45.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc461c4640 1 -- 172.21.15.177:0/3357812244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc400b3c70 con 0x7fcc4015ad40 2023-11-28T20:08:45.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.238+0000 7fcc461c4640 1 -- 172.21.15.177:0/3357812244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc40069440 con 0x7fcc4015ad40 2023-11-28T20:08:45.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.242+0000 7fcc27fff640 1 -- 172.21.15.177:0/3357812244 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc380b4070 con 0x7fcc4015ad40 2023-11-28T20:08:45.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.242+0000 7fcc27fff640 1 --2- 172.21.15.177:0/3357812244 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcc2c066470 0x7fcc2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:45.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.242+0000 7fcc27fff640 1 -- 172.21.15.177:0/3357812244 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc3811e400 con 0x7fcc4015ad40 2023-11-28T20:08:45.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.242+0000 7fcc3f7fe640 1 --2- 172.21.15.177:0/3357812244 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcc2c066470 0x7fcc2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:45.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.242+0000 7fcc3f7fe640 1 --2- 172.21.15.177:0/3357812244 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcc2c066470 0x7fcc2c068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcc4015d6b0 tx=0x7fcc30009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:45.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.246+0000 7fcc27fff640 1 -- 172.21.15.177:0/3357812244 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc380eb920 con 0x7fcc4015ad40 2023-11-28T20:08:45.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.450+0000 7fcc461c4640 1 -- 172.21.15.177:0/3357812244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fcc4006d1e0 con 0x7fcc4015ad40 2023-11-28T20:08:45.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.450+0000 7fcc27fff640 1 -- 172.21.15.177:0/3357812244 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1655 (secure 0 0 0) 0x7fcc380eef40 con 0x7fcc4015ad40 2023-11-28T20:08:45.452 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:45.452 INFO:teuthology.orchestra.run.smithi177.stdout:{"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":89,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1701202048,"num_in_osds":8,"osd_in_since":1701202039,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":237977600,"bytes_avail":772856135680,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5214}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-11-28T20:08:29.427883+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T20:08:45.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.450+0000 7fcc461c4640 1 -- 172.21.15.177:0/3357812244 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcc2c066470 msgr2=0x7fcc2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.450+0000 7fcc461c4640 1 --2- 172.21.15.177:0/3357812244 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcc2c066470 0x7fcc2c068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcc4015d6b0 tx=0x7fcc30009040 comp rx=0 tx=0).stop 2023-11-28T20:08:45.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.450+0000 7fcc461c4640 1 -- 172.21.15.177:0/3357812244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc4015ad40 msgr2=0x7fcc401596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.450+0000 7fcc461c4640 1 --2- 172.21.15.177:0/3357812244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc4015ad40 0x7fcc401596c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcc380194f0 tx=0x7fcc38019680 comp rx=0 tx=0).stop 2023-11-28T20:08:45.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.450+0000 7fcc461c4640 1 -- 172.21.15.177:0/3357812244 shutdown_connections 2023-11-28T20:08:45.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.450+0000 7fcc461c4640 1 --2- 172.21.15.177:0/3357812244 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcc2c066470 0x7fcc2c068930 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.450+0000 7fcc461c4640 1 --2- 172.21.15.177:0/3357812244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc4015ad40 0x7fcc401596c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.450+0000 7fcc461c4640 1 --2- 172.21.15.177:0/3357812244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4013cf30 0x7fcc40159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.450+0000 7fcc461c4640 1 --2- 172.21.15.177:0/3357812244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc4006c9d0 0x7fcc400b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.450+0000 7fcc461c4640 1 -- 172.21.15.177:0/3357812244 >> 172.21.15.177:0/3357812244 conn(0x7fcc4006a530 msgr2=0x7fcc4015b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:45.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.450+0000 7fcc461c4640 1 -- 172.21.15.177:0/3357812244 shutdown_connections 2023-11-28T20:08:45.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.450+0000 7fcc461c4640 1 -- 172.21.15.177:0/3357812244 wait complete. 2023-11-28T20:08:45.473 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T20:08:45.473 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:08:45.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.610+0000 7ff0ea617640 1 Processor -- start 2023-11-28T20:08:45.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.610+0000 7ff0ea617640 1 -- start start 2023-11-28T20:08:45.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.610+0000 7ff0ea617640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff0e40af030 0x7ff0e406d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:45.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.610+0000 7ff0ea617640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e415b800 con 0x7ff0e40aebb0 2023-11-28T20:08:45.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.610+0000 7ff0ea617640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e415bae0 con 0x7ff0e406b540 2023-11-28T20:08:45.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.610+0000 7ff0ea617640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e415c480 con 0x7ff0e40af030 2023-11-28T20:08:45.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.610+0000 7ff0e8bb4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff0e40af030 0x7ff0e406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:45.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.610+0000 7ff0e37fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ff0e40aebb0 0x7ff0e406cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:57324/0 (socket says 172.21.15.177:57324) 2023-11-28T20:08:45.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.610+0000 7ff0e37fe640 1 -- 172.21.15.177:0/1385119006 learned_addr learned my addr 172.21.15.177:0/1385119006 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:45.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.610+0000 7ff0e8bb4640 1 -- 172.21.15.177:0/1385119006 >> v1:172.21.15.195:6789/0 conn(0x7ff0e406b540 legacy=0x7ff0e406b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.610+0000 7ff0e8bb4640 1 -- 172.21.15.177:0/1385119006 >> v1:172.21.15.177:6789/0 conn(0x7ff0e40aebb0 legacy=0x7ff0e406cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.610+0000 7ff0e8bb4640 1 -- 172.21.15.177:0/1385119006 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e415bdc0 con 0x7ff0e40af030 2023-11-28T20:08:45.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.614+0000 7ff0e8bb4640 1 --2- 172.21.15.177:0/1385119006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e40af030 0x7ff0e406d640 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009d90 tx=0x7ff0dc01d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49fe7b069cabeed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:45.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.614+0000 7ff0e2ffd640 1 -- 172.21.15.177:0/1385119006 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0a5a00 con 0x7ff0e40af030 2023-11-28T20:08:45.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.614+0000 7ff0e2ffd640 1 -- 172.21.15.177:0/1385119006 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc0a5b60 con 0x7ff0e40af030 2023-11-28T20:08:45.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.614+0000 7ff0e2ffd640 1 -- 172.21.15.177:0/1385119006 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0ad440 con 0x7ff0e40af030 2023-11-28T20:08:45.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.614+0000 7ff0ea617640 1 -- 172.21.15.177:0/1385119006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e40af030 msgr2=0x7ff0e406d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.614+0000 7ff0ea617640 1 --2- 172.21.15.177:0/1385119006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e40af030 0x7ff0e406d640 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009d90 tx=0x7ff0dc01d380 comp rx=0 tx=0).stop 2023-11-28T20:08:45.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.614+0000 7ff0ea617640 1 -- 172.21.15.177:0/1385119006 shutdown_connections 2023-11-28T20:08:45.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.614+0000 7ff0ea617640 1 --2- 172.21.15.177:0/1385119006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e40af030 0x7ff0e406d640 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.614+0000 7ff0ea617640 1 -- 172.21.15.177:0/1385119006 >> 172.21.15.177:0/1385119006 conn(0x7ff0e40b1af0 msgr2=0x7ff0e4070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:45.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.614+0000 7ff0ea617640 1 -- 172.21.15.177:0/1385119006 shutdown_connections 2023-11-28T20:08:45.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.614+0000 7ff0ea617640 1 -- 172.21.15.177:0/1385119006 wait complete. 2023-11-28T20:08:45.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0ea617640 1 Processor -- start 2023-11-28T20:08:45.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0ea617640 1 -- start start 2023-11-28T20:08:45.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0ea617640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff0e406b540 0x7ff0e40af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:45.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0ea617640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e40aebb0 0x7ff0e415dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:45.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0ea617640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e40af030 0x7ff0e415e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:45.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0ea617640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e4151660 con 0x7ff0e40af030 2023-11-28T20:08:45.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0ea617640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e4151940 con 0x7ff0e40aebb0 2023-11-28T20:08:45.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0ea617640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e4151c20 con 0x7ff0e406b540 2023-11-28T20:08:45.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e8bb4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e40af030 0x7ff0e415e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:45.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e8bb4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e40af030 0x7ff0e415e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48254/0 (socket says 172.21.15.177:48254) 2023-11-28T20:08:45.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e8bb4640 1 -- 172.21.15.177:0/2113607041 learned_addr learned my addr 172.21.15.177:0/2113607041 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:45.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e37fe640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e40aebb0 0x7ff0e415dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:45.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e3fff640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff0e406b540 0x7ff0e40af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:45.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e8bb4640 1 -- 172.21.15.177:0/2113607041 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff0e406b540 msgr2=0x7ff0e40af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e8bb4640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff0e406b540 0x7ff0e40af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e8bb4640 1 -- 172.21.15.177:0/2113607041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e40aebb0 msgr2=0x7ff0e415dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e8bb4640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e40aebb0 0x7ff0e415dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e8bb4640 1 -- 172.21.15.177:0/2113607041 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc009a70 con 0x7ff0e40af030 2023-11-28T20:08:45.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e3fff640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff0e406b540 0x7ff0e40af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:45.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e37fe640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e40aebb0 0x7ff0e415dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:45.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e8bb4640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e40af030 0x7ff0e415e2c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc019530 tx=0x7ff0e406e390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:45.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e0ff9640 1 -- 172.21.15.177:0/2113607041 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0ade80 con 0x7ff0e40af030 2023-11-28T20:08:45.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e0ff9640 1 -- 172.21.15.177:0/2113607041 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc0b9450 con 0x7ff0e40af030 2023-11-28T20:08:45.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0e0ff9640 1 -- 172.21.15.177:0/2113607041 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0b97e0 con 0x7ff0e40af030 2023-11-28T20:08:45.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0ea617640 1 -- 172.21.15.177:0/2113607041 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e4151f00 con 0x7ff0e40af030 2023-11-28T20:08:45.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.618+0000 7ff0ea617640 1 -- 172.21.15.177:0/2113607041 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e41512f0 con 0x7ff0e40af030 2023-11-28T20:08:45.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.622+0000 7ff0ea617640 1 -- 172.21.15.177:0/2113607041 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e4069440 con 0x7ff0e40af030 2023-11-28T20:08:45.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.622+0000 7ff0e0ff9640 1 -- 172.21.15.177:0/2113607041 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff0dc0b9940 con 0x7ff0e40af030 2023-11-28T20:08:45.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.622+0000 7ff0e0ff9640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff0d0066470 0x7ff0d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:45.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.622+0000 7ff0e0ff9640 1 -- 172.21.15.177:0/2113607041 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0dc11f7c0 con 0x7ff0e40af030 2023-11-28T20:08:45.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.622+0000 7ff0e3fff640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff0d0066470 0x7ff0d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:45.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.622+0000 7ff0e3fff640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff0d0066470 0x7ff0d0068930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40b0020 tx=0x7ff0d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:45.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.626+0000 7ff0e0ff9640 1 -- 172.21.15.177:0/2113607041 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0dc0ecba0 con 0x7ff0e40af030 2023-11-28T20:08:45.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.774+0000 7ff0ea617640 1 -- 172.21.15.177:0/2113607041 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0e4168cb0 con 0x7ff0d0066470 2023-11-28T20:08:45.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.782+0000 7ff0e0ff9640 1 -- 172.21.15.177:0/2113607041 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288912 (secure 0 0 0) 0x7ff0d40050d0 con 0x7ff0d0066470 2023-11-28T20:08:45.786 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:45.788 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:08:45.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.786+0000 7ff0ea617640 1 -- 172.21.15.177:0/2113607041 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff0d0066470 msgr2=0x7ff0d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.786+0000 7ff0ea617640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff0d0066470 0x7ff0d0068930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40b0020 tx=0x7ff0d4009040 comp rx=0 tx=0).stop 2023-11-28T20:08:45.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.786+0000 7ff0ea617640 1 -- 172.21.15.177:0/2113607041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e40af030 msgr2=0x7ff0e415e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:45.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.786+0000 7ff0ea617640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e40af030 0x7ff0e415e2c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc019530 tx=0x7ff0e406e390 comp rx=0 tx=0).stop 2023-11-28T20:08:45.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.786+0000 7ff0ea617640 1 -- 172.21.15.177:0/2113607041 shutdown_connections 2023-11-28T20:08:45.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.786+0000 7ff0ea617640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff0d0066470 0x7ff0d0068930 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.786+0000 7ff0ea617640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e40af030 0x7ff0e415e2c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.786+0000 7ff0ea617640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e40aebb0 0x7ff0e415dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.786+0000 7ff0ea617640 1 --2- 172.21.15.177:0/2113607041 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff0e406b540 0x7ff0e40af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.786+0000 7ff0ea617640 1 -- 172.21.15.177:0/2113607041 >> 172.21.15.177:0/2113607041 conn(0x7ff0e40b1af0 msgr2=0x7ff0e40cd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.786+0000 7ff0ea617640 1 -- 172.21.15.177:0/2113607041 shutdown_connections 2023-11-28T20:08:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:45.786+0000 7ff0ea617640 1 -- 172.21.15.177:0/2113607041 wait complete. 2023-11-28T20:08:45.807 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-11-28T20:08:45.430319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236948,"kb_used_data":4112,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737772,"statfs":{"total":773094113280,"available":772851478528,"internally_reserved":0,"allocated":4210688,"data_stored":2347052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.406464"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.417641+0000","last_change":"2023-11-28T20:08:40.052951+0000","last_active":"2023-11-28T20:08:43.417641+0000","last_peered":"2023-11-28T20:08:43.417641+0000","last_clean":"2023-11-28T20:08:43.417641+0000","last_became_active":"2023-11-28T20:08:40.052540+0000","last_became_peered":"2023-11-28T20:08:40.052540+0000","last_unstale":"2023-11-28T20:08:43.417641+0000","last_undegraded":"2023-11-28T20:08:43.417641+0000","last_fullsized":"2023-11-28T20:08:43.417641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:43.229485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.048524+0000","last_change":"2023-11-28T20:08:40.045841+0000","last_active":"2023-11-28T20:08:41.048524+0000","last_peered":"2023-11-28T20:08:41.048524+0000","last_clean":"2023-11-28T20:08:41.048524+0000","last_became_active":"2023-11-28T20:08:40.045576+0000","last_became_peered":"2023-11-28T20:08:40.045576+0000","last_unstale":"2023-11-28T20:08:41.048524+0000","last_undegraded":"2023-11-28T20:08:41.048524+0000","last_fullsized":"2023-11-28T20:08:41.048524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:44.234331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668953+0000","last_change":"2023-11-28T20:08:40.052119+0000","last_active":"2023-11-28T20:08:41.668953+0000","last_peered":"2023-11-28T20:08:41.668953+0000","last_clean":"2023-11-28T20:08:41.668953+0000","last_became_active":"2023-11-28T20:08:40.051850+0000","last_became_peered":"2023-11-28T20:08:40.051850+0000","last_unstale":"2023-11-28T20:08:41.668953+0000","last_undegraded":"2023-11-28T20:08:41.668953+0000","last_fullsized":"2023-11-28T20:08:41.668953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:44.234331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047135+0000","last_change":"2023-11-28T20:08:40.053285+0000","last_active":"2023-11-28T20:08:41.047135+0000","last_peered":"2023-11-28T20:08:41.047135+0000","last_clean":"2023-11-28T20:08:41.047135+0000","last_became_active":"2023-11-28T20:08:40.052474+0000","last_became_peered":"2023-11-28T20:08:40.052474+0000","last_unstale":"2023-11-28T20:08:41.047135+0000","last_undegraded":"2023-11-28T20:08:41.047135+0000","last_fullsized":"2023-11-28T20:08:41.047135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:36.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.045808+0000","last_change":"2023-11-28T20:08:40.047637+0000","last_active":"2023-11-28T20:08:41.045808+0000","last_peered":"2023-11-28T20:08:41.045808+0000","last_clean":"2023-11-28T20:08:41.045808+0000","last_became_active":"2023-11-28T20:08:40.047330+0000","last_became_peered":"2023-11-28T20:08:40.047330+0000","last_unstale":"2023-11-28T20:08:41.045808+0000","last_undegraded":"2023-11-28T20:08:41.045808+0000","last_fullsized":"2023-11-28T20:08:41.045808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:34.898231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047582+0000","last_change":"2023-11-28T20:08:40.048675+0000","last_active":"2023-11-28T20:08:41.047582+0000","last_peered":"2023-11-28T20:08:41.047582+0000","last_clean":"2023-11-28T20:08:41.047582+0000","last_became_active":"2023-11-28T20:08:40.047298+0000","last_became_peered":"2023-11-28T20:08:40.047298+0000","last_unstale":"2023-11-28T20:08:41.047582+0000","last_undegraded":"2023-11-28T20:08:41.047582+0000","last_fullsized":"2023-11-28T20:08:41.047582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:30.085597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695313+0000","last_change":"2023-11-28T20:08:40.053337+0000","last_active":"2023-11-28T20:08:42.695313+0000","last_peered":"2023-11-28T20:08:42.695313+0000","last_clean":"2023-11-28T20:08:42.695313+0000","last_became_active":"2023-11-28T20:08:40.051946+0000","last_became_peered":"2023-11-28T20:08:40.051946+0000","last_unstale":"2023-11-28T20:08:42.695313+0000","last_undegraded":"2023-11-28T20:08:42.695313+0000","last_fullsized":"2023-11-28T20:08:42.695313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:53:36.378129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695057+0000","last_change":"2023-11-28T20:08:40.051215+0000","last_active":"2023-11-28T20:08:42.695057+0000","last_peered":"2023-11-28T20:08:42.695057+0000","last_clean":"2023-11-28T20:08:42.695057+0000","last_became_active":"2023-11-28T20:08:40.050660+0000","last_became_peered":"2023-11-28T20:08:40.050660+0000","last_unstale":"2023-11-28T20:08:42.695057+0000","last_undegraded":"2023-11-28T20:08:42.695057+0000","last_fullsized":"2023-11-28T20:08:42.695057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:54.307528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908885+0000","last_change":"2023-11-28T20:08:40.055964+0000","last_active":"2023-11-28T20:08:41.908885+0000","last_peered":"2023-11-28T20:08:41.908885+0000","last_clean":"2023-11-28T20:08:41.908885+0000","last_became_active":"2023-11-28T20:08:40.055687+0000","last_became_peered":"2023-11-28T20:08:40.055687+0000","last_unstale":"2023-11-28T20:08:41.908885+0000","last_undegraded":"2023-11-28T20:08:41.908885+0000","last_fullsized":"2023-11-28T20:08:41.908885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:06.628014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047256+0000","last_change":"2023-11-28T20:08:40.062001+0000","last_active":"2023-11-28T20:08:41.047256+0000","last_peered":"2023-11-28T20:08:41.047256+0000","last_clean":"2023-11-28T20:08:41.047256+0000","last_became_active":"2023-11-28T20:08:40.061696+0000","last_became_peered":"2023-11-28T20:08:40.061696+0000","last_unstale":"2023-11-28T20:08:41.047256+0000","last_undegraded":"2023-11-28T20:08:41.047256+0000","last_fullsized":"2023-11-28T20:08:41.047256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:00.987683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695642+0000","last_change":"2023-11-28T20:08:40.054673+0000","last_active":"2023-11-28T20:08:42.695642+0000","last_peered":"2023-11-28T20:08:42.695642+0000","last_clean":"2023-11-28T20:08:42.695642+0000","last_became_active":"2023-11-28T20:08:40.053597+0000","last_became_peered":"2023-11-28T20:08:40.053597+0000","last_unstale":"2023-11-28T20:08:42.695642+0000","last_undegraded":"2023-11-28T20:08:42.695642+0000","last_fullsized":"2023-11-28T20:08:42.695642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:27:45.978639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668907+0000","last_change":"2023-11-28T20:08:40.048165+0000","last_active":"2023-11-28T20:08:41.668907+0000","last_peered":"2023-11-28T20:08:41.668907+0000","last_clean":"2023-11-28T20:08:41.668907+0000","last_became_active":"2023-11-28T20:08:40.047465+0000","last_became_peered":"2023-11-28T20:08:40.047465+0000","last_unstale":"2023-11-28T20:08:41.668907+0000","last_undegraded":"2023-11-28T20:08:41.668907+0000","last_fullsized":"2023-11-28T20:08:41.668907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:31.385535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.045931+0000","last_change":"2023-11-28T20:08:40.052197+0000","last_active":"2023-11-28T20:08:41.045931+0000","last_peered":"2023-11-28T20:08:41.045931+0000","last_clean":"2023-11-28T20:08:41.045931+0000","last_became_active":"2023-11-28T20:08:40.051877+0000","last_became_peered":"2023-11-28T20:08:40.051877+0000","last_unstale":"2023-11-28T20:08:41.045931+0000","last_undegraded":"2023-11-28T20:08:41.045931+0000","last_fullsized":"2023-11-28T20:08:41.045931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:04.198255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047707+0000","last_change":"2023-11-28T20:08:40.041961+0000","last_active":"2023-11-28T20:08:41.047707+0000","last_peered":"2023-11-28T20:08:41.047707+0000","last_clean":"2023-11-28T20:08:41.047707+0000","last_became_active":"2023-11-28T20:08:40.041688+0000","last_became_peered":"2023-11-28T20:08:40.041688+0000","last_unstale":"2023-11-28T20:08:41.047707+0000","last_undegraded":"2023-11-28T20:08:41.047707+0000","last_fullsized":"2023-11-28T20:08:41.047707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:44:50.193301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668747+0000","last_change":"2023-11-28T20:08:40.046983+0000","last_active":"2023-11-28T20:08:41.668747+0000","last_peered":"2023-11-28T20:08:41.668747+0000","last_clean":"2023-11-28T20:08:41.668747+0000","last_became_active":"2023-11-28T20:08:40.046637+0000","last_became_peered":"2023-11-28T20:08:40.046637+0000","last_unstale":"2023-11-28T20:08:41.668747+0000","last_undegraded":"2023-11-28T20:08:41.668747+0000","last_fullsized":"2023-11-28T20:08:41.668747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:54.307528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695615+0000","last_change":"2023-11-28T20:08:40.051076+0000","last_active":"2023-11-28T20:08:42.695615+0000","last_peered":"2023-11-28T20:08:42.695615+0000","last_clean":"2023-11-28T20:08:42.695615+0000","last_became_active":"2023-11-28T20:08:40.050261+0000","last_became_peered":"2023-11-28T20:08:40.050261+0000","last_unstale":"2023-11-28T20:08:42.695615+0000","last_undegraded":"2023-11-28T20:08:42.695615+0000","last_fullsized":"2023-11-28T20:08:42.695615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:32:39.529558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695479+0000","last_change":"2023-11-28T20:08:40.059789+0000","last_active":"2023-11-28T20:08:42.695479+0000","last_peered":"2023-11-28T20:08:42.695479+0000","last_clean":"2023-11-28T20:08:42.695479+0000","last_became_active":"2023-11-28T20:08:40.059532+0000","last_became_peered":"2023-11-28T20:08:40.059532+0000","last_unstale":"2023-11-28T20:08:42.695479+0000","last_undegraded":"2023-11-28T20:08:42.695479+0000","last_fullsized":"2023-11-28T20:08:42.695479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:44.234331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.048581+0000","last_change":"2023-11-28T20:08:40.058856+0000","last_active":"2023-11-28T20:08:41.048581+0000","last_peered":"2023-11-28T20:08:41.048581+0000","last_clean":"2023-11-28T20:08:41.048581+0000","last_became_active":"2023-11-28T20:08:40.058412+0000","last_became_peered":"2023-11-28T20:08:40.058412+0000","last_unstale":"2023-11-28T20:08:41.048581+0000","last_undegraded":"2023-11-28T20:08:41.048581+0000","last_fullsized":"2023-11-28T20:08:41.048581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:06:02.491701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.048349+0000","last_change":"2023-11-28T20:08:40.055499+0000","last_active":"2023-11-28T20:08:41.048349+0000","last_peered":"2023-11-28T20:08:41.048349+0000","last_clean":"2023-11-28T20:08:41.048349+0000","last_became_active":"2023-11-28T20:08:40.055250+0000","last_became_peered":"2023-11-28T20:08:40.055250+0000","last_unstale":"2023-11-28T20:08:41.048349+0000","last_undegraded":"2023-11-28T20:08:41.048349+0000","last_fullsized":"2023-11-28T20:08:41.048349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:55.271394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.045937+0000","last_change":"2023-11-28T20:08:40.048094+0000","last_active":"2023-11-28T20:08:41.045937+0000","last_peered":"2023-11-28T20:08:41.045937+0000","last_clean":"2023-11-28T20:08:41.045937+0000","last_became_active":"2023-11-28T20:08:40.047813+0000","last_became_peered":"2023-11-28T20:08:40.047813+0000","last_unstale":"2023-11-28T20:08:41.045937+0000","last_undegraded":"2023-11-28T20:08:41.045937+0000","last_fullsized":"2023-11-28T20:08:41.045937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:20.204711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908390+0000","last_change":"2023-11-28T20:08:40.044880+0000","last_active":"2023-11-28T20:08:41.908390+0000","last_peered":"2023-11-28T20:08:41.908390+0000","last_clean":"2023-11-28T20:08:41.908390+0000","last_became_active":"2023-11-28T20:08:40.044511+0000","last_became_peered":"2023-11-28T20:08:40.044511+0000","last_unstale":"2023-11-28T20:08:41.908390+0000","last_undegraded":"2023-11-28T20:08:41.908390+0000","last_fullsized":"2023-11-28T20:08:41.908390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:43:06.475495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908640+0000","last_change":"2023-11-28T20:08:40.046886+0000","last_active":"2023-11-28T20:08:41.908640+0000","last_peered":"2023-11-28T20:08:41.908640+0000","last_clean":"2023-11-28T20:08:41.908640+0000","last_became_active":"2023-11-28T20:08:40.046596+0000","last_became_peered":"2023-11-28T20:08:40.046596+0000","last_unstale":"2023-11-28T20:08:41.908640+0000","last_undegraded":"2023-11-28T20:08:41.908640+0000","last_fullsized":"2023-11-28T20:08:41.908640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:43.229485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.032311+0000","last_change":"2023-11-28T20:08:40.056328+0000","last_active":"2023-11-28T20:08:43.032311+0000","last_peered":"2023-11-28T20:08:43.032311+0000","last_clean":"2023-11-28T20:08:43.032311+0000","last_became_active":"2023-11-28T20:08:40.056022+0000","last_became_peered":"2023-11-28T20:08:40.056022+0000","last_unstale":"2023-11-28T20:08:43.032311+0000","last_undegraded":"2023-11-28T20:08:43.032311+0000","last_fullsized":"2023-11-28T20:08:43.032311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:22:14.044802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668447+0000","last_change":"2023-11-28T20:08:40.051880+0000","last_active":"2023-11-28T20:08:41.668447+0000","last_peered":"2023-11-28T20:08:41.668447+0000","last_clean":"2023-11-28T20:08:41.668447+0000","last_became_active":"2023-11-28T20:08:40.051586+0000","last_became_peered":"2023-11-28T20:08:40.051586+0000","last_unstale":"2023-11-28T20:08:41.668447+0000","last_undegraded":"2023-11-28T20:08:41.668447+0000","last_fullsized":"2023-11-28T20:08:41.668447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:59.132654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047572+0000","last_change":"2023-11-28T20:08:40.062285+0000","last_active":"2023-11-28T20:08:41.047572+0000","last_peered":"2023-11-28T20:08:41.047572+0000","last_clean":"2023-11-28T20:08:41.047572+0000","last_became_active":"2023-11-28T20:08:40.061637+0000","last_became_peered":"2023-11-28T20:08:40.061637+0000","last_unstale":"2023-11-28T20:08:41.047572+0000","last_undegraded":"2023-11-28T20:08:41.047572+0000","last_fullsized":"2023-11-28T20:08:41.047572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:59.053923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.048639+0000","last_change":"2023-11-28T20:08:40.058731+0000","last_active":"2023-11-28T20:08:41.048639+0000","last_peered":"2023-11-28T20:08:41.048639+0000","last_clean":"2023-11-28T20:08:41.048639+0000","last_became_active":"2023-11-28T20:08:40.058354+0000","last_became_peered":"2023-11-28T20:08:40.058354+0000","last_unstale":"2023-11-28T20:08:41.048639+0000","last_undegraded":"2023-11-28T20:08:41.048639+0000","last_fullsized":"2023-11-28T20:08:41.048639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:32:39.529558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047730+0000","last_change":"2023-11-28T20:08:40.056879+0000","last_active":"2023-11-28T20:08:41.047730+0000","last_peered":"2023-11-28T20:08:41.047730+0000","last_clean":"2023-11-28T20:08:41.047730+0000","last_became_active":"2023-11-28T20:08:40.056661+0000","last_became_peered":"2023-11-28T20:08:40.056661+0000","last_unstale":"2023-11-28T20:08:41.047730+0000","last_undegraded":"2023-11-28T20:08:41.047730+0000","last_fullsized":"2023-11-28T20:08:41.047730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:35.834132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668884+0000","last_change":"2023-11-28T20:08:40.043208+0000","last_active":"2023-11-28T20:08:41.668884+0000","last_peered":"2023-11-28T20:08:41.668884+0000","last_clean":"2023-11-28T20:08:41.668884+0000","last_became_active":"2023-11-28T20:08:40.042894+0000","last_became_peered":"2023-11-28T20:08:40.042894+0000","last_unstale":"2023-11-28T20:08:41.668884+0000","last_undegraded":"2023-11-28T20:08:41.668884+0000","last_fullsized":"2023-11-28T20:08:41.668884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:55.271394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908466+0000","last_change":"2023-11-28T20:08:40.046926+0000","last_active":"2023-11-28T20:08:41.908466+0000","last_peered":"2023-11-28T20:08:41.908466+0000","last_clean":"2023-11-28T20:08:41.908466+0000","last_became_active":"2023-11-28T20:08:40.046657+0000","last_became_peered":"2023-11-28T20:08:40.046657+0000","last_unstale":"2023-11-28T20:08:41.908466+0000","last_undegraded":"2023-11-28T20:08:41.908466+0000","last_fullsized":"2023-11-28T20:08:41.908466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:58.382436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695337+0000","last_change":"2023-11-28T20:08:40.058425+0000","last_active":"2023-11-28T20:08:42.695337+0000","last_peered":"2023-11-28T20:08:42.695337+0000","last_clean":"2023-11-28T20:08:42.695337+0000","last_became_active":"2023-11-28T20:08:40.057442+0000","last_became_peered":"2023-11-28T20:08:40.057442+0000","last_unstale":"2023-11-28T20:08:42.695337+0000","last_undegraded":"2023-11-28T20:08:42.695337+0000","last_fullsized":"2023-11-28T20:08:42.695337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:55.271394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.417472+0000","last_change":"2023-11-28T20:08:40.049242+0000","last_active":"2023-11-28T20:08:43.417472+0000","last_peered":"2023-11-28T20:08:43.417472+0000","last_clean":"2023-11-28T20:08:43.417472+0000","last_became_active":"2023-11-28T20:08:40.048961+0000","last_became_peered":"2023-11-28T20:08:40.048961+0000","last_unstale":"2023-11-28T20:08:43.417472+0000","last_undegraded":"2023-11-28T20:08:43.417472+0000","last_fullsized":"2023-11-28T20:08:43.417472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:58.382436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695094+0000","last_change":"2023-11-28T20:08:40.050987+0000","last_active":"2023-11-28T20:08:42.695094+0000","last_peered":"2023-11-28T20:08:42.695094+0000","last_clean":"2023-11-28T20:08:42.695094+0000","last_became_active":"2023-11-28T20:08:40.049699+0000","last_became_peered":"2023-11-28T20:08:40.049699+0000","last_unstale":"2023-11-28T20:08:42.695094+0000","last_undegraded":"2023-11-28T20:08:42.695094+0000","last_fullsized":"2023-11-28T20:08:42.695094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:03.306001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.032621+0000","last_change":"2023-11-28T20:08:40.068540+0000","last_active":"2023-11-28T20:08:43.032621+0000","last_peered":"2023-11-28T20:08:43.032621+0000","last_clean":"2023-11-28T20:08:43.032621+0000","last_became_active":"2023-11-28T20:08:40.068245+0000","last_became_peered":"2023-11-28T20:08:40.068245+0000","last_unstale":"2023-11-28T20:08:43.032621+0000","last_undegraded":"2023-11-28T20:08:43.032621+0000","last_fullsized":"2023-11-28T20:08:43.032621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:36.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.065084+0000","last_change":"2023-11-28T20:08:39.051923+0000","last_active":"2023-11-28T20:08:40.065084+0000","last_peered":"2023-11-28T20:08:40.065084+0000","last_clean":"2023-11-28T20:08:40.065084+0000","last_became_active":"2023-11-28T20:08:39.051686+0000","last_became_peered":"2023-11-28T20:08:39.051686+0000","last_unstale":"2023-11-28T20:08:40.065084+0000","last_undegraded":"2023-11-28T20:08:40.065084+0000","last_fullsized":"2023-11-28T20:08:40.065084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:26.640119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.417675+0000","last_change":"2023-11-28T20:08:40.049927+0000","last_active":"2023-11-28T20:08:43.417675+0000","last_peered":"2023-11-28T20:08:43.417675+0000","last_clean":"2023-11-28T20:08:43.417675+0000","last_became_active":"2023-11-28T20:08:40.048414+0000","last_became_peered":"2023-11-28T20:08:40.048414+0000","last_unstale":"2023-11-28T20:08:43.417675+0000","last_undegraded":"2023-11-28T20:08:43.417675+0000","last_fullsized":"2023-11-28T20:08:43.417675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:32.120496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.069433+0000","last_change":"2023-11-28T20:08:39.050457+0000","last_active":"2023-11-28T20:08:40.069433+0000","last_peered":"2023-11-28T20:08:40.069433+0000","last_clean":"2023-11-28T20:08:40.069433+0000","last_became_active":"2023-11-28T20:08:39.050147+0000","last_became_peered":"2023-11-28T20:08:39.050147+0000","last_unstale":"2023-11-28T20:08:40.069433+0000","last_undegraded":"2023-11-28T20:08:40.069433+0000","last_fullsized":"2023-11-28T20:08:40.069433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:10:06.752978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908671+0000","last_change":"2023-11-28T20:08:40.046976+0000","last_active":"2023-11-28T20:08:41.908671+0000","last_peered":"2023-11-28T20:08:41.908671+0000","last_clean":"2023-11-28T20:08:41.908671+0000","last_became_active":"2023-11-28T20:08:40.046688+0000","last_became_peered":"2023-11-28T20:08:40.046688+0000","last_unstale":"2023-11-28T20:08:41.908671+0000","last_undegraded":"2023-11-28T20:08:41.908671+0000","last_fullsized":"2023-11-28T20:08:41.908671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:32.120496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.075269+0000","last_change":"2023-11-28T20:08:39.038126+0000","last_active":"2023-11-28T20:08:40.075269+0000","last_peered":"2023-11-28T20:08:40.075269+0000","last_clean":"2023-11-28T20:08:40.075269+0000","last_became_active":"2023-11-28T20:08:39.037863+0000","last_became_peered":"2023-11-28T20:08:39.037863+0000","last_unstale":"2023-11-28T20:08:40.075269+0000","last_undegraded":"2023-11-28T20:08:40.075269+0000","last_fullsized":"2023-11-28T20:08:40.075269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:53.299352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047863+0000","last_change":"2023-11-28T20:08:40.049988+0000","last_active":"2023-11-28T20:08:41.047863+0000","last_peered":"2023-11-28T20:08:41.047863+0000","last_clean":"2023-11-28T20:08:41.047863+0000","last_became_active":"2023-11-28T20:08:40.049746+0000","last_became_peered":"2023-11-28T20:08:40.049746+0000","last_unstale":"2023-11-28T20:08:41.047863+0000","last_undegraded":"2023-11-28T20:08:41.047863+0000","last_fullsized":"2023-11-28T20:08:41.047863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:59.132654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.062039+0000","last_change":"2023-11-28T20:08:39.042090+0000","last_active":"2023-11-28T20:08:40.062039+0000","last_peered":"2023-11-28T20:08:40.062039+0000","last_clean":"2023-11-28T20:08:40.062039+0000","last_became_active":"2023-11-28T20:08:39.041294+0000","last_became_peered":"2023-11-28T20:08:39.041294+0000","last_unstale":"2023-11-28T20:08:40.062039+0000","last_undegraded":"2023-11-28T20:08:40.062039+0000","last_fullsized":"2023-11-28T20:08:40.062039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:23:00.108341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695254+0000","last_change":"2023-11-28T20:08:40.056222+0000","last_active":"2023-11-28T20:08:42.695254+0000","last_peered":"2023-11-28T20:08:42.695254+0000","last_clean":"2023-11-28T20:08:42.695254+0000","last_became_active":"2023-11-28T20:08:40.055943+0000","last_became_peered":"2023-11-28T20:08:40.055943+0000","last_unstale":"2023-11-28T20:08:42.695254+0000","last_undegraded":"2023-11-28T20:08:42.695254+0000","last_fullsized":"2023-11-28T20:08:42.695254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:44:50.193301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.073411+0000","last_change":"2023-11-28T20:08:39.055828+0000","last_active":"2023-11-28T20:08:40.073411+0000","last_peered":"2023-11-28T20:08:40.073411+0000","last_clean":"2023-11-28T20:08:40.073411+0000","last_became_active":"2023-11-28T20:08:39.055521+0000","last_became_peered":"2023-11-28T20:08:39.055521+0000","last_unstale":"2023-11-28T20:08:40.073411+0000","last_undegraded":"2023-11-28T20:08:40.073411+0000","last_fullsized":"2023-11-28T20:08:40.073411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:32.812365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668514+0000","last_change":"2023-11-28T20:08:40.045890+0000","last_active":"2023-11-28T20:08:41.668514+0000","last_peered":"2023-11-28T20:08:41.668514+0000","last_clean":"2023-11-28T20:08:41.668514+0000","last_became_active":"2023-11-28T20:08:40.045687+0000","last_became_peered":"2023-11-28T20:08:40.045687+0000","last_unstale":"2023-11-28T20:08:41.668514+0000","last_undegraded":"2023-11-28T20:08:41.668514+0000","last_fullsized":"2023-11-28T20:08:41.668514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:26:52.052106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.073396+0000","last_change":"2023-11-28T20:08:39.055341+0000","last_active":"2023-11-28T20:08:40.073396+0000","last_peered":"2023-11-28T20:08:40.073396+0000","last_clean":"2023-11-28T20:08:40.073396+0000","last_became_active":"2023-11-28T20:08:39.055067+0000","last_became_peered":"2023-11-28T20:08:39.055067+0000","last_unstale":"2023-11-28T20:08:40.073396+0000","last_undegraded":"2023-11-28T20:08:40.073396+0000","last_fullsized":"2023-11-28T20:08:40.073396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:45.860504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908574+0000","last_change":"2023-11-28T20:08:40.044328+0000","last_active":"2023-11-28T20:08:41.908574+0000","last_peered":"2023-11-28T20:08:41.908574+0000","last_clean":"2023-11-28T20:08:41.908574+0000","last_became_active":"2023-11-28T20:08:40.044046+0000","last_became_peered":"2023-11-28T20:08:40.044046+0000","last_unstale":"2023-11-28T20:08:41.908574+0000","last_undegraded":"2023-11-28T20:08:41.908574+0000","last_fullsized":"2023-11-28T20:08:41.908574+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:10:07.761153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.032575+0000","last_change":"2023-11-28T20:08:39.038642+0000","last_active":"2023-11-28T20:08:40.032575+0000","last_peered":"2023-11-28T20:08:40.032575+0000","last_clean":"2023-11-28T20:08:40.032575+0000","last_became_active":"2023-11-28T20:08:39.038381+0000","last_became_peered":"2023-11-28T20:08:39.038381+0000","last_unstale":"2023-11-28T20:08:40.032575+0000","last_undegraded":"2023-11-28T20:08:40.032575+0000","last_fullsized":"2023-11-28T20:08:40.032575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:26:51.043930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.046988+0000","last_change":"2023-11-28T20:08:40.050635+0000","last_active":"2023-11-28T20:08:41.046988+0000","last_peered":"2023-11-28T20:08:41.046988+0000","last_clean":"2023-11-28T20:08:41.046988+0000","last_became_active":"2023-11-28T20:08:40.050392+0000","last_became_peered":"2023-11-28T20:08:40.050392+0000","last_unstale":"2023-11-28T20:08:41.046988+0000","last_undegraded":"2023-11-28T20:08:41.046988+0000","last_fullsized":"2023-11-28T20:08:41.046988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:23.517883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.030083+0000","last_change":"2023-11-28T20:08:39.052418+0000","last_active":"2023-11-28T20:08:40.030083+0000","last_peered":"2023-11-28T20:08:40.030083+0000","last_clean":"2023-11-28T20:08:40.030083+0000","last_became_active":"2023-11-28T20:08:39.052119+0000","last_became_peered":"2023-11-28T20:08:39.052119+0000","last_unstale":"2023-11-28T20:08:40.030083+0000","last_undegraded":"2023-11-28T20:08:40.030083+0000","last_fullsized":"2023-11-28T20:08:40.030083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:03.190080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668768+0000","last_change":"2023-11-28T20:08:40.047577+0000","last_active":"2023-11-28T20:08:41.668768+0000","last_peered":"2023-11-28T20:08:41.668768+0000","last_clean":"2023-11-28T20:08:41.668768+0000","last_became_active":"2023-11-28T20:08:40.047289+0000","last_became_peered":"2023-11-28T20:08:40.047289+0000","last_unstale":"2023-11-28T20:08:41.668768+0000","last_undegraded":"2023-11-28T20:08:41.668768+0000","last_fullsized":"2023-11-28T20:08:41.668768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:30.085597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.030598+0000","last_change":"2023-11-28T20:08:39.051487+0000","last_active":"2023-11-28T20:08:40.030598+0000","last_peered":"2023-11-28T20:08:40.030598+0000","last_clean":"2023-11-28T20:08:40.030598+0000","last_became_active":"2023-11-28T20:08:39.051180+0000","last_became_peered":"2023-11-28T20:08:39.051180+0000","last_unstale":"2023-11-28T20:08:40.030598+0000","last_undegraded":"2023-11-28T20:08:40.030598+0000","last_fullsized":"2023-11-28T20:08:40.030598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:35.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.048752+0000","last_change":"2023-11-28T20:08:40.055719+0000","last_active":"2023-11-28T20:08:41.048752+0000","last_peered":"2023-11-28T20:08:41.048752+0000","last_clean":"2023-11-28T20:08:41.048752+0000","last_became_active":"2023-11-28T20:08:40.054746+0000","last_became_peered":"2023-11-28T20:08:40.054746+0000","last_unstale":"2023-11-28T20:08:41.048752+0000","last_undegraded":"2023-11-28T20:08:41.048752+0000","last_fullsized":"2023-11-28T20:08:41.048752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:27:45.978639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.040583+0000","last_change":"2023-11-28T20:08:39.045704+0000","last_active":"2023-11-28T20:08:40.040583+0000","last_peered":"2023-11-28T20:08:40.040583+0000","last_clean":"2023-11-28T20:08:40.040583+0000","last_became_active":"2023-11-28T20:08:39.045183+0000","last_became_peered":"2023-11-28T20:08:39.045183+0000","last_unstale":"2023-11-28T20:08:40.040583+0000","last_undegraded":"2023-11-28T20:08:40.040583+0000","last_fullsized":"2023-11-28T20:08:40.040583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:42.221309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.048388+0000","last_change":"2023-11-28T20:08:40.059424+0000","last_active":"2023-11-28T20:08:41.048388+0000","last_peered":"2023-11-28T20:08:41.048388+0000","last_clean":"2023-11-28T20:08:41.048388+0000","last_became_active":"2023-11-28T20:08:40.059058+0000","last_became_peered":"2023-11-28T20:08:40.059058+0000","last_unstale":"2023-11-28T20:08:41.048388+0000","last_undegraded":"2023-11-28T20:08:41.048388+0000","last_fullsized":"2023-11-28T20:08:41.048388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:31.385535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.067757+0000","last_change":"2023-11-28T20:08:39.038134+0000","last_active":"2023-11-28T20:08:40.067757+0000","last_peered":"2023-11-28T20:08:40.067757+0000","last_clean":"2023-11-28T20:08:40.067757+0000","last_became_active":"2023-11-28T20:08:39.037794+0000","last_became_peered":"2023-11-28T20:08:39.037794+0000","last_unstale":"2023-11-28T20:08:40.067757+0000","last_undegraded":"2023-11-28T20:08:40.067757+0000","last_fullsized":"2023-11-28T20:08:40.067757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:59.979507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668768+0000","last_change":"2023-11-28T20:08:40.060319+0000","last_active":"2023-11-28T20:08:41.668768+0000","last_peered":"2023-11-28T20:08:41.668768+0000","last_clean":"2023-11-28T20:08:41.668768+0000","last_became_active":"2023-11-28T20:08:40.055895+0000","last_became_peered":"2023-11-28T20:08:40.055895+0000","last_unstale":"2023-11-28T20:08:41.668768+0000","last_undegraded":"2023-11-28T20:08:41.668768+0000","last_fullsized":"2023-11-28T20:08:41.668768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:03.306001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.078048+0000","last_change":"2023-11-28T20:08:39.047500+0000","last_active":"2023-11-28T20:08:40.078048+0000","last_peered":"2023-11-28T20:08:40.078048+0000","last_clean":"2023-11-28T20:08:40.078048+0000","last_became_active":"2023-11-28T20:08:39.047204+0000","last_became_peered":"2023-11-28T20:08:39.047204+0000","last_unstale":"2023-11-28T20:08:40.078048+0000","last_undegraded":"2023-11-28T20:08:40.078048+0000","last_fullsized":"2023-11-28T20:08:40.078048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:58.045748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.046821+0000","last_change":"2023-11-28T20:08:40.050563+0000","last_active":"2023-11-28T20:08:41.046821+0000","last_peered":"2023-11-28T20:08:41.046821+0000","last_clean":"2023-11-28T20:08:41.046821+0000","last_became_active":"2023-11-28T20:08:40.050285+0000","last_became_peered":"2023-11-28T20:08:40.050285+0000","last_unstale":"2023-11-28T20:08:41.046821+0000","last_undegraded":"2023-11-28T20:08:41.046821+0000","last_fullsized":"2023-11-28T20:08:41.046821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:06.628014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.067605+0000","last_change":"2023-11-28T20:08:39.053709+0000","last_active":"2023-11-28T20:08:40.067605+0000","last_peered":"2023-11-28T20:08:40.067605+0000","last_clean":"2023-11-28T20:08:40.067605+0000","last_became_active":"2023-11-28T20:08:39.053407+0000","last_became_peered":"2023-11-28T20:08:39.053407+0000","last_unstale":"2023-11-28T20:08:40.067605+0000","last_undegraded":"2023-11-28T20:08:40.067605+0000","last_fullsized":"2023-11-28T20:08:40.067605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:58.041266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.048275+0000","last_change":"2023-11-28T20:08:40.045614+0000","last_active":"2023-11-28T20:08:41.048275+0000","last_peered":"2023-11-28T20:08:41.048275+0000","last_clean":"2023-11-28T20:08:41.048275+0000","last_became_active":"2023-11-28T20:08:40.045110+0000","last_became_peered":"2023-11-28T20:08:40.045110+0000","last_unstale":"2023-11-28T20:08:41.048275+0000","last_undegraded":"2023-11-28T20:08:41.048275+0000","last_fullsized":"2023-11-28T20:08:41.048275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:53:36.378129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.040332+0000","last_change":"2023-11-28T20:08:39.044015+0000","last_active":"2023-11-28T20:08:40.040332+0000","last_peered":"2023-11-28T20:08:40.040332+0000","last_clean":"2023-11-28T20:08:40.040332+0000","last_became_active":"2023-11-28T20:08:39.043754+0000","last_became_peered":"2023-11-28T20:08:39.043754+0000","last_unstale":"2023-11-28T20:08:40.040332+0000","last_undegraded":"2023-11-28T20:08:40.040332+0000","last_fullsized":"2023-11-28T20:08:40.040332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:43:05.467320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695538+0000","last_change":"2023-11-28T20:08:40.061311+0000","last_active":"2023-11-28T20:08:42.695538+0000","last_peered":"2023-11-28T20:08:42.695538+0000","last_clean":"2023-11-28T20:08:42.695538+0000","last_became_active":"2023-11-28T20:08:40.060939+0000","last_became_peered":"2023-11-28T20:08:40.060939+0000","last_unstale":"2023-11-28T20:08:42.695538+0000","last_undegraded":"2023-11-28T20:08:42.695538+0000","last_fullsized":"2023-11-28T20:08:42.695538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:06:02.491701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.030529+0000","last_change":"2023-11-28T20:08:39.044109+0000","last_active":"2023-11-28T20:08:40.030529+0000","last_peered":"2023-11-28T20:08:40.030529+0000","last_clean":"2023-11-28T20:08:40.030529+0000","last_became_active":"2023-11-28T20:08:39.043914+0000","last_became_peered":"2023-11-28T20:08:39.043914+0000","last_unstale":"2023-11-28T20:08:40.030529+0000","last_undegraded":"2023-11-28T20:08:40.030529+0000","last_fullsized":"2023-11-28T20:08:40.030529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:22.509707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.417600+0000","last_change":"2023-11-28T20:08:40.047394+0000","last_active":"2023-11-28T20:08:43.417600+0000","last_peered":"2023-11-28T20:08:43.417600+0000","last_clean":"2023-11-28T20:08:43.417600+0000","last_became_active":"2023-11-28T20:08:40.046969+0000","last_became_peered":"2023-11-28T20:08:40.046969+0000","last_unstale":"2023-11-28T20:08:43.417600+0000","last_undegraded":"2023-11-28T20:08:43.417600+0000","last_fullsized":"2023-11-28T20:08:43.417600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:10:07.761153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.075997+0000","last_change":"2023-11-28T20:08:39.040358+0000","last_active":"2023-11-28T20:08:40.075997+0000","last_peered":"2023-11-28T20:08:40.075997+0000","last_clean":"2023-11-28T20:08:40.075997+0000","last_became_active":"2023-11-28T20:08:39.040054+0000","last_became_peered":"2023-11-28T20:08:39.040054+0000","last_unstale":"2023-11-28T20:08:40.075997+0000","last_undegraded":"2023-11-28T20:08:40.075997+0000","last_fullsized":"2023-11-28T20:08:40.075997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:43:05.467320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908855+0000","last_change":"2023-11-28T20:08:40.044911+0000","last_active":"2023-11-28T20:08:41.908855+0000","last_peered":"2023-11-28T20:08:41.908855+0000","last_clean":"2023-11-28T20:08:41.908855+0000","last_became_active":"2023-11-28T20:08:40.044465+0000","last_became_peered":"2023-11-28T20:08:40.044465+0000","last_unstale":"2023-11-28T20:08:41.908855+0000","last_undegraded":"2023-11-28T20:08:41.908855+0000","last_fullsized":"2023-11-28T20:08:41.908855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:22:14.044802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.074211+0000","last_change":"2023-11-28T20:08:39.041688+0000","last_active":"2023-11-28T20:08:40.074211+0000","last_peered":"2023-11-28T20:08:40.074211+0000","last_clean":"2023-11-28T20:08:40.074211+0000","last_became_active":"2023-11-28T20:08:39.041313+0000","last_became_peered":"2023-11-28T20:08:39.041313+0000","last_unstale":"2023-11-28T20:08:40.074211+0000","last_undegraded":"2023-11-28T20:08:40.074211+0000","last_fullsized":"2023-11-28T20:08:40.074211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:42.221309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668777+0000","last_change":"2023-11-28T20:08:40.043820+0000","last_active":"2023-11-28T20:08:41.668777+0000","last_peered":"2023-11-28T20:08:41.668777+0000","last_clean":"2023-11-28T20:08:41.668777+0000","last_became_active":"2023-11-28T20:08:40.043559+0000","last_became_peered":"2023-11-28T20:08:40.043559+0000","last_unstale":"2023-11-28T20:08:41.668777+0000","last_undegraded":"2023-11-28T20:08:41.668777+0000","last_fullsized":"2023-11-28T20:08:41.668777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:44:50.193301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.066862+0000","last_change":"2023-11-28T20:08:39.053602+0000","last_active":"2023-11-28T20:08:40.066862+0000","last_peered":"2023-11-28T20:08:40.066862+0000","last_clean":"2023-11-28T20:08:40.066862+0000","last_became_active":"2023-11-28T20:08:39.053315+0000","last_became_peered":"2023-11-28T20:08:39.053315+0000","last_unstale":"2023-11-28T20:08:40.066862+0000","last_undegraded":"2023-11-28T20:08:40.066862+0000","last_fullsized":"2023-11-28T20:08:40.066862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:20.720449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047173+0000","last_change":"2023-11-28T20:08:40.061077+0000","last_active":"2023-11-28T20:08:41.047173+0000","last_peered":"2023-11-28T20:08:41.047173+0000","last_clean":"2023-11-28T20:08:41.047173+0000","last_became_active":"2023-11-28T20:08:40.060754+0000","last_became_peered":"2023-11-28T20:08:40.060754+0000","last_unstale":"2023-11-28T20:08:41.047173+0000","last_undegraded":"2023-11-28T20:08:41.047173+0000","last_fullsized":"2023-11-28T20:08:41.047173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:51:57.420205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.068130+0000","last_change":"2023-11-28T20:08:39.051771+0000","last_active":"2023-11-28T20:08:40.068130+0000","last_peered":"2023-11-28T20:08:40.068130+0000","last_clean":"2023-11-28T20:08:40.068130+0000","last_became_active":"2023-11-28T20:08:39.051358+0000","last_became_peered":"2023-11-28T20:08:39.051358+0000","last_unstale":"2023-11-28T20:08:40.068130+0000","last_undegraded":"2023-11-28T20:08:40.068130+0000","last_fullsized":"2023-11-28T20:08:40.068130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:39.748590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.046260+0000","last_change":"2023-11-28T20:08:40.053305+0000","last_active":"2023-11-28T20:08:41.046260+0000","last_peered":"2023-11-28T20:08:41.046260+0000","last_clean":"2023-11-28T20:08:41.046260+0000","last_became_active":"2023-11-28T20:08:40.052993+0000","last_became_peered":"2023-11-28T20:08:40.052993+0000","last_unstale":"2023-11-28T20:08:41.046260+0000","last_undegraded":"2023-11-28T20:08:41.046260+0000","last_fullsized":"2023-11-28T20:08:41.046260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:59:47.156481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.030472+0000","last_change":"2023-11-28T20:08:39.054927+0000","last_active":"2023-11-28T20:08:40.030472+0000","last_peered":"2023-11-28T20:08:40.030472+0000","last_clean":"2023-11-28T20:08:40.030472+0000","last_became_active":"2023-11-28T20:08:39.054571+0000","last_became_peered":"2023-11-28T20:08:39.054571+0000","last_unstale":"2023-11-28T20:08:40.030472+0000","last_undegraded":"2023-11-28T20:08:40.030472+0000","last_fullsized":"2023-11-28T20:08:40.030472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:59:46.148305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.045832+0000","last_change":"2023-11-28T20:08:40.035572+0000","last_active":"2023-11-28T20:08:41.045832+0000","last_peered":"2023-11-28T20:08:41.045832+0000","last_clean":"2023-11-28T20:08:41.045832+0000","last_became_active":"2023-11-28T20:08:40.035289+0000","last_became_peered":"2023-11-28T20:08:40.035289+0000","last_unstale":"2023-11-28T20:08:41.045832+0000","last_undegraded":"2023-11-28T20:08:41.045832+0000","last_fullsized":"2023-11-28T20:08:41.045832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:08:12.084586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.073276+0000","last_change":"2023-11-28T20:08:39.052923+0000","last_active":"2023-11-28T20:08:40.073276+0000","last_peered":"2023-11-28T20:08:40.073276+0000","last_clean":"2023-11-28T20:08:40.073276+0000","last_became_active":"2023-11-28T20:08:39.052638+0000","last_became_peered":"2023-11-28T20:08:39.052638+0000","last_unstale":"2023-11-28T20:08:40.073276+0000","last_undegraded":"2023-11-28T20:08:40.073276+0000","last_fullsized":"2023-11-28T20:08:40.073276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:43:05.467320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.046045+0000","last_change":"2023-11-28T20:08:40.048358+0000","last_active":"2023-11-28T20:08:41.046045+0000","last_peered":"2023-11-28T20:08:41.046045+0000","last_clean":"2023-11-28T20:08:41.046045+0000","last_became_active":"2023-11-28T20:08:40.047896+0000","last_became_peered":"2023-11-28T20:08:40.047896+0000","last_unstale":"2023-11-28T20:08:41.046045+0000","last_undegraded":"2023-11-28T20:08:41.046045+0000","last_fullsized":"2023-11-28T20:08:41.046045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:46.868680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.045374+0000","last_change":"2023-11-28T20:08:39.047483+0000","last_active":"2023-11-28T20:08:40.045374+0000","last_peered":"2023-11-28T20:08:40.045374+0000","last_clean":"2023-11-28T20:08:40.045374+0000","last_became_active":"2023-11-28T20:08:39.046983+0000","last_became_peered":"2023-11-28T20:08:39.046983+0000","last_unstale":"2023-11-28T20:08:40.045374+0000","last_undegraded":"2023-11-28T20:08:40.045374+0000","last_fullsized":"2023-11-28T20:08:40.045374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:16.515072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.045744+0000","last_change":"2023-11-28T20:08:40.042981+0000","last_active":"2023-11-28T20:08:41.045744+0000","last_peered":"2023-11-28T20:08:41.045744+0000","last_clean":"2023-11-28T20:08:41.045744+0000","last_became_active":"2023-11-28T20:08:40.042706+0000","last_became_peered":"2023-11-28T20:08:40.042706+0000","last_unstale":"2023-11-28T20:08:41.045744+0000","last_undegraded":"2023-11-28T20:08:41.045744+0000","last_fullsized":"2023-11-28T20:08:41.045744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:58:17.045949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.030251+0000","last_change":"2023-11-28T20:08:39.046750+0000","last_active":"2023-11-28T20:08:40.030251+0000","last_peered":"2023-11-28T20:08:40.030251+0000","last_clean":"2023-11-28T20:08:40.030251+0000","last_became_active":"2023-11-28T20:08:39.041254+0000","last_became_peered":"2023-11-28T20:08:39.041254+0000","last_unstale":"2023-11-28T20:08:40.030251+0000","last_undegraded":"2023-11-28T20:08:40.030251+0000","last_fullsized":"2023-11-28T20:08:40.030251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:19.196536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695193+0000","last_change":"2023-11-28T20:08:40.052374+0000","last_active":"2023-11-28T20:08:42.695193+0000","last_peered":"2023-11-28T20:08:42.695193+0000","last_clean":"2023-11-28T20:08:42.695193+0000","last_became_active":"2023-11-28T20:08:40.051613+0000","last_became_peered":"2023-11-28T20:08:40.051613+0000","last_unstale":"2023-11-28T20:08:42.695193+0000","last_undegraded":"2023-11-28T20:08:42.695193+0000","last_fullsized":"2023-11-28T20:08:42.695193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:30.085597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.039306+0000","last_change":"2023-11-28T20:08:39.040971+0000","last_active":"2023-11-28T20:08:40.039306+0000","last_peered":"2023-11-28T20:08:40.039306+0000","last_clean":"2023-11-28T20:08:40.039306+0000","last_became_active":"2023-11-28T20:08:39.040632+0000","last_became_peered":"2023-11-28T20:08:39.040632+0000","last_unstale":"2023-11-28T20:08:40.039306+0000","last_undegraded":"2023-11-28T20:08:40.039306+0000","last_fullsized":"2023-11-28T20:08:40.039306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:58.045748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.046192+0000","last_change":"2023-11-28T20:08:40.046317+0000","last_active":"2023-11-28T20:08:41.046192+0000","last_peered":"2023-11-28T20:08:41.046192+0000","last_clean":"2023-11-28T20:08:41.046192+0000","last_became_active":"2023-11-28T20:08:40.045947+0000","last_became_peered":"2023-11-28T20:08:40.045947+0000","last_unstale":"2023-11-28T20:08:41.046192+0000","last_undegraded":"2023-11-28T20:08:41.046192+0000","last_fullsized":"2023-11-28T20:08:41.046192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:46.232765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.067802+0000","last_change":"2023-11-28T20:08:39.041943+0000","last_active":"2023-11-28T20:08:40.067802+0000","last_peered":"2023-11-28T20:08:40.067802+0000","last_clean":"2023-11-28T20:08:40.067802+0000","last_became_active":"2023-11-28T20:08:39.041621+0000","last_became_peered":"2023-11-28T20:08:39.041621+0000","last_unstale":"2023-11-28T20:08:40.067802+0000","last_undegraded":"2023-11-28T20:08:40.067802+0000","last_fullsized":"2023-11-28T20:08:40.067802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:31.112320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668778+0000","last_change":"2023-11-28T20:08:40.058135+0000","last_active":"2023-11-28T20:08:41.668778+0000","last_peered":"2023-11-28T20:08:41.668778+0000","last_clean":"2023-11-28T20:08:41.668778+0000","last_became_active":"2023-11-28T20:08:40.057847+0000","last_became_peered":"2023-11-28T20:08:40.057847+0000","last_unstale":"2023-11-28T20:08:41.668778+0000","last_undegraded":"2023-11-28T20:08:41.668778+0000","last_fullsized":"2023-11-28T20:08:41.668778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:53:36.378129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.032728+0000","last_change":"2023-11-28T20:08:39.048687+0000","last_active":"2023-11-28T20:08:43.032728+0000","last_peered":"2023-11-28T20:08:43.032728+0000","last_clean":"2023-11-28T20:08:43.032728+0000","last_became_active":"2023-11-28T20:08:39.048387+0000","last_became_peered":"2023-11-28T20:08:39.048387+0000","last_unstale":"2023-11-28T20:08:43.032728+0000","last_undegraded":"2023-11-28T20:08:43.032728+0000","last_fullsized":"2023-11-28T20:08:43.032728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:31.112320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.032503+0000","last_change":"2023-11-28T20:08:40.053687+0000","last_active":"2023-11-28T20:08:43.032503+0000","last_peered":"2023-11-28T20:08:43.032503+0000","last_clean":"2023-11-28T20:08:43.032503+0000","last_became_active":"2023-11-28T20:08:40.053231+0000","last_became_peered":"2023-11-28T20:08:40.053231+0000","last_unstale":"2023-11-28T20:08:43.032503+0000","last_undegraded":"2023-11-28T20:08:43.032503+0000","last_fullsized":"2023-11-28T20:08:43.032503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:23.517883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.039043+0000","last_change":"2023-11-28T20:08:39.041853+0000","last_active":"2023-11-28T20:08:40.039043+0000","last_peered":"2023-11-28T20:08:40.039043+0000","last_clean":"2023-11-28T20:08:40.039043+0000","last_became_active":"2023-11-28T20:08:39.040640+0000","last_became_peered":"2023-11-28T20:08:39.040640+0000","last_unstale":"2023-11-28T20:08:40.039043+0000","last_undegraded":"2023-11-28T20:08:40.039043+0000","last_fullsized":"2023-11-28T20:08:40.039043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:26.640119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.417440+0000","last_change":"2023-11-28T20:08:40.045812+0000","last_active":"2023-11-28T20:08:43.417440+0000","last_peered":"2023-11-28T20:08:43.417440+0000","last_clean":"2023-11-28T20:08:43.417440+0000","last_became_active":"2023-11-28T20:08:40.045558+0000","last_became_peered":"2023-11-28T20:08:40.045558+0000","last_unstale":"2023-11-28T20:08:43.417440+0000","last_undegraded":"2023-11-28T20:08:43.417440+0000","last_fullsized":"2023-11-28T20:08:43.417440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:43:06.475495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.039209+0000","last_change":"2023-11-28T20:08:39.040389+0000","last_active":"2023-11-28T20:08:40.039209+0000","last_peered":"2023-11-28T20:08:40.039209+0000","last_clean":"2023-11-28T20:08:40.039209+0000","last_became_active":"2023-11-28T20:08:39.039925+0000","last_became_peered":"2023-11-28T20:08:39.039925+0000","last_unstale":"2023-11-28T20:08:40.039209+0000","last_undegraded":"2023-11-28T20:08:40.039209+0000","last_fullsized":"2023-11-28T20:08:40.039209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:57.374261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.032466+0000","last_change":"2023-11-28T20:08:40.061372+0000","last_active":"2023-11-28T20:08:43.032466+0000","last_peered":"2023-11-28T20:08:43.032466+0000","last_clean":"2023-11-28T20:08:43.032466+0000","last_became_active":"2023-11-28T20:08:40.061102+0000","last_became_peered":"2023-11-28T20:08:40.061102+0000","last_unstale":"2023-11-28T20:08:43.032466+0000","last_undegraded":"2023-11-28T20:08:43.032466+0000","last_fullsized":"2023-11-28T20:08:43.032466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:06.628014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.040454+0000","last_change":"2023-11-28T20:08:39.040222+0000","last_active":"2023-11-28T20:08:40.040454+0000","last_peered":"2023-11-28T20:08:40.040454+0000","last_clean":"2023-11-28T20:08:40.040454+0000","last_became_active":"2023-11-28T20:08:39.039056+0000","last_became_peered":"2023-11-28T20:08:39.039056+0000","last_unstale":"2023-11-28T20:08:40.040454+0000","last_undegraded":"2023-11-28T20:08:40.040454+0000","last_fullsized":"2023-11-28T20:08:40.040454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:57.374261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047550+0000","last_change":"2023-11-28T20:08:40.054981+0000","last_active":"2023-11-28T20:08:41.047550+0000","last_peered":"2023-11-28T20:08:41.047550+0000","last_clean":"2023-11-28T20:08:41.047550+0000","last_became_active":"2023-11-28T20:08:40.054644+0000","last_became_peered":"2023-11-28T20:08:40.054644+0000","last_unstale":"2023-11-28T20:08:41.047550+0000","last_undegraded":"2023-11-28T20:08:41.047550+0000","last_fullsized":"2023-11-28T20:08:41.047550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:03.306001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.030407+0000","last_change":"2023-11-28T20:08:39.046104+0000","last_active":"2023-11-28T20:08:40.030407+0000","last_peered":"2023-11-28T20:08:40.030407+0000","last_clean":"2023-11-28T20:08:40.030407+0000","last_became_active":"2023-11-28T20:08:39.045331+0000","last_became_peered":"2023-11-28T20:08:39.045331+0000","last_unstale":"2023-11-28T20:08:40.030407+0000","last_undegraded":"2023-11-28T20:08:40.030407+0000","last_fullsized":"2023-11-28T20:08:40.030407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:45.224589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908294+0000","last_change":"2023-11-28T20:08:40.047482+0000","last_active":"2023-11-28T20:08:41.908294+0000","last_peered":"2023-11-28T20:08:41.908294+0000","last_clean":"2023-11-28T20:08:41.908294+0000","last_became_active":"2023-11-28T20:08:40.047163+0000","last_became_peered":"2023-11-28T20:08:40.047163+0000","last_unstale":"2023-11-28T20:08:41.908294+0000","last_undegraded":"2023-11-28T20:08:41.908294+0000","last_fullsized":"2023-11-28T20:08:41.908294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:27.648294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.030168+0000","last_change":"2023-11-28T20:08:39.044947+0000","last_active":"2023-11-28T20:08:40.030168+0000","last_peered":"2023-11-28T20:08:40.030168+0000","last_clean":"2023-11-28T20:08:40.030168+0000","last_became_active":"2023-11-28T20:08:39.044662+0000","last_became_peered":"2023-11-28T20:08:39.044662+0000","last_unstale":"2023-11-28T20:08:40.030168+0000","last_undegraded":"2023-11-28T20:08:40.030168+0000","last_fullsized":"2023-11-28T20:08:40.030168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:05.619838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695444+0000","last_change":"2023-11-28T20:08:40.050613+0000","last_active":"2023-11-28T20:08:42.695444+0000","last_peered":"2023-11-28T20:08:42.695444+0000","last_clean":"2023-11-28T20:08:42.695444+0000","last_became_active":"2023-11-28T20:08:40.049733+0000","last_became_peered":"2023-11-28T20:08:40.049733+0000","last_unstale":"2023-11-28T20:08:42.695444+0000","last_undegraded":"2023-11-28T20:08:42.695444+0000","last_fullsized":"2023-11-28T20:08:42.695444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:31.385535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.045196+0000","last_change":"2023-11-28T20:08:39.051230+0000","last_active":"2023-11-28T20:08:40.045196+0000","last_peered":"2023-11-28T20:08:40.045196+0000","last_clean":"2023-11-28T20:08:40.045196+0000","last_became_active":"2023-11-28T20:08:39.050779+0000","last_became_peered":"2023-11-28T20:08:39.050779+0000","last_unstale":"2023-11-28T20:08:40.045196+0000","last_undegraded":"2023-11-28T20:08:40.045196+0000","last_fullsized":"2023-11-28T20:08:40.045196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:58.041266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.035437+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:08:40.035437+0000","last_peered":"2023-11-28T20:08:40.035437+0000","last_clean":"2023-11-28T20:08:40.035437+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:08:40.035437+0000","last_undegraded":"2023-11-28T20:08:40.035437+0000","last_fullsized":"2023-11-28T20:08:40.035437+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":730920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.032}]},{"osd":1,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":1.0009999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":1.1359999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":1.165}]},{"osd":4,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":1.0920000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":1.1180000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":1.054},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.90200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":141078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":2.8279999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":3.54},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":3.9620000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":2.9830000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":3.5819999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.125},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":6.2249999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":4.0789999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":2.9390000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":8.6159999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":4.0380000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":2.879},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":3.4910000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":380928,"data_stored":147434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.67800000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.81599999999999995}]},{"osd":2,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.0209999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.84399999999999997}]},{"osd":4,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.91900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":146866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.501},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.57299999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.621}]},{"osd":2,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.67200000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.81899999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.70499999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.753}]},{"osd":7,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.96199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":6.016,"5min":6.016,"15min":6.016},"last":0.40600000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.435}]},{"osd":2,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.52200000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":5.8810000000000002,"5min":5.8810000000000002,"15min":5.8810000000000002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.9349999999999996,"5min":5.9349999999999996,"15min":5.9349999999999996},"last":0.83799999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.75900000000000001}]},{"osd":7,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.9740000000000002,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.621},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.69199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":146832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":4.4939999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":5.3140000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":3.7650000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":5.3460000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.89900000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":3.8090000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":5.2809999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.48}]},{"osd":6,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":4.5369999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":5.2039999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":3.863},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":5.2460000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.42499999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.9909999999999997,"5min":4.9909999999999997,"15min":4.9909999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.9109999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.501}]},{"osd":3,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":4.8239999999999998,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.46700000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":4.5890000000000004,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.82299999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.7889999999999997,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.7069999999999999,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.746}]},{"osd":7,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.7539999999999996,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":0.72799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":737130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.34100000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38400000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.437},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.48899999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.57499999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.66400000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.61299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:08:48.813 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:08:48.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.958+0000 7f6f3492a640 1 Processor -- start 2023-11-28T20:08:48.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.958+0000 7f6f3492a640 1 -- start start 2023-11-28T20:08:48.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.958+0000 7f6f3492a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6f3015d380 0x7f6f300c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:48.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.958+0000 7f6f3492a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f300afe00 con 0x7f6f300c8470 2023-11-28T20:08:48.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.958+0000 7f6f3492a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f300af840 con 0x7f6f300cfab0 2023-11-28T20:08:48.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.958+0000 7f6f3492a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f300afb20 con 0x7f6f3015d380 2023-11-28T20:08:48.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.958+0000 7f6f2ed9d640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f6f300c8470 0x7f6f300cd1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:59530/0 (socket says 172.21.15.177:59530) 2023-11-28T20:08:48.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.958+0000 7f6f2ed9d640 1 -- 172.21.15.177:0/4019232197 learned_addr learned my addr 172.21.15.177:0/4019232197 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:48.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.958+0000 7f6f2e59c640 1 --2- 172.21.15.177:0/4019232197 >> v2:172.21.15.195:3300/0 conn(0x7f6f3015d380 0x7f6f300c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:48.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.958+0000 7f6f2dd9b640 1 -- 172.21.15.177:0/4019232197 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904423591 0 0) 0x7f6f300afe00 con 0x7f6f300c8470 2023-11-28T20:08:48.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.958+0000 7f6f2dd9b640 1 -- 172.21.15.177:0/4019232197 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f1c003530 con 0x7f6f300c8470 2023-11-28T20:08:48.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.958+0000 7f6f2e59c640 1 -- 172.21.15.177:0/4019232197 >> v1:172.21.15.195:6789/0 conn(0x7f6f300cfab0 legacy=0x7f6f300cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:48.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.958+0000 7f6f2e59c640 1 -- 172.21.15.177:0/4019232197 >> v1:172.21.15.177:6789/0 conn(0x7f6f300c8470 legacy=0x7f6f300cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:48.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.958+0000 7f6f2e59c640 1 -- 172.21.15.177:0/4019232197 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f300cbce0 con 0x7f6f3015d380 2023-11-28T20:08:48.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.962+0000 7f6f2e59c640 1 --2- 172.21.15.177:0/4019232197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f3015d380 0x7f6f300c9050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6f200097c0 tx=0x7f6f2001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8c701dadf7cf8be server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:48.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.962+0000 7f6f2dd9b640 1 -- 172.21.15.177:0/4019232197 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f200a8050 con 0x7f6f3015d380 2023-11-28T20:08:48.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.962+0000 7f6f2dd9b640 1 -- 172.21.15.177:0/4019232197 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f200ac5f0 con 0x7f6f3015d380 2023-11-28T20:08:48.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.962+0000 7f6f2dd9b640 1 -- 172.21.15.177:0/4019232197 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f200ac980 con 0x7f6f3015d380 2023-11-28T20:08:48.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.962+0000 7f6f3492a640 1 -- 172.21.15.177:0/4019232197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f3015d380 msgr2=0x7f6f300c9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:48.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.962+0000 7f6f3492a640 1 --2- 172.21.15.177:0/4019232197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f3015d380 0x7f6f300c9050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6f200097c0 tx=0x7f6f2001c480 comp rx=0 tx=0).stop 2023-11-28T20:08:48.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.962+0000 7f6f3492a640 1 -- 172.21.15.177:0/4019232197 shutdown_connections 2023-11-28T20:08:48.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.962+0000 7f6f3492a640 1 --2- 172.21.15.177:0/4019232197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f3015d380 0x7f6f300c9050 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:48.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.962+0000 7f6f3492a640 1 -- 172.21.15.177:0/4019232197 >> 172.21.15.177:0/4019232197 conn(0x7f6f30071c50 msgr2=0x7f6f30072030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:48.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.962+0000 7f6f3492a640 1 -- 172.21.15.177:0/4019232197 shutdown_connections 2023-11-28T20:08:48.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.962+0000 7f6f3492a640 1 -- 172.21.15.177:0/4019232197 wait complete. 2023-11-28T20:08:48.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f3492a640 1 Processor -- start 2023-11-28T20:08:48.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f3492a640 1 -- start start 2023-11-28T20:08:48.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f3492a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f300c8470 0x7f6f3015c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:48.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f3492a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f300cfab0 0x7f6f3014c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:48.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f3492a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f3015d380 0x7f6f30152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:48.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f3492a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f301511c0 con 0x7f6f300c8470 2023-11-28T20:08:48.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f3492a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3014f6f0 con 0x7f6f3015d380 2023-11-28T20:08:48.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f3492a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f301505b0 con 0x7f6f300cfab0 2023-11-28T20:08:48.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f2e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f300c8470 0x7f6f3015c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:48.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f2e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f300c8470 0x7f6f3015c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55822/0 (socket says 172.21.15.177:55822) 2023-11-28T20:08:48.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f2e59c640 1 -- 172.21.15.177:0/3558819208 learned_addr learned my addr 172.21.15.177:0/3558819208 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:48.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f2ed9d640 1 --2- 172.21.15.177:0/3558819208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f3015d380 0x7f6f30152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:48.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f2e59c640 1 -- 172.21.15.177:0/3558819208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f300cfab0 msgr2=0x7f6f3014c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:48.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f2e59c640 1 --2- 172.21.15.177:0/3558819208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f300cfab0 0x7f6f3014c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:48.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f2e59c640 1 -- 172.21.15.177:0/3558819208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f3015d380 msgr2=0x7f6f30152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:48.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f2e59c640 1 --2- 172.21.15.177:0/3558819208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f3015d380 0x7f6f30152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:48.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f2e59c640 1 -- 172.21.15.177:0/3558819208 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f20009420 con 0x7f6f300c8470 2023-11-28T20:08:48.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f2ed9d640 1 --2- 172.21.15.177:0/3558819208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f3015d380 0x7f6f30152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:48.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f2e59c640 1 --2- 172.21.15.177:0/3558819208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f300c8470 0x7f6f3015c2e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6f200af040 tx=0x7f6f2001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:48.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f26ffd640 1 -- 172.21.15.177:0/3558819208 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20006e20 con 0x7f6f300c8470 2023-11-28T20:08:48.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f26ffd640 1 -- 172.21.15.177:0/3558819208 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f200b8660 con 0x7f6f300c8470 2023-11-28T20:08:48.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f26ffd640 1 -- 172.21.15.177:0/3558819208 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f200b8a30 con 0x7f6f300c8470 2023-11-28T20:08:48.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f3492a640 1 -- 172.21.15.177:0/3558819208 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f30150890 con 0x7f6f300c8470 2023-11-28T20:08:48.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.966+0000 7f6f3492a640 1 -- 172.21.15.177:0/3558819208 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f30150e50 con 0x7f6f300c8470 2023-11-28T20:08:48.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.970+0000 7f6f3492a640 1 -- 172.21.15.177:0/3558819208 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3015a3e0 con 0x7f6f300c8470 2023-11-28T20:08:48.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.970+0000 7f6f26ffd640 1 -- 172.21.15.177:0/3558819208 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6f200b8b90 con 0x7f6f300c8470 2023-11-28T20:08:48.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.970+0000 7f6f26ffd640 1 --2- 172.21.15.177:0/3558819208 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6f100664a0 0x7f6f10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:48.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.970+0000 7f6f26ffd640 1 -- 172.21.15.177:0/3558819208 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f2011e280 con 0x7f6f300c8470 2023-11-28T20:08:48.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.970+0000 7f6f27fff640 1 --2- 172.21.15.177:0/3558819208 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6f100664a0 0x7f6f10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:48.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.970+0000 7f6f27fff640 1 --2- 172.21.15.177:0/3558819208 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6f100664a0 0x7f6f10068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6f18000f70 tx=0x7f6f180079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:48.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:48.974+0000 7f6f26ffd640 1 -- 172.21.15.177:0/3558819208 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f200eb790 con 0x7f6f300c8470 2023-11-28T20:08:49.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.122+0000 7f6f3492a640 1 -- 172.21.15.177:0/3558819208 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f3016bab0 con 0x7f6f100664a0 2023-11-28T20:08:49.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.130+0000 7f6f26ffd640 1 -- 172.21.15.177:0/3558819208 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288912 (secure 0 0 0) 0x7f6f18005080 con 0x7f6f100664a0 2023-11-28T20:08:49.135 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:49.136 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:08:49.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.134+0000 7f6f3492a640 1 -- 172.21.15.177:0/3558819208 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6f100664a0 msgr2=0x7f6f10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:49.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.134+0000 7f6f3492a640 1 --2- 172.21.15.177:0/3558819208 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6f100664a0 0x7f6f10068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6f18000f70 tx=0x7f6f180079c0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.134+0000 7f6f3492a640 1 -- 172.21.15.177:0/3558819208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f300c8470 msgr2=0x7f6f3015c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:49.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.134+0000 7f6f3492a640 1 --2- 172.21.15.177:0/3558819208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f300c8470 0x7f6f3015c2e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6f200af040 tx=0x7f6f2001acc0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.134+0000 7f6f3492a640 1 -- 172.21.15.177:0/3558819208 shutdown_connections 2023-11-28T20:08:49.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.134+0000 7f6f3492a640 1 --2- 172.21.15.177:0/3558819208 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6f100664a0 0x7f6f10068960 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.134+0000 7f6f3492a640 1 --2- 172.21.15.177:0/3558819208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f3015d380 0x7f6f30152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.134+0000 7f6f3492a640 1 --2- 172.21.15.177:0/3558819208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f300cfab0 0x7f6f3014c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.134+0000 7f6f3492a640 1 --2- 172.21.15.177:0/3558819208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f300c8470 0x7f6f3015c2e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.134+0000 7f6f3492a640 1 -- 172.21.15.177:0/3558819208 >> 172.21.15.177:0/3558819208 conn(0x7f6f30071c50 msgr2=0x7f6f300aec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:49.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.134+0000 7f6f3492a640 1 -- 172.21.15.177:0/3558819208 shutdown_connections 2023-11-28T20:08:49.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.134+0000 7f6f3492a640 1 -- 172.21.15.177:0/3558819208 wait complete. 2023-11-28T20:08:49.155 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-11-28T20:08:47.430760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236948,"kb_used_data":4112,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737772,"statfs":{"total":773094113280,"available":772851478528,"internally_reserved":0,"allocated":4210688,"data_stored":2347052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001416"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.417641+0000","last_change":"2023-11-28T20:08:40.052951+0000","last_active":"2023-11-28T20:08:43.417641+0000","last_peered":"2023-11-28T20:08:43.417641+0000","last_clean":"2023-11-28T20:08:43.417641+0000","last_became_active":"2023-11-28T20:08:40.052540+0000","last_became_peered":"2023-11-28T20:08:40.052540+0000","last_unstale":"2023-11-28T20:08:43.417641+0000","last_undegraded":"2023-11-28T20:08:43.417641+0000","last_fullsized":"2023-11-28T20:08:43.417641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:43.229485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.048524+0000","last_change":"2023-11-28T20:08:40.045841+0000","last_active":"2023-11-28T20:08:41.048524+0000","last_peered":"2023-11-28T20:08:41.048524+0000","last_clean":"2023-11-28T20:08:41.048524+0000","last_became_active":"2023-11-28T20:08:40.045576+0000","last_became_peered":"2023-11-28T20:08:40.045576+0000","last_unstale":"2023-11-28T20:08:41.048524+0000","last_undegraded":"2023-11-28T20:08:41.048524+0000","last_fullsized":"2023-11-28T20:08:41.048524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:44.234331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668953+0000","last_change":"2023-11-28T20:08:40.052119+0000","last_active":"2023-11-28T20:08:41.668953+0000","last_peered":"2023-11-28T20:08:41.668953+0000","last_clean":"2023-11-28T20:08:41.668953+0000","last_became_active":"2023-11-28T20:08:40.051850+0000","last_became_peered":"2023-11-28T20:08:40.051850+0000","last_unstale":"2023-11-28T20:08:41.668953+0000","last_undegraded":"2023-11-28T20:08:41.668953+0000","last_fullsized":"2023-11-28T20:08:41.668953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:44.234331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047135+0000","last_change":"2023-11-28T20:08:40.053285+0000","last_active":"2023-11-28T20:08:41.047135+0000","last_peered":"2023-11-28T20:08:41.047135+0000","last_clean":"2023-11-28T20:08:41.047135+0000","last_became_active":"2023-11-28T20:08:40.052474+0000","last_became_peered":"2023-11-28T20:08:40.052474+0000","last_unstale":"2023-11-28T20:08:41.047135+0000","last_undegraded":"2023-11-28T20:08:41.047135+0000","last_fullsized":"2023-11-28T20:08:41.047135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:36.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.045808+0000","last_change":"2023-11-28T20:08:40.047637+0000","last_active":"2023-11-28T20:08:41.045808+0000","last_peered":"2023-11-28T20:08:41.045808+0000","last_clean":"2023-11-28T20:08:41.045808+0000","last_became_active":"2023-11-28T20:08:40.047330+0000","last_became_peered":"2023-11-28T20:08:40.047330+0000","last_unstale":"2023-11-28T20:08:41.045808+0000","last_undegraded":"2023-11-28T20:08:41.045808+0000","last_fullsized":"2023-11-28T20:08:41.045808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:34.898231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047582+0000","last_change":"2023-11-28T20:08:40.048675+0000","last_active":"2023-11-28T20:08:41.047582+0000","last_peered":"2023-11-28T20:08:41.047582+0000","last_clean":"2023-11-28T20:08:41.047582+0000","last_became_active":"2023-11-28T20:08:40.047298+0000","last_became_peered":"2023-11-28T20:08:40.047298+0000","last_unstale":"2023-11-28T20:08:41.047582+0000","last_undegraded":"2023-11-28T20:08:41.047582+0000","last_fullsized":"2023-11-28T20:08:41.047582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:30.085597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695313+0000","last_change":"2023-11-28T20:08:40.053337+0000","last_active":"2023-11-28T20:08:42.695313+0000","last_peered":"2023-11-28T20:08:42.695313+0000","last_clean":"2023-11-28T20:08:42.695313+0000","last_became_active":"2023-11-28T20:08:40.051946+0000","last_became_peered":"2023-11-28T20:08:40.051946+0000","last_unstale":"2023-11-28T20:08:42.695313+0000","last_undegraded":"2023-11-28T20:08:42.695313+0000","last_fullsized":"2023-11-28T20:08:42.695313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:53:36.378129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695057+0000","last_change":"2023-11-28T20:08:40.051215+0000","last_active":"2023-11-28T20:08:42.695057+0000","last_peered":"2023-11-28T20:08:42.695057+0000","last_clean":"2023-11-28T20:08:42.695057+0000","last_became_active":"2023-11-28T20:08:40.050660+0000","last_became_peered":"2023-11-28T20:08:40.050660+0000","last_unstale":"2023-11-28T20:08:42.695057+0000","last_undegraded":"2023-11-28T20:08:42.695057+0000","last_fullsized":"2023-11-28T20:08:42.695057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:54.307528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908885+0000","last_change":"2023-11-28T20:08:40.055964+0000","last_active":"2023-11-28T20:08:41.908885+0000","last_peered":"2023-11-28T20:08:41.908885+0000","last_clean":"2023-11-28T20:08:41.908885+0000","last_became_active":"2023-11-28T20:08:40.055687+0000","last_became_peered":"2023-11-28T20:08:40.055687+0000","last_unstale":"2023-11-28T20:08:41.908885+0000","last_undegraded":"2023-11-28T20:08:41.908885+0000","last_fullsized":"2023-11-28T20:08:41.908885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:06.628014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047256+0000","last_change":"2023-11-28T20:08:40.062001+0000","last_active":"2023-11-28T20:08:41.047256+0000","last_peered":"2023-11-28T20:08:41.047256+0000","last_clean":"2023-11-28T20:08:41.047256+0000","last_became_active":"2023-11-28T20:08:40.061696+0000","last_became_peered":"2023-11-28T20:08:40.061696+0000","last_unstale":"2023-11-28T20:08:41.047256+0000","last_undegraded":"2023-11-28T20:08:41.047256+0000","last_fullsized":"2023-11-28T20:08:41.047256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:00.987683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695642+0000","last_change":"2023-11-28T20:08:40.054673+0000","last_active":"2023-11-28T20:08:42.695642+0000","last_peered":"2023-11-28T20:08:42.695642+0000","last_clean":"2023-11-28T20:08:42.695642+0000","last_became_active":"2023-11-28T20:08:40.053597+0000","last_became_peered":"2023-11-28T20:08:40.053597+0000","last_unstale":"2023-11-28T20:08:42.695642+0000","last_undegraded":"2023-11-28T20:08:42.695642+0000","last_fullsized":"2023-11-28T20:08:42.695642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:27:45.978639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668907+0000","last_change":"2023-11-28T20:08:40.048165+0000","last_active":"2023-11-28T20:08:41.668907+0000","last_peered":"2023-11-28T20:08:41.668907+0000","last_clean":"2023-11-28T20:08:41.668907+0000","last_became_active":"2023-11-28T20:08:40.047465+0000","last_became_peered":"2023-11-28T20:08:40.047465+0000","last_unstale":"2023-11-28T20:08:41.668907+0000","last_undegraded":"2023-11-28T20:08:41.668907+0000","last_fullsized":"2023-11-28T20:08:41.668907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:31.385535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.045931+0000","last_change":"2023-11-28T20:08:40.052197+0000","last_active":"2023-11-28T20:08:41.045931+0000","last_peered":"2023-11-28T20:08:41.045931+0000","last_clean":"2023-11-28T20:08:41.045931+0000","last_became_active":"2023-11-28T20:08:40.051877+0000","last_became_peered":"2023-11-28T20:08:40.051877+0000","last_unstale":"2023-11-28T20:08:41.045931+0000","last_undegraded":"2023-11-28T20:08:41.045931+0000","last_fullsized":"2023-11-28T20:08:41.045931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:04.198255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047707+0000","last_change":"2023-11-28T20:08:40.041961+0000","last_active":"2023-11-28T20:08:41.047707+0000","last_peered":"2023-11-28T20:08:41.047707+0000","last_clean":"2023-11-28T20:08:41.047707+0000","last_became_active":"2023-11-28T20:08:40.041688+0000","last_became_peered":"2023-11-28T20:08:40.041688+0000","last_unstale":"2023-11-28T20:08:41.047707+0000","last_undegraded":"2023-11-28T20:08:41.047707+0000","last_fullsized":"2023-11-28T20:08:41.047707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:44:50.193301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668747+0000","last_change":"2023-11-28T20:08:40.046983+0000","last_active":"2023-11-28T20:08:41.668747+0000","last_peered":"2023-11-28T20:08:41.668747+0000","last_clean":"2023-11-28T20:08:41.668747+0000","last_became_active":"2023-11-28T20:08:40.046637+0000","last_became_peered":"2023-11-28T20:08:40.046637+0000","last_unstale":"2023-11-28T20:08:41.668747+0000","last_undegraded":"2023-11-28T20:08:41.668747+0000","last_fullsized":"2023-11-28T20:08:41.668747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:54.307528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695615+0000","last_change":"2023-11-28T20:08:40.051076+0000","last_active":"2023-11-28T20:08:42.695615+0000","last_peered":"2023-11-28T20:08:42.695615+0000","last_clean":"2023-11-28T20:08:42.695615+0000","last_became_active":"2023-11-28T20:08:40.050261+0000","last_became_peered":"2023-11-28T20:08:40.050261+0000","last_unstale":"2023-11-28T20:08:42.695615+0000","last_undegraded":"2023-11-28T20:08:42.695615+0000","last_fullsized":"2023-11-28T20:08:42.695615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:32:39.529558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695479+0000","last_change":"2023-11-28T20:08:40.059789+0000","last_active":"2023-11-28T20:08:42.695479+0000","last_peered":"2023-11-28T20:08:42.695479+0000","last_clean":"2023-11-28T20:08:42.695479+0000","last_became_active":"2023-11-28T20:08:40.059532+0000","last_became_peered":"2023-11-28T20:08:40.059532+0000","last_unstale":"2023-11-28T20:08:42.695479+0000","last_undegraded":"2023-11-28T20:08:42.695479+0000","last_fullsized":"2023-11-28T20:08:42.695479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:44.234331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.048581+0000","last_change":"2023-11-28T20:08:40.058856+0000","last_active":"2023-11-28T20:08:41.048581+0000","last_peered":"2023-11-28T20:08:41.048581+0000","last_clean":"2023-11-28T20:08:41.048581+0000","last_became_active":"2023-11-28T20:08:40.058412+0000","last_became_peered":"2023-11-28T20:08:40.058412+0000","last_unstale":"2023-11-28T20:08:41.048581+0000","last_undegraded":"2023-11-28T20:08:41.048581+0000","last_fullsized":"2023-11-28T20:08:41.048581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:06:02.491701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.048349+0000","last_change":"2023-11-28T20:08:40.055499+0000","last_active":"2023-11-28T20:08:41.048349+0000","last_peered":"2023-11-28T20:08:41.048349+0000","last_clean":"2023-11-28T20:08:41.048349+0000","last_became_active":"2023-11-28T20:08:40.055250+0000","last_became_peered":"2023-11-28T20:08:40.055250+0000","last_unstale":"2023-11-28T20:08:41.048349+0000","last_undegraded":"2023-11-28T20:08:41.048349+0000","last_fullsized":"2023-11-28T20:08:41.048349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:55.271394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.045937+0000","last_change":"2023-11-28T20:08:40.048094+0000","last_active":"2023-11-28T20:08:41.045937+0000","last_peered":"2023-11-28T20:08:41.045937+0000","last_clean":"2023-11-28T20:08:41.045937+0000","last_became_active":"2023-11-28T20:08:40.047813+0000","last_became_peered":"2023-11-28T20:08:40.047813+0000","last_unstale":"2023-11-28T20:08:41.045937+0000","last_undegraded":"2023-11-28T20:08:41.045937+0000","last_fullsized":"2023-11-28T20:08:41.045937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:20.204711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908390+0000","last_change":"2023-11-28T20:08:40.044880+0000","last_active":"2023-11-28T20:08:41.908390+0000","last_peered":"2023-11-28T20:08:41.908390+0000","last_clean":"2023-11-28T20:08:41.908390+0000","last_became_active":"2023-11-28T20:08:40.044511+0000","last_became_peered":"2023-11-28T20:08:40.044511+0000","last_unstale":"2023-11-28T20:08:41.908390+0000","last_undegraded":"2023-11-28T20:08:41.908390+0000","last_fullsized":"2023-11-28T20:08:41.908390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:43:06.475495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908640+0000","last_change":"2023-11-28T20:08:40.046886+0000","last_active":"2023-11-28T20:08:41.908640+0000","last_peered":"2023-11-28T20:08:41.908640+0000","last_clean":"2023-11-28T20:08:41.908640+0000","last_became_active":"2023-11-28T20:08:40.046596+0000","last_became_peered":"2023-11-28T20:08:40.046596+0000","last_unstale":"2023-11-28T20:08:41.908640+0000","last_undegraded":"2023-11-28T20:08:41.908640+0000","last_fullsized":"2023-11-28T20:08:41.908640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:43.229485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.032311+0000","last_change":"2023-11-28T20:08:40.056328+0000","last_active":"2023-11-28T20:08:43.032311+0000","last_peered":"2023-11-28T20:08:43.032311+0000","last_clean":"2023-11-28T20:08:43.032311+0000","last_became_active":"2023-11-28T20:08:40.056022+0000","last_became_peered":"2023-11-28T20:08:40.056022+0000","last_unstale":"2023-11-28T20:08:43.032311+0000","last_undegraded":"2023-11-28T20:08:43.032311+0000","last_fullsized":"2023-11-28T20:08:43.032311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:22:14.044802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668447+0000","last_change":"2023-11-28T20:08:40.051880+0000","last_active":"2023-11-28T20:08:41.668447+0000","last_peered":"2023-11-28T20:08:41.668447+0000","last_clean":"2023-11-28T20:08:41.668447+0000","last_became_active":"2023-11-28T20:08:40.051586+0000","last_became_peered":"2023-11-28T20:08:40.051586+0000","last_unstale":"2023-11-28T20:08:41.668447+0000","last_undegraded":"2023-11-28T20:08:41.668447+0000","last_fullsized":"2023-11-28T20:08:41.668447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:59.132654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047572+0000","last_change":"2023-11-28T20:08:40.062285+0000","last_active":"2023-11-28T20:08:41.047572+0000","last_peered":"2023-11-28T20:08:41.047572+0000","last_clean":"2023-11-28T20:08:41.047572+0000","last_became_active":"2023-11-28T20:08:40.061637+0000","last_became_peered":"2023-11-28T20:08:40.061637+0000","last_unstale":"2023-11-28T20:08:41.047572+0000","last_undegraded":"2023-11-28T20:08:41.047572+0000","last_fullsized":"2023-11-28T20:08:41.047572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:59.053923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.048639+0000","last_change":"2023-11-28T20:08:40.058731+0000","last_active":"2023-11-28T20:08:41.048639+0000","last_peered":"2023-11-28T20:08:41.048639+0000","last_clean":"2023-11-28T20:08:41.048639+0000","last_became_active":"2023-11-28T20:08:40.058354+0000","last_became_peered":"2023-11-28T20:08:40.058354+0000","last_unstale":"2023-11-28T20:08:41.048639+0000","last_undegraded":"2023-11-28T20:08:41.048639+0000","last_fullsized":"2023-11-28T20:08:41.048639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:32:39.529558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047730+0000","last_change":"2023-11-28T20:08:40.056879+0000","last_active":"2023-11-28T20:08:41.047730+0000","last_peered":"2023-11-28T20:08:41.047730+0000","last_clean":"2023-11-28T20:08:41.047730+0000","last_became_active":"2023-11-28T20:08:40.056661+0000","last_became_peered":"2023-11-28T20:08:40.056661+0000","last_unstale":"2023-11-28T20:08:41.047730+0000","last_undegraded":"2023-11-28T20:08:41.047730+0000","last_fullsized":"2023-11-28T20:08:41.047730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:35.834132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668884+0000","last_change":"2023-11-28T20:08:40.043208+0000","last_active":"2023-11-28T20:08:41.668884+0000","last_peered":"2023-11-28T20:08:41.668884+0000","last_clean":"2023-11-28T20:08:41.668884+0000","last_became_active":"2023-11-28T20:08:40.042894+0000","last_became_peered":"2023-11-28T20:08:40.042894+0000","last_unstale":"2023-11-28T20:08:41.668884+0000","last_undegraded":"2023-11-28T20:08:41.668884+0000","last_fullsized":"2023-11-28T20:08:41.668884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:55.271394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908466+0000","last_change":"2023-11-28T20:08:40.046926+0000","last_active":"2023-11-28T20:08:41.908466+0000","last_peered":"2023-11-28T20:08:41.908466+0000","last_clean":"2023-11-28T20:08:41.908466+0000","last_became_active":"2023-11-28T20:08:40.046657+0000","last_became_peered":"2023-11-28T20:08:40.046657+0000","last_unstale":"2023-11-28T20:08:41.908466+0000","last_undegraded":"2023-11-28T20:08:41.908466+0000","last_fullsized":"2023-11-28T20:08:41.908466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:58.382436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695337+0000","last_change":"2023-11-28T20:08:40.058425+0000","last_active":"2023-11-28T20:08:42.695337+0000","last_peered":"2023-11-28T20:08:42.695337+0000","last_clean":"2023-11-28T20:08:42.695337+0000","last_became_active":"2023-11-28T20:08:40.057442+0000","last_became_peered":"2023-11-28T20:08:40.057442+0000","last_unstale":"2023-11-28T20:08:42.695337+0000","last_undegraded":"2023-11-28T20:08:42.695337+0000","last_fullsized":"2023-11-28T20:08:42.695337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:55.271394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.417472+0000","last_change":"2023-11-28T20:08:40.049242+0000","last_active":"2023-11-28T20:08:43.417472+0000","last_peered":"2023-11-28T20:08:43.417472+0000","last_clean":"2023-11-28T20:08:43.417472+0000","last_became_active":"2023-11-28T20:08:40.048961+0000","last_became_peered":"2023-11-28T20:08:40.048961+0000","last_unstale":"2023-11-28T20:08:43.417472+0000","last_undegraded":"2023-11-28T20:08:43.417472+0000","last_fullsized":"2023-11-28T20:08:43.417472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:58.382436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695094+0000","last_change":"2023-11-28T20:08:40.050987+0000","last_active":"2023-11-28T20:08:42.695094+0000","last_peered":"2023-11-28T20:08:42.695094+0000","last_clean":"2023-11-28T20:08:42.695094+0000","last_became_active":"2023-11-28T20:08:40.049699+0000","last_became_peered":"2023-11-28T20:08:40.049699+0000","last_unstale":"2023-11-28T20:08:42.695094+0000","last_undegraded":"2023-11-28T20:08:42.695094+0000","last_fullsized":"2023-11-28T20:08:42.695094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:03.306001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.032621+0000","last_change":"2023-11-28T20:08:40.068540+0000","last_active":"2023-11-28T20:08:43.032621+0000","last_peered":"2023-11-28T20:08:43.032621+0000","last_clean":"2023-11-28T20:08:43.032621+0000","last_became_active":"2023-11-28T20:08:40.068245+0000","last_became_peered":"2023-11-28T20:08:40.068245+0000","last_unstale":"2023-11-28T20:08:43.032621+0000","last_undegraded":"2023-11-28T20:08:43.032621+0000","last_fullsized":"2023-11-28T20:08:43.032621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:36.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.065084+0000","last_change":"2023-11-28T20:08:39.051923+0000","last_active":"2023-11-28T20:08:40.065084+0000","last_peered":"2023-11-28T20:08:40.065084+0000","last_clean":"2023-11-28T20:08:40.065084+0000","last_became_active":"2023-11-28T20:08:39.051686+0000","last_became_peered":"2023-11-28T20:08:39.051686+0000","last_unstale":"2023-11-28T20:08:40.065084+0000","last_undegraded":"2023-11-28T20:08:40.065084+0000","last_fullsized":"2023-11-28T20:08:40.065084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:26.640119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.417675+0000","last_change":"2023-11-28T20:08:40.049927+0000","last_active":"2023-11-28T20:08:43.417675+0000","last_peered":"2023-11-28T20:08:43.417675+0000","last_clean":"2023-11-28T20:08:43.417675+0000","last_became_active":"2023-11-28T20:08:40.048414+0000","last_became_peered":"2023-11-28T20:08:40.048414+0000","last_unstale":"2023-11-28T20:08:43.417675+0000","last_undegraded":"2023-11-28T20:08:43.417675+0000","last_fullsized":"2023-11-28T20:08:43.417675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:32.120496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.069433+0000","last_change":"2023-11-28T20:08:39.050457+0000","last_active":"2023-11-28T20:08:40.069433+0000","last_peered":"2023-11-28T20:08:40.069433+0000","last_clean":"2023-11-28T20:08:40.069433+0000","last_became_active":"2023-11-28T20:08:39.050147+0000","last_became_peered":"2023-11-28T20:08:39.050147+0000","last_unstale":"2023-11-28T20:08:40.069433+0000","last_undegraded":"2023-11-28T20:08:40.069433+0000","last_fullsized":"2023-11-28T20:08:40.069433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:10:06.752978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908671+0000","last_change":"2023-11-28T20:08:40.046976+0000","last_active":"2023-11-28T20:08:41.908671+0000","last_peered":"2023-11-28T20:08:41.908671+0000","last_clean":"2023-11-28T20:08:41.908671+0000","last_became_active":"2023-11-28T20:08:40.046688+0000","last_became_peered":"2023-11-28T20:08:40.046688+0000","last_unstale":"2023-11-28T20:08:41.908671+0000","last_undegraded":"2023-11-28T20:08:41.908671+0000","last_fullsized":"2023-11-28T20:08:41.908671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:32.120496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.075269+0000","last_change":"2023-11-28T20:08:39.038126+0000","last_active":"2023-11-28T20:08:40.075269+0000","last_peered":"2023-11-28T20:08:40.075269+0000","last_clean":"2023-11-28T20:08:40.075269+0000","last_became_active":"2023-11-28T20:08:39.037863+0000","last_became_peered":"2023-11-28T20:08:39.037863+0000","last_unstale":"2023-11-28T20:08:40.075269+0000","last_undegraded":"2023-11-28T20:08:40.075269+0000","last_fullsized":"2023-11-28T20:08:40.075269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:53.299352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047863+0000","last_change":"2023-11-28T20:08:40.049988+0000","last_active":"2023-11-28T20:08:41.047863+0000","last_peered":"2023-11-28T20:08:41.047863+0000","last_clean":"2023-11-28T20:08:41.047863+0000","last_became_active":"2023-11-28T20:08:40.049746+0000","last_became_peered":"2023-11-28T20:08:40.049746+0000","last_unstale":"2023-11-28T20:08:41.047863+0000","last_undegraded":"2023-11-28T20:08:41.047863+0000","last_fullsized":"2023-11-28T20:08:41.047863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:59.132654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.062039+0000","last_change":"2023-11-28T20:08:39.042090+0000","last_active":"2023-11-28T20:08:40.062039+0000","last_peered":"2023-11-28T20:08:40.062039+0000","last_clean":"2023-11-28T20:08:40.062039+0000","last_became_active":"2023-11-28T20:08:39.041294+0000","last_became_peered":"2023-11-28T20:08:39.041294+0000","last_unstale":"2023-11-28T20:08:40.062039+0000","last_undegraded":"2023-11-28T20:08:40.062039+0000","last_fullsized":"2023-11-28T20:08:40.062039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:23:00.108341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695254+0000","last_change":"2023-11-28T20:08:40.056222+0000","last_active":"2023-11-28T20:08:42.695254+0000","last_peered":"2023-11-28T20:08:42.695254+0000","last_clean":"2023-11-28T20:08:42.695254+0000","last_became_active":"2023-11-28T20:08:40.055943+0000","last_became_peered":"2023-11-28T20:08:40.055943+0000","last_unstale":"2023-11-28T20:08:42.695254+0000","last_undegraded":"2023-11-28T20:08:42.695254+0000","last_fullsized":"2023-11-28T20:08:42.695254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:44:50.193301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.073411+0000","last_change":"2023-11-28T20:08:39.055828+0000","last_active":"2023-11-28T20:08:40.073411+0000","last_peered":"2023-11-28T20:08:40.073411+0000","last_clean":"2023-11-28T20:08:40.073411+0000","last_became_active":"2023-11-28T20:08:39.055521+0000","last_became_peered":"2023-11-28T20:08:39.055521+0000","last_unstale":"2023-11-28T20:08:40.073411+0000","last_undegraded":"2023-11-28T20:08:40.073411+0000","last_fullsized":"2023-11-28T20:08:40.073411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:32.812365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668514+0000","last_change":"2023-11-28T20:08:40.045890+0000","last_active":"2023-11-28T20:08:41.668514+0000","last_peered":"2023-11-28T20:08:41.668514+0000","last_clean":"2023-11-28T20:08:41.668514+0000","last_became_active":"2023-11-28T20:08:40.045687+0000","last_became_peered":"2023-11-28T20:08:40.045687+0000","last_unstale":"2023-11-28T20:08:41.668514+0000","last_undegraded":"2023-11-28T20:08:41.668514+0000","last_fullsized":"2023-11-28T20:08:41.668514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:26:52.052106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.073396+0000","last_change":"2023-11-28T20:08:39.055341+0000","last_active":"2023-11-28T20:08:40.073396+0000","last_peered":"2023-11-28T20:08:40.073396+0000","last_clean":"2023-11-28T20:08:40.073396+0000","last_became_active":"2023-11-28T20:08:39.055067+0000","last_became_peered":"2023-11-28T20:08:39.055067+0000","last_unstale":"2023-11-28T20:08:40.073396+0000","last_undegraded":"2023-11-28T20:08:40.073396+0000","last_fullsized":"2023-11-28T20:08:40.073396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:45.860504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908574+0000","last_change":"2023-11-28T20:08:40.044328+0000","last_active":"2023-11-28T20:08:41.908574+0000","last_peered":"2023-11-28T20:08:41.908574+0000","last_clean":"2023-11-28T20:08:41.908574+0000","last_became_active":"2023-11-28T20:08:40.044046+0000","last_became_peered":"2023-11-28T20:08:40.044046+0000","last_unstale":"2023-11-28T20:08:41.908574+0000","last_undegraded":"2023-11-28T20:08:41.908574+0000","last_fullsized":"2023-11-28T20:08:41.908574+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:10:07.761153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.032575+0000","last_change":"2023-11-28T20:08:39.038642+0000","last_active":"2023-11-28T20:08:40.032575+0000","last_peered":"2023-11-28T20:08:40.032575+0000","last_clean":"2023-11-28T20:08:40.032575+0000","last_became_active":"2023-11-28T20:08:39.038381+0000","last_became_peered":"2023-11-28T20:08:39.038381+0000","last_unstale":"2023-11-28T20:08:40.032575+0000","last_undegraded":"2023-11-28T20:08:40.032575+0000","last_fullsized":"2023-11-28T20:08:40.032575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:26:51.043930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.046988+0000","last_change":"2023-11-28T20:08:40.050635+0000","last_active":"2023-11-28T20:08:41.046988+0000","last_peered":"2023-11-28T20:08:41.046988+0000","last_clean":"2023-11-28T20:08:41.046988+0000","last_became_active":"2023-11-28T20:08:40.050392+0000","last_became_peered":"2023-11-28T20:08:40.050392+0000","last_unstale":"2023-11-28T20:08:41.046988+0000","last_undegraded":"2023-11-28T20:08:41.046988+0000","last_fullsized":"2023-11-28T20:08:41.046988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:23.517883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.030083+0000","last_change":"2023-11-28T20:08:39.052418+0000","last_active":"2023-11-28T20:08:40.030083+0000","last_peered":"2023-11-28T20:08:40.030083+0000","last_clean":"2023-11-28T20:08:40.030083+0000","last_became_active":"2023-11-28T20:08:39.052119+0000","last_became_peered":"2023-11-28T20:08:39.052119+0000","last_unstale":"2023-11-28T20:08:40.030083+0000","last_undegraded":"2023-11-28T20:08:40.030083+0000","last_fullsized":"2023-11-28T20:08:40.030083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:03.190080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668768+0000","last_change":"2023-11-28T20:08:40.047577+0000","last_active":"2023-11-28T20:08:41.668768+0000","last_peered":"2023-11-28T20:08:41.668768+0000","last_clean":"2023-11-28T20:08:41.668768+0000","last_became_active":"2023-11-28T20:08:40.047289+0000","last_became_peered":"2023-11-28T20:08:40.047289+0000","last_unstale":"2023-11-28T20:08:41.668768+0000","last_undegraded":"2023-11-28T20:08:41.668768+0000","last_fullsized":"2023-11-28T20:08:41.668768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:30.085597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.030598+0000","last_change":"2023-11-28T20:08:39.051487+0000","last_active":"2023-11-28T20:08:40.030598+0000","last_peered":"2023-11-28T20:08:40.030598+0000","last_clean":"2023-11-28T20:08:40.030598+0000","last_became_active":"2023-11-28T20:08:39.051180+0000","last_became_peered":"2023-11-28T20:08:39.051180+0000","last_unstale":"2023-11-28T20:08:40.030598+0000","last_undegraded":"2023-11-28T20:08:40.030598+0000","last_fullsized":"2023-11-28T20:08:40.030598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:35.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.048752+0000","last_change":"2023-11-28T20:08:40.055719+0000","last_active":"2023-11-28T20:08:41.048752+0000","last_peered":"2023-11-28T20:08:41.048752+0000","last_clean":"2023-11-28T20:08:41.048752+0000","last_became_active":"2023-11-28T20:08:40.054746+0000","last_became_peered":"2023-11-28T20:08:40.054746+0000","last_unstale":"2023-11-28T20:08:41.048752+0000","last_undegraded":"2023-11-28T20:08:41.048752+0000","last_fullsized":"2023-11-28T20:08:41.048752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:27:45.978639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.040583+0000","last_change":"2023-11-28T20:08:39.045704+0000","last_active":"2023-11-28T20:08:40.040583+0000","last_peered":"2023-11-28T20:08:40.040583+0000","last_clean":"2023-11-28T20:08:40.040583+0000","last_became_active":"2023-11-28T20:08:39.045183+0000","last_became_peered":"2023-11-28T20:08:39.045183+0000","last_unstale":"2023-11-28T20:08:40.040583+0000","last_undegraded":"2023-11-28T20:08:40.040583+0000","last_fullsized":"2023-11-28T20:08:40.040583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:42.221309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.048388+0000","last_change":"2023-11-28T20:08:40.059424+0000","last_active":"2023-11-28T20:08:41.048388+0000","last_peered":"2023-11-28T20:08:41.048388+0000","last_clean":"2023-11-28T20:08:41.048388+0000","last_became_active":"2023-11-28T20:08:40.059058+0000","last_became_peered":"2023-11-28T20:08:40.059058+0000","last_unstale":"2023-11-28T20:08:41.048388+0000","last_undegraded":"2023-11-28T20:08:41.048388+0000","last_fullsized":"2023-11-28T20:08:41.048388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:31.385535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.067757+0000","last_change":"2023-11-28T20:08:39.038134+0000","last_active":"2023-11-28T20:08:40.067757+0000","last_peered":"2023-11-28T20:08:40.067757+0000","last_clean":"2023-11-28T20:08:40.067757+0000","last_became_active":"2023-11-28T20:08:39.037794+0000","last_became_peered":"2023-11-28T20:08:39.037794+0000","last_unstale":"2023-11-28T20:08:40.067757+0000","last_undegraded":"2023-11-28T20:08:40.067757+0000","last_fullsized":"2023-11-28T20:08:40.067757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:59.979507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668768+0000","last_change":"2023-11-28T20:08:40.060319+0000","last_active":"2023-11-28T20:08:41.668768+0000","last_peered":"2023-11-28T20:08:41.668768+0000","last_clean":"2023-11-28T20:08:41.668768+0000","last_became_active":"2023-11-28T20:08:40.055895+0000","last_became_peered":"2023-11-28T20:08:40.055895+0000","last_unstale":"2023-11-28T20:08:41.668768+0000","last_undegraded":"2023-11-28T20:08:41.668768+0000","last_fullsized":"2023-11-28T20:08:41.668768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:03.306001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.078048+0000","last_change":"2023-11-28T20:08:39.047500+0000","last_active":"2023-11-28T20:08:40.078048+0000","last_peered":"2023-11-28T20:08:40.078048+0000","last_clean":"2023-11-28T20:08:40.078048+0000","last_became_active":"2023-11-28T20:08:39.047204+0000","last_became_peered":"2023-11-28T20:08:39.047204+0000","last_unstale":"2023-11-28T20:08:40.078048+0000","last_undegraded":"2023-11-28T20:08:40.078048+0000","last_fullsized":"2023-11-28T20:08:40.078048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:58.045748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.046821+0000","last_change":"2023-11-28T20:08:40.050563+0000","last_active":"2023-11-28T20:08:41.046821+0000","last_peered":"2023-11-28T20:08:41.046821+0000","last_clean":"2023-11-28T20:08:41.046821+0000","last_became_active":"2023-11-28T20:08:40.050285+0000","last_became_peered":"2023-11-28T20:08:40.050285+0000","last_unstale":"2023-11-28T20:08:41.046821+0000","last_undegraded":"2023-11-28T20:08:41.046821+0000","last_fullsized":"2023-11-28T20:08:41.046821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:06.628014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.067605+0000","last_change":"2023-11-28T20:08:39.053709+0000","last_active":"2023-11-28T20:08:40.067605+0000","last_peered":"2023-11-28T20:08:40.067605+0000","last_clean":"2023-11-28T20:08:40.067605+0000","last_became_active":"2023-11-28T20:08:39.053407+0000","last_became_peered":"2023-11-28T20:08:39.053407+0000","last_unstale":"2023-11-28T20:08:40.067605+0000","last_undegraded":"2023-11-28T20:08:40.067605+0000","last_fullsized":"2023-11-28T20:08:40.067605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:58.041266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.048275+0000","last_change":"2023-11-28T20:08:40.045614+0000","last_active":"2023-11-28T20:08:41.048275+0000","last_peered":"2023-11-28T20:08:41.048275+0000","last_clean":"2023-11-28T20:08:41.048275+0000","last_became_active":"2023-11-28T20:08:40.045110+0000","last_became_peered":"2023-11-28T20:08:40.045110+0000","last_unstale":"2023-11-28T20:08:41.048275+0000","last_undegraded":"2023-11-28T20:08:41.048275+0000","last_fullsized":"2023-11-28T20:08:41.048275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:53:36.378129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.040332+0000","last_change":"2023-11-28T20:08:39.044015+0000","last_active":"2023-11-28T20:08:40.040332+0000","last_peered":"2023-11-28T20:08:40.040332+0000","last_clean":"2023-11-28T20:08:40.040332+0000","last_became_active":"2023-11-28T20:08:39.043754+0000","last_became_peered":"2023-11-28T20:08:39.043754+0000","last_unstale":"2023-11-28T20:08:40.040332+0000","last_undegraded":"2023-11-28T20:08:40.040332+0000","last_fullsized":"2023-11-28T20:08:40.040332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:43:05.467320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695538+0000","last_change":"2023-11-28T20:08:40.061311+0000","last_active":"2023-11-28T20:08:42.695538+0000","last_peered":"2023-11-28T20:08:42.695538+0000","last_clean":"2023-11-28T20:08:42.695538+0000","last_became_active":"2023-11-28T20:08:40.060939+0000","last_became_peered":"2023-11-28T20:08:40.060939+0000","last_unstale":"2023-11-28T20:08:42.695538+0000","last_undegraded":"2023-11-28T20:08:42.695538+0000","last_fullsized":"2023-11-28T20:08:42.695538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:06:02.491701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.030529+0000","last_change":"2023-11-28T20:08:39.044109+0000","last_active":"2023-11-28T20:08:40.030529+0000","last_peered":"2023-11-28T20:08:40.030529+0000","last_clean":"2023-11-28T20:08:40.030529+0000","last_became_active":"2023-11-28T20:08:39.043914+0000","last_became_peered":"2023-11-28T20:08:39.043914+0000","last_unstale":"2023-11-28T20:08:40.030529+0000","last_undegraded":"2023-11-28T20:08:40.030529+0000","last_fullsized":"2023-11-28T20:08:40.030529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:22.509707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.417600+0000","last_change":"2023-11-28T20:08:40.047394+0000","last_active":"2023-11-28T20:08:43.417600+0000","last_peered":"2023-11-28T20:08:43.417600+0000","last_clean":"2023-11-28T20:08:43.417600+0000","last_became_active":"2023-11-28T20:08:40.046969+0000","last_became_peered":"2023-11-28T20:08:40.046969+0000","last_unstale":"2023-11-28T20:08:43.417600+0000","last_undegraded":"2023-11-28T20:08:43.417600+0000","last_fullsized":"2023-11-28T20:08:43.417600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:10:07.761153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.075997+0000","last_change":"2023-11-28T20:08:39.040358+0000","last_active":"2023-11-28T20:08:40.075997+0000","last_peered":"2023-11-28T20:08:40.075997+0000","last_clean":"2023-11-28T20:08:40.075997+0000","last_became_active":"2023-11-28T20:08:39.040054+0000","last_became_peered":"2023-11-28T20:08:39.040054+0000","last_unstale":"2023-11-28T20:08:40.075997+0000","last_undegraded":"2023-11-28T20:08:40.075997+0000","last_fullsized":"2023-11-28T20:08:40.075997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:43:05.467320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908855+0000","last_change":"2023-11-28T20:08:40.044911+0000","last_active":"2023-11-28T20:08:41.908855+0000","last_peered":"2023-11-28T20:08:41.908855+0000","last_clean":"2023-11-28T20:08:41.908855+0000","last_became_active":"2023-11-28T20:08:40.044465+0000","last_became_peered":"2023-11-28T20:08:40.044465+0000","last_unstale":"2023-11-28T20:08:41.908855+0000","last_undegraded":"2023-11-28T20:08:41.908855+0000","last_fullsized":"2023-11-28T20:08:41.908855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:22:14.044802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.074211+0000","last_change":"2023-11-28T20:08:39.041688+0000","last_active":"2023-11-28T20:08:40.074211+0000","last_peered":"2023-11-28T20:08:40.074211+0000","last_clean":"2023-11-28T20:08:40.074211+0000","last_became_active":"2023-11-28T20:08:39.041313+0000","last_became_peered":"2023-11-28T20:08:39.041313+0000","last_unstale":"2023-11-28T20:08:40.074211+0000","last_undegraded":"2023-11-28T20:08:40.074211+0000","last_fullsized":"2023-11-28T20:08:40.074211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:42.221309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668777+0000","last_change":"2023-11-28T20:08:40.043820+0000","last_active":"2023-11-28T20:08:41.668777+0000","last_peered":"2023-11-28T20:08:41.668777+0000","last_clean":"2023-11-28T20:08:41.668777+0000","last_became_active":"2023-11-28T20:08:40.043559+0000","last_became_peered":"2023-11-28T20:08:40.043559+0000","last_unstale":"2023-11-28T20:08:41.668777+0000","last_undegraded":"2023-11-28T20:08:41.668777+0000","last_fullsized":"2023-11-28T20:08:41.668777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:44:50.193301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.066862+0000","last_change":"2023-11-28T20:08:39.053602+0000","last_active":"2023-11-28T20:08:40.066862+0000","last_peered":"2023-11-28T20:08:40.066862+0000","last_clean":"2023-11-28T20:08:40.066862+0000","last_became_active":"2023-11-28T20:08:39.053315+0000","last_became_peered":"2023-11-28T20:08:39.053315+0000","last_unstale":"2023-11-28T20:08:40.066862+0000","last_undegraded":"2023-11-28T20:08:40.066862+0000","last_fullsized":"2023-11-28T20:08:40.066862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:20.720449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047173+0000","last_change":"2023-11-28T20:08:40.061077+0000","last_active":"2023-11-28T20:08:41.047173+0000","last_peered":"2023-11-28T20:08:41.047173+0000","last_clean":"2023-11-28T20:08:41.047173+0000","last_became_active":"2023-11-28T20:08:40.060754+0000","last_became_peered":"2023-11-28T20:08:40.060754+0000","last_unstale":"2023-11-28T20:08:41.047173+0000","last_undegraded":"2023-11-28T20:08:41.047173+0000","last_fullsized":"2023-11-28T20:08:41.047173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:51:57.420205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.068130+0000","last_change":"2023-11-28T20:08:39.051771+0000","last_active":"2023-11-28T20:08:40.068130+0000","last_peered":"2023-11-28T20:08:40.068130+0000","last_clean":"2023-11-28T20:08:40.068130+0000","last_became_active":"2023-11-28T20:08:39.051358+0000","last_became_peered":"2023-11-28T20:08:39.051358+0000","last_unstale":"2023-11-28T20:08:40.068130+0000","last_undegraded":"2023-11-28T20:08:40.068130+0000","last_fullsized":"2023-11-28T20:08:40.068130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:39.748590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.046260+0000","last_change":"2023-11-28T20:08:40.053305+0000","last_active":"2023-11-28T20:08:41.046260+0000","last_peered":"2023-11-28T20:08:41.046260+0000","last_clean":"2023-11-28T20:08:41.046260+0000","last_became_active":"2023-11-28T20:08:40.052993+0000","last_became_peered":"2023-11-28T20:08:40.052993+0000","last_unstale":"2023-11-28T20:08:41.046260+0000","last_undegraded":"2023-11-28T20:08:41.046260+0000","last_fullsized":"2023-11-28T20:08:41.046260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:59:47.156481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.030472+0000","last_change":"2023-11-28T20:08:39.054927+0000","last_active":"2023-11-28T20:08:40.030472+0000","last_peered":"2023-11-28T20:08:40.030472+0000","last_clean":"2023-11-28T20:08:40.030472+0000","last_became_active":"2023-11-28T20:08:39.054571+0000","last_became_peered":"2023-11-28T20:08:39.054571+0000","last_unstale":"2023-11-28T20:08:40.030472+0000","last_undegraded":"2023-11-28T20:08:40.030472+0000","last_fullsized":"2023-11-28T20:08:40.030472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:59:46.148305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.045832+0000","last_change":"2023-11-28T20:08:40.035572+0000","last_active":"2023-11-28T20:08:41.045832+0000","last_peered":"2023-11-28T20:08:41.045832+0000","last_clean":"2023-11-28T20:08:41.045832+0000","last_became_active":"2023-11-28T20:08:40.035289+0000","last_became_peered":"2023-11-28T20:08:40.035289+0000","last_unstale":"2023-11-28T20:08:41.045832+0000","last_undegraded":"2023-11-28T20:08:41.045832+0000","last_fullsized":"2023-11-28T20:08:41.045832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:08:12.084586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.073276+0000","last_change":"2023-11-28T20:08:39.052923+0000","last_active":"2023-11-28T20:08:40.073276+0000","last_peered":"2023-11-28T20:08:40.073276+0000","last_clean":"2023-11-28T20:08:40.073276+0000","last_became_active":"2023-11-28T20:08:39.052638+0000","last_became_peered":"2023-11-28T20:08:39.052638+0000","last_unstale":"2023-11-28T20:08:40.073276+0000","last_undegraded":"2023-11-28T20:08:40.073276+0000","last_fullsized":"2023-11-28T20:08:40.073276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:43:05.467320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.046045+0000","last_change":"2023-11-28T20:08:40.048358+0000","last_active":"2023-11-28T20:08:41.046045+0000","last_peered":"2023-11-28T20:08:41.046045+0000","last_clean":"2023-11-28T20:08:41.046045+0000","last_became_active":"2023-11-28T20:08:40.047896+0000","last_became_peered":"2023-11-28T20:08:40.047896+0000","last_unstale":"2023-11-28T20:08:41.046045+0000","last_undegraded":"2023-11-28T20:08:41.046045+0000","last_fullsized":"2023-11-28T20:08:41.046045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:46.868680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.045374+0000","last_change":"2023-11-28T20:08:39.047483+0000","last_active":"2023-11-28T20:08:40.045374+0000","last_peered":"2023-11-28T20:08:40.045374+0000","last_clean":"2023-11-28T20:08:40.045374+0000","last_became_active":"2023-11-28T20:08:39.046983+0000","last_became_peered":"2023-11-28T20:08:39.046983+0000","last_unstale":"2023-11-28T20:08:40.045374+0000","last_undegraded":"2023-11-28T20:08:40.045374+0000","last_fullsized":"2023-11-28T20:08:40.045374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:16.515072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.045744+0000","last_change":"2023-11-28T20:08:40.042981+0000","last_active":"2023-11-28T20:08:41.045744+0000","last_peered":"2023-11-28T20:08:41.045744+0000","last_clean":"2023-11-28T20:08:41.045744+0000","last_became_active":"2023-11-28T20:08:40.042706+0000","last_became_peered":"2023-11-28T20:08:40.042706+0000","last_unstale":"2023-11-28T20:08:41.045744+0000","last_undegraded":"2023-11-28T20:08:41.045744+0000","last_fullsized":"2023-11-28T20:08:41.045744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:58:17.045949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.030251+0000","last_change":"2023-11-28T20:08:39.046750+0000","last_active":"2023-11-28T20:08:40.030251+0000","last_peered":"2023-11-28T20:08:40.030251+0000","last_clean":"2023-11-28T20:08:40.030251+0000","last_became_active":"2023-11-28T20:08:39.041254+0000","last_became_peered":"2023-11-28T20:08:39.041254+0000","last_unstale":"2023-11-28T20:08:40.030251+0000","last_undegraded":"2023-11-28T20:08:40.030251+0000","last_fullsized":"2023-11-28T20:08:40.030251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:19.196536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695193+0000","last_change":"2023-11-28T20:08:40.052374+0000","last_active":"2023-11-28T20:08:42.695193+0000","last_peered":"2023-11-28T20:08:42.695193+0000","last_clean":"2023-11-28T20:08:42.695193+0000","last_became_active":"2023-11-28T20:08:40.051613+0000","last_became_peered":"2023-11-28T20:08:40.051613+0000","last_unstale":"2023-11-28T20:08:42.695193+0000","last_undegraded":"2023-11-28T20:08:42.695193+0000","last_fullsized":"2023-11-28T20:08:42.695193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:30.085597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.039306+0000","last_change":"2023-11-28T20:08:39.040971+0000","last_active":"2023-11-28T20:08:40.039306+0000","last_peered":"2023-11-28T20:08:40.039306+0000","last_clean":"2023-11-28T20:08:40.039306+0000","last_became_active":"2023-11-28T20:08:39.040632+0000","last_became_peered":"2023-11-28T20:08:39.040632+0000","last_unstale":"2023-11-28T20:08:40.039306+0000","last_undegraded":"2023-11-28T20:08:40.039306+0000","last_fullsized":"2023-11-28T20:08:40.039306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:58.045748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.046192+0000","last_change":"2023-11-28T20:08:40.046317+0000","last_active":"2023-11-28T20:08:41.046192+0000","last_peered":"2023-11-28T20:08:41.046192+0000","last_clean":"2023-11-28T20:08:41.046192+0000","last_became_active":"2023-11-28T20:08:40.045947+0000","last_became_peered":"2023-11-28T20:08:40.045947+0000","last_unstale":"2023-11-28T20:08:41.046192+0000","last_undegraded":"2023-11-28T20:08:41.046192+0000","last_fullsized":"2023-11-28T20:08:41.046192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:46.232765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.067802+0000","last_change":"2023-11-28T20:08:39.041943+0000","last_active":"2023-11-28T20:08:40.067802+0000","last_peered":"2023-11-28T20:08:40.067802+0000","last_clean":"2023-11-28T20:08:40.067802+0000","last_became_active":"2023-11-28T20:08:39.041621+0000","last_became_peered":"2023-11-28T20:08:39.041621+0000","last_unstale":"2023-11-28T20:08:40.067802+0000","last_undegraded":"2023-11-28T20:08:40.067802+0000","last_fullsized":"2023-11-28T20:08:40.067802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:31.112320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.668778+0000","last_change":"2023-11-28T20:08:40.058135+0000","last_active":"2023-11-28T20:08:41.668778+0000","last_peered":"2023-11-28T20:08:41.668778+0000","last_clean":"2023-11-28T20:08:41.668778+0000","last_became_active":"2023-11-28T20:08:40.057847+0000","last_became_peered":"2023-11-28T20:08:40.057847+0000","last_unstale":"2023-11-28T20:08:41.668778+0000","last_undegraded":"2023-11-28T20:08:41.668778+0000","last_fullsized":"2023-11-28T20:08:41.668778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:53:36.378129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.032728+0000","last_change":"2023-11-28T20:08:39.048687+0000","last_active":"2023-11-28T20:08:43.032728+0000","last_peered":"2023-11-28T20:08:43.032728+0000","last_clean":"2023-11-28T20:08:43.032728+0000","last_became_active":"2023-11-28T20:08:39.048387+0000","last_became_peered":"2023-11-28T20:08:39.048387+0000","last_unstale":"2023-11-28T20:08:43.032728+0000","last_undegraded":"2023-11-28T20:08:43.032728+0000","last_fullsized":"2023-11-28T20:08:43.032728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:31.112320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.032503+0000","last_change":"2023-11-28T20:08:40.053687+0000","last_active":"2023-11-28T20:08:43.032503+0000","last_peered":"2023-11-28T20:08:43.032503+0000","last_clean":"2023-11-28T20:08:43.032503+0000","last_became_active":"2023-11-28T20:08:40.053231+0000","last_became_peered":"2023-11-28T20:08:40.053231+0000","last_unstale":"2023-11-28T20:08:43.032503+0000","last_undegraded":"2023-11-28T20:08:43.032503+0000","last_fullsized":"2023-11-28T20:08:43.032503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:23.517883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.039043+0000","last_change":"2023-11-28T20:08:39.041853+0000","last_active":"2023-11-28T20:08:40.039043+0000","last_peered":"2023-11-28T20:08:40.039043+0000","last_clean":"2023-11-28T20:08:40.039043+0000","last_became_active":"2023-11-28T20:08:39.040640+0000","last_became_peered":"2023-11-28T20:08:39.040640+0000","last_unstale":"2023-11-28T20:08:40.039043+0000","last_undegraded":"2023-11-28T20:08:40.039043+0000","last_fullsized":"2023-11-28T20:08:40.039043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:26.640119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.417440+0000","last_change":"2023-11-28T20:08:40.045812+0000","last_active":"2023-11-28T20:08:43.417440+0000","last_peered":"2023-11-28T20:08:43.417440+0000","last_clean":"2023-11-28T20:08:43.417440+0000","last_became_active":"2023-11-28T20:08:40.045558+0000","last_became_peered":"2023-11-28T20:08:40.045558+0000","last_unstale":"2023-11-28T20:08:43.417440+0000","last_undegraded":"2023-11-28T20:08:43.417440+0000","last_fullsized":"2023-11-28T20:08:43.417440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:43:06.475495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.039209+0000","last_change":"2023-11-28T20:08:39.040389+0000","last_active":"2023-11-28T20:08:40.039209+0000","last_peered":"2023-11-28T20:08:40.039209+0000","last_clean":"2023-11-28T20:08:40.039209+0000","last_became_active":"2023-11-28T20:08:39.039925+0000","last_became_peered":"2023-11-28T20:08:39.039925+0000","last_unstale":"2023-11-28T20:08:40.039209+0000","last_undegraded":"2023-11-28T20:08:40.039209+0000","last_fullsized":"2023-11-28T20:08:40.039209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:57.374261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:43.032466+0000","last_change":"2023-11-28T20:08:40.061372+0000","last_active":"2023-11-28T20:08:43.032466+0000","last_peered":"2023-11-28T20:08:43.032466+0000","last_clean":"2023-11-28T20:08:43.032466+0000","last_became_active":"2023-11-28T20:08:40.061102+0000","last_became_peered":"2023-11-28T20:08:40.061102+0000","last_unstale":"2023-11-28T20:08:43.032466+0000","last_undegraded":"2023-11-28T20:08:43.032466+0000","last_fullsized":"2023-11-28T20:08:43.032466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:06.628014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.040454+0000","last_change":"2023-11-28T20:08:39.040222+0000","last_active":"2023-11-28T20:08:40.040454+0000","last_peered":"2023-11-28T20:08:40.040454+0000","last_clean":"2023-11-28T20:08:40.040454+0000","last_became_active":"2023-11-28T20:08:39.039056+0000","last_became_peered":"2023-11-28T20:08:39.039056+0000","last_unstale":"2023-11-28T20:08:40.040454+0000","last_undegraded":"2023-11-28T20:08:40.040454+0000","last_fullsized":"2023-11-28T20:08:40.040454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:57.374261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.047550+0000","last_change":"2023-11-28T20:08:40.054981+0000","last_active":"2023-11-28T20:08:41.047550+0000","last_peered":"2023-11-28T20:08:41.047550+0000","last_clean":"2023-11-28T20:08:41.047550+0000","last_became_active":"2023-11-28T20:08:40.054644+0000","last_became_peered":"2023-11-28T20:08:40.054644+0000","last_unstale":"2023-11-28T20:08:41.047550+0000","last_undegraded":"2023-11-28T20:08:41.047550+0000","last_fullsized":"2023-11-28T20:08:41.047550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:03.306001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.030407+0000","last_change":"2023-11-28T20:08:39.046104+0000","last_active":"2023-11-28T20:08:40.030407+0000","last_peered":"2023-11-28T20:08:40.030407+0000","last_clean":"2023-11-28T20:08:40.030407+0000","last_became_active":"2023-11-28T20:08:39.045331+0000","last_became_peered":"2023-11-28T20:08:39.045331+0000","last_unstale":"2023-11-28T20:08:40.030407+0000","last_undegraded":"2023-11-28T20:08:40.030407+0000","last_fullsized":"2023-11-28T20:08:40.030407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:45.224589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:41.908294+0000","last_change":"2023-11-28T20:08:40.047482+0000","last_active":"2023-11-28T20:08:41.908294+0000","last_peered":"2023-11-28T20:08:41.908294+0000","last_clean":"2023-11-28T20:08:41.908294+0000","last_became_active":"2023-11-28T20:08:40.047163+0000","last_became_peered":"2023-11-28T20:08:40.047163+0000","last_unstale":"2023-11-28T20:08:41.908294+0000","last_undegraded":"2023-11-28T20:08:41.908294+0000","last_fullsized":"2023-11-28T20:08:41.908294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:27.648294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.030168+0000","last_change":"2023-11-28T20:08:39.044947+0000","last_active":"2023-11-28T20:08:40.030168+0000","last_peered":"2023-11-28T20:08:40.030168+0000","last_clean":"2023-11-28T20:08:40.030168+0000","last_became_active":"2023-11-28T20:08:39.044662+0000","last_became_peered":"2023-11-28T20:08:39.044662+0000","last_unstale":"2023-11-28T20:08:40.030168+0000","last_undegraded":"2023-11-28T20:08:40.030168+0000","last_fullsized":"2023-11-28T20:08:40.030168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:05.619838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T20:08:42.695444+0000","last_change":"2023-11-28T20:08:40.050613+0000","last_active":"2023-11-28T20:08:42.695444+0000","last_peered":"2023-11-28T20:08:42.695444+0000","last_clean":"2023-11-28T20:08:42.695444+0000","last_became_active":"2023-11-28T20:08:40.049733+0000","last_became_peered":"2023-11-28T20:08:40.049733+0000","last_unstale":"2023-11-28T20:08:42.695444+0000","last_undegraded":"2023-11-28T20:08:42.695444+0000","last_fullsized":"2023-11-28T20:08:42.695444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:39.012458+0000","last_clean_scrub_stamp":"2023-11-28T20:08:39.012458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:31.385535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.045196+0000","last_change":"2023-11-28T20:08:39.051230+0000","last_active":"2023-11-28T20:08:40.045196+0000","last_peered":"2023-11-28T20:08:40.045196+0000","last_clean":"2023-11-28T20:08:40.045196+0000","last_became_active":"2023-11-28T20:08:39.050779+0000","last_became_peered":"2023-11-28T20:08:39.050779+0000","last_unstale":"2023-11-28T20:08:40.045196+0000","last_undegraded":"2023-11-28T20:08:40.045196+0000","last_fullsized":"2023-11-28T20:08:40.045196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:08:38.004282+0000","last_clean_scrub_stamp":"2023-11-28T20:08:38.004282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:58.041266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T20:08:40.035437+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:08:40.035437+0000","last_peered":"2023-11-28T20:08:40.035437+0000","last_clean":"2023-11-28T20:08:40.035437+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:08:40.035437+0000","last_undegraded":"2023-11-28T20:08:40.035437+0000","last_fullsized":"2023-11-28T20:08:40.035437+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":730920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.032}]},{"osd":1,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":1.0009999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":1.1359999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":1.165}]},{"osd":4,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":1.0920000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":1.1180000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":1.054},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.90200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":141078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":2.8279999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":3.54},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":3.9620000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":2.9830000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":3.5819999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.125},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":6.2249999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":4.0789999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":2.9390000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":8.6159999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":4.0380000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":2.879},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":3.4910000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":380928,"data_stored":147434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.67800000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.81599999999999995}]},{"osd":2,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.0209999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.84399999999999997}]},{"osd":4,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.91900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":146866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.501},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.57299999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.621}]},{"osd":2,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.67200000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.81899999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.70499999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.753}]},{"osd":7,"last update":"Tue Nov 28 20:08:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.96199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":6.016,"5min":6.016,"15min":6.016},"last":0.40600000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.435}]},{"osd":2,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.52200000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":5.8810000000000002,"5min":5.8810000000000002,"15min":5.8810000000000002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.9349999999999996,"5min":5.9349999999999996,"15min":5.9349999999999996},"last":0.83799999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.75900000000000001}]},{"osd":7,"last update":"Tue Nov 28 20:08:28 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.9740000000000002,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.621},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.69199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":146832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":4.4939999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":5.3140000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":3.7650000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":5.3460000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.89900000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":3.8090000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":5.2809999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.48}]},{"osd":6,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":4.5369999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":5.2039999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":3.863},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":5.2460000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.42499999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.9909999999999997,"5min":4.9909999999999997,"15min":4.9909999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.9109999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.501}]},{"osd":3,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":4.8239999999999998,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.46700000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":4.5890000000000004,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.82299999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.7889999999999997,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.7069999999999999,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.746}]},{"osd":7,"last update":"Tue Nov 28 20:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.7539999999999996,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":0.72799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":737130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.34100000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38400000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.437},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.48899999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.57499999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.66400000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:08:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.61299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:08:49.160 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T20:08:49.160 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-28T20:08:49.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.342+0000 7fc868780640 1 Processor -- start 2023-11-28T20:08:49.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.342+0000 7fc868780640 1 -- start start 2023-11-28T20:08:49.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc868780640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8600b42d0 0x7fc8600b4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:49.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc868780640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8601446f0 con 0x7fc860070480 2023-11-28T20:08:49.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc868780640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc860070910 con 0x7fc860143d10 2023-11-28T20:08:49.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc868780640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc860071590 con 0x7fc8600b42d0 2023-11-28T20:08:49.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc865d1b640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc860070480 0x7fc86015b5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:59544/0 (socket says 172.21.15.177:59544) 2023-11-28T20:08:49.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc865d1b640 1 -- 172.21.15.177:0/2027540688 learned_addr learned my addr 172.21.15.177:0/2027540688 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:49.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc866d1d640 1 --2- 172.21.15.177:0/2027540688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8600b42d0 0x7fc8600b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:49.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341350313 0 0) 0x7fc8601446f0 con 0x7fc860070480 2023-11-28T20:08:49.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc84c003530 con 0x7fc860070480 2023-11-28T20:08:49.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375387801 0 0) 0x7fc860070910 con 0x7fc860143d10 2023-11-28T20:08:49.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8601446f0 con 0x7fc860143d10 2023-11-28T20:08:49.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1442546656 0 0) 0x7fc84c003530 con 0x7fc860070480 2023-11-28T20:08:49.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8600b42d0 msgr2=0x7fc8600b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:49.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 --2- 172.21.15.177:0/2027540688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8600b42d0 0x7fc8600b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 >> v1:172.21.15.195:6789/0 conn(0x7fc860143d10 legacy=0x7fc86015f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:49.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc860070bf0 con 0x7fc860070480 2023-11-28T20:08:49.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7fc850001680 con 0x7fc860070480 2023-11-28T20:08:49.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 >> v1:172.21.15.177:6789/0 conn(0x7fc860070480 legacy=0x7fc86015b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:49.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 --2- 172.21.15.177:0/2027540688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc84c003b40 0x7fc84c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:49.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 --2- 172.21.15.177:0/2027540688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8600b42d0 0x7fc84c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:49.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 --2- 172.21.15.177:0/2027540688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc84c004d10 0x7fc84c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:49.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc860071590 con 0x7fc84c003b40 2023-11-28T20:08:49.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c00bb80 con 0x7fc84c004d10 2023-11-28T20:08:49.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c00bd40 con 0x7fc8600b42d0 2023-11-28T20:08:49.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86651c640 1 --2- 172.21.15.177:0/2027540688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc84c003b40 0x7fc84c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:49.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc866d1d640 1 --2- 172.21.15.177:0/2027540688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc84c004d10 0x7fc84c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:49.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc865d1b640 1 --2- 172.21.15.177:0/2027540688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8600b42d0 0x7fc84c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:49.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86651c640 1 -- 172.21.15.177:0/2027540688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8600b42d0 msgr2=0x7fc84c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:49.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86651c640 1 --2- 172.21.15.177:0/2027540688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8600b42d0 0x7fc84c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86651c640 1 -- 172.21.15.177:0/2027540688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc84c004d10 msgr2=0x7fc84c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:49.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86651c640 1 --2- 172.21.15.177:0/2027540688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc84c004d10 0x7fc84c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc86651c640 1 -- 172.21.15.177:0/2027540688 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c003530 con 0x7fc84c003b40 2023-11-28T20:08:49.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.346+0000 7fc865d1b640 1 --2- 172.21.15.177:0/2027540688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8600b42d0 0x7fc84c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:49.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.350+0000 7fc86651c640 1 --2- 172.21.15.177:0/2027540688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc84c003b40 0x7fc84c003f40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0018d0 tx=0x7fc85c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a02903e34b5776 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:49.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.350+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c0052d0 con 0x7fc84c003b40 2023-11-28T20:08:49.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.350+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c0a7050 con 0x7fc84c003b40 2023-11-28T20:08:49.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.350+0000 7fc86551a640 1 -- 172.21.15.177:0/2027540688 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c003600 con 0x7fc84c003b40 2023-11-28T20:08:49.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.350+0000 7fc868780640 1 -- 172.21.15.177:0/2027540688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc84c003b40 msgr2=0x7fc84c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:49.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.350+0000 7fc868780640 1 --2- 172.21.15.177:0/2027540688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc84c003b40 0x7fc84c003f40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0018d0 tx=0x7fc85c01c560 comp rx=0 tx=0).stop 2023-11-28T20:08:49.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.350+0000 7fc866d1d640 1 -- 172.21.15.177:0/2027540688 reap_dead start 2023-11-28T20:08:49.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.350+0000 7fc868780640 1 -- 172.21.15.177:0/2027540688 shutdown_connections 2023-11-28T20:08:49.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.350+0000 7fc868780640 1 -- 172.21.15.177:0/2027540688 >> 172.21.15.177:0/2027540688 conn(0x7fc8600b0cc0 msgr2=0x7fc8600b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:49.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.350+0000 7fc868780640 1 -- 172.21.15.177:0/2027540688 shutdown_connections 2023-11-28T20:08:49.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.350+0000 7fc868780640 1 -- 172.21.15.177:0/2027540688 wait complete. 2023-11-28T20:08:49.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc868780640 1 Processor -- start 2023-11-28T20:08:49.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc868780640 1 -- start start 2023-11-28T20:08:49.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc868780640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc84c003b40 0x7fc86013aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:49.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc868780640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8600b3080 0x7fc8601593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:49.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc868780640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8600b3700 0x7fc8600b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:49.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc868780640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8600b4cc0 con 0x7fc8600b3700 2023-11-28T20:08:49.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc868780640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8600b40f0 con 0x7fc8600b3080 2023-11-28T20:08:49.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc868780640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86015a920 con 0x7fc84c003b40 2023-11-28T20:08:49.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc866d1d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8600b3700 0x7fc8600b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:49.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc866d1d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8600b3700 0x7fc8600b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55840/0 (socket says 172.21.15.177:55840) 2023-11-28T20:08:49.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc866d1d640 1 -- 172.21.15.177:0/1231864066 learned_addr learned my addr 172.21.15.177:0/1231864066 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:49.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc86651c640 1 --2- 172.21.15.177:0/1231864066 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc84c003b40 0x7fc86013aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:49.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc865d1b640 1 --2- 172.21.15.177:0/1231864066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8600b3080 0x7fc8601593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:49.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc866d1d640 1 -- 172.21.15.177:0/1231864066 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc84c003b40 msgr2=0x7fc86013aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:49.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc866d1d640 1 --2- 172.21.15.177:0/1231864066 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc84c003b40 0x7fc86013aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc866d1d640 1 -- 172.21.15.177:0/1231864066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8600b3080 msgr2=0x7fc8601593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:49.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc866d1d640 1 --2- 172.21.15.177:0/1231864066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8600b3080 0x7fc8601593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc866d1d640 1 -- 172.21.15.177:0/1231864066 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc860159d10 con 0x7fc8600b3700 2023-11-28T20:08:49.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc866d1d640 1 --2- 172.21.15.177:0/1231864066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8600b3700 0x7fc8600b3bb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc8600672a0 tx=0x7fc85800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:49.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc856ffd640 1 -- 172.21.15.177:0/1231864066 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85800e040 con 0x7fc8600b3700 2023-11-28T20:08:49.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc856ffd640 1 -- 172.21.15.177:0/1231864066 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85800f040 con 0x7fc8600b3700 2023-11-28T20:08:49.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc868780640 1 -- 172.21.15.177:0/1231864066 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc860159ff0 con 0x7fc8600b3700 2023-11-28T20:08:49.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc856ffd640 1 -- 172.21.15.177:0/1231864066 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858015430 con 0x7fc8600b3700 2023-11-28T20:08:49.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc868780640 1 -- 172.21.15.177:0/1231864066 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86015a5b0 con 0x7fc8600b3700 2023-11-28T20:08:49.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.354+0000 7fc868780640 1 -- 172.21.15.177:0/1231864066 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86015aad0 con 0x7fc8600b3700 2023-11-28T20:08:49.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.358+0000 7fc856ffd640 1 -- 172.21.15.177:0/1231864066 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc858015590 con 0x7fc8600b3700 2023-11-28T20:08:49.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.358+0000 7fc856ffd640 1 --2- 172.21.15.177:0/1231864066 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc844066470 0x7fc844068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:49.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.358+0000 7fc856ffd640 1 -- 172.21.15.177:0/1231864066 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8580844c0 con 0x7fc8600b3700 2023-11-28T20:08:49.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.358+0000 7fc86651c640 1 --2- 172.21.15.177:0/1231864066 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc844066470 0x7fc844068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:49.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.358+0000 7fc86651c640 1 --2- 172.21.15.177:0/1231864066 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc844066470 0x7fc844068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0ac000 tx=0x7fc85c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:49.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.362+0000 7fc856ffd640 1 -- 172.21.15.177:0/1231864066 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc86015aad0 con 0x7fc8600b3700 2023-11-28T20:08:49.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.566+0000 7fc868780640 1 -- 172.21.15.177:0/1231864066 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc86015aa90 con 0x7fc8600b3700 2023-11-28T20:08:49.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.570+0000 7fc856ffd640 1 -- 172.21.15.177:0/1231864066 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fc858055460 con 0x7fc8600b3700 2023-11-28T20:08:49.573 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-11-28T20:08:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZl+2t5KxAAc/J7x+fjSQR4IkIQJ/X8sw== 2023-11-28T20:08:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-11-28T20:08:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-11-28T20:08:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T20:08:49.576 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-11-28T20:08:49.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.574+0000 7fc868780640 1 -- 172.21.15.177:0/1231864066 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc844066470 msgr2=0x7fc844068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:49.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.574+0000 7fc868780640 1 --2- 172.21.15.177:0/1231864066 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc844066470 0x7fc844068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0ac000 tx=0x7fc85c0a6000 comp rx=0 tx=0).stop 2023-11-28T20:08:49.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.574+0000 7fc868780640 1 -- 172.21.15.177:0/1231864066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8600b3700 msgr2=0x7fc8600b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:49.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.574+0000 7fc868780640 1 --2- 172.21.15.177:0/1231864066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8600b3700 0x7fc8600b3bb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc8600672a0 tx=0x7fc85800f580 comp rx=0 tx=0).stop 2023-11-28T20:08:49.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.574+0000 7fc868780640 1 -- 172.21.15.177:0/1231864066 shutdown_connections 2023-11-28T20:08:49.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.574+0000 7fc868780640 1 --2- 172.21.15.177:0/1231864066 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc844066470 0x7fc844068930 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.574+0000 7fc868780640 1 --2- 172.21.15.177:0/1231864066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8600b3700 0x7fc8600b3bb0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.574+0000 7fc868780640 1 --2- 172.21.15.177:0/1231864066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8600b3080 0x7fc8601593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.574+0000 7fc868780640 1 --2- 172.21.15.177:0/1231864066 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc84c003b40 0x7fc86013aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.574+0000 7fc868780640 1 -- 172.21.15.177:0/1231864066 >> 172.21.15.177:0/1231864066 conn(0x7fc8600b0cc0 msgr2=0x7fc86015d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:49.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.574+0000 7fc868780640 1 -- 172.21.15.177:0/1231864066 shutdown_connections 2023-11-28T20:08:49.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.574+0000 7fc868780640 1 -- 172.21.15.177:0/1231864066 wait complete. 2023-11-28T20:08:49.597 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:08:49.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9656e09640 1 Processor -- start 2023-11-28T20:08:49.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9656e09640 1 -- start start 2023-11-28T20:08:49.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9656e09640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f965013cf30 0x7f965006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:49.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9656e09640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f965006c800 0x7f965015a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:49.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9656e09640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f965015ab70 0x7f9650071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:49.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9656e09640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965013d310 con 0x7f965013cf30 2023-11-28T20:08:49.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9656e09640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96501404e0 con 0x7f965015ab70 2023-11-28T20:08:49.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9656e09640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965015b3a0 con 0x7f965006c800 2023-11-28T20:08:49.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9654ba5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f965013cf30 0x7f965006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:49.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9654ba5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f965013cf30 0x7f965006c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55848/0 (socket says 172.21.15.177:55848) 2023-11-28T20:08:49.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9654ba5640 1 -- 172.21.15.177:0/34161868 learned_addr learned my addr 172.21.15.177:0/34161868 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:49.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9654ba5640 1 -- 172.21.15.177:0/34161868 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f965006c800 msgr2=0x7f965015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:49.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9654ba5640 1 --2- 172.21.15.177:0/34161868 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f965006c800 0x7f965015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9654ba5640 1 -- 172.21.15.177:0/34161868 >> v2:172.21.15.195:3300/0 conn(0x7f965015ab70 msgr2=0x7f9650071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:49.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9654ba5640 1 --2- 172.21.15.177:0/34161868 >> v2:172.21.15.195:3300/0 conn(0x7f965015ab70 0x7f9650071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.734+0000 7f9654ba5640 1 -- 172.21.15.177:0/34161868 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965006cc40 con 0x7f965013cf30 2023-11-28T20:08:49.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.738+0000 7f9654ba5640 1 --2- 172.21.15.177:0/34161868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f965013cf30 0x7f965006c2c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f965006d630 tx=0x7f964c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422126b3946454d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:49.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.738+0000 7f96477fe640 1 -- 172.21.15.177:0/34161868 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c0ab600 con 0x7f965013cf30 2023-11-28T20:08:49.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.738+0000 7f96477fe640 1 -- 172.21.15.177:0/34161868 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c0ab760 con 0x7f965013cf30 2023-11-28T20:08:49.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.738+0000 7f96477fe640 1 -- 172.21.15.177:0/34161868 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c0abaf0 con 0x7f965013cf30 2023-11-28T20:08:49.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.738+0000 7f9656e09640 1 -- 172.21.15.177:0/34161868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f965013cf30 msgr2=0x7f965006c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:49.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.738+0000 7f9656e09640 1 --2- 172.21.15.177:0/34161868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f965013cf30 0x7f965006c2c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f965006d630 tx=0x7f964c01c440 comp rx=0 tx=0).stop 2023-11-28T20:08:49.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.738+0000 7f9656e09640 1 -- 172.21.15.177:0/34161868 shutdown_connections 2023-11-28T20:08:49.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.738+0000 7f9656e09640 1 --2- 172.21.15.177:0/34161868 >> v2:172.21.15.195:3300/0 conn(0x7f965015ab70 0x7f9650071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.738+0000 7f9656e09640 1 --2- 172.21.15.177:0/34161868 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f965006c800 0x7f965015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.738+0000 7f9656e09640 1 --2- 172.21.15.177:0/34161868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f965013cf30 0x7f965006c2c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.738+0000 7f9656e09640 1 -- 172.21.15.177:0/34161868 >> 172.21.15.177:0/34161868 conn(0x7f965006a530 msgr2=0x7f965006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:49.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.738+0000 7f9656e09640 1 -- 172.21.15.177:0/34161868 shutdown_connections 2023-11-28T20:08:49.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.738+0000 7f9656e09640 1 -- 172.21.15.177:0/34161868 wait complete. 2023-11-28T20:08:49.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9656e09640 1 Processor -- start 2023-11-28T20:08:49.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9656e09640 1 -- start start 2023-11-28T20:08:49.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9656e09640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f965006c800 0x7f96501f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:49.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9656e09640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f965013cf30 0x7f965015ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:49.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9656e09640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f965015ab70 0x7f96500b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:49.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9656e09640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965015b5a0 con 0x7f965006c800 2023-11-28T20:08:49.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9656e09640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965015c390 con 0x7f965013cf30 2023-11-28T20:08:49.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9656e09640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965015b780 con 0x7f965015ab70 2023-11-28T20:08:49.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9654ba5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f965006c800 0x7f96501f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:49.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9654ba5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f965006c800 0x7f96501f9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55856/0 (socket says 172.21.15.177:55856) 2023-11-28T20:08:49.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9654ba5640 1 -- 172.21.15.177:0/1071374415 learned_addr learned my addr 172.21.15.177:0/1071374415 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:49.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9647fff640 1 --2- 172.21.15.177:0/1071374415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f965013cf30 0x7f965015ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:49.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f96553a6640 1 --2- 172.21.15.177:0/1071374415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f965015ab70 0x7f96500b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:49.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9654ba5640 1 -- 172.21.15.177:0/1071374415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f965015ab70 msgr2=0x7f96500b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:49.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9654ba5640 1 --2- 172.21.15.177:0/1071374415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f965015ab70 0x7f96500b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9654ba5640 1 -- 172.21.15.177:0/1071374415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f965013cf30 msgr2=0x7f965015ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:49.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9654ba5640 1 --2- 172.21.15.177:0/1071374415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f965013cf30 0x7f965015ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9654ba5640 1 -- 172.21.15.177:0/1071374415 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c0094d0 con 0x7f965006c800 2023-11-28T20:08:49.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9654ba5640 1 --2- 172.21.15.177:0/1071374415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f965006c800 0x7f96501f9100 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f964c01cce0 tx=0x7f964c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:49.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f96457fa640 1 -- 172.21.15.177:0/1071374415 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c0b4800 con 0x7f965006c800 2023-11-28T20:08:49.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f96457fa640 1 -- 172.21.15.177:0/1071374415 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c0b4980 con 0x7f965006c800 2023-11-28T20:08:49.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f96457fa640 1 -- 172.21.15.177:0/1071374415 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c0b4d30 con 0x7f965006c800 2023-11-28T20:08:49.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9656e09640 1 -- 172.21.15.177:0/1071374415 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965015ba60 con 0x7f965006c800 2023-11-28T20:08:49.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.742+0000 7f9656e09640 1 -- 172.21.15.177:0/1071374415 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965015c020 con 0x7f965006c800 2023-11-28T20:08:49.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.746+0000 7f9656e09640 1 -- 172.21.15.177:0/1071374415 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9650069440 con 0x7f965006c800 2023-11-28T20:08:49.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.746+0000 7f96457fa640 1 -- 172.21.15.177:0/1071374415 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f964c0b3380 con 0x7f965006c800 2023-11-28T20:08:49.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.746+0000 7f96457fa640 1 --2- 172.21.15.177:0/1071374415 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f963c066470 0x7f963c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:49.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.746+0000 7f96457fa640 1 -- 172.21.15.177:0/1071374415 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f964c11e260 con 0x7f965006c800 2023-11-28T20:08:49.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.746+0000 7f9647fff640 1 --2- 172.21.15.177:0/1071374415 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f963c066470 0x7f963c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:49.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.746+0000 7f9647fff640 1 --2- 172.21.15.177:0/1071374415 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f963c066470 0x7f963c068930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9640006fd0 tx=0x7f9640008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:49.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.750+0000 7f96457fa640 1 -- 172.21.15.177:0/1071374415 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f964c0eb6f0 con 0x7f965006c800 2023-11-28T20:08:49.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.930+0000 7f9656e09640 1 -- 172.21.15.177:0/1071374415 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9650154580 con 0x7f965006c800 2023-11-28T20:08:49.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.930+0000 7f96457fa640 1 -- 172.21.15.177:0/1071374415 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f964c0eed10 con 0x7f965006c800 2023-11-28T20:08:49.934 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:49.935 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2829857708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2829857708},{"type":"v1","addr":"172.21.15.177:6836","nonce":2829857708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5101,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/916709103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":916709103},{"type":"v1","addr":"172.21.15.195:6834","nonce":916709103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1987123637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1987123637},{"type":"v1","addr":"172.21.15.195:6835","nonce":1987123637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:08:39.405256+0000","modified":"2023-11-28T20:08:42.420072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/3143070912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":3143070912},{"type":"v1","addr":"172.21.15.177:6837","nonce":3143070912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T20:08:49.936 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 17 2023-11-28T20:08:49.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.934+0000 7f9656e09640 1 -- 172.21.15.177:0/1071374415 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f963c066470 msgr2=0x7f963c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:49.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.934+0000 7f9656e09640 1 --2- 172.21.15.177:0/1071374415 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f963c066470 0x7f963c068930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9640006fd0 tx=0x7f9640008040 comp rx=0 tx=0).stop 2023-11-28T20:08:49.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.934+0000 7f9656e09640 1 -- 172.21.15.177:0/1071374415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f965006c800 msgr2=0x7f96501f9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:49.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.934+0000 7f9656e09640 1 --2- 172.21.15.177:0/1071374415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f965006c800 0x7f96501f9100 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f964c01cce0 tx=0x7f964c01ac80 comp rx=0 tx=0).stop 2023-11-28T20:08:49.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.934+0000 7f9656e09640 1 -- 172.21.15.177:0/1071374415 shutdown_connections 2023-11-28T20:08:49.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.934+0000 7f9656e09640 1 --2- 172.21.15.177:0/1071374415 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f963c066470 0x7f963c068930 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.934+0000 7f9656e09640 1 --2- 172.21.15.177:0/1071374415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f965015ab70 0x7f96500b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.934+0000 7f9656e09640 1 --2- 172.21.15.177:0/1071374415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f965013cf30 0x7f965015ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.934+0000 7f9656e09640 1 --2- 172.21.15.177:0/1071374415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f965006c800 0x7f96501f9100 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:49.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.934+0000 7f9656e09640 1 -- 172.21.15.177:0/1071374415 >> 172.21.15.177:0/1071374415 conn(0x7f965006a530 msgr2=0x7f965013c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:49.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.934+0000 7f9656e09640 1 -- 172.21.15.177:0/1071374415 shutdown_connections 2023-11-28T20:08:49.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:49.934+0000 7f9656e09640 1 -- 172.21.15.177:0/1071374415 wait complete. 2023-11-28T20:08:50.357 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T20:08:39.405256+0000', 'modified': '2023-11-28T20:08:42.420072+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5214}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5214': {'gid': 5214, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.177:6837/3143070912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6835', 'nonce': 3143070912}, {'type': 'v1', 'addr': '172.21.15.177:6837', 'nonce': 3143070912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T20:08:50.357 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T20:08:50.357 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T20:08:50.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.494+0000 7f54535b8640 1 Processor -- start 2023-11-28T20:08:50.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f54535b8640 1 -- start start 2023-11-28T20:08:50.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f54535b8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f544c0b4760 0x7f544c0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f54535b8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f544c0b4b40 0x7f544c0d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f54535b8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f544c142c00 0x7f544c143070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f54535b8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544c15d7c0 con 0x7f544c0b4760 2023-11-28T20:08:50.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f54535b8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544c140930 con 0x7f544c142c00 2023-11-28T20:08:50.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f54535b8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544c15da10 con 0x7f544c0b4b40 2023-11-28T20:08:50.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f5451354640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f544c0b4760 0x7f544c0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f5451354640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f544c0b4760 0x7f544c0d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55868/0 (socket says 172.21.15.177:55868) 2023-11-28T20:08:50.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f5451354640 1 -- 172.21.15.177:0/3120767357 learned_addr learned my addr 172.21.15.177:0/3120767357 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:50.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f5450b53640 1 --2- 172.21.15.177:0/3120767357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f544c0b4b40 0x7f544c0d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f5451b55640 1 --2- 172.21.15.177:0/3120767357 >> v2:172.21.15.195:3300/0 conn(0x7f544c142c00 0x7f544c143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f5451354640 1 -- 172.21.15.177:0/3120767357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f544c0b4b40 msgr2=0x7f544c0d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:50.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f5451354640 1 --2- 172.21.15.177:0/3120767357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f544c0b4b40 0x7f544c0d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f5451354640 1 -- 172.21.15.177:0/3120767357 >> v2:172.21.15.195:3300/0 conn(0x7f544c142c00 msgr2=0x7f544c143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:50.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f5451354640 1 --2- 172.21.15.177:0/3120767357 >> v2:172.21.15.195:3300/0 conn(0x7f544c142c00 0x7f544c143070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f5451354640 1 -- 172.21.15.177:0/3120767357 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c15dcf0 con 0x7f544c0b4760 2023-11-28T20:08:50.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f5450b53640 1 --2- 172.21.15.177:0/3120767357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f544c0b4b40 0x7f544c0d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:50.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.498+0000 7f5451b55640 1 --2- 172.21.15.177:0/3120767357 >> v2:172.21.15.195:3300/0 conn(0x7f544c142c00 0x7f544c143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:50.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.502+0000 7f5451354640 1 --2- 172.21.15.177:0/3120767357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f544c0b4760 0x7f544c0d10a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f544c06d820 tx=0x7f544801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37be2010e75eb464 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:50.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.502+0000 7f5443fff640 1 -- 172.21.15.177:0/3120767357 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54480ab600 con 0x7f544c0b4760 2023-11-28T20:08:50.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.502+0000 7f5443fff640 1 -- 172.21.15.177:0/3120767357 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54480a7050 con 0x7f544c0b4760 2023-11-28T20:08:50.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.502+0000 7f5443fff640 1 -- 172.21.15.177:0/3120767357 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54480ab980 con 0x7f544c0b4760 2023-11-28T20:08:50.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.502+0000 7f54535b8640 1 -- 172.21.15.177:0/3120767357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f544c0b4760 msgr2=0x7f544c0d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.502+0000 7f54535b8640 1 --2- 172.21.15.177:0/3120767357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f544c0b4760 0x7f544c0d10a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f544c06d820 tx=0x7f544801c500 comp rx=0 tx=0).stop 2023-11-28T20:08:50.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.502+0000 7f54535b8640 1 -- 172.21.15.177:0/3120767357 shutdown_connections 2023-11-28T20:08:50.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.502+0000 7f54535b8640 1 --2- 172.21.15.177:0/3120767357 >> v2:172.21.15.195:3300/0 conn(0x7f544c142c00 0x7f544c143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.502+0000 7f54535b8640 1 --2- 172.21.15.177:0/3120767357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f544c0b4b40 0x7f544c0d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.502+0000 7f54535b8640 1 --2- 172.21.15.177:0/3120767357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f544c0b4760 0x7f544c0d10a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.502+0000 7f54535b8640 1 -- 172.21.15.177:0/3120767357 >> 172.21.15.177:0/3120767357 conn(0x7f544c06a530 msgr2=0x7f544c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:50.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.502+0000 7f54535b8640 1 -- 172.21.15.177:0/3120767357 shutdown_connections 2023-11-28T20:08:50.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.502+0000 7f54535b8640 1 -- 172.21.15.177:0/3120767357 wait complete. 2023-11-28T20:08:50.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.502+0000 7f54535b8640 1 Processor -- start 2023-11-28T20:08:50.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.502+0000 7f54535b8640 1 -- start start 2023-11-28T20:08:50.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f54535b8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f544c0b4760 0x7f544c139c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f54535b8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f544c0b4b40 0x7f544c1541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f54535b8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f544c142c00 0x7f544c13df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f54535b8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c13a1d0 con 0x7f544c0b4b40 2023-11-28T20:08:50.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f54535b8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c155df0 con 0x7f544c0b4760 2023-11-28T20:08:50.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f54535b8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544c155550 con 0x7f544c142c00 2023-11-28T20:08:50.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5450b53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f544c0b4b40 0x7f544c1541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5450b53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f544c0b4b40 0x7f544c1541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55874/0 (socket says 172.21.15.177:55874) 2023-11-28T20:08:50.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5450b53640 1 -- 172.21.15.177:0/2035057408 learned_addr learned my addr 172.21.15.177:0/2035057408 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:50.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5450b53640 1 -- 172.21.15.177:0/2035057408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f544c142c00 msgr2=0x7f544c13df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5451b55640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f544c142c00 0x7f544c13df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5451354640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f544c0b4760 0x7f544c139c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5450b53640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f544c142c00 0x7f544c13df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5450b53640 1 -- 172.21.15.177:0/2035057408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f544c0b4760 msgr2=0x7f544c139c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5450b53640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f544c0b4760 0x7f544c139c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5450b53640 1 -- 172.21.15.177:0/2035057408 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480094d0 con 0x7f544c0b4b40 2023-11-28T20:08:50.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5451354640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f544c0b4760 0x7f544c139c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:50.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5451b55640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f544c142c00 0x7f544c13df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:50.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5450b53640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f544c0b4b40 0x7f544c1541f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f543c00c7c0 tx=0x7f543c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:50.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5441ffb640 1 -- 172.21.15.177:0/2035057408 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c007a30 con 0x7f544c0b4b40 2023-11-28T20:08:50.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5441ffb640 1 -- 172.21.15.177:0/2035057408 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c007b90 con 0x7f544c0b4b40 2023-11-28T20:08:50.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f5441ffb640 1 -- 172.21.15.177:0/2035057408 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c00ce70 con 0x7f544c0b4b40 2023-11-28T20:08:50.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f54535b8640 1 -- 172.21.15.177:0/2035057408 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544c155830 con 0x7f544c0b4b40 2023-11-28T20:08:50.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.506+0000 7f54535b8640 1 -- 172.21.15.177:0/2035057408 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544c1562c0 con 0x7f544c0b4b40 2023-11-28T20:08:50.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f5441ffb640 1 -- 172.21.15.177:0/2035057408 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f543c0113f0 con 0x7f544c0b4b40 2023-11-28T20:08:50.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f5441ffb640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f54300664a0 0x7f5430068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f5441ffb640 1 -- 172.21.15.177:0/2035057408 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f543c084240 con 0x7f544c0b4b40 2023-11-28T20:08:50.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f5451354640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f54300664a0 0x7f5430068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f545691e000 1 Processor -- start 2023-11-28T20:08:50.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f545691e000 1 -- start start 2023-11-28T20:08:50.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f5451354640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f54300664a0 0x7f5430068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f54480ad000 tx=0x7f5448008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:50.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f545691e000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f3424d0c90 0x55f3424d1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f545691e000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d15b0 0x55f342486de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f545691e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f342487700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f545691e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3422f1130 con 0x55f342487320 2023-11-28T20:08:50.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f545691e000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3422de9a0 con 0x55f3424d15b0 2023-11-28T20:08:50.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f545691e000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3422dbed0 con 0x55f3424d0c90 2023-11-28T20:08:50.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f5451b55640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f342487700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f5451b55640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f342487700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55888/0 (socket says 172.21.15.177:55888) 2023-11-28T20:08:50.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f5451b55640 1 -- 172.21.15.177:0/740500176 learned_addr learned my addr 172.21.15.177:0/740500176 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:50.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f5451b55640 1 -- 172.21.15.177:0/740500176 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f3424d0c90 msgr2=0x55f3424d1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:50.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f5450b53640 1 --2- 172.21.15.177:0/740500176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d15b0 0x55f342486de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f5451354640 1 --2- 172.21.15.177:0/740500176 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f3424d0c90 0x55f3424d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f5451b55640 1 --2- 172.21.15.177:0/740500176 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f3424d0c90 0x55f3424d1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f5451b55640 1 -- 172.21.15.177:0/740500176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d15b0 msgr2=0x55f342486de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:50.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f5451b55640 1 --2- 172.21.15.177:0/740500176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d15b0 0x55f342486de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.510+0000 7f5451b55640 1 -- 172.21.15.177:0/740500176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f341fcf890 con 0x55f342487320 2023-11-28T20:08:50.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f5451b55640 1 --2- 172.21.15.177:0/740500176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f342487700 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5444007f40 tx=0x7f544400d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1df45a52b459d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:50.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f542effd640 1 -- 172.21.15.177:0/740500176 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544400f860 con 0x55f342487320 2023-11-28T20:08:50.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f542effd640 1 -- 172.21.15.177:0/740500176 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544400f9c0 con 0x55f342487320 2023-11-28T20:08:50.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f542effd640 1 -- 172.21.15.177:0/740500176 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544400fd50 con 0x55f342487320 2023-11-28T20:08:50.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 -- 172.21.15.177:0/740500176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 msgr2=0x55f342487700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 --2- 172.21.15.177:0/740500176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f342487700 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5444007f40 tx=0x7f544400d800 comp rx=0 tx=0).stop 2023-11-28T20:08:50.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 -- 172.21.15.177:0/740500176 shutdown_connections 2023-11-28T20:08:50.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 --2- 172.21.15.177:0/740500176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f342487700 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 --2- 172.21.15.177:0/740500176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d15b0 0x55f342486de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 --2- 172.21.15.177:0/740500176 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f3424d0c90 0x55f3424d1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 -- 172.21.15.177:0/740500176 >> 172.21.15.177:0/740500176 conn(0x55f3424832d0 msgr2=0x55f3424856c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:50.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 -- 172.21.15.177:0/740500176 shutdown_connections 2023-11-28T20:08:50.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 -- 172.21.15.177:0/740500176 wait complete. 2023-11-28T20:08:50.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 -- start start 2023-11-28T20:08:50.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 Processor -- start 2023-11-28T20:08:50.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f34248bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f3424d0c90 0x55f34248c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d15b0 0x55f34249f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3422d77c0 con 0x55f342487320 2023-11-28T20:08:50.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f34228fbf0 con 0x55f3424d15b0 2023-11-28T20:08:50.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f342295a90 con 0x55f3424d0c90 2023-11-28T20:08:50.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f545691e000 10 client.0 _ll_register_callbacks cb 0x55f3424723c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:08:50.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f5451354640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f34248bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f5451354640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f34248bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55892/0 (socket says 172.21.15.177:55892) 2023-11-28T20:08:50.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f5451354640 1 -- 172.21.15.177:0/2880579669 learned_addr learned my addr 172.21.15.177:0/2880579669 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:50.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f5450b53640 1 --2- 172.21.15.177:0/2880579669 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f3424d0c90 0x55f34248c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.514+0000 7f5451b55640 1 --2- 172.21.15.177:0/2880579669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d15b0 0x55f34249f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5451354640 1 -- 172.21.15.177:0/2880579669 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f3424d0c90 msgr2=0x55f34248c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:50.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5451354640 1 --2- 172.21.15.177:0/2880579669 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f3424d0c90 0x55f34248c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5451354640 1 -- 172.21.15.177:0/2880579669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d15b0 msgr2=0x55f34249f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:50.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5451354640 1 --2- 172.21.15.177:0/2880579669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d15b0 0x55f34249f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5451354640 1 -- 172.21.15.177:0/2880579669 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5444007b70 con 0x55f342487320 2023-11-28T20:08:50.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5451354640 1 --2- 172.21.15.177:0/2880579669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f34248bd10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5448008010 tx=0x7f544801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3878f542b878eb98 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:50.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5427fff640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-11-28T20:08:50.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5427fff640 1 -- 172.21.15.177:0/2880579669 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54480bb070 con 0x55f342487320 2023-11-28T20:08:50.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 1 -- 172.21.15.177:0/2880579669 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f342299470 con 0x55f342487320 2023-11-28T20:08:50.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5427fff640 1 -- 172.21.15.177:0/2880579669 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54480abe30 con 0x55f342487320 2023-11-28T20:08:50.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5427fff640 1 -- 172.21.15.177:0/2880579669 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54480c1420 con 0x55f342487320 2023-11-28T20:08:50.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 10 client.5412 fetch_fsmap learned FSMap version 17 2023-11-28T20:08:50.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 1 -- 172.21.15.177:0/2880579669 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f342298190 con 0x55f342487320 2023-11-28T20:08:50.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5427fff640 1 -- 172.21.15.177:0/2880579669 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f342299470 con 0x55f342487320 2023-11-28T20:08:50.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5427fff640 1 -- 172.21.15.177:0/2880579669 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f54480c1580 con 0x55f342487320 2023-11-28T20:08:50.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 10 client.5412 fetch_fsmap finished waiting for FSMap version 17 2023-11-28T20:08:50.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 10 client.5412 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T20:08:50.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 20 client.5412 populate_metadata read hostname 'smithi177' 2023-11-28T20:08:50.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 1 --2- 172.21.15.177:0/2880579669 >> [v2:172.21.15.177:6835/3143070912,v1:172.21.15.177:6837/3143070912] conn(0x55f3424a0320 0x55f3424e2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 4 client.5412 mds_command: new command op to 5214 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T20:08:50.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 1 -- 172.21.15.177:0/2880579669 --> [v2:172.21.15.177:6835/3143070912,v1:172.21.15.177:6837/3143070912] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f34229cb50 con 0x55f3424a0320 2023-11-28T20:08:50.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5450b53640 1 --2- 172.21.15.177:0/2880579669 >> [v2:172.21.15.177:6835/3143070912,v1:172.21.15.177:6837/3143070912] conn(0x55f3424a0320 0x55f3424e2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5450b53640 1 --2- 172.21.15.177:0/2880579669 >> [v2:172.21.15.177:6835/3143070912,v1:172.21.15.177:6837/3143070912] conn(0x55f3424a0320 0x55f3424e2f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cace162814ec4014 server_cookie=59bb5ee551ba417b in_seq=0 out_seq=0 2023-11-28T20:08:50.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5427fff640 10 client.5412 ms_handle_connect on v2:172.21.15.177:6835/3143070912 2023-11-28T20:08:50.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5427fff640 1 -- 172.21.15.177:0/2880579669 <== mds.0 v2:172.21.15.177:6835/3143070912 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f34229cb50 con 0x55f3424a0320 2023-11-28T20:08:50.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5427fff640 10 client.5412 handle_command_reply: tid=0 2023-11-28T20:08:50.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 1 client.5412 shutdown 2023-11-28T20:08:50.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 1 -- 172.21.15.177:0/2880579669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 msgr2=0x55f34248bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 1 --2- 172.21.15.177:0/2880579669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f34248bd10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5448008010 tx=0x7f544801ad40 comp rx=0 tx=0).stop 2023-11-28T20:08:50.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 1 -- 172.21.15.177:0/2880579669 shutdown_connections 2023-11-28T20:08:50.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 1 --2- 172.21.15.177:0/2880579669 >> [v2:172.21.15.177:6835/3143070912,v1:172.21.15.177:6837/3143070912] conn(0x55f3424a0320 0x55f3424e2f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 1 --2- 172.21.15.177:0/2880579669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d15b0 0x55f34249f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 1 --2- 172.21.15.177:0/2880579669 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f3424d0c90 0x55f34248c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f5427fff640 0 client.5412 ms_handle_reset on v2:172.21.15.177:6835/3143070912 2023-11-28T20:08:50.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 1 --2- 172.21.15.177:0/2880579669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f34248bd10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 1 -- 172.21.15.177:0/2880579669 >> 172.21.15.177:0/2880579669 conn(0x55f3424832d0 msgr2=0x55f3424856c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:50.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 1 -- 172.21.15.177:0/2880579669 shutdown_connections 2023-11-28T20:08:50.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 1 -- 172.21.15.177:0/2880579669 wait complete. 2023-11-28T20:08:50.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.518+0000 7f545691e000 20 client.5412 trim_cache size 0 max 16384 2023-11-28T20:08:50.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.550+0000 7f545691e000 1 Processor -- start 2023-11-28T20:08:50.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.550+0000 7f545691e000 1 -- start start 2023-11-28T20:08:50.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f545691e000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f342487320 0x55f3424cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f545691e000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d0c90 0x55f3424ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f545691e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3424d15b0 0x55f3424cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f545691e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f341f90940 con 0x55f3424d15b0 2023-11-28T20:08:50.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f545691e000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f34248e890 con 0x55f3424d0c90 2023-11-28T20:08:50.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f545691e000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f34235efa0 con 0x55f342487320 2023-11-28T20:08:50.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f5451b55640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3424d15b0 0x55f3424cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f5451b55640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3424d15b0 0x55f3424cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55906/0 (socket says 172.21.15.177:55906) 2023-11-28T20:08:50.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f5451b55640 1 -- 172.21.15.177:0/3369675301 learned_addr learned my addr 172.21.15.177:0/3369675301 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:50.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f5450b53640 1 --2- 172.21.15.177:0/3369675301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d0c90 0x55f3424ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f5451354640 1 --2- 172.21.15.177:0/3369675301 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f342487320 0x55f3424cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f5451b55640 1 -- 172.21.15.177:0/3369675301 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f342487320 msgr2=0x55f3424cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:50.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f5451b55640 1 --2- 172.21.15.177:0/3369675301 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f342487320 0x55f3424cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f5451b55640 1 -- 172.21.15.177:0/3369675301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d0c90 msgr2=0x55f3424ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:50.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f5451b55640 1 --2- 172.21.15.177:0/3369675301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d0c90 0x55f3424ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f5451b55640 1 -- 172.21.15.177:0/3369675301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f34227e490 con 0x55f3424d15b0 2023-11-28T20:08:50.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f5451b55640 1 --2- 172.21.15.177:0/3369675301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3424d15b0 0x55f3424cf070 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5444014000 tx=0x7f5444012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1e45ddbe8241ac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:50.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f542f7fe640 1 -- 172.21.15.177:0/3369675301 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544400f9a0 con 0x55f3424d15b0 2023-11-28T20:08:50.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f542f7fe640 1 -- 172.21.15.177:0/3369675301 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544401e040 con 0x55f3424d15b0 2023-11-28T20:08:50.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f542f7fe640 1 -- 172.21.15.177:0/3369675301 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544400fd40 con 0x55f3424d15b0 2023-11-28T20:08:50.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f545691e000 1 -- 172.21.15.177:0/3369675301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3424d15b0 msgr2=0x55f3424cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f545691e000 1 --2- 172.21.15.177:0/3369675301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3424d15b0 0x55f3424cf070 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5444014000 tx=0x7f5444012000 comp rx=0 tx=0).stop 2023-11-28T20:08:50.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f545691e000 1 -- 172.21.15.177:0/3369675301 shutdown_connections 2023-11-28T20:08:50.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f545691e000 1 --2- 172.21.15.177:0/3369675301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3424d15b0 0x55f3424cf070 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f545691e000 1 --2- 172.21.15.177:0/3369675301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d0c90 0x55f3424ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f545691e000 1 --2- 172.21.15.177:0/3369675301 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f342487320 0x55f3424cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f545691e000 1 -- 172.21.15.177:0/3369675301 >> 172.21.15.177:0/3369675301 conn(0x55f3424832d0 msgr2=0x55f3424de280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:50.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f545691e000 1 -- 172.21.15.177:0/3369675301 shutdown_connections 2023-11-28T20:08:50.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.554+0000 7f545691e000 1 -- 172.21.15.177:0/3369675301 wait complete. 2023-11-28T20:08:50.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f545691e000 1 -- start start 2023-11-28T20:08:50.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f545691e000 1 Processor -- start 2023-11-28T20:08:50.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f545691e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f3424b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f545691e000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d0c90 0x55f3424886a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f545691e000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f3424d15b0 0x55f342488be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f545691e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f34228c760 con 0x55f342487320 2023-11-28T20:08:50.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f545691e000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3422936f0 con 0x55f3424d0c90 2023-11-28T20:08:50.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f545691e000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3422d3130 con 0x55f3424d15b0 2023-11-28T20:08:50.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f545691e000 10 client.0 _ll_register_callbacks cb 0x55f342325c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:08:50.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f5451354640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f3424b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f5451354640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f3424b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55918/0 (socket says 172.21.15.177:55918) 2023-11-28T20:08:50.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f5451354640 1 -- 172.21.15.177:0/2640009397 learned_addr learned my addr 172.21.15.177:0/2640009397 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:50.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f5450b53640 1 --2- 172.21.15.177:0/2640009397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d0c90 0x55f3424886a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f5451b55640 1 --2- 172.21.15.177:0/2640009397 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f3424d15b0 0x55f342488be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f5451354640 1 -- 172.21.15.177:0/2640009397 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f3424d15b0 msgr2=0x55f342488be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:50.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f5451354640 1 --2- 172.21.15.177:0/2640009397 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f3424d15b0 0x55f342488be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f5451354640 1 -- 172.21.15.177:0/2640009397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d0c90 msgr2=0x55f3424886a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:50.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f5451354640 1 --2- 172.21.15.177:0/2640009397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d0c90 0x55f3424886a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f5451354640 1 -- 172.21.15.177:0/2640009397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f341fcf890 con 0x55f342487320 2023-11-28T20:08:50.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f5451354640 1 --2- 172.21.15.177:0/2640009397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f3424b3ff0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f544801c9e0 tx=0x7f54480a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca983c0af6be5c7b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:50.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.558+0000 7f5427fff640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-11-28T20:08:50.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f5427fff640 1 -- 172.21.15.177:0/2640009397 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54480ab5d0 con 0x55f342487320 2023-11-28T20:08:50.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f5427fff640 1 -- 172.21.15.177:0/2640009397 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5448004450 con 0x55f342487320 2023-11-28T20:08:50.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 1 -- 172.21.15.177:0/2640009397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3422d6110 con 0x55f342487320 2023-11-28T20:08:50.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f5427fff640 1 -- 172.21.15.177:0/2640009397 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54480c1b80 con 0x55f342487320 2023-11-28T20:08:50.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 10 client.5418 fetch_fsmap learned FSMap version 17 2023-11-28T20:08:50.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 1 -- 172.21.15.177:0/2640009397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f341fcfcc0 con 0x55f342487320 2023-11-28T20:08:50.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f5427fff640 1 -- 172.21.15.177:0/2640009397 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f3422d6110 con 0x55f342487320 2023-11-28T20:08:50.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f5427fff640 1 -- 172.21.15.177:0/2640009397 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f54480c1d20 con 0x55f342487320 2023-11-28T20:08:50.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 10 client.5418 fetch_fsmap finished waiting for FSMap version 17 2023-11-28T20:08:50.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 10 client.5418 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T20:08:50.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 20 client.5418 populate_metadata read hostname 'smithi177' 2023-11-28T20:08:50.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 1 --2- 172.21.15.177:0/2640009397 >> [v2:172.21.15.177:6835/3143070912,v1:172.21.15.177:6837/3143070912] conn(0x55f3424e3370 0x55f3424e3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 4 client.5418 mds_command: new command op to 5214 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T20:08:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 1 -- 172.21.15.177:0/2640009397 --> [v2:172.21.15.177:6835/3143070912,v1:172.21.15.177:6837/3143070912] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f3423059a0 con 0x55f3424e3370 2023-11-28T20:08:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f5450b53640 1 --2- 172.21.15.177:0/2640009397 >> [v2:172.21.15.177:6835/3143070912,v1:172.21.15.177:6837/3143070912] conn(0x55f3424e3370 0x55f3424e3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f5450b53640 1 --2- 172.21.15.177:0/2640009397 >> [v2:172.21.15.177:6835/3143070912,v1:172.21.15.177:6837/3143070912] conn(0x55f3424e3370 0x55f3424e3750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a2c946460d3b5a5 server_cookie=1ee0c67672886314 in_seq=0 out_seq=0 2023-11-28T20:08:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f5427fff640 10 client.5418 ms_handle_connect on v2:172.21.15.177:6835/3143070912 2023-11-28T20:08:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f5427fff640 1 -- 172.21.15.177:0/2640009397 <== mds.0 v2:172.21.15.177:6835/3143070912 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f3423059a0 con 0x55f3424e3370 2023-11-28T20:08:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f5427fff640 10 client.5418 handle_command_reply: tid=0 2023-11-28T20:08:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 1 client.5418 shutdown 2023-11-28T20:08:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 1 -- 172.21.15.177:0/2640009397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 msgr2=0x55f3424b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 1 --2- 172.21.15.177:0/2640009397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f3424b3ff0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f544801c9e0 tx=0x7f54480a8000 comp rx=0 tx=0).stop 2023-11-28T20:08:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 1 -- 172.21.15.177:0/2640009397 shutdown_connections 2023-11-28T20:08:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 1 --2- 172.21.15.177:0/2640009397 >> [v2:172.21.15.177:6835/3143070912,v1:172.21.15.177:6837/3143070912] conn(0x55f3424e3370 0x55f3424e3750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 1 --2- 172.21.15.177:0/2640009397 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f3424d15b0 0x55f342488be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 1 --2- 172.21.15.177:0/2640009397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f3424d0c90 0x55f3424886a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f5427fff640 0 client.5418 ms_handle_reset on v2:172.21.15.177:6835/3143070912 2023-11-28T20:08:50.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 1 --2- 172.21.15.177:0/2640009397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f342487320 0x55f3424b3ff0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 1 -- 172.21.15.177:0/2640009397 >> 172.21.15.177:0/2640009397 conn(0x55f3424832d0 msgr2=0x55f3424856c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:50.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 1 -- 172.21.15.177:0/2640009397 shutdown_connections 2023-11-28T20:08:50.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 1 -- 172.21.15.177:0/2640009397 wait complete. 2023-11-28T20:08:50.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f545691e000 20 client.5418 trim_cache size 0 max 16384 2023-11-28T20:08:50.571 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:08:50.571 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "281097bd-2f79-488c-a8b5-264c5bd230f4", 2023-11-28T20:08:50.572 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-11-28T20:08:50.572 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 5214, 2023-11-28T20:08:50.572 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-11-28T20:08:50.572 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-11-28T20:08:50.572 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-11-28T20:08:50.573 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 10.527642481000001, 2023-11-28T20:08:50.573 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 17, 2023-11-28T20:08:50.573 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 33, 2023-11-28T20:08:50.573 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 33, 2023-11-28T20:08:50.573 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 17.538500246000002 2023-11-28T20:08:50.573 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:08:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f54535b8640 1 -- 172.21.15.177:0/2035057408 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f54300664a0 msgr2=0x7f5430068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f54535b8640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f54300664a0 0x7f5430068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f54480ad000 tx=0x7f5448008040 comp rx=0 tx=0).stop 2023-11-28T20:08:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f54535b8640 1 -- 172.21.15.177:0/2035057408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f544c0b4b40 msgr2=0x7f544c1541f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f54535b8640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f544c0b4b40 0x7f544c1541f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f543c00c7c0 tx=0x7f543c00cc80 comp rx=0 tx=0).stop 2023-11-28T20:08:50.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f54535b8640 1 -- 172.21.15.177:0/2035057408 shutdown_connections 2023-11-28T20:08:50.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f54535b8640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f54300664a0 0x7f5430068960 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f54535b8640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f544c142c00 0x7f544c13df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f54535b8640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f544c0b4b40 0x7f544c1541f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f54535b8640 1 --2- 172.21.15.177:0/2035057408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f544c0b4760 0x7f544c139c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f54535b8640 1 -- 172.21.15.177:0/2035057408 >> 172.21.15.177:0/2035057408 conn(0x7f544c06a530 msgr2=0x7f544c142300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:50.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f54535b8640 1 -- 172.21.15.177:0/2035057408 shutdown_connections 2023-11-28T20:08:50.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.562+0000 7f54535b8640 1 -- 172.21.15.177:0/2035057408 wait complete. 2023-11-28T20:08:50.585 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:08:50.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.718+0000 7fe2a11d1640 1 Processor -- start 2023-11-28T20:08:50.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.718+0000 7fe2a11d1640 1 -- start start 2023-11-28T20:08:50.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.722+0000 7fe2a11d1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe29c06c9d0 0x7fe29c070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.722+0000 7fe2a11d1640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c0710e0 con 0x7fe29c072180 2023-11-28T20:08:50.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.722+0000 7fe2a11d1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c0713c0 con 0x7fe29c144840 2023-11-28T20:08:50.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.722+0000 7fe2a11d1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29c15f010 con 0x7fe29c06c9d0 2023-11-28T20:08:50.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.722+0000 7fe29b59e640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe29c072180 0x7fe29c15b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:59554/0 (socket says 172.21.15.177:59554) 2023-11-28T20:08:50.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.722+0000 7fe29b59e640 1 -- 172.21.15.177:0/129830552 learned_addr learned my addr 172.21.15.177:0/129830552 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:50.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.722+0000 7fe29259c640 1 --2- 172.21.15.177:0/129830552 >> v2:172.21.15.195:3300/0 conn(0x7fe29c06c9d0 0x7fe29c070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.722+0000 7fe29a59c640 1 -- 172.21.15.177:0/129830552 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030386803 0 0) 0x7fe29c0710e0 con 0x7fe29c072180 2023-11-28T20:08:50.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.722+0000 7fe29a59c640 1 -- 172.21.15.177:0/129830552 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe288003530 con 0x7fe29c072180 2023-11-28T20:08:50.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.722+0000 7fe29a59c640 1 -- 172.21.15.177:0/129830552 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613249622 0 0) 0x7fe29c0713c0 con 0x7fe29c144840 2023-11-28T20:08:50.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.722+0000 7fe29259c640 1 -- 172.21.15.177:0/129830552 >> v1:172.21.15.195:6789/0 conn(0x7fe29c144840 legacy=0x7fe29c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.722+0000 7fe29259c640 1 -- 172.21.15.177:0/129830552 >> v1:172.21.15.177:6789/0 conn(0x7fe29c072180 legacy=0x7fe29c15b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.722+0000 7fe29259c640 1 -- 172.21.15.177:0/129830552 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c0716a0 con 0x7fe29c06c9d0 2023-11-28T20:08:50.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.726+0000 7fe29259c640 1 --2- 172.21.15.177:0/129830552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe29c06c9d0 0x7fe29c070460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe2840097c0 tx=0x7fe28401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67441132ae7b8244 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:50.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.726+0000 7fe29a59c640 1 -- 172.21.15.177:0/129830552 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2840ab650 con 0x7fe29c06c9d0 2023-11-28T20:08:50.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.726+0000 7fe29a59c640 1 -- 172.21.15.177:0/129830552 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2840ab7b0 con 0x7fe29c06c9d0 2023-11-28T20:08:50.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.726+0000 7fe29a59c640 1 -- 172.21.15.177:0/129830552 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2840abb40 con 0x7fe29c06c9d0 2023-11-28T20:08:50.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.726+0000 7fe2a11d1640 1 -- 172.21.15.177:0/129830552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe29c06c9d0 msgr2=0x7fe29c070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.726+0000 7fe2a11d1640 1 --2- 172.21.15.177:0/129830552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe29c06c9d0 0x7fe29c070460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe2840097c0 tx=0x7fe28401c450 comp rx=0 tx=0).stop 2023-11-28T20:08:50.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.726+0000 7fe2a11d1640 1 -- 172.21.15.177:0/129830552 shutdown_connections 2023-11-28T20:08:50.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.726+0000 7fe2a11d1640 1 --2- 172.21.15.177:0/129830552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe29c06c9d0 0x7fe29c070460 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.726+0000 7fe2a11d1640 1 -- 172.21.15.177:0/129830552 >> 172.21.15.177:0/129830552 conn(0x7fe29c06a530 msgr2=0x7fe29c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:50.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.726+0000 7fe2a11d1640 1 -- 172.21.15.177:0/129830552 shutdown_connections 2023-11-28T20:08:50.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.726+0000 7fe2a11d1640 1 -- 172.21.15.177:0/129830552 wait complete. 2023-11-28T20:08:50.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.726+0000 7fe2a11d1640 1 Processor -- start 2023-11-28T20:08:50.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.726+0000 7fe2a11d1640 1 -- start start 2023-11-28T20:08:50.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe2a11d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe29c06c9d0 0x7fe29c142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe2a11d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe29c072180 0x7fe29c165600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe2a11d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe29c144840 0x7fe29c1fa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe2a11d1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c165b40 con 0x7fe29c06c9d0 2023-11-28T20:08:50.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe2a11d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c165de0 con 0x7fe29c072180 2023-11-28T20:08:50.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe2a11d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c1660c0 con 0x7fe29c144840 2023-11-28T20:08:50.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe29ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe29c06c9d0 0x7fe29c142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe29ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe29c06c9d0 0x7fe29c142810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55922/0 (socket says 172.21.15.177:55922) 2023-11-28T20:08:50.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe29ad9d640 1 -- 172.21.15.177:0/1210125019 learned_addr learned my addr 172.21.15.177:0/1210125019 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:50.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe29259c640 1 --2- 172.21.15.177:0/1210125019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe29c072180 0x7fe29c165600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe29b59e640 1 --2- 172.21.15.177:0/1210125019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe29c144840 0x7fe29c1fa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe29ad9d640 1 -- 172.21.15.177:0/1210125019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe29c144840 msgr2=0x7fe29c1fa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe29ad9d640 1 --2- 172.21.15.177:0/1210125019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe29c144840 0x7fe29c1fa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe29ad9d640 1 -- 172.21.15.177:0/1210125019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe29c072180 msgr2=0x7fe29c165600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe29ad9d640 1 --2- 172.21.15.177:0/1210125019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe29c072180 0x7fe29c165600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe29ad9d640 1 -- 172.21.15.177:0/1210125019 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe284009420 con 0x7fe29c06c9d0 2023-11-28T20:08:50.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe29ad9d640 1 --2- 172.21.15.177:0/1210125019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe29c06c9d0 0x7fe29c142810 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe28c001ec0 tx=0x7fe28c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:50.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe293fff640 1 -- 172.21.15.177:0/1210125019 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0054e0 con 0x7fe29c06c9d0 2023-11-28T20:08:50.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe293fff640 1 -- 172.21.15.177:0/1210125019 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c003600 con 0x7fe29c06c9d0 2023-11-28T20:08:50.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe293fff640 1 -- 172.21.15.177:0/1210125019 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0039b0 con 0x7fe29c06c9d0 2023-11-28T20:08:50.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe2a11d1640 1 -- 172.21.15.177:0/1210125019 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29c1f9920 con 0x7fe29c06c9d0 2023-11-28T20:08:50.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe2a11d1640 1 -- 172.21.15.177:0/1210125019 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29c1663a0 con 0x7fe29c06c9d0 2023-11-28T20:08:50.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.730+0000 7fe2a11d1640 1 -- 172.21.15.177:0/1210125019 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29c166590 con 0x7fe29c06c9d0 2023-11-28T20:08:50.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.734+0000 7fe293fff640 1 -- 172.21.15.177:0/1210125019 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe28c003b10 con 0x7fe29c06c9d0 2023-11-28T20:08:50.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.734+0000 7fe293fff640 1 --2- 172.21.15.177:0/1210125019 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe27c066470 0x7fe27c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:50.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.734+0000 7fe293fff640 1 -- 172.21.15.177:0/1210125019 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe28c0833e0 con 0x7fe29c06c9d0 2023-11-28T20:08:50.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.734+0000 7fe29259c640 1 --2- 172.21.15.177:0/1210125019 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe27c066470 0x7fe27c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:50.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.734+0000 7fe29259c640 1 --2- 172.21.15.177:0/1210125019 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe27c066470 0x7fe27c068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe2840af000 tx=0x7fe2840a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:50.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.738+0000 7fe293fff640 1 -- 172.21.15.177:0/1210125019 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe28c050900 con 0x7fe29c06c9d0 2023-11-28T20:08:50.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.918+0000 7fe2a11d1640 1 -- 172.21.15.177:0/1210125019 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe29c1f9e40 con 0x7fe29c06c9d0 2023-11-28T20:08:50.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.918+0000 7fe293fff640 1 -- 172.21.15.177:0/1210125019 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe28c017070 con 0x7fe29c06c9d0 2023-11-28T20:08:50.919 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:08:50.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.918+0000 7fe2a11d1640 1 -- 172.21.15.177:0/1210125019 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe27c066470 msgr2=0x7fe27c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.918+0000 7fe2a11d1640 1 --2- 172.21.15.177:0/1210125019 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe27c066470 0x7fe27c068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe2840af000 tx=0x7fe2840a7000 comp rx=0 tx=0).stop 2023-11-28T20:08:50.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.918+0000 7fe2a11d1640 1 -- 172.21.15.177:0/1210125019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe29c06c9d0 msgr2=0x7fe29c142810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:50.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.918+0000 7fe2a11d1640 1 --2- 172.21.15.177:0/1210125019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe29c06c9d0 0x7fe29c142810 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe28c001ec0 tx=0x7fe28c00c8e0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.918+0000 7fe2a11d1640 1 -- 172.21.15.177:0/1210125019 shutdown_connections 2023-11-28T20:08:50.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.918+0000 7fe2a11d1640 1 --2- 172.21.15.177:0/1210125019 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe27c066470 0x7fe27c068930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.918+0000 7fe2a11d1640 1 --2- 172.21.15.177:0/1210125019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe29c144840 0x7fe29c1fa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.918+0000 7fe2a11d1640 1 --2- 172.21.15.177:0/1210125019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe29c072180 0x7fe29c165600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.918+0000 7fe2a11d1640 1 --2- 172.21.15.177:0/1210125019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe29c06c9d0 0x7fe29c142810 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:50.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.918+0000 7fe2a11d1640 1 -- 172.21.15.177:0/1210125019 >> 172.21.15.177:0/1210125019 conn(0x7fe29c06a530 msgr2=0x7fe29c13f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:50.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.918+0000 7fe2a11d1640 1 -- 172.21.15.177:0/1210125019 shutdown_connections 2023-11-28T20:08:50.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:50.918+0000 7fe2a11d1640 1 -- 172.21.15.177:0/1210125019 wait complete. 2023-11-28T20:08:50.940 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T20:08:50.940 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:08:50.940 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-11-28T20:08:50.941 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T20:08:50.941 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:08:50.941 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T20:08:50.941 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T20:08:50.941 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:08:50.941 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:08:50.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:50.941 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-11-28T20:08:50.951 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:08:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:08:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:08:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-11-28T20:08:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:50.951 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:08:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-11-28T20:08:50.952 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:08:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-11-28T20:08:50.952 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:08:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:50.952 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:08:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:08:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42343sec preferred_lft 42343sec 2023-11-28T20:08:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-11-28T20:08:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:50.953 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:08:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:91:19:71:65 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:08:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:50.953 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:08:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:08:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:08:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:08:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:50.954 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:08:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:08:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:08:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:50.954 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:08:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:08:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-28T20:08:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:08:50.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:50.956 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:08:51.020 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-11-28T20:08:51.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:51.023 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-11-28T20:08:51.076 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-11-28T20:08:51.076 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:08:51.076 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:08:51.077 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:08:51.077 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:08:51.077 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:08:51.077 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:08:51.077 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:08:51.077 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:08:51.077 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:08:51.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:51.078 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-28T20:08:51.078 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-28T20:08:51.078 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:08:51.078 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:08:51.078 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:08:51.078 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-28T20:08:51.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:51.168 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-11-28T20:08:51.178 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T20:08:51.178 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T20:08:51.178 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:08:51.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:51.179 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-11-28T20:08:51.243 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T20:08:51.243 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:08:51.243 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T20:08:51.298 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:08:51.299 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:08:51.299 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:08:51.354 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:08:51.423 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:08:51.480 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:08:51.480 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:08:51.480 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:08:51.480 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:08:51.480 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:08:51.481 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:08:51.481 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:08:51.481 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:08:51.481 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:08:51.481 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:08:51.481 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:08:51.481 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:08:51.481 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:08:51.482 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:08:51.482 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:08:51.482 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:08:51.482 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:08:51.482 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:08:51.482 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:08:51.482 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:08:51.483 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:08:51.483 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:08:51.483 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:08:51.483 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:08:51.483 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:08:51.483 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:08:51.483 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:08:51.483 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:08:51.484 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:08:51.484 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:08:51.484 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:08:51.484 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:08:51.484 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:08:51.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:51.487 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:08:51.538 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T20:08:51.539 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T20:08:51.585 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:08:51.606 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:08:51.660 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:08:51.660 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:08:51.660 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:08:51.660 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:08:51.660 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:08:51.661 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:08:51.661 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:08:51.661 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:08:51.661 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:08:51.661 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:08:51.661 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:08:51.661 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:08:51.661 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:08:51.661 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:08:51.661 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:08:51.661 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:08:51.661 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:08:51.661 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:08:51.662 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:08:51.662 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:08:51.662 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:08:51.663 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:08:51.663 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:08:51.663 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:08:51.663 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:08:51.663 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:08:51.663 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:08:51.663 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:08:51.663 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:08:51.663 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:08:51.663 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:08:51.663 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:08:51.663 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:08:51.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:51.667 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:08:51.680 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-11-28T20:08:51.678+0000 7f959e48d580 -1 init, newargv = 0x555b6a065080 newargc=15 2023-11-28T20:08:51.680 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[49042]: starting ceph client 2023-11-28T20:08:51.686 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[49042]: starting fuse 2023-11-28T20:08:51.690 INFO:teuthology.orchestra.run.smithi177.stdout:43 2023-11-28T20:08:51.691 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T20:08:51.691 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-11-28T20:08:51.691 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-11-28T20:08:51.691 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-11-28T20:08:51.691 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-11-28T20:08:51.691 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-11-28T20:08:51.691 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:08:51.691 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-11-28T20:08:51.691 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T20:08:51.692 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-11-28T20:08:51.692 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T20:08:51.692 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:08:51.692 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-11-28T20:08:51.692 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-11-28T20:08:51.692 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-11-28T20:08:51.692 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-11-28T20:08:51.692 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:08:51.692 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-11-28T20:08:51.692 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T20:08:51.692 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T20:08:51.692 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T20:08:51.692 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-11-28T20:08:51.692 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-11-28T20:08:51.692 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-11-28T20:08:51.693 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T20:08:51.693 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:08:51.693 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-11-28T20:08:51.693 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-11-28T20:08:51.819 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.49042.asok 2023-11-28T20:08:51.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T20:08:51.831 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49042.asok 2023-11-28T20:08:51.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:51.831 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49042.asok status 2023-11-28T20:08:52.003 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:08:52.003 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-11-28T20:08:52.003 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T20:08:52.003 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T20:08:52.003 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-11-28T20:08:52.003 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-11-28T20:08:52.004 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T20:08:52.004 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "49042", 2023-11-28T20:08:52.004 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-11-28T20:08:52.004 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:52.004 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-11-28T20:08:52.004 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-11-28T20:08:52.004 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 5433, 2023-11-28T20:08:52.004 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-11-28T20:08:52.004 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-11-28T20:08:52.004 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-11-28T20:08:52.004 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 5433 2023-11-28T20:08:52.004 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:52.004 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:08:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:08:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:08:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 669970092 2023-11-28T20:08:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:08:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:08:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:08:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:08:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 669970092 2023-11-28T20:08:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:08:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.5433 192.168.0.1:0/669970092", 2023-11-28T20:08:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/669970092", 2023-11-28T20:08:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-11-28T20:08:52.006 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 17, 2023-11-28T20:08:52.006 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 33, 2023-11-28T20:08:52.006 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-11-28T20:08:52.006 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-11-28T20:08:52.006 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-11-28T20:08:52.006 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:08:52.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:52.018 DEBUG:teuthology.orchestra.run.smithi177:> stat --file-system '--printf=%T 2023-11-28T20:08:52.018 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T20:08:52.030 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-11-28T20:08:52.030 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T20:08:52.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:52.031 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:08:52.101 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2023-11-28T20:08:52.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.286+0000 7f7478a5f640 1 Processor -- start 2023-11-28T20:08:52.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.286+0000 7f7478a5f640 1 -- start start 2023-11-28T20:08:52.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.286+0000 7f7478a5f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7474159ba0 0x7f74740c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:52.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.286+0000 7f7478a5f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74740cb0c0 0x7f7474070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:52.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.286+0000 7f7478a5f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f74740cce60 0x7f74740cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:52.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.286+0000 7f7478a5f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74740cd830 con 0x7f74740cce60 2023-11-28T20:08:52.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.286+0000 7f7478a5f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74740cb520 con 0x7f7474159ba0 2023-11-28T20:08:52.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.286+0000 7f7478a5f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7474159f80 con 0x7f74740cb0c0 2023-11-28T20:08:52.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.286+0000 7f7472d9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f74740cce60 0x7f74740cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:52.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.286+0000 7f7472d9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f74740cce60 0x7f74740cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55928/0 (socket says 172.21.15.177:55928) 2023-11-28T20:08:52.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.286+0000 7f7472d9d640 1 -- 172.21.15.177:0/1080369335 learned_addr learned my addr 172.21.15.177:0/1080369335 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:52.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.290+0000 7f747259c640 1 --2- 172.21.15.177:0/1080369335 >> v2:172.21.15.195:3300/0 conn(0x7f7474159ba0 0x7f74740c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:52.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.290+0000 7f7469d9b640 1 --2- 172.21.15.177:0/1080369335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74740cb0c0 0x7f7474070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:52.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.290+0000 7f7472d9d640 1 -- 172.21.15.177:0/1080369335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74740cb0c0 msgr2=0x7f7474070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:52.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.290+0000 7f7472d9d640 1 --2- 172.21.15.177:0/1080369335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74740cb0c0 0x7f7474070580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:52.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.290+0000 7f7472d9d640 1 -- 172.21.15.177:0/1080369335 >> v2:172.21.15.195:3300/0 conn(0x7f7474159ba0 msgr2=0x7f74740c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:52.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.290+0000 7f7472d9d640 1 --2- 172.21.15.177:0/1080369335 >> v2:172.21.15.195:3300/0 conn(0x7f7474159ba0 0x7f74740c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:52.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.290+0000 7f7472d9d640 1 -- 172.21.15.177:0/1080369335 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74740ce460 con 0x7f74740cce60 2023-11-28T20:08:52.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.290+0000 7f7469d9b640 1 --2- 172.21.15.177:0/1080369335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74740cb0c0 0x7f7474070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:52.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.290+0000 7f747259c640 1 --2- 172.21.15.177:0/1080369335 >> v2:172.21.15.195:3300/0 conn(0x7f7474159ba0 0x7f74740c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:52.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.290+0000 7f7472d9d640 1 --2- 172.21.15.177:0/1080369335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74740cce60 0x7f74740cd2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7474068020 tx=0x7f746c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c26f01f7023e2e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:52.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.290+0000 7f7471d9b640 1 -- 172.21.15.177:0/1080369335 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0a57a0 con 0x7f74740cce60 2023-11-28T20:08:52.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.290+0000 7f7471d9b640 1 -- 172.21.15.177:0/1080369335 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c0a5900 con 0x7f74740cce60 2023-11-28T20:08:52.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.290+0000 7f7471d9b640 1 -- 172.21.15.177:0/1080369335 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0a5c90 con 0x7f74740cce60 2023-11-28T20:08:52.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.290+0000 7f7478a5f640 1 -- 172.21.15.177:0/1080369335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74740cce60 msgr2=0x7f74740cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:52.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.290+0000 7f7478a5f640 1 --2- 172.21.15.177:0/1080369335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74740cce60 0x7f74740cd2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7474068020 tx=0x7f746c01c9a0 comp rx=0 tx=0).stop 2023-11-28T20:08:52.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7478a5f640 1 -- 172.21.15.177:0/1080369335 shutdown_connections 2023-11-28T20:08:52.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7478a5f640 1 --2- 172.21.15.177:0/1080369335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74740cce60 0x7f74740cd2f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:52.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7478a5f640 1 --2- 172.21.15.177:0/1080369335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74740cb0c0 0x7f7474070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:52.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7478a5f640 1 --2- 172.21.15.177:0/1080369335 >> v2:172.21.15.195:3300/0 conn(0x7f7474159ba0 0x7f74740c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:52.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7478a5f640 1 -- 172.21.15.177:0/1080369335 >> 172.21.15.177:0/1080369335 conn(0x7f74740b0c50 msgr2=0x7f74740b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:52.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7478a5f640 1 -- 172.21.15.177:0/1080369335 shutdown_connections 2023-11-28T20:08:52.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7478a5f640 1 -- 172.21.15.177:0/1080369335 wait complete. 2023-11-28T20:08:52.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7478a5f640 1 Processor -- start 2023-11-28T20:08:52.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7478a5f640 1 -- start start 2023-11-28T20:08:52.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7478a5f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74740cb0c0 0x7f747414cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:52.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7478a5f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74740cce60 0x7f747406c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:52.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7478a5f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7474159ba0 0x7f747406cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:52.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7478a5f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7474150980 con 0x7f74740cce60 2023-11-28T20:08:52.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7478a5f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7474150bd0 con 0x7f74740cb0c0 2023-11-28T20:08:52.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7478a5f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7474150eb0 con 0x7f7474159ba0 2023-11-28T20:08:52.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7469d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74740cce60 0x7f747406c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:52.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f747259c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74740cb0c0 0x7f747414cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:52.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7469d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74740cce60 0x7f747406c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55944/0 (socket says 172.21.15.177:55944) 2023-11-28T20:08:52.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7469d9b640 1 -- 172.21.15.177:0/2422853235 learned_addr learned my addr 172.21.15.177:0/2422853235 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:52.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7472d9d640 1 --2- 172.21.15.177:0/2422853235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7474159ba0 0x7f747406cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:52.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7469d9b640 1 -- 172.21.15.177:0/2422853235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7474159ba0 msgr2=0x7f747406cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:52.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7469d9b640 1 --2- 172.21.15.177:0/2422853235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7474159ba0 0x7f747406cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:52.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7469d9b640 1 -- 172.21.15.177:0/2422853235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74740cb0c0 msgr2=0x7f747414cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:52.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7469d9b640 1 --2- 172.21.15.177:0/2422853235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74740cb0c0 0x7f747414cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:52.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.294+0000 7f7469d9b640 1 -- 172.21.15.177:0/2422853235 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c009b30 con 0x7f74740cce60 2023-11-28T20:08:52.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.298+0000 7f7469d9b640 1 --2- 172.21.15.177:0/2422853235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74740cce60 0x7f747406c5e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f746400e810 tx=0x7f746400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:52.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.298+0000 7f746b7fe640 1 -- 172.21.15.177:0/2422853235 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464004030 con 0x7f74740cce60 2023-11-28T20:08:52.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.298+0000 7f746b7fe640 1 -- 172.21.15.177:0/2422853235 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7464004190 con 0x7f74740cce60 2023-11-28T20:08:52.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.298+0000 7f7478a5f640 1 -- 172.21.15.177:0/2422853235 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7474151190 con 0x7f74740cce60 2023-11-28T20:08:52.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.298+0000 7f746b7fe640 1 -- 172.21.15.177:0/2422853235 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464004520 con 0x7f74740cce60 2023-11-28T20:08:52.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.298+0000 7f7478a5f640 1 -- 172.21.15.177:0/2422853235 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7474151750 con 0x7f74740cce60 2023-11-28T20:08:52.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.298+0000 7f7478a5f640 1 -- 172.21.15.177:0/2422853235 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747404e850 con 0x7f74740cce60 2023-11-28T20:08:52.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.298+0000 7f746b7fe640 1 -- 172.21.15.177:0/2422853235 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f746400c6d0 con 0x7f74740cce60 2023-11-28T20:08:52.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.298+0000 7f746b7fe640 1 --2- 172.21.15.177:0/2422853235 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7454066470 0x7f7454068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:52.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.298+0000 7f746b7fe640 1 -- 172.21.15.177:0/2422853235 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7464083a40 con 0x7f74740cce60 2023-11-28T20:08:52.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.298+0000 7f747259c640 1 --2- 172.21.15.177:0/2422853235 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7454066470 0x7f7454068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:52.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.302+0000 7f747259c640 1 --2- 172.21.15.177:0/2422853235 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7454066470 0x7f7454068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f745c0045f0 tx=0x7f745c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:52.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.302+0000 7f746b7fe640 1 -- 172.21.15.177:0/2422853235 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7464085e60 con 0x7f74740cce60 2023-11-28T20:08:52.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:52.454+0000 7f7478a5f640 1 -- 172.21.15.177:0/2422853235 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) v1 -- 0x7f74740693d0 con 0x7f74740cce60 2023-11-28T20:08:53.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.250+0000 7f746b7fe640 1 -- 172.21.15.177:0/2422853235 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v34) v1 ==== 124+0+0 (secure 0 0 0) 0x7f74640200a0 con 0x7f74740cce60 2023-11-28T20:08:53.253 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'data_new' created 2023-11-28T20:08:53.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.254+0000 7f7478a5f640 1 -- 172.21.15.177:0/2422853235 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7454066470 msgr2=0x7f7454068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:53.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.254+0000 7f7478a5f640 1 --2- 172.21.15.177:0/2422853235 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7454066470 0x7f7454068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f745c0045f0 tx=0x7f745c008040 comp rx=0 tx=0).stop 2023-11-28T20:08:53.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.254+0000 7f7478a5f640 1 -- 172.21.15.177:0/2422853235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74740cce60 msgr2=0x7f747406c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:53.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.254+0000 7f7478a5f640 1 --2- 172.21.15.177:0/2422853235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74740cce60 0x7f747406c5e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f746400e810 tx=0x7f746400ecd0 comp rx=0 tx=0).stop 2023-11-28T20:08:53.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.254+0000 7f7478a5f640 1 -- 172.21.15.177:0/2422853235 shutdown_connections 2023-11-28T20:08:53.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.254+0000 7f7478a5f640 1 --2- 172.21.15.177:0/2422853235 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7454066470 0x7f7454068930 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:53.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.254+0000 7f7478a5f640 1 --2- 172.21.15.177:0/2422853235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7474159ba0 0x7f747406cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:53.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.254+0000 7f7478a5f640 1 --2- 172.21.15.177:0/2422853235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74740cce60 0x7f747406c5e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:53.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.254+0000 7f7478a5f640 1 --2- 172.21.15.177:0/2422853235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74740cb0c0 0x7f747414cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:53.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.254+0000 7f7478a5f640 1 -- 172.21.15.177:0/2422853235 >> 172.21.15.177:0/2422853235 conn(0x7f74740b0c50 msgr2=0x7f74740aeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:53.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.254+0000 7f7478a5f640 1 -- 172.21.15.177:0/2422853235 shutdown_connections 2023-11-28T20:08:53.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.254+0000 7f7478a5f640 1 -- 172.21.15.177:0/2422853235 wait complete. 2023-11-28T20:08:53.286 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2023-11-28T20:08:53.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.426+0000 7f658c479640 1 Processor -- start 2023-11-28T20:08:53.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.426+0000 7f658c479640 1 -- start start 2023-11-28T20:08:53.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.426+0000 7f658c479640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f658414abe0 0x7f6584165a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:53.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.426+0000 7f658c479640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f658414b1e0 0x7f65840b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:53.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.426+0000 7f658c479640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65840b1fc0 con 0x7f65840b4350 2023-11-28T20:08:53.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.426+0000 7f658c479640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65840b47e0 con 0x7f658414b1e0 2023-11-28T20:08:53.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.426+0000 7f658c479640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65840b2260 con 0x7f658414abe0 2023-11-28T20:08:53.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.426+0000 7f658aa16640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f65840b4350 0x7f6584161b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:59570/0 (socket says 172.21.15.177:59570) 2023-11-28T20:08:53.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.426+0000 7f658aa16640 1 -- 172.21.15.177:0/1140127 learned_addr learned my addr 172.21.15.177:0/1140127 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:53.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.426+0000 7f658a215640 1 --2- 172.21.15.177:0/1140127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f658414abe0 0x7f6584165a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:53.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.426+0000 7f6589a14640 1 --2- 172.21.15.177:0/1140127 >> v2:172.21.15.195:3300/0 conn(0x7f658414b1e0 0x7f65840b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:53.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.426+0000 7f658a215640 1 -- 172.21.15.177:0/1140127 >> v2:172.21.15.195:3300/0 conn(0x7f658414b1e0 msgr2=0x7f65840b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:53.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.426+0000 7f658a215640 1 --2- 172.21.15.177:0/1140127 >> v2:172.21.15.195:3300/0 conn(0x7f658414b1e0 0x7f65840b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:53.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.426+0000 7f658a215640 1 -- 172.21.15.177:0/1140127 >> v1:172.21.15.177:6789/0 conn(0x7f65840b4350 legacy=0x7f6584161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:53.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.426+0000 7f658a215640 1 -- 172.21.15.177:0/1140127 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65840b2540 con 0x7f658414abe0 2023-11-28T20:08:53.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.430+0000 7f658a215640 1 --2- 172.21.15.177:0/1140127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f658414abe0 0x7f6584165a20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f65800097c0 tx=0x7f658001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab77b13f504f3648 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:53.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.430+0000 7f6589213640 1 -- 172.21.15.177:0/1140127 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800ab650 con 0x7f658414abe0 2023-11-28T20:08:53.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.430+0000 7f6589213640 1 -- 172.21.15.177:0/1140127 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65800ab7b0 con 0x7f658414abe0 2023-11-28T20:08:53.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.430+0000 7f6589213640 1 -- 172.21.15.177:0/1140127 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800abb40 con 0x7f658414abe0 2023-11-28T20:08:53.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.430+0000 7f658c479640 1 -- 172.21.15.177:0/1140127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f658414abe0 msgr2=0x7f6584165a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:53.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.430+0000 7f658c479640 1 --2- 172.21.15.177:0/1140127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f658414abe0 0x7f6584165a20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f65800097c0 tx=0x7f658001c450 comp rx=0 tx=0).stop 2023-11-28T20:08:53.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.430+0000 7f658c479640 1 -- 172.21.15.177:0/1140127 shutdown_connections 2023-11-28T20:08:53.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.430+0000 7f658c479640 1 --2- 172.21.15.177:0/1140127 >> v2:172.21.15.195:3300/0 conn(0x7f658414b1e0 0x7f65840b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:53.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.430+0000 7f658c479640 1 --2- 172.21.15.177:0/1140127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f658414abe0 0x7f6584165a20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:53.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.430+0000 7f658c479640 1 -- 172.21.15.177:0/1140127 >> 172.21.15.177:0/1140127 conn(0x7f65840b0cc0 msgr2=0x7f65840b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:53.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.430+0000 7f658c479640 1 -- 172.21.15.177:0/1140127 shutdown_connections 2023-11-28T20:08:53.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.430+0000 7f658c479640 1 -- 172.21.15.177:0/1140127 wait complete. 2023-11-28T20:08:53.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658c479640 1 Processor -- start 2023-11-28T20:08:53.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658c479640 1 -- start start 2023-11-28T20:08:53.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658c479640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65840b4350 0x7f6584166780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:53.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658c479640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f658414abe0 0x7f6584161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:53.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658c479640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65841490a0 0x7f6584147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:53.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658c479640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658414a770 con 0x7f65840b4350 2023-11-28T20:08:53.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658c479640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658416a890 con 0x7f65841490a0 2023-11-28T20:08:53.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658c479640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6584166e80 con 0x7f658414abe0 2023-11-28T20:08:53.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658a215640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65840b4350 0x7f6584166780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:53.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658a215640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65840b4350 0x7f6584166780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55956/0 (socket says 172.21.15.177:55956) 2023-11-28T20:08:53.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658a215640 1 -- 172.21.15.177:0/3163511928 learned_addr learned my addr 172.21.15.177:0/3163511928 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:53.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f6589a14640 1 --2- 172.21.15.177:0/3163511928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f658414abe0 0x7f6584161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:53.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658aa16640 1 --2- 172.21.15.177:0/3163511928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65841490a0 0x7f6584147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:53.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658a215640 1 -- 172.21.15.177:0/3163511928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f658414abe0 msgr2=0x7f6584161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:53.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658a215640 1 --2- 172.21.15.177:0/3163511928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f658414abe0 0x7f6584161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:53.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658a215640 1 -- 172.21.15.177:0/3163511928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65841490a0 msgr2=0x7f6584147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:53.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658a215640 1 --2- 172.21.15.177:0/3163511928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65841490a0 0x7f6584147200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:53.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658a215640 1 -- 172.21.15.177:0/3163511928 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6580009420 con 0x7f65840b4350 2023-11-28T20:08:53.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658a215640 1 --2- 172.21.15.177:0/3163511928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65840b4350 0x7f6584166780 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f658001ab00 tx=0x7f658001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:53.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f657affd640 1 -- 172.21.15.177:0/3163511928 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800bf610 con 0x7f65840b4350 2023-11-28T20:08:53.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f657affd640 1 -- 172.21.15.177:0/3163511928 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65800bf790 con 0x7f65840b4350 2023-11-28T20:08:53.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f657affd640 1 -- 172.21.15.177:0/3163511928 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800bfb40 con 0x7f65840b4350 2023-11-28T20:08:53.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658c479640 1 -- 172.21.15.177:0/3163511928 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6584167160 con 0x7f65840b4350 2023-11-28T20:08:53.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.434+0000 7f658c479640 1 -- 172.21.15.177:0/3163511928 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6584167720 con 0x7f65840b4350 2023-11-28T20:08:53.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.438+0000 7f658c479640 1 -- 172.21.15.177:0/3163511928 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65840693d0 con 0x7f65840b4350 2023-11-28T20:08:53.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.438+0000 7f657affd640 1 -- 172.21.15.177:0/3163511928 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f65800ca420 con 0x7f65840b4350 2023-11-28T20:08:53.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.438+0000 7f657affd640 1 --2- 172.21.15.177:0/3163511928 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f65680664a0 0x7f6568068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:53.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.438+0000 7f657affd640 1 -- 172.21.15.177:0/3163511928 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6072+0+0 (secure 0 0 0) 0x7f6584162a70 con 0x7f65840b4350 2023-11-28T20:08:53.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.438+0000 7f6589a14640 1 --2- 172.21.15.177:0/3163511928 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f65680664a0 0x7f6568068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:53.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.438+0000 7f6589a14640 1 --2- 172.21.15.177:0/3163511928 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f65680664a0 0x7f6568068960 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6584168190 tx=0x7f6574008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:53.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.442+0000 7f657affd640 1 -- 172.21.15.177:0/3163511928 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65800ec7c0 con 0x7f65840b4350 2023-11-28T20:08:53.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:53.630+0000 7f658c479640 1 -- 172.21.15.177:0/3163511928 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) v1 -- 0x7f6584166560 con 0x7f65840b4350 2023-11-28T20:08:54.276 INFO:teuthology.orchestra.run.smithi177.stderr:added data pool 6 to fsmap 2023-11-28T20:08:54.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.274+0000 7f657affd640 1 -- 172.21.15.177:0/3163511928 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 6 to fsmap v18) v1 ==== 131+0+0 (secure 0 0 0) 0x7f65800efde0 con 0x7f65840b4350 2023-11-28T20:08:54.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.278+0000 7f658c479640 1 -- 172.21.15.177:0/3163511928 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f65680664a0 msgr2=0x7f6568068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.278+0000 7f658c479640 1 --2- 172.21.15.177:0/3163511928 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f65680664a0 0x7f6568068960 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6584168190 tx=0x7f6574008040 comp rx=0 tx=0).stop 2023-11-28T20:08:54.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.278+0000 7f658c479640 1 -- 172.21.15.177:0/3163511928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65840b4350 msgr2=0x7f6584166780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.278+0000 7f658c479640 1 --2- 172.21.15.177:0/3163511928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65840b4350 0x7f6584166780 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f658001ab00 tx=0x7f658001ac90 comp rx=0 tx=0).stop 2023-11-28T20:08:54.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.278+0000 7f658c479640 1 -- 172.21.15.177:0/3163511928 shutdown_connections 2023-11-28T20:08:54.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.278+0000 7f658c479640 1 --2- 172.21.15.177:0/3163511928 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f65680664a0 0x7f6568068960 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.278+0000 7f658c479640 1 --2- 172.21.15.177:0/3163511928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65841490a0 0x7f6584147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.278+0000 7f658c479640 1 --2- 172.21.15.177:0/3163511928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f658414abe0 0x7f6584161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.278+0000 7f658c479640 1 --2- 172.21.15.177:0/3163511928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65840b4350 0x7f6584166780 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.278+0000 7f658c479640 1 -- 172.21.15.177:0/3163511928 >> 172.21.15.177:0/3163511928 conn(0x7f65840b0cc0 msgr2=0x7f6584164570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:54.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.282+0000 7f658c479640 1 -- 172.21.15.177:0/3163511928 shutdown_connections 2023-11-28T20:08:54.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.282+0000 7f658c479640 1 -- 172.21.15.177:0/3163511928 wait complete. 2023-11-28T20:08:54.305 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:08:54.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fe48dc640 1 Processor -- start 2023-11-28T20:08:54.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fe48dc640 1 -- start start 2023-11-28T20:08:54.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fe48dc640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1fe015d7d0 0x7f1fe00d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:54.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fe48dc640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe00d1970 con 0x7f1fe00b2ae0 2023-11-28T20:08:54.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fe48dc640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe00d0da0 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fe48dc640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe00d0810 con 0x7f1fe015d7d0 2023-11-28T20:08:54.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fded9d640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f1fe00b2ae0 0x7f1fe015d0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:59584/0 (socket says 172.21.15.177:59584) 2023-11-28T20:08:54.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fded9d640 1 -- 172.21.15.177:0/3180752536 learned_addr learned my addr 172.21.15.177:0/3180752536 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:54.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fde59c640 1 --2- 172.21.15.177:0/3180752536 >> v2:172.21.15.195:3300/0 conn(0x7f1fe015d7d0 0x7f1fe00d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:54.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fddd9b640 1 -- 172.21.15.177:0/3180752536 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769607903 0 0) 0x7f1fe00d1970 con 0x7f1fe00b2ae0 2023-11-28T20:08:54.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fddd9b640 1 -- 172.21.15.177:0/3180752536 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fc8003530 con 0x7f1fe00b2ae0 2023-11-28T20:08:54.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fddd9b640 1 -- 172.21.15.177:0/3180752536 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947142700 0 0) 0x7f1fe00d0da0 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fddd9b640 1 -- 172.21.15.177:0/3180752536 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fe00d1970 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fde59c640 1 -- 172.21.15.177:0/3180752536 >> v1:172.21.15.195:6789/0 conn(0x7f1fe00b2ec0 legacy=0x7f1fe00cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fde59c640 1 -- 172.21.15.177:0/3180752536 >> v1:172.21.15.177:6789/0 conn(0x7f1fe00b2ae0 legacy=0x7f1fe015d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.446+0000 7f1fde59c640 1 -- 172.21.15.177:0/3180752536 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe00d1040 con 0x7f1fe015d7d0 2023-11-28T20:08:54.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.450+0000 7f1fde59c640 1 --2- 172.21.15.177:0/3180752536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fe015d7d0 0x7f1fe00d3a40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40097c0 tx=0x7f1fd401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adc2954d4ca89054 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:54.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.450+0000 7f1fddd9b640 1 -- 172.21.15.177:0/3180752536 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40ab650 con 0x7f1fe015d7d0 2023-11-28T20:08:54.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.450+0000 7f1fddd9b640 1 -- 172.21.15.177:0/3180752536 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd40ab7b0 con 0x7f1fe015d7d0 2023-11-28T20:08:54.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.450+0000 7f1fddd9b640 1 -- 172.21.15.177:0/3180752536 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40abb40 con 0x7f1fe015d7d0 2023-11-28T20:08:54.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.450+0000 7f1fe48dc640 1 -- 172.21.15.177:0/3180752536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fe015d7d0 msgr2=0x7f1fe00d3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.450+0000 7f1fe48dc640 1 --2- 172.21.15.177:0/3180752536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fe015d7d0 0x7f1fe00d3a40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40097c0 tx=0x7f1fd401c450 comp rx=0 tx=0).stop 2023-11-28T20:08:54.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.450+0000 7f1fe48dc640 1 -- 172.21.15.177:0/3180752536 shutdown_connections 2023-11-28T20:08:54.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.450+0000 7f1fe48dc640 1 --2- 172.21.15.177:0/3180752536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fe015d7d0 0x7f1fe00d3a40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.450+0000 7f1fe48dc640 1 -- 172.21.15.177:0/3180752536 >> 172.21.15.177:0/3180752536 conn(0x7f1fe00d2f20 msgr2=0x7f1fe00d3330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:54.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.450+0000 7f1fe48dc640 1 -- 172.21.15.177:0/3180752536 shutdown_connections 2023-11-28T20:08:54.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.450+0000 7f1fe48dc640 1 -- 172.21.15.177:0/3180752536 wait complete. 2023-11-28T20:08:54.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fe48dc640 1 Processor -- start 2023-11-28T20:08:54.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fe48dc640 1 -- start start 2023-11-28T20:08:54.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fe48dc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1fe00b2ae0 0x7f1fe0153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:54.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fe48dc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fe00b2ec0 0x7f1fe0152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:54.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fe48dc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fe015d7d0 0x7f1fe013a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:54.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fe48dc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe0153910 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fe48dc640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe0160a70 con 0x7f1fe015d7d0 2023-11-28T20:08:54.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fe48dc640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe0160790 con 0x7f1fe00b2ae0 2023-11-28T20:08:54.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fde59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fe00b2ec0 0x7f1fe0152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:54.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fde59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fe00b2ec0 0x7f1fe0152a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55966/0 (socket says 172.21.15.177:55966) 2023-11-28T20:08:54.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fded9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1fe00b2ae0 0x7f1fe0153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:54.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fde59c640 1 -- 172.21.15.177:0/3644846406 learned_addr learned my addr 172.21.15.177:0/3644846406 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:54.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fdf59e640 1 --2- 172.21.15.177:0/3644846406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fe015d7d0 0x7f1fe013a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:54.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fde59c640 1 -- 172.21.15.177:0/3644846406 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1fe00b2ae0 msgr2=0x7f1fe0153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fde59c640 1 --2- 172.21.15.177:0/3644846406 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1fe00b2ae0 0x7f1fe0153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fde59c640 1 -- 172.21.15.177:0/3644846406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fe015d7d0 msgr2=0x7f1fe013a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fde59c640 1 --2- 172.21.15.177:0/3644846406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fe015d7d0 0x7f1fe013a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fde59c640 1 -- 172.21.15.177:0/3644846406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd4009420 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fdf59e640 1 --2- 172.21.15.177:0/3644846406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fe015d7d0 0x7f1fe013a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:54.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fde59c640 1 --2- 172.21.15.177:0/3644846406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fe00b2ec0 0x7f1fe0152a70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1fd401a080 tx=0x7f1fd40191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:54.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fc77fe640 1 -- 172.21.15.177:0/3644846406 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40abdf0 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fc77fe640 1 -- 172.21.15.177:0/3644846406 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd40bf450 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fc77fe640 1 -- 172.21.15.177:0/3644846406 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40bf800 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fe48dc640 1 -- 172.21.15.177:0/3644846406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe01532c0 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.454+0000 7f1fe48dc640 1 -- 172.21.15.177:0/3644846406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe0152fb0 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.458+0000 7f1fe48dc640 1 -- 172.21.15.177:0/3644846406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe00a0e70 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.458+0000 7f1fc77fe640 1 -- 172.21.15.177:0/3644846406 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1fd40b43f0 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.458+0000 7f1fc77fe640 1 --2- 172.21.15.177:0/3644846406 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1fcc0664a0 0x7f1fcc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:54.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.458+0000 7f1fc77fe640 1 -- 172.21.15.177:0/3644846406 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f1fd411ea20 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.458+0000 7f1fded9d640 1 --2- 172.21.15.177:0/3644846406 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1fcc0664a0 0x7f1fcc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:54.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.458+0000 7f1fded9d640 1 --2- 172.21.15.177:0/3644846406 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1fcc0664a0 0x7f1fcc068960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0007fd0 tx=0x7f1fd0007d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:54.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.462+0000 7f1fc77fe640 1 -- 172.21.15.177:0/3644846406 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1fd40ebdc0 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.642+0000 7f1fe48dc640 1 -- 172.21.15.177:0/3644846406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1fe00b2590 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.642+0000 7f1fc77fe640 1 -- 172.21.15.177:0/3644846406 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4924 (secure 0 0 0) 0x7f1fd40c4020 con 0x7f1fe00b2ec0 2023-11-28T20:08:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:54.646 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2829857708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2829857708},{"type":"v1","addr":"172.21.15.177:6836","nonce":2829857708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5101,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/916709103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":916709103},{"type":"v1","addr":"172.21.15.195:6834","nonce":916709103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1987123637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1987123637},{"type":"v1","addr":"172.21.15.195:6835","nonce":1987123637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:08:39.405256+0000","modified":"2023-11-28T20:08:53.633079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/3143070912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":3143070912},{"type":"v1","addr":"172.21.15.177:6837","nonce":3143070912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T20:08:54.646 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 18 2023-11-28T20:08:54.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.646+0000 7f1fe48dc640 1 -- 172.21.15.177:0/3644846406 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1fcc0664a0 msgr2=0x7f1fcc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.646+0000 7f1fe48dc640 1 --2- 172.21.15.177:0/3644846406 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1fcc0664a0 0x7f1fcc068960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0007fd0 tx=0x7f1fd0007d80 comp rx=0 tx=0).stop 2023-11-28T20:08:54.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.646+0000 7f1fe48dc640 1 -- 172.21.15.177:0/3644846406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fe00b2ec0 msgr2=0x7f1fe0152a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.646+0000 7f1fe48dc640 1 --2- 172.21.15.177:0/3644846406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fe00b2ec0 0x7f1fe0152a70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1fd401a080 tx=0x7f1fd40191f0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.646+0000 7f1fe48dc640 1 -- 172.21.15.177:0/3644846406 shutdown_connections 2023-11-28T20:08:54.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.646+0000 7f1fe48dc640 1 --2- 172.21.15.177:0/3644846406 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1fcc0664a0 0x7f1fcc068960 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.646+0000 7f1fe48dc640 1 --2- 172.21.15.177:0/3644846406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fe015d7d0 0x7f1fe013a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.646+0000 7f1fe48dc640 1 --2- 172.21.15.177:0/3644846406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fe00b2ec0 0x7f1fe0152a70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.646+0000 7f1fe48dc640 1 --2- 172.21.15.177:0/3644846406 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1fe00b2ae0 0x7f1fe0153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.646+0000 7f1fe48dc640 1 -- 172.21.15.177:0/3644846406 >> 172.21.15.177:0/3644846406 conn(0x7f1fe00d2f20 msgr2=0x7f1fe015c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:54.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.646+0000 7f1fe48dc640 1 -- 172.21.15.177:0/3644846406 shutdown_connections 2023-11-28T20:08:54.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.646+0000 7f1fe48dc640 1 -- 172.21.15.177:0/3644846406 wait complete. 2023-11-28T20:08:54.667 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:54.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.802+0000 7fdf46701640 1 Processor -- start 2023-11-28T20:08:54.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.802+0000 7fdf46701640 1 -- start start 2023-11-28T20:08:54.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.806+0000 7fdf46701640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdf4013cf30 0x7fdf4006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:54.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.806+0000 7fdf46701640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4015b170 con 0x7fdf4006c800 2023-11-28T20:08:54.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.806+0000 7fdf46701640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4015b3a0 con 0x7fdf4015ad40 2023-11-28T20:08:54.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.806+0000 7fdf46701640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf4013d310 con 0x7fdf4013cf30 2023-11-28T20:08:54.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.806+0000 7fdf3f7fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fdf4006c800 0x7fdf4015a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:59594/0 (socket says 172.21.15.177:59594) 2023-11-28T20:08:54.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.806+0000 7fdf3f7fe640 1 -- 172.21.15.177:0/3451363253 learned_addr learned my addr 172.21.15.177:0/3451363253 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:54.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.806+0000 7fdf3ffff640 1 --2- 172.21.15.177:0/3451363253 >> v2:172.21.15.195:3300/0 conn(0x7fdf4013cf30 0x7fdf4006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:54.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.806+0000 7fdf3effd640 1 -- 172.21.15.177:0/3451363253 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581200576 0 0) 0x7fdf4015b170 con 0x7fdf4006c800 2023-11-28T20:08:54.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.806+0000 7fdf3effd640 1 -- 172.21.15.177:0/3451363253 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf28003530 con 0x7fdf4006c800 2023-11-28T20:08:54.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.806+0000 7fdf3effd640 1 -- 172.21.15.177:0/3451363253 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756646586 0 0) 0x7fdf4015b3a0 con 0x7fdf4015ad40 2023-11-28T20:08:54.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.806+0000 7fdf3effd640 1 -- 172.21.15.177:0/3451363253 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf4015b170 con 0x7fdf4015ad40 2023-11-28T20:08:54.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.806+0000 7fdf3ffff640 1 -- 172.21.15.177:0/3451363253 >> v1:172.21.15.195:6789/0 conn(0x7fdf4015ad40 legacy=0x7fdf400cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.806+0000 7fdf3ffff640 1 -- 172.21.15.177:0/3451363253 >> v1:172.21.15.177:6789/0 conn(0x7fdf4006c800 legacy=0x7fdf4015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.806+0000 7fdf3ffff640 1 -- 172.21.15.177:0/3451363253 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4013f720 con 0x7fdf4013cf30 2023-11-28T20:08:54.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf3ffff640 1 --2- 172.21.15.177:0/3451363253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4013cf30 0x7fdf4006c2c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdf300097c0 tx=0x7fdf3001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaea10d32e47927f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:54.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf3effd640 1 -- 172.21.15.177:0/3451363253 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf300ab600 con 0x7fdf4013cf30 2023-11-28T20:08:54.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf3effd640 1 -- 172.21.15.177:0/3451363253 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf300a7050 con 0x7fdf4013cf30 2023-11-28T20:08:54.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf3effd640 1 -- 172.21.15.177:0/3451363253 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf300ab980 con 0x7fdf4013cf30 2023-11-28T20:08:54.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf46701640 1 -- 172.21.15.177:0/3451363253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4013cf30 msgr2=0x7fdf4006c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf46701640 1 --2- 172.21.15.177:0/3451363253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4013cf30 0x7fdf4006c2c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdf300097c0 tx=0x7fdf3001c3f0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf46701640 1 -- 172.21.15.177:0/3451363253 shutdown_connections 2023-11-28T20:08:54.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf46701640 1 --2- 172.21.15.177:0/3451363253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4013cf30 0x7fdf4006c2c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf46701640 1 -- 172.21.15.177:0/3451363253 >> 172.21.15.177:0/3451363253 conn(0x7fdf4006a530 msgr2=0x7fdf4006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:54.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf46701640 1 -- 172.21.15.177:0/3451363253 shutdown_connections 2023-11-28T20:08:54.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf46701640 1 -- 172.21.15.177:0/3451363253 wait complete. 2023-11-28T20:08:54.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf46701640 1 Processor -- start 2023-11-28T20:08:54.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf46701640 1 -- start start 2023-11-28T20:08:54.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf46701640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf4006c800 0x7fdf40136310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:54.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf46701640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf4013cf30 0x7fdf4013dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:54.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf46701640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4015ad40 0x7fdf4013afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:54.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf46701640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf40136850 con 0x7fdf4013cf30 2023-11-28T20:08:54.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf46701640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4013a3a0 con 0x7fdf4015ad40 2023-11-28T20:08:54.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.810+0000 7fdf46701640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4013a680 con 0x7fdf4006c800 2023-11-28T20:08:54.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf3f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf4013cf30 0x7fdf4013dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:54.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf3f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf4013cf30 0x7fdf4013dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55970/0 (socket says 172.21.15.177:55970) 2023-11-28T20:08:54.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf3f7fe640 1 -- 172.21.15.177:0/2324461780 learned_addr learned my addr 172.21.15.177:0/2324461780 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:54.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf3ffff640 1 --2- 172.21.15.177:0/2324461780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf4006c800 0x7fdf40136310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:54.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf44c9e640 1 --2- 172.21.15.177:0/2324461780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4015ad40 0x7fdf4013afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:54.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf3f7fe640 1 -- 172.21.15.177:0/2324461780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf4006c800 msgr2=0x7fdf40136310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf3f7fe640 1 --2- 172.21.15.177:0/2324461780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf4006c800 0x7fdf40136310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf3f7fe640 1 -- 172.21.15.177:0/2324461780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4015ad40 msgr2=0x7fdf4013afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf3f7fe640 1 --2- 172.21.15.177:0/2324461780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4015ad40 0x7fdf4013afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf3f7fe640 1 -- 172.21.15.177:0/2324461780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf30009420 con 0x7fdf4013cf30 2023-11-28T20:08:54.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf3f7fe640 1 --2- 172.21.15.177:0/2324461780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf4013cf30 0x7fdf4013dd50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400c420 tx=0x7fdf3400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:54.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf3cff9640 1 -- 172.21.15.177:0/2324461780 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34005cf0 con 0x7fdf4013cf30 2023-11-28T20:08:54.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf3cff9640 1 -- 172.21.15.177:0/2324461780 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf34005e50 con 0x7fdf4013cf30 2023-11-28T20:08:54.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf3cff9640 1 -- 172.21.15.177:0/2324461780 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf340072f0 con 0x7fdf4013cf30 2023-11-28T20:08:54.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf46701640 1 -- 172.21.15.177:0/2324461780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4013a960 con 0x7fdf4013cf30 2023-11-28T20:08:54.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf46701640 1 -- 172.21.15.177:0/2324461780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf40139fe0 con 0x7fdf4013cf30 2023-11-28T20:08:54.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf46701640 1 -- 172.21.15.177:0/2324461780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf40069440 con 0x7fdf4013cf30 2023-11-28T20:08:54.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.814+0000 7fdf3cff9640 1 -- 172.21.15.177:0/2324461780 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdf34007450 con 0x7fdf4013cf30 2023-11-28T20:08:54.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.818+0000 7fdf3cff9640 1 --2- 172.21.15.177:0/2324461780 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdf2c0664a0 0x7fdf2c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:54.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.818+0000 7fdf3cff9640 1 -- 172.21.15.177:0/2324461780 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fdf34083510 con 0x7fdf4013cf30 2023-11-28T20:08:54.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.818+0000 7fdf3ffff640 1 --2- 172.21.15.177:0/2324461780 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdf2c0664a0 0x7fdf2c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:54.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.818+0000 7fdf3ffff640 1 --2- 172.21.15.177:0/2324461780 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdf2c0664a0 0x7fdf2c068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdf300ad000 tx=0x7fdf30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:54.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.822+0000 7fdf3cff9640 1 -- 172.21.15.177:0/2324461780 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdf340508b0 con 0x7fdf4013cf30 2023-11-28T20:08:54.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.970+0000 7fdf46701640 1 -- 172.21.15.177:0/2324461780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf4006d1e0 con 0x7fdf4013cf30 2023-11-28T20:08:54.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.974+0000 7fdf3cff9640 1 -- 172.21.15.177:0/2324461780 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18421 (secure 0 0 0) 0x7fdf34053ed0 con 0x7fdf4013cf30 2023-11-28T20:08:54.975 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:54.976 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":35,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:53.632846+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:08:37.943771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T20:08:38.396895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2023-11-28T20:08:52.500186+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:54.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.974+0000 7fdf46701640 1 -- 172.21.15.177:0/2324461780 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdf2c0664a0 msgr2=0x7fdf2c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.974+0000 7fdf46701640 1 --2- 172.21.15.177:0/2324461780 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdf2c0664a0 0x7fdf2c068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdf300ad000 tx=0x7fdf30008040 comp rx=0 tx=0).stop 2023-11-28T20:08:54.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.974+0000 7fdf46701640 1 -- 172.21.15.177:0/2324461780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf4013cf30 msgr2=0x7fdf4013dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:54.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.974+0000 7fdf46701640 1 --2- 172.21.15.177:0/2324461780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf4013cf30 0x7fdf4013dd50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400c420 tx=0x7fdf3400c8e0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.974+0000 7fdf46701640 1 -- 172.21.15.177:0/2324461780 shutdown_connections 2023-11-28T20:08:54.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.974+0000 7fdf46701640 1 --2- 172.21.15.177:0/2324461780 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdf2c0664a0 0x7fdf2c068960 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.974+0000 7fdf46701640 1 --2- 172.21.15.177:0/2324461780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4015ad40 0x7fdf4013afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.974+0000 7fdf46701640 1 --2- 172.21.15.177:0/2324461780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf4013cf30 0x7fdf4013dd50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.974+0000 7fdf46701640 1 --2- 172.21.15.177:0/2324461780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf4006c800 0x7fdf40136310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:54.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.974+0000 7fdf46701640 1 -- 172.21.15.177:0/2324461780 >> 172.21.15.177:0/2324461780 conn(0x7fdf4006a530 msgr2=0x7fdf4015b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:54.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.974+0000 7fdf46701640 1 -- 172.21.15.177:0/2324461780 shutdown_connections 2023-11-28T20:08:54.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:54.974+0000 7fdf46701640 1 -- 172.21.15.177:0/2324461780 wait complete. 2023-11-28T20:08:54.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:54.997 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2023-11-28T20:08:55.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:55.013 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2023-11-28T20:08:55.067 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2023-11-28T20:08:55.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.250+0000 7f9051980640 1 Processor -- start 2023-11-28T20:08:55.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.254+0000 7f9051980640 1 -- start start 2023-11-28T20:08:55.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.254+0000 7f9051980640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f904c0d02c0 0x7f904c1680d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:55.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.254+0000 7f9051980640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c06ced0 con 0x7f904c160910 2023-11-28T20:08:55.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.254+0000 7f9051980640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c160cf0 con 0x7f904c070dc0 2023-11-28T20:08:55.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.254+0000 7f9051980640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904c0cf290 con 0x7f904c0d02c0 2023-11-28T20:08:55.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.254+0000 7f904b7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f904c0d02c0 0x7f904c1680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:55.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.254+0000 7f904b7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f904c0d02c0 0x7f904c1680d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55980/0 (socket says 172.21.15.177:55980) 2023-11-28T20:08:55.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.254+0000 7f904b7fe640 1 -- 172.21.15.177:0/3252221956 learned_addr learned my addr 172.21.15.177:0/3252221956 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:55.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.254+0000 7f904affd640 1 --1- 172.21.15.177:0/3252221956 >> v1:172.21.15.177:6789/0 conn(0x7f904c160910 0x7f904c0706b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:59602/0 (socket says 172.21.15.177:59602) 2023-11-28T20:08:55.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.254+0000 7f904b7fe640 1 -- 172.21.15.177:0/3252221956 >> v1:172.21.15.195:6789/0 conn(0x7f904c070dc0 legacy=0x7f904c0cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:55.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.254+0000 7f904b7fe640 1 -- 172.21.15.177:0/3252221956 >> v1:172.21.15.177:6789/0 conn(0x7f904c160910 legacy=0x7f904c0706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:55.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.254+0000 7f904b7fe640 1 -- 172.21.15.177:0/3252221956 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c0d07c0 con 0x7f904c0d02c0 2023-11-28T20:08:55.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.254+0000 7f904a7fc640 1 -- 172.21.15.177:0/3252221956 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725504513 0 0) 0x7f904c06ced0 con 0x7f904c160910 2023-11-28T20:08:55.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.258+0000 7f904b7fe640 1 --2- 172.21.15.177:0/3252221956 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c0d02c0 0x7f904c1680d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9044009e50 tx=0x7f904401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e68ae18db9580d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:55.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.258+0000 7f904a7fc640 1 -- 172.21.15.177:0/3252221956 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90440a5640 con 0x7f904c0d02c0 2023-11-28T20:08:55.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.258+0000 7f904a7fc640 1 -- 172.21.15.177:0/3252221956 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90440a57a0 con 0x7f904c0d02c0 2023-11-28T20:08:55.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.258+0000 7f904a7fc640 1 -- 172.21.15.177:0/3252221956 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90440a5b30 con 0x7f904c0d02c0 2023-11-28T20:08:55.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.258+0000 7f9051980640 1 -- 172.21.15.177:0/3252221956 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c0d02c0 msgr2=0x7f904c1680d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:55.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.258+0000 7f9051980640 1 --2- 172.21.15.177:0/3252221956 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c0d02c0 0x7f904c1680d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9044009e50 tx=0x7f904401c980 comp rx=0 tx=0).stop 2023-11-28T20:08:55.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.258+0000 7f9051980640 1 -- 172.21.15.177:0/3252221956 shutdown_connections 2023-11-28T20:08:55.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.258+0000 7f9051980640 1 --2- 172.21.15.177:0/3252221956 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c0d02c0 0x7f904c1680d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:55.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.258+0000 7f9051980640 1 -- 172.21.15.177:0/3252221956 >> 172.21.15.177:0/3252221956 conn(0x7f904c06e8c0 msgr2=0x7f904c06ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:55.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.258+0000 7f9051980640 1 -- 172.21.15.177:0/3252221956 shutdown_connections 2023-11-28T20:08:55.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.258+0000 7f9051980640 1 -- 172.21.15.177:0/3252221956 wait complete. 2023-11-28T20:08:55.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.258+0000 7f9051980640 1 Processor -- start 2023-11-28T20:08:55.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.258+0000 7f9051980640 1 -- start start 2023-11-28T20:08:55.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f9051980640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c070dc0 0x7f904c14e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:55.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f9051980640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f904c0d02c0 0x7f904c0cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:55.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f9051980640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f904c160910 0x7f904c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:55.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f9051980640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0cd740 con 0x7f904c070dc0 2023-11-28T20:08:55.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f9051980640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c151cd0 con 0x7f904c0d02c0 2023-11-28T20:08:55.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f9051980640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0cd080 con 0x7f904c160910 2023-11-28T20:08:55.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f904affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c070dc0 0x7f904c14e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:55.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f904affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c070dc0 0x7f904c14e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55982/0 (socket says 172.21.15.177:55982) 2023-11-28T20:08:55.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f904affd640 1 -- 172.21.15.177:0/3623198896 learned_addr learned my addr 172.21.15.177:0/3623198896 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:55.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f904b7fe640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f904c160910 0x7f904c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:55.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f904affd640 1 -- 172.21.15.177:0/3623198896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f904c160910 msgr2=0x7f904c0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:55.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f9043fff640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f904c0d02c0 0x7f904c0cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:55.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f904affd640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f904c160910 0x7f904c0cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:55.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f904affd640 1 -- 172.21.15.177:0/3623198896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f904c0d02c0 msgr2=0x7f904c0cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:55.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f904affd640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f904c0d02c0 0x7f904c0cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:55.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f904affd640 1 -- 172.21.15.177:0/3623198896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9044009b30 con 0x7f904c070dc0 2023-11-28T20:08:55.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f904b7fe640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f904c160910 0x7f904c0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:55.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f9043fff640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f904c0d02c0 0x7f904c0cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:08:55.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f904affd640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c070dc0 0x7f904c14e450 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f903c00c410 tx=0x7f903c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:55.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f9048ff9640 1 -- 172.21.15.177:0/3623198896 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c0074e0 con 0x7f904c070dc0 2023-11-28T20:08:55.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f9048ff9640 1 -- 172.21.15.177:0/3623198896 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c007640 con 0x7f904c070dc0 2023-11-28T20:08:55.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f9048ff9640 1 -- 172.21.15.177:0/3623198896 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c004a30 con 0x7f904c070dc0 2023-11-28T20:08:55.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f9051980640 1 -- 172.21.15.177:0/3623198896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904c0cd360 con 0x7f904c070dc0 2023-11-28T20:08:55.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f9051980640 1 -- 172.21.15.177:0/3623198896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904c0cce00 con 0x7f904c070dc0 2023-11-28T20:08:55.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.262+0000 7f9051980640 1 -- 172.21.15.177:0/3623198896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904c069440 con 0x7f904c070dc0 2023-11-28T20:08:55.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.266+0000 7f9048ff9640 1 -- 172.21.15.177:0/3623198896 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f903c004b90 con 0x7f904c070dc0 2023-11-28T20:08:55.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.266+0000 7f9048ff9640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f902c066470 0x7f902c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:55.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.266+0000 7f9048ff9640 1 -- 172.21.15.177:0/3623198896 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f903c084300 con 0x7f904c070dc0 2023-11-28T20:08:55.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.266+0000 7f9043fff640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f902c066470 0x7f902c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:55.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.266+0000 7f9043fff640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f902c066470 0x7f902c068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f904c152ea0 tx=0x7f9034009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:55.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.266+0000 7f9048ff9640 1 -- 172.21.15.177:0/3623198896 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f903c051760 con 0x7f904c070dc0 2023-11-28T20:08:55.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.470+0000 7f9051980640 1 -- 172.21.15.177:0/3623198896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f904c0b3610 con 0x7f904c070dc0 2023-11-28T20:08:55.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.474+0000 7f9048ff9640 1 -- 172.21.15.177:0/3623198896 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v16) v1 ==== 210+0+167 (secure 0 0 0) 0x7f903c054d80 con 0x7f904c070dc0 2023-11-28T20:08:55.822 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-11-28T20:08:55.822 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZl+2t5KxAAc/J7x+fjSQR4IkIQJ/X8sw== 2023-11-28T20:08:55.822 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow rw" 2023-11-28T20:08:55.823 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-11-28T20:08:55.823 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2023-11-28T20:08:55.825 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-11-28T20:08:55.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.478+0000 7f9051980640 1 -- 172.21.15.177:0/3623198896 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f902c066470 msgr2=0x7f902c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:55.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.478+0000 7f9051980640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f902c066470 0x7f902c068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f904c152ea0 tx=0x7f9034009040 comp rx=0 tx=0).stop 2023-11-28T20:08:55.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.478+0000 7f9051980640 1 -- 172.21.15.177:0/3623198896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c070dc0 msgr2=0x7f904c14e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:55.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.478+0000 7f9051980640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c070dc0 0x7f904c14e450 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f903c00c410 tx=0x7f903c00c8d0 comp rx=0 tx=0).stop 2023-11-28T20:08:55.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.478+0000 7f9051980640 1 -- 172.21.15.177:0/3623198896 shutdown_connections 2023-11-28T20:08:55.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.478+0000 7f9051980640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f902c066470 0x7f902c068930 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:55.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.478+0000 7f9051980640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f904c160910 0x7f904c0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:55.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.478+0000 7f9051980640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f904c0d02c0 0x7f904c0cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:55.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.478+0000 7f9051980640 1 --2- 172.21.15.177:0/3623198896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904c070dc0 0x7f904c14e450 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:55.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.478+0000 7f9051980640 1 -- 172.21.15.177:0/3623198896 >> 172.21.15.177:0/3623198896 conn(0x7f904c06e8c0 msgr2=0x7f904c0d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:55.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.478+0000 7f9051980640 1 -- 172.21.15.177:0/3623198896 shutdown_connections 2023-11-28T20:08:55.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:55.478+0000 7f9051980640 1 -- 172.21.15.177:0/3623198896 wait complete. 2023-11-28T20:08:55.828 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:08:55.828 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:08:55.840 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:56.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d4e5d1640 1 Processor -- start 2023-11-28T20:08:56.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d4e5d1640 1 -- start start 2023-11-28T20:08:56.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d4e5d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d48144840 0x7f0d4806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d4e5d1640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d480710e0 con 0x7f0d48070b70 2023-11-28T20:08:56.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d4e5d1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d480713c0 con 0x7f0d48072180 2023-11-28T20:08:56.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d4e5d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4815f010 con 0x7f0d48144840 2023-11-28T20:08:56.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d4cb6e640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f0d48070b70 0x7f0d4815b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:59616/0 (socket says 172.21.15.177:59616) 2023-11-28T20:08:56.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d4cb6e640 1 -- 172.21.15.177:0/1114053720 learned_addr learned my addr 172.21.15.177:0/1114053720 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:56.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d47fff640 1 --2- 172.21.15.177:0/1114053720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d48144840 0x7f0d4806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486281600 0 0) 0x7f0d480710e0 con 0x7f0d48070b70 2023-11-28T20:08:56.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d30003530 con 0x7f0d48070b70 2023-11-28T20:08:56.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600413324 0 0) 0x7f0d480713c0 con 0x7f0d48072180 2023-11-28T20:08:56.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d480710e0 con 0x7f0d48072180 2023-11-28T20:08:56.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1587835765 0 0) 0x7f0d30003530 con 0x7f0d48070b70 2023-11-28T20:08:56.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d48144840 msgr2=0x7f0d4806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:56.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 --2- 172.21.15.177:0/1114053720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d48144840 0x7f0d4806c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 >> v1:172.21.15.195:6789/0 conn(0x7f0d48072180 legacy=0x7f0d48070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d480716a0 con 0x7f0d48070b70 2023-11-28T20:08:56.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f0d40001a00 con 0x7f0d48070b70 2023-11-28T20:08:56.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 >> v1:172.21.15.177:6789/0 conn(0x7f0d48070b70 legacy=0x7f0d4815b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 --2- 172.21.15.177:0/1114053720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d30003b40 0x7f0d30003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 --2- 172.21.15.177:0/1114053720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d48144840 0x7f0d300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 --2- 172.21.15.177:0/1114053720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d30004d10 0x7f0d30005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3000ba40 con 0x7f0d30003b40 2023-11-28T20:08:56.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3000bb80 con 0x7f0d30004d10 2023-11-28T20:08:56.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3000bcf0 con 0x7f0d48144840 2023-11-28T20:08:56.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d47fff640 1 --2- 172.21.15.177:0/1114053720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d30003b40 0x7f0d30003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d477fe640 1 --2- 172.21.15.177:0/1114053720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d48144840 0x7f0d300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.026+0000 7f0d4cb6e640 1 --2- 172.21.15.177:0/1114053720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d30004d10 0x7f0d30005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.030+0000 7f0d47fff640 1 -- 172.21.15.177:0/1114053720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d48144840 msgr2=0x7f0d300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:56.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.030+0000 7f0d47fff640 1 --2- 172.21.15.177:0/1114053720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d48144840 0x7f0d300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.030+0000 7f0d47fff640 1 -- 172.21.15.177:0/1114053720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d30004d10 msgr2=0x7f0d30005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:56.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.030+0000 7f0d47fff640 1 --2- 172.21.15.177:0/1114053720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d30004d10 0x7f0d30005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.030+0000 7f0d47fff640 1 -- 172.21.15.177:0/1114053720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d30003530 con 0x7f0d30003b40 2023-11-28T20:08:56.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.030+0000 7f0d47fff640 1 --2- 172.21.15.177:0/1114053720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d30003b40 0x7f0d30003f40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009ae0 tx=0x7f0d3801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233be10353743b4e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:56.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.030+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d380a55f0 con 0x7f0d30003b40 2023-11-28T20:08:56.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.030+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d380a5750 con 0x7f0d30003b40 2023-11-28T20:08:56.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.030+0000 7f0d46ffd640 1 -- 172.21.15.177:0/1114053720 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d380a5b00 con 0x7f0d30003b40 2023-11-28T20:08:56.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.030+0000 7f0d4e5d1640 1 -- 172.21.15.177:0/1114053720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d30003b40 msgr2=0x7f0d30003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.030+0000 7f0d4e5d1640 1 --2- 172.21.15.177:0/1114053720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d30003b40 0x7f0d30003f40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009ae0 tx=0x7f0d3801ca20 comp rx=0 tx=0).stop 2023-11-28T20:08:56.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.030+0000 7f0d4cb6e640 1 -- 172.21.15.177:0/1114053720 reap_dead start 2023-11-28T20:08:56.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.030+0000 7f0d4e5d1640 1 -- 172.21.15.177:0/1114053720 shutdown_connections 2023-11-28T20:08:56.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.030+0000 7f0d4e5d1640 1 -- 172.21.15.177:0/1114053720 >> 172.21.15.177:0/1114053720 conn(0x7f0d4806a530 msgr2=0x7f0d4806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:56.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4e5d1640 1 -- 172.21.15.177:0/1114053720 shutdown_connections 2023-11-28T20:08:56.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4e5d1640 1 -- 172.21.15.177:0/1114053720 wait complete. 2023-11-28T20:08:56.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4e5d1640 1 Processor -- start 2023-11-28T20:08:56.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4e5d1640 1 -- start start 2023-11-28T20:08:56.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4e5d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d30003b40 0x7f0d480cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4e5d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d48134700 0x7f0d48134b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4e5d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d481f91e0 0x7f0d481f9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4e5d1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d48140310 con 0x7f0d481f91e0 2023-11-28T20:08:56.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4e5d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4813d2b0 con 0x7f0d48134700 2023-11-28T20:08:56.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4e5d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d481350c0 con 0x7f0d30003b40 2023-11-28T20:08:56.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4cb6e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d481f91e0 0x7f0d481f9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4cb6e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d481f91e0 0x7f0d481f9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56000/0 (socket says 172.21.15.177:56000) 2023-11-28T20:08:56.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4cb6e640 1 -- 172.21.15.177:0/289585125 learned_addr learned my addr 172.21.15.177:0/289585125 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:56.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d47fff640 1 --2- 172.21.15.177:0/289585125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d30003b40 0x7f0d480cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d477fe640 1 --2- 172.21.15.177:0/289585125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d48134700 0x7f0d48134b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4cb6e640 1 -- 172.21.15.177:0/289585125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d30003b40 msgr2=0x7f0d480cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4cb6e640 1 --2- 172.21.15.177:0/289585125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d30003b40 0x7f0d480cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4cb6e640 1 -- 172.21.15.177:0/289585125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d48134700 msgr2=0x7f0d48134b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4cb6e640 1 --2- 172.21.15.177:0/289585125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d48134700 0x7f0d48134b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4cb6e640 1 -- 172.21.15.177:0/289585125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d48132290 con 0x7f0d481f91e0 2023-11-28T20:08:56.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.034+0000 7f0d4cb6e640 1 --2- 172.21.15.177:0/289585125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d481f91e0 0x7f0d481f9690 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0d480b0c50 tx=0x7f0d4000a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:56.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.038+0000 7f0d44ff9640 1 -- 172.21.15.177:0/289585125 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40007970 con 0x7f0d481f91e0 2023-11-28T20:08:56.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.038+0000 7f0d44ff9640 1 -- 172.21.15.177:0/289585125 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d40007af0 con 0x7f0d481f91e0 2023-11-28T20:08:56.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.038+0000 7f0d4e5d1640 1 -- 172.21.15.177:0/289585125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4813d500 con 0x7f0d481f91e0 2023-11-28T20:08:56.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.038+0000 7f0d44ff9640 1 -- 172.21.15.177:0/289585125 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40013610 con 0x7f0d481f91e0 2023-11-28T20:08:56.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.038+0000 7f0d4e5d1640 1 -- 172.21.15.177:0/289585125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4813dac0 con 0x7f0d481f91e0 2023-11-28T20:08:56.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.038+0000 7f0d4e5d1640 1 -- 172.21.15.177:0/289585125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d48069440 con 0x7f0d481f91e0 2023-11-28T20:08:56.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.038+0000 7f0d44ff9640 1 -- 172.21.15.177:0/289585125 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0d40013770 con 0x7f0d481f91e0 2023-11-28T20:08:56.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.038+0000 7f0d44ff9640 1 --2- 172.21.15.177:0/289585125 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d340664a0 0x7f0d34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.038+0000 7f0d44ff9640 1 -- 172.21.15.177:0/289585125 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f0d40084610 con 0x7f0d481f91e0 2023-11-28T20:08:56.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.038+0000 7f0d47fff640 1 --2- 172.21.15.177:0/289585125 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d340664a0 0x7f0d34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.042+0000 7f0d47fff640 1 --2- 172.21.15.177:0/289585125 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d340664a0 0x7f0d34068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d380af000 tx=0x7f0d380046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:56.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.042+0000 7f0d44ff9640 1 -- 172.21.15.177:0/289585125 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0d40051900 con 0x7f0d481f91e0 2023-11-28T20:08:56.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.198+0000 7f0d4e5d1640 1 -- 172.21.15.177:0/289585125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d4815cae0 con 0x7f0d481f91e0 2023-11-28T20:08:56.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.198+0000 7f0d44ff9640 1 -- 172.21.15.177:0/289585125 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18408 (secure 0 0 0) 0x7f0d40054f20 con 0x7f0d481f91e0 2023-11-28T20:08:56.201 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:56.201 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":36,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:55.264752+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:08:37.943771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T20:08:38.396895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2023-11-28T20:08:52.500186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:56.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.202+0000 7f0d4e5d1640 1 -- 172.21.15.177:0/289585125 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d340664a0 msgr2=0x7f0d34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.202+0000 7f0d4e5d1640 1 --2- 172.21.15.177:0/289585125 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d340664a0 0x7f0d34068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d380af000 tx=0x7f0d380046d0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.202+0000 7f0d4e5d1640 1 -- 172.21.15.177:0/289585125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d481f91e0 msgr2=0x7f0d481f9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.202+0000 7f0d4e5d1640 1 --2- 172.21.15.177:0/289585125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d481f91e0 0x7f0d481f9690 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0d480b0c50 tx=0x7f0d4000a6a0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.202+0000 7f0d4e5d1640 1 -- 172.21.15.177:0/289585125 shutdown_connections 2023-11-28T20:08:56.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.202+0000 7f0d4e5d1640 1 --2- 172.21.15.177:0/289585125 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d340664a0 0x7f0d34068960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.202+0000 7f0d4e5d1640 1 --2- 172.21.15.177:0/289585125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d481f91e0 0x7f0d481f9690 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.202+0000 7f0d4e5d1640 1 --2- 172.21.15.177:0/289585125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d48134700 0x7f0d48134b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.202+0000 7f0d4e5d1640 1 --2- 172.21.15.177:0/289585125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d30003b40 0x7f0d480cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.202+0000 7f0d4e5d1640 1 -- 172.21.15.177:0/289585125 >> 172.21.15.177:0/289585125 conn(0x7f0d4806a530 msgr2=0x7f0d480cabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:56.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.202+0000 7f0d4e5d1640 1 -- 172.21.15.177:0/289585125 shutdown_connections 2023-11-28T20:08:56.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.202+0000 7f0d4e5d1640 1 -- 172.21.15.177:0/289585125 wait complete. 2023-11-28T20:08:56.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:08:37.943771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:08:38.396895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2023-11-28T20:08:52.500186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:56.223 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:56.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.366+0000 7fd496c09640 1 Processor -- start 2023-11-28T20:08:56.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.366+0000 7fd496c09640 1 -- start start 2023-11-28T20:08:56.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.370+0000 7fd496c09640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd490071d90 0x7fd490072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.370+0000 7fd496c09640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd49015adb0 0x7fd49013d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.370+0000 7fd496c09640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49013d2b0 con 0x7fd49013f5f0 2023-11-28T20:08:56.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.370+0000 7fd496c09640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd490140520 con 0x7fd490071d90 2023-11-28T20:08:56.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.370+0000 7fd496c09640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4900cd7f0 con 0x7fd49015adb0 2023-11-28T20:08:56.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.370+0000 7fd4949a5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd490071d90 0x7fd490072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.370+0000 7fd4949a5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd490071d90 0x7fd490072170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56010/0 (socket says 172.21.15.177:56010) 2023-11-28T20:08:56.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.370+0000 7fd4949a5640 1 -- 172.21.15.177:0/2766680987 learned_addr learned my addr 172.21.15.177:0/2766680987 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:56.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.370+0000 7fd487fff640 1 --2- 172.21.15.177:0/2766680987 >> v2:172.21.15.195:3300/0 conn(0x7fd49015adb0 0x7fd49013d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.370+0000 7fd4949a5640 1 -- 172.21.15.177:0/2766680987 >> v2:172.21.15.195:3300/0 conn(0x7fd49015adb0 msgr2=0x7fd49013d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:56.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.370+0000 7fd4949a5640 1 --2- 172.21.15.177:0/2766680987 >> v2:172.21.15.195:3300/0 conn(0x7fd49015adb0 0x7fd49013d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.370+0000 7fd4949a5640 1 -- 172.21.15.177:0/2766680987 >> v1:172.21.15.195:6789/0 conn(0x7fd49013f5f0 legacy=0x7fd4900ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.370+0000 7fd4949a5640 1 -- 172.21.15.177:0/2766680987 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4900cdd70 con 0x7fd490071d90 2023-11-28T20:08:56.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.374+0000 7fd4949a5640 1 --2- 172.21.15.177:0/2766680987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd490071d90 0x7fd490072170 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd4900744d0 tx=0x7fd48c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d826cbff559e2490 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:56.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.374+0000 7fd4877fe640 1 -- 172.21.15.177:0/2766680987 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0aa660 con 0x7fd490071d90 2023-11-28T20:08:56.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.374+0000 7fd4877fe640 1 -- 172.21.15.177:0/2766680987 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c0aa7c0 con 0x7fd490071d90 2023-11-28T20:08:56.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.374+0000 7fd4877fe640 1 -- 172.21.15.177:0/2766680987 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0aab50 con 0x7fd490071d90 2023-11-28T20:08:56.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.374+0000 7fd496c09640 1 -- 172.21.15.177:0/2766680987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd490071d90 msgr2=0x7fd490072170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.374+0000 7fd496c09640 1 --2- 172.21.15.177:0/2766680987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd490071d90 0x7fd490072170 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd4900744d0 tx=0x7fd48c01c500 comp rx=0 tx=0).stop 2023-11-28T20:08:56.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.374+0000 7fd496c09640 1 -- 172.21.15.177:0/2766680987 shutdown_connections 2023-11-28T20:08:56.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.374+0000 7fd496c09640 1 --2- 172.21.15.177:0/2766680987 >> v2:172.21.15.195:3300/0 conn(0x7fd49015adb0 0x7fd49013d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.374+0000 7fd496c09640 1 --2- 172.21.15.177:0/2766680987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd490071d90 0x7fd490072170 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.374+0000 7fd496c09640 1 -- 172.21.15.177:0/2766680987 >> 172.21.15.177:0/2766680987 conn(0x7fd4900b0cc0 msgr2=0x7fd4900b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:56.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.374+0000 7fd496c09640 1 -- 172.21.15.177:0/2766680987 shutdown_connections 2023-11-28T20:08:56.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.374+0000 7fd496c09640 1 -- 172.21.15.177:0/2766680987 wait complete. 2023-11-28T20:08:56.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.374+0000 7fd496c09640 1 Processor -- start 2023-11-28T20:08:56.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.374+0000 7fd496c09640 1 -- start start 2023-11-28T20:08:56.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd496c09640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd490071d90 0x7fd49013a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd496c09640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd49013f5f0 0x7fd49013e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd496c09640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd49015adb0 0x7fd49013e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd496c09640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4901f60e0 con 0x7fd49015adb0 2023-11-28T20:08:56.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd496c09640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49013edc0 con 0x7fd490071d90 2023-11-28T20:08:56.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd496c09640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4901f62e0 con 0x7fd49013f5f0 2023-11-28T20:08:56.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd4951a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd49015adb0 0x7fd49013e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd4949a5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd490071d90 0x7fd49013a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd487fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd49013f5f0 0x7fd49013e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd4949a5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd490071d90 0x7fd49013a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:37154/0 (socket says 172.21.15.177:37154) 2023-11-28T20:08:56.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd4949a5640 1 -- 172.21.15.177:0/1080876586 learned_addr learned my addr 172.21.15.177:0/1080876586 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:56.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd4951a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd49015adb0 0x7fd49013e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56022/0 (socket says 172.21.15.177:56022) 2023-11-28T20:08:56.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd4949a5640 1 -- 172.21.15.177:0/1080876586 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd49013f5f0 msgr2=0x7fd49013e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd4949a5640 1 --2- 172.21.15.177:0/1080876586 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd49013f5f0 0x7fd49013e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd4949a5640 1 -- 172.21.15.177:0/1080876586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd49015adb0 msgr2=0x7fd49013e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd4949a5640 1 --2- 172.21.15.177:0/1080876586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd49015adb0 0x7fd49013e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd4949a5640 1 -- 172.21.15.177:0/1080876586 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c0094d0 con 0x7fd490071d90 2023-11-28T20:08:56.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd4951a6640 1 --2- 172.21.15.177:0/1080876586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd49015adb0 0x7fd49013e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:56.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd4949a5640 1 --2- 172.21.15.177:0/1080876586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd490071d90 0x7fd49013a470 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd48c01a130 tx=0x7fd48c01ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd4857fa640 1 -- 172.21.15.177:0/1080876586 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0b38c0 con 0x7fd490071d90 2023-11-28T20:08:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd4857fa640 1 -- 172.21.15.177:0/1080876586 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c0b3a40 con 0x7fd490071d90 2023-11-28T20:08:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd496c09640 1 -- 172.21.15.177:0/1080876586 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4901f65c0 con 0x7fd490071d90 2023-11-28T20:08:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd4857fa640 1 -- 172.21.15.177:0/1080876586 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0b3df0 con 0x7fd490071d90 2023-11-28T20:08:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd496c09640 1 -- 172.21.15.177:0/1080876586 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4901f70a0 con 0x7fd490071d90 2023-11-28T20:08:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.378+0000 7fd496c09640 1 -- 172.21.15.177:0/1080876586 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4900693d0 con 0x7fd490071d90 2023-11-28T20:08:56.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.382+0000 7fd4857fa640 1 -- 172.21.15.177:0/1080876586 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd48c0059a0 con 0x7fd490071d90 2023-11-28T20:08:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.382+0000 7fd4857fa640 1 --2- 172.21.15.177:0/1080876586 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd47c066470 0x7fd47c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.382+0000 7fd4857fa640 1 -- 172.21.15.177:0/1080876586 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fd48c0a6040 con 0x7fd490071d90 2023-11-28T20:08:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.382+0000 7fd487fff640 1 --2- 172.21.15.177:0/1080876586 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd47c066470 0x7fd47c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.382+0000 7fd487fff640 1 --2- 172.21.15.177:0/1080876586 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd47c066470 0x7fd47c068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd4900af020 tx=0x7fd480008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:56.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.386+0000 7fd4857fa640 1 -- 172.21.15.177:0/1080876586 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd48c0ec3f0 con 0x7fd490071d90 2023-11-28T20:08:56.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.538+0000 7fd496c09640 1 -- 172.21.15.177:0/1080876586 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd4901f7290 con 0x7fd490071d90 2023-11-28T20:08:56.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.538+0000 7fd4857fa640 1 -- 172.21.15.177:0/1080876586 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd48c0efa10 con 0x7fd490071d90 2023-11-28T20:08:56.540 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:56.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.538+0000 7fd496c09640 1 -- 172.21.15.177:0/1080876586 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd47c066470 msgr2=0x7fd47c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.538+0000 7fd496c09640 1 --2- 172.21.15.177:0/1080876586 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd47c066470 0x7fd47c068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd4900af020 tx=0x7fd480008040 comp rx=0 tx=0).stop 2023-11-28T20:08:56.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.538+0000 7fd496c09640 1 -- 172.21.15.177:0/1080876586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd490071d90 msgr2=0x7fd49013a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.538+0000 7fd496c09640 1 --2- 172.21.15.177:0/1080876586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd490071d90 0x7fd49013a470 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd48c01a130 tx=0x7fd48c01ad40 comp rx=0 tx=0).stop 2023-11-28T20:08:56.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.538+0000 7fd496c09640 1 -- 172.21.15.177:0/1080876586 shutdown_connections 2023-11-28T20:08:56.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.538+0000 7fd496c09640 1 --2- 172.21.15.177:0/1080876586 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd47c066470 0x7fd47c068930 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.538+0000 7fd496c09640 1 --2- 172.21.15.177:0/1080876586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd49015adb0 0x7fd49013e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.538+0000 7fd496c09640 1 --2- 172.21.15.177:0/1080876586 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd49013f5f0 0x7fd49013e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.538+0000 7fd496c09640 1 --2- 172.21.15.177:0/1080876586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd490071d90 0x7fd49013a470 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.538+0000 7fd496c09640 1 -- 172.21.15.177:0/1080876586 >> 172.21.15.177:0/1080876586 conn(0x7fd4900b0cc0 msgr2=0x7fd490070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:56.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.538+0000 7fd496c09640 1 -- 172.21.15.177:0/1080876586 shutdown_connections 2023-11-28T20:08:56.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.538+0000 7fd496c09640 1 -- 172.21.15.177:0/1080876586 wait complete. 2023-11-28T20:08:56.561 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:56.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.698+0000 7f97c4879640 1 Processor -- start 2023-11-28T20:08:56.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.698+0000 7f97c4879640 1 -- start start 2023-11-28T20:08:56.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.702+0000 7f97c4879640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97c0143a10 0x7f97c006f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.702+0000 7f97c4879640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c006f940 con 0x7f97c0146760 2023-11-28T20:08:56.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.702+0000 7f97c4879640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c0161030 con 0x7f97c006ac40 2023-11-28T20:08:56.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.702+0000 7f97c4879640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c01619d0 con 0x7f97c0143a10 2023-11-28T20:08:56.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.702+0000 7f97b7fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f97c0146760 0x7f97c006a530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:59626/0 (socket says 172.21.15.177:59626) 2023-11-28T20:08:56.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.702+0000 7f97b7fff640 1 -- 172.21.15.177:0/1868602723 learned_addr learned my addr 172.21.15.177:0/1868602723 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:56.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.702+0000 7f97be59c640 1 --2- 172.21.15.177:0/1868602723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97c0143a10 0x7f97c006f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.702+0000 7f97bdd9b640 1 -- 172.21.15.177:0/1868602723 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512817725 0 0) 0x7f97c006f940 con 0x7f97c0146760 2023-11-28T20:08:56.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.702+0000 7f97bdd9b640 1 -- 172.21.15.177:0/1868602723 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97ac003530 con 0x7f97c0146760 2023-11-28T20:08:56.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.702+0000 7f97bdd9b640 1 -- 172.21.15.177:0/1868602723 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617990792 0 0) 0x7f97c0161030 con 0x7f97c006ac40 2023-11-28T20:08:56.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.702+0000 7f97bdd9b640 1 -- 172.21.15.177:0/1868602723 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97c006f940 con 0x7f97c006ac40 2023-11-28T20:08:56.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.702+0000 7f97be59c640 1 -- 172.21.15.177:0/1868602723 >> v1:172.21.15.195:6789/0 conn(0x7f97c006ac40 legacy=0x7f97c00b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.702+0000 7f97be59c640 1 -- 172.21.15.177:0/1868602723 >> v1:172.21.15.177:6789/0 conn(0x7f97c0146760 legacy=0x7f97c006a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.702+0000 7f97be59c640 1 -- 172.21.15.177:0/1868602723 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c0161310 con 0x7f97c0143a10 2023-11-28T20:08:56.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.706+0000 7f97be59c640 1 --2- 172.21.15.177:0/1868602723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97c0143a10 0x7f97c006f260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f97b00097f0 tx=0x7f97b001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5540e85b5bab5aff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:56.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.706+0000 7f97bdd9b640 1 -- 172.21.15.177:0/1868602723 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b00ab600 con 0x7f97c0143a10 2023-11-28T20:08:56.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.706+0000 7f97bdd9b640 1 -- 172.21.15.177:0/1868602723 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b00a7050 con 0x7f97c0143a10 2023-11-28T20:08:56.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.706+0000 7f97bdd9b640 1 -- 172.21.15.177:0/1868602723 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b00ab980 con 0x7f97c0143a10 2023-11-28T20:08:56.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.706+0000 7f97c4879640 1 -- 172.21.15.177:0/1868602723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97c0143a10 msgr2=0x7f97c006f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.706+0000 7f97c4879640 1 --2- 172.21.15.177:0/1868602723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97c0143a10 0x7f97c006f260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f97b00097f0 tx=0x7f97b001c430 comp rx=0 tx=0).stop 2023-11-28T20:08:56.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.706+0000 7f97c4879640 1 -- 172.21.15.177:0/1868602723 shutdown_connections 2023-11-28T20:08:56.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.706+0000 7f97c4879640 1 --2- 172.21.15.177:0/1868602723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97c0143a10 0x7f97c006f260 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.706+0000 7f97c4879640 1 -- 172.21.15.177:0/1868602723 >> 172.21.15.177:0/1868602723 conn(0x7f97c00b1db0 msgr2=0x7f97c00b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:56.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.706+0000 7f97c4879640 1 -- 172.21.15.177:0/1868602723 shutdown_connections 2023-11-28T20:08:56.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.706+0000 7f97c4879640 1 -- 172.21.15.177:0/1868602723 wait complete. 2023-11-28T20:08:56.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.706+0000 7f97c4879640 1 Processor -- start 2023-11-28T20:08:56.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.706+0000 7f97c4879640 1 -- start start 2023-11-28T20:08:56.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97c4879640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97c006ac40 0x7f97c015f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97c4879640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97c0143a10 0x7f97c0159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97c4879640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97c0146760 0x7f97c013fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97c4879640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00b1360 con 0x7f97c0143a10 2023-11-28T20:08:56.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97c4879640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00b0da0 con 0x7f97c006ac40 2023-11-28T20:08:56.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97c4879640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00b1080 con 0x7f97c0146760 2023-11-28T20:08:56.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97b7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97c0143a10 0x7f97c0159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97be59c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97c006ac40 0x7f97c015f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97b7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97c0143a10 0x7f97c0159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56024/0 (socket says 172.21.15.177:56024) 2023-11-28T20:08:56.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97b7fff640 1 -- 172.21.15.177:0/119659472 learned_addr learned my addr 172.21.15.177:0/119659472 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:56.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97bed9d640 1 --2- 172.21.15.177:0/119659472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97c0146760 0x7f97c013fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97b7fff640 1 -- 172.21.15.177:0/119659472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97c0146760 msgr2=0x7f97c013fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97b7fff640 1 --2- 172.21.15.177:0/119659472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97c0146760 0x7f97c013fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97b7fff640 1 -- 172.21.15.177:0/119659472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97c006ac40 msgr2=0x7f97c015f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97b7fff640 1 --2- 172.21.15.177:0/119659472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97c006ac40 0x7f97c015f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97b7fff640 1 -- 172.21.15.177:0/119659472 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b0009420 con 0x7f97c0143a10 2023-11-28T20:08:56.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97b7fff640 1 --2- 172.21.15.177:0/119659472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97c0143a10 0x7f97c0159e50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f97a800c420 tx=0x7f97a800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:56.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97b6ffd640 1 -- 172.21.15.177:0/119659472 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8005cf0 con 0x7f97c0143a10 2023-11-28T20:08:56.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97b6ffd640 1 -- 172.21.15.177:0/119659472 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a8005e70 con 0x7f97c0143a10 2023-11-28T20:08:56.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97b6ffd640 1 -- 172.21.15.177:0/119659472 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a80072d0 con 0x7f97c0143a10 2023-11-28T20:08:56.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97c4879640 1 -- 172.21.15.177:0/119659472 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c015b8a0 con 0x7f97c0143a10 2023-11-28T20:08:56.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97c4879640 1 -- 172.21.15.177:0/119659472 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c015a390 con 0x7f97c0143a10 2023-11-28T20:08:56.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.710+0000 7f97c4879640 1 -- 172.21.15.177:0/119659472 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c00693d0 con 0x7f97c0143a10 2023-11-28T20:08:56.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.714+0000 7f97b6ffd640 1 -- 172.21.15.177:0/119659472 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f97a8007430 con 0x7f97c0143a10 2023-11-28T20:08:56.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.714+0000 7f97b6ffd640 1 --2- 172.21.15.177:0/119659472 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97a00664a0 0x7f97a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:56.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.714+0000 7f97b6ffd640 1 -- 172.21.15.177:0/119659472 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f97a8083560 con 0x7f97c0143a10 2023-11-28T20:08:56.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.714+0000 7f97be59c640 1 --2- 172.21.15.177:0/119659472 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97a00664a0 0x7f97a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:56.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.714+0000 7f97be59c640 1 --2- 172.21.15.177:0/119659472 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97a00664a0 0x7f97a0068960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f97b00ad000 tx=0x7f97b00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:56.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.718+0000 7f97b6ffd640 1 -- 172.21.15.177:0/119659472 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97a8050900 con 0x7f97c0143a10 2023-11-28T20:08:56.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.866+0000 7f97c4879640 1 -- 172.21.15.177:0/119659472 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97c015bd50 con 0x7f97c0143a10 2023-11-28T20:08:56.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.866+0000 7f97b6ffd640 1 -- 172.21.15.177:0/119659472 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f97a8053f20 con 0x7f97c0143a10 2023-11-28T20:08:56.869 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:56.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.870+0000 7f97c4879640 1 -- 172.21.15.177:0/119659472 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97a00664a0 msgr2=0x7f97a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.870+0000 7f97c4879640 1 --2- 172.21.15.177:0/119659472 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97a00664a0 0x7f97a0068960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f97b00ad000 tx=0x7f97b00a6000 comp rx=0 tx=0).stop 2023-11-28T20:08:56.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.870+0000 7f97c4879640 1 -- 172.21.15.177:0/119659472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97c0143a10 msgr2=0x7f97c0159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.870+0000 7f97c4879640 1 --2- 172.21.15.177:0/119659472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97c0143a10 0x7f97c0159e50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f97a800c420 tx=0x7f97a800c8e0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.870+0000 7f97c4879640 1 -- 172.21.15.177:0/119659472 shutdown_connections 2023-11-28T20:08:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.870+0000 7f97c4879640 1 --2- 172.21.15.177:0/119659472 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f97a00664a0 0x7f97a0068960 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.870+0000 7f97c4879640 1 --2- 172.21.15.177:0/119659472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97c0146760 0x7f97c013fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.870+0000 7f97c4879640 1 --2- 172.21.15.177:0/119659472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97c0143a10 0x7f97c0159e50 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.870+0000 7f97c4879640 1 --2- 172.21.15.177:0/119659472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97c006ac40 0x7f97c015f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.870+0000 7f97c4879640 1 -- 172.21.15.177:0/119659472 >> 172.21.15.177:0/119659472 conn(0x7f97c00b1db0 msgr2=0x7f97c0071500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.870+0000 7f97c4879640 1 -- 172.21.15.177:0/119659472 shutdown_connections 2023-11-28T20:08:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:56.870+0000 7f97c4879640 1 -- 172.21.15.177:0/119659472 wait complete. 2023-11-28T20:08:56.891 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:57.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2af2748640 1 Processor -- start 2023-11-28T20:08:57.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2af2748640 1 -- start start 2023-11-28T20:08:57.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2af2748640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2aec0cfec0 0x7f2aec0cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2af2748640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec0b3d00 con 0x7f2aec0b4270 2023-11-28T20:08:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2af2748640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec0d0450 con 0x7f2aec0cfae0 2023-11-28T20:08:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2af2748640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec0d0730 con 0x7f2aec0cfec0 2023-11-28T20:08:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2af0f45640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f2aec0b4270 0x7f2aec0d1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:59638/0 (socket says 172.21.15.177:59638) 2023-11-28T20:08:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2af0f45640 1 -- 172.21.15.177:0/3967190729 learned_addr learned my addr 172.21.15.177:0/3967190729 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2af1f47640 1 --2- 172.21.15.177:0/3967190729 >> v2:172.21.15.195:3300/0 conn(0x7f2aec0cfec0 0x7f2aec0cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205827810 0 0) 0x7f2aec0b3d00 con 0x7f2aec0b4270 2023-11-28T20:08:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ad8003530 con 0x7f2aec0b4270 2023-11-28T20:08:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483548709 0 0) 0x7f2aec0d0450 con 0x7f2aec0cfae0 2023-11-28T20:08:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aec0b3d00 con 0x7f2aec0cfae0 2023-11-28T20:08:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 750744494 0 0) 0x7f2ad8003530 con 0x7f2aec0b4270 2023-11-28T20:08:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 >> v2:172.21.15.195:3300/0 conn(0x7f2aec0cfec0 msgr2=0x7f2aec0cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 --2- 172.21.15.177:0/3967190729 >> v2:172.21.15.195:3300/0 conn(0x7f2aec0cfec0 0x7f2aec0cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 >> v1:172.21.15.195:6789/0 conn(0x7f2aec0cfae0 legacy=0x7f2aec0d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec0b3200 con 0x7f2aec0b4270 2023-11-28T20:08:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f2adc001680 con 0x7f2aec0b4270 2023-11-28T20:08:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 >> v1:172.21.15.177:6789/0 conn(0x7f2aec0b4270 legacy=0x7f2aec0d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 --2- 172.21.15.177:0/3967190729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ad8003b60 0x7f2ad8003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 --2- 172.21.15.177:0/3967190729 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ad80047d0 0x7f2ad8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 --2- 172.21.15.177:0/3967190729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad8005250 0x7f2ad800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0d0730 con 0x7f2ad8005250 2023-11-28T20:08:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad800c190 con 0x7f2ad8003b60 2023-11-28T20:08:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad800c350 con 0x7f2ad80047d0 2023-11-28T20:08:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.030+0000 7f2af1f47640 1 --2- 172.21.15.177:0/3967190729 >> v2:172.21.15.195:3300/0 conn(0x7f2aec0cfec0 0x7f2aec0cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.034+0000 7f2af1746640 1 --2- 172.21.15.177:0/3967190729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ad8003b60 0x7f2ad8003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.034+0000 7f2af1f47640 1 --2- 172.21.15.177:0/3967190729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad8005250 0x7f2ad800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.034+0000 7f2af0f45640 1 --2- 172.21.15.177:0/3967190729 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ad80047d0 0x7f2ad8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.034+0000 7f2af1f47640 1 -- 172.21.15.177:0/3967190729 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ad80047d0 msgr2=0x7f2ad8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.034+0000 7f2af1f47640 1 --2- 172.21.15.177:0/3967190729 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ad80047d0 0x7f2ad8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.034+0000 7f2af1f47640 1 -- 172.21.15.177:0/3967190729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ad8003b60 msgr2=0x7f2ad8003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.034+0000 7f2af1f47640 1 --2- 172.21.15.177:0/3967190729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ad8003b60 0x7f2ad8003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.034+0000 7f2af1f47640 1 -- 172.21.15.177:0/3967190729 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad8003530 con 0x7f2ad8005250 2023-11-28T20:08:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.034+0000 7f2af1746640 1 --2- 172.21.15.177:0/3967190729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ad8003b60 0x7f2ad8003f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:57.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.034+0000 7f2af1f47640 1 -- 172.21.15.177:0/3967190729 reap_dead start 2023-11-28T20:08:57.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.034+0000 7f2af1f47640 1 --2- 172.21.15.177:0/3967190729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad8005250 0x7f2ad800b990 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400e350 tx=0x7f2ae401ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbef3c265f159a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:57.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.034+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40a5c30 con 0x7f2ad8005250 2023-11-28T20:08:57.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.034+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae400f040 con 0x7f2ad8005250 2023-11-28T20:08:57.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.034+0000 7f2ae3fff640 1 -- 172.21.15.177:0/3967190729 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40039a0 con 0x7f2ad8005250 2023-11-28T20:08:57.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af2748640 1 -- 172.21.15.177:0/3967190729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad8005250 msgr2=0x7f2ad800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af2748640 1 --2- 172.21.15.177:0/3967190729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad8005250 0x7f2ad800b990 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400e350 tx=0x7f2ae401ce40 comp rx=0 tx=0).stop 2023-11-28T20:08:57.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af2748640 1 -- 172.21.15.177:0/3967190729 shutdown_connections 2023-11-28T20:08:57.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af2748640 1 --2- 172.21.15.177:0/3967190729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad8005250 0x7f2ad800b990 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af2748640 1 -- 172.21.15.177:0/3967190729 >> 172.21.15.177:0/3967190729 conn(0x7f2aec0d2f90 msgr2=0x7f2aec0d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:57.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af2748640 1 -- 172.21.15.177:0/3967190729 shutdown_connections 2023-11-28T20:08:57.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af2748640 1 -- 172.21.15.177:0/3967190729 wait complete. 2023-11-28T20:08:57.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af2748640 1 Processor -- start 2023-11-28T20:08:57.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af2748640 1 -- start start 2023-11-28T20:08:57.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af2748640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad8005250 0x7f2aec14c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af2748640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2aec0afb00 0x7f2aec0ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af2748640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2aec167c90 0x7f2aec156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af2748640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec152520 con 0x7f2ad8005250 2023-11-28T20:08:57.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af2748640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec14cc80 con 0x7f2aec0afb00 2023-11-28T20:08:57.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af2748640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec1518a0 con 0x7f2aec167c90 2023-11-28T20:08:57.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af1746640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad8005250 0x7f2aec14c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af1746640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad8005250 0x7f2aec14c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56040/0 (socket says 172.21.15.177:56040) 2023-11-28T20:08:57.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af1746640 1 -- 172.21.15.177:0/1973785531 learned_addr learned my addr 172.21.15.177:0/1973785531 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:57.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af0f45640 1 --2- 172.21.15.177:0/1973785531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2aec0afb00 0x7f2aec0ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af1f47640 1 --2- 172.21.15.177:0/1973785531 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2aec167c90 0x7f2aec156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af1746640 1 -- 172.21.15.177:0/1973785531 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2aec167c90 msgr2=0x7f2aec156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af1746640 1 --2- 172.21.15.177:0/1973785531 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2aec167c90 0x7f2aec156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af1746640 1 -- 172.21.15.177:0/1973785531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2aec0afb00 msgr2=0x7f2aec0ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af1746640 1 --2- 172.21.15.177:0/1973785531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2aec0afb00 0x7f2aec0ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af1746640 1 -- 172.21.15.177:0/1973785531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec151b80 con 0x7f2ad8005250 2023-11-28T20:08:57.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.038+0000 7f2af1746640 1 --2- 172.21.15.177:0/1973785531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad8005250 0x7f2aec14c740 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8007f40 tx=0x7f2ae800fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:57.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.042+0000 7f2ae1ffb640 1 -- 172.21.15.177:0/1973785531 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8018070 con 0x7f2ad8005250 2023-11-28T20:08:57.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.042+0000 7f2ae1ffb640 1 -- 172.21.15.177:0/1973785531 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae80052e0 con 0x7f2ad8005250 2023-11-28T20:08:57.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.042+0000 7f2ae1ffb640 1 -- 172.21.15.177:0/1973785531 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae80054b0 con 0x7f2ad8005250 2023-11-28T20:08:57.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.042+0000 7f2af2748640 1 -- 172.21.15.177:0/1973785531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec151e60 con 0x7f2ad8005250 2023-11-28T20:08:57.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.042+0000 7f2af2748640 1 -- 172.21.15.177:0/1973785531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec0ca5a0 con 0x7f2ad8005250 2023-11-28T20:08:57.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.042+0000 7f2af2748640 1 -- 172.21.15.177:0/1973785531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aec0679f0 con 0x7f2ad8005250 2023-11-28T20:08:57.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.042+0000 7f2ae1ffb640 1 -- 172.21.15.177:0/1973785531 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ae80067e0 con 0x7f2ad8005250 2023-11-28T20:08:57.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.042+0000 7f2ae1ffb640 1 --2- 172.21.15.177:0/1973785531 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2ad00664a0 0x7f2ad0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.042+0000 7f2ae1ffb640 1 -- 172.21.15.177:0/1973785531 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f2ae8083920 con 0x7f2ad8005250 2023-11-28T20:08:57.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.046+0000 7f2af0f45640 1 --2- 172.21.15.177:0/1973785531 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2ad00664a0 0x7f2ad0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.046+0000 7f2af0f45640 1 --2- 172.21.15.177:0/1973785531 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2ad00664a0 0x7f2ad0068960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0b8710 tx=0x7f2adc001b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:57.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.046+0000 7f2ae1ffb640 1 -- 172.21.15.177:0/1973785531 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ae8050d50 con 0x7f2ad8005250 2023-11-28T20:08:57.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.198+0000 7f2af2748640 1 -- 172.21.15.177:0/1973785531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2aec0a0e80 con 0x7f2ad8005250 2023-11-28T20:08:57.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.198+0000 7f2ae1ffb640 1 -- 172.21.15.177:0/1973785531 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ae8054370 con 0x7f2ad8005250 2023-11-28T20:08:57.201 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:57.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.202+0000 7f2af2748640 1 -- 172.21.15.177:0/1973785531 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2ad00664a0 msgr2=0x7f2ad0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.202+0000 7f2af2748640 1 --2- 172.21.15.177:0/1973785531 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2ad00664a0 0x7f2ad0068960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0b8710 tx=0x7f2adc001b50 comp rx=0 tx=0).stop 2023-11-28T20:08:57.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.202+0000 7f2af2748640 1 -- 172.21.15.177:0/1973785531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad8005250 msgr2=0x7f2aec14c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.202+0000 7f2af2748640 1 --2- 172.21.15.177:0/1973785531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad8005250 0x7f2aec14c740 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8007f40 tx=0x7f2ae800fd40 comp rx=0 tx=0).stop 2023-11-28T20:08:57.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.202+0000 7f2af2748640 1 -- 172.21.15.177:0/1973785531 shutdown_connections 2023-11-28T20:08:57.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.202+0000 7f2af2748640 1 --2- 172.21.15.177:0/1973785531 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2ad00664a0 0x7f2ad0068960 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.202+0000 7f2af2748640 1 --2- 172.21.15.177:0/1973785531 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2aec167c90 0x7f2aec156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.202+0000 7f2af2748640 1 --2- 172.21.15.177:0/1973785531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2aec0afb00 0x7f2aec0ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.202+0000 7f2af2748640 1 --2- 172.21.15.177:0/1973785531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad8005250 0x7f2aec14c740 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.202+0000 7f2af2748640 1 -- 172.21.15.177:0/1973785531 >> 172.21.15.177:0/1973785531 conn(0x7f2aec0d2f90 msgr2=0x7f2aec0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:57.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.202+0000 7f2af2748640 1 -- 172.21.15.177:0/1973785531 shutdown_connections 2023-11-28T20:08:57.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.202+0000 7f2af2748640 1 -- 172.21.15.177:0/1973785531 wait complete. 2023-11-28T20:08:57.222 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-11-28T20:08:57.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04d4817640 1 Processor -- start 2023-11-28T20:08:57.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04d4817640 1 -- start start 2023-11-28T20:08:57.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04d4817640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d0071d90 0x7f04d0072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04d4817640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f04d015adb0 0x7f04d013d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04d4817640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d013d2b0 con 0x7f04d013f5f0 2023-11-28T20:08:57.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04d4817640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d0140520 con 0x7f04d015adb0 2023-11-28T20:08:57.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04d4817640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00cd7f0 con 0x7f04d0071d90 2023-11-28T20:08:57.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04ced9d640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f04d013f5f0 0x7f04d00ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:59642/0 (socket says 172.21.15.177:59642) 2023-11-28T20:08:57.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04ced9d640 1 -- 172.21.15.177:0/3928606110 learned_addr learned my addr 172.21.15.177:0/3928606110 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:57.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04c5d9b640 1 --2- 172.21.15.177:0/3928606110 >> v2:172.21.15.195:3300/0 conn(0x7f04d015adb0 0x7f04d013d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04ce59c640 1 --2- 172.21.15.177:0/3928606110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d0071d90 0x7f04d0072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04cdd9b640 1 -- 172.21.15.177:0/3928606110 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605058934 0 0) 0x7f04d013d2b0 con 0x7f04d013f5f0 2023-11-28T20:08:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04cdd9b640 1 -- 172.21.15.177:0/3928606110 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04bc003530 con 0x7f04d013f5f0 2023-11-28T20:08:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04cdd9b640 1 -- 172.21.15.177:0/3928606110 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3615748584 0 0) 0x7f04bc003530 con 0x7f04d013f5f0 2023-11-28T20:08:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04cdd9b640 1 -- 172.21.15.177:0/3928606110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d0071d90 msgr2=0x7f04d0072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04cdd9b640 1 --2- 172.21.15.177:0/3928606110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d0071d90 0x7f04d0072170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04cdd9b640 1 -- 172.21.15.177:0/3928606110 >> v2:172.21.15.195:3300/0 conn(0x7f04d015adb0 msgr2=0x7f04d013d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04cdd9b640 1 --2- 172.21.15.177:0/3928606110 >> v2:172.21.15.195:3300/0 conn(0x7f04d015adb0 0x7f04d013d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04cdd9b640 1 -- 172.21.15.177:0/3928606110 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d00cdd70 con 0x7f04d013f5f0 2023-11-28T20:08:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.362+0000 7f04cdd9b640 1 -- 172.21.15.177:0/3928606110 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f04c8001680 con 0x7f04d013f5f0 2023-11-28T20:08:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04cdd9b640 1 -- 172.21.15.177:0/3928606110 >> v1:172.21.15.177:6789/0 conn(0x7f04d013f5f0 legacy=0x7f04d00ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04cdd9b640 1 --2- 172.21.15.177:0/3928606110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d0071d90 0x7f04bc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04cdd9b640 1 --2- 172.21.15.177:0/3928606110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04bc003f00 0x7f04bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04cdd9b640 1 --2- 172.21.15.177:0/3928606110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04bc004d10 0x7f04bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04cdd9b640 1 -- 172.21.15.177:0/3928606110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d0140520 con 0x7f04bc004d10 2023-11-28T20:08:57.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04cdd9b640 1 -- 172.21.15.177:0/3928606110 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00cd7f0 con 0x7f04bc003f00 2023-11-28T20:08:57.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04cdd9b640 1 -- 172.21.15.177:0/3928606110 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc00dba0 con 0x7f04d0071d90 2023-11-28T20:08:57.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04ce59c640 1 --2- 172.21.15.177:0/3928606110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d0071d90 0x7f04bc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04ced9d640 1 --2- 172.21.15.177:0/3928606110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04bc004d10 0x7f04bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04c5d9b640 1 --2- 172.21.15.177:0/3928606110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04bc003f00 0x7f04bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04ced9d640 1 -- 172.21.15.177:0/3928606110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d0071d90 msgr2=0x7f04bc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:57.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04ced9d640 1 --2- 172.21.15.177:0/3928606110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d0071d90 0x7f04bc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04ced9d640 1 -- 172.21.15.177:0/3928606110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04bc003f00 msgr2=0x7f04bc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:57.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04ced9d640 1 --2- 172.21.15.177:0/3928606110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04bc003f00 0x7f04bc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04ced9d640 1 -- 172.21.15.177:0/3928606110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc003530 con 0x7f04bc004d10 2023-11-28T20:08:57.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04ce59c640 1 --2- 172.21.15.177:0/3928606110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d0071d90 0x7f04bc003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:57.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04ced9d640 1 --2- 172.21.15.177:0/3928606110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04bc004d10 0x7f04bc005190 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f04c800c240 tx=0x7f04c801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b1bf3c183f6383 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:57.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04cdd9b640 1 -- 172.21.15.177:0/3928606110 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c80a5960 con 0x7f04bc004d10 2023-11-28T20:08:57.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04cdd9b640 1 -- 172.21.15.177:0/3928606110 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c80a5ac0 con 0x7f04bc004d10 2023-11-28T20:08:57.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.366+0000 7f04cdd9b640 1 -- 172.21.15.177:0/3928606110 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c80058e0 con 0x7f04bc004d10 2023-11-28T20:08:57.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04d4817640 1 -- 172.21.15.177:0/3928606110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04bc004d10 msgr2=0x7f04bc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04d4817640 1 --2- 172.21.15.177:0/3928606110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04bc004d10 0x7f04bc005190 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f04c800c240 tx=0x7f04c801cc00 comp rx=0 tx=0).stop 2023-11-28T20:08:57.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04ced9d640 1 -- 172.21.15.177:0/3928606110 reap_dead start 2023-11-28T20:08:57.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04d4817640 1 -- 172.21.15.177:0/3928606110 shutdown_connections 2023-11-28T20:08:57.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04d4817640 1 -- 172.21.15.177:0/3928606110 >> 172.21.15.177:0/3928606110 conn(0x7f04d00b0cc0 msgr2=0x7f04d00b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:57.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04d4817640 1 -- 172.21.15.177:0/3928606110 shutdown_connections 2023-11-28T20:08:57.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04d4817640 1 -- 172.21.15.177:0/3928606110 wait complete. 2023-11-28T20:08:57.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04d4817640 1 Processor -- start 2023-11-28T20:08:57.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04d4817640 1 -- start start 2023-11-28T20:08:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04d4817640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04bc004d10 0x7f04d00acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04d4817640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d00a8430 0x7f04d00a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04d4817640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04d01eef00 0x7f04d01ef3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04d4817640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00a8df0 con 0x7f04d01eef00 2023-11-28T20:08:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04d4817640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00a90b0 con 0x7f04bc004d10 2023-11-28T20:08:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04d4817640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00a9390 con 0x7f04d00a8430 2023-11-28T20:08:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.370+0000 7f04ced9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04d01eef00 0x7f04d01ef3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04ced9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04d01eef00 0x7f04d01ef3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56056/0 (socket says 172.21.15.177:56056) 2023-11-28T20:08:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04ced9d640 1 -- 172.21.15.177:0/2699623568 learned_addr learned my addr 172.21.15.177:0/2699623568 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04ce59c640 1 --2- 172.21.15.177:0/2699623568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04bc004d10 0x7f04d00acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04c5d9b640 1 --2- 172.21.15.177:0/2699623568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d00a8430 0x7f04d00a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04ced9d640 1 -- 172.21.15.177:0/2699623568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d00a8430 msgr2=0x7f04d00a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04ced9d640 1 --2- 172.21.15.177:0/2699623568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d00a8430 0x7f04d00a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04ced9d640 1 -- 172.21.15.177:0/2699623568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04bc004d10 msgr2=0x7f04d00acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04ced9d640 1 --2- 172.21.15.177:0/2699623568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04bc004d10 0x7f04d00acf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04ced9d640 1 -- 172.21.15.177:0/2699623568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d00a9670 con 0x7f04d01eef00 2023-11-28T20:08:57.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04ced9d640 1 --2- 172.21.15.177:0/2699623568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04d01eef00 0x7f04d01ef3b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f04c800c240 tx=0x7f04bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:57.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04c77fe640 1 -- 172.21.15.177:0/2699623568 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c80a5960 con 0x7f04d01eef00 2023-11-28T20:08:57.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04c77fe640 1 -- 172.21.15.177:0/2699623568 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c80b3070 con 0x7f04d01eef00 2023-11-28T20:08:57.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04d4817640 1 -- 172.21.15.177:0/2699623568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d00a9950 con 0x7f04d01eef00 2023-11-28T20:08:57.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04c77fe640 1 -- 172.21.15.177:0/2699623568 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c80074d0 con 0x7f04d01eef00 2023-11-28T20:08:57.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04d4817640 1 -- 172.21.15.177:0/2699623568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d01ef8f0 con 0x7f04d01eef00 2023-11-28T20:08:57.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04d4817640 1 -- 172.21.15.177:0/2699623568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d0073cf0 con 0x7f04d01eef00 2023-11-28T20:08:57.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04c77fe640 1 -- 172.21.15.177:0/2699623568 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f04c8007630 con 0x7f04d01eef00 2023-11-28T20:08:57.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04c77fe640 1 --2- 172.21.15.177:0/2699623568 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f04b0066470 0x7f04b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.374+0000 7f04c77fe640 1 -- 172.21.15.177:0/2699623568 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f04c80b5070 con 0x7f04d01eef00 2023-11-28T20:08:57.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.378+0000 7f04ce59c640 1 --2- 172.21.15.177:0/2699623568 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f04b0066470 0x7f04b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.378+0000 7f04ce59c640 1 --2- 172.21.15.177:0/2699623568 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f04b0066470 0x7f04b0068930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f04d00b0080 tx=0x7f04c000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:57.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.378+0000 7f04c77fe640 1 -- 172.21.15.177:0/2699623568 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f04d0073cf0 con 0x7f04d01eef00 2023-11-28T20:08:57.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.530+0000 7f04d4817640 1 -- 172.21.15.177:0/2699623568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f04d0073cf0 con 0x7f04d01eef00 2023-11-28T20:08:57.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.530+0000 7f04c77fe640 1 -- 172.21.15.177:0/2699623568 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v36) v1 ==== 97+0+11 (secure 0 0 0) 0x7f04d0073cf0 con 0x7f04d01eef00 2023-11-28T20:08:57.533 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:57.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.534+0000 7f04d4817640 1 -- 172.21.15.177:0/2699623568 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f04b0066470 msgr2=0x7f04b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.534+0000 7f04d4817640 1 --2- 172.21.15.177:0/2699623568 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f04b0066470 0x7f04b0068930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f04d00b0080 tx=0x7f04c000b040 comp rx=0 tx=0).stop 2023-11-28T20:08:57.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.534+0000 7f04d4817640 1 -- 172.21.15.177:0/2699623568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04d01eef00 msgr2=0x7f04d01ef3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.534+0000 7f04d4817640 1 --2- 172.21.15.177:0/2699623568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04d01eef00 0x7f04d01ef3b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f04c800c240 tx=0x7f04bc005800 comp rx=0 tx=0).stop 2023-11-28T20:08:57.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.534+0000 7f04d4817640 1 -- 172.21.15.177:0/2699623568 shutdown_connections 2023-11-28T20:08:57.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.534+0000 7f04d4817640 1 --2- 172.21.15.177:0/2699623568 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f04b0066470 0x7f04b0068930 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.534+0000 7f04d4817640 1 --2- 172.21.15.177:0/2699623568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04d01eef00 0x7f04d01ef3b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.534+0000 7f04d4817640 1 --2- 172.21.15.177:0/2699623568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d00a8430 0x7f04d00a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.534+0000 7f04d4817640 1 --2- 172.21.15.177:0/2699623568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04bc004d10 0x7f04d00acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.534+0000 7f04d4817640 1 -- 172.21.15.177:0/2699623568 >> 172.21.15.177:0/2699623568 conn(0x7f04d00b0cc0 msgr2=0x7f04d013dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:57.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.534+0000 7f04d4817640 1 -- 172.21.15.177:0/2699623568 shutdown_connections 2023-11-28T20:08:57.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.534+0000 7f04d4817640 1 -- 172.21.15.177:0/2699623568 wait complete. 2023-11-28T20:08:57.555 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:08:57.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.690+0000 7f83b130f640 1 Processor -- start 2023-11-28T20:08:57.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.690+0000 7f83b130f640 1 -- start start 2023-11-28T20:08:57.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.690+0000 7f83b130f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83ac15d200 0x7f83ac0d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.690+0000 7f83b130f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f83ac0d1160 0x7f83ac0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.690+0000 7f83b130f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f83ac0d15a0 0x7f83ac0ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.690+0000 7f83b130f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ac0ce870 con 0x7f83ac0d1160 2023-11-28T20:08:57.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.690+0000 7f83b130f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ac0b29f0 con 0x7f83ac0d15a0 2023-11-28T20:08:57.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.690+0000 7f83b130f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac0d1b00 con 0x7f83ac15d200 2023-11-28T20:08:57.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.694+0000 7f83a27fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f83ac0d1160 0x7f83ac0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.694+0000 7f83a27fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f83ac0d1160 0x7f83ac0cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56066/0 (socket says 172.21.15.177:56066) 2023-11-28T20:08:57.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.694+0000 7f83a27fc640 1 -- 172.21.15.177:0/2288567121 learned_addr learned my addr 172.21.15.177:0/2288567121 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:57.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.694+0000 7f83aaffd640 1 --2- 172.21.15.177:0/2288567121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83ac15d200 0x7f83ac0d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.694+0000 7f83ab7fe640 1 --2- 172.21.15.177:0/2288567121 >> v2:172.21.15.195:3300/0 conn(0x7f83ac0d15a0 0x7f83ac0ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.694+0000 7f83a27fc640 1 -- 172.21.15.177:0/2288567121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83ac15d200 msgr2=0x7f83ac0d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:57.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.694+0000 7f83a27fc640 1 --2- 172.21.15.177:0/2288567121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83ac15d200 0x7f83ac0d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.694+0000 7f83a27fc640 1 -- 172.21.15.177:0/2288567121 >> v2:172.21.15.195:3300/0 conn(0x7f83ac0d15a0 msgr2=0x7f83ac0ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:57.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.694+0000 7f83a27fc640 1 --2- 172.21.15.177:0/2288567121 >> v2:172.21.15.195:3300/0 conn(0x7f83ac0d15a0 0x7f83ac0ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.694+0000 7f83a27fc640 1 -- 172.21.15.177:0/2288567121 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac0d1de0 con 0x7f83ac0d1160 2023-11-28T20:08:57.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.694+0000 7f83a27fc640 1 --2- 172.21.15.177:0/2288567121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83ac0d1160 0x7f83ac0cddf0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0b60e0 tx=0x7f839401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba065e73882f33e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:57.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.694+0000 7f83aa7fc640 1 -- 172.21.15.177:0/2288567121 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940af400 con 0x7f83ac0d1160 2023-11-28T20:08:57.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.694+0000 7f83aa7fc640 1 -- 172.21.15.177:0/2288567121 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83940ab050 con 0x7f83ac0d1160 2023-11-28T20:08:57.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.694+0000 7f83aa7fc640 1 -- 172.21.15.177:0/2288567121 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940af780 con 0x7f83ac0d1160 2023-11-28T20:08:57.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 -- 172.21.15.177:0/2288567121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83ac0d1160 msgr2=0x7f83ac0cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 --2- 172.21.15.177:0/2288567121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83ac0d1160 0x7f83ac0cddf0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0b60e0 tx=0x7f839401f1c0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 -- 172.21.15.177:0/2288567121 shutdown_connections 2023-11-28T20:08:57.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 --2- 172.21.15.177:0/2288567121 >> v2:172.21.15.195:3300/0 conn(0x7f83ac0d15a0 0x7f83ac0ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 --2- 172.21.15.177:0/2288567121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83ac0d1160 0x7f83ac0cddf0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 --2- 172.21.15.177:0/2288567121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83ac15d200 0x7f83ac0d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 -- 172.21.15.177:0/2288567121 >> 172.21.15.177:0/2288567121 conn(0x7f83ac072260 msgr2=0x7f83ac0cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:57.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 -- 172.21.15.177:0/2288567121 shutdown_connections 2023-11-28T20:08:57.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 -- 172.21.15.177:0/2288567121 wait complete. 2023-11-28T20:08:57.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 Processor -- start 2023-11-28T20:08:57.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 -- start start 2023-11-28T20:08:57.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83ac0d1160 0x7f83ac14fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83ac0d15a0 0x7f83ac0c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83ac15d200 0x7f83ac0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac0cd110 con 0x7f83ac0d1160 2023-11-28T20:08:57.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac0cd3f0 con 0x7f83ac15d200 2023-11-28T20:08:57.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83b130f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac157b40 con 0x7f83ac0d15a0 2023-11-28T20:08:57.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83aaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83ac0d1160 0x7f83ac14fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83aaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83ac0d1160 0x7f83ac14fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56072/0 (socket says 172.21.15.177:56072) 2023-11-28T20:08:57.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83aaffd640 1 -- 172.21.15.177:0/3256671953 learned_addr learned my addr 172.21.15.177:0/3256671953 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:57.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.698+0000 7f83ab7fe640 1 --2- 172.21.15.177:0/3256671953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83ac15d200 0x7f83ac0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83a27fc640 1 --2- 172.21.15.177:0/3256671953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83ac0d15a0 0x7f83ac0c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83aaffd640 1 -- 172.21.15.177:0/3256671953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83ac0d15a0 msgr2=0x7f83ac0c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83aaffd640 1 --2- 172.21.15.177:0/3256671953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83ac0d15a0 0x7f83ac0c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83aaffd640 1 -- 172.21.15.177:0/3256671953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83ac15d200 msgr2=0x7f83ac0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83aaffd640 1 --2- 172.21.15.177:0/3256671953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83ac15d200 0x7f83ac0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83aaffd640 1 -- 172.21.15.177:0/3256671953 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8394009b30 con 0x7f83ac0d1160 2023-11-28T20:08:57.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83aaffd640 1 --2- 172.21.15.177:0/3256671953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83ac0d1160 0x7f83ac14fca0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f839c00e870 tx=0x7f839c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:57.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83a3fff640 1 -- 172.21.15.177:0/3256671953 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c009510 con 0x7f83ac0d1160 2023-11-28T20:08:57.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83a3fff640 1 -- 172.21.15.177:0/3256671953 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839c00eec0 con 0x7f83ac0d1160 2023-11-28T20:08:57.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83a3fff640 1 -- 172.21.15.177:0/3256671953 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c00cb40 con 0x7f83ac0d1160 2023-11-28T20:08:57.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83b130f640 1 -- 172.21.15.177:0/3256671953 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ac157e20 con 0x7f83ac0d1160 2023-11-28T20:08:57.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83b130f640 1 -- 172.21.15.177:0/3256671953 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ac1501e0 con 0x7f83ac0d1160 2023-11-28T20:08:57.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83b130f640 1 -- 172.21.15.177:0/3256671953 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ac0cd5b0 con 0x7f83ac0d1160 2023-11-28T20:08:57.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83a3fff640 1 -- 172.21.15.177:0/3256671953 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f839c00cca0 con 0x7f83ac0d1160 2023-11-28T20:08:57.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83a3fff640 1 --2- 172.21.15.177:0/3256671953 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f838c066470 0x7f838c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:57.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83a3fff640 1 -- 172.21.15.177:0/3256671953 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f839c0840e0 con 0x7f83ac0d1160 2023-11-28T20:08:57.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.702+0000 7f83a27fc640 1 --2- 172.21.15.177:0/3256671953 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f838c066470 0x7f838c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:57.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.706+0000 7f83a27fc640 1 --2- 172.21.15.177:0/3256671953 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f838c066470 0x7f838c068930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f83940b1000 tx=0x7f83940aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:57.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.706+0000 7f83a3fff640 1 -- 172.21.15.177:0/3256671953 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f83ac0cd5b0 con 0x7f83ac0d1160 2023-11-28T20:08:57.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.866+0000 7f83b130f640 1 -- 172.21.15.177:0/3256671953 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f83ac0cd5b0 con 0x7f83ac0d1160 2023-11-28T20:08:57.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.870+0000 7f83a3fff640 1 -- 172.21.15.177:0/3256671953 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f83ac0cd5b0 con 0x7f83ac0d1160 2023-11-28T20:08:57.871 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:08:57.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.870+0000 7f83b130f640 1 -- 172.21.15.177:0/3256671953 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f838c066470 msgr2=0x7f838c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.870+0000 7f83b130f640 1 --2- 172.21.15.177:0/3256671953 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f838c066470 0x7f838c068930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f83940b1000 tx=0x7f83940aa000 comp rx=0 tx=0).stop 2023-11-28T20:08:57.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.870+0000 7f83b130f640 1 -- 172.21.15.177:0/3256671953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83ac0d1160 msgr2=0x7f83ac14fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:57.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.870+0000 7f83b130f640 1 --2- 172.21.15.177:0/3256671953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83ac0d1160 0x7f83ac14fca0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f839c00e870 tx=0x7f839c00ec70 comp rx=0 tx=0).stop 2023-11-28T20:08:57.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.870+0000 7f83b130f640 1 -- 172.21.15.177:0/3256671953 shutdown_connections 2023-11-28T20:08:57.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.870+0000 7f83b130f640 1 --2- 172.21.15.177:0/3256671953 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f838c066470 0x7f838c068930 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.870+0000 7f83b130f640 1 --2- 172.21.15.177:0/3256671953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83ac15d200 0x7f83ac0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.870+0000 7f83b130f640 1 --2- 172.21.15.177:0/3256671953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83ac0d15a0 0x7f83ac0c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.870+0000 7f83b130f640 1 --2- 172.21.15.177:0/3256671953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83ac0d1160 0x7f83ac14fca0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:57.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.870+0000 7f83b130f640 1 -- 172.21.15.177:0/3256671953 >> 172.21.15.177:0/3256671953 conn(0x7f83ac072260 msgr2=0x7f83ac0b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:57.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.870+0000 7f83b130f640 1 -- 172.21.15.177:0/3256671953 shutdown_connections 2023-11-28T20:08:57.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:57.870+0000 7f83b130f640 1 -- 172.21.15.177:0/3256671953 wait complete. 2023-11-28T20:08:57.891 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:08:57.891 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:08:57.902 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:08:58.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.082+0000 7fa04053e640 1 Processor -- start 2023-11-28T20:08:58.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.082+0000 7fa04053e640 1 -- start start 2023-11-28T20:08:58.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.082+0000 7fa04053e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa03806cdb0 0x7fa038150250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.082+0000 7fa04053e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa03815a4b0 0x7fa038150790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.082+0000 7fa04053e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa038070460 con 0x7fa03806d190 2023-11-28T20:08:58.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.082+0000 7fa04053e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa038150cd0 con 0x7fa03806cdb0 2023-11-28T20:08:58.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.082+0000 7fa04053e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03815a8e0 con 0x7fa03815a4b0 2023-11-28T20:08:58.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.082+0000 7fa03e2da640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa03806cdb0 0x7fa038150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.082+0000 7fa03e2da640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa03806cdb0 0x7fa038150250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56086/0 (socket says 172.21.15.177:56086) 2023-11-28T20:08:58.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.082+0000 7fa03e2da640 1 -- 172.21.15.177:0/1955097993 learned_addr learned my addr 172.21.15.177:0/1955097993 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:58.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.086+0000 7fa03eadb640 1 --2- 172.21.15.177:0/1955097993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa03815a4b0 0x7fa038150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.086+0000 7fa03e2da640 1 -- 172.21.15.177:0/1955097993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa03815a4b0 msgr2=0x7fa038150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:58.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.086+0000 7fa03e2da640 1 --2- 172.21.15.177:0/1955097993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa03815a4b0 0x7fa038150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.086+0000 7fa03e2da640 1 -- 172.21.15.177:0/1955097993 >> v1:172.21.15.195:6789/0 conn(0x7fa03806d190 legacy=0x7fa038159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.086+0000 7fa03e2da640 1 -- 172.21.15.177:0/1955097993 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03815ab20 con 0x7fa03806cdb0 2023-11-28T20:08:58.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.086+0000 7fa03e2da640 1 --2- 172.21.15.177:0/1955097993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa03806cdb0 0x7fa038150250 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa034009870 tx=0x7fa03401d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945de3fdeed14527 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:58.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.086+0000 7fa03d2d8640 1 -- 172.21.15.177:0/1955097993 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0340ab610 con 0x7fa03806cdb0 2023-11-28T20:08:58.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.086+0000 7fa03d2d8640 1 -- 172.21.15.177:0/1955097993 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0340a7040 con 0x7fa03806cdb0 2023-11-28T20:08:58.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.086+0000 7fa03d2d8640 1 -- 172.21.15.177:0/1955097993 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0340ab990 con 0x7fa03806cdb0 2023-11-28T20:08:58.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.086+0000 7fa04053e640 1 -- 172.21.15.177:0/1955097993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa03806cdb0 msgr2=0x7fa038150250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.086+0000 7fa04053e640 1 --2- 172.21.15.177:0/1955097993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa03806cdb0 0x7fa038150250 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa034009870 tx=0x7fa03401d650 comp rx=0 tx=0).stop 2023-11-28T20:08:58.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa04053e640 1 -- 172.21.15.177:0/1955097993 shutdown_connections 2023-11-28T20:08:58.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa04053e640 1 --2- 172.21.15.177:0/1955097993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa03815a4b0 0x7fa038150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa04053e640 1 --2- 172.21.15.177:0/1955097993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa03806cdb0 0x7fa038150250 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa04053e640 1 -- 172.21.15.177:0/1955097993 >> 172.21.15.177:0/1955097993 conn(0x7fa03806a530 msgr2=0x7fa03806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:58.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa04053e640 1 -- 172.21.15.177:0/1955097993 shutdown_connections 2023-11-28T20:08:58.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa04053e640 1 -- 172.21.15.177:0/1955097993 wait complete. 2023-11-28T20:08:58.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa04053e640 1 Processor -- start 2023-11-28T20:08:58.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa04053e640 1 -- start start 2023-11-28T20:08:58.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa04053e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa03806cdb0 0x7fa03812ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa04053e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa03806d190 0x7fa038143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa04053e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa03815a4b0 0x7fa038147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa04053e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa038150e10 con 0x7fa03806cdb0 2023-11-28T20:08:58.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa04053e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0381510d0 con 0x7fa03806d190 2023-11-28T20:08:58.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa04053e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0381513b0 con 0x7fa03815a4b0 2023-11-28T20:08:58.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa03e2da640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa03806cdb0 0x7fa03812ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa03e2da640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa03806cdb0 0x7fa03812ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56096/0 (socket says 172.21.15.177:56096) 2023-11-28T20:08:58.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa03e2da640 1 -- 172.21.15.177:0/1266044661 learned_addr learned my addr 172.21.15.177:0/1266044661 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:58.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa03eadb640 1 --2- 172.21.15.177:0/1266044661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa03815a4b0 0x7fa038147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa03dad9640 1 --2- 172.21.15.177:0/1266044661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa03806d190 0x7fa038143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa03e2da640 1 -- 172.21.15.177:0/1266044661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa03815a4b0 msgr2=0x7fa038147a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa03e2da640 1 --2- 172.21.15.177:0/1266044661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa03815a4b0 0x7fa038147a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa03e2da640 1 -- 172.21.15.177:0/1266044661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa03806d190 msgr2=0x7fa038143c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa03e2da640 1 --2- 172.21.15.177:0/1266044661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa03806d190 0x7fa038143c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.090+0000 7fa03e2da640 1 -- 172.21.15.177:0/1266044661 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0340094d0 con 0x7fa03806cdb0 2023-11-28T20:08:58.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.094+0000 7fa03e2da640 1 --2- 172.21.15.177:0/1266044661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa03806cdb0 0x7fa03812ff20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa0340ad040 tx=0x7fa03401a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:58.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.094+0000 7fa02effd640 1 -- 172.21.15.177:0/1266044661 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0340bc070 con 0x7fa03806cdb0 2023-11-28T20:08:58.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.094+0000 7fa02effd640 1 -- 172.21.15.177:0/1266044661 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0340abe70 con 0x7fa03806cdb0 2023-11-28T20:08:58.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.094+0000 7fa02effd640 1 -- 172.21.15.177:0/1266044661 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0340b4640 con 0x7fa03806cdb0 2023-11-28T20:08:58.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.094+0000 7fa04053e640 1 -- 172.21.15.177:0/1266044661 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa038151690 con 0x7fa03806cdb0 2023-11-28T20:08:58.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.094+0000 7fa04053e640 1 -- 172.21.15.177:0/1266044661 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa038130460 con 0x7fa03806cdb0 2023-11-28T20:08:58.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.094+0000 7fa04053e640 1 -- 172.21.15.177:0/1266044661 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0380ae6a0 con 0x7fa03806cdb0 2023-11-28T20:08:58.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.094+0000 7fa02effd640 1 -- 172.21.15.177:0/1266044661 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa0340b47a0 con 0x7fa03806cdb0 2023-11-28T20:08:58.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.094+0000 7fa02effd640 1 --2- 172.21.15.177:0/1266044661 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa01c066470 0x7fa01c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.094+0000 7fa02effd640 1 -- 172.21.15.177:0/1266044661 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fa03411d9b0 con 0x7fa03806cdb0 2023-11-28T20:08:58.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.098+0000 7fa03dad9640 1 --2- 172.21.15.177:0/1266044661 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa01c066470 0x7fa01c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.098+0000 7fa03dad9640 1 --2- 172.21.15.177:0/1266044661 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa01c066470 0x7fa01c068930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa038145c50 tx=0x7fa028009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:58.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.098+0000 7fa02effd640 1 -- 172.21.15.177:0/1266044661 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0340eade0 con 0x7fa03806cdb0 2023-11-28T20:08:58.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.250+0000 7fa04053e640 1 -- 172.21.15.177:0/1266044661 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa038069440 con 0x7fa03806cdb0 2023-11-28T20:08:58.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.254+0000 7fa02effd640 1 -- 172.21.15.177:0/1266044661 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18408 (secure 0 0 0) 0x7fa03411d030 con 0x7fa03806cdb0 2023-11-28T20:08:58.255 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:08:58.255 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":36,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:55.264752+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:08:37.943771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T20:08:38.396895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2023-11-28T20:08:52.500186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:08:58.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.254+0000 7fa04053e640 1 -- 172.21.15.177:0/1266044661 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa01c066470 msgr2=0x7fa01c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.254+0000 7fa04053e640 1 --2- 172.21.15.177:0/1266044661 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa01c066470 0x7fa01c068930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa038145c50 tx=0x7fa028009040 comp rx=0 tx=0).stop 2023-11-28T20:08:58.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.254+0000 7fa04053e640 1 -- 172.21.15.177:0/1266044661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa03806cdb0 msgr2=0x7fa03812ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.254+0000 7fa04053e640 1 --2- 172.21.15.177:0/1266044661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa03806cdb0 0x7fa03812ff20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa0340ad040 tx=0x7fa03401a3f0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.254+0000 7fa04053e640 1 -- 172.21.15.177:0/1266044661 shutdown_connections 2023-11-28T20:08:58.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.254+0000 7fa04053e640 1 --2- 172.21.15.177:0/1266044661 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa01c066470 0x7fa01c068930 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.254+0000 7fa04053e640 1 --2- 172.21.15.177:0/1266044661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa03815a4b0 0x7fa038147a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.254+0000 7fa04053e640 1 --2- 172.21.15.177:0/1266044661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa03806d190 0x7fa038143c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.254+0000 7fa04053e640 1 --2- 172.21.15.177:0/1266044661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa03806cdb0 0x7fa03812ff20 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.254+0000 7fa04053e640 1 -- 172.21.15.177:0/1266044661 >> 172.21.15.177:0/1266044661 conn(0x7fa03806a530 msgr2=0x7fa0380b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:58.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.254+0000 7fa04053e640 1 -- 172.21.15.177:0/1266044661 shutdown_connections 2023-11-28T20:08:58.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.254+0000 7fa04053e640 1 -- 172.21.15.177:0/1266044661 wait complete. 2023-11-28T20:08:58.275 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:08:37.943771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:08:38.396895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2023-11-28T20:08:52.500186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:08:58.276 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:08:58.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.418+0000 7fda6a479640 1 Processor -- start 2023-11-28T20:08:58.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.418+0000 7fda6a479640 1 -- start start 2023-11-28T20:08:58.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.418+0000 7fda6a479640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda64071d90 0x7fda64072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.418+0000 7fda6a479640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fda6413f5f0 0x7fda640ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.418+0000 7fda6a479640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6413d2b0 con 0x7fda6415adb0 2023-11-28T20:08:58.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.418+0000 7fda6a479640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda64140520 con 0x7fda6413f5f0 2023-11-28T20:08:58.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.418+0000 7fda6a479640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda640cd7f0 con 0x7fda64071d90 2023-11-28T20:08:58.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.418+0000 7fda63fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda64071d90 0x7fda64072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.418+0000 7fda63fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda64071d90 0x7fda64072170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:45310/0 (socket says 172.21.15.177:45310) 2023-11-28T20:08:58.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.418+0000 7fda63fff640 1 -- 172.21.15.177:0/2623589910 learned_addr learned my addr 172.21.15.177:0/2623589910 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:58.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.418+0000 7fda637fe640 1 --1- 172.21.15.177:0/2623589910 >> v1:172.21.15.195:6789/0 conn(0x7fda6415adb0 0x7fda6413d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:40214/0 (socket says 172.21.15.177:40214) 2023-11-28T20:08:58.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.418+0000 7fda68a16640 1 --2- 172.21.15.177:0/2623589910 >> v2:172.21.15.195:3300/0 conn(0x7fda6413f5f0 0x7fda640ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.422+0000 7fda63fff640 1 -- 172.21.15.177:0/2623589910 >> v2:172.21.15.195:3300/0 conn(0x7fda6413f5f0 msgr2=0x7fda640ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:58.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.422+0000 7fda63fff640 1 --2- 172.21.15.177:0/2623589910 >> v2:172.21.15.195:3300/0 conn(0x7fda6413f5f0 0x7fda640ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.422+0000 7fda63fff640 1 -- 172.21.15.177:0/2623589910 >> v1:172.21.15.195:6789/0 conn(0x7fda6415adb0 legacy=0x7fda6413d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.422+0000 7fda63fff640 1 -- 172.21.15.177:0/2623589910 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda640cdd70 con 0x7fda64071d90 2023-11-28T20:08:58.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.422+0000 7fda68a16640 1 --2- 172.21.15.177:0/2623589910 >> v2:172.21.15.195:3300/0 conn(0x7fda6413f5f0 0x7fda640ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:58.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.422+0000 7fda63fff640 1 --2- 172.21.15.177:0/2623589910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda64071d90 0x7fda64072170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fda54009870 tx=0x7fda5401e750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6e443acaca0e665 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:58.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.422+0000 7fda62ffd640 1 -- 172.21.15.177:0/2623589910 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda540a8620 con 0x7fda64071d90 2023-11-28T20:08:58.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.422+0000 7fda62ffd640 1 -- 172.21.15.177:0/2623589910 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda540a8780 con 0x7fda64071d90 2023-11-28T20:08:58.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.422+0000 7fda62ffd640 1 -- 172.21.15.177:0/2623589910 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda540a8b10 con 0x7fda64071d90 2023-11-28T20:08:58.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 -- 172.21.15.177:0/2623589910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda64071d90 msgr2=0x7fda64072170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 --2- 172.21.15.177:0/2623589910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda64071d90 0x7fda64072170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fda54009870 tx=0x7fda5401e750 comp rx=0 tx=0).stop 2023-11-28T20:08:58.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 -- 172.21.15.177:0/2623589910 shutdown_connections 2023-11-28T20:08:58.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 --2- 172.21.15.177:0/2623589910 >> v2:172.21.15.195:3300/0 conn(0x7fda6413f5f0 0x7fda640ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 --2- 172.21.15.177:0/2623589910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda64071d90 0x7fda64072170 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 -- 172.21.15.177:0/2623589910 >> 172.21.15.177:0/2623589910 conn(0x7fda640b0cc0 msgr2=0x7fda640b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:58.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 -- 172.21.15.177:0/2623589910 shutdown_connections 2023-11-28T20:08:58.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 -- 172.21.15.177:0/2623589910 wait complete. 2023-11-28T20:08:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 Processor -- start 2023-11-28T20:08:58.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 -- start start 2023-11-28T20:08:58.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda64071d90 0x7fda640b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6413f5f0 0x7fda6413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6415adb0 0x7fda64134e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda64143110 con 0x7fda64071d90 2023-11-28T20:08:58.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda640b2790 con 0x7fda6413f5f0 2023-11-28T20:08:58.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda6a479640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda640b29a0 con 0x7fda6415adb0 2023-11-28T20:08:58.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda63fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda64071d90 0x7fda640b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda63fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda64071d90 0x7fda640b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56108/0 (socket says 172.21.15.177:56108) 2023-11-28T20:08:58.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda63fff640 1 -- 172.21.15.177:0/3740868388 learned_addr learned my addr 172.21.15.177:0/3740868388 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:58.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda68a16640 1 --2- 172.21.15.177:0/3740868388 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6415adb0 0x7fda64134e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.426+0000 7fda637fe640 1 --2- 172.21.15.177:0/3740868388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6413f5f0 0x7fda6413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda63fff640 1 -- 172.21.15.177:0/3740868388 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6415adb0 msgr2=0x7fda64134e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda63fff640 1 --2- 172.21.15.177:0/3740868388 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6415adb0 0x7fda64134e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda63fff640 1 -- 172.21.15.177:0/3740868388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6413f5f0 msgr2=0x7fda6413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda63fff640 1 --2- 172.21.15.177:0/3740868388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6413f5f0 0x7fda6413ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda63fff640 1 -- 172.21.15.177:0/3740868388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c009a70 con 0x7fda64071d90 2023-11-28T20:08:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda63fff640 1 --2- 172.21.15.177:0/3740868388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda64071d90 0x7fda640b44b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fda5401ce00 tx=0x7fda5401b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda60ff9640 1 -- 172.21.15.177:0/3740868388 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda540a9890 con 0x7fda64071d90 2023-11-28T20:08:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda60ff9640 1 -- 172.21.15.177:0/3740868388 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda540a9a10 con 0x7fda64071d90 2023-11-28T20:08:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda6a479640 1 -- 172.21.15.177:0/3740868388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda540094d0 con 0x7fda64071d90 2023-11-28T20:08:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda60ff9640 1 -- 172.21.15.177:0/3740868388 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda540a9dc0 con 0x7fda64071d90 2023-11-28T20:08:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda6a479640 1 -- 172.21.15.177:0/3740868388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda64135ad0 con 0x7fda64071d90 2023-11-28T20:08:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda6a479640 1 -- 172.21.15.177:0/3740868388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6413dc00 con 0x7fda64071d90 2023-11-28T20:08:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda60ff9640 1 -- 172.21.15.177:0/3740868388 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fda540b3450 con 0x7fda64071d90 2023-11-28T20:08:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda60ff9640 1 --2- 172.21.15.177:0/3740868388 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fda50066470 0x7fda50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda60ff9640 1 -- 172.21.15.177:0/3740868388 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fda5411e550 con 0x7fda64071d90 2023-11-28T20:08:58.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.430+0000 7fda637fe640 1 --2- 172.21.15.177:0/3740868388 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fda50066470 0x7fda50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.434+0000 7fda637fe640 1 --2- 172.21.15.177:0/3740868388 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fda50066470 0x7fda50068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda6413c860 tx=0x7fda58007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:58.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.434+0000 7fda60ff9640 1 -- 172.21.15.177:0/3740868388 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fda540eb850 con 0x7fda64071d90 2023-11-28T20:08:58.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.590+0000 7fda6a479640 1 -- 172.21.15.177:0/3740868388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda640b3020 con 0x7fda64071d90 2023-11-28T20:08:58.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.590+0000 7fda60ff9640 1 -- 172.21.15.177:0/3740868388 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda540eee70 con 0x7fda64071d90 2023-11-28T20:08:58.592 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:08:58.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.590+0000 7fda6a479640 1 -- 172.21.15.177:0/3740868388 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fda50066470 msgr2=0x7fda50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.590+0000 7fda6a479640 1 --2- 172.21.15.177:0/3740868388 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fda50066470 0x7fda50068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda6413c860 tx=0x7fda58007e50 comp rx=0 tx=0).stop 2023-11-28T20:08:58.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.590+0000 7fda6a479640 1 -- 172.21.15.177:0/3740868388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda64071d90 msgr2=0x7fda640b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.590+0000 7fda6a479640 1 --2- 172.21.15.177:0/3740868388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda64071d90 0x7fda640b44b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fda5401ce00 tx=0x7fda5401b4f0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.590+0000 7fda6a479640 1 -- 172.21.15.177:0/3740868388 shutdown_connections 2023-11-28T20:08:58.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.590+0000 7fda6a479640 1 --2- 172.21.15.177:0/3740868388 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fda50066470 0x7fda50068930 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.590+0000 7fda6a479640 1 --2- 172.21.15.177:0/3740868388 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6415adb0 0x7fda64134e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.590+0000 7fda6a479640 1 --2- 172.21.15.177:0/3740868388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6413f5f0 0x7fda6413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.590+0000 7fda6a479640 1 --2- 172.21.15.177:0/3740868388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda64071d90 0x7fda640b44b0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.590+0000 7fda6a479640 1 -- 172.21.15.177:0/3740868388 >> 172.21.15.177:0/3740868388 conn(0x7fda640b0cc0 msgr2=0x7fda6413de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:58.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.594+0000 7fda6a479640 1 -- 172.21.15.177:0/3740868388 shutdown_connections 2023-11-28T20:08:58.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.594+0000 7fda6a479640 1 -- 172.21.15.177:0/3740868388 wait complete. 2023-11-28T20:08:58.614 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:08:58.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.754+0000 7fc98b90f640 1 Processor -- start 2023-11-28T20:08:58.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.754+0000 7fc98b90f640 1 -- start start 2023-11-28T20:08:58.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.754+0000 7fc98b90f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98414b1e0 0x7fc9840b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.754+0000 7fc98b90f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc9840b4350 0x7fc9840703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.754+0000 7fc98b90f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9840b1fc0 con 0x7fc98414abe0 2023-11-28T20:08:58.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.754+0000 7fc98b90f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9840b47e0 con 0x7fc9840b4350 2023-11-28T20:08:58.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.754+0000 7fc98b90f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc984166130 con 0x7fc98414b1e0 2023-11-28T20:08:58.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.754+0000 7fc989eac640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc9840b4350 0x7fc9840703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.754+0000 7fc989eac640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc9840b4350 0x7fc9840703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55500/0 (socket says 172.21.15.177:55500) 2023-11-28T20:08:58.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.754+0000 7fc989eac640 1 -- 172.21.15.177:0/2453523992 learned_addr learned my addr 172.21.15.177:0/2453523992 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:58.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.754+0000 7fc988eaa640 1 --2- 172.21.15.177:0/2453523992 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98414b1e0 0x7fc9840b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.754+0000 7fc989eac640 1 -- 172.21.15.177:0/2453523992 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98414b1e0 msgr2=0x7fc9840b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:58.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.754+0000 7fc989eac640 1 --2- 172.21.15.177:0/2453523992 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98414b1e0 0x7fc9840b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.754+0000 7fc989eac640 1 -- 172.21.15.177:0/2453523992 >> v1:172.21.15.195:6789/0 conn(0x7fc98414abe0 legacy=0x7fc984165a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.754+0000 7fc989eac640 1 -- 172.21.15.177:0/2453523992 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9840b2260 con 0x7fc9840b4350 2023-11-28T20:08:58.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.758+0000 7fc989eac640 1 --2- 172.21.15.177:0/2453523992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9840b4350 0x7fc9840703f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009870 tx=0x7fc97c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac9ae4d927fc0af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:58.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.758+0000 7fc97bfff640 1 -- 172.21.15.177:0/2453523992 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c0aa670 con 0x7fc9840b4350 2023-11-28T20:08:58.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.758+0000 7fc97bfff640 1 -- 172.21.15.177:0/2453523992 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c0aa7d0 con 0x7fc9840b4350 2023-11-28T20:08:58.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.758+0000 7fc97bfff640 1 -- 172.21.15.177:0/2453523992 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c0aab60 con 0x7fc9840b4350 2023-11-28T20:08:58.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.758+0000 7fc98b90f640 1 -- 172.21.15.177:0/2453523992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9840b4350 msgr2=0x7fc9840703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.758+0000 7fc98b90f640 1 --2- 172.21.15.177:0/2453523992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9840b4350 0x7fc9840703f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009870 tx=0x7fc97c01c510 comp rx=0 tx=0).stop 2023-11-28T20:08:58.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.758+0000 7fc98b90f640 1 -- 172.21.15.177:0/2453523992 shutdown_connections 2023-11-28T20:08:58.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.758+0000 7fc98b90f640 1 --2- 172.21.15.177:0/2453523992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9840b4350 0x7fc9840703f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.758+0000 7fc98b90f640 1 --2- 172.21.15.177:0/2453523992 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98414b1e0 0x7fc9840b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.758+0000 7fc98b90f640 1 -- 172.21.15.177:0/2453523992 >> 172.21.15.177:0/2453523992 conn(0x7fc9840b0cc0 msgr2=0x7fc9840b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:58.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.758+0000 7fc98b90f640 1 -- 172.21.15.177:0/2453523992 shutdown_connections 2023-11-28T20:08:58.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.758+0000 7fc98b90f640 1 -- 172.21.15.177:0/2453523992 wait complete. 2023-11-28T20:08:58.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc98b90f640 1 Processor -- start 2023-11-28T20:08:58.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc98b90f640 1 -- start start 2023-11-28T20:08:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc98b90f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9840b4350 0x7fc98415cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc98b90f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98414abe0 0x7fc98415bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc98b90f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc984145800 0x7fc984145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc98b90f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc984146bb0 con 0x7fc9840b4350 2023-11-28T20:08:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc98b90f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc984146310 con 0x7fc984145800 2023-11-28T20:08:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc98b90f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9841465f0 con 0x7fc98414abe0 2023-11-28T20:08:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc9896ab640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9840b4350 0x7fc98415cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc9896ab640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9840b4350 0x7fc98415cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55504/0 (socket says 172.21.15.177:55504) 2023-11-28T20:08:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc9896ab640 1 -- 172.21.15.177:0/2030904817 learned_addr learned my addr 172.21.15.177:0/2030904817 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc989eac640 1 --2- 172.21.15.177:0/2030904817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc984145800 0x7fc984145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc988eaa640 1 --2- 172.21.15.177:0/2030904817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98414abe0 0x7fc98415bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc9896ab640 1 -- 172.21.15.177:0/2030904817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98414abe0 msgr2=0x7fc98415bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc9896ab640 1 --2- 172.21.15.177:0/2030904817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98414abe0 0x7fc98415bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc9896ab640 1 -- 172.21.15.177:0/2030904817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc984145800 msgr2=0x7fc984145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc9896ab640 1 --2- 172.21.15.177:0/2030904817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc984145800 0x7fc984145c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc9896ab640 1 -- 172.21.15.177:0/2030904817 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c0094d0 con 0x7fc9840b4350 2023-11-28T20:08:58.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc988eaa640 1 --2- 172.21.15.177:0/2030904817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98414abe0 0x7fc98415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:58.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc9896ab640 1 --2- 172.21.15.177:0/2030904817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9840b4350 0x7fc98415cae0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc98000c7f0 tx=0x7fc98000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:58.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc979ffb640 1 -- 172.21.15.177:0/2030904817 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980003b80 con 0x7fc9840b4350 2023-11-28T20:08:58.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc979ffb640 1 -- 172.21.15.177:0/2030904817 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc980003ce0 con 0x7fc9840b4350 2023-11-28T20:08:58.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc979ffb640 1 -- 172.21.15.177:0/2030904817 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98000aa90 con 0x7fc9840b4350 2023-11-28T20:08:58.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc98b90f640 1 -- 172.21.15.177:0/2030904817 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9841468d0 con 0x7fc9840b4350 2023-11-28T20:08:58.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.762+0000 7fc98b90f640 1 -- 172.21.15.177:0/2030904817 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98415c200 con 0x7fc9840b4350 2023-11-28T20:08:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.766+0000 7fc98b90f640 1 -- 172.21.15.177:0/2030904817 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9840693d0 con 0x7fc9840b4350 2023-11-28T20:08:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.766+0000 7fc979ffb640 1 -- 172.21.15.177:0/2030904817 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc98000abf0 con 0x7fc9840b4350 2023-11-28T20:08:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.766+0000 7fc979ffb640 1 --2- 172.21.15.177:0/2030904817 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc968066470 0x7fc968068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.766+0000 7fc979ffb640 1 -- 172.21.15.177:0/2030904817 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fc980083db0 con 0x7fc9840b4350 2023-11-28T20:08:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.766+0000 7fc988eaa640 1 --2- 172.21.15.177:0/2030904817 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc968066470 0x7fc968068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.766+0000 7fc988eaa640 1 --2- 172.21.15.177:0/2030904817 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc968066470 0x7fc968068930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc984147400 tx=0x7fc974008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:58.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.770+0000 7fc979ffb640 1 -- 172.21.15.177:0/2030904817 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc980051130 con 0x7fc9840b4350 2023-11-28T20:08:58.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.922+0000 7fc98b90f640 1 -- 172.21.15.177:0/2030904817 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9841422c0 con 0x7fc9840b4350 2023-11-28T20:08:58.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.922+0000 7fc979ffb640 1 -- 172.21.15.177:0/2030904817 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc980054750 con 0x7fc9840b4350 2023-11-28T20:08:58.923 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:58.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.922+0000 7fc98b90f640 1 -- 172.21.15.177:0/2030904817 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc968066470 msgr2=0x7fc968068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.922+0000 7fc98b90f640 1 --2- 172.21.15.177:0/2030904817 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc968066470 0x7fc968068930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc984147400 tx=0x7fc974008040 comp rx=0 tx=0).stop 2023-11-28T20:08:58.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.922+0000 7fc98b90f640 1 -- 172.21.15.177:0/2030904817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9840b4350 msgr2=0x7fc98415cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:58.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.922+0000 7fc98b90f640 1 --2- 172.21.15.177:0/2030904817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9840b4350 0x7fc98415cae0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc98000c7f0 tx=0x7fc98000ccb0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.922+0000 7fc98b90f640 1 -- 172.21.15.177:0/2030904817 shutdown_connections 2023-11-28T20:08:58.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.922+0000 7fc98b90f640 1 --2- 172.21.15.177:0/2030904817 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc968066470 0x7fc968068930 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.922+0000 7fc98b90f640 1 --2- 172.21.15.177:0/2030904817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc984145800 0x7fc984145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.922+0000 7fc98b90f640 1 --2- 172.21.15.177:0/2030904817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98414abe0 0x7fc98415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.922+0000 7fc98b90f640 1 --2- 172.21.15.177:0/2030904817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9840b4350 0x7fc98415cae0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:58.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.922+0000 7fc98b90f640 1 -- 172.21.15.177:0/2030904817 >> 172.21.15.177:0/2030904817 conn(0x7fc9840b0cc0 msgr2=0x7fc984162d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:58.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.922+0000 7fc98b90f640 1 -- 172.21.15.177:0/2030904817 shutdown_connections 2023-11-28T20:08:58.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:58.922+0000 7fc98b90f640 1 -- 172.21.15.177:0/2030904817 wait complete. 2023-11-28T20:08:58.944 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:08:59.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.082+0000 7fb33d7aa640 1 Processor -- start 2023-11-28T20:08:59.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.082+0000 7fb33d7aa640 1 -- start start 2023-11-28T20:08:59.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.082+0000 7fb33d7aa640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb33815adb0 0x7fb33813d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.082+0000 7fb33d7aa640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33813d2b0 con 0x7fb33813f5f0 2023-11-28T20:08:59.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.082+0000 7fb33d7aa640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3380cdd70 con 0x7fb338071d90 2023-11-28T20:08:59.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.082+0000 7fb33d7aa640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb338140520 con 0x7fb33815adb0 2023-11-28T20:08:59.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.086+0000 7fb336ffd640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb338071d90 0x7fb338072170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:36888/0 (socket says 172.21.15.177:36888) 2023-11-28T20:08:59.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.086+0000 7fb336ffd640 1 -- 172.21.15.177:0/3802150654 learned_addr learned my addr 172.21.15.177:0/3802150654 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:59.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.086+0000 7fb3377fe640 1 --1- 172.21.15.177:0/3802150654 >> v1:172.21.15.177:6789/0 conn(0x7fb33813f5f0 0x7fb3380ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:39506/0 (socket says 172.21.15.177:39506) 2023-11-28T20:08:59.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.086+0000 7fb32e7fc640 1 --2- 172.21.15.177:0/3802150654 >> v2:172.21.15.195:3300/0 conn(0x7fb33815adb0 0x7fb33813d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.086+0000 7fb3367fc640 1 -- 172.21.15.177:0/3802150654 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121092340 0 0) 0x7fb3380cdd70 con 0x7fb338071d90 2023-11-28T20:08:59.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.086+0000 7fb3367fc640 1 -- 172.21.15.177:0/3802150654 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb324003530 con 0x7fb338071d90 2023-11-28T20:08:59.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.086+0000 7fb3367fc640 1 -- 172.21.15.177:0/3802150654 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901651293 0 0) 0x7fb33813d2b0 con 0x7fb33813f5f0 2023-11-28T20:08:59.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.086+0000 7fb3367fc640 1 -- 172.21.15.177:0/3802150654 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3380cdd70 con 0x7fb33813f5f0 2023-11-28T20:08:59.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.086+0000 7fb32e7fc640 1 -- 172.21.15.177:0/3802150654 >> v1:172.21.15.195:6789/0 conn(0x7fb338071d90 legacy=0x7fb338072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.086+0000 7fb32e7fc640 1 -- 172.21.15.177:0/3802150654 >> v1:172.21.15.177:6789/0 conn(0x7fb33813f5f0 legacy=0x7fb3380ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.086+0000 7fb32e7fc640 1 -- 172.21.15.177:0/3802150654 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33813ff60 con 0x7fb33815adb0 2023-11-28T20:08:59.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.086+0000 7fb32e7fc640 1 --2- 172.21.15.177:0/3802150654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb33815adb0 0x7fb33813d560 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb3280097c0 tx=0x7fb32801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=386a01fd8daa08f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:59.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb3367fc640 1 -- 172.21.15.177:0/3802150654 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3280ab600 con 0x7fb33815adb0 2023-11-28T20:08:59.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb3367fc640 1 -- 172.21.15.177:0/3802150654 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3280a7050 con 0x7fb33815adb0 2023-11-28T20:08:59.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb3367fc640 1 -- 172.21.15.177:0/3802150654 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3280ab980 con 0x7fb33815adb0 2023-11-28T20:08:59.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb33d7aa640 1 -- 172.21.15.177:0/3802150654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb33815adb0 msgr2=0x7fb33813d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb33d7aa640 1 --2- 172.21.15.177:0/3802150654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb33815adb0 0x7fb33813d560 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb3280097c0 tx=0x7fb32801c480 comp rx=0 tx=0).stop 2023-11-28T20:08:59.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb33d7aa640 1 -- 172.21.15.177:0/3802150654 shutdown_connections 2023-11-28T20:08:59.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb33d7aa640 1 --2- 172.21.15.177:0/3802150654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb33815adb0 0x7fb33813d560 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb33d7aa640 1 -- 172.21.15.177:0/3802150654 >> 172.21.15.177:0/3802150654 conn(0x7fb3380b0cc0 msgr2=0x7fb3380b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:59.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb33d7aa640 1 -- 172.21.15.177:0/3802150654 shutdown_connections 2023-11-28T20:08:59.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb33d7aa640 1 -- 172.21.15.177:0/3802150654 wait complete. 2023-11-28T20:08:59.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb33d7aa640 1 Processor -- start 2023-11-28T20:08:59.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb33d7aa640 1 -- start start 2023-11-28T20:08:59.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb33d7aa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb338071d90 0x7fb3380a9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb33d7aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb33813f5f0 0x7fb3381f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb33d7aa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb33815adb0 0x7fb3380b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb33d7aa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3380b4ed0 con 0x7fb33815adb0 2023-11-28T20:08:59.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb33d7aa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3380b4350 con 0x7fb338071d90 2023-11-28T20:08:59.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.090+0000 7fb33d7aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3380b4630 con 0x7fb33813f5f0 2023-11-28T20:08:59.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb336ffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb338071d90 0x7fb3380a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb3377fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb33815adb0 0x7fb3380b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb336ffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb338071d90 0x7fb3380a9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:43788/0 (socket says 172.21.15.177:43788) 2023-11-28T20:08:59.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb336ffd640 1 -- 172.21.15.177:0/4138856002 learned_addr learned my addr 172.21.15.177:0/4138856002 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:59.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb32e7fc640 1 --2- 172.21.15.177:0/4138856002 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb33813f5f0 0x7fb3381f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb336ffd640 1 -- 172.21.15.177:0/4138856002 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb33813f5f0 msgr2=0x7fb3381f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb336ffd640 1 --2- 172.21.15.177:0/4138856002 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb33813f5f0 0x7fb3381f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb336ffd640 1 -- 172.21.15.177:0/4138856002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb33815adb0 msgr2=0x7fb3380b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb336ffd640 1 --2- 172.21.15.177:0/4138856002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb33815adb0 0x7fb3380b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb336ffd640 1 -- 172.21.15.177:0/4138856002 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb328009420 con 0x7fb338071d90 2023-11-28T20:08:59.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb336ffd640 1 --2- 172.21.15.177:0/4138856002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb338071d90 0x7fb3380a9620 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb32000c4d0 tx=0x7fb32000c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:59.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb32ffff640 1 -- 172.21.15.177:0/4138856002 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb320005cf0 con 0x7fb338071d90 2023-11-28T20:08:59.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb32ffff640 1 -- 172.21.15.177:0/4138856002 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb320005e50 con 0x7fb338071d90 2023-11-28T20:08:59.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb32ffff640 1 -- 172.21.15.177:0/4138856002 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb320007270 con 0x7fb338071d90 2023-11-28T20:08:59.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb33d7aa640 1 -- 172.21.15.177:0/4138856002 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3380b4910 con 0x7fb338071d90 2023-11-28T20:08:59.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb33d7aa640 1 -- 172.21.15.177:0/4138856002 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3380b3fd0 con 0x7fb338071d90 2023-11-28T20:08:59.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb33d7aa640 1 -- 172.21.15.177:0/4138856002 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3380693d0 con 0x7fb338071d90 2023-11-28T20:08:59.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb32ffff640 1 -- 172.21.15.177:0/4138856002 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb3200073d0 con 0x7fb338071d90 2023-11-28T20:08:59.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb32ffff640 1 --2- 172.21.15.177:0/4138856002 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb318066470 0x7fb318068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.094+0000 7fb32ffff640 1 -- 172.21.15.177:0/4138856002 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fb320083530 con 0x7fb338071d90 2023-11-28T20:08:59.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.098+0000 7fb32e7fc640 1 --2- 172.21.15.177:0/4138856002 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb318066470 0x7fb318068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.098+0000 7fb32e7fc640 1 --2- 172.21.15.177:0/4138856002 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb318066470 0x7fb318068930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb3280ad000 tx=0x7fb328008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:59.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.098+0000 7fb32ffff640 1 -- 172.21.15.177:0/4138856002 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3200508c0 con 0x7fb338071d90 2023-11-28T20:08:59.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.250+0000 7fb33d7aa640 1 -- 172.21.15.177:0/4138856002 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3381f32c0 con 0x7fb338071d90 2023-11-28T20:08:59.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.250+0000 7fb32ffff640 1 -- 172.21.15.177:0/4138856002 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb320053ee0 con 0x7fb338071d90 2023-11-28T20:08:59.252 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:08:59.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.250+0000 7fb33d7aa640 1 -- 172.21.15.177:0/4138856002 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb318066470 msgr2=0x7fb318068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.250+0000 7fb33d7aa640 1 --2- 172.21.15.177:0/4138856002 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb318066470 0x7fb318068930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb3280ad000 tx=0x7fb328008040 comp rx=0 tx=0).stop 2023-11-28T20:08:59.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.250+0000 7fb33d7aa640 1 -- 172.21.15.177:0/4138856002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb338071d90 msgr2=0x7fb3380a9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.250+0000 7fb33d7aa640 1 --2- 172.21.15.177:0/4138856002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb338071d90 0x7fb3380a9620 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb32000c4d0 tx=0x7fb32000c990 comp rx=0 tx=0).stop 2023-11-28T20:08:59.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.250+0000 7fb33d7aa640 1 -- 172.21.15.177:0/4138856002 shutdown_connections 2023-11-28T20:08:59.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.250+0000 7fb33d7aa640 1 --2- 172.21.15.177:0/4138856002 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb318066470 0x7fb318068930 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.250+0000 7fb33d7aa640 1 --2- 172.21.15.177:0/4138856002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb33815adb0 0x7fb3380b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.250+0000 7fb33d7aa640 1 --2- 172.21.15.177:0/4138856002 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb33813f5f0 0x7fb3381f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.250+0000 7fb33d7aa640 1 --2- 172.21.15.177:0/4138856002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb338071d90 0x7fb3380a9620 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.250+0000 7fb33d7aa640 1 -- 172.21.15.177:0/4138856002 >> 172.21.15.177:0/4138856002 conn(0x7fb3380b0cc0 msgr2=0x7fb33813c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:59.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.254+0000 7fb33d7aa640 1 -- 172.21.15.177:0/4138856002 shutdown_connections 2023-11-28T20:08:59.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.254+0000 7fb33d7aa640 1 -- 172.21.15.177:0/4138856002 wait complete. 2023-11-28T20:08:59.274 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-11-28T20:08:59.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bf590f640 1 Processor -- start 2023-11-28T20:08:59.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bf590f640 1 -- start start 2023-11-28T20:08:59.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bf590f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2bf015d2b0 0x7f2bf00d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bf590f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bf00d1cf0 0x7f2bf00cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bf590f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf00aff30 con 0x7f2bf015d690 2023-11-28T20:08:59.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bf590f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf00b01d0 con 0x7f2bf015d2b0 2023-11-28T20:08:59.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bf590f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf00b04b0 con 0x7f2bf00d1cf0 2023-11-28T20:08:59.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bef7fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f2bf015d690 0x7f2bf00cdd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:39510/0 (socket says 172.21.15.177:39510) 2023-11-28T20:08:59.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bef7fe640 1 -- 172.21.15.177:0/2949471890 learned_addr learned my addr 172.21.15.177:0/2949471890 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:59.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2beeffd640 1 --2- 172.21.15.177:0/2949471890 >> v2:172.21.15.195:3300/0 conn(0x7f2bf015d2b0 0x7f2bf00d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bee7fc640 1 --2- 172.21.15.177:0/2949471890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bf00d1cf0 0x7f2bf00cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bedffb640 1 -- 172.21.15.177:0/2949471890 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341357125 0 0) 0x7f2bf00aff30 con 0x7f2bf015d690 2023-11-28T20:08:59.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bedffb640 1 -- 172.21.15.177:0/2949471890 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bd8003530 con 0x7f2bf015d690 2023-11-28T20:08:59.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bee7fc640 1 -- 172.21.15.177:0/2949471890 >> v2:172.21.15.195:3300/0 conn(0x7f2bf015d2b0 msgr2=0x7f2bf00d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:59.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bee7fc640 1 --2- 172.21.15.177:0/2949471890 >> v2:172.21.15.195:3300/0 conn(0x7f2bf015d2b0 0x7f2bf00d17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bee7fc640 1 -- 172.21.15.177:0/2949471890 >> v1:172.21.15.177:6789/0 conn(0x7f2bf015d690 legacy=0x7f2bf00cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2bee7fc640 1 -- 172.21.15.177:0/2949471890 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf00b0790 con 0x7f2bf00d1cf0 2023-11-28T20:08:59.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.414+0000 7f2beeffd640 1 --2- 172.21.15.177:0/2949471890 >> v2:172.21.15.195:3300/0 conn(0x7f2bf015d2b0 0x7f2bf00d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:59.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.418+0000 7f2bee7fc640 1 --2- 172.21.15.177:0/2949471890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bf00d1cf0 0x7f2bf00cfbe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2be40097c0 tx=0x7f2be401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dea4aceea03e9f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:59.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.418+0000 7f2bedffb640 1 -- 172.21.15.177:0/2949471890 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be40ab620 con 0x7f2bf00d1cf0 2023-11-28T20:08:59.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.418+0000 7f2bedffb640 1 -- 172.21.15.177:0/2949471890 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be40ab780 con 0x7f2bf00d1cf0 2023-11-28T20:08:59.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.418+0000 7f2bedffb640 1 -- 172.21.15.177:0/2949471890 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be40abb10 con 0x7f2bf00d1cf0 2023-11-28T20:08:59.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.418+0000 7f2bf590f640 1 -- 172.21.15.177:0/2949471890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bf00d1cf0 msgr2=0x7f2bf00cfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.418+0000 7f2bf590f640 1 --2- 172.21.15.177:0/2949471890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bf00d1cf0 0x7f2bf00cfbe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2be40097c0 tx=0x7f2be401c480 comp rx=0 tx=0).stop 2023-11-28T20:08:59.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.418+0000 7f2bf590f640 1 -- 172.21.15.177:0/2949471890 shutdown_connections 2023-11-28T20:08:59.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.418+0000 7f2bf590f640 1 --2- 172.21.15.177:0/2949471890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bf00d1cf0 0x7f2bf00cfbe0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.418+0000 7f2bf590f640 1 --2- 172.21.15.177:0/2949471890 >> v2:172.21.15.195:3300/0 conn(0x7f2bf015d2b0 0x7f2bf00d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.418+0000 7f2bf590f640 1 -- 172.21.15.177:0/2949471890 >> 172.21.15.177:0/2949471890 conn(0x7f2bf009c510 msgr2=0x7f2bf00d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:59.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.418+0000 7f2bf590f640 1 -- 172.21.15.177:0/2949471890 shutdown_connections 2023-11-28T20:08:59.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.418+0000 7f2bf590f640 1 -- 172.21.15.177:0/2949471890 wait complete. 2023-11-28T20:08:59.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bf590f640 1 Processor -- start 2023-11-28T20:08:59.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bf590f640 1 -- start start 2023-11-28T20:08:59.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bf590f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bf00d1cf0 0x7f2bf0153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bf590f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bf015d2b0 0x7f2bf00c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bf590f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bf015d690 0x7f2bf00c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bf590f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf015b5e0 con 0x7f2bf015d2b0 2023-11-28T20:08:59.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bf590f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf015b8c0 con 0x7f2bf00d1cf0 2023-11-28T20:08:59.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bf590f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf015bba0 con 0x7f2bf015d690 2023-11-28T20:08:59.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bee7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bf015d2b0 0x7f2bf00c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bee7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bf015d2b0 0x7f2bf00c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55526/0 (socket says 172.21.15.177:55526) 2023-11-28T20:08:59.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bee7fc640 1 -- 172.21.15.177:0/1415102502 learned_addr learned my addr 172.21.15.177:0/1415102502 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:59.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2beeffd640 1 --2- 172.21.15.177:0/1415102502 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bf00d1cf0 0x7f2bf0153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bef7fe640 1 --2- 172.21.15.177:0/1415102502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bf015d690 0x7f2bf00c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bee7fc640 1 -- 172.21.15.177:0/1415102502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bf015d690 msgr2=0x7f2bf00c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bee7fc640 1 --2- 172.21.15.177:0/1415102502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bf015d690 0x7f2bf00c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bee7fc640 1 -- 172.21.15.177:0/1415102502 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bf00d1cf0 msgr2=0x7f2bf0153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bee7fc640 1 --2- 172.21.15.177:0/1415102502 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bf00d1cf0 0x7f2bf0153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bee7fc640 1 -- 172.21.15.177:0/1415102502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be0009420 con 0x7f2bf015d2b0 2023-11-28T20:08:59.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bee7fc640 1 --2- 172.21.15.177:0/1415102502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bf015d2b0 0x7f2bf00c74f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2be40ad040 tx=0x7f2be401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:59.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bd7fff640 1 -- 172.21.15.177:0/1415102502 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be40abe40 con 0x7f2bf015d2b0 2023-11-28T20:08:59.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bd7fff640 1 -- 172.21.15.177:0/1415102502 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be40bf410 con 0x7f2bf015d2b0 2023-11-28T20:08:59.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bd7fff640 1 -- 172.21.15.177:0/1415102502 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be40bf7c0 con 0x7f2bf015d2b0 2023-11-28T20:08:59.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bf590f640 1 -- 172.21.15.177:0/1415102502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be4009420 con 0x7f2bf015d2b0 2023-11-28T20:08:59.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bf590f640 1 -- 172.21.15.177:0/1415102502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf015c160 con 0x7f2bf015d2b0 2023-11-28T20:08:59.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.422+0000 7f2bf590f640 1 -- 172.21.15.177:0/1415102502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf00679f0 con 0x7f2bf015d2b0 2023-11-28T20:08:59.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.426+0000 7f2bd7fff640 1 -- 172.21.15.177:0/1415102502 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2be40b5400 con 0x7f2bf015d2b0 2023-11-28T20:08:59.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.426+0000 7f2bd7fff640 1 --2- 172.21.15.177:0/1415102502 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2bdc066470 0x7f2bdc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.426+0000 7f2bd7fff640 1 -- 172.21.15.177:0/1415102502 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f2be411e430 con 0x7f2bf015d2b0 2023-11-28T20:08:59.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.426+0000 7f2beeffd640 1 --2- 172.21.15.177:0/1415102502 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2bdc066470 0x7f2bdc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.426+0000 7f2beeffd640 1 --2- 172.21.15.177:0/1415102502 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2bdc066470 0x7f2bdc068930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2be0009cf0 tx=0x7f2be0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:59.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.430+0000 7f2bd7fff640 1 -- 172.21.15.177:0/1415102502 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2be40eb860 con 0x7f2bf015d2b0 2023-11-28T20:08:59.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.582+0000 7f2bf590f640 1 -- 172.21.15.177:0/1415102502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f2bf015c350 con 0x7f2bf015d2b0 2023-11-28T20:08:59.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.582+0000 7f2bd7fff640 1 -- 172.21.15.177:0/1415102502 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v36) v1 ==== 97+0+11 (secure 0 0 0) 0x7f2be40eee80 con 0x7f2bf015d2b0 2023-11-28T20:08:59.585 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:08:59.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.582+0000 7f2bf590f640 1 -- 172.21.15.177:0/1415102502 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2bdc066470 msgr2=0x7f2bdc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.582+0000 7f2bf590f640 1 --2- 172.21.15.177:0/1415102502 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2bdc066470 0x7f2bdc068930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2be0009cf0 tx=0x7f2be0009190 comp rx=0 tx=0).stop 2023-11-28T20:08:59.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.582+0000 7f2bf590f640 1 -- 172.21.15.177:0/1415102502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bf015d2b0 msgr2=0x7f2bf00c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.582+0000 7f2bf590f640 1 --2- 172.21.15.177:0/1415102502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bf015d2b0 0x7f2bf00c74f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2be40ad040 tx=0x7f2be401acc0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.582+0000 7f2bf590f640 1 -- 172.21.15.177:0/1415102502 shutdown_connections 2023-11-28T20:08:59.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.582+0000 7f2bf590f640 1 --2- 172.21.15.177:0/1415102502 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2bdc066470 0x7f2bdc068930 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.582+0000 7f2bf590f640 1 --2- 172.21.15.177:0/1415102502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bf015d690 0x7f2bf00c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.582+0000 7f2bf590f640 1 --2- 172.21.15.177:0/1415102502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bf015d2b0 0x7f2bf00c74f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.582+0000 7f2bf590f640 1 --2- 172.21.15.177:0/1415102502 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bf00d1cf0 0x7f2bf0153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.582+0000 7f2bf590f640 1 -- 172.21.15.177:0/1415102502 >> 172.21.15.177:0/1415102502 conn(0x7f2bf009c510 msgr2=0x7f2bf00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:59.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.582+0000 7f2bf590f640 1 -- 172.21.15.177:0/1415102502 shutdown_connections 2023-11-28T20:08:59.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.582+0000 7f2bf590f640 1 -- 172.21.15.177:0/1415102502 wait complete. 2023-11-28T20:08:59.605 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:08:59.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.742+0000 7f113f09c640 1 Processor -- start 2023-11-28T20:08:59.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.742+0000 7f113f09c640 1 -- start start 2023-11-28T20:08:59.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.742+0000 7f113f09c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f113813cf30 0x7f113806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.742+0000 7f113f09c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113815b3a0 con 0x7f113806c800 2023-11-28T20:08:59.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.742+0000 7f113f09c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113806cc40 con 0x7f113815ad40 2023-11-28T20:08:59.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.742+0000 7f113f09c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113813d310 con 0x7f113813cf30 2023-11-28T20:08:59.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.742+0000 7f112ffff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f113806c800 0x7f113815a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:39516/0 (socket says 172.21.15.177:39516) 2023-11-28T20:08:59.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.742+0000 7f112ffff640 1 -- 172.21.15.177:0/748930486 learned_addr learned my addr 172.21.15.177:0/748930486 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:08:59.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f113ce38640 1 --2- 172.21.15.177:0/748930486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f113813cf30 0x7f113806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777418284 0 0) 0x7f113815b3a0 con 0x7f113806c800 2023-11-28T20:08:59.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1120005740 con 0x7f113806c800 2023-11-28T20:08:59.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254273831 0 0) 0x7f113806cc40 con 0x7f113815ad40 2023-11-28T20:08:59.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f113815b3a0 con 0x7f113815ad40 2023-11-28T20:08:59.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 741474044 0 0) 0x7f1120005740 con 0x7f113806c800 2023-11-28T20:08:59.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f113813cf30 msgr2=0x7f113806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:59.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 --2- 172.21.15.177:0/748930486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f113813cf30 0x7f113806c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 >> v1:172.21.15.195:6789/0 conn(0x7f113815ad40 legacy=0x7f11380cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113813f720 con 0x7f113806c800 2023-11-28T20:08:59.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f1128001680 con 0x7f113806c800 2023-11-28T20:08:59.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 >> v1:172.21.15.177:6789/0 conn(0x7f113806c800 legacy=0x7f113815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 --2- 172.21.15.177:0/748930486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1120005d50 0x7f1120006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 --2- 172.21.15.177:0/748930486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f113813cf30 0x7f11200069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 --2- 172.21.15.177:0/748930486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1120006f20 0x7f11200073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112000dd30 con 0x7f1120006f20 2023-11-28T20:08:59.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112000de70 con 0x7f1120005d50 2023-11-28T20:08:59.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112000e000 con 0x7f113813cf30 2023-11-28T20:08:59.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f113d639640 1 --2- 172.21.15.177:0/748930486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1120006f20 0x7f11200073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f113ce38640 1 --2- 172.21.15.177:0/748930486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1120005d50 0x7f1120006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f112ffff640 1 --2- 172.21.15.177:0/748930486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f113813cf30 0x7f11200069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f113d639640 1 -- 172.21.15.177:0/748930486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f113813cf30 msgr2=0x7f11200069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:59.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f113d639640 1 --2- 172.21.15.177:0/748930486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f113813cf30 0x7f11200069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f113d639640 1 -- 172.21.15.177:0/748930486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1120005d50 msgr2=0x7f1120006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:08:59.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f113d639640 1 --2- 172.21.15.177:0/748930486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1120005d50 0x7f1120006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f113d639640 1 -- 172.21.15.177:0/748930486 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1120005740 con 0x7f1120006f20 2023-11-28T20:08:59.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.746+0000 7f113ce38640 1 --2- 172.21.15.177:0/748930486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1120005d50 0x7f1120006150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:08:59.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.750+0000 7f113d639640 1 --2- 172.21.15.177:0/748930486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1120006f20 0x7f11200073a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1130002000 tx=0x7f113001f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd025e2cd8edd45 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:59.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.750+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11300a8c70 con 0x7f1120006f20 2023-11-28T20:08:59.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.750+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11300a8df0 con 0x7f1120006f20 2023-11-28T20:08:59.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.750+0000 7f112f7fe640 1 -- 172.21.15.177:0/748930486 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130003bc0 con 0x7f1120006f20 2023-11-28T20:08:59.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.750+0000 7f113f09c640 1 -- 172.21.15.177:0/748930486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1120006f20 msgr2=0x7f11200073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.750+0000 7f113f09c640 1 --2- 172.21.15.177:0/748930486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1120006f20 0x7f11200073a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1130002000 tx=0x7f113001f050 comp rx=0 tx=0).stop 2023-11-28T20:08:59.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.750+0000 7f113d639640 1 -- 172.21.15.177:0/748930486 reap_dead start 2023-11-28T20:08:59.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.750+0000 7f113f09c640 1 -- 172.21.15.177:0/748930486 shutdown_connections 2023-11-28T20:08:59.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.750+0000 7f113f09c640 1 -- 172.21.15.177:0/748930486 >> 172.21.15.177:0/748930486 conn(0x7f113806a530 msgr2=0x7f113806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:59.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.750+0000 7f113f09c640 1 -- 172.21.15.177:0/748930486 shutdown_connections 2023-11-28T20:08:59.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.750+0000 7f113f09c640 1 -- 172.21.15.177:0/748930486 wait complete. 2023-11-28T20:08:59.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.750+0000 7f113f09c640 1 Processor -- start 2023-11-28T20:08:59.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.750+0000 7f113f09c640 1 -- start start 2023-11-28T20:08:59.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.750+0000 7f113f09c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1120006f20 0x7f11381eea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113f09c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11381386f0 0x7f1138159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113f09c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1138159a70 0x7f113813e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113f09c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11381eef70 con 0x7f1138159a70 2023-11-28T20:08:59.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113f09c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1138159f10 con 0x7f1120006f20 2023-11-28T20:08:59.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113f09c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113815a1f0 con 0x7f11381386f0 2023-11-28T20:08:59.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113d639640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1138159a70 0x7f113813e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113d639640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1138159a70 0x7f113813e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55534/0 (socket says 172.21.15.177:55534) 2023-11-28T20:08:59.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113d639640 1 -- 172.21.15.177:0/3478192519 learned_addr learned my addr 172.21.15.177:0/3478192519 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:08:59.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113ce38640 1 --2- 172.21.15.177:0/3478192519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1120006f20 0x7f11381eea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f112ffff640 1 --2- 172.21.15.177:0/3478192519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11381386f0 0x7f1138159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113d639640 1 -- 172.21.15.177:0/3478192519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11381386f0 msgr2=0x7f1138159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113d639640 1 --2- 172.21.15.177:0/3478192519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11381386f0 0x7f1138159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113d639640 1 -- 172.21.15.177:0/3478192519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1120006f20 msgr2=0x7f11381eea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113d639640 1 --2- 172.21.15.177:0/3478192519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1120006f20 0x7f11381eea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113d639640 1 -- 172.21.15.177:0/3478192519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138139430 con 0x7f1138159a70 2023-11-28T20:08:59.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f112ffff640 1 --2- 172.21.15.177:0/3478192519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11381386f0 0x7f1138159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:08:59.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113d639640 1 --2- 172.21.15.177:0/3478192519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1138159a70 0x7f113813e740 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1130005040 tx=0x7f1120007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:59.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f112d7fa640 1 -- 172.21.15.177:0/3478192519 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130003e80 con 0x7f1138159a70 2023-11-28T20:08:59.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f112d7fa640 1 -- 172.21.15.177:0/3478192519 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11300a8c70 con 0x7f1138159a70 2023-11-28T20:08:59.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f112d7fa640 1 -- 172.21.15.177:0/3478192519 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130006d60 con 0x7f1138159a70 2023-11-28T20:08:59.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113f09c640 1 -- 172.21.15.177:0/3478192519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1138139710 con 0x7f1138159a70 2023-11-28T20:08:59.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113f09c640 1 -- 172.21.15.177:0/3478192519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1138152200 con 0x7f1138159a70 2023-11-28T20:08:59.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f113f09c640 1 -- 172.21.15.177:0/3478192519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11381523f0 con 0x7f1138159a70 2023-11-28T20:08:59.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f112d7fa640 1 -- 172.21.15.177:0/3478192519 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1130005070 con 0x7f1138159a70 2023-11-28T20:08:59.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.754+0000 7f112d7fa640 1 --2- 172.21.15.177:0/3478192519 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1124066470 0x7f1124068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:08:59.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.758+0000 7f112d7fa640 1 -- 172.21.15.177:0/3478192519 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f1130120860 con 0x7f1138159a70 2023-11-28T20:08:59.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.758+0000 7f113ce38640 1 --2- 172.21.15.177:0/3478192519 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1124066470 0x7f1124068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:08:59.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.758+0000 7f113ce38640 1 --2- 172.21.15.177:0/3478192519 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1124066470 0x7f1124068930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f113813cbd0 tx=0x7f1134009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:08:59.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.762+0000 7f112d7fa640 1 -- 172.21.15.177:0/3478192519 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f11381523f0 con 0x7f1138159a70 2023-11-28T20:08:59.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.922+0000 7f113f09c640 1 -- 172.21.15.177:0/3478192519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f11381523f0 con 0x7f1138159a70 2023-11-28T20:08:59.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.922+0000 7f112d7fa640 1 -- 172.21.15.177:0/3478192519 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f11381523f0 con 0x7f1138159a70 2023-11-28T20:08:59.923 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:08:59.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.922+0000 7f113f09c640 1 -- 172.21.15.177:0/3478192519 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1124066470 msgr2=0x7f1124068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.922+0000 7f113f09c640 1 --2- 172.21.15.177:0/3478192519 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1124066470 0x7f1124068930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f113813cbd0 tx=0x7f1134009190 comp rx=0 tx=0).stop 2023-11-28T20:08:59.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.922+0000 7f113f09c640 1 -- 172.21.15.177:0/3478192519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1138159a70 msgr2=0x7f113813e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:08:59.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.922+0000 7f113f09c640 1 --2- 172.21.15.177:0/3478192519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1138159a70 0x7f113813e740 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1130005040 tx=0x7f1120007a10 comp rx=0 tx=0).stop 2023-11-28T20:08:59.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.922+0000 7f113f09c640 1 -- 172.21.15.177:0/3478192519 shutdown_connections 2023-11-28T20:08:59.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.922+0000 7f113f09c640 1 --2- 172.21.15.177:0/3478192519 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1124066470 0x7f1124068930 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.922+0000 7f113f09c640 1 --2- 172.21.15.177:0/3478192519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1138159a70 0x7f113813e740 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.922+0000 7f113f09c640 1 --2- 172.21.15.177:0/3478192519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11381386f0 0x7f1138159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.922+0000 7f113f09c640 1 --2- 172.21.15.177:0/3478192519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1120006f20 0x7f11381eea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:08:59.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.922+0000 7f113f09c640 1 -- 172.21.15.177:0/3478192519 >> 172.21.15.177:0/3478192519 conn(0x7f113806a530 msgr2=0x7f1138157370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:08:59.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.922+0000 7f113f09c640 1 -- 172.21.15.177:0/3478192519 shutdown_connections 2023-11-28T20:08:59.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:08:59.922+0000 7f113f09c640 1 -- 172.21.15.177:0/3478192519 wait complete. 2023-11-28T20:08:59.944 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-11-28T20:08:59.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:08:59.945 DEBUG:teuthology.orchestra.run.smithi177:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T20:08:59.963 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[49042]: fuse finished with error 0 and tester_r 0 2023-11-28T20:08:59.967 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:09:06.069 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:09:06.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:06.069 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T20:09:06.080 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:09:06.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb508faa640 1 Processor -- start 2023-11-28T20:09:06.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb508faa640 1 -- start start 2023-11-28T20:09:06.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb508faa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5040d2b10 0x7fb5040b6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:06.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb508faa640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb5040b51a0 0x7fb5040b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:06.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb508faa640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5040d0d70 con 0x7fb504160870 2023-11-28T20:09:06.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb508faa640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb504160c50 con 0x7fb5040b51a0 2023-11-28T20:09:06.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb508faa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040b5b50 con 0x7fb5040d2b10 2023-11-28T20:09:06.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb50259c640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb504160870 0x7fb5040cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:36904/0 (socket says 172.21.15.177:36904) 2023-11-28T20:09:06.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb501d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5040d2b10 0x7fb5040b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:06.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb50259c640 1 -- 172.21.15.177:0/3152827232 learned_addr learned my addr 172.21.15.177:0/3152827232 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:06.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb502d9d640 1 --2- 172.21.15.177:0/3152827232 >> v2:172.21.15.195:3300/0 conn(0x7fb5040b51a0 0x7fb5040b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:06.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb50159a640 1 -- 172.21.15.177:0/3152827232 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811317856 0 0) 0x7fb5040d0d70 con 0x7fb504160870 2023-11-28T20:09:06.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb50159a640 1 -- 172.21.15.177:0/3152827232 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4ec003530 con 0x7fb504160870 2023-11-28T20:09:06.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb501d9b640 1 -- 172.21.15.177:0/3152827232 >> v2:172.21.15.195:3300/0 conn(0x7fb5040b51a0 msgr2=0x7fb5040b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:06.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb501d9b640 1 --2- 172.21.15.177:0/3152827232 >> v2:172.21.15.195:3300/0 conn(0x7fb5040b51a0 0x7fb5040b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:06.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb501d9b640 1 -- 172.21.15.177:0/3152827232 >> v1:172.21.15.195:6789/0 conn(0x7fb504160870 legacy=0x7fb5040cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:06.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb501d9b640 1 -- 172.21.15.177:0/3152827232 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040d2f50 con 0x7fb5040d2b10 2023-11-28T20:09:06.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.274+0000 7fb502d9d640 1 --2- 172.21.15.177:0/3152827232 >> v2:172.21.15.195:3300/0 conn(0x7fb5040b51a0 0x7fb5040b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:09:06.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.278+0000 7fb501d9b640 1 --2- 172.21.15.177:0/3152827232 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5040d2b10 0x7fb5040b6230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80097c0 tx=0x7fb4f801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf0fb4a143fbac5b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:06.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.278+0000 7fb50159a640 1 -- 172.21.15.177:0/3152827232 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80ab600 con 0x7fb5040d2b10 2023-11-28T20:09:06.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.278+0000 7fb50159a640 1 -- 172.21.15.177:0/3152827232 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f80a7050 con 0x7fb5040d2b10 2023-11-28T20:09:06.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.278+0000 7fb50159a640 1 -- 172.21.15.177:0/3152827232 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80ab980 con 0x7fb5040d2b10 2023-11-28T20:09:06.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.278+0000 7fb508faa640 1 -- 172.21.15.177:0/3152827232 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5040d2b10 msgr2=0x7fb5040b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:06.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.278+0000 7fb508faa640 1 --2- 172.21.15.177:0/3152827232 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5040d2b10 0x7fb5040b6230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80097c0 tx=0x7fb4f801c480 comp rx=0 tx=0).stop 2023-11-28T20:09:06.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.278+0000 7fb508faa640 1 -- 172.21.15.177:0/3152827232 shutdown_connections 2023-11-28T20:09:06.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.278+0000 7fb508faa640 1 --2- 172.21.15.177:0/3152827232 >> v2:172.21.15.195:3300/0 conn(0x7fb5040b51a0 0x7fb5040b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:06.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.278+0000 7fb508faa640 1 --2- 172.21.15.177:0/3152827232 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5040d2b10 0x7fb5040b6230 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:06.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.278+0000 7fb508faa640 1 -- 172.21.15.177:0/3152827232 >> 172.21.15.177:0/3152827232 conn(0x7fb504072060 msgr2=0x7fb504072470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:06.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.278+0000 7fb508faa640 1 -- 172.21.15.177:0/3152827232 shutdown_connections 2023-11-28T20:09:06.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.278+0000 7fb508faa640 1 -- 172.21.15.177:0/3152827232 wait complete. 2023-11-28T20:09:06.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb508faa640 1 Processor -- start 2023-11-28T20:09:06.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb508faa640 1 -- start start 2023-11-28T20:09:06.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb508faa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5040b51a0 0x7fb50414ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:06.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb508faa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5040d2b10 0x7fb50415cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:06.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb508faa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb504160870 0x7fb50415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:06.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb508faa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb504152ef0 con 0x7fb5040d2b10 2023-11-28T20:09:06.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb508faa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5041525c0 con 0x7fb504160870 2023-11-28T20:09:06.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb508faa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5041528a0 con 0x7fb5040b51a0 2023-11-28T20:09:06.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb501d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5040d2b10 0x7fb50415cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:06.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb501d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5040d2b10 0x7fb50415cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55538/0 (socket says 172.21.15.177:55538) 2023-11-28T20:09:06.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb501d9b640 1 -- 172.21.15.177:0/2992241252 learned_addr learned my addr 172.21.15.177:0/2992241252 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:06.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb50259c640 1 --2- 172.21.15.177:0/2992241252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5040b51a0 0x7fb50414ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:06.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb502d9d640 1 --2- 172.21.15.177:0/2992241252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb504160870 0x7fb50415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:06.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb501d9b640 1 -- 172.21.15.177:0/2992241252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5040b51a0 msgr2=0x7fb50414ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:06.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb501d9b640 1 --2- 172.21.15.177:0/2992241252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5040b51a0 0x7fb50414ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:06.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb501d9b640 1 -- 172.21.15.177:0/2992241252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb504160870 msgr2=0x7fb50415d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:06.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb501d9b640 1 --2- 172.21.15.177:0/2992241252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb504160870 0x7fb50415d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:06.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb501d9b640 1 -- 172.21.15.177:0/2992241252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc009a70 con 0x7fb5040d2b10 2023-11-28T20:09:06.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb502d9d640 1 --2- 172.21.15.177:0/2992241252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb504160870 0x7fb50415d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:06.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb501d9b640 1 --2- 172.21.15.177:0/2992241252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5040d2b10 0x7fb50415cda0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80ae040 tx=0x7fb4f8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:06.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb4f2ffd640 1 -- 172.21.15.177:0/2992241252 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80b4430 con 0x7fb5040d2b10 2023-11-28T20:09:06.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb4f2ffd640 1 -- 172.21.15.177:0/2992241252 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f80b45b0 con 0x7fb5040d2b10 2023-11-28T20:09:06.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb508faa640 1 -- 172.21.15.177:0/2992241252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f8009420 con 0x7fb5040d2b10 2023-11-28T20:09:06.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb4f2ffd640 1 -- 172.21.15.177:0/2992241252 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80b4960 con 0x7fb5040d2b10 2023-11-28T20:09:06.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.282+0000 7fb508faa640 1 -- 172.21.15.177:0/2992241252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50415a900 con 0x7fb5040d2b10 2023-11-28T20:09:06.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.286+0000 7fb508faa640 1 -- 172.21.15.177:0/2992241252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb504069440 con 0x7fb5040d2b10 2023-11-28T20:09:06.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.286+0000 7fb4f2ffd640 1 -- 172.21.15.177:0/2992241252 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb4f80b2040 con 0x7fb5040d2b10 2023-11-28T20:09:06.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.286+0000 7fb4f2ffd640 1 --2- 172.21.15.177:0/2992241252 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb4e4066470 0x7fb4e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:06.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.286+0000 7fb4f2ffd640 1 -- 172.21.15.177:0/2992241252 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fb4f811df30 con 0x7fb5040d2b10 2023-11-28T20:09:06.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.286+0000 7fb50259c640 1 --2- 172.21.15.177:0/2992241252 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb4e4066470 0x7fb4e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:06.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.286+0000 7fb50259c640 1 --2- 172.21.15.177:0/2992241252 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb4e4066470 0x7fb4e4068930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40011f0 tx=0x7fb4f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:06.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.290+0000 7fb4f2ffd640 1 -- 172.21.15.177:0/2992241252 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4f80eb180 con 0x7fb5040d2b10 2023-11-28T20:09:06.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.474+0000 7fb508faa640 1 -- 172.21.15.177:0/2992241252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb5040d0ab0 con 0x7fb5040d2b10 2023-11-28T20:09:06.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.474+0000 7fb4f2ffd640 1 -- 172.21.15.177:0/2992241252 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+82 (secure 0 0 0) 0x7fb4f80b0070 con 0x7fb5040d2b10 2023-11-28T20:09:06.476 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2023-11-28T20:09:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.474+0000 7fb508faa640 1 -- 172.21.15.177:0/2992241252 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb4e4066470 msgr2=0x7fb4e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.474+0000 7fb508faa640 1 --2- 172.21.15.177:0/2992241252 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb4e4066470 0x7fb4e4068930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40011f0 tx=0x7fb4f4009040 comp rx=0 tx=0).stop 2023-11-28T20:09:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.474+0000 7fb508faa640 1 -- 172.21.15.177:0/2992241252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5040d2b10 msgr2=0x7fb50415cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.474+0000 7fb508faa640 1 --2- 172.21.15.177:0/2992241252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5040d2b10 0x7fb50415cda0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80ae040 tx=0x7fb4f8019220 comp rx=0 tx=0).stop 2023-11-28T20:09:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.474+0000 7fb508faa640 1 -- 172.21.15.177:0/2992241252 shutdown_connections 2023-11-28T20:09:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.474+0000 7fb508faa640 1 --2- 172.21.15.177:0/2992241252 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fb4e4066470 0x7fb4e4068930 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.474+0000 7fb508faa640 1 --2- 172.21.15.177:0/2992241252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb504160870 0x7fb50415d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.474+0000 7fb508faa640 1 --2- 172.21.15.177:0/2992241252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5040d2b10 0x7fb50415cda0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.474+0000 7fb508faa640 1 --2- 172.21.15.177:0/2992241252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5040b51a0 0x7fb50414ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:06.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.474+0000 7fb508faa640 1 -- 172.21.15.177:0/2992241252 >> 172.21.15.177:0/2992241252 conn(0x7fb504072060 msgr2=0x7fb5040b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:06.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.474+0000 7fb508faa640 1 -- 172.21.15.177:0/2992241252 shutdown_connections 2023-11-28T20:09:06.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:06.474+0000 7fb508faa640 1 -- 172.21.15.177:0/2992241252 wait complete. 2023-11-28T20:09:06.497 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T20:09:06.497 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:09:06.497 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-11-28T20:09:06.497 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T20:09:06.497 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:06.497 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T20:09:06.497 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T20:09:06.498 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:09:06.498 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:09:06.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:06.498 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-11-28T20:09:06.508 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:09:06.508 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:09:06.508 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:09:06.508 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:06.508 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-11-28T20:09:06.508 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:06.508 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:09:06.508 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:06.508 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-11-28T20:09:06.509 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:09:06.509 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:06.509 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-11-28T20:09:06.509 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:09:06.509 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:06.509 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:09:06.509 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:06.509 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:09:06.509 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42327sec preferred_lft 42327sec 2023-11-28T20:09:06.509 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-11-28T20:09:06.509 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:06.509 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:09:06.510 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:91:19:71:65 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:06.510 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:09:06.510 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:06.510 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:09:06.510 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:06.510 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:09:06.510 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:06.510 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:09:06.510 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:06.510 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:09:06.510 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:06.510 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:09:06.511 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:06.511 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:09:06.511 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:06.511 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-28T20:09:06.511 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:06.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:06.511 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:09:06.568 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-11-28T20:09:06.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:06.570 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-11-28T20:09:06.628 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-11-28T20:09:06.629 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:09:06.629 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:09:06.629 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:09:06.629 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:09:06.629 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:09:06.629 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:09:06.629 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:09:06.629 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:09:06.629 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:09:06.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:06.630 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-28T20:09:06.630 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-28T20:09:06.630 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:09:06.630 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:09:06.630 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:09:06.630 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-28T20:09:06.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:06.720 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-11-28T20:09:06.729 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T20:09:06.729 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T20:09:06.730 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:09:06.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:06.730 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-11-28T20:09:06.794 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T20:09:06.795 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:09:06.795 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:06.847 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:09:06.847 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:09:06.848 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:06.898 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:09:06.963 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:09:07.016 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:09:07.016 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:09:07.016 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:09:07.016 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:09:07.016 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:09:07.016 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:09:07.016 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:09:07.016 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:09:07.017 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:09:07.017 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:09:07.017 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:09:07.017 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:09:07.017 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:09:07.017 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:09:07.017 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:09:07.017 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:09:07.017 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:09:07.017 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:09:07.017 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:09:07.017 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:09:07.018 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:09:07.018 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:09:07.018 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:09:07.018 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:09:07.018 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:09:07.018 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:09:07.018 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:09:07.018 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:09:07.018 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:09:07.018 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:07.018 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:07.018 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:07.019 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:07.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:07.020 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:09:07.070 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T20:09:07.070 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T20:09:07.117 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:09:07.139 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:09:07.191 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:09:07.192 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:09:07.192 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:09:07.192 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:09:07.192 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:09:07.192 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:09:07.192 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:09:07.192 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:09:07.192 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:09:07.192 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:09:07.192 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:09:07.193 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:09:07.193 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:09:07.193 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:09:07.193 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:09:07.193 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:09:07.193 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:09:07.193 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:09:07.193 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:09:07.193 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:09:07.193 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:09:07.193 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:09:07.193 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:09:07.194 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:09:07.194 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:09:07.194 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:09:07.194 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:09:07.194 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:09:07.194 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:09:07.194 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:07.194 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:07.194 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:07.194 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:07.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:07.195 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:09:07.212 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-11-28T20:09:07.210+0000 7f5489645580 -1 init, newargv = 0x5610bb3e8e10 newargc=15 2023-11-28T20:09:07.213 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[49600]: starting ceph client 2023-11-28T20:09:07.219 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[49600]: starting fuse 2023-11-28T20:09:07.221 INFO:teuthology.orchestra.run.smithi177.stdout:43 2023-11-28T20:09:07.221 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T20:09:07.222 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-11-28T20:09:07.222 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-11-28T20:09:07.222 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-11-28T20:09:07.222 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-11-28T20:09:07.222 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-11-28T20:09:07.222 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:09:07.222 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-11-28T20:09:07.222 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T20:09:07.222 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-11-28T20:09:07.223 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T20:09:07.223 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:09:07.223 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-11-28T20:09:07.223 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-11-28T20:09:07.223 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-11-28T20:09:07.223 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-11-28T20:09:07.223 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:09:07.223 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-11-28T20:09:07.223 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T20:09:07.223 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T20:09:07.223 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T20:09:07.223 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-11-28T20:09:07.223 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-11-28T20:09:07.223 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-11-28T20:09:07.224 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T20:09:07.224 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:09:07.224 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-11-28T20:09:07.224 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-11-28T20:09:07.342 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.49600.asok 2023-11-28T20:09:07.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T20:09:07.353 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49600.asok 2023-11-28T20:09:07.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:07.353 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49600.asok status 2023-11-28T20:09:07.523 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:09:07.523 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-11-28T20:09:07.523 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T20:09:07.523 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T20:09:07.523 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-11-28T20:09:07.523 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-11-28T20:09:07.523 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T20:09:07.523 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "49600", 2023-11-28T20:09:07.524 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-11-28T20:09:07.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:07.524 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-11-28T20:09:07.524 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-11-28T20:09:07.524 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 5547, 2023-11-28T20:09:07.524 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-11-28T20:09:07.524 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-11-28T20:09:07.524 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-11-28T20:09:07.524 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 5547 2023-11-28T20:09:07.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:07.524 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:09:07.525 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:09:07.525 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:09:07.525 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3052786952 2023-11-28T20:09:07.525 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:07.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:07.525 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:09:07.525 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:09:07.525 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:09:07.525 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3052786952 2023-11-28T20:09:07.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:07.526 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.5547 192.168.0.1:0/3052786952", 2023-11-28T20:09:07.526 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/3052786952", 2023-11-28T20:09:07.526 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-11-28T20:09:07.526 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 18, 2023-11-28T20:09:07.526 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 36, 2023-11-28T20:09:07.526 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-11-28T20:09:07.526 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-11-28T20:09:07.526 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-11-28T20:09:07.526 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:09:07.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:07.538 DEBUG:teuthology.orchestra.run.smithi177:> stat --file-system '--printf=%T 2023-11-28T20:09:07.538 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:07.548 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-11-28T20:09:07.548 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:07.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:07.549 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:07.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:07.610 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-11-28T20:09:07.674 INFO:teuthology.orchestra.run.smithi177.stderr:setfattr: layoutfile: Permission denied 2023-11-28T20:09:07.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:09:07.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:07.676 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-11-28T20:09:07.728 INFO:teuthology.orchestra.run.smithi177.stderr:setfattr: layoutdir: Permission denied 2023-11-28T20:09:07.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:09:07.729 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:09:07.729 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:09:07.779 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:09:07.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfed957640 1 Processor -- start 2023-11-28T20:09:07.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfed957640 1 -- start start 2023-11-28T20:09:07.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfed957640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcfe815d090 0x7fcfe80716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:07.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfed957640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe80ad250 0x7fcfe80b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:07.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfed957640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcfe806b540 0x7fcfe806b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:07.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfed957640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe8071c10 con 0x7fcfe806b540 2023-11-28T20:09:07.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfed957640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe806bed0 con 0x7fcfe815d090 2023-11-28T20:09:07.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfed957640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80b3700 con 0x7fcfe80ad250 2023-11-28T20:09:07.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfe77fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcfe806b540 0x7fcfe806b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:07.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfe77fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcfe806b540 0x7fcfe806b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55554/0 (socket says 172.21.15.177:55554) 2023-11-28T20:09:07.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfe77fe640 1 -- 172.21.15.177:0/604167235 learned_addr learned my addr 172.21.15.177:0/604167235 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:07.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfe6ffd640 1 --2- 172.21.15.177:0/604167235 >> v2:172.21.15.195:3300/0 conn(0x7fcfe815d090 0x7fcfe80716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:07.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfde7fc640 1 --2- 172.21.15.177:0/604167235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe80ad250 0x7fcfe80b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:07.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfe77fe640 1 -- 172.21.15.177:0/604167235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe80ad250 msgr2=0x7fcfe80b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:07.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfe77fe640 1 --2- 172.21.15.177:0/604167235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe80ad250 0x7fcfe80b3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:07.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfe77fe640 1 -- 172.21.15.177:0/604167235 >> v2:172.21.15.195:3300/0 conn(0x7fcfe815d090 msgr2=0x7fcfe80716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:07.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfe77fe640 1 --2- 172.21.15.177:0/604167235 >> v2:172.21.15.195:3300/0 conn(0x7fcfe815d090 0x7fcfe80716d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:07.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.962+0000 7fcfe77fe640 1 -- 172.21.15.177:0/604167235 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe80b46e0 con 0x7fcfe806b540 2023-11-28T20:09:07.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.966+0000 7fcfe77fe640 1 --2- 172.21.15.177:0/604167235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe806b540 0x7fcfe806b990 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8074030 tx=0x7fcfe001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9728552bd5408950 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:07.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.966+0000 7fcfe67fc640 1 -- 172.21.15.177:0/604167235 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00ab600 con 0x7fcfe806b540 2023-11-28T20:09:07.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.966+0000 7fcfe67fc640 1 -- 172.21.15.177:0/604167235 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe00ab760 con 0x7fcfe806b540 2023-11-28T20:09:07.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.966+0000 7fcfe67fc640 1 -- 172.21.15.177:0/604167235 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00abaf0 con 0x7fcfe806b540 2023-11-28T20:09:07.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.966+0000 7fcfed957640 1 -- 172.21.15.177:0/604167235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe806b540 msgr2=0x7fcfe806b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:07.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.966+0000 7fcfed957640 1 --2- 172.21.15.177:0/604167235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe806b540 0x7fcfe806b990 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8074030 tx=0x7fcfe001c440 comp rx=0 tx=0).stop 2023-11-28T20:09:07.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.966+0000 7fcfed957640 1 -- 172.21.15.177:0/604167235 shutdown_connections 2023-11-28T20:09:07.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.966+0000 7fcfed957640 1 --2- 172.21.15.177:0/604167235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe806b540 0x7fcfe806b990 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:07.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.966+0000 7fcfed957640 1 --2- 172.21.15.177:0/604167235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe80ad250 0x7fcfe80b3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:07.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.966+0000 7fcfed957640 1 --2- 172.21.15.177:0/604167235 >> v2:172.21.15.195:3300/0 conn(0x7fcfe815d090 0x7fcfe80716d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:07.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.966+0000 7fcfed957640 1 -- 172.21.15.177:0/604167235 >> 172.21.15.177:0/604167235 conn(0x7fcfe8070bb0 msgr2=0x7fcfe8070fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:07.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.966+0000 7fcfed957640 1 -- 172.21.15.177:0/604167235 shutdown_connections 2023-11-28T20:09:07.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.966+0000 7fcfed957640 1 -- 172.21.15.177:0/604167235 wait complete. 2023-11-28T20:09:07.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.966+0000 7fcfed957640 1 Processor -- start 2023-11-28T20:09:07.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfed957640 1 -- start start 2023-11-28T20:09:07.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfed957640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfe806b540 0x7fcfe8160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:07.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfed957640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe80ad250 0x7fcfe815e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:07.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfed957640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe815d090 0x7fcfe80ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:07.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfed957640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8160660 con 0x7fcfe80ad250 2023-11-28T20:09:07.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfed957640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe806e340 con 0x7fcfe806b540 2023-11-28T20:09:07.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfed957640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8151ff0 con 0x7fcfe815d090 2023-11-28T20:09:07.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfde7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe80ad250 0x7fcfe815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:07.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfde7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe80ad250 0x7fcfe815e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55568/0 (socket says 172.21.15.177:55568) 2023-11-28T20:09:07.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfde7fc640 1 -- 172.21.15.177:0/3186502262 learned_addr learned my addr 172.21.15.177:0/3186502262 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:07.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfe6ffd640 1 --2- 172.21.15.177:0/3186502262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfe806b540 0x7fcfe8160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:07.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfe77fe640 1 --2- 172.21.15.177:0/3186502262 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe815d090 0x7fcfe80ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:07.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfde7fc640 1 -- 172.21.15.177:0/3186502262 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe815d090 msgr2=0x7fcfe80ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:07.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfde7fc640 1 --2- 172.21.15.177:0/3186502262 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe815d090 0x7fcfe80ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:07.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfde7fc640 1 -- 172.21.15.177:0/3186502262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfe806b540 msgr2=0x7fcfe8160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:07.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfde7fc640 1 --2- 172.21.15.177:0/3186502262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfe806b540 0x7fcfe8160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:07.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfde7fc640 1 -- 172.21.15.177:0/3186502262 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe00094d0 con 0x7fcfe80ad250 2023-11-28T20:09:07.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfe77fe640 1 --2- 172.21.15.177:0/3186502262 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe815d090 0x7fcfe80ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:07.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfde7fc640 1 --2- 172.21.15.177:0/3186502262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe80ad250 0x7fcfe815e370 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000e8b0 tx=0x7fcfd000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:07.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfe4ff9640 1 -- 172.21.15.177:0/3186502262 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd000c940 con 0x7fcfe80ad250 2023-11-28T20:09:07.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfe4ff9640 1 -- 172.21.15.177:0/3186502262 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd000caa0 con 0x7fcfe80ad250 2023-11-28T20:09:07.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfe4ff9640 1 -- 172.21.15.177:0/3186502262 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd000ce30 con 0x7fcfe80ad250 2023-11-28T20:09:07.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfed957640 1 -- 172.21.15.177:0/3186502262 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe806e5e0 con 0x7fcfe80ad250 2023-11-28T20:09:07.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfed957640 1 -- 172.21.15.177:0/3186502262 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe806eba0 con 0x7fcfe80ad250 2023-11-28T20:09:07.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.970+0000 7fcfed957640 1 -- 172.21.15.177:0/3186502262 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe80693d0 con 0x7fcfe80ad250 2023-11-28T20:09:07.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.974+0000 7fcfe4ff9640 1 -- 172.21.15.177:0/3186502262 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcfd0013470 con 0x7fcfe80ad250 2023-11-28T20:09:07.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.974+0000 7fcfe4ff9640 1 --2- 172.21.15.177:0/3186502262 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfc80664a0 0x7fcfc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:07.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.974+0000 7fcfe4ff9640 1 -- 172.21.15.177:0/3186502262 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fcfd0084160 con 0x7fcfe80ad250 2023-11-28T20:09:07.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.974+0000 7fcfe6ffd640 1 --2- 172.21.15.177:0/3186502262 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfc80664a0 0x7fcfc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:07.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.974+0000 7fcfe6ffd640 1 --2- 172.21.15.177:0/3186502262 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfc80664a0 0x7fcfc8068960 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8011340 tx=0x7fcfd800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:07.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:07.978+0000 7fcfe4ff9640 1 -- 172.21.15.177:0/3186502262 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcfd0051460 con 0x7fcfe80ad250 2023-11-28T20:09:08.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.130+0000 7fcfed957640 1 -- 172.21.15.177:0/3186502262 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfe80666d0 con 0x7fcfe80ad250 2023-11-28T20:09:08.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.130+0000 7fcfe4ff9640 1 -- 172.21.15.177:0/3186502262 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18408 (secure 0 0 0) 0x7fcfd0054a80 con 0x7fcfe80ad250 2023-11-28T20:09:08.132 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:08.132 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":36,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:55.264752+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:08:37.943771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T20:08:38.396895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2023-11-28T20:08:52.500186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:09:08.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.130+0000 7fcfed957640 1 -- 172.21.15.177:0/3186502262 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfc80664a0 msgr2=0x7fcfc8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.130+0000 7fcfed957640 1 --2- 172.21.15.177:0/3186502262 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfc80664a0 0x7fcfc8068960 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8011340 tx=0x7fcfd800b040 comp rx=0 tx=0).stop 2023-11-28T20:09:08.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.130+0000 7fcfed957640 1 -- 172.21.15.177:0/3186502262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe80ad250 msgr2=0x7fcfe815e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.130+0000 7fcfed957640 1 --2- 172.21.15.177:0/3186502262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe80ad250 0x7fcfe815e370 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000e8b0 tx=0x7fcfd000ed70 comp rx=0 tx=0).stop 2023-11-28T20:09:08.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.134+0000 7fcfed957640 1 -- 172.21.15.177:0/3186502262 shutdown_connections 2023-11-28T20:09:08.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.134+0000 7fcfed957640 1 --2- 172.21.15.177:0/3186502262 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcfc80664a0 0x7fcfc8068960 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.134+0000 7fcfed957640 1 --2- 172.21.15.177:0/3186502262 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcfe815d090 0x7fcfe80ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.134+0000 7fcfed957640 1 --2- 172.21.15.177:0/3186502262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe80ad250 0x7fcfe815e370 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.134+0000 7fcfed957640 1 --2- 172.21.15.177:0/3186502262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfe806b540 0x7fcfe8160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.134+0000 7fcfed957640 1 -- 172.21.15.177:0/3186502262 >> 172.21.15.177:0/3186502262 conn(0x7fcfe8070bb0 msgr2=0x7fcfe8160a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:08.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.134+0000 7fcfed957640 1 -- 172.21.15.177:0/3186502262 shutdown_connections 2023-11-28T20:09:08.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.134+0000 7fcfed957640 1 -- 172.21.15.177:0/3186502262 wait complete. 2023-11-28T20:09:08.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:08:37.943771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:08:38.396895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2023-11-28T20:08:52.500186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:09:08.155 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:09:08.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.294+0000 7f2519596640 1 Processor -- start 2023-11-28T20:09:08.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.294+0000 7f2519596640 1 -- start start 2023-11-28T20:09:08.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.294+0000 7f2519596640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f251415d2b0 0x7f25140d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.294+0000 7f2519596640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25140d1cf0 0x7f25140cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.294+0000 7f2519596640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25140aff30 con 0x7f251415d690 2023-11-28T20:09:08.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.294+0000 7f2519596640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25140b01d0 con 0x7f251415d2b0 2023-11-28T20:09:08.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.294+0000 7f2519596640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25140b04b0 con 0x7f25140d1cf0 2023-11-28T20:09:08.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.294+0000 7f2512ffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f251415d2b0 0x7f25140d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.294+0000 7f250a7fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25140d1cf0 0x7f25140cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.294+0000 7f25137fe640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f251415d690 0x7f25140cdd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:36914/0 (socket says 172.21.15.177:36914) 2023-11-28T20:09:08.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.294+0000 7f2512ffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f251415d2b0 0x7f25140d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:43870/0 (socket says 172.21.15.177:43870) 2023-11-28T20:09:08.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.294+0000 7f25137fe640 1 -- 172.21.15.177:0/1381327528 learned_addr learned my addr 172.21.15.177:0/1381327528 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:08.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f2512ffd640 1 -- 172.21.15.177:0/1381327528 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25140d1cf0 msgr2=0x7f25140cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:08.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f2512ffd640 1 --2- 172.21.15.177:0/1381327528 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25140d1cf0 0x7f25140cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f2512ffd640 1 -- 172.21.15.177:0/1381327528 >> v1:172.21.15.195:6789/0 conn(0x7f251415d690 legacy=0x7f25140cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f2512ffd640 1 -- 172.21.15.177:0/1381327528 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25140b0790 con 0x7f251415d2b0 2023-11-28T20:09:08.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f2512ffd640 1 --2- 172.21.15.177:0/1381327528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f251415d2b0 0x7f25140d17b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f25040097c0 tx=0x7f250401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9a4379f71f22257 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:08.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f25127fc640 1 -- 172.21.15.177:0/1381327528 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040ab620 con 0x7f251415d2b0 2023-11-28T20:09:08.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f25127fc640 1 -- 172.21.15.177:0/1381327528 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25040ab780 con 0x7f251415d2b0 2023-11-28T20:09:08.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f25127fc640 1 -- 172.21.15.177:0/1381327528 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040abb10 con 0x7f251415d2b0 2023-11-28T20:09:08.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f2519596640 1 -- 172.21.15.177:0/1381327528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f251415d2b0 msgr2=0x7f25140d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f2519596640 1 --2- 172.21.15.177:0/1381327528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f251415d2b0 0x7f25140d17b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f25040097c0 tx=0x7f250401c480 comp rx=0 tx=0).stop 2023-11-28T20:09:08.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f2519596640 1 -- 172.21.15.177:0/1381327528 shutdown_connections 2023-11-28T20:09:08.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f2519596640 1 --2- 172.21.15.177:0/1381327528 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25140d1cf0 0x7f25140cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f2519596640 1 --2- 172.21.15.177:0/1381327528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f251415d2b0 0x7f25140d17b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f2519596640 1 -- 172.21.15.177:0/1381327528 >> 172.21.15.177:0/1381327528 conn(0x7f251409c510 msgr2=0x7f25140d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:08.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f2519596640 1 -- 172.21.15.177:0/1381327528 shutdown_connections 2023-11-28T20:09:08.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.298+0000 7f2519596640 1 -- 172.21.15.177:0/1381327528 wait complete. 2023-11-28T20:09:08.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2519596640 1 Processor -- start 2023-11-28T20:09:08.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2519596640 1 -- start start 2023-11-28T20:09:08.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2519596640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25140d1cf0 0x7f25140cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2519596640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f251415d2b0 0x7f25141535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2519596640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f251415d690 0x7f25141fa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2519596640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25140cbc60 con 0x7f25140d1cf0 2023-11-28T20:09:08.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2519596640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2514152860 con 0x7f251415d690 2023-11-28T20:09:08.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2519596640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25140ca680 con 0x7f251415d2b0 2023-11-28T20:09:08.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2512ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25140d1cf0 0x7f25140cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f250a7fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f251415d2b0 0x7f25141535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2512ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25140d1cf0 0x7f25140cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55576/0 (socket says 172.21.15.177:55576) 2023-11-28T20:09:08.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2512ffd640 1 -- 172.21.15.177:0/1207039421 learned_addr learned my addr 172.21.15.177:0/1207039421 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:08.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f25137fe640 1 --2- 172.21.15.177:0/1207039421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f251415d690 0x7f25141fa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2512ffd640 1 -- 172.21.15.177:0/1207039421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f251415d2b0 msgr2=0x7f25141535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2512ffd640 1 --2- 172.21.15.177:0/1207039421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f251415d2b0 0x7f25141535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2512ffd640 1 -- 172.21.15.177:0/1207039421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f251415d690 msgr2=0x7f25141fa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2512ffd640 1 --2- 172.21.15.177:0/1207039421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f251415d690 0x7f25141fa080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2512ffd640 1 -- 172.21.15.177:0/1207039421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2504009420 con 0x7f25140d1cf0 2023-11-28T20:09:08.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.302+0000 7f2512ffd640 1 --2- 172.21.15.177:0/1207039421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25140d1cf0 0x7f25140cb720 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f25040ad040 tx=0x7f250401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:08.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.306+0000 7f250bfff640 1 -- 172.21.15.177:0/1207039421 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040abe40 con 0x7f25140d1cf0 2023-11-28T20:09:08.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.306+0000 7f250bfff640 1 -- 172.21.15.177:0/1207039421 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25040bf410 con 0x7f25140d1cf0 2023-11-28T20:09:08.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.306+0000 7f250bfff640 1 -- 172.21.15.177:0/1207039421 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040bf7c0 con 0x7f25140d1cf0 2023-11-28T20:09:08.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.306+0000 7f2519596640 1 -- 172.21.15.177:0/1207039421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25140ca960 con 0x7f25140d1cf0 2023-11-28T20:09:08.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.306+0000 7f2519596640 1 -- 172.21.15.177:0/1207039421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25140caf20 con 0x7f25140d1cf0 2023-11-28T20:09:08.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.306+0000 7f2519596640 1 -- 172.21.15.177:0/1207039421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25140679f0 con 0x7f25140d1cf0 2023-11-28T20:09:08.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.306+0000 7f250bfff640 1 -- 172.21.15.177:0/1207039421 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25040b5400 con 0x7f25140d1cf0 2023-11-28T20:09:08.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.306+0000 7f250bfff640 1 --2- 172.21.15.177:0/1207039421 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f24f4066470 0x7f24f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.306+0000 7f250bfff640 1 -- 172.21.15.177:0/1207039421 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f250411e370 con 0x7f25140d1cf0 2023-11-28T20:09:08.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.306+0000 7f250a7fc640 1 --2- 172.21.15.177:0/1207039421 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f24f4066470 0x7f24f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.306+0000 7f250a7fc640 1 --2- 172.21.15.177:0/1207039421 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f24f4066470 0x7f24f4068930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f251406cfd0 tx=0x7f24fc00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:08.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.310+0000 7f250bfff640 1 -- 172.21.15.177:0/1207039421 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25040eb700 con 0x7f25140d1cf0 2023-11-28T20:09:08.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.462+0000 7f2519596640 1 -- 172.21.15.177:0/1207039421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25140693d0 con 0x7f25140d1cf0 2023-11-28T20:09:08.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.462+0000 7f250bfff640 1 -- 172.21.15.177:0/1207039421 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25040eed20 con 0x7f25140d1cf0 2023-11-28T20:09:08.466 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:09:08.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.462+0000 7f2519596640 1 -- 172.21.15.177:0/1207039421 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f24f4066470 msgr2=0x7f24f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.462+0000 7f2519596640 1 --2- 172.21.15.177:0/1207039421 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f24f4066470 0x7f24f4068930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f251406cfd0 tx=0x7f24fc00b040 comp rx=0 tx=0).stop 2023-11-28T20:09:08.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.462+0000 7f2519596640 1 -- 172.21.15.177:0/1207039421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25140d1cf0 msgr2=0x7f25140cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.462+0000 7f2519596640 1 --2- 172.21.15.177:0/1207039421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25140d1cf0 0x7f25140cb720 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f25040ad040 tx=0x7f250401acc0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.462+0000 7f2519596640 1 -- 172.21.15.177:0/1207039421 shutdown_connections 2023-11-28T20:09:08.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.462+0000 7f2519596640 1 --2- 172.21.15.177:0/1207039421 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f24f4066470 0x7f24f4068930 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.462+0000 7f2519596640 1 --2- 172.21.15.177:0/1207039421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f251415d690 0x7f25141fa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.462+0000 7f2519596640 1 --2- 172.21.15.177:0/1207039421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f251415d2b0 0x7f25141535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.462+0000 7f2519596640 1 --2- 172.21.15.177:0/1207039421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25140d1cf0 0x7f25140cb720 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.462+0000 7f2519596640 1 -- 172.21.15.177:0/1207039421 >> 172.21.15.177:0/1207039421 conn(0x7f251409c510 msgr2=0x7f25140b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:08.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.462+0000 7f2519596640 1 -- 172.21.15.177:0/1207039421 shutdown_connections 2023-11-28T20:09:08.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.462+0000 7f2519596640 1 -- 172.21.15.177:0/1207039421 wait complete. 2023-11-28T20:09:08.485 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:09:08.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.622+0000 7fa864d80640 1 Processor -- start 2023-11-28T20:09:08.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.622+0000 7fa864d80640 1 -- start start 2023-11-28T20:09:08.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.626+0000 7fa864d80640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa860158ca0 0x7fa86015eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.626+0000 7fa864d80640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa8600cba10 0x7fa86015be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.626+0000 7fa864d80640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86015b670 con 0x7fa8600b42d0 2023-11-28T20:09:08.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.626+0000 7fa864d80640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86015f410 con 0x7fa8600cba10 2023-11-28T20:09:08.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.626+0000 7fa864d80640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86015f6f0 con 0x7fa860158ca0 2023-11-28T20:09:08.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.626+0000 7fa85dd9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa8600cba10 0x7fa86015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.626+0000 7fa85dd9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa8600cba10 0x7fa86015be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55592/0 (socket says 172.21.15.177:55592) 2023-11-28T20:09:08.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.626+0000 7fa85dd9b640 1 -- 172.21.15.177:0/3568230011 learned_addr learned my addr 172.21.15.177:0/3568230011 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:08.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.626+0000 7fa85e59c640 1 --2- 172.21.15.177:0/3568230011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa860158ca0 0x7fa86015eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.626+0000 7fa85dd9b640 1 -- 172.21.15.177:0/3568230011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa860158ca0 msgr2=0x7fa86015eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:08.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.626+0000 7fa85dd9b640 1 --2- 172.21.15.177:0/3568230011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa860158ca0 0x7fa86015eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.626+0000 7fa85dd9b640 1 -- 172.21.15.177:0/3568230011 >> v1:172.21.15.195:6789/0 conn(0x7fa8600b42d0 legacy=0x7fa8600703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.626+0000 7fa85dd9b640 1 -- 172.21.15.177:0/3568230011 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86015b8e0 con 0x7fa8600cba10 2023-11-28T20:09:08.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.630+0000 7fa85dd9b640 1 --2- 172.21.15.177:0/3568230011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8600cba10 0x7fa86015be00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa854009870 tx=0x7fa85401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16538eb1362c6c5d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:08.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.630+0000 7fa85d59a640 1 -- 172.21.15.177:0/3568230011 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8540a9620 con 0x7fa8600cba10 2023-11-28T20:09:08.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.630+0000 7fa85d59a640 1 -- 172.21.15.177:0/3568230011 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8540a9780 con 0x7fa8600cba10 2023-11-28T20:09:08.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.630+0000 7fa85d59a640 1 -- 172.21.15.177:0/3568230011 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8540a9b10 con 0x7fa8600cba10 2023-11-28T20:09:08.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.630+0000 7fa864d80640 1 -- 172.21.15.177:0/3568230011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8600cba10 msgr2=0x7fa86015be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.630+0000 7fa864d80640 1 --2- 172.21.15.177:0/3568230011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8600cba10 0x7fa86015be00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa854009870 tx=0x7fa85401c540 comp rx=0 tx=0).stop 2023-11-28T20:09:08.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.630+0000 7fa864d80640 1 -- 172.21.15.177:0/3568230011 shutdown_connections 2023-11-28T20:09:08.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.630+0000 7fa864d80640 1 --2- 172.21.15.177:0/3568230011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8600cba10 0x7fa86015be00 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.630+0000 7fa864d80640 1 --2- 172.21.15.177:0/3568230011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa860158ca0 0x7fa86015eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.630+0000 7fa864d80640 1 -- 172.21.15.177:0/3568230011 >> 172.21.15.177:0/3568230011 conn(0x7fa8600b0cc0 msgr2=0x7fa8600b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:08.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.630+0000 7fa864d80640 1 -- 172.21.15.177:0/3568230011 shutdown_connections 2023-11-28T20:09:08.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.630+0000 7fa864d80640 1 -- 172.21.15.177:0/3568230011 wait complete. 2023-11-28T20:09:08.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.630+0000 7fa864d80640 1 Processor -- start 2023-11-28T20:09:08.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.630+0000 7fa864d80640 1 -- start start 2023-11-28T20:09:08.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa864d80640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8600b42d0 0x7fa86014ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa864d80640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8600cba10 0x7fa8600ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa864d80640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa860158ca0 0x7fa8601f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa864d80640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa860150480 con 0x7fa8600b42d0 2023-11-28T20:09:08.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa864d80640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8601f7310 con 0x7fa860158ca0 2023-11-28T20:09:08.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa864d80640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8601f6d50 con 0x7fa8600cba10 2023-11-28T20:09:08.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa85e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8600b42d0 0x7fa86014ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa85e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8600b42d0 0x7fa86014ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55596/0 (socket says 172.21.15.177:55596) 2023-11-28T20:09:08.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa85e59c640 1 -- 172.21.15.177:0/3899794693 learned_addr learned my addr 172.21.15.177:0/3899794693 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:08.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa85ed9d640 1 --2- 172.21.15.177:0/3899794693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa860158ca0 0x7fa8601f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa85dd9b640 1 --2- 172.21.15.177:0/3899794693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8600cba10 0x7fa8600ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa85e59c640 1 -- 172.21.15.177:0/3899794693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8600cba10 msgr2=0x7fa8600ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa85e59c640 1 --2- 172.21.15.177:0/3899794693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8600cba10 0x7fa8600ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa85e59c640 1 -- 172.21.15.177:0/3899794693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa860158ca0 msgr2=0x7fa8601f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa85e59c640 1 --2- 172.21.15.177:0/3899794693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa860158ca0 0x7fa8601f6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa85e59c640 1 -- 172.21.15.177:0/3899794693 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8540094d0 con 0x7fa8600b42d0 2023-11-28T20:09:08.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa85e59c640 1 --2- 172.21.15.177:0/3899794693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8600b42d0 0x7fa86014ff40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa85000e870 tx=0x7fa85000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:08.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa84effd640 1 -- 172.21.15.177:0/3899794693 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850009530 con 0x7fa8600b42d0 2023-11-28T20:09:08.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa84effd640 1 -- 172.21.15.177:0/3899794693 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85000c940 con 0x7fa8600b42d0 2023-11-28T20:09:08.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa864d80640 1 -- 172.21.15.177:0/3899794693 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8601f7030 con 0x7fa8600b42d0 2023-11-28T20:09:08.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa84effd640 1 -- 172.21.15.177:0/3899794693 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85000ccd0 con 0x7fa8600b42d0 2023-11-28T20:09:08.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa864d80640 1 -- 172.21.15.177:0/3899794693 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8600acc50 con 0x7fa8600b42d0 2023-11-28T20:09:08.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.634+0000 7fa864d80640 1 -- 172.21.15.177:0/3899794693 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8601584f0 con 0x7fa8600b42d0 2023-11-28T20:09:08.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.638+0000 7fa84effd640 1 -- 172.21.15.177:0/3899794693 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa850013470 con 0x7fa8600b42d0 2023-11-28T20:09:08.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.638+0000 7fa84effd640 1 --2- 172.21.15.177:0/3899794693 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa840066470 0x7fa840068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.638+0000 7fa84effd640 1 -- 172.21.15.177:0/3899794693 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fa850083ff0 con 0x7fa8600b42d0 2023-11-28T20:09:08.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.638+0000 7fa85dd9b640 1 --2- 172.21.15.177:0/3899794693 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa840066470 0x7fa840068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.638+0000 7fa85dd9b640 1 --2- 172.21.15.177:0/3899794693 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa840066470 0x7fa840068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa8540ae000 tx=0x7fa8540b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:08.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.642+0000 7fa84effd640 1 -- 172.21.15.177:0/3899794693 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa850051420 con 0x7fa8600b42d0 2023-11-28T20:09:08.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.790+0000 7fa864d80640 1 -- 172.21.15.177:0/3899794693 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8600ace40 con 0x7fa8600b42d0 2023-11-28T20:09:08.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.790+0000 7fa84effd640 1 -- 172.21.15.177:0/3899794693 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa850054a40 con 0x7fa8600b42d0 2023-11-28T20:09:08.793 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:09:08.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.794+0000 7fa864d80640 1 -- 172.21.15.177:0/3899794693 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa840066470 msgr2=0x7fa840068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.794+0000 7fa864d80640 1 --2- 172.21.15.177:0/3899794693 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa840066470 0x7fa840068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa8540ae000 tx=0x7fa8540b3040 comp rx=0 tx=0).stop 2023-11-28T20:09:08.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.794+0000 7fa864d80640 1 -- 172.21.15.177:0/3899794693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8600b42d0 msgr2=0x7fa86014ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.794+0000 7fa864d80640 1 --2- 172.21.15.177:0/3899794693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8600b42d0 0x7fa86014ff40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa85000e870 tx=0x7fa85000ed30 comp rx=0 tx=0).stop 2023-11-28T20:09:08.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.794+0000 7fa864d80640 1 -- 172.21.15.177:0/3899794693 shutdown_connections 2023-11-28T20:09:08.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.794+0000 7fa864d80640 1 --2- 172.21.15.177:0/3899794693 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa840066470 0x7fa840068930 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.794+0000 7fa864d80640 1 --2- 172.21.15.177:0/3899794693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa860158ca0 0x7fa8601f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.794+0000 7fa864d80640 1 --2- 172.21.15.177:0/3899794693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8600cba10 0x7fa8600ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.794+0000 7fa864d80640 1 --2- 172.21.15.177:0/3899794693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8600b42d0 0x7fa86014ff40 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.794+0000 7fa864d80640 1 -- 172.21.15.177:0/3899794693 >> 172.21.15.177:0/3899794693 conn(0x7fa8600b0cc0 msgr2=0x7fa8600af880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:08.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.794+0000 7fa864d80640 1 -- 172.21.15.177:0/3899794693 shutdown_connections 2023-11-28T20:09:08.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.794+0000 7fa864d80640 1 -- 172.21.15.177:0/3899794693 wait complete. 2023-11-28T20:09:08.814 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:09:08.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.950+0000 7fc2909c3640 1 Processor -- start 2023-11-28T20:09:08.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.950+0000 7fc2909c3640 1 -- start start 2023-11-28T20:09:08.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.954+0000 7fc2909c3640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc28c15e590 0x7fc28c0ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.954+0000 7fc2909c3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28c0ae010 0x7fc28c06bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.954+0000 7fc2909c3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc28c0ce330 con 0x7fc28c0b3ac0 2023-11-28T20:09:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.954+0000 7fc2909c3640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc28c15e970 con 0x7fc28c15e590 2023-11-28T20:09:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.954+0000 7fc2909c3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c0b2ca0 con 0x7fc28c0ae010 2023-11-28T20:09:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.954+0000 7fc28ad9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc28c15e590 0x7fc28c0ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.954+0000 7fc28ad9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc28c15e590 0x7fc28c0ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59374/0 (socket says 172.21.15.177:59374) 2023-11-28T20:09:08.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.954+0000 7fc28ad9d640 1 -- 172.21.15.177:0/2907829916 learned_addr learned my addr 172.21.15.177:0/2907829916 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:08.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.954+0000 7fc28b59e640 1 --2- 172.21.15.177:0/2907829916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28c0ae010 0x7fc28c06bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.954+0000 7fc28ad9d640 1 -- 172.21.15.177:0/2907829916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28c0ae010 msgr2=0x7fc28c06bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:08.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.954+0000 7fc28ad9d640 1 --2- 172.21.15.177:0/2907829916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28c0ae010 0x7fc28c06bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.954+0000 7fc28ad9d640 1 -- 172.21.15.177:0/2907829916 >> v1:172.21.15.195:6789/0 conn(0x7fc28c0b3ac0 legacy=0x7fc28c0ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.954+0000 7fc28ad9d640 1 -- 172.21.15.177:0/2907829916 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c0b4080 con 0x7fc28c15e590 2023-11-28T20:09:08.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.954+0000 7fc28b59e640 1 --2- 172.21.15.177:0/2907829916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28c0ae010 0x7fc28c06bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:08.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.954+0000 7fc28ad9d640 1 --2- 172.21.15.177:0/2907829916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28c15e590 0x7fc28c0ce5a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009870 tx=0x7fc27c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba05ddf6c64ceaf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:08.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc28a59c640 1 -- 172.21.15.177:0/2907829916 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c0ab600 con 0x7fc28c15e590 2023-11-28T20:09:08.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc28a59c640 1 -- 172.21.15.177:0/2907829916 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27c0a7050 con 0x7fc28c15e590 2023-11-28T20:09:08.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc28a59c640 1 -- 172.21.15.177:0/2907829916 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c0ab980 con 0x7fc28c15e590 2023-11-28T20:09:08.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 -- 172.21.15.177:0/2907829916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28c15e590 msgr2=0x7fc28c0ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 --2- 172.21.15.177:0/2907829916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28c15e590 0x7fc28c0ce5a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009870 tx=0x7fc27c01c420 comp rx=0 tx=0).stop 2023-11-28T20:09:08.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 -- 172.21.15.177:0/2907829916 shutdown_connections 2023-11-28T20:09:08.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 --2- 172.21.15.177:0/2907829916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28c0ae010 0x7fc28c06bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 --2- 172.21.15.177:0/2907829916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28c15e590 0x7fc28c0ce5a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 -- 172.21.15.177:0/2907829916 >> 172.21.15.177:0/2907829916 conn(0x7fc28c0b0920 msgr2=0x7fc28c0b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:08.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 -- 172.21.15.177:0/2907829916 shutdown_connections 2023-11-28T20:09:08.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 -- 172.21.15.177:0/2907829916 wait complete. 2023-11-28T20:09:08.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 Processor -- start 2023-11-28T20:09:08.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 -- start start 2023-11-28T20:09:08.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28c0ae010 0x7fc28c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28c0b3ac0 0x7fc28c15c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc28c15e590 0x7fc28c15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c071ef0 con 0x7fc28c0ae010 2023-11-28T20:09:08.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c070b80 con 0x7fc28c15e590 2023-11-28T20:09:08.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.958+0000 7fc2909c3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c070e50 con 0x7fc28c0b3ac0 2023-11-28T20:09:08.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc28ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28c0ae010 0x7fc28c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc28ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28c0ae010 0x7fc28c070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59382/0 (socket says 172.21.15.177:59382) 2023-11-28T20:09:08.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc28ad9d640 1 -- 172.21.15.177:0/184488424 learned_addr learned my addr 172.21.15.177:0/184488424 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:08.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc28259c640 1 --2- 172.21.15.177:0/184488424 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28c0b3ac0 0x7fc28c15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc28b59e640 1 --2- 172.21.15.177:0/184488424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc28c15e590 0x7fc28c15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc28ad9d640 1 -- 172.21.15.177:0/184488424 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28c0b3ac0 msgr2=0x7fc28c15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc28ad9d640 1 --2- 172.21.15.177:0/184488424 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28c0b3ac0 0x7fc28c15c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc28ad9d640 1 -- 172.21.15.177:0/184488424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc28c15e590 msgr2=0x7fc28c15cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:08.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc28ad9d640 1 --2- 172.21.15.177:0/184488424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc28c15e590 0x7fc28c15cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:08.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc28ad9d640 1 -- 172.21.15.177:0/184488424 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c0094d0 con 0x7fc28c0ae010 2023-11-28T20:09:08.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc28ad9d640 1 --2- 172.21.15.177:0/184488424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28c0ae010 0x7fc28c070640 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0ae040 tx=0x7fc27c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:08.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc283fff640 1 -- 172.21.15.177:0/184488424 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c0b6620 con 0x7fc28c0ae010 2023-11-28T20:09:08.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc283fff640 1 -- 172.21.15.177:0/184488424 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27c0abe90 con 0x7fc28c0ae010 2023-11-28T20:09:08.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc2909c3640 1 -- 172.21.15.177:0/184488424 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28c071130 con 0x7fc28c0ae010 2023-11-28T20:09:08.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc283fff640 1 -- 172.21.15.177:0/184488424 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c0b69e0 con 0x7fc28c0ae010 2023-11-28T20:09:08.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc2909c3640 1 -- 172.21.15.177:0/184488424 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c0716f0 con 0x7fc28c0ae010 2023-11-28T20:09:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc2909c3640 1 -- 172.21.15.177:0/184488424 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28c09d080 con 0x7fc28c0ae010 2023-11-28T20:09:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.962+0000 7fc283fff640 1 -- 172.21.15.177:0/184488424 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc27c0b2040 con 0x7fc28c0ae010 2023-11-28T20:09:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.966+0000 7fc283fff640 1 --2- 172.21.15.177:0/184488424 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc26c066470 0x7fc26c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.966+0000 7fc283fff640 1 -- 172.21.15.177:0/184488424 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fc27c11e540 con 0x7fc28c0ae010 2023-11-28T20:09:08.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.966+0000 7fc28259c640 1 --2- 172.21.15.177:0/184488424 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc26c066470 0x7fc26c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:08.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.966+0000 7fc28259c640 1 --2- 172.21.15.177:0/184488424 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc26c066470 0x7fc26c068930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0ce8c0 tx=0x7fc274009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:08.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:08.970+0000 7fc283fff640 1 -- 172.21.15.177:0/184488424 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc27c0eb7c0 con 0x7fc28c0ae010 2023-11-28T20:09:09.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.118+0000 7fc2909c3640 1 -- 172.21.15.177:0/184488424 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc28c165cf0 con 0x7fc28c0ae010 2023-11-28T20:09:09.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.118+0000 7fc283fff640 1 -- 172.21.15.177:0/184488424 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc27c0eede0 con 0x7fc28c0ae010 2023-11-28T20:09:09.121 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:09:09.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.118+0000 7fc2909c3640 1 -- 172.21.15.177:0/184488424 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc26c066470 msgr2=0x7fc26c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:09.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.118+0000 7fc2909c3640 1 --2- 172.21.15.177:0/184488424 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc26c066470 0x7fc26c068930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0ce8c0 tx=0x7fc274009040 comp rx=0 tx=0).stop 2023-11-28T20:09:09.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.118+0000 7fc2909c3640 1 -- 172.21.15.177:0/184488424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28c0ae010 msgr2=0x7fc28c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:09.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.118+0000 7fc2909c3640 1 --2- 172.21.15.177:0/184488424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28c0ae010 0x7fc28c070640 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0ae040 tx=0x7fc27c01ac60 comp rx=0 tx=0).stop 2023-11-28T20:09:09.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.118+0000 7fc2909c3640 1 -- 172.21.15.177:0/184488424 shutdown_connections 2023-11-28T20:09:09.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.118+0000 7fc2909c3640 1 --2- 172.21.15.177:0/184488424 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc26c066470 0x7fc26c068930 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.118+0000 7fc2909c3640 1 --2- 172.21.15.177:0/184488424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc28c15e590 0x7fc28c15cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.118+0000 7fc2909c3640 1 --2- 172.21.15.177:0/184488424 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc28c0b3ac0 0x7fc28c15c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.118+0000 7fc2909c3640 1 --2- 172.21.15.177:0/184488424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc28c0ae010 0x7fc28c070640 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.118+0000 7fc2909c3640 1 -- 172.21.15.177:0/184488424 >> 172.21.15.177:0/184488424 conn(0x7fc28c0b0920 msgr2=0x7fc28c15eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.118+0000 7fc2909c3640 1 -- 172.21.15.177:0/184488424 shutdown_connections 2023-11-28T20:09:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.118+0000 7fc2909c3640 1 -- 172.21.15.177:0/184488424 wait complete. 2023-11-28T20:09:09.141 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-11-28T20:09:09.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.278+0000 7f7a5889c640 1 Processor -- start 2023-11-28T20:09:09.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.278+0000 7f7a5889c640 1 -- start start 2023-11-28T20:09:09.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.282+0000 7f7a5889c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7a54071d90 0x7f7a54072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:09.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.282+0000 7f7a5889c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5413d2b0 con 0x7f7a5413f5f0 2023-11-28T20:09:09.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.282+0000 7f7a5889c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a540cdd70 con 0x7f7a5415adb0 2023-11-28T20:09:09.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.282+0000 7f7a5889c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a54140520 con 0x7f7a54071d90 2023-11-28T20:09:09.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.282+0000 7f7a52d9d640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f7a5413f5f0 0x7f7a540ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:55360/0 (socket says 172.21.15.177:55360) 2023-11-28T20:09:09.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.282+0000 7f7a52d9d640 1 -- 172.21.15.177:0/2898452330 learned_addr learned my addr 172.21.15.177:0/2898452330 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:09.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.282+0000 7f7a5259c640 1 --2- 172.21.15.177:0/2898452330 >> v2:172.21.15.195:3300/0 conn(0x7f7a54071d90 0x7f7a54072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:09.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.282+0000 7f7a5159a640 1 -- 172.21.15.177:0/2898452330 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607826462 0 0) 0x7f7a5413d2b0 con 0x7f7a5413f5f0 2023-11-28T20:09:09.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.282+0000 7f7a5159a640 1 -- 172.21.15.177:0/2898452330 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a3c003530 con 0x7f7a5413f5f0 2023-11-28T20:09:09.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.282+0000 7f7a5159a640 1 -- 172.21.15.177:0/2898452330 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854943347 0 0) 0x7f7a540cdd70 con 0x7f7a5415adb0 2023-11-28T20:09:09.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.282+0000 7f7a5159a640 1 -- 172.21.15.177:0/2898452330 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a5413d2b0 con 0x7f7a5415adb0 2023-11-28T20:09:09.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.282+0000 7f7a5259c640 1 -- 172.21.15.177:0/2898452330 >> v1:172.21.15.195:6789/0 conn(0x7f7a5415adb0 legacy=0x7f7a5413d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:09.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.282+0000 7f7a5259c640 1 -- 172.21.15.177:0/2898452330 >> v1:172.21.15.177:6789/0 conn(0x7f7a5413f5f0 legacy=0x7f7a540ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:09.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.282+0000 7f7a5159a640 1 -- 172.21.15.177:0/2898452330 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1934639635 0 0) 0x7f7a3c003530 con 0x7f7a5413f5f0 2023-11-28T20:09:09.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.282+0000 7f7a5259c640 1 -- 172.21.15.177:0/2898452330 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a540726b0 con 0x7f7a54071d90 2023-11-28T20:09:09.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.286+0000 7f7a5259c640 1 --2- 172.21.15.177:0/2898452330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a54071d90 0x7f7a54072170 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7a440097c0 tx=0x7f7a4401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5829774c340a02a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:09.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.286+0000 7f7a5159a640 1 -- 172.21.15.177:0/2898452330 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c001a00 con 0x7f7a54071d90 2023-11-28T20:09:09.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.286+0000 7f7a5159a640 1 -- 172.21.15.177:0/2898452330 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a440a7050 con 0x7f7a54071d90 2023-11-28T20:09:09.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.286+0000 7f7a5159a640 1 -- 172.21.15.177:0/2898452330 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a440ab620 con 0x7f7a54071d90 2023-11-28T20:09:09.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.286+0000 7f7a5889c640 1 -- 172.21.15.177:0/2898452330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a54071d90 msgr2=0x7f7a54072170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:09.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.286+0000 7f7a5889c640 1 --2- 172.21.15.177:0/2898452330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a54071d90 0x7f7a54072170 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7a440097c0 tx=0x7f7a4401c3a0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.286+0000 7f7a5889c640 1 -- 172.21.15.177:0/2898452330 shutdown_connections 2023-11-28T20:09:09.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.286+0000 7f7a5889c640 1 --2- 172.21.15.177:0/2898452330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a54071d90 0x7f7a54072170 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.286+0000 7f7a5889c640 1 -- 172.21.15.177:0/2898452330 >> 172.21.15.177:0/2898452330 conn(0x7f7a540b0cc0 msgr2=0x7f7a540b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:09.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.286+0000 7f7a5889c640 1 -- 172.21.15.177:0/2898452330 shutdown_connections 2023-11-28T20:09:09.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.286+0000 7f7a5889c640 1 -- 172.21.15.177:0/2898452330 wait complete. 2023-11-28T20:09:09.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a5889c640 1 Processor -- start 2023-11-28T20:09:09.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a5889c640 1 -- start start 2023-11-28T20:09:09.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a5889c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a54071d90 0x7f7a541f9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:09.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a5889c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a5413f5f0 0x7f7a540afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:09.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a5889c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5415adb0 0x7f7a540b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:09.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a5889c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a541f9b80 con 0x7f7a5415adb0 2023-11-28T20:09:09.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a5889c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a54142740 con 0x7f7a54071d90 2023-11-28T20:09:09.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a5889c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a54142a20 con 0x7f7a5413f5f0 2023-11-28T20:09:09.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a52d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5415adb0 0x7f7a540b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:09.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a52d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5415adb0 0x7f7a540b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59398/0 (socket says 172.21.15.177:59398) 2023-11-28T20:09:09.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a52d9d640 1 -- 172.21.15.177:0/2454494007 learned_addr learned my addr 172.21.15.177:0/2454494007 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:09.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a5259c640 1 --2- 172.21.15.177:0/2454494007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a54071d90 0x7f7a541f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:09.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a51d9b640 1 --2- 172.21.15.177:0/2454494007 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a5413f5f0 0x7f7a540afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:09.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a52d9d640 1 -- 172.21.15.177:0/2454494007 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a5413f5f0 msgr2=0x7f7a540afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:09.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a52d9d640 1 --2- 172.21.15.177:0/2454494007 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a5413f5f0 0x7f7a540afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a52d9d640 1 -- 172.21.15.177:0/2454494007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a54071d90 msgr2=0x7f7a541f9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:09.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a52d9d640 1 --2- 172.21.15.177:0/2454494007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a54071d90 0x7f7a541f9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a52d9d640 1 -- 172.21.15.177:0/2454494007 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a44009420 con 0x7f7a5415adb0 2023-11-28T20:09:09.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a51d9b640 1 --2- 172.21.15.177:0/2454494007 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a5413f5f0 0x7f7a540afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:09.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a52d9d640 1 --2- 172.21.15.177:0/2454494007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5415adb0 0x7f7a540b02f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c001f70 tx=0x7f7a4c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:09.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a42ffd640 1 -- 172.21.15.177:0/2454494007 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c012400 con 0x7f7a5415adb0 2023-11-28T20:09:09.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a42ffd640 1 -- 172.21.15.177:0/2454494007 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c012560 con 0x7f7a5415adb0 2023-11-28T20:09:09.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a42ffd640 1 -- 172.21.15.177:0/2454494007 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c012910 con 0x7f7a5415adb0 2023-11-28T20:09:09.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a5889c640 1 -- 172.21.15.177:0/2454494007 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a54142d00 con 0x7f7a5415adb0 2023-11-28T20:09:09.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a5889c640 1 -- 172.21.15.177:0/2454494007 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a541432c0 con 0x7f7a5415adb0 2023-11-28T20:09:09.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.290+0000 7f7a5889c640 1 -- 172.21.15.177:0/2454494007 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a541434e0 con 0x7f7a5415adb0 2023-11-28T20:09:09.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.294+0000 7f7a42ffd640 1 -- 172.21.15.177:0/2454494007 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7a4c012a70 con 0x7f7a5415adb0 2023-11-28T20:09:09.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.294+0000 7f7a42ffd640 1 --2- 172.21.15.177:0/2454494007 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7a34066470 0x7f7a34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:09.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.294+0000 7f7a42ffd640 1 -- 172.21.15.177:0/2454494007 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f7a4c084840 con 0x7f7a5415adb0 2023-11-28T20:09:09.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.294+0000 7f7a5259c640 1 --2- 172.21.15.177:0/2454494007 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7a34066470 0x7f7a34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:09.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.294+0000 7f7a5259c640 1 --2- 172.21.15.177:0/2454494007 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7a34066470 0x7f7a34068930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7a440ad000 tx=0x7f7a440a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:09.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.298+0000 7f7a42ffd640 1 -- 172.21.15.177:0/2454494007 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7a4c051a00 con 0x7f7a5415adb0 2023-11-28T20:09:09.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.446+0000 7f7a5889c640 1 -- 172.21.15.177:0/2454494007 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f7a5413da70 con 0x7f7a5415adb0 2023-11-28T20:09:09.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.446+0000 7f7a42ffd640 1 -- 172.21.15.177:0/2454494007 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v36) v1 ==== 97+0+11 (secure 0 0 0) 0x7f7a4c055020 con 0x7f7a5415adb0 2023-11-28T20:09:09.449 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:09:09.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.450+0000 7f7a5889c640 1 -- 172.21.15.177:0/2454494007 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7a34066470 msgr2=0x7f7a34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:09.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.450+0000 7f7a5889c640 1 --2- 172.21.15.177:0/2454494007 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7a34066470 0x7f7a34068930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7a440ad000 tx=0x7f7a440a6000 comp rx=0 tx=0).stop 2023-11-28T20:09:09.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.450+0000 7f7a5889c640 1 -- 172.21.15.177:0/2454494007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5415adb0 msgr2=0x7f7a540b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:09.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.450+0000 7f7a5889c640 1 --2- 172.21.15.177:0/2454494007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5415adb0 0x7f7a540b02f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c001f70 tx=0x7f7a4c00a430 comp rx=0 tx=0).stop 2023-11-28T20:09:09.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.450+0000 7f7a5889c640 1 -- 172.21.15.177:0/2454494007 shutdown_connections 2023-11-28T20:09:09.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.450+0000 7f7a5889c640 1 --2- 172.21.15.177:0/2454494007 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7a34066470 0x7f7a34068930 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.450+0000 7f7a5889c640 1 --2- 172.21.15.177:0/2454494007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5415adb0 0x7f7a540b02f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.450+0000 7f7a5889c640 1 --2- 172.21.15.177:0/2454494007 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a5413f5f0 0x7f7a540afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.450+0000 7f7a5889c640 1 --2- 172.21.15.177:0/2454494007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a54071d90 0x7f7a541f9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.450+0000 7f7a5889c640 1 -- 172.21.15.177:0/2454494007 >> 172.21.15.177:0/2454494007 conn(0x7f7a540b0cc0 msgr2=0x7f7a540ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:09.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.450+0000 7f7a5889c640 1 -- 172.21.15.177:0/2454494007 shutdown_connections 2023-11-28T20:09:09.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.450+0000 7f7a5889c640 1 -- 172.21.15.177:0/2454494007 wait complete. 2023-11-28T20:09:09.470 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:09:09.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.610+0000 7ff4f70ad640 1 Processor -- start 2023-11-28T20:09:09.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.610+0000 7ff4f70ad640 1 -- start start 2023-11-28T20:09:09.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.610+0000 7ff4f70ad640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff4f013cf30 0x7ff4f006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:09.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.610+0000 7ff4f70ad640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4f015ad40 0x7ff4f00cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:09.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.610+0000 7ff4f70ad640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f015b3a0 con 0x7ff4f006c800 2023-11-28T20:09:09.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.610+0000 7ff4f70ad640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f013d310 con 0x7ff4f013cf30 2023-11-28T20:09:09.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.610+0000 7ff4f70ad640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f015b1b0 con 0x7ff4f015ad40 2023-11-28T20:09:09.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.610+0000 7ff4f4e49640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff4f013cf30 0x7ff4f006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:09.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.610+0000 7ff4f4e49640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff4f013cf30 0x7ff4f006c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59400/0 (socket says 172.21.15.177:59400) 2023-11-28T20:09:09.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.610+0000 7ff4f4e49640 1 -- 172.21.15.177:0/3084557921 learned_addr learned my addr 172.21.15.177:0/3084557921 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:09.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.610+0000 7ff4f564a640 1 --2- 172.21.15.177:0/3084557921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4f015ad40 0x7ff4f00cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:09.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.610+0000 7ff4f4e49640 1 -- 172.21.15.177:0/3084557921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4f015ad40 msgr2=0x7ff4f00cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:09.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.610+0000 7ff4f4e49640 1 --2- 172.21.15.177:0/3084557921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4f015ad40 0x7ff4f00cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.610+0000 7ff4f4e49640 1 -- 172.21.15.177:0/3084557921 >> v1:172.21.15.195:6789/0 conn(0x7ff4f006c800 legacy=0x7ff4f015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:09.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.610+0000 7ff4f4e49640 1 -- 172.21.15.177:0/3084557921 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f013f720 con 0x7ff4f013cf30 2023-11-28T20:09:09.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.614+0000 7ff4f4e49640 1 --2- 172.21.15.177:0/3084557921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f013cf30 0x7ff4f006c2c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009870 tx=0x7ff4e401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4f9dfeeae0f052 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:09.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.614+0000 7ff4ef7fe640 1 -- 172.21.15.177:0/3084557921 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40ab600 con 0x7ff4f013cf30 2023-11-28T20:09:09.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.614+0000 7ff4ef7fe640 1 -- 172.21.15.177:0/3084557921 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e40a7050 con 0x7ff4f013cf30 2023-11-28T20:09:09.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.614+0000 7ff4ef7fe640 1 -- 172.21.15.177:0/3084557921 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40ab980 con 0x7ff4f013cf30 2023-11-28T20:09:09.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.614+0000 7ff4f70ad640 1 -- 172.21.15.177:0/3084557921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f013cf30 msgr2=0x7ff4f006c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:09.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.614+0000 7ff4f70ad640 1 --2- 172.21.15.177:0/3084557921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f013cf30 0x7ff4f006c2c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009870 tx=0x7ff4e401c4b0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.614+0000 7ff4f70ad640 1 -- 172.21.15.177:0/3084557921 shutdown_connections 2023-11-28T20:09:09.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.614+0000 7ff4f70ad640 1 --2- 172.21.15.177:0/3084557921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4f015ad40 0x7ff4f00cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.614+0000 7ff4f70ad640 1 --2- 172.21.15.177:0/3084557921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f013cf30 0x7ff4f006c2c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.614+0000 7ff4f70ad640 1 -- 172.21.15.177:0/3084557921 >> 172.21.15.177:0/3084557921 conn(0x7ff4f006a530 msgr2=0x7ff4f006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:09.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.614+0000 7ff4f70ad640 1 -- 172.21.15.177:0/3084557921 shutdown_connections 2023-11-28T20:09:09.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.614+0000 7ff4f70ad640 1 -- 172.21.15.177:0/3084557921 wait complete. 2023-11-28T20:09:09.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4f70ad640 1 Processor -- start 2023-11-28T20:09:09.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4f70ad640 1 -- start start 2023-11-28T20:09:09.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4f70ad640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4f006c800 0x7ff4f013a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:09.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4f70ad640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f013cf30 0x7ff4f013b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:09.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4f70ad640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4f015ad40 0x7ff4f013bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:09.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4f70ad640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f013ac10 con 0x7ff4f013cf30 2023-11-28T20:09:09.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4f70ad640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f0158d10 con 0x7ff4f015ad40 2023-11-28T20:09:09.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4f70ad640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f013c670 con 0x7ff4f006c800 2023-11-28T20:09:09.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4effff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f013cf30 0x7ff4f013b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:09.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4effff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f013cf30 0x7ff4f013b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59416/0 (socket says 172.21.15.177:59416) 2023-11-28T20:09:09.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4effff640 1 -- 172.21.15.177:0/467046667 learned_addr learned my addr 172.21.15.177:0/467046667 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:09.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4f564a640 1 --2- 172.21.15.177:0/467046667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4f015ad40 0x7ff4f013bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:09.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4f4e49640 1 --2- 172.21.15.177:0/467046667 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4f006c800 0x7ff4f013a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:09.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4effff640 1 -- 172.21.15.177:0/467046667 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4f006c800 msgr2=0x7ff4f013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:09.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4effff640 1 --2- 172.21.15.177:0/467046667 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4f006c800 0x7ff4f013a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4effff640 1 -- 172.21.15.177:0/467046667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4f015ad40 msgr2=0x7ff4f013bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:09.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4effff640 1 --2- 172.21.15.177:0/467046667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4f015ad40 0x7ff4f013bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4effff640 1 -- 172.21.15.177:0/467046667 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e40094d0 con 0x7ff4f013cf30 2023-11-28T20:09:09.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4effff640 1 --2- 172.21.15.177:0/467046667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f013cf30 0x7ff4f013b820 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00c3c0 tx=0x7ff4dc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:09.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4ed7fa640 1 -- 172.21.15.177:0/467046667 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0052d0 con 0x7ff4f013cf30 2023-11-28T20:09:09.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4ed7fa640 1 -- 172.21.15.177:0/467046667 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc005430 con 0x7ff4f013cf30 2023-11-28T20:09:09.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4f70ad640 1 -- 172.21.15.177:0/467046667 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f013c390 con 0x7ff4f013cf30 2023-11-28T20:09:09.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4ed7fa640 1 -- 172.21.15.177:0/467046667 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc003840 con 0x7ff4f013cf30 2023-11-28T20:09:09.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4f70ad640 1 -- 172.21.15.177:0/467046667 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f0155570 con 0x7ff4f013cf30 2023-11-28T20:09:09.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.618+0000 7ff4f70ad640 1 -- 172.21.15.177:0/467046667 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f01550f0 con 0x7ff4f013cf30 2023-11-28T20:09:09.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.622+0000 7ff4ed7fa640 1 -- 172.21.15.177:0/467046667 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff4dc0039a0 con 0x7ff4f013cf30 2023-11-28T20:09:09.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.622+0000 7ff4ed7fa640 1 --2- 172.21.15.177:0/467046667 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff4d4066470 0x7ff4d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:09.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.622+0000 7ff4ed7fa640 1 -- 172.21.15.177:0/467046667 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7ff4dc083550 con 0x7ff4f013cf30 2023-11-28T20:09:09.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.622+0000 7ff4f4e49640 1 --2- 172.21.15.177:0/467046667 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff4d4066470 0x7ff4d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:09.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.622+0000 7ff4f4e49640 1 --2- 172.21.15.177:0/467046667 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff4d4066470 0x7ff4d4068930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40ad000 tx=0x7ff4e40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:09.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.626+0000 7ff4ed7fa640 1 -- 172.21.15.177:0/467046667 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4f01550f0 con 0x7ff4f013cf30 2023-11-28T20:09:09.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.790+0000 7ff4f70ad640 1 -- 172.21.15.177:0/467046667 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff4f01550f0 con 0x7ff4f013cf30 2023-11-28T20:09:09.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.790+0000 7ff4ed7fa640 1 -- 172.21.15.177:0/467046667 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff4f01550f0 con 0x7ff4f013cf30 2023-11-28T20:09:09.794 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:09:09.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.794+0000 7ff4f70ad640 1 -- 172.21.15.177:0/467046667 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff4d4066470 msgr2=0x7ff4d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:09.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.794+0000 7ff4f70ad640 1 --2- 172.21.15.177:0/467046667 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff4d4066470 0x7ff4d4068930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40ad000 tx=0x7ff4e40a6000 comp rx=0 tx=0).stop 2023-11-28T20:09:09.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.794+0000 7ff4f70ad640 1 -- 172.21.15.177:0/467046667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f013cf30 msgr2=0x7ff4f013b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:09.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.794+0000 7ff4f70ad640 1 --2- 172.21.15.177:0/467046667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f013cf30 0x7ff4f013b820 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00c3c0 tx=0x7ff4dc00c880 comp rx=0 tx=0).stop 2023-11-28T20:09:09.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.794+0000 7ff4f70ad640 1 -- 172.21.15.177:0/467046667 shutdown_connections 2023-11-28T20:09:09.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.794+0000 7ff4f70ad640 1 --2- 172.21.15.177:0/467046667 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff4d4066470 0x7ff4d4068930 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.794+0000 7ff4f70ad640 1 --2- 172.21.15.177:0/467046667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4f015ad40 0x7ff4f013bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.794+0000 7ff4f70ad640 1 --2- 172.21.15.177:0/467046667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f013cf30 0x7ff4f013b820 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.794+0000 7ff4f70ad640 1 --2- 172.21.15.177:0/467046667 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4f006c800 0x7ff4f013a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:09.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.794+0000 7ff4f70ad640 1 -- 172.21.15.177:0/467046667 >> 172.21.15.177:0/467046667 conn(0x7ff4f006a530 msgr2=0x7ff4f013d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:09.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.794+0000 7ff4f70ad640 1 -- 172.21.15.177:0/467046667 shutdown_connections 2023-11-28T20:09:09.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:09.794+0000 7ff4f70ad640 1 -- 172.21.15.177:0/467046667 wait complete. 2023-11-28T20:09:09.816 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:09:09.816 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:09:09.827 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:09:10.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b44c9640 1 Processor -- start 2023-11-28T20:09:10.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b44c9640 1 -- start start 2023-11-28T20:09:10.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b44c9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f89ac06c9d0 0x7f89ac070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b44c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89ac072180 0x7f89ac0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b44c9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ac0710e0 con 0x7f89ac144840 2023-11-28T20:09:10.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b44c9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac15f010 con 0x7f89ac06c9d0 2023-11-28T20:09:10.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b44c9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac070ee0 con 0x7f89ac072180 2023-11-28T20:09:10.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b1a64640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f89ac06c9d0 0x7f89ac070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b1a64640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f89ac06c9d0 0x7f89ac070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59426/0 (socket says 172.21.15.177:59426) 2023-11-28T20:09:10.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b2265640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f89ac144840 0x7f89ac06c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:55374/0 (socket says 172.21.15.177:55374) 2023-11-28T20:09:10.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b1a64640 1 -- 172.21.15.177:0/823189447 learned_addr learned my addr 172.21.15.177:0/823189447 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:10.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b2a66640 1 --2- 172.21.15.177:0/823189447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89ac072180 0x7f89ac0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b1a64640 1 -- 172.21.15.177:0/823189447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89ac072180 msgr2=0x7f89ac0709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:10.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b1a64640 1 --2- 172.21.15.177:0/823189447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89ac072180 0x7f89ac0709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b1a64640 1 -- 172.21.15.177:0/823189447 >> v1:172.21.15.177:6789/0 conn(0x7f89ac144840 legacy=0x7f89ac06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.010+0000 7f89b1a64640 1 -- 172.21.15.177:0/823189447 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac0713c0 con 0x7f89ac06c9d0 2023-11-28T20:09:10.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.014+0000 7f89b1a64640 1 --2- 172.21.15.177:0/823189447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ac06c9d0 0x7f89ac070460 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f899c009870 tx=0x7f899c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38af026070ceced6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:10.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.014+0000 7f89b1263640 1 -- 172.21.15.177:0/823189447 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c0aa670 con 0x7f89ac06c9d0 2023-11-28T20:09:10.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.014+0000 7f89b1263640 1 -- 172.21.15.177:0/823189447 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c0aa7d0 con 0x7f89ac06c9d0 2023-11-28T20:09:10.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.014+0000 7f89b1263640 1 -- 172.21.15.177:0/823189447 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c0aab60 con 0x7f89ac06c9d0 2023-11-28T20:09:10.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.014+0000 7f89b44c9640 1 -- 172.21.15.177:0/823189447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ac06c9d0 msgr2=0x7f89ac070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.014+0000 7f89b44c9640 1 --2- 172.21.15.177:0/823189447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ac06c9d0 0x7f89ac070460 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f899c009870 tx=0x7f899c01c510 comp rx=0 tx=0).stop 2023-11-28T20:09:10.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.014+0000 7f89b44c9640 1 -- 172.21.15.177:0/823189447 shutdown_connections 2023-11-28T20:09:10.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.014+0000 7f89b44c9640 1 --2- 172.21.15.177:0/823189447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ac06c9d0 0x7f89ac070460 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.014+0000 7f89b44c9640 1 --2- 172.21.15.177:0/823189447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89ac072180 0x7f89ac0709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.014+0000 7f89b44c9640 1 -- 172.21.15.177:0/823189447 >> 172.21.15.177:0/823189447 conn(0x7f89ac06a530 msgr2=0x7f89ac06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:10.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.014+0000 7f89b44c9640 1 -- 172.21.15.177:0/823189447 shutdown_connections 2023-11-28T20:09:10.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.014+0000 7f89b44c9640 1 -- 172.21.15.177:0/823189447 wait complete. 2023-11-28T20:09:10.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b44c9640 1 Processor -- start 2023-11-28T20:09:10.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b44c9640 1 -- start start 2023-11-28T20:09:10.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b44c9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89ac06c9d0 0x7f89ac159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b44c9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ac072180 0x7f89ac142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b44c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89ac144840 0x7f89ac142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b44c9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac1f5b80 con 0x7f89ac072180 2023-11-28T20:09:10.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b44c9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac1f4f70 con 0x7f89ac06c9d0 2023-11-28T20:09:10.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b44c9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac1f5250 con 0x7f89ac144840 2023-11-28T20:09:10.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b1a64640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ac072180 0x7f89ac142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b1a64640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ac072180 0x7f89ac142780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59434/0 (socket says 172.21.15.177:59434) 2023-11-28T20:09:10.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b1a64640 1 -- 172.21.15.177:0/1657713522 learned_addr learned my addr 172.21.15.177:0/1657713522 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:10.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b2265640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89ac06c9d0 0x7f89ac159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b2a66640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89ac144840 0x7f89ac142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b1a64640 1 -- 172.21.15.177:0/1657713522 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89ac144840 msgr2=0x7f89ac142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b1a64640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89ac144840 0x7f89ac142cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b1a64640 1 -- 172.21.15.177:0/1657713522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89ac06c9d0 msgr2=0x7f89ac159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b1a64640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89ac06c9d0 0x7f89ac159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b1a64640 1 -- 172.21.15.177:0/1657713522 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c0094d0 con 0x7f89ac072180 2023-11-28T20:09:10.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b2265640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89ac06c9d0 0x7f89ac159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:10.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b2a66640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89ac144840 0x7f89ac142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:10.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b1a64640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ac072180 0x7f89ac142780 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f899c01a140 tx=0x7f899c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:10.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89a2ffd640 1 -- 172.21.15.177:0/1657713522 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c0aa670 con 0x7f89ac072180 2023-11-28T20:09:10.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89a2ffd640 1 -- 172.21.15.177:0/1657713522 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c0b3800 con 0x7f89ac072180 2023-11-28T20:09:10.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89a2ffd640 1 -- 172.21.15.177:0/1657713522 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c0b3bb0 con 0x7f89ac072180 2023-11-28T20:09:10.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b44c9640 1 -- 172.21.15.177:0/1657713522 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ac1f5530 con 0x7f89ac072180 2023-11-28T20:09:10.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b44c9640 1 -- 172.21.15.177:0/1657713522 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ac13c530 con 0x7f89ac072180 2023-11-28T20:09:10.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.018+0000 7f89b44c9640 1 -- 172.21.15.177:0/1657713522 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ac1f5cf0 con 0x7f89ac072180 2023-11-28T20:09:10.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.022+0000 7f89a2ffd640 1 -- 172.21.15.177:0/1657713522 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f899c0b3d10 con 0x7f89ac072180 2023-11-28T20:09:10.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.022+0000 7f89a2ffd640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8990066470 0x7f8990068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.022+0000 7f89a2ffd640 1 -- 172.21.15.177:0/1657713522 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f899c11e800 con 0x7f89ac072180 2023-11-28T20:09:10.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.022+0000 7f89b2265640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8990066470 0x7f8990068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.022+0000 7f89b2265640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8990066470 0x7f8990068930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f89a8007fd0 tx=0x7f89a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:10.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.026+0000 7f89a2ffd640 1 -- 172.21.15.177:0/1657713522 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f899c0ebc30 con 0x7f89ac072180 2023-11-28T20:09:10.063 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:09:10.067 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:09:10.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.178+0000 7f89b44c9640 1 -- 172.21.15.177:0/1657713522 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89ac1f5390 con 0x7f89ac072180 2023-11-28T20:09:10.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.182+0000 7f89a2ffd640 1 -- 172.21.15.177:0/1657713522 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18408 (secure 0 0 0) 0x7f89ac1f5390 con 0x7f89ac072180 2023-11-28T20:09:10.183 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:10.183 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":36,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:55.264752+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:08:37.943771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T20:08:38.396895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2023-11-28T20:08:52.500186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:09:10.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.182+0000 7f89b44c9640 1 -- 172.21.15.177:0/1657713522 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8990066470 msgr2=0x7f8990068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.182+0000 7f89b44c9640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8990066470 0x7f8990068930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f89a8007fd0 tx=0x7f89a8009040 comp rx=0 tx=0).stop 2023-11-28T20:09:10.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.182+0000 7f89b44c9640 1 -- 172.21.15.177:0/1657713522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ac072180 msgr2=0x7f89ac142780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.182+0000 7f89b44c9640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ac072180 0x7f89ac142780 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f899c01a140 tx=0x7f899c01ad50 comp rx=0 tx=0).stop 2023-11-28T20:09:10.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.182+0000 7f89b44c9640 1 -- 172.21.15.177:0/1657713522 shutdown_connections 2023-11-28T20:09:10.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.182+0000 7f89b44c9640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8990066470 0x7f8990068930 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.182+0000 7f89b44c9640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89ac144840 0x7f89ac142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.182+0000 7f89b44c9640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ac072180 0x7f89ac142780 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.182+0000 7f89b44c9640 1 --2- 172.21.15.177:0/1657713522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89ac06c9d0 0x7f89ac159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.182+0000 7f89b44c9640 1 -- 172.21.15.177:0/1657713522 >> 172.21.15.177:0/1657713522 conn(0x7f89ac06a530 msgr2=0x7f89ac15c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:10.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.182+0000 7f89b44c9640 1 -- 172.21.15.177:0/1657713522 shutdown_connections 2023-11-28T20:09:10.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.182+0000 7f89b44c9640 1 -- 172.21.15.177:0/1657713522 wait complete. 2023-11-28T20:09:10.204 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:08:37.943771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:08:38.396895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2023-11-28T20:08:52.500186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:09:10.204 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:09:10.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.346+0000 7f3be91b8640 1 Processor -- start 2023-11-28T20:09:10.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.346+0000 7f3be91b8640 1 -- start start 2023-11-28T20:09:10.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.346+0000 7f3be91b8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3be415adb0 0x7f3be413d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.346+0000 7f3be91b8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be413d2b0 con 0x7f3be4071d90 2023-11-28T20:09:10.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.346+0000 7f3be91b8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be40cdd70 con 0x7f3be413f5f0 2023-11-28T20:09:10.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.346+0000 7f3be91b8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be4140520 con 0x7f3be415adb0 2023-11-28T20:09:10.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.346+0000 7f3be2d9d640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f3be4071d90 0x7f3be4072170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:55376/0 (socket says 172.21.15.177:55376) 2023-11-28T20:09:10.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.346+0000 7f3be2d9d640 1 -- 172.21.15.177:0/3753207896 learned_addr learned my addr 172.21.15.177:0/3753207896 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:10.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.346+0000 7f3be259c640 1 --2- 172.21.15.177:0/3753207896 >> v2:172.21.15.177:3300/0 conn(0x7f3be415adb0 0x7f3be413d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.346+0000 7f3be1d9b640 1 -- 172.21.15.177:0/3753207896 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480611143 0 0) 0x7f3be413d2b0 con 0x7f3be4071d90 2023-11-28T20:09:10.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.346+0000 7f3be1d9b640 1 -- 172.21.15.177:0/3753207896 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bcc003530 con 0x7f3be4071d90 2023-11-28T20:09:10.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.346+0000 7f3be259c640 1 -- 172.21.15.177:0/3753207896 >> v1:172.21.15.195:6789/0 conn(0x7f3be413f5f0 legacy=0x7f3be40ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.346+0000 7f3be259c640 1 -- 172.21.15.177:0/3753207896 >> v1:172.21.15.177:6789/0 conn(0x7f3be4071d90 legacy=0x7f3be4072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.346+0000 7f3be259c640 1 -- 172.21.15.177:0/3753207896 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be413ff60 con 0x7f3be415adb0 2023-11-28T20:09:10.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.350+0000 7f3be259c640 1 --2- 172.21.15.177:0/3753207896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3be415adb0 0x7f3be413d560 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80097c0 tx=0x7f3bd801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588f637379583b53 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:10.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.350+0000 7f3be1d9b640 1 -- 172.21.15.177:0/3753207896 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80ab600 con 0x7f3be415adb0 2023-11-28T20:09:10.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.350+0000 7f3be1d9b640 1 -- 172.21.15.177:0/3753207896 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd80a7050 con 0x7f3be415adb0 2023-11-28T20:09:10.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.350+0000 7f3be1d9b640 1 -- 172.21.15.177:0/3753207896 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80ab960 con 0x7f3be415adb0 2023-11-28T20:09:10.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.350+0000 7f3be91b8640 1 -- 172.21.15.177:0/3753207896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3be415adb0 msgr2=0x7f3be413d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.350+0000 7f3be91b8640 1 --2- 172.21.15.177:0/3753207896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3be415adb0 0x7f3be413d560 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80097c0 tx=0x7f3bd801c480 comp rx=0 tx=0).stop 2023-11-28T20:09:10.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.350+0000 7f3be91b8640 1 -- 172.21.15.177:0/3753207896 shutdown_connections 2023-11-28T20:09:10.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.350+0000 7f3be91b8640 1 --2- 172.21.15.177:0/3753207896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3be415adb0 0x7f3be413d560 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.350+0000 7f3be91b8640 1 -- 172.21.15.177:0/3753207896 >> 172.21.15.177:0/3753207896 conn(0x7f3be40b0cc0 msgr2=0x7f3be40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:10.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.350+0000 7f3be91b8640 1 -- 172.21.15.177:0/3753207896 shutdown_connections 2023-11-28T20:09:10.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.350+0000 7f3be91b8640 1 -- 172.21.15.177:0/3753207896 wait complete. 2023-11-28T20:09:10.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be91b8640 1 Processor -- start 2023-11-28T20:09:10.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be91b8640 1 -- start start 2023-11-28T20:09:10.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be91b8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3be4071d90 0x7f3be41653a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be91b8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3be413f5f0 0x7f3be40b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be91b8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3be415adb0 0x7f3be41f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be91b8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be415f140 con 0x7f3be4071d90 2023-11-28T20:09:10.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be91b8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be40b2d00 con 0x7f3be413f5f0 2023-11-28T20:09:10.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be91b8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be415e4c0 con 0x7f3be415adb0 2023-11-28T20:09:10.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be2d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3be4071d90 0x7f3be41653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be2d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3be4071d90 0x7f3be41653a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59444/0 (socket says 172.21.15.177:59444) 2023-11-28T20:09:10.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be2d9d640 1 -- 172.21.15.177:0/403604376 learned_addr learned my addr 172.21.15.177:0/403604376 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:10.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be259c640 1 --2- 172.21.15.177:0/403604376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3be413f5f0 0x7f3be40b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be359e640 1 --2- 172.21.15.177:0/403604376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3be415adb0 0x7f3be41f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be2d9d640 1 -- 172.21.15.177:0/403604376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3be415adb0 msgr2=0x7f3be41f5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be2d9d640 1 --2- 172.21.15.177:0/403604376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3be415adb0 0x7f3be41f5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be2d9d640 1 -- 172.21.15.177:0/403604376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3be413f5f0 msgr2=0x7f3be40b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be2d9d640 1 --2- 172.21.15.177:0/403604376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3be413f5f0 0x7f3be40b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be2d9d640 1 -- 172.21.15.177:0/403604376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd8009420 con 0x7f3be4071d90 2023-11-28T20:09:10.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be2d9d640 1 --2- 172.21.15.177:0/403604376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3be4071d90 0x7f3be41653a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400c500 tx=0x7f3bd400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:10.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3bcb7fe640 1 -- 172.21.15.177:0/403604376 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4005cf0 con 0x7f3be4071d90 2023-11-28T20:09:10.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3bcb7fe640 1 -- 172.21.15.177:0/403604376 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd4005e50 con 0x7f3be4071d90 2023-11-28T20:09:10.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3bcb7fe640 1 -- 172.21.15.177:0/403604376 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd40072f0 con 0x7f3be4071d90 2023-11-28T20:09:10.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be91b8640 1 -- 172.21.15.177:0/403604376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be415e7a0 con 0x7f3be4071d90 2023-11-28T20:09:10.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be91b8640 1 -- 172.21.15.177:0/403604376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be415ed60 con 0x7f3be4071d90 2023-11-28T20:09:10.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.354+0000 7f3be91b8640 1 -- 172.21.15.177:0/403604376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be40693d0 con 0x7f3be4071d90 2023-11-28T20:09:10.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.358+0000 7f3bcb7fe640 1 -- 172.21.15.177:0/403604376 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3bd4007450 con 0x7f3be4071d90 2023-11-28T20:09:10.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.358+0000 7f3bcb7fe640 1 --2- 172.21.15.177:0/403604376 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3bd0066470 0x7f3bd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.358+0000 7f3bcb7fe640 1 -- 172.21.15.177:0/403604376 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f3bd4083500 con 0x7f3be4071d90 2023-11-28T20:09:10.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.358+0000 7f3be259c640 1 --2- 172.21.15.177:0/403604376 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3bd0066470 0x7f3bd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.358+0000 7f3be259c640 1 --2- 172.21.15.177:0/403604376 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3bd0066470 0x7f3bd0068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80ad000 tx=0x7f3bd8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:10.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.362+0000 7f3bcb7fe640 1 -- 172.21.15.177:0/403604376 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3bd4050930 con 0x7f3be4071d90 2023-11-28T20:09:10.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.510+0000 7f3be91b8640 1 -- 172.21.15.177:0/403604376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3be406e710 con 0x7f3be4071d90 2023-11-28T20:09:10.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.514+0000 7f3bcb7fe640 1 -- 172.21.15.177:0/403604376 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3bd4017020 con 0x7f3be4071d90 2023-11-28T20:09:10.515 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:09:10.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.514+0000 7f3be91b8640 1 -- 172.21.15.177:0/403604376 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3bd0066470 msgr2=0x7f3bd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.514+0000 7f3be91b8640 1 --2- 172.21.15.177:0/403604376 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3bd0066470 0x7f3bd0068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80ad000 tx=0x7f3bd8008040 comp rx=0 tx=0).stop 2023-11-28T20:09:10.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.514+0000 7f3be91b8640 1 -- 172.21.15.177:0/403604376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3be4071d90 msgr2=0x7f3be41653a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.514+0000 7f3be91b8640 1 --2- 172.21.15.177:0/403604376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3be4071d90 0x7f3be41653a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400c500 tx=0x7f3bd400c9c0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.514+0000 7f3be91b8640 1 -- 172.21.15.177:0/403604376 shutdown_connections 2023-11-28T20:09:10.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.514+0000 7f3be91b8640 1 --2- 172.21.15.177:0/403604376 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3bd0066470 0x7f3bd0068930 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.514+0000 7f3be91b8640 1 --2- 172.21.15.177:0/403604376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3be415adb0 0x7f3be41f5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.514+0000 7f3be91b8640 1 --2- 172.21.15.177:0/403604376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3be413f5f0 0x7f3be40b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.514+0000 7f3be91b8640 1 --2- 172.21.15.177:0/403604376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3be4071d90 0x7f3be41653a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.514+0000 7f3be91b8640 1 -- 172.21.15.177:0/403604376 >> 172.21.15.177:0/403604376 conn(0x7f3be40b0cc0 msgr2=0x7f3be415b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:10.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.514+0000 7f3be91b8640 1 -- 172.21.15.177:0/403604376 shutdown_connections 2023-11-28T20:09:10.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.514+0000 7f3be91b8640 1 -- 172.21.15.177:0/403604376 wait complete. 2023-11-28T20:09:10.536 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:09:10.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.674+0000 7f59da3aa640 1 Processor -- start 2023-11-28T20:09:10.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.674+0000 7f59da3aa640 1 -- start start 2023-11-28T20:09:10.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.674+0000 7f59da3aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d40cba10 0x7f59d415be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.674+0000 7f59da3aa640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f59d40b42d0 0x7f59d40b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.674+0000 7f59da3aa640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d40b4c40 con 0x7f59d4158ca0 2023-11-28T20:09:10.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.674+0000 7f59da3aa640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d415b670 con 0x7f59d40b42d0 2023-11-28T20:09:10.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.674+0000 7f59da3aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d415f410 con 0x7f59d40cba10 2023-11-28T20:09:10.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.674+0000 7f59d8947640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f59d40b42d0 0x7f59d40b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.674+0000 7f59d8947640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f59d40b42d0 0x7f59d40b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59456/0 (socket says 172.21.15.177:59456) 2023-11-28T20:09:10.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.678+0000 7f59d8947640 1 -- 172.21.15.177:0/3769807631 learned_addr learned my addr 172.21.15.177:0/3769807631 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:10.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.678+0000 7f59d37fe640 1 --2- 172.21.15.177:0/3769807631 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d40cba10 0x7f59d415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.678+0000 7f59d8947640 1 -- 172.21.15.177:0/3769807631 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d40cba10 msgr2=0x7f59d415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:10.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.678+0000 7f59d8947640 1 --2- 172.21.15.177:0/3769807631 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d40cba10 0x7f59d415be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.678+0000 7f59d8947640 1 -- 172.21.15.177:0/3769807631 >> v1:172.21.15.195:6789/0 conn(0x7f59d4158ca0 legacy=0x7f59d415eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.678+0000 7f59d8947640 1 -- 172.21.15.177:0/3769807631 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d415f6f0 con 0x7f59d40b42d0 2023-11-28T20:09:10.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.678+0000 7f59d8947640 1 --2- 172.21.15.177:0/3769807631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59d40b42d0 0x7f59d40b4700 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009e50 tx=0x7f59cc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9535826b83371a2b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:10.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.678+0000 7f59d2ffd640 1 -- 172.21.15.177:0/3769807631 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc0a57f0 con 0x7f59d40b42d0 2023-11-28T20:09:10.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.678+0000 7f59d2ffd640 1 -- 172.21.15.177:0/3769807631 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc0a5950 con 0x7f59d40b42d0 2023-11-28T20:09:10.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.678+0000 7f59d2ffd640 1 -- 172.21.15.177:0/3769807631 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc0a5ce0 con 0x7f59d40b42d0 2023-11-28T20:09:10.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 -- 172.21.15.177:0/3769807631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59d40b42d0 msgr2=0x7f59d40b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 --2- 172.21.15.177:0/3769807631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59d40b42d0 0x7f59d40b4700 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009e50 tx=0x7f59cc01ca10 comp rx=0 tx=0).stop 2023-11-28T20:09:10.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 -- 172.21.15.177:0/3769807631 shutdown_connections 2023-11-28T20:09:10.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 --2- 172.21.15.177:0/3769807631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59d40b42d0 0x7f59d40b4700 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 --2- 172.21.15.177:0/3769807631 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d40cba10 0x7f59d415be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 -- 172.21.15.177:0/3769807631 >> 172.21.15.177:0/3769807631 conn(0x7f59d40b0cc0 msgr2=0x7f59d40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:10.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 -- 172.21.15.177:0/3769807631 shutdown_connections 2023-11-28T20:09:10.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 -- 172.21.15.177:0/3769807631 wait complete. 2023-11-28T20:09:10.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 Processor -- start 2023-11-28T20:09:10.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 -- start start 2023-11-28T20:09:10.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59d40b42d0 0x7f59d414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59d40cba10 0x7f59d4151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d4158ca0 0x7f59d413d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d413dde0 con 0x7f59d40b42d0 2023-11-28T20:09:10.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d413e0c0 con 0x7f59d40cba10 2023-11-28T20:09:10.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59da3aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d4151650 con 0x7f59d4158ca0 2023-11-28T20:09:10.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59d3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59d40b42d0 0x7f59d414fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59d3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59d40b42d0 0x7f59d414fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59462/0 (socket says 172.21.15.177:59462) 2023-11-28T20:09:10.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59d3fff640 1 -- 172.21.15.177:0/1267460641 learned_addr learned my addr 172.21.15.177:0/1267460641 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:10.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59d37fe640 1 --2- 172.21.15.177:0/1267460641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59d40cba10 0x7f59d4151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59d8947640 1 --2- 172.21.15.177:0/1267460641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d4158ca0 0x7f59d413d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59d3fff640 1 -- 172.21.15.177:0/1267460641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d4158ca0 msgr2=0x7f59d413d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59d3fff640 1 --2- 172.21.15.177:0/1267460641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d4158ca0 0x7f59d413d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59d3fff640 1 -- 172.21.15.177:0/1267460641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59d40cba10 msgr2=0x7f59d4151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59d3fff640 1 --2- 172.21.15.177:0/1267460641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59d40cba10 0x7f59d4151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.682+0000 7f59d3fff640 1 -- 172.21.15.177:0/1267460641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc009b30 con 0x7f59d40b42d0 2023-11-28T20:09:10.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.686+0000 7f59d3fff640 1 --2- 172.21.15.177:0/1267460641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59d40b42d0 0x7f59d414fad0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f59c400c450 tx=0x7f59c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:10.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.686+0000 7f59d0ff9640 1 -- 172.21.15.177:0/1267460641 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c40052d0 con 0x7f59d40b42d0 2023-11-28T20:09:10.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.686+0000 7f59d0ff9640 1 -- 172.21.15.177:0/1267460641 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c4005450 con 0x7f59d40b42d0 2023-11-28T20:09:10.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.686+0000 7f59da3aa640 1 -- 172.21.15.177:0/1267460641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d4151930 con 0x7f59d40b42d0 2023-11-28T20:09:10.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.686+0000 7f59d0ff9640 1 -- 172.21.15.177:0/1267460641 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4012870 con 0x7f59d40b42d0 2023-11-28T20:09:10.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.686+0000 7f59da3aa640 1 -- 172.21.15.177:0/1267460641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d414eb30 con 0x7f59d40b42d0 2023-11-28T20:09:10.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.686+0000 7f59da3aa640 1 -- 172.21.15.177:0/1267460641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d4151b70 con 0x7f59d40b42d0 2023-11-28T20:09:10.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.686+0000 7f59d0ff9640 1 -- 172.21.15.177:0/1267460641 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f59c40129d0 con 0x7f59d40b42d0 2023-11-28T20:09:10.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.686+0000 7f59d0ff9640 1 --2- 172.21.15.177:0/1267460641 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f59c0066470 0x7f59c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:10.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.686+0000 7f59d0ff9640 1 -- 172.21.15.177:0/1267460641 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f59c4083a90 con 0x7f59d40b42d0 2023-11-28T20:09:10.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.686+0000 7f59d37fe640 1 --2- 172.21.15.177:0/1267460641 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f59c0066470 0x7f59c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:10.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.690+0000 7f59d37fe640 1 --2- 172.21.15.177:0/1267460641 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f59c0066470 0x7f59c0068930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f59d4154120 tx=0x7f59c8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:10.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.690+0000 7f59d0ff9640 1 -- 172.21.15.177:0/1267460641 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f59d4151b70 con 0x7f59d40b42d0 2023-11-28T20:09:10.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.842+0000 7f59da3aa640 1 -- 172.21.15.177:0/1267460641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f59d4151b20 con 0x7f59d40b42d0 2023-11-28T20:09:10.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.842+0000 7f59d0ff9640 1 -- 172.21.15.177:0/1267460641 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f59c4050d90 con 0x7f59d40b42d0 2023-11-28T20:09:10.844 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:09:10.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.842+0000 7f59da3aa640 1 -- 172.21.15.177:0/1267460641 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f59c0066470 msgr2=0x7f59c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.842+0000 7f59da3aa640 1 --2- 172.21.15.177:0/1267460641 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f59c0066470 0x7f59c0068930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f59d4154120 tx=0x7f59c8009190 comp rx=0 tx=0).stop 2023-11-28T20:09:10.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.842+0000 7f59da3aa640 1 -- 172.21.15.177:0/1267460641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59d40b42d0 msgr2=0x7f59d414fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:10.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.842+0000 7f59da3aa640 1 --2- 172.21.15.177:0/1267460641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59d40b42d0 0x7f59d414fad0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f59c400c450 tx=0x7f59c400c910 comp rx=0 tx=0).stop 2023-11-28T20:09:10.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.842+0000 7f59da3aa640 1 -- 172.21.15.177:0/1267460641 shutdown_connections 2023-11-28T20:09:10.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.842+0000 7f59da3aa640 1 --2- 172.21.15.177:0/1267460641 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f59c0066470 0x7f59c0068930 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.842+0000 7f59da3aa640 1 --2- 172.21.15.177:0/1267460641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d4158ca0 0x7f59d413d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.842+0000 7f59da3aa640 1 --2- 172.21.15.177:0/1267460641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59d40cba10 0x7f59d4151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.842+0000 7f59da3aa640 1 --2- 172.21.15.177:0/1267460641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59d40b42d0 0x7f59d414fad0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:10.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.842+0000 7f59da3aa640 1 -- 172.21.15.177:0/1267460641 >> 172.21.15.177:0/1267460641 conn(0x7f59d40b0cc0 msgr2=0x7f59d4159740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:10.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.846+0000 7f59da3aa640 1 -- 172.21.15.177:0/1267460641 shutdown_connections 2023-11-28T20:09:10.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:10.846+0000 7f59da3aa640 1 -- 172.21.15.177:0/1267460641 wait complete. 2023-11-28T20:09:10.865 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:09:11.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.002+0000 7f318d69e640 1 Processor -- start 2023-11-28T20:09:11.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f318d69e640 1 -- start start 2023-11-28T20:09:11.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f318d69e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3188158ca0 0x7f318815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f318d69e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f31880cba10 0x7f318815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f318d69e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318815b670 con 0x7f31880b42d0 2023-11-28T20:09:11.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f318d69e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318815f410 con 0x7f31880cba10 2023-11-28T20:09:11.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f318d69e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318815f6f0 con 0x7f3188158ca0 2023-11-28T20:09:11.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f31877fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f31880b42d0 0x7f31880703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:55390/0 (socket says 172.21.15.177:55390) 2023-11-28T20:09:11.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f31877fe640 1 -- 172.21.15.177:0/2163741463 learned_addr learned my addr 172.21.15.177:0/2163741463 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:11.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f31867fc640 1 --2- 172.21.15.177:0/2163741463 >> v2:172.21.15.195:3300/0 conn(0x7f31880cba10 0x7f318815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f3186ffd640 1 --2- 172.21.15.177:0/2163741463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3188158ca0 0x7f318815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f3185ffb640 1 -- 172.21.15.177:0/2163741463 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376177771 0 0) 0x7f318815b670 con 0x7f31880b42d0 2023-11-28T20:09:11.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f3185ffb640 1 -- 172.21.15.177:0/2163741463 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3170003530 con 0x7f31880b42d0 2023-11-28T20:09:11.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f3186ffd640 1 -- 172.21.15.177:0/2163741463 >> v2:172.21.15.195:3300/0 conn(0x7f31880cba10 msgr2=0x7f318815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:11.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f3186ffd640 1 --2- 172.21.15.177:0/2163741463 >> v2:172.21.15.195:3300/0 conn(0x7f31880cba10 0x7f318815be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f3186ffd640 1 -- 172.21.15.177:0/2163741463 >> v1:172.21.15.177:6789/0 conn(0x7f31880b42d0 legacy=0x7f31880703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.006+0000 7f3186ffd640 1 -- 172.21.15.177:0/2163741463 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318815b8e0 con 0x7f3188158ca0 2023-11-28T20:09:11.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.010+0000 7f3186ffd640 1 --2- 172.21.15.177:0/2163741463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3188158ca0 0x7f318815eb50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f31780097c0 tx=0x7f317801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4728f40686e827e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:11.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.010+0000 7f3185ffb640 1 -- 172.21.15.177:0/2163741463 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31780a6040 con 0x7f3188158ca0 2023-11-28T20:09:11.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.010+0000 7f3185ffb640 1 -- 172.21.15.177:0/2163741463 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31780aa600 con 0x7f3188158ca0 2023-11-28T20:09:11.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.010+0000 7f3185ffb640 1 -- 172.21.15.177:0/2163741463 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31780aa990 con 0x7f3188158ca0 2023-11-28T20:09:11.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.010+0000 7f318d69e640 1 -- 172.21.15.177:0/2163741463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3188158ca0 msgr2=0x7f318815eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.010+0000 7f318d69e640 1 --2- 172.21.15.177:0/2163741463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3188158ca0 0x7f318815eb50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f31780097c0 tx=0x7f317801c480 comp rx=0 tx=0).stop 2023-11-28T20:09:11.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.010+0000 7f318d69e640 1 -- 172.21.15.177:0/2163741463 shutdown_connections 2023-11-28T20:09:11.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.010+0000 7f318d69e640 1 --2- 172.21.15.177:0/2163741463 >> v2:172.21.15.195:3300/0 conn(0x7f31880cba10 0x7f318815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.010+0000 7f318d69e640 1 --2- 172.21.15.177:0/2163741463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3188158ca0 0x7f318815eb50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.010+0000 7f318d69e640 1 -- 172.21.15.177:0/2163741463 >> 172.21.15.177:0/2163741463 conn(0x7f31880b0cc0 msgr2=0x7f31880b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:11.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.010+0000 7f318d69e640 1 -- 172.21.15.177:0/2163741463 shutdown_connections 2023-11-28T20:09:11.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.010+0000 7f318d69e640 1 -- 172.21.15.177:0/2163741463 wait complete. 2023-11-28T20:09:11.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f318d69e640 1 Processor -- start 2023-11-28T20:09:11.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f318d69e640 1 -- start start 2023-11-28T20:09:11.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f318d69e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31880b42d0 0x7f3188137540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f318d69e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31880cba10 0x7f3188148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f318d69e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3188158ca0 0x7f3188149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f318d69e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318815da50 con 0x7f31880cba10 2023-11-28T20:09:11.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f318d69e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318815c6d0 con 0x7f3188158ca0 2023-11-28T20:09:11.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f318d69e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318815c9b0 con 0x7f31880b42d0 2023-11-28T20:09:11.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f31867fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31880cba10 0x7f3188148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f31867fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31880cba10 0x7f3188148af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59476/0 (socket says 172.21.15.177:59476) 2023-11-28T20:09:11.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f31867fc640 1 -- 172.21.15.177:0/1639036056 learned_addr learned my addr 172.21.15.177:0/1639036056 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:11.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f3186ffd640 1 --2- 172.21.15.177:0/1639036056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31880b42d0 0x7f3188137540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f31877fe640 1 --2- 172.21.15.177:0/1639036056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3188158ca0 0x7f3188149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f31867fc640 1 -- 172.21.15.177:0/1639036056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31880b42d0 msgr2=0x7f3188137540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f31867fc640 1 --2- 172.21.15.177:0/1639036056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31880b42d0 0x7f3188137540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f31867fc640 1 -- 172.21.15.177:0/1639036056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3188158ca0 msgr2=0x7f3188149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f31867fc640 1 --2- 172.21.15.177:0/1639036056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3188158ca0 0x7f3188149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f31867fc640 1 -- 172.21.15.177:0/1639036056 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3178009420 con 0x7f31880cba10 2023-11-28T20:09:11.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f3186ffd640 1 --2- 172.21.15.177:0/1639036056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31880b42d0 0x7f3188137540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:11.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f31867fc640 1 --2- 172.21.15.177:0/1639036056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31880cba10 0x7f3188148af0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f317c00e900 tx=0x7f317c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:11.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f316f7fe640 1 -- 172.21.15.177:0/1639036056 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c009690 con 0x7f31880cba10 2023-11-28T20:09:11.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f316f7fe640 1 -- 172.21.15.177:0/1639036056 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c00ca00 con 0x7f31880cba10 2023-11-28T20:09:11.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f318d69e640 1 -- 172.21.15.177:0/1639036056 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318815cc90 con 0x7f31880cba10 2023-11-28T20:09:11.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f316f7fe640 1 -- 172.21.15.177:0/1639036056 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c00cdb0 con 0x7f31880cba10 2023-11-28T20:09:11.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f318d69e640 1 -- 172.21.15.177:0/1639036056 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318815d250 con 0x7f31880cba10 2023-11-28T20:09:11.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.014+0000 7f318d69e640 1 -- 172.21.15.177:0/1639036056 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31880693d0 con 0x7f31880cba10 2023-11-28T20:09:11.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.018+0000 7f316f7fe640 1 -- 172.21.15.177:0/1639036056 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f317c013470 con 0x7f31880cba10 2023-11-28T20:09:11.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.018+0000 7f316f7fe640 1 --2- 172.21.15.177:0/1639036056 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3174066470 0x7f3174068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.018+0000 7f316f7fe640 1 -- 172.21.15.177:0/1639036056 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f317c0841d0 con 0x7f31880cba10 2023-11-28T20:09:11.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.018+0000 7f3186ffd640 1 --2- 172.21.15.177:0/1639036056 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3174066470 0x7f3174068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.018+0000 7f3186ffd640 1 --2- 172.21.15.177:0/1639036056 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3174066470 0x7f3174068930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f31780ae000 tx=0x7f31780a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:11.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.022+0000 7f316f7fe640 1 -- 172.21.15.177:0/1639036056 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f317c051550 con 0x7f31880cba10 2023-11-28T20:09:11.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.174+0000 7f318d69e640 1 -- 172.21.15.177:0/1639036056 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31880b1990 con 0x7f31880cba10 2023-11-28T20:09:11.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.174+0000 7f316f7fe640 1 -- 172.21.15.177:0/1639036056 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f317c054b70 con 0x7f31880cba10 2023-11-28T20:09:11.176 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:09:11.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.174+0000 7f318d69e640 1 -- 172.21.15.177:0/1639036056 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3174066470 msgr2=0x7f3174068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.174+0000 7f318d69e640 1 --2- 172.21.15.177:0/1639036056 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3174066470 0x7f3174068930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f31780ae000 tx=0x7f31780a7000 comp rx=0 tx=0).stop 2023-11-28T20:09:11.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.174+0000 7f318d69e640 1 -- 172.21.15.177:0/1639036056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31880cba10 msgr2=0x7f3188148af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.174+0000 7f318d69e640 1 --2- 172.21.15.177:0/1639036056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31880cba10 0x7f3188148af0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f317c00e900 tx=0x7f317c00edc0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.174+0000 7f318d69e640 1 -- 172.21.15.177:0/1639036056 shutdown_connections 2023-11-28T20:09:11.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.174+0000 7f318d69e640 1 --2- 172.21.15.177:0/1639036056 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3174066470 0x7f3174068930 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.174+0000 7f318d69e640 1 --2- 172.21.15.177:0/1639036056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3188158ca0 0x7f3188149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.174+0000 7f318d69e640 1 --2- 172.21.15.177:0/1639036056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31880cba10 0x7f3188148af0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.174+0000 7f318d69e640 1 --2- 172.21.15.177:0/1639036056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31880b42d0 0x7f3188137540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.174+0000 7f318d69e640 1 -- 172.21.15.177:0/1639036056 >> 172.21.15.177:0/1639036056 conn(0x7f31880b0cc0 msgr2=0x7f31881590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:11.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.174+0000 7f318d69e640 1 -- 172.21.15.177:0/1639036056 shutdown_connections 2023-11-28T20:09:11.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.174+0000 7f318d69e640 1 -- 172.21.15.177:0/1639036056 wait complete. 2023-11-28T20:09:11.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-11-28T20:09:11.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feebb5aa640 1 Processor -- start 2023-11-28T20:09:11.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feebb5aa640 1 -- start start 2023-11-28T20:09:11.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feebb5aa640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7feeb414abe0 0x7feeb4165a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feebb5aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feeb40b4520 0x7feeb40703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feebb5aa640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb40b1fc0 con 0x7feeb414b1e0 2023-11-28T20:09:11.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feebb5aa640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb40b2260 con 0x7feeb414abe0 2023-11-28T20:09:11.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feebb5aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40b2540 con 0x7feeb40b4520 2023-11-28T20:09:11.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feeb8b45640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7feeb414b1e0 0x7feeb40b3e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:55406/0 (socket says 172.21.15.177:55406) 2023-11-28T20:09:11.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feeb8b45640 1 -- 172.21.15.177:0/1504838776 learned_addr learned my addr 172.21.15.177:0/1504838776 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:11.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feeb9346640 1 --2- 172.21.15.177:0/1504838776 >> v2:172.21.15.195:3300/0 conn(0x7feeb414abe0 0x7feeb4165a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feeb9b47640 1 --2- 172.21.15.177:0/1504838776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feeb40b4520 0x7feeb40703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feeabfff640 1 -- 172.21.15.177:0/1504838776 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559240817 0 0) 0x7feeb40b1fc0 con 0x7feeb414b1e0 2023-11-28T20:09:11.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feeabfff640 1 -- 172.21.15.177:0/1504838776 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea0003530 con 0x7feeb414b1e0 2023-11-28T20:09:11.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feeabfff640 1 -- 172.21.15.177:0/1504838776 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 737914565 0 0) 0x7feea0003530 con 0x7feeb414b1e0 2023-11-28T20:09:11.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feeabfff640 1 -- 172.21.15.177:0/1504838776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feeb40b4520 msgr2=0x7feeb40703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:11.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.338+0000 7feeabfff640 1 --2- 172.21.15.177:0/1504838776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feeb40b4520 0x7feeb40703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeabfff640 1 -- 172.21.15.177:0/1504838776 >> v2:172.21.15.195:3300/0 conn(0x7feeb414abe0 msgr2=0x7feeb4165a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:11.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeabfff640 1 --2- 172.21.15.177:0/1504838776 >> v2:172.21.15.195:3300/0 conn(0x7feeb414abe0 0x7feeb4165a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeabfff640 1 -- 172.21.15.177:0/1504838776 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb40b2820 con 0x7feeb414b1e0 2023-11-28T20:09:11.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeabfff640 1 -- 172.21.15.177:0/1504838776 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7feea4001680 con 0x7feeb414b1e0 2023-11-28T20:09:11.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeabfff640 1 -- 172.21.15.177:0/1504838776 >> v1:172.21.15.177:6789/0 conn(0x7feeb414b1e0 legacy=0x7feeb40b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeabfff640 1 --2- 172.21.15.177:0/1504838776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feea0003980 0x7feea0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeabfff640 1 --2- 172.21.15.177:0/1504838776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feea00047d0 0x7feea0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeabfff640 1 --2- 172.21.15.177:0/1504838776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feea0005190 0x7feea000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeabfff640 1 -- 172.21.15.177:0/1504838776 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40b2260 con 0x7feea0005190 2023-11-28T20:09:11.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeabfff640 1 -- 172.21.15.177:0/1504838776 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40b2540 con 0x7feea0003980 2023-11-28T20:09:11.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeabfff640 1 -- 172.21.15.177:0/1504838776 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea000bed0 con 0x7feea00047d0 2023-11-28T20:09:11.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeb9b47640 1 --2- 172.21.15.177:0/1504838776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feeb40b4520 0x7feeb40703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:09:11.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeb9346640 1 --2- 172.21.15.177:0/1504838776 >> v2:172.21.15.195:3300/0 conn(0x7feeb414abe0 0x7feeb4165a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:09:11.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeb9b47640 1 --2- 172.21.15.177:0/1504838776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feea0005190 0x7feea000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeb9346640 1 --2- 172.21.15.177:0/1504838776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feea0003980 0x7feea0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeb8b45640 1 --2- 172.21.15.177:0/1504838776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feea00047d0 0x7feea0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeb9b47640 1 -- 172.21.15.177:0/1504838776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feea00047d0 msgr2=0x7feea0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:11.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeb9b47640 1 --2- 172.21.15.177:0/1504838776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feea00047d0 0x7feea0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeb9b47640 1 -- 172.21.15.177:0/1504838776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feea0003980 msgr2=0x7feea0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:11.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeb9b47640 1 --2- 172.21.15.177:0/1504838776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feea0003980 0x7feea0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeb9b47640 1 -- 172.21.15.177:0/1504838776 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea0003530 con 0x7feea0005190 2023-11-28T20:09:11.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeb9b47640 1 --2- 172.21.15.177:0/1504838776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feea0005190 0x7feea000b990 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7feeac00e1f0 tx=0x7feeac01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f009a5cc52b9dee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:11.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeabfff640 1 -- 172.21.15.177:0/1504838776 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac0a5d10 con 0x7feea0005190 2023-11-28T20:09:11.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeabfff640 1 -- 172.21.15.177:0/1504838776 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac00f040 con 0x7feea0005190 2023-11-28T20:09:11.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.342+0000 7feeabfff640 1 -- 172.21.15.177:0/1504838776 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac003bc0 con 0x7feea0005190 2023-11-28T20:09:11.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feebb5aa640 1 -- 172.21.15.177:0/1504838776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feea0005190 msgr2=0x7feea000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feebb5aa640 1 --2- 172.21.15.177:0/1504838776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feea0005190 0x7feea000b990 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7feeac00e1f0 tx=0x7feeac01ccc0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feeb9b47640 1 -- 172.21.15.177:0/1504838776 reap_dead start 2023-11-28T20:09:11.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feebb5aa640 1 -- 172.21.15.177:0/1504838776 shutdown_connections 2023-11-28T20:09:11.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feebb5aa640 1 -- 172.21.15.177:0/1504838776 >> 172.21.15.177:0/1504838776 conn(0x7feeb40b0cc0 msgr2=0x7feeb40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:11.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feebb5aa640 1 -- 172.21.15.177:0/1504838776 shutdown_connections 2023-11-28T20:09:11.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feebb5aa640 1 -- 172.21.15.177:0/1504838776 wait complete. 2023-11-28T20:09:11.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feebb5aa640 1 Processor -- start 2023-11-28T20:09:11.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feebb5aa640 1 -- start start 2023-11-28T20:09:11.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feebb5aa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feea0005190 0x7feeb415dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feebb5aa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feeb4143980 0x7feeb41fa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feebb5aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feeb40702f0 0x7feeb4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feebb5aa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb4070cb0 con 0x7feeb4143980 2023-11-28T20:09:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feebb5aa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb41fb7c0 con 0x7feea0005190 2023-11-28T20:09:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feebb5aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb41fb200 con 0x7feeb40702f0 2023-11-28T20:09:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feeb8b45640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feeb4143980 0x7feeb41fa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feeb8b45640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feeb4143980 0x7feeb41fa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59488/0 (socket says 172.21.15.177:59488) 2023-11-28T20:09:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feeb8b45640 1 -- 172.21.15.177:0/1984797745 learned_addr learned my addr 172.21.15.177:0/1984797745 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feeb9b47640 1 --2- 172.21.15.177:0/1984797745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feeb40702f0 0x7feeb4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.346+0000 7feeb9346640 1 --2- 172.21.15.177:0/1984797745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feea0005190 0x7feeb415dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feeb8b45640 1 -- 172.21.15.177:0/1984797745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feeb40702f0 msgr2=0x7feeb4070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feeb8b45640 1 --2- 172.21.15.177:0/1984797745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feeb40702f0 0x7feeb4070770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feeb8b45640 1 -- 172.21.15.177:0/1984797745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feea0005190 msgr2=0x7feeb415dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feeb8b45640 1 --2- 172.21.15.177:0/1984797745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feea0005190 0x7feeb415dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feeb8b45640 1 -- 172.21.15.177:0/1984797745 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb41fb4e0 con 0x7feeb4143980 2023-11-28T20:09:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feeb8b45640 1 --2- 172.21.15.177:0/1984797745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feeb4143980 0x7feeb41fa890 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7feea400e7c0 tx=0x7feea400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feea9ffb640 1 -- 172.21.15.177:0/1984797745 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400eed0 con 0x7feeb4143980 2023-11-28T20:09:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feea9ffb640 1 -- 172.21.15.177:0/1984797745 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea400c870 con 0x7feeb4143980 2023-11-28T20:09:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feebb5aa640 1 -- 172.21.15.177:0/1984797745 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb4140e60 con 0x7feeb4143980 2023-11-28T20:09:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feea9ffb640 1 -- 172.21.15.177:0/1984797745 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400cc20 con 0x7feeb4143980 2023-11-28T20:09:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feebb5aa640 1 -- 172.21.15.177:0/1984797745 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb41fadd0 con 0x7feeb4143980 2023-11-28T20:09:11.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feebb5aa640 1 -- 172.21.15.177:0/1984797745 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb4164050 con 0x7feeb4143980 2023-11-28T20:09:11.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feea9ffb640 1 -- 172.21.15.177:0/1984797745 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feea401d460 con 0x7feeb4143980 2023-11-28T20:09:11.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feea9ffb640 1 --2- 172.21.15.177:0/1984797745 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee980664f0 0x7fee980689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feea9ffb640 1 -- 172.21.15.177:0/1984797745 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7feea4083e00 con 0x7feeb4143980 2023-11-28T20:09:11.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.350+0000 7feeb9346640 1 --2- 172.21.15.177:0/1984797745 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee980664f0 0x7fee980689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.354+0000 7feeb9346640 1 --2- 172.21.15.177:0/1984797745 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee980664f0 0x7fee980689b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feeb00093f0 tx=0x7feeb0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:11.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.354+0000 7feea9ffb640 1 -- 172.21.15.177:0/1984797745 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feea4051210 con 0x7feeb4143980 2023-11-28T20:09:11.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.506+0000 7feebb5aa640 1 -- 172.21.15.177:0/1984797745 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7feeb40cbc40 con 0x7feeb4143980 2023-11-28T20:09:11.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.506+0000 7feea9ffb640 1 -- 172.21.15.177:0/1984797745 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v36) v1 ==== 97+0+11 (secure 0 0 0) 0x7feea4054830 con 0x7feeb4143980 2023-11-28T20:09:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:09:11.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.510+0000 7feebb5aa640 1 -- 172.21.15.177:0/1984797745 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee980664f0 msgr2=0x7fee980689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.510+0000 7feebb5aa640 1 --2- 172.21.15.177:0/1984797745 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee980664f0 0x7fee980689b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feeb00093f0 tx=0x7feeb0009190 comp rx=0 tx=0).stop 2023-11-28T20:09:11.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.510+0000 7feebb5aa640 1 -- 172.21.15.177:0/1984797745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feeb4143980 msgr2=0x7feeb41fa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.510+0000 7feebb5aa640 1 --2- 172.21.15.177:0/1984797745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feeb4143980 0x7feeb41fa890 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7feea400e7c0 tx=0x7feea400ec80 comp rx=0 tx=0).stop 2023-11-28T20:09:11.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.510+0000 7feebb5aa640 1 -- 172.21.15.177:0/1984797745 shutdown_connections 2023-11-28T20:09:11.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.510+0000 7feebb5aa640 1 --2- 172.21.15.177:0/1984797745 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee980664f0 0x7fee980689b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.510+0000 7feebb5aa640 1 --2- 172.21.15.177:0/1984797745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feeb40702f0 0x7feeb4070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.510+0000 7feebb5aa640 1 --2- 172.21.15.177:0/1984797745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feeb4143980 0x7feeb41fa890 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.510+0000 7feebb5aa640 1 --2- 172.21.15.177:0/1984797745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feea0005190 0x7feeb415dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.510+0000 7feebb5aa640 1 -- 172.21.15.177:0/1984797745 >> 172.21.15.177:0/1984797745 conn(0x7feeb40b0cc0 msgr2=0x7feeb4071090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.510+0000 7feebb5aa640 1 -- 172.21.15.177:0/1984797745 shutdown_connections 2023-11-28T20:09:11.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.510+0000 7feebb5aa640 1 -- 172.21.15.177:0/1984797745 wait complete. 2023-11-28T20:09:11.530 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:09:11.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd3180640 1 Processor -- start 2023-11-28T20:09:11.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd3180640 1 -- start start 2023-11-28T20:09:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd3180640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbcc144840 0x7fcbcc06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd3180640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcbcc072180 0x7fcbcc06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd3180640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcbcc070460 0x7fcbcc0708e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd3180640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbcc15f010 con 0x7fcbcc070460 2023-11-28T20:09:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd3180640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbcc070e20 con 0x7fcbcc072180 2023-11-28T20:09:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd3180640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0710e0 con 0x7fcbcc144840 2023-11-28T20:09:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd171d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcbcc070460 0x7fcbcc0708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd171d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcbcc070460 0x7fcbcc0708e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59496/0 (socket says 172.21.15.177:59496) 2023-11-28T20:09:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd171d640 1 -- 172.21.15.177:0/390428474 learned_addr learned my addr 172.21.15.177:0/390428474 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd0f1c640 1 --2- 172.21.15.177:0/390428474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbcc144840 0x7fcbcc06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbc3fff640 1 --2- 172.21.15.177:0/390428474 >> v2:172.21.15.195:3300/0 conn(0x7fcbcc072180 0x7fcbcc06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd171d640 1 -- 172.21.15.177:0/390428474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbcc144840 msgr2=0x7fcbcc06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd171d640 1 --2- 172.21.15.177:0/390428474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbcc144840 0x7fcbcc06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd171d640 1 -- 172.21.15.177:0/390428474 >> v2:172.21.15.195:3300/0 conn(0x7fcbcc072180 msgr2=0x7fcbcc06c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd171d640 1 --2- 172.21.15.177:0/390428474 >> v2:172.21.15.195:3300/0 conn(0x7fcbcc072180 0x7fcbcc06c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.666+0000 7fcbd171d640 1 -- 172.21.15.177:0/390428474 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc0713c0 con 0x7fcbcc070460 2023-11-28T20:09:11.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.670+0000 7fcbd171d640 1 --2- 172.21.15.177:0/390428474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbcc070460 0x7fcbcc0708e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc067f30 tx=0x7fcbc401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d59421bc8c99fd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:11.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.670+0000 7fcbc37fe640 1 -- 172.21.15.177:0/390428474 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc40a5820 con 0x7fcbcc070460 2023-11-28T20:09:11.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.670+0000 7fcbc37fe640 1 -- 172.21.15.177:0/390428474 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc40a5980 con 0x7fcbcc070460 2023-11-28T20:09:11.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.670+0000 7fcbc37fe640 1 -- 172.21.15.177:0/390428474 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc40a5d10 con 0x7fcbcc070460 2023-11-28T20:09:11.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.670+0000 7fcbd3180640 1 -- 172.21.15.177:0/390428474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbcc070460 msgr2=0x7fcbcc0708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.670+0000 7fcbd3180640 1 --2- 172.21.15.177:0/390428474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbcc070460 0x7fcbcc0708e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc067f30 tx=0x7fcbc401c9a0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.670+0000 7fcbd3180640 1 -- 172.21.15.177:0/390428474 shutdown_connections 2023-11-28T20:09:11.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.670+0000 7fcbd3180640 1 --2- 172.21.15.177:0/390428474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbcc070460 0x7fcbcc0708e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.670+0000 7fcbd3180640 1 --2- 172.21.15.177:0/390428474 >> v2:172.21.15.195:3300/0 conn(0x7fcbcc072180 0x7fcbcc06c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.670+0000 7fcbd3180640 1 --2- 172.21.15.177:0/390428474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbcc144840 0x7fcbcc06c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.670+0000 7fcbd3180640 1 -- 172.21.15.177:0/390428474 >> 172.21.15.177:0/390428474 conn(0x7fcbcc06a530 msgr2=0x7fcbcc06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:11.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.670+0000 7fcbd3180640 1 -- 172.21.15.177:0/390428474 shutdown_connections 2023-11-28T20:09:11.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.670+0000 7fcbd3180640 1 -- 172.21.15.177:0/390428474 wait complete. 2023-11-28T20:09:11.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbd3180640 1 Processor -- start 2023-11-28T20:09:11.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbd3180640 1 -- start start 2023-11-28T20:09:11.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbd3180640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbcc070460 0x7fcbcc164350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbd3180640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbcc072180 0x7fcbcc13f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbd3180640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbcc144840 0x7fcbcc13f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbd3180640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc13fec0 con 0x7fcbcc072180 2023-11-28T20:09:11.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbd3180640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0b3170 con 0x7fcbcc070460 2023-11-28T20:09:11.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbd3180640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0b3450 con 0x7fcbcc144840 2023-11-28T20:09:11.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbc3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbcc072180 0x7fcbcc13f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbc3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbcc072180 0x7fcbcc13f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59510/0 (socket says 172.21.15.177:59510) 2023-11-28T20:09:11.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbc3fff640 1 -- 172.21.15.177:0/2962828462 learned_addr learned my addr 172.21.15.177:0/2962828462 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:11.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbc3fff640 1 -- 172.21.15.177:0/2962828462 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbcc144840 msgr2=0x7fcbcc13f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbd0f1c640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbcc070460 0x7fcbcc164350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbd171d640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbcc144840 0x7fcbcc13f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbc3fff640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbcc144840 0x7fcbcc13f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbc3fff640 1 -- 172.21.15.177:0/2962828462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbcc070460 msgr2=0x7fcbcc164350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbc3fff640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbcc070460 0x7fcbcc164350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbc3fff640 1 -- 172.21.15.177:0/2962828462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4009b30 con 0x7fcbcc072180 2023-11-28T20:09:11.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbd171d640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbcc144840 0x7fcbcc13f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:11.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbd0f1c640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbcc070460 0x7fcbcc164350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:11.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbc3fff640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbcc072180 0x7fcbcc13f440 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc00d7d0 tx=0x7fcbbc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:11.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbc17fa640 1 -- 172.21.15.177:0/2962828462 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc018070 con 0x7fcbcc072180 2023-11-28T20:09:11.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbc17fa640 1 -- 172.21.15.177:0/2962828462 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc004020 con 0x7fcbcc072180 2023-11-28T20:09:11.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbc17fa640 1 -- 172.21.15.177:0/2962828462 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc0041d0 con 0x7fcbcc072180 2023-11-28T20:09:11.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbd3180640 1 -- 172.21.15.177:0/2962828462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbcc0b3730 con 0x7fcbcc072180 2023-11-28T20:09:11.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.674+0000 7fcbd3180640 1 -- 172.21.15.177:0/2962828462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbcc0b3cf0 con 0x7fcbcc072180 2023-11-28T20:09:11.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.678+0000 7fcbd3180640 1 -- 172.21.15.177:0/2962828462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbcc0b3e80 con 0x7fcbcc072180 2023-11-28T20:09:11.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.678+0000 7fcbc17fa640 1 -- 172.21.15.177:0/2962828462 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcbbc004330 con 0x7fcbcc072180 2023-11-28T20:09:11.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.678+0000 7fcbc17fa640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcbb8066470 0x7fcbb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:11.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.678+0000 7fcbc17fa640 1 -- 172.21.15.177:0/2962828462 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fcbbc083f00 con 0x7fcbcc072180 2023-11-28T20:09:11.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.678+0000 7fcbd0f1c640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcbb8066470 0x7fcbb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:11.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.678+0000 7fcbd0f1c640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcbb8066470 0x7fcbb8068930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009720 tx=0x7fcbc8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:11.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.682+0000 7fcbc17fa640 1 -- 172.21.15.177:0/2962828462 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcbbc0511e0 con 0x7fcbcc072180 2023-11-28T20:09:11.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.842+0000 7fcbd3180640 1 -- 172.21.15.177:0/2962828462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcbcc069440 con 0x7fcbcc072180 2023-11-28T20:09:11.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.846+0000 7fcbc17fa640 1 -- 172.21.15.177:0/2962828462 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcbbc054800 con 0x7fcbcc072180 2023-11-28T20:09:11.847 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:09:11.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.846+0000 7fcbd3180640 1 -- 172.21.15.177:0/2962828462 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcbb8066470 msgr2=0x7fcbb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.846+0000 7fcbd3180640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcbb8066470 0x7fcbb8068930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009720 tx=0x7fcbc8008040 comp rx=0 tx=0).stop 2023-11-28T20:09:11.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.846+0000 7fcbd3180640 1 -- 172.21.15.177:0/2962828462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbcc072180 msgr2=0x7fcbcc13f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:11.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.846+0000 7fcbd3180640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbcc072180 0x7fcbcc13f440 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc00d7d0 tx=0x7fcbbc00dc90 comp rx=0 tx=0).stop 2023-11-28T20:09:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.846+0000 7fcbd3180640 1 -- 172.21.15.177:0/2962828462 shutdown_connections 2023-11-28T20:09:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.846+0000 7fcbd3180640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcbb8066470 0x7fcbb8068930 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.846+0000 7fcbd3180640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbcc144840 0x7fcbcc13f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.846+0000 7fcbd3180640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbcc072180 0x7fcbcc13f440 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.846+0000 7fcbd3180640 1 --2- 172.21.15.177:0/2962828462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbcc070460 0x7fcbcc164350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.846+0000 7fcbd3180640 1 -- 172.21.15.177:0/2962828462 >> 172.21.15.177:0/2962828462 conn(0x7fcbcc06a530 msgr2=0x7fcbcc06c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.846+0000 7fcbd3180640 1 -- 172.21.15.177:0/2962828462 shutdown_connections 2023-11-28T20:09:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:11.846+0000 7fcbd3180640 1 -- 172.21.15.177:0/2962828462 wait complete. 2023-11-28T20:09:11.867 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-11-28T20:09:11.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:11.867 DEBUG:teuthology.orchestra.run.smithi177:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:11.886 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[49600]: fuse finished with error 0 and tester_r 0 2023-11-28T20:09:11.889 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:09:17.991 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:09:17.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:17.991 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T20:09:18.002 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2023-11-28T20:09:18.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06b0e5a640 1 Processor -- start 2023-11-28T20:09:18.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06b0e5a640 1 -- start start 2023-11-28T20:09:18.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06b0e5a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f06ac072530 0x7f06ac0cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:18.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06b0e5a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06ac0ce200 0x7f06ac13e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:18.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06b0e5a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac0ced10 con 0x7f06ac13d0a0 2023-11-28T20:09:18.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06b0e5a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac13d480 con 0x7f06ac072530 2023-11-28T20:09:18.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06b0e5a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0cea30 con 0x7f06ac0ce200 2023-11-28T20:09:18.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06aa59c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f06ac13d0a0 0x7f06ac071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:55418/0 (socket says 172.21.15.177:55418) 2023-11-28T20:09:18.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06aa59c640 1 -- 172.21.15.177:0/3769924158 learned_addr learned my addr 172.21.15.177:0/3769924158 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:18.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06aad9d640 1 --2- 172.21.15.177:0/3769924158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06ac0ce200 0x7f06ac13e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:18.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06a9d9b640 1 --2- 172.21.15.177:0/3769924158 >> v2:172.21.15.195:3300/0 conn(0x7f06ac072530 0x7f06ac0cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:18.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06a959a640 1 -- 172.21.15.177:0/3769924158 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134821720 0 0) 0x7f06ac0ced10 con 0x7f06ac13d0a0 2023-11-28T20:09:18.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06a959a640 1 -- 172.21.15.177:0/3769924158 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0694003530 con 0x7f06ac13d0a0 2023-11-28T20:09:18.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06a959a640 1 -- 172.21.15.177:0/3769924158 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1002011693 0 0) 0x7f0694003530 con 0x7f06ac13d0a0 2023-11-28T20:09:18.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06aad9d640 1 -- 172.21.15.177:0/3769924158 >> v2:172.21.15.195:3300/0 conn(0x7f06ac072530 msgr2=0x7f06ac0cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:18.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06aad9d640 1 --2- 172.21.15.177:0/3769924158 >> v2:172.21.15.195:3300/0 conn(0x7f06ac072530 0x7f06ac0cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06aad9d640 1 -- 172.21.15.177:0/3769924158 >> v1:172.21.15.177:6789/0 conn(0x7f06ac13d0a0 legacy=0x7f06ac071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:18.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.197+0000 7f06aad9d640 1 -- 172.21.15.177:0/3769924158 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac13d800 con 0x7f06ac0ce200 2023-11-28T20:09:18.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.201+0000 7f06aad9d640 1 --2- 172.21.15.177:0/3769924158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06ac0ce200 0x7f06ac13e2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009d90 tx=0x7f06a401e9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58c087a42d11c4b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:18.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.201+0000 7f06a959a640 1 -- 172.21.15.177:0/3769924158 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c001680 con 0x7f06ac0ce200 2023-11-28T20:09:18.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.201+0000 7f06a959a640 1 -- 172.21.15.177:0/3769924158 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a40a77d0 con 0x7f06ac0ce200 2023-11-28T20:09:18.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.201+0000 7f06a959a640 1 -- 172.21.15.177:0/3769924158 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a40a7b60 con 0x7f06ac0ce200 2023-11-28T20:09:18.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.201+0000 7f06b0e5a640 1 -- 172.21.15.177:0/3769924158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06ac0ce200 msgr2=0x7f06ac13e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:18.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.201+0000 7f06b0e5a640 1 --2- 172.21.15.177:0/3769924158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06ac0ce200 0x7f06ac13e2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009d90 tx=0x7f06a401e9c0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.201+0000 7f06b0e5a640 1 -- 172.21.15.177:0/3769924158 shutdown_connections 2023-11-28T20:09:18.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.201+0000 7f06b0e5a640 1 --2- 172.21.15.177:0/3769924158 >> v2:172.21.15.195:3300/0 conn(0x7f06ac072530 0x7f06ac0cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.201+0000 7f06b0e5a640 1 --2- 172.21.15.177:0/3769924158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06ac0ce200 0x7f06ac13e2e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.201+0000 7f06b0e5a640 1 -- 172.21.15.177:0/3769924158 >> 172.21.15.177:0/3769924158 conn(0x7f06ac0b0cc0 msgr2=0x7f06ac0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:18.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.201+0000 7f06b0e5a640 1 -- 172.21.15.177:0/3769924158 shutdown_connections 2023-11-28T20:09:18.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.201+0000 7f06b0e5a640 1 -- 172.21.15.177:0/3769924158 wait complete. 2023-11-28T20:09:18.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06b0e5a640 1 Processor -- start 2023-11-28T20:09:18.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06b0e5a640 1 -- start start 2023-11-28T20:09:18.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06b0e5a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06ac072530 0x7f06ac1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:18.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06b0e5a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06ac0ce200 0x7f06ac0b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:18.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06b0e5a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06ac13d0a0 0x7f06ac155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:18.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06b0e5a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0b4d90 con 0x7f06ac13d0a0 2023-11-28T20:09:18.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06b0e5a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac156270 con 0x7f06ac072530 2023-11-28T20:09:18.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06b0e5a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0b3030 con 0x7f06ac0ce200 2023-11-28T20:09:18.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06aad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06ac13d0a0 0x7f06ac155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:18.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06aad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06ac13d0a0 0x7f06ac155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59526/0 (socket says 172.21.15.177:59526) 2023-11-28T20:09:18.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06aad9d640 1 -- 172.21.15.177:0/4257711241 learned_addr learned my addr 172.21.15.177:0/4257711241 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:18.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06aa59c640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06ac072530 0x7f06ac1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:18.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06a9d9b640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06ac0ce200 0x7f06ac0b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:18.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06aad9d640 1 -- 172.21.15.177:0/4257711241 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06ac0ce200 msgr2=0x7f06ac0b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:18.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06aad9d640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06ac0ce200 0x7f06ac0b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06aad9d640 1 -- 172.21.15.177:0/4257711241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06ac072530 msgr2=0x7f06ac1559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06aad9d640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06ac072530 0x7f06ac1559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06aad9d640 1 -- 172.21.15.177:0/4257711241 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a4009a70 con 0x7f06ac13d0a0 2023-11-28T20:09:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06a9d9b640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06ac0ce200 0x7f06ac0b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06aa59c640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06ac072530 0x7f06ac1559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06aad9d640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06ac13d0a0 0x7f06ac155250 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009d90 tx=0x7f06a401b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f069affd640 1 -- 172.21.15.177:0/4257711241 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a40ba670 con 0x7f06ac13d0a0 2023-11-28T20:09:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f069affd640 1 -- 172.21.15.177:0/4257711241 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a40ba7d0 con 0x7f06ac13d0a0 2023-11-28T20:09:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f069affd640 1 -- 172.21.15.177:0/4257711241 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a40bab60 con 0x7f06ac13d0a0 2023-11-28T20:09:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06b0e5a640 1 -- 172.21.15.177:0/4257711241 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac0b3310 con 0x7f06ac13d0a0 2023-11-28T20:09:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.205+0000 7f06b0e5a640 1 -- 172.21.15.177:0/4257711241 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac0b38d0 con 0x7f06ac13d0a0 2023-11-28T20:09:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.209+0000 7f06b0e5a640 1 -- 172.21.15.177:0/4257711241 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac069440 con 0x7f06ac13d0a0 2023-11-28T20:09:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.209+0000 7f069affd640 1 -- 172.21.15.177:0/4257711241 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f06a40b6070 con 0x7f06ac13d0a0 2023-11-28T20:09:18.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.209+0000 7f069affd640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f068c066470 0x7f068c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:18.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.209+0000 7f069affd640 1 -- 172.21.15.177:0/4257711241 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f06a411f020 con 0x7f06ac13d0a0 2023-11-28T20:09:18.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.209+0000 7f06aa59c640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f068c066470 0x7f068c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:18.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.209+0000 7f06aa59c640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f068c066470 0x7f068c068930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f069c005890 tx=0x7f069c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:18.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.213+0000 7f069affd640 1 -- 172.21.15.177:0/4257711241 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f06a40ec310 con 0x7f06ac13d0a0 2023-11-28T20:09:18.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.413+0000 7f06b0e5a640 1 -- 172.21.15.177:0/4257711241 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f06ac155790 con 0x7f06ac13d0a0 2023-11-28T20:09:18.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.417+0000 7f069affd640 1 -- 172.21.15.177:0/4257711241 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v17) v1 ==== 211+0+168 (secure 0 0 0) 0x7f06a40b40c0 con 0x7f06ac13d0a0 2023-11-28T20:09:18.421 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-11-28T20:09:18.421 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZl+2t5KxAAc/J7x+fjSQR4IkIQJ/X8sw== 2023-11-28T20:09:18.422 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow rwp" 2023-11-28T20:09:18.422 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-11-28T20:09:18.422 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2023-11-28T20:09:18.424 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-11-28T20:09:18.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.421+0000 7f06b0e5a640 1 -- 172.21.15.177:0/4257711241 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f068c066470 msgr2=0x7f068c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:18.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.421+0000 7f06b0e5a640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f068c066470 0x7f068c068930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f069c005890 tx=0x7f069c009040 comp rx=0 tx=0).stop 2023-11-28T20:09:18.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.421+0000 7f06b0e5a640 1 -- 172.21.15.177:0/4257711241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06ac13d0a0 msgr2=0x7f06ac155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:18.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.421+0000 7f06b0e5a640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06ac13d0a0 0x7f06ac155250 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009d90 tx=0x7f06a401b760 comp rx=0 tx=0).stop 2023-11-28T20:09:18.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.421+0000 7f06b0e5a640 1 -- 172.21.15.177:0/4257711241 shutdown_connections 2023-11-28T20:09:18.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.421+0000 7f06b0e5a640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f068c066470 0x7f068c068930 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.421+0000 7f06b0e5a640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06ac13d0a0 0x7f06ac155250 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.421+0000 7f06b0e5a640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06ac0ce200 0x7f06ac0b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.421+0000 7f06b0e5a640 1 --2- 172.21.15.177:0/4257711241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06ac072530 0x7f06ac1559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.421+0000 7f06b0e5a640 1 -- 172.21.15.177:0/4257711241 >> 172.21.15.177:0/4257711241 conn(0x7f06ac0b0cc0 msgr2=0x7f06ac1429f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:18.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.421+0000 7f06b0e5a640 1 -- 172.21.15.177:0/4257711241 shutdown_connections 2023-11-28T20:09:18.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.421+0000 7f06b0e5a640 1 -- 172.21.15.177:0/4257711241 wait complete. 2023-11-28T20:09:18.443 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:09:18.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.581+0000 7f85f1b57640 1 Processor -- start 2023-11-28T20:09:18.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.581+0000 7f85f1b57640 1 -- start start 2023-11-28T20:09:18.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.581+0000 7f85f1b57640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f85ec144840 0x7f85ec06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:18.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.581+0000 7f85f1b57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85ec072180 0x7f85ec06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:18.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.581+0000 7f85f1b57640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ec0710e0 con 0x7f85ec070460 2023-11-28T20:09:18.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.581+0000 7f85f1b57640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ec15f010 con 0x7f85ec144840 2023-11-28T20:09:18.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.581+0000 7f85f1b57640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0713c0 con 0x7f85ec072180 2023-11-28T20:09:18.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.581+0000 7f85eb7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f85ec144840 0x7f85ec06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:18.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.585+0000 7f85eb7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f85ec144840 0x7f85ec06c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59528/0 (socket says 172.21.15.177:59528) 2023-11-28T20:09:18.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.585+0000 7f85eb7fe640 1 -- 172.21.15.177:0/2102811803 learned_addr learned my addr 172.21.15.177:0/2102811803 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:18.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.585+0000 7f85eaffd640 1 --2- 172.21.15.177:0/2102811803 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85ec072180 0x7f85ec06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:18.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.585+0000 7f85eb7fe640 1 -- 172.21.15.177:0/2102811803 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85ec072180 msgr2=0x7f85ec06c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:18.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.585+0000 7f85eb7fe640 1 --2- 172.21.15.177:0/2102811803 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85ec072180 0x7f85ec06c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.585+0000 7f85eb7fe640 1 -- 172.21.15.177:0/2102811803 >> v1:172.21.15.195:6789/0 conn(0x7f85ec070460 legacy=0x7f85ec0708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:18.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.585+0000 7f85eb7fe640 1 -- 172.21.15.177:0/2102811803 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec0716a0 con 0x7f85ec144840 2023-11-28T20:09:18.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.585+0000 7f85eaffd640 1 --2- 172.21.15.177:0/2102811803 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85ec072180 0x7f85ec06c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:18.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.585+0000 7f85eb7fe640 1 --2- 172.21.15.177:0/2102811803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85ec144840 0x7f85ec06c2c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009870 tx=0x7f85dc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bb229a82cfc33f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:18.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.585+0000 7f85ea7fc640 1 -- 172.21.15.177:0/2102811803 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0aa670 con 0x7f85ec144840 2023-11-28T20:09:18.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.585+0000 7f85ea7fc640 1 -- 172.21.15.177:0/2102811803 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc0aa7d0 con 0x7f85ec144840 2023-11-28T20:09:18.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.585+0000 7f85ea7fc640 1 -- 172.21.15.177:0/2102811803 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0aab60 con 0x7f85ec144840 2023-11-28T20:09:18.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 -- 172.21.15.177:0/2102811803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85ec144840 msgr2=0x7f85ec06c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:18.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 --2- 172.21.15.177:0/2102811803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85ec144840 0x7f85ec06c2c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009870 tx=0x7f85dc01c510 comp rx=0 tx=0).stop 2023-11-28T20:09:18.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 -- 172.21.15.177:0/2102811803 shutdown_connections 2023-11-28T20:09:18.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 --2- 172.21.15.177:0/2102811803 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85ec072180 0x7f85ec06c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 --2- 172.21.15.177:0/2102811803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85ec144840 0x7f85ec06c2c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 -- 172.21.15.177:0/2102811803 >> 172.21.15.177:0/2102811803 conn(0x7f85ec06a530 msgr2=0x7f85ec06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 -- 172.21.15.177:0/2102811803 shutdown_connections 2023-11-28T20:09:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 -- 172.21.15.177:0/2102811803 wait complete. 2023-11-28T20:09:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 Processor -- start 2023-11-28T20:09:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 -- start start 2023-11-28T20:09:18.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85ec070460 0x7f85ec0b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:18.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ec072180 0x7f85ec1f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:18.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85ec144840 0x7f85ec13b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:18.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec13b610 con 0x7f85ec070460 2023-11-28T20:09:18.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0b3220 con 0x7f85ec072180 2023-11-28T20:09:18.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85f1b57640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec1f5ec0 con 0x7f85ec144840 2023-11-28T20:09:18.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85eb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85ec070460 0x7f85ec0b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:18.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85eb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85ec070460 0x7f85ec0b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59536/0 (socket says 172.21.15.177:59536) 2023-11-28T20:09:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85eb7fe640 1 -- 172.21.15.177:0/3767416982 learned_addr learned my addr 172.21.15.177:0/3767416982 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85eaffd640 1 --2- 172.21.15.177:0/3767416982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ec072180 0x7f85ec1f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85ebfff640 1 --2- 172.21.15.177:0/3767416982 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85ec144840 0x7f85ec13b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85eb7fe640 1 -- 172.21.15.177:0/3767416982 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85ec144840 msgr2=0x7f85ec13b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85eb7fe640 1 --2- 172.21.15.177:0/3767416982 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85ec144840 0x7f85ec13b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85eb7fe640 1 -- 172.21.15.177:0/3767416982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ec072180 msgr2=0x7f85ec1f9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85eb7fe640 1 --2- 172.21.15.177:0/3767416982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ec072180 0x7f85ec1f9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.589+0000 7f85eb7fe640 1 -- 172.21.15.177:0/3767416982 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc0094d0 con 0x7f85ec070460 2023-11-28T20:09:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.593+0000 7f85eb7fe640 1 --2- 172.21.15.177:0/3767416982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85ec070460 0x7f85ec0b2b90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0ac040 tx=0x7f85dc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.593+0000 7f85d3fff640 1 -- 172.21.15.177:0/3767416982 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0b3800 con 0x7f85ec070460 2023-11-28T20:09:18.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.593+0000 7f85d3fff640 1 -- 172.21.15.177:0/3767416982 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc0b3980 con 0x7f85ec070460 2023-11-28T20:09:18.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.593+0000 7f85f1b57640 1 -- 172.21.15.177:0/3767416982 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ec1f61a0 con 0x7f85ec070460 2023-11-28T20:09:18.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.593+0000 7f85d3fff640 1 -- 172.21.15.177:0/3767416982 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0b3d30 con 0x7f85ec070460 2023-11-28T20:09:18.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.593+0000 7f85f1b57640 1 -- 172.21.15.177:0/3767416982 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ec1f5b70 con 0x7f85ec070460 2023-11-28T20:09:18.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.593+0000 7f85f1b57640 1 -- 172.21.15.177:0/3767416982 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ec1f6000 con 0x7f85ec070460 2023-11-28T20:09:18.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.593+0000 7f85d3fff640 1 -- 172.21.15.177:0/3767416982 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f85dc0b2380 con 0x7f85ec070460 2023-11-28T20:09:18.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.593+0000 7f85d3fff640 1 --2- 172.21.15.177:0/3767416982 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f85d8066470 0x7f85d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:18.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.597+0000 7f85d3fff640 1 -- 172.21.15.177:0/3767416982 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f85dc11e0b0 con 0x7f85ec070460 2023-11-28T20:09:18.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.597+0000 7f85eaffd640 1 --2- 172.21.15.177:0/3767416982 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f85d8066470 0x7f85d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:18.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.597+0000 7f85eaffd640 1 --2- 172.21.15.177:0/3767416982 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f85d8066470 0x7f85d8068930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f85ec1f6f30 tx=0x7f85e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:18.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.601+0000 7f85d3fff640 1 -- 172.21.15.177:0/3767416982 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f85ec1f6000 con 0x7f85ec070460 2023-11-28T20:09:18.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.781+0000 7f85f1b57640 1 -- 172.21.15.177:0/3767416982 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f85ec1f6000 con 0x7f85ec070460 2023-11-28T20:09:18.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.781+0000 7f85d3fff640 1 -- 172.21.15.177:0/3767416982 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+82 (secure 0 0 0) 0x7f85ec1f6000 con 0x7f85ec070460 2023-11-28T20:09:18.785 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2023-11-28T20:09:18.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.781+0000 7f85f1b57640 1 -- 172.21.15.177:0/3767416982 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f85d8066470 msgr2=0x7f85d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:18.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.781+0000 7f85f1b57640 1 --2- 172.21.15.177:0/3767416982 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f85d8066470 0x7f85d8068930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f85ec1f6f30 tx=0x7f85e0008040 comp rx=0 tx=0).stop 2023-11-28T20:09:18.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.781+0000 7f85f1b57640 1 -- 172.21.15.177:0/3767416982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85ec070460 msgr2=0x7f85ec0b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:18.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.781+0000 7f85f1b57640 1 --2- 172.21.15.177:0/3767416982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85ec070460 0x7f85ec0b2b90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0ac040 tx=0x7f85dc01ad50 comp rx=0 tx=0).stop 2023-11-28T20:09:18.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.781+0000 7f85f1b57640 1 -- 172.21.15.177:0/3767416982 shutdown_connections 2023-11-28T20:09:18.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.781+0000 7f85f1b57640 1 --2- 172.21.15.177:0/3767416982 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f85d8066470 0x7f85d8068930 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.781+0000 7f85f1b57640 1 --2- 172.21.15.177:0/3767416982 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85ec144840 0x7f85ec13b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.781+0000 7f85f1b57640 1 --2- 172.21.15.177:0/3767416982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ec072180 0x7f85ec1f9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.781+0000 7f85f1b57640 1 --2- 172.21.15.177:0/3767416982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85ec070460 0x7f85ec0b2b90 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:18.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.781+0000 7f85f1b57640 1 -- 172.21.15.177:0/3767416982 >> 172.21.15.177:0/3767416982 conn(0x7f85ec06a530 msgr2=0x7f85ec15d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:18.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.785+0000 7f85f1b57640 1 -- 172.21.15.177:0/3767416982 shutdown_connections 2023-11-28T20:09:18.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:18.785+0000 7f85f1b57640 1 -- 172.21.15.177:0/3767416982 wait complete. 2023-11-28T20:09:18.807 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T20:09:18.807 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:09:18.807 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-11-28T20:09:18.807 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T20:09:18.807 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:18.807 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T20:09:18.807 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T20:09:18.807 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:09:18.808 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:09:18.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:18.808 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-11-28T20:09:18.818 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:09:18.818 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:09:18.819 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:09:18.819 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:18.819 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-11-28T20:09:18.819 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:18.819 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:09:18.819 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:18.819 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-11-28T20:09:18.819 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:09:18.819 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:18.819 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-11-28T20:09:18.819 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:09:18.820 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:18.820 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:09:18.820 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:18.820 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:09:18.820 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42315sec preferred_lft 42315sec 2023-11-28T20:09:18.820 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-11-28T20:09:18.820 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:18.820 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:09:18.820 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:91:19:71:65 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:18.820 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:09:18.820 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:18.820 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:09:18.821 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:18.821 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:09:18.821 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:18.821 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:09:18.821 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:18.821 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:09:18.821 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:18.821 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:09:18.821 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:18.822 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:09:18.822 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:18.822 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-28T20:09:18.822 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:18.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:18.823 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:09:18.883 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-11-28T20:09:18.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:18.885 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-11-28T20:09:18.942 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-11-28T20:09:18.942 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:09:18.942 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:09:18.942 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:09:18.942 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:09:18.943 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:09:18.943 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:09:18.943 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:09:18.943 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:09:18.943 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:09:18.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:18.946 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-28T20:09:18.946 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-28T20:09:18.947 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:09:18.947 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:09:18.947 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:09:18.947 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-28T20:09:19.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:19.038 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-11-28T20:09:19.091 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T20:09:19.091 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T20:09:19.091 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:09:19.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:19.092 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-11-28T20:09:19.154 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T20:09:19.154 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:09:19.154 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:19.208 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:09:19.209 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:09:19.209 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:19.258 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:09:19.325 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:09:19.376 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:09:19.376 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:09:19.377 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:09:19.377 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:09:19.377 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:09:19.377 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:09:19.377 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:09:19.377 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:09:19.377 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:09:19.378 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:09:19.378 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:09:19.378 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:09:19.378 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:09:19.378 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:09:19.378 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:09:19.378 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:09:19.378 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:09:19.378 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:09:19.378 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:09:19.379 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:09:19.379 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:09:19.379 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:09:19.379 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:09:19.379 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:09:19.379 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:09:19.379 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:09:19.379 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:09:19.380 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:09:19.380 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:09:19.380 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:19.380 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:19.380 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:19.380 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:19.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:19.381 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:09:19.430 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T20:09:19.430 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T20:09:19.477 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:09:19.498 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:09:19.557 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:09:19.557 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:09:19.557 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:09:19.558 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:09:19.558 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:09:19.558 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:09:19.558 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:09:19.558 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:09:19.558 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:09:19.558 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:09:19.558 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:09:19.558 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:09:19.558 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:09:19.558 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:09:19.558 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:09:19.559 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:09:19.559 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:09:19.559 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:09:19.559 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:09:19.559 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:09:19.559 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:09:19.559 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:09:19.559 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:09:19.559 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:09:19.559 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:09:19.559 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:09:19.559 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:09:19.560 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:09:19.560 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:09:19.560 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:19.560 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:19.560 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:19.560 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:19.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:19.561 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:09:19.574 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-11-28T20:09:19.569+0000 7feee3524580 -1 init, newargv = 0x562ff8aded70 newargc=15 2023-11-28T20:09:19.574 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[50055]: starting ceph client 2023-11-28T20:09:19.582 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[50055]: starting fuse 2023-11-28T20:09:19.585 INFO:teuthology.orchestra.run.smithi177.stdout:43 2023-11-28T20:09:19.585 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T20:09:19.585 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-11-28T20:09:19.586 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-11-28T20:09:19.586 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-11-28T20:09:19.586 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-11-28T20:09:19.586 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-11-28T20:09:19.586 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:09:19.586 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-11-28T20:09:19.586 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T20:09:19.586 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-11-28T20:09:19.586 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T20:09:19.586 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:09:19.586 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-11-28T20:09:19.587 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-11-28T20:09:19.588 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-11-28T20:09:19.588 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-11-28T20:09:19.588 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:09:19.588 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-11-28T20:09:19.588 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T20:09:19.588 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T20:09:19.588 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T20:09:19.589 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-11-28T20:09:19.589 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-11-28T20:09:19.589 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-11-28T20:09:19.589 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T20:09:19.589 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:09:19.589 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-11-28T20:09:19.589 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-11-28T20:09:19.714 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.50055.asok 2023-11-28T20:09:19.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T20:09:19.725 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50055.asok 2023-11-28T20:09:19.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:19.726 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50055.asok status 2023-11-28T20:09:19.901 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:09:19.901 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-11-28T20:09:19.901 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T20:09:19.901 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T20:09:19.901 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-11-28T20:09:19.901 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-11-28T20:09:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T20:09:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "50055", 2023-11-28T20:09:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-11-28T20:09:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-11-28T20:09:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-11-28T20:09:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 5643, 2023-11-28T20:09:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-11-28T20:09:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-11-28T20:09:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-11-28T20:09:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 5643 2023-11-28T20:09:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:09:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:09:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:09:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1185005283 2023-11-28T20:09:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:09:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:09:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:09:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1185005283 2023-11-28T20:09:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.5643 192.168.0.1:0/1185005283", 2023-11-28T20:09:19.904 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/1185005283", 2023-11-28T20:09:19.904 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-11-28T20:09:19.904 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 18, 2023-11-28T20:09:19.904 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 36, 2023-11-28T20:09:19.904 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-11-28T20:09:19.904 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-11-28T20:09:19.904 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-11-28T20:09:19.904 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:09:19.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:19.916 DEBUG:teuthology.orchestra.run.smithi177:> stat --file-system '--printf=%T 2023-11-28T20:09:19.917 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:19.928 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-11-28T20:09:19.928 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:19.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:19.929 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:19.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:19.990 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-11-28T20:09:20.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:20.043 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-11-28T20:09:20.100 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:09:20.100 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:09:20.155 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:09:20.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.333+0000 7fa48f8ea640 1 Processor -- start 2023-11-28T20:09:20.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.333+0000 7fa48f8ea640 1 -- start start 2023-11-28T20:09:20.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.337+0000 7fa48f8ea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4880b4760 0x7fa4880d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:20.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.337+0000 7fa48f8ea640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa4880b4b40 0x7fa4880d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:20.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.337+0000 7fa48f8ea640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa488143780 con 0x7fa488142c00 2023-11-28T20:09:20.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.337+0000 7fa48f8ea640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa488161dc0 con 0x7fa4880b4b40 2023-11-28T20:09:20.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.337+0000 7fa48f8ea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48815d7c0 con 0x7fa4880b4760 2023-11-28T20:09:20.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.337+0000 7fa48ce85640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa4880b4b40 0x7fa4880d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:20.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.337+0000 7fa48ce85640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa4880b4b40 0x7fa4880d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39356/0 (socket says 172.21.15.177:39356) 2023-11-28T20:09:20.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.337+0000 7fa48ce85640 1 -- 172.21.15.177:0/45938249 learned_addr learned my addr 172.21.15.177:0/45938249 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.337+0000 7fa48ce85640 1 -- 172.21.15.177:0/45938249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4880b4760 msgr2=0x7fa4880d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.337+0000 7fa48d686640 1 --2- 172.21.15.177:0/45938249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4880b4760 0x7fa4880d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.337+0000 7fa48ce85640 1 --2- 172.21.15.177:0/45938249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4880b4760 0x7fa4880d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.337+0000 7fa48ce85640 1 -- 172.21.15.177:0/45938249 >> v1:172.21.15.195:6789/0 conn(0x7fa488142c00 legacy=0x7fa488143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.337+0000 7fa48ce85640 1 -- 172.21.15.177:0/45938249 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa488140930 con 0x7fa4880b4b40 2023-11-28T20:09:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.337+0000 7fa48d686640 1 --2- 172.21.15.177:0/45938249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4880b4760 0x7fa4880d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:20.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.341+0000 7fa48ce85640 1 --2- 172.21.15.177:0/45938249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4880b4b40 0x7fa4880d15e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa478009870 tx=0x7fa47801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25d779f433eab4a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:20.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.341+0000 7fa47ffff640 1 -- 172.21.15.177:0/45938249 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4780ab600 con 0x7fa4880b4b40 2023-11-28T20:09:20.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.341+0000 7fa47ffff640 1 -- 172.21.15.177:0/45938249 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4780a7050 con 0x7fa4880b4b40 2023-11-28T20:09:20.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.341+0000 7fa47ffff640 1 -- 172.21.15.177:0/45938249 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4780ab980 con 0x7fa4880b4b40 2023-11-28T20:09:20.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.341+0000 7fa48f8ea640 1 -- 172.21.15.177:0/45938249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4880b4b40 msgr2=0x7fa4880d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:20.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.341+0000 7fa48f8ea640 1 --2- 172.21.15.177:0/45938249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4880b4b40 0x7fa4880d15e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa478009870 tx=0x7fa47801c500 comp rx=0 tx=0).stop 2023-11-28T20:09:20.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.341+0000 7fa48f8ea640 1 -- 172.21.15.177:0/45938249 shutdown_connections 2023-11-28T20:09:20.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.341+0000 7fa48f8ea640 1 --2- 172.21.15.177:0/45938249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4880b4b40 0x7fa4880d15e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.341+0000 7fa48f8ea640 1 --2- 172.21.15.177:0/45938249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4880b4760 0x7fa4880d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.341+0000 7fa48f8ea640 1 -- 172.21.15.177:0/45938249 >> 172.21.15.177:0/45938249 conn(0x7fa48806a530 msgr2=0x7fa48806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:20.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.341+0000 7fa48f8ea640 1 -- 172.21.15.177:0/45938249 shutdown_connections 2023-11-28T20:09:20.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.341+0000 7fa48f8ea640 1 -- 172.21.15.177:0/45938249 wait complete. 2023-11-28T20:09:20.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.341+0000 7fa48f8ea640 1 Processor -- start 2023-11-28T20:09:20.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.341+0000 7fa48f8ea640 1 -- start start 2023-11-28T20:09:20.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48f8ea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4880b4760 0x7fa488158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:20.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48f8ea640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4880b4b40 0x7fa488139be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:20.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48f8ea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa488142c00 0x7fa48815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:20.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48f8ea640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa488156ce0 con 0x7fa488142c00 2023-11-28T20:09:20.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48f8ea640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48806c3a0 con 0x7fa4880b4b40 2023-11-28T20:09:20.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48f8ea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48806c5f0 con 0x7fa4880b4760 2023-11-28T20:09:20.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48de87640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa488142c00 0x7fa48815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:20.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48de87640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa488142c00 0x7fa48815b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39360/0 (socket says 172.21.15.177:39360) 2023-11-28T20:09:20.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48de87640 1 -- 172.21.15.177:0/1462684069 learned_addr learned my addr 172.21.15.177:0/1462684069 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:20.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48d686640 1 --2- 172.21.15.177:0/1462684069 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4880b4760 0x7fa488158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:20.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48ce85640 1 --2- 172.21.15.177:0/1462684069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4880b4b40 0x7fa488139be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:20.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48de87640 1 -- 172.21.15.177:0/1462684069 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4880b4760 msgr2=0x7fa488158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:20.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48de87640 1 --2- 172.21.15.177:0/1462684069 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4880b4760 0x7fa488158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48de87640 1 -- 172.21.15.177:0/1462684069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4880b4b40 msgr2=0x7fa488139be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:20.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48de87640 1 --2- 172.21.15.177:0/1462684069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4880b4b40 0x7fa488139be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48de87640 1 -- 172.21.15.177:0/1462684069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4780094d0 con 0x7fa488142c00 2023-11-28T20:09:20.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48de87640 1 --2- 172.21.15.177:0/1462684069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa488142c00 0x7fa48815b3c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa48000b970 tx=0x7fa48000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:20.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa47dffb640 1 -- 172.21.15.177:0/1462684069 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000cb40 con 0x7fa488142c00 2023-11-28T20:09:20.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa47dffb640 1 -- 172.21.15.177:0/1462684069 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48000cca0 con 0x7fa488142c00 2023-11-28T20:09:20.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa47dffb640 1 -- 172.21.15.177:0/1462684069 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480014680 con 0x7fa488142c00 2023-11-28T20:09:20.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48f8ea640 1 -- 172.21.15.177:0/1462684069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48806c8d0 con 0x7fa488142c00 2023-11-28T20:09:20.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48f8ea640 1 -- 172.21.15.177:0/1462684069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48806ce90 con 0x7fa488142c00 2023-11-28T20:09:20.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa48f8ea640 1 -- 172.21.15.177:0/1462684069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48806d080 con 0x7fa488142c00 2023-11-28T20:09:20.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.345+0000 7fa47dffb640 1 -- 172.21.15.177:0/1462684069 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa48001d3b0 con 0x7fa488142c00 2023-11-28T20:09:20.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.349+0000 7fa47dffb640 1 --2- 172.21.15.177:0/1462684069 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa46c0664a0 0x7fa46c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:20.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.349+0000 7fa47dffb640 1 -- 172.21.15.177:0/1462684069 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fa480083d00 con 0x7fa488142c00 2023-11-28T20:09:20.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.349+0000 7fa48d686640 1 --2- 172.21.15.177:0/1462684069 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa46c0664a0 0x7fa46c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:20.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.349+0000 7fa48d686640 1 --2- 172.21.15.177:0/1462684069 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa46c0664a0 0x7fa46c068960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa48400ab60 tx=0x7fa484008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:20.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.353+0000 7fa47dffb640 1 -- 172.21.15.177:0/1462684069 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa480051130 con 0x7fa488142c00 2023-11-28T20:09:20.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.505+0000 7fa48f8ea640 1 -- 172.21.15.177:0/1462684069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa488069440 con 0x7fa488142c00 2023-11-28T20:09:20.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.505+0000 7fa47dffb640 1 -- 172.21.15.177:0/1462684069 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18408 (secure 0 0 0) 0x7fa480054750 con 0x7fa488142c00 2023-11-28T20:09:20.509 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:20.509 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":36,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:55.264752+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:08:37.943771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T20:08:38.396895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2023-11-28T20:08:52.500186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:09:20.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.509+0000 7fa48f8ea640 1 -- 172.21.15.177:0/1462684069 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa46c0664a0 msgr2=0x7fa46c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:20.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.509+0000 7fa48f8ea640 1 --2- 172.21.15.177:0/1462684069 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa46c0664a0 0x7fa46c068960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa48400ab60 tx=0x7fa484008040 comp rx=0 tx=0).stop 2023-11-28T20:09:20.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.509+0000 7fa48f8ea640 1 -- 172.21.15.177:0/1462684069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa488142c00 msgr2=0x7fa48815b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:20.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.509+0000 7fa48f8ea640 1 --2- 172.21.15.177:0/1462684069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa488142c00 0x7fa48815b3c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa48000b970 tx=0x7fa48000be30 comp rx=0 tx=0).stop 2023-11-28T20:09:20.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.509+0000 7fa48f8ea640 1 -- 172.21.15.177:0/1462684069 shutdown_connections 2023-11-28T20:09:20.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.509+0000 7fa48f8ea640 1 --2- 172.21.15.177:0/1462684069 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa46c0664a0 0x7fa46c068960 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.509+0000 7fa48f8ea640 1 --2- 172.21.15.177:0/1462684069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa488142c00 0x7fa48815b3c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.509+0000 7fa48f8ea640 1 --2- 172.21.15.177:0/1462684069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4880b4b40 0x7fa488139be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.509+0000 7fa48f8ea640 1 --2- 172.21.15.177:0/1462684069 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4880b4760 0x7fa488158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.509+0000 7fa48f8ea640 1 -- 172.21.15.177:0/1462684069 >> 172.21.15.177:0/1462684069 conn(0x7fa48806a530 msgr2=0x7fa4880d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:20.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.509+0000 7fa48f8ea640 1 -- 172.21.15.177:0/1462684069 shutdown_connections 2023-11-28T20:09:20.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.509+0000 7fa48f8ea640 1 -- 172.21.15.177:0/1462684069 wait complete. 2023-11-28T20:09:20.531 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:08:37.943771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:08:38.396895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2023-11-28T20:08:52.500186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:09:20.531 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:09:20.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.669+0000 7feef98bb640 1 Processor -- start 2023-11-28T20:09:20.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.669+0000 7feef98bb640 1 -- start start 2023-11-28T20:09:20.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.673+0000 7feef98bb640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7feef4071d90 0x7feef4072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:20.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.673+0000 7feef98bb640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7feef413f5f0 0x7feef40ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:20.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.673+0000 7feef98bb640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef413d2b0 con 0x7feef415adb0 2023-11-28T20:09:20.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.673+0000 7feef98bb640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef4140520 con 0x7feef413f5f0 2023-11-28T20:09:20.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.673+0000 7feef98bb640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef40cd7f0 con 0x7feef4071d90 2023-11-28T20:09:20.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.673+0000 7feef37fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7feef413f5f0 0x7feef40ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:20.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.673+0000 7feeea7fc640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7feef415adb0 0x7feef413d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44596/0 (socket says 172.21.15.177:44596) 2023-11-28T20:09:20.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.673+0000 7feef37fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7feef413f5f0 0x7feef40ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39374/0 (socket says 172.21.15.177:39374) 2023-11-28T20:09:20.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.673+0000 7feeea7fc640 1 -- 172.21.15.177:0/516202317 learned_addr learned my addr 172.21.15.177:0/516202317 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:20.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.673+0000 7feef2ffd640 1 --2- 172.21.15.177:0/516202317 >> v2:172.21.15.195:3300/0 conn(0x7feef4071d90 0x7feef4072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:20.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.673+0000 7feef37fe640 1 -- 172.21.15.177:0/516202317 >> v2:172.21.15.195:3300/0 conn(0x7feef4071d90 msgr2=0x7feef4072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:20.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.673+0000 7feef37fe640 1 --2- 172.21.15.177:0/516202317 >> v2:172.21.15.195:3300/0 conn(0x7feef4071d90 0x7feef4072170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.673+0000 7feef37fe640 1 -- 172.21.15.177:0/516202317 >> v1:172.21.15.177:6789/0 conn(0x7feef415adb0 legacy=0x7feef413d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:20.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.673+0000 7feef37fe640 1 -- 172.21.15.177:0/516202317 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef40cdd70 con 0x7feef413f5f0 2023-11-28T20:09:20.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.673+0000 7feef2ffd640 1 --2- 172.21.15.177:0/516202317 >> v2:172.21.15.195:3300/0 conn(0x7feef4071d90 0x7feef4072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:20.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.677+0000 7feef37fe640 1 --2- 172.21.15.177:0/516202317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef413f5f0 0x7feef40ce200 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7feef40b1d80 tx=0x7feeec01eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff8dcd5f6f2b07d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:20.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.677+0000 7feef27fc640 1 -- 172.21.15.177:0/516202317 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec0a7b00 con 0x7feef413f5f0 2023-11-28T20:09:20.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.677+0000 7feef27fc640 1 -- 172.21.15.177:0/516202317 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec0a7c60 con 0x7feef413f5f0 2023-11-28T20:09:20.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.677+0000 7feef27fc640 1 -- 172.21.15.177:0/516202317 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec0af440 con 0x7feef413f5f0 2023-11-28T20:09:20.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.677+0000 7feef98bb640 1 -- 172.21.15.177:0/516202317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef413f5f0 msgr2=0x7feef40ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:20.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.677+0000 7feef98bb640 1 --2- 172.21.15.177:0/516202317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef413f5f0 0x7feef40ce200 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7feef40b1d80 tx=0x7feeec01eb30 comp rx=0 tx=0).stop 2023-11-28T20:09:20.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.677+0000 7feef98bb640 1 -- 172.21.15.177:0/516202317 shutdown_connections 2023-11-28T20:09:20.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.677+0000 7feef98bb640 1 --2- 172.21.15.177:0/516202317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef413f5f0 0x7feef40ce200 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.677+0000 7feef98bb640 1 --2- 172.21.15.177:0/516202317 >> v2:172.21.15.195:3300/0 conn(0x7feef4071d90 0x7feef4072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.677+0000 7feef98bb640 1 -- 172.21.15.177:0/516202317 >> 172.21.15.177:0/516202317 conn(0x7feef40b0cc0 msgr2=0x7feef40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:20.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.677+0000 7feef98bb640 1 -- 172.21.15.177:0/516202317 shutdown_connections 2023-11-28T20:09:20.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.677+0000 7feef98bb640 1 -- 172.21.15.177:0/516202317 wait complete. 2023-11-28T20:09:20.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.677+0000 7feef98bb640 1 Processor -- start 2023-11-28T20:09:20.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.677+0000 7feef98bb640 1 -- start start 2023-11-28T20:09:20.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef98bb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef4071d90 0x7feef41357f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:20.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef98bb640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feef413f5f0 0x7feef4150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:20.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef98bb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feef415adb0 0x7feef40b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:20.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef98bb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef41423a0 con 0x7feef4071d90 2023-11-28T20:09:20.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef98bb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef41f6780 con 0x7feef415adb0 2023-11-28T20:09:20.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef98bb640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef40b30f0 con 0x7feef413f5f0 2023-11-28T20:09:20.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef4071d90 0x7feef41357f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:20.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef4071d90 0x7feef41357f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39388/0 (socket says 172.21.15.177:39388) 2023-11-28T20:09:20.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef2ffd640 1 -- 172.21.15.177:0/3314419905 learned_addr learned my addr 172.21.15.177:0/3314419905 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:20.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef37fe640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feef415adb0 0x7feef40b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:20.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef2ffd640 1 -- 172.21.15.177:0/3314419905 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feef413f5f0 msgr2=0x7feef4150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:20.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feeea7fc640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feef413f5f0 0x7feef4150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:20.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef2ffd640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feef413f5f0 0x7feef4150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef2ffd640 1 -- 172.21.15.177:0/3314419905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feef415adb0 msgr2=0x7feef40b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:20.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef2ffd640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feef415adb0 0x7feef40b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef2ffd640 1 -- 172.21.15.177:0/3314419905 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec00b6c0 con 0x7feef4071d90 2023-11-28T20:09:20.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef37fe640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feef415adb0 0x7feef40b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:20.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feeea7fc640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feef413f5f0 0x7feef4150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:20.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef2ffd640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef4071d90 0x7feef41357f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7feee400ce00 tx=0x7feee400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:20.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef0ff9640 1 -- 172.21.15.177:0/3314419905 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee400f890 con 0x7feef4071d90 2023-11-28T20:09:20.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef0ff9640 1 -- 172.21.15.177:0/3314419905 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee400f9f0 con 0x7feef4071d90 2023-11-28T20:09:20.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef98bb640 1 -- 172.21.15.177:0/3314419905 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef4141a00 con 0x7feef4071d90 2023-11-28T20:09:20.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef0ff9640 1 -- 172.21.15.177:0/3314419905 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee400fdc0 con 0x7feef4071d90 2023-11-28T20:09:20.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef98bb640 1 -- 172.21.15.177:0/3314419905 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef4141fc0 con 0x7feef4071d90 2023-11-28T20:09:20.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.681+0000 7feef98bb640 1 -- 172.21.15.177:0/3314419905 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef40693d0 con 0x7feef4071d90 2023-11-28T20:09:20.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.685+0000 7feef0ff9640 1 -- 172.21.15.177:0/3314419905 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feee400b040 con 0x7feef4071d90 2023-11-28T20:09:20.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.685+0000 7feef0ff9640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7feed4066470 0x7feed4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:20.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.685+0000 7feef0ff9640 1 -- 172.21.15.177:0/3314419905 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7feee4084a60 con 0x7feef4071d90 2023-11-28T20:09:20.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.685+0000 7feeea7fc640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7feed4066470 0x7feed4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:20.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.685+0000 7feeea7fc640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7feed4066470 0x7feed4068930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feef413eb70 tx=0x7feedc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:20.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.689+0000 7feef0ff9640 1 -- 172.21.15.177:0/3314419905 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feee4051df0 con 0x7feef4071d90 2023-11-28T20:09:20.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.837+0000 7feef98bb640 1 -- 172.21.15.177:0/3314419905 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feef406e710 con 0x7feef4071d90 2023-11-28T20:09:20.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.837+0000 7feef0ff9640 1 -- 172.21.15.177:0/3314419905 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7feee4055410 con 0x7feef4071d90 2023-11-28T20:09:20.841 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:09:20.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.841+0000 7feef98bb640 1 -- 172.21.15.177:0/3314419905 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7feed4066470 msgr2=0x7feed4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:20.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.841+0000 7feef98bb640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7feed4066470 0x7feed4068930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feef413eb70 tx=0x7feedc009040 comp rx=0 tx=0).stop 2023-11-28T20:09:20.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.841+0000 7feef98bb640 1 -- 172.21.15.177:0/3314419905 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef4071d90 msgr2=0x7feef41357f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:20.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.841+0000 7feef98bb640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef4071d90 0x7feef41357f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7feee400ce00 tx=0x7feee400a650 comp rx=0 tx=0).stop 2023-11-28T20:09:20.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.841+0000 7feef98bb640 1 -- 172.21.15.177:0/3314419905 shutdown_connections 2023-11-28T20:09:20.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.841+0000 7feef98bb640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7feed4066470 0x7feed4068930 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.841+0000 7feef98bb640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feef415adb0 0x7feef40b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.841+0000 7feef98bb640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feef413f5f0 0x7feef4150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.841+0000 7feef98bb640 1 --2- 172.21.15.177:0/3314419905 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef4071d90 0x7feef41357f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:20.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.841+0000 7feef98bb640 1 -- 172.21.15.177:0/3314419905 >> 172.21.15.177:0/3314419905 conn(0x7feef40b0cc0 msgr2=0x7feef413c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:20.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.841+0000 7feef98bb640 1 -- 172.21.15.177:0/3314419905 shutdown_connections 2023-11-28T20:09:20.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:20.841+0000 7feef98bb640 1 -- 172.21.15.177:0/3314419905 wait complete. 2023-11-28T20:09:20.862 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:09:21.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63afb1d640 1 Processor -- start 2023-11-28T20:09:21.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63afb1d640 1 -- start start 2023-11-28T20:09:21.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63afb1d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f63a815adb0 0x7f63a813d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63afb1d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f63a813f5f0 0x7f63a80ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63afb1d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a813d2b0 con 0x7f63a8071d90 2023-11-28T20:09:21.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63afb1d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a8140520 con 0x7f63a813f5f0 2023-11-28T20:09:21.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63afb1d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a80cd7f0 con 0x7f63a815adb0 2023-11-28T20:09:21.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63ae0ba640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f63a813f5f0 0x7f63a80ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63ae0ba640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f63a813f5f0 0x7f63a80ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39396/0 (socket says 172.21.15.177:39396) 2023-11-28T20:09:21.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63ae0ba640 1 -- 172.21.15.177:0/11030869 learned_addr learned my addr 172.21.15.177:0/11030869 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:21.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63ad0b8640 1 --2- 172.21.15.177:0/11030869 >> v2:172.21.15.195:3300/0 conn(0x7f63a815adb0 0x7f63a813d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63ae0ba640 1 -- 172.21.15.177:0/11030869 >> v2:172.21.15.195:3300/0 conn(0x7f63a815adb0 msgr2=0x7f63a813d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:21.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63ae0ba640 1 --2- 172.21.15.177:0/11030869 >> v2:172.21.15.195:3300/0 conn(0x7f63a815adb0 0x7f63a813d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63ae0ba640 1 -- 172.21.15.177:0/11030869 >> v1:172.21.15.195:6789/0 conn(0x7f63a8071d90 legacy=0x7f63a8072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:21.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63ae0ba640 1 -- 172.21.15.177:0/11030869 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a80cdd70 con 0x7f63a813f5f0 2023-11-28T20:09:21.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.001+0000 7f63ad0b8640 1 --2- 172.21.15.177:0/11030869 >> v2:172.21.15.195:3300/0 conn(0x7f63a815adb0 0x7f63a813d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:21.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.005+0000 7f63ae0ba640 1 --2- 172.21.15.177:0/11030869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a813f5f0 0x7f63a80ce200 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f63a80744d0 tx=0x7f63a001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9421811df6ef66c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:21.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.005+0000 7f63ac8b7640 1 -- 172.21.15.177:0/11030869 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00a5820 con 0x7f63a813f5f0 2023-11-28T20:09:21.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.005+0000 7f63ac8b7640 1 -- 172.21.15.177:0/11030869 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a00a5980 con 0x7f63a813f5f0 2023-11-28T20:09:21.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.005+0000 7f63ac8b7640 1 -- 172.21.15.177:0/11030869 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00a5d10 con 0x7f63a813f5f0 2023-11-28T20:09:21.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.005+0000 7f63afb1d640 1 -- 172.21.15.177:0/11030869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a813f5f0 msgr2=0x7f63a80ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.005+0000 7f63afb1d640 1 --2- 172.21.15.177:0/11030869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a813f5f0 0x7f63a80ce200 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f63a80744d0 tx=0x7f63a001c960 comp rx=0 tx=0).stop 2023-11-28T20:09:21.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.005+0000 7f63afb1d640 1 -- 172.21.15.177:0/11030869 shutdown_connections 2023-11-28T20:09:21.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.005+0000 7f63afb1d640 1 --2- 172.21.15.177:0/11030869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a813f5f0 0x7f63a80ce200 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.005+0000 7f63afb1d640 1 --2- 172.21.15.177:0/11030869 >> v2:172.21.15.195:3300/0 conn(0x7f63a815adb0 0x7f63a813d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.005+0000 7f63afb1d640 1 -- 172.21.15.177:0/11030869 >> 172.21.15.177:0/11030869 conn(0x7f63a80b0cc0 msgr2=0x7f63a80b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:21.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.005+0000 7f63afb1d640 1 -- 172.21.15.177:0/11030869 shutdown_connections 2023-11-28T20:09:21.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.005+0000 7f63afb1d640 1 -- 172.21.15.177:0/11030869 wait complete. 2023-11-28T20:09:21.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63afb1d640 1 Processor -- start 2023-11-28T20:09:21.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63afb1d640 1 -- start start 2023-11-28T20:09:21.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63afb1d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63a8071d90 0x7f63a80adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63afb1d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63a813f5f0 0x7f63a81346d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63afb1d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a815adb0 0x7f63a8138480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63afb1d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a80ae230 con 0x7f63a815adb0 2023-11-28T20:09:21.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63afb1d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a80ad860 con 0x7f63a8071d90 2023-11-28T20:09:21.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63afb1d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a80ad250 con 0x7f63a813f5f0 2023-11-28T20:09:21.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63ae0ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a815adb0 0x7f63a8138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63ae0ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a815adb0 0x7f63a8138480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39408/0 (socket says 172.21.15.177:39408) 2023-11-28T20:09:21.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63ae0ba640 1 -- 172.21.15.177:0/3798432541 learned_addr learned my addr 172.21.15.177:0/3798432541 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:21.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63ad0b8640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63a813f5f0 0x7f63a81346d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63ad8b9640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63a8071d90 0x7f63a80adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63ae0ba640 1 -- 172.21.15.177:0/3798432541 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63a813f5f0 msgr2=0x7f63a81346d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63ae0ba640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63a813f5f0 0x7f63a81346d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63ae0ba640 1 -- 172.21.15.177:0/3798432541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63a8071d90 msgr2=0x7f63a80adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63ae0ba640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63a8071d90 0x7f63a80adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63ae0ba640 1 -- 172.21.15.177:0/3798432541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a0009b30 con 0x7f63a815adb0 2023-11-28T20:09:21.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63ad0b8640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63a813f5f0 0x7f63a81346d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:21.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63ad8b9640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63a8071d90 0x7f63a80adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:21.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63ae0ba640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a815adb0 0x7f63a8138480 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f63a001a590 tx=0x7f63a0019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:21.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f639e7fc640 1 -- 172.21.15.177:0/3798432541 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00b8880 con 0x7f63a815adb0 2023-11-28T20:09:21.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f639e7fc640 1 -- 172.21.15.177:0/3798432541 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a00b89e0 con 0x7f63a815adb0 2023-11-28T20:09:21.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f639e7fc640 1 -- 172.21.15.177:0/3798432541 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00b8d90 con 0x7f63a815adb0 2023-11-28T20:09:21.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63afb1d640 1 -- 172.21.15.177:0/3798432541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a8143260 con 0x7f63a815adb0 2023-11-28T20:09:21.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63afb1d640 1 -- 172.21.15.177:0/3798432541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a80ad4f0 con 0x7f63a815adb0 2023-11-28T20:09:21.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.009+0000 7f63afb1d640 1 -- 172.21.15.177:0/3798432541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a80ada10 con 0x7f63a815adb0 2023-11-28T20:09:21.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.013+0000 7f639e7fc640 1 -- 172.21.15.177:0/3798432541 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f63a00b6440 con 0x7f63a815adb0 2023-11-28T20:09:21.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.013+0000 7f639e7fc640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f638c066470 0x7f638c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.013+0000 7f639e7fc640 1 -- 172.21.15.177:0/3798432541 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f63a011f700 con 0x7f63a815adb0 2023-11-28T20:09:21.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.013+0000 7f63ad8b9640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f638c066470 0x7f638c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.013+0000 7f63ad8b9640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f638c066470 0x7f638c068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f63a4003e40 tx=0x7f63a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:21.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.017+0000 7f639e7fc640 1 -- 172.21.15.177:0/3798432541 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f63a80ada10 con 0x7f63a815adb0 2023-11-28T20:09:21.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.165+0000 7f63afb1d640 1 -- 172.21.15.177:0/3798432541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f63a8073cf0 con 0x7f63a815adb0 2023-11-28T20:09:21.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.165+0000 7f639e7fc640 1 -- 172.21.15.177:0/3798432541 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f63a8073cf0 con 0x7f63a815adb0 2023-11-28T20:09:21.170 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:09:21.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.169+0000 7f63afb1d640 1 -- 172.21.15.177:0/3798432541 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f638c066470 msgr2=0x7f638c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.169+0000 7f63afb1d640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f638c066470 0x7f638c068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f63a4003e40 tx=0x7f63a4009040 comp rx=0 tx=0).stop 2023-11-28T20:09:21.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.169+0000 7f63afb1d640 1 -- 172.21.15.177:0/3798432541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a815adb0 msgr2=0x7f63a8138480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.169+0000 7f63afb1d640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a815adb0 0x7f63a8138480 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f63a001a590 tx=0x7f63a0019700 comp rx=0 tx=0).stop 2023-11-28T20:09:21.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.169+0000 7f63afb1d640 1 -- 172.21.15.177:0/3798432541 shutdown_connections 2023-11-28T20:09:21.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.169+0000 7f63afb1d640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f638c066470 0x7f638c068930 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.169+0000 7f63afb1d640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a815adb0 0x7f63a8138480 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.169+0000 7f63afb1d640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63a813f5f0 0x7f63a81346d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.169+0000 7f63afb1d640 1 --2- 172.21.15.177:0/3798432541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63a8071d90 0x7f63a80adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.169+0000 7f63afb1d640 1 -- 172.21.15.177:0/3798432541 >> 172.21.15.177:0/3798432541 conn(0x7f63a80b0cc0 msgr2=0x7f63a813c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:21.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.169+0000 7f63afb1d640 1 -- 172.21.15.177:0/3798432541 shutdown_connections 2023-11-28T20:09:21.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.169+0000 7f63afb1d640 1 -- 172.21.15.177:0/3798432541 wait complete. 2023-11-28T20:09:21.191 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:09:21.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.329+0000 7f721f5f8640 1 Processor -- start 2023-11-28T20:09:21.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.329+0000 7f721f5f8640 1 -- start start 2023-11-28T20:09:21.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.329+0000 7f721f5f8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7218071d90 0x7f7218072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.329+0000 7f721f5f8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f721813f5f0 0x7f72180ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.329+0000 7f721f5f8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721813d2b0 con 0x7f721815adb0 2023-11-28T20:09:21.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.329+0000 7f721f5f8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7218140520 con 0x7f721813f5f0 2023-11-28T20:09:21.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.329+0000 7f721f5f8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72180cd7f0 con 0x7f7218071d90 2023-11-28T20:09:21.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f721cb93640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f721815adb0 0x7f721813d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44604/0 (socket says 172.21.15.177:44604) 2023-11-28T20:09:21.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f721cb93640 1 -- 172.21.15.177:0/181161352 learned_addr learned my addr 172.21.15.177:0/181161352 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:21.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f721db95640 1 --2- 172.21.15.177:0/181161352 >> v2:172.21.15.195:3300/0 conn(0x7f721813f5f0 0x7f72180ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f721d394640 1 --2- 172.21.15.177:0/181161352 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7218071d90 0x7f7218072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 -- 172.21.15.177:0/181161352 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411660071 0 0) 0x7f721813d2b0 con 0x7f721815adb0 2023-11-28T20:09:21.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 -- 172.21.15.177:0/181161352 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7204003530 con 0x7f721815adb0 2023-11-28T20:09:21.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 -- 172.21.15.177:0/181161352 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 849093003 0 0) 0x7f7204003530 con 0x7f721815adb0 2023-11-28T20:09:21.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 -- 172.21.15.177:0/181161352 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7218071d90 msgr2=0x7f7218072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:21.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 --2- 172.21.15.177:0/181161352 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7218071d90 0x7f7218072170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 -- 172.21.15.177:0/181161352 >> v2:172.21.15.195:3300/0 conn(0x7f721813f5f0 msgr2=0x7f72180ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:21.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 --2- 172.21.15.177:0/181161352 >> v2:172.21.15.195:3300/0 conn(0x7f721813f5f0 0x7f72180ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 -- 172.21.15.177:0/181161352 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72180cdd70 con 0x7f721815adb0 2023-11-28T20:09:21.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 -- 172.21.15.177:0/181161352 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f7208001680 con 0x7f721815adb0 2023-11-28T20:09:21.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 -- 172.21.15.177:0/181161352 >> v1:172.21.15.177:6789/0 conn(0x7f721815adb0 legacy=0x7f721813d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 --2- 172.21.15.177:0/181161352 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7218071d90 0x7f7204003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 --2- 172.21.15.177:0/181161352 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7204003f50 0x7f72040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 --2- 172.21.15.177:0/181161352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7204004d10 0x7f7204005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 -- 172.21.15.177:0/181161352 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7218140520 con 0x7f7204004d10 2023-11-28T20:09:21.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 -- 172.21.15.177:0/181161352 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72180cd7f0 con 0x7f7204003f50 2023-11-28T20:09:21.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f720ffff640 1 -- 172.21.15.177:0/181161352 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720400dba0 con 0x7f7218071d90 2023-11-28T20:09:21.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f721db95640 1 --2- 172.21.15.177:0/181161352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7204004d10 0x7f7204005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f721d394640 1 --2- 172.21.15.177:0/181161352 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7218071d90 0x7f7204003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f721cb93640 1 --2- 172.21.15.177:0/181161352 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7204003f50 0x7f72040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f721db95640 1 -- 172.21.15.177:0/181161352 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7218071d90 msgr2=0x7f7204003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:21.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f721db95640 1 --2- 172.21.15.177:0/181161352 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7218071d90 0x7f7204003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f721db95640 1 -- 172.21.15.177:0/181161352 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7204003f50 msgr2=0x7f72040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:21.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f721db95640 1 --2- 172.21.15.177:0/181161352 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7204003f50 0x7f72040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.333+0000 7f721db95640 1 -- 172.21.15.177:0/181161352 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7204003530 con 0x7f7204004d10 2023-11-28T20:09:21.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.337+0000 7f721db95640 1 --2- 172.21.15.177:0/181161352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7204004d10 0x7f7204005190 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f721000e170 tx=0x7f721001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7cdb25a03d3074 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:21.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.337+0000 7f720ffff640 1 -- 172.21.15.177:0/181161352 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72100a5c90 con 0x7f7204004d10 2023-11-28T20:09:21.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.337+0000 7f720ffff640 1 -- 172.21.15.177:0/181161352 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721000f040 con 0x7f7204004d10 2023-11-28T20:09:21.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.337+0000 7f720ffff640 1 -- 172.21.15.177:0/181161352 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72100ad440 con 0x7f7204004d10 2023-11-28T20:09:21.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.337+0000 7f721f5f8640 1 -- 172.21.15.177:0/181161352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7204004d10 msgr2=0x7f7204005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.337+0000 7f721f5f8640 1 --2- 172.21.15.177:0/181161352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7204004d10 0x7f7204005190 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f721000e170 tx=0x7f721001cc80 comp rx=0 tx=0).stop 2023-11-28T20:09:21.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.337+0000 7f721db95640 1 -- 172.21.15.177:0/181161352 reap_dead start 2023-11-28T20:09:21.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.337+0000 7f721f5f8640 1 -- 172.21.15.177:0/181161352 shutdown_connections 2023-11-28T20:09:21.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.337+0000 7f721f5f8640 1 -- 172.21.15.177:0/181161352 >> 172.21.15.177:0/181161352 conn(0x7f72180b0cc0 msgr2=0x7f72180b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:21.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.337+0000 7f721f5f8640 1 -- 172.21.15.177:0/181161352 shutdown_connections 2023-11-28T20:09:21.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.337+0000 7f721f5f8640 1 -- 172.21.15.177:0/181161352 wait complete. 2023-11-28T20:09:21.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.337+0000 7f721f5f8640 1 Processor -- start 2023-11-28T20:09:21.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.337+0000 7f721f5f8640 1 -- start start 2023-11-28T20:09:21.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721f5f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7204004d10 0x7f72180a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721f5f8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72180adae0 0x7f72180b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721f5f8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72180adf60 0x7f72180b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721f5f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72180a93b0 con 0x7f7204004d10 2023-11-28T20:09:21.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721f5f8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72180a87a0 con 0x7f72180adae0 2023-11-28T20:09:21.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721f5f8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72180a8a80 con 0x7f72180adf60 2023-11-28T20:09:21.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721d394640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7204004d10 0x7f72180a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721d394640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7204004d10 0x7f72180a9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39434/0 (socket says 172.21.15.177:39434) 2023-11-28T20:09:21.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721d394640 1 -- 172.21.15.177:0/4180721024 learned_addr learned my addr 172.21.15.177:0/4180721024 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:21.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721cb93640 1 --2- 172.21.15.177:0/4180721024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72180adae0 0x7f72180b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721db95640 1 --2- 172.21.15.177:0/4180721024 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72180adf60 0x7f72180b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721d394640 1 -- 172.21.15.177:0/4180721024 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72180adf60 msgr2=0x7f72180b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721d394640 1 --2- 172.21.15.177:0/4180721024 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72180adf60 0x7f72180b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721d394640 1 -- 172.21.15.177:0/4180721024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72180adae0 msgr2=0x7f72180b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721d394640 1 --2- 172.21.15.177:0/4180721024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72180adae0 0x7f72180b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721d394640 1 -- 172.21.15.177:0/4180721024 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72180a8d60 con 0x7f7204004d10 2023-11-28T20:09:21.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721d394640 1 --2- 172.21.15.177:0/4180721024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7204004d10 0x7f72180a9840 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f72140119d0 tx=0x7f7214011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:21.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f720dffb640 1 -- 172.21.15.177:0/4180721024 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400fb50 con 0x7f7204004d10 2023-11-28T20:09:21.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f720dffb640 1 -- 172.21.15.177:0/4180721024 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721400fcb0 con 0x7f7204004d10 2023-11-28T20:09:21.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f720dffb640 1 -- 172.21.15.177:0/4180721024 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214014440 con 0x7f7204004d10 2023-11-28T20:09:21.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721f5f8640 1 -- 172.21.15.177:0/4180721024 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72180a9040 con 0x7f7204004d10 2023-11-28T20:09:21.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721f5f8640 1 -- 172.21.15.177:0/4180721024 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72180a8430 con 0x7f7204004d10 2023-11-28T20:09:21.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f721f5f8640 1 -- 172.21.15.177:0/4180721024 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72180693d0 con 0x7f7204004d10 2023-11-28T20:09:21.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.341+0000 7f720dffb640 1 -- 172.21.15.177:0/4180721024 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f72140145a0 con 0x7f7204004d10 2023-11-28T20:09:21.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.345+0000 7f720dffb640 1 --2- 172.21.15.177:0/4180721024 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71fc0664a0 0x7f71fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.345+0000 7f720dffb640 1 -- 172.21.15.177:0/4180721024 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f7214084880 con 0x7f7204004d10 2023-11-28T20:09:21.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.345+0000 7f721cb93640 1 --2- 172.21.15.177:0/4180721024 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71fc0664a0 0x7f71fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.345+0000 7f721cb93640 1 --2- 172.21.15.177:0/4180721024 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71fc0664a0 0x7f71fc068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7208001060 tx=0x7f7208009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:21.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.349+0000 7f720dffb640 1 -- 172.21.15.177:0/4180721024 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7214051c30 con 0x7f7204004d10 2023-11-28T20:09:21.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.501+0000 7f721f5f8640 1 -- 172.21.15.177:0/4180721024 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f721806e710 con 0x7f7204004d10 2023-11-28T20:09:21.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.501+0000 7f720dffb640 1 -- 172.21.15.177:0/4180721024 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7214022020 con 0x7f7204004d10 2023-11-28T20:09:21.504 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:09:21.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.501+0000 7f721f5f8640 1 -- 172.21.15.177:0/4180721024 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71fc0664a0 msgr2=0x7f71fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.501+0000 7f721f5f8640 1 --2- 172.21.15.177:0/4180721024 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71fc0664a0 0x7f71fc068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7208001060 tx=0x7f7208009040 comp rx=0 tx=0).stop 2023-11-28T20:09:21.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.501+0000 7f721f5f8640 1 -- 172.21.15.177:0/4180721024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7204004d10 msgr2=0x7f72180a9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.501+0000 7f721f5f8640 1 --2- 172.21.15.177:0/4180721024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7204004d10 0x7f72180a9840 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f72140119d0 tx=0x7f7214011e90 comp rx=0 tx=0).stop 2023-11-28T20:09:21.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.501+0000 7f721f5f8640 1 -- 172.21.15.177:0/4180721024 shutdown_connections 2023-11-28T20:09:21.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.501+0000 7f721f5f8640 1 --2- 172.21.15.177:0/4180721024 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f71fc0664a0 0x7f71fc068960 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.501+0000 7f721f5f8640 1 --2- 172.21.15.177:0/4180721024 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72180adf60 0x7f72180b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.501+0000 7f721f5f8640 1 --2- 172.21.15.177:0/4180721024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72180adae0 0x7f72180b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.501+0000 7f721f5f8640 1 --2- 172.21.15.177:0/4180721024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7204004d10 0x7f72180a9840 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.501+0000 7f721f5f8640 1 -- 172.21.15.177:0/4180721024 >> 172.21.15.177:0/4180721024 conn(0x7f72180b0cc0 msgr2=0x7f721813ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:21.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.501+0000 7f721f5f8640 1 -- 172.21.15.177:0/4180721024 shutdown_connections 2023-11-28T20:09:21.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.501+0000 7f721f5f8640 1 -- 172.21.15.177:0/4180721024 wait complete. 2023-11-28T20:09:21.525 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-11-28T20:09:21.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.665+0000 7f68679f5640 1 Processor -- start 2023-11-28T20:09:21.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.665+0000 7f68679f5640 1 -- start start 2023-11-28T20:09:21.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.665+0000 7f68679f5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f686014b1e0 0x7f68600b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.665+0000 7f68679f5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68600b4350 0x7f68600703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.665+0000 7f68679f5640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68600b1fc0 con 0x7f686014abe0 2023-11-28T20:09:21.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.665+0000 7f68679f5640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6860166130 con 0x7f686014b1e0 2023-11-28T20:09:21.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.665+0000 7f68679f5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68600b47c0 con 0x7f68600b4350 2023-11-28T20:09:21.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.669+0000 7f6865f92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68600b4350 0x7f68600703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.669+0000 7f6864f90640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f686014b1e0 0x7f68600b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.669+0000 7f6865791640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f686014abe0 0x7f6860165a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:47244/0 (socket says 172.21.15.177:47244) 2023-11-28T20:09:21.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.669+0000 7f6865791640 1 -- 172.21.15.177:0/4228308346 learned_addr learned my addr 172.21.15.177:0/4228308346 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:21.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.669+0000 7f6865f92640 1 --2- 172.21.15.177:0/4228308346 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68600b4350 0x7f68600703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:59644/0 (socket says 172.21.15.177:59644) 2023-11-28T20:09:21.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.669+0000 7f6865f92640 1 -- 172.21.15.177:0/4228308346 >> v2:172.21.15.195:3300/0 conn(0x7f686014b1e0 msgr2=0x7f68600b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:21.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.669+0000 7f6865f92640 1 --2- 172.21.15.177:0/4228308346 >> v2:172.21.15.195:3300/0 conn(0x7f686014b1e0 0x7f68600b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.669+0000 7f6865f92640 1 -- 172.21.15.177:0/4228308346 >> v1:172.21.15.195:6789/0 conn(0x7f686014abe0 legacy=0x7f6860165a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.669+0000 7f6865f92640 1 -- 172.21.15.177:0/4228308346 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68600b2260 con 0x7f68600b4350 2023-11-28T20:09:21.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.669+0000 7f6865f92640 1 --2- 172.21.15.177:0/4228308346 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68600b4350 0x7f68600703f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6858009d90 tx=0x7f685801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fc98e55b41b443f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:21.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f6857fff640 1 -- 172.21.15.177:0/4228308346 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580a59e0 con 0x7f68600b4350 2023-11-28T20:09:21.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f6857fff640 1 -- 172.21.15.177:0/4228308346 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68580a5b40 con 0x7f68600b4350 2023-11-28T20:09:21.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f6857fff640 1 -- 172.21.15.177:0/4228308346 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580ad440 con 0x7f68600b4350 2023-11-28T20:09:21.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 -- 172.21.15.177:0/4228308346 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68600b4350 msgr2=0x7f68600703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 --2- 172.21.15.177:0/4228308346 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68600b4350 0x7f68600703f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6858009d90 tx=0x7f685801c920 comp rx=0 tx=0).stop 2023-11-28T20:09:21.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 -- 172.21.15.177:0/4228308346 shutdown_connections 2023-11-28T20:09:21.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 --2- 172.21.15.177:0/4228308346 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68600b4350 0x7f68600703f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 --2- 172.21.15.177:0/4228308346 >> v2:172.21.15.195:3300/0 conn(0x7f686014b1e0 0x7f68600b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 -- 172.21.15.177:0/4228308346 >> 172.21.15.177:0/4228308346 conn(0x7f68600b0cc0 msgr2=0x7f68600b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:21.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 -- 172.21.15.177:0/4228308346 shutdown_connections 2023-11-28T20:09:21.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 -- 172.21.15.177:0/4228308346 wait complete. 2023-11-28T20:09:21.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 Processor -- start 2023-11-28T20:09:21.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 -- start start 2023-11-28T20:09:21.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68600b4350 0x7f686015fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f686014abe0 0x7f686015f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6860161310 0x7f68600cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6860161180 con 0x7f6860161310 2023-11-28T20:09:21.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6860160600 con 0x7f686014abe0 2023-11-28T20:09:21.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f68679f5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68601608e0 con 0x7f68600b4350 2023-11-28T20:09:21.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f6865f92640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6860161310 0x7f68600cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.673+0000 7f6865f92640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6860161310 0x7f68600cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39446/0 (socket says 172.21.15.177:39446) 2023-11-28T20:09:21.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f6865f92640 1 -- 172.21.15.177:0/2211033878 learned_addr learned my addr 172.21.15.177:0/2211033878 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:21.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f6865791640 1 --2- 172.21.15.177:0/2211033878 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68600b4350 0x7f686015fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f6864f90640 1 --2- 172.21.15.177:0/2211033878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f686014abe0 0x7f686015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f6865f92640 1 -- 172.21.15.177:0/2211033878 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68600b4350 msgr2=0x7f686015fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f6865f92640 1 --2- 172.21.15.177:0/2211033878 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68600b4350 0x7f686015fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f6865f92640 1 -- 172.21.15.177:0/2211033878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f686014abe0 msgr2=0x7f686015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f6865f92640 1 --2- 172.21.15.177:0/2211033878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f686014abe0 0x7f686015f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f6865f92640 1 -- 172.21.15.177:0/2211033878 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6858009a70 con 0x7f6860161310 2023-11-28T20:09:21.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f6865f92640 1 --2- 172.21.15.177:0/2211033878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6860161310 0x7f68600cc730 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f68580b0040 tx=0x7f68580196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:21.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f6855ffb640 1 -- 172.21.15.177:0/2211033878 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580add70 con 0x7f6860161310 2023-11-28T20:09:21.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f6855ffb640 1 -- 172.21.15.177:0/2211033878 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6858009450 con 0x7f6860161310 2023-11-28T20:09:21.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f6855ffb640 1 -- 172.21.15.177:0/2211033878 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580b9690 con 0x7f6860161310 2023-11-28T20:09:21.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f68679f5640 1 -- 172.21.15.177:0/2211033878 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6860160bc0 con 0x7f6860161310 2023-11-28T20:09:21.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f68679f5640 1 -- 172.21.15.177:0/2211033878 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68601602f0 con 0x7f6860161310 2023-11-28T20:09:21.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f68679f5640 1 -- 172.21.15.177:0/2211033878 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68600693d0 con 0x7f6860161310 2023-11-28T20:09:21.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.677+0000 7f6855ffb640 1 -- 172.21.15.177:0/2211033878 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f68580b97f0 con 0x7f6860161310 2023-11-28T20:09:21.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.681+0000 7f6855ffb640 1 --2- 172.21.15.177:0/2211033878 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f68440664a0 0x7f6844068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.681+0000 7f6855ffb640 1 -- 172.21.15.177:0/2211033878 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f685811f130 con 0x7f6860161310 2023-11-28T20:09:21.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.681+0000 7f6865791640 1 --2- 172.21.15.177:0/2211033878 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f68440664a0 0x7f6844068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.681+0000 7f6865791640 1 --2- 172.21.15.177:0/2211033878 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f68440664a0 0x7f6844068960 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f685c000f70 tx=0x7f685c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:21.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.681+0000 7f6855ffb640 1 -- 172.21.15.177:0/2211033878 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68580ec3a0 con 0x7f6860161310 2023-11-28T20:09:21.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.833+0000 7f68679f5640 1 -- 172.21.15.177:0/2211033878 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f686006e710 con 0x7f6860161310 2023-11-28T20:09:21.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.833+0000 7f6855ffb640 1 -- 172.21.15.177:0/2211033878 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v36) v1 ==== 97+0+11 (secure 0 0 0) 0x7f68580ef9c0 con 0x7f6860161310 2023-11-28T20:09:21.836 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:09:21.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.833+0000 7f68679f5640 1 -- 172.21.15.177:0/2211033878 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f68440664a0 msgr2=0x7f6844068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.833+0000 7f68679f5640 1 --2- 172.21.15.177:0/2211033878 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f68440664a0 0x7f6844068960 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f685c000f70 tx=0x7f685c009040 comp rx=0 tx=0).stop 2023-11-28T20:09:21.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.833+0000 7f68679f5640 1 -- 172.21.15.177:0/2211033878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6860161310 msgr2=0x7f68600cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.833+0000 7f68679f5640 1 --2- 172.21.15.177:0/2211033878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6860161310 0x7f68600cc730 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f68580b0040 tx=0x7f68580196c0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.833+0000 7f68679f5640 1 -- 172.21.15.177:0/2211033878 shutdown_connections 2023-11-28T20:09:21.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.833+0000 7f68679f5640 1 --2- 172.21.15.177:0/2211033878 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f68440664a0 0x7f6844068960 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.833+0000 7f68679f5640 1 --2- 172.21.15.177:0/2211033878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6860161310 0x7f68600cc730 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.833+0000 7f68679f5640 1 --2- 172.21.15.177:0/2211033878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f686014abe0 0x7f686015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.833+0000 7f68679f5640 1 --2- 172.21.15.177:0/2211033878 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68600b4350 0x7f686015fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.833+0000 7f68679f5640 1 -- 172.21.15.177:0/2211033878 >> 172.21.15.177:0/2211033878 conn(0x7f68600b0cc0 msgr2=0x7f6860143fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:21.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.833+0000 7f68679f5640 1 -- 172.21.15.177:0/2211033878 shutdown_connections 2023-11-28T20:09:21.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.837+0000 7f68679f5640 1 -- 172.21.15.177:0/2211033878 wait complete. 2023-11-28T20:09:21.858 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:09:21.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de2c88640 1 Processor -- start 2023-11-28T20:09:21.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de2c88640 1 -- start start 2023-11-28T20:09:21.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de2c88640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3ddc1608c0 0x7f3ddc0cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de2c88640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3ddc160ca0 0x7f3ddc0cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:21.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de2c88640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc0cf130 con 0x7f3ddc0ce680 2023-11-28T20:09:21.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de2c88640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ddc0ceb70 con 0x7f3ddc1608c0 2023-11-28T20:09:21.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de2c88640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ddc0cee50 con 0x7f3ddc160ca0 2023-11-28T20:09:21.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de1c86640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3ddc1608c0 0x7f3ddc0cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de2487640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f3ddc0ce680 0x7f3ddc0d0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44614/0 (socket says 172.21.15.177:44614) 2023-11-28T20:09:21.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de2487640 1 -- 172.21.15.177:0/1279670886 learned_addr learned my addr 172.21.15.177:0/1279670886 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:21.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de1485640 1 --2- 172.21.15.177:0/1279670886 >> v2:172.21.15.195:3300/0 conn(0x7f3ddc160ca0 0x7f3ddc0cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:21.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de1c86640 1 -- 172.21.15.177:0/1279670886 >> v2:172.21.15.195:3300/0 conn(0x7f3ddc160ca0 msgr2=0x7f3ddc0cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:21.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de1c86640 1 --2- 172.21.15.177:0/1279670886 >> v2:172.21.15.195:3300/0 conn(0x7f3ddc160ca0 0x7f3ddc0cfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:21.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de1c86640 1 -- 172.21.15.177:0/1279670886 >> v1:172.21.15.177:6789/0 conn(0x7f3ddc0ce680 legacy=0x7f3ddc0d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:21.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de1c86640 1 -- 172.21.15.177:0/1279670886 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc0b29e0 con 0x7f3ddc1608c0 2023-11-28T20:09:21.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.993+0000 7f3de1485640 1 --2- 172.21.15.177:0/1279670886 >> v2:172.21.15.195:3300/0 conn(0x7f3ddc160ca0 0x7f3ddc0cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:22.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.997+0000 7f3de1c86640 1 --2- 172.21.15.177:0/1279670886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ddc1608c0 0x7f3ddc0cf510 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0c6ad0 tx=0x7f3dd801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ebe9e3e4e2b606 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:22.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.997+0000 7f3de0c84640 1 -- 172.21.15.177:0/1279670886 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd80ab650 con 0x7f3ddc1608c0 2023-11-28T20:09:22.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.997+0000 7f3de0c84640 1 -- 172.21.15.177:0/1279670886 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd80ab7b0 con 0x7f3ddc1608c0 2023-11-28T20:09:22.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.997+0000 7f3de0c84640 1 -- 172.21.15.177:0/1279670886 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd80abb40 con 0x7f3ddc1608c0 2023-11-28T20:09:22.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.997+0000 7f3de2c88640 1 -- 172.21.15.177:0/1279670886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ddc1608c0 msgr2=0x7f3ddc0cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.997+0000 7f3de2c88640 1 --2- 172.21.15.177:0/1279670886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ddc1608c0 0x7f3ddc0cf510 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0c6ad0 tx=0x7f3dd801c430 comp rx=0 tx=0).stop 2023-11-28T20:09:22.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.997+0000 7f3de2c88640 1 -- 172.21.15.177:0/1279670886 shutdown_connections 2023-11-28T20:09:22.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.997+0000 7f3de2c88640 1 --2- 172.21.15.177:0/1279670886 >> v2:172.21.15.195:3300/0 conn(0x7f3ddc160ca0 0x7f3ddc0cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.997+0000 7f3de2c88640 1 --2- 172.21.15.177:0/1279670886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ddc1608c0 0x7f3ddc0cf510 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.997+0000 7f3de2c88640 1 -- 172.21.15.177:0/1279670886 >> 172.21.15.177:0/1279670886 conn(0x7f3ddc0d2fd0 msgr2=0x7f3ddc0d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:22.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.997+0000 7f3de2c88640 1 -- 172.21.15.177:0/1279670886 shutdown_connections 2023-11-28T20:09:22.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:21.997+0000 7f3de2c88640 1 -- 172.21.15.177:0/1279670886 wait complete. 2023-11-28T20:09:22.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2c88640 1 Processor -- start 2023-11-28T20:09:22.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2c88640 1 -- start start 2023-11-28T20:09:22.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2c88640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ddc0ce680 0x7f3ddc14fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:22.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2c88640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ddc1608c0 0x7f3ddc06ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:22.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2c88640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ddc160ca0 0x7f3ddc14eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:22.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2c88640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc150520 con 0x7f3ddc160ca0 2023-11-28T20:09:22.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2c88640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc150800 con 0x7f3ddc1608c0 2023-11-28T20:09:22.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2c88640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc150ae0 con 0x7f3ddc0ce680 2023-11-28T20:09:22.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2487640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ddc160ca0 0x7f3ddc14eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:22.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2487640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ddc160ca0 0x7f3ddc14eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39472/0 (socket says 172.21.15.177:39472) 2023-11-28T20:09:22.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2487640 1 -- 172.21.15.177:0/1306578428 learned_addr learned my addr 172.21.15.177:0/1306578428 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:22.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de1c86640 1 --2- 172.21.15.177:0/1306578428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ddc0ce680 0x7f3ddc14fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:22.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de1485640 1 --2- 172.21.15.177:0/1306578428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ddc1608c0 0x7f3ddc06ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:22.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2487640 1 -- 172.21.15.177:0/1306578428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ddc0ce680 msgr2=0x7f3ddc14fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2487640 1 --2- 172.21.15.177:0/1306578428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ddc0ce680 0x7f3ddc14fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2487640 1 -- 172.21.15.177:0/1306578428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ddc1608c0 msgr2=0x7f3ddc06ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2487640 1 --2- 172.21.15.177:0/1306578428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ddc1608c0 0x7f3ddc06ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2487640 1 -- 172.21.15.177:0/1306578428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd8009420 con 0x7f3ddc160ca0 2023-11-28T20:09:22.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2487640 1 --2- 172.21.15.177:0/1306578428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ddc160ca0 0x7f3ddc14eff0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400cbc0 tx=0x7f3dd400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:22.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3dd27fc640 1 -- 172.21.15.177:0/1306578428 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd400ad40 con 0x7f3ddc160ca0 2023-11-28T20:09:22.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3dd27fc640 1 -- 172.21.15.177:0/1306578428 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd4012400 con 0x7f3ddc160ca0 2023-11-28T20:09:22.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2c88640 1 -- 172.21.15.177:0/1306578428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ddc150dc0 con 0x7f3ddc160ca0 2023-11-28T20:09:22.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3dd27fc640 1 -- 172.21.15.177:0/1306578428 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd400aea0 con 0x7f3ddc160ca0 2023-11-28T20:09:22.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2c88640 1 -- 172.21.15.177:0/1306578428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ddc1500f0 con 0x7f3ddc160ca0 2023-11-28T20:09:22.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.001+0000 7f3de2c88640 1 -- 172.21.15.177:0/1306578428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ddc0a1000 con 0x7f3ddc160ca0 2023-11-28T20:09:22.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.005+0000 7f3dd27fc640 1 -- 172.21.15.177:0/1306578428 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3dd4007070 con 0x7f3ddc160ca0 2023-11-28T20:09:22.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.005+0000 7f3dd27fc640 1 --2- 172.21.15.177:0/1306578428 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3dc00664c0 0x7f3dc0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:22.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.005+0000 7f3dd27fc640 1 -- 172.21.15.177:0/1306578428 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f3dd4083e10 con 0x7f3ddc160ca0 2023-11-28T20:09:22.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.005+0000 7f3de1c86640 1 --2- 172.21.15.177:0/1306578428 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3dc00664c0 0x7f3dc0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:22.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.005+0000 7f3de1c86640 1 --2- 172.21.15.177:0/1306578428 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3dc00664c0 0x7f3dc0068980 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80af000 tx=0x7f3dd80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:22.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.009+0000 7f3dd27fc640 1 -- 172.21.15.177:0/1306578428 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3dd4087030 con 0x7f3ddc160ca0 2023-11-28T20:09:22.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.169+0000 7f3de2c88640 1 -- 172.21.15.177:0/1306578428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3ddc0d2000 con 0x7f3ddc160ca0 2023-11-28T20:09:22.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.169+0000 7f3dd27fc640 1 -- 172.21.15.177:0/1306578428 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3dd4051220 con 0x7f3ddc160ca0 2023-11-28T20:09:22.174 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:09:22.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.173+0000 7f3de2c88640 1 -- 172.21.15.177:0/1306578428 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3dc00664c0 msgr2=0x7f3dc0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.173+0000 7f3de2c88640 1 --2- 172.21.15.177:0/1306578428 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3dc00664c0 0x7f3dc0068980 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80af000 tx=0x7f3dd80a7000 comp rx=0 tx=0).stop 2023-11-28T20:09:22.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.173+0000 7f3de2c88640 1 -- 172.21.15.177:0/1306578428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ddc160ca0 msgr2=0x7f3ddc14eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.173+0000 7f3de2c88640 1 --2- 172.21.15.177:0/1306578428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ddc160ca0 0x7f3ddc14eff0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400cbc0 tx=0x7f3dd400a430 comp rx=0 tx=0).stop 2023-11-28T20:09:22.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.173+0000 7f3de2c88640 1 -- 172.21.15.177:0/1306578428 shutdown_connections 2023-11-28T20:09:22.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.173+0000 7f3de2c88640 1 --2- 172.21.15.177:0/1306578428 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3dc00664c0 0x7f3dc0068980 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.173+0000 7f3de2c88640 1 --2- 172.21.15.177:0/1306578428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ddc160ca0 0x7f3ddc14eff0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.173+0000 7f3de2c88640 1 --2- 172.21.15.177:0/1306578428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ddc1608c0 0x7f3ddc06ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.173+0000 7f3de2c88640 1 --2- 172.21.15.177:0/1306578428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ddc0ce680 0x7f3ddc14fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.173+0000 7f3de2c88640 1 -- 172.21.15.177:0/1306578428 >> 172.21.15.177:0/1306578428 conn(0x7f3ddc0d2fd0 msgr2=0x7f3ddc0cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:22.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.173+0000 7f3de2c88640 1 -- 172.21.15.177:0/1306578428 shutdown_connections 2023-11-28T20:09:22.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.173+0000 7f3de2c88640 1 -- 172.21.15.177:0/1306578428 wait complete. 2023-11-28T20:09:22.195 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:09:22.195 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:09:22.206 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:09:22.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a6489c640 1 Processor -- start 2023-11-28T20:09:22.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a6489c640 1 -- start start 2023-11-28T20:09:22.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a6489c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7a6015d200 0x7f7a600d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:22.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a6489c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7a600d15a0 0x7f7a600b6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:22.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a6489c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a600b29f0 con 0x7f7a600d1160 2023-11-28T20:09:22.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a6489c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a600d1b00 con 0x7f7a600d15a0 2023-11-28T20:09:22.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a6489c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a600d1de0 con 0x7f7a6015d200 2023-11-28T20:09:22.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a5ed9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7a600d15a0 0x7f7a600b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:22.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a55d9b640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f7a600d1160 0x7f7a600cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44618/0 (socket says 172.21.15.177:44618) 2023-11-28T20:09:22.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a55d9b640 1 -- 172.21.15.177:0/650870121 learned_addr learned my addr 172.21.15.177:0/650870121 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:22.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a5e59c640 1 --2- 172.21.15.177:0/650870121 >> v2:172.21.15.195:3300/0 conn(0x7f7a6015d200 0x7f7a600d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:22.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a5ed9d640 1 -- 172.21.15.177:0/650870121 >> v2:172.21.15.195:3300/0 conn(0x7f7a6015d200 msgr2=0x7f7a600d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:22.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a5ed9d640 1 --2- 172.21.15.177:0/650870121 >> v2:172.21.15.195:3300/0 conn(0x7f7a6015d200 0x7f7a600d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a5ed9d640 1 -- 172.21.15.177:0/650870121 >> v1:172.21.15.177:6789/0 conn(0x7f7a600d1160 legacy=0x7f7a600cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a5ed9d640 1 -- 172.21.15.177:0/650870121 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a600d20c0 con 0x7f7a600d15a0 2023-11-28T20:09:22.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.385+0000 7f7a5dd9b640 1 -- 172.21.15.177:0/650870121 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338807593 0 0) 0x7f7a600b29f0 con 0x7f7a600d1160 2023-11-28T20:09:22.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.389+0000 7f7a5ed9d640 1 --2- 172.21.15.177:0/650870121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a600d15a0 0x7f7a600b6190 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7a600b5800 tx=0x7f7a5801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b1d352228cb585 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:22.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.389+0000 7f7a5dd9b640 1 -- 172.21.15.177:0/650870121 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a580a8950 con 0x7f7a600d15a0 2023-11-28T20:09:22.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.389+0000 7f7a5dd9b640 1 -- 172.21.15.177:0/650870121 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a580a8ab0 con 0x7f7a600d15a0 2023-11-28T20:09:22.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.389+0000 7f7a5dd9b640 1 -- 172.21.15.177:0/650870121 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a580a8e40 con 0x7f7a600d15a0 2023-11-28T20:09:22.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.389+0000 7f7a6489c640 1 -- 172.21.15.177:0/650870121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a600d15a0 msgr2=0x7f7a600b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.389+0000 7f7a6489c640 1 --2- 172.21.15.177:0/650870121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a600d15a0 0x7f7a600b6190 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7a600b5800 tx=0x7f7a5801ec50 comp rx=0 tx=0).stop 2023-11-28T20:09:22.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.389+0000 7f7a6489c640 1 -- 172.21.15.177:0/650870121 shutdown_connections 2023-11-28T20:09:22.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.389+0000 7f7a6489c640 1 --2- 172.21.15.177:0/650870121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a600d15a0 0x7f7a600b6190 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.389+0000 7f7a6489c640 1 --2- 172.21.15.177:0/650870121 >> v2:172.21.15.195:3300/0 conn(0x7f7a6015d200 0x7f7a600d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.389+0000 7f7a6489c640 1 -- 172.21.15.177:0/650870121 >> 172.21.15.177:0/650870121 conn(0x7f7a60072260 msgr2=0x7f7a600cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:22.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.389+0000 7f7a6489c640 1 -- 172.21.15.177:0/650870121 shutdown_connections 2023-11-28T20:09:22.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.389+0000 7f7a6489c640 1 -- 172.21.15.177:0/650870121 wait complete. 2023-11-28T20:09:22.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a6489c640 1 Processor -- start 2023-11-28T20:09:22.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a6489c640 1 -- start start 2023-11-28T20:09:22.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a6489c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a600d1160 0x7f7a600c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:22.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a6489c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a600d15a0 0x7f7a600cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:22.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a6489c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a6015d200 0x7f7a6015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:22.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a6489c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a600c7530 con 0x7f7a600d1160 2023-11-28T20:09:22.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a6489c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a600c80b0 con 0x7f7a600d15a0 2023-11-28T20:09:22.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a6489c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a600c84d0 con 0x7f7a6015d200 2023-11-28T20:09:22.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a5e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a600d1160 0x7f7a600c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:22.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a5e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a600d1160 0x7f7a600c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39488/0 (socket says 172.21.15.177:39488) 2023-11-28T20:09:22.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a5e59c640 1 -- 172.21.15.177:0/1180952046 learned_addr learned my addr 172.21.15.177:0/1180952046 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:22.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a55d9b640 1 --2- 172.21.15.177:0/1180952046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a600d15a0 0x7f7a600cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:22.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a5ed9d640 1 --2- 172.21.15.177:0/1180952046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a6015d200 0x7f7a6015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:22.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a5e59c640 1 -- 172.21.15.177:0/1180952046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a6015d200 msgr2=0x7f7a6015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a5e59c640 1 --2- 172.21.15.177:0/1180952046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a6015d200 0x7f7a6015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a5e59c640 1 -- 172.21.15.177:0/1180952046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a600d15a0 msgr2=0x7f7a600cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a5e59c640 1 --2- 172.21.15.177:0/1180952046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a600d15a0 0x7f7a600cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a5e59c640 1 -- 172.21.15.177:0/1180952046 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a58009420 con 0x7f7a600d1160 2023-11-28T20:09:22.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a5e59c640 1 --2- 172.21.15.177:0/1180952046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a600d1160 0x7f7a600c9750 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7a50007e70 tx=0x7f7a5000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:22.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a577fe640 1 -- 172.21.15.177:0/1180952046 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a50014620 con 0x7f7a600d1160 2023-11-28T20:09:22.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a577fe640 1 -- 172.21.15.177:0/1180952046 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a50014780 con 0x7f7a600d1160 2023-11-28T20:09:22.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a577fe640 1 -- 172.21.15.177:0/1180952046 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a50014b10 con 0x7f7a600d1160 2023-11-28T20:09:22.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a6489c640 1 -- 172.21.15.177:0/1180952046 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a600c7710 con 0x7f7a600d1160 2023-11-28T20:09:22.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.393+0000 7f7a6489c640 1 -- 172.21.15.177:0/1180952046 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a600c7cd0 con 0x7f7a600d1160 2023-11-28T20:09:22.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.397+0000 7f7a6489c640 1 -- 172.21.15.177:0/1180952046 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a60069440 con 0x7f7a600d1160 2023-11-28T20:09:22.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.397+0000 7f7a577fe640 1 -- 172.21.15.177:0/1180952046 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7a50014c70 con 0x7f7a600d1160 2023-11-28T20:09:22.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.397+0000 7f7a577fe640 1 --2- 172.21.15.177:0/1180952046 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7a40066470 0x7f7a40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:22.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.397+0000 7f7a577fe640 1 -- 172.21.15.177:0/1180952046 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f7a50084970 con 0x7f7a600d1160 2023-11-28T20:09:22.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.397+0000 7f7a55d9b640 1 --2- 172.21.15.177:0/1180952046 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7a40066470 0x7f7a40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:22.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.397+0000 7f7a55d9b640 1 --2- 172.21.15.177:0/1180952046 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7a40066470 0x7f7a40068930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7a600c9600 tx=0x7f7a48007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:22.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.401+0000 7f7a577fe640 1 -- 172.21.15.177:0/1180952046 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7a50051c60 con 0x7f7a600d1160 2023-11-28T20:09:22.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.553+0000 7f7a6489c640 1 -- 172.21.15.177:0/1180952046 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a600b1fc0 con 0x7f7a600d1160 2023-11-28T20:09:22.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.557+0000 7f7a577fe640 1 -- 172.21.15.177:0/1180952046 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18408 (secure 0 0 0) 0x7f7a600b1fc0 con 0x7f7a600d1160 2023-11-28T20:09:22.558 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:22.559 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":36,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:55.264752+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:08:37.943771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T20:08:38.396895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2023-11-28T20:08:52.500186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:09:22.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.557+0000 7f7a6489c640 1 -- 172.21.15.177:0/1180952046 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7a40066470 msgr2=0x7f7a40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.557+0000 7f7a6489c640 1 --2- 172.21.15.177:0/1180952046 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7a40066470 0x7f7a40068930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7a600c9600 tx=0x7f7a48007b60 comp rx=0 tx=0).stop 2023-11-28T20:09:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.557+0000 7f7a6489c640 1 -- 172.21.15.177:0/1180952046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a600d1160 msgr2=0x7f7a600c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.557+0000 7f7a6489c640 1 --2- 172.21.15.177:0/1180952046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a600d1160 0x7f7a600c9750 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7a50007e70 tx=0x7f7a5000e4b0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.557+0000 7f7a6489c640 1 -- 172.21.15.177:0/1180952046 shutdown_connections 2023-11-28T20:09:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.557+0000 7f7a6489c640 1 --2- 172.21.15.177:0/1180952046 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7a40066470 0x7f7a40068930 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.557+0000 7f7a6489c640 1 --2- 172.21.15.177:0/1180952046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a6015d200 0x7f7a6015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.557+0000 7f7a6489c640 1 --2- 172.21.15.177:0/1180952046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a600d15a0 0x7f7a600cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.557+0000 7f7a6489c640 1 --2- 172.21.15.177:0/1180952046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a600d1160 0x7f7a600c9750 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.557+0000 7f7a6489c640 1 -- 172.21.15.177:0/1180952046 >> 172.21.15.177:0/1180952046 conn(0x7f7a60072260 msgr2=0x7f7a600b7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.557+0000 7f7a6489c640 1 -- 172.21.15.177:0/1180952046 shutdown_connections 2023-11-28T20:09:22.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.557+0000 7f7a6489c640 1 -- 172.21.15.177:0/1180952046 wait complete. 2023-11-28T20:09:22.580 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:08:37.943771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:08:38.396895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2023-11-28T20:08:52.500186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:09:22.580 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:09:22.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.717+0000 7ffa08009640 1 Processor -- start 2023-11-28T20:09:22.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.717+0000 7ffa08009640 1 -- start start 2023-11-28T20:09:22.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.721+0000 7ffa08009640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ffa0015adb0 0x7ffa0013d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:22.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.721+0000 7ffa08009640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0013d2b0 con 0x7ffa0013f5f0 2023-11-28T20:09:22.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.721+0000 7ffa08009640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa000cdd70 con 0x7ffa00071d90 2023-11-28T20:09:22.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.721+0000 7ffa08009640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa00140520 con 0x7ffa0015adb0 2023-11-28T20:09:22.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.721+0000 7ffa065a6640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ffa0013f5f0 0x7ffa000ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44632/0 (socket says 172.21.15.177:44632) 2023-11-28T20:09:22.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.721+0000 7ffa065a6640 1 -- 172.21.15.177:0/339699130 learned_addr learned my addr 172.21.15.177:0/339699130 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:22.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.721+0000 7ffa055a4640 1 --2- 172.21.15.177:0/339699130 >> v2:172.21.15.195:3300/0 conn(0x7ffa0015adb0 0x7ffa0013d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:22.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.721+0000 7ffa04da3640 1 -- 172.21.15.177:0/339699130 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601573641 0 0) 0x7ffa0013d2b0 con 0x7ffa0013f5f0 2023-11-28T20:09:22.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.721+0000 7ffa04da3640 1 -- 172.21.15.177:0/339699130 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9ec003530 con 0x7ffa0013f5f0 2023-11-28T20:09:22.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.721+0000 7ffa055a4640 1 -- 172.21.15.177:0/339699130 >> v1:172.21.15.195:6789/0 conn(0x7ffa00071d90 legacy=0x7ffa00072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.721+0000 7ffa055a4640 1 -- 172.21.15.177:0/339699130 >> v1:172.21.15.177:6789/0 conn(0x7ffa0013f5f0 legacy=0x7ffa000ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.721+0000 7ffa055a4640 1 -- 172.21.15.177:0/339699130 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0013ff60 con 0x7ffa0015adb0 2023-11-28T20:09:22.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.725+0000 7ffa055a4640 1 --2- 172.21.15.177:0/339699130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa0015adb0 0x7ffa0013d560 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00097c0 tx=0x7ff9f001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f21cc32f34354311 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:22.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.725+0000 7ffa04da3640 1 -- 172.21.15.177:0/339699130 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00ab600 con 0x7ffa0015adb0 2023-11-28T20:09:22.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.725+0000 7ffa04da3640 1 -- 172.21.15.177:0/339699130 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f00a7050 con 0x7ffa0015adb0 2023-11-28T20:09:22.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.725+0000 7ffa04da3640 1 -- 172.21.15.177:0/339699130 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00ab960 con 0x7ffa0015adb0 2023-11-28T20:09:22.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.725+0000 7ffa08009640 1 -- 172.21.15.177:0/339699130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa0015adb0 msgr2=0x7ffa0013d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.725+0000 7ffa08009640 1 --2- 172.21.15.177:0/339699130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa0015adb0 0x7ffa0013d560 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00097c0 tx=0x7ff9f001c480 comp rx=0 tx=0).stop 2023-11-28T20:09:22.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.725+0000 7ffa08009640 1 -- 172.21.15.177:0/339699130 shutdown_connections 2023-11-28T20:09:22.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.725+0000 7ffa08009640 1 --2- 172.21.15.177:0/339699130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa0015adb0 0x7ffa0013d560 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.725+0000 7ffa08009640 1 -- 172.21.15.177:0/339699130 >> 172.21.15.177:0/339699130 conn(0x7ffa000b0cc0 msgr2=0x7ffa000b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:22.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.725+0000 7ffa08009640 1 -- 172.21.15.177:0/339699130 shutdown_connections 2023-11-28T20:09:22.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.725+0000 7ffa08009640 1 -- 172.21.15.177:0/339699130 wait complete. 2023-11-28T20:09:22.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.725+0000 7ffa08009640 1 Processor -- start 2023-11-28T20:09:22.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.725+0000 7ffa08009640 1 -- start start 2023-11-28T20:09:22.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa08009640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa00071d90 0x7ffa00150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:22.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa08009640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa0013f5f0 0x7ffa000ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:22.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa08009640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa0015adb0 0x7ffa00133ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:22.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa08009640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa000ae130 con 0x7ffa0013f5f0 2023-11-28T20:09:22.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa08009640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa00150fa0 con 0x7ffa00071d90 2023-11-28T20:09:22.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa08009640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa000ad090 con 0x7ffa0015adb0 2023-11-28T20:09:22.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa055a4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa0013f5f0 0x7ffa000ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:22.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa055a4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa0013f5f0 0x7ffa000ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39500/0 (socket says 172.21.15.177:39500) 2023-11-28T20:09:22.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa055a4640 1 -- 172.21.15.177:0/3398770865 learned_addr learned my addr 172.21.15.177:0/3398770865 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:22.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa05da5640 1 --2- 172.21.15.177:0/3398770865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa00071d90 0x7ffa00150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:22.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa065a6640 1 --2- 172.21.15.177:0/3398770865 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa0015adb0 0x7ffa00133ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:22.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa055a4640 1 -- 172.21.15.177:0/3398770865 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa0015adb0 msgr2=0x7ffa00133ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa055a4640 1 --2- 172.21.15.177:0/3398770865 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa0015adb0 0x7ffa00133ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa055a4640 1 -- 172.21.15.177:0/3398770865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa00071d90 msgr2=0x7ffa00150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa055a4640 1 --2- 172.21.15.177:0/3398770865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa00071d90 0x7ffa00150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa055a4640 1 -- 172.21.15.177:0/3398770865 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f0009420 con 0x7ffa0013f5f0 2023-11-28T20:09:22.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa055a4640 1 --2- 172.21.15.177:0/3398770865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa0013f5f0 0x7ffa000ac840 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff9f001a0b0 tx=0x7ff9f0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:22.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ff9f67fc640 1 -- 172.21.15.177:0/3398770865 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0006e20 con 0x7ffa0013f5f0 2023-11-28T20:09:22.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ff9f67fc640 1 -- 172.21.15.177:0/3398770865 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f0004020 con 0x7ffa0013f5f0 2023-11-28T20:09:22.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ff9f67fc640 1 -- 172.21.15.177:0/3398770865 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0004390 con 0x7ffa0013f5f0 2023-11-28T20:09:22.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa08009640 1 -- 172.21.15.177:0/3398770865 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa000ad370 con 0x7ffa0013f5f0 2023-11-28T20:09:22.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa08009640 1 -- 172.21.15.177:0/3398770865 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa000ad930 con 0x7ffa0013f5f0 2023-11-28T20:09:22.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ffa08009640 1 -- 172.21.15.177:0/3398770865 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa000ced20 con 0x7ffa0013f5f0 2023-11-28T20:09:22.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.729+0000 7ff9f67fc640 1 -- 172.21.15.177:0/3398770865 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff9f00b2040 con 0x7ffa0013f5f0 2023-11-28T20:09:22.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.733+0000 7ff9f67fc640 1 --2- 172.21.15.177:0/3398770865 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff9e4066470 0x7ff9e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:22.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.733+0000 7ff9f67fc640 1 -- 172.21.15.177:0/3398770865 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7ff9f011d1c0 con 0x7ffa0013f5f0 2023-11-28T20:09:22.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.733+0000 7ffa05da5640 1 --2- 172.21.15.177:0/3398770865 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff9e4066470 0x7ff9e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:22.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.733+0000 7ffa05da5640 1 --2- 172.21.15.177:0/3398770865 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff9e4066470 0x7ff9e4068930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa000cc610 tx=0x7ff9fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:22.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.737+0000 7ff9f67fc640 1 -- 172.21.15.177:0/3398770865 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9f00ea560 con 0x7ffa0013f5f0 2023-11-28T20:09:22.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.885+0000 7ffa08009640 1 -- 172.21.15.177:0/3398770865 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa000693d0 con 0x7ffa0013f5f0 2023-11-28T20:09:22.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.885+0000 7ff9f67fc640 1 -- 172.21.15.177:0/3398770865 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9f00044f0 con 0x7ffa0013f5f0 2023-11-28T20:09:22.890 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:09:22.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.889+0000 7ffa08009640 1 -- 172.21.15.177:0/3398770865 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff9e4066470 msgr2=0x7ff9e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.889+0000 7ffa08009640 1 --2- 172.21.15.177:0/3398770865 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff9e4066470 0x7ff9e4068930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa000cc610 tx=0x7ff9fc009040 comp rx=0 tx=0).stop 2023-11-28T20:09:22.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.889+0000 7ffa08009640 1 -- 172.21.15.177:0/3398770865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa0013f5f0 msgr2=0x7ffa000ac840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:22.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.889+0000 7ffa08009640 1 --2- 172.21.15.177:0/3398770865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa0013f5f0 0x7ffa000ac840 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff9f001a0b0 tx=0x7ff9f0019220 comp rx=0 tx=0).stop 2023-11-28T20:09:22.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.889+0000 7ffa08009640 1 -- 172.21.15.177:0/3398770865 shutdown_connections 2023-11-28T20:09:22.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.889+0000 7ffa08009640 1 --2- 172.21.15.177:0/3398770865 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff9e4066470 0x7ff9e4068930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.889+0000 7ffa08009640 1 --2- 172.21.15.177:0/3398770865 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa0015adb0 0x7ffa00133ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.889+0000 7ffa08009640 1 --2- 172.21.15.177:0/3398770865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa0013f5f0 0x7ffa000ac840 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.889+0000 7ffa08009640 1 --2- 172.21.15.177:0/3398770865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa00071d90 0x7ffa00150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:22.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.889+0000 7ffa08009640 1 -- 172.21.15.177:0/3398770865 >> 172.21.15.177:0/3398770865 conn(0x7ffa000b0cc0 msgr2=0x7ffa0013e670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:22.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.889+0000 7ffa08009640 1 -- 172.21.15.177:0/3398770865 shutdown_connections 2023-11-28T20:09:22.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:22.889+0000 7ffa08009640 1 -- 172.21.15.177:0/3398770865 wait complete. 2023-11-28T20:09:22.910 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:09:23.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f901985a640 1 Processor -- start 2023-11-28T20:09:23.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f901985a640 1 -- start start 2023-11-28T20:09:23.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f901985a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f901415adb0 0x7f901413d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f901985a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901413f5f0 0x7f90140ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f901985a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901413d2b0 con 0x7f9014071d90 2023-11-28T20:09:23.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f901985a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9014140520 con 0x7f901415adb0 2023-11-28T20:09:23.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f901985a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90140cd7f0 con 0x7f901413f5f0 2023-11-28T20:09:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f90127fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f901415adb0 0x7f901413d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f90127fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f901415adb0 0x7f901413d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39512/0 (socket says 172.21.15.177:39512) 2023-11-28T20:09:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f90127fc640 1 -- 172.21.15.177:0/1476338389 learned_addr learned my addr 172.21.15.177:0/1476338389 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f90137fe640 1 --2- 172.21.15.177:0/1476338389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901413f5f0 0x7f90140ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f90127fc640 1 -- 172.21.15.177:0/1476338389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901413f5f0 msgr2=0x7f90140ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f90127fc640 1 --2- 172.21.15.177:0/1476338389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901413f5f0 0x7f90140ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f90127fc640 1 -- 172.21.15.177:0/1476338389 >> v1:172.21.15.195:6789/0 conn(0x7f9014071d90 legacy=0x7f9014072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f90127fc640 1 -- 172.21.15.177:0/1476338389 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90140cdd70 con 0x7f901415adb0 2023-11-28T20:09:23.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.049+0000 7f90137fe640 1 --2- 172.21.15.177:0/1476338389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901413f5f0 0x7f90140ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:23.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.053+0000 7f90127fc640 1 --2- 172.21.15.177:0/1476338389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901415adb0 0x7f901413d560 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9008009870 tx=0x7f900801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa852bd66ff02b9b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:23.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.053+0000 7f9011ffb640 1 -- 172.21.15.177:0/1476338389 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080aa670 con 0x7f901415adb0 2023-11-28T20:09:23.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.053+0000 7f9011ffb640 1 -- 172.21.15.177:0/1476338389 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90080aa7d0 con 0x7f901415adb0 2023-11-28T20:09:23.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.053+0000 7f9011ffb640 1 -- 172.21.15.177:0/1476338389 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080aab60 con 0x7f901415adb0 2023-11-28T20:09:23.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.053+0000 7f901985a640 1 -- 172.21.15.177:0/1476338389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901415adb0 msgr2=0x7f901413d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.053+0000 7f901985a640 1 --2- 172.21.15.177:0/1476338389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901415adb0 0x7f901413d560 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9008009870 tx=0x7f900801c510 comp rx=0 tx=0).stop 2023-11-28T20:09:23.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.053+0000 7f901985a640 1 -- 172.21.15.177:0/1476338389 shutdown_connections 2023-11-28T20:09:23.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.053+0000 7f901985a640 1 --2- 172.21.15.177:0/1476338389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901413f5f0 0x7f90140ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.053+0000 7f901985a640 1 --2- 172.21.15.177:0/1476338389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901415adb0 0x7f901413d560 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.053+0000 7f901985a640 1 -- 172.21.15.177:0/1476338389 >> 172.21.15.177:0/1476338389 conn(0x7f90140b0cc0 msgr2=0x7f90140b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:23.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.053+0000 7f901985a640 1 -- 172.21.15.177:0/1476338389 shutdown_connections 2023-11-28T20:09:23.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.053+0000 7f901985a640 1 -- 172.21.15.177:0/1476338389 wait complete. 2023-11-28T20:09:23.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.053+0000 7f901985a640 1 Processor -- start 2023-11-28T20:09:23.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f901985a640 1 -- start start 2023-11-28T20:09:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f901985a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9014071d90 0x7f9014150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f901985a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901413f5f0 0x7f9014151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f901985a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901415adb0 0x7f90140b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f901985a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90140b38e0 con 0x7f901415adb0 2023-11-28T20:09:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f901985a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90141361a0 con 0x7f9014071d90 2023-11-28T20:09:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f901985a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90140b3b10 con 0x7f901413f5f0 2023-11-28T20:09:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f90137fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901415adb0 0x7f90140b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f90137fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901415adb0 0x7f90140b33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39526/0 (socket says 172.21.15.177:39526) 2023-11-28T20:09:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f90137fe640 1 -- 172.21.15.177:0/3769180553 learned_addr learned my addr 172.21.15.177:0/3769180553 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f9012ffd640 1 --2- 172.21.15.177:0/3769180553 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9014071d90 0x7f9014150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f90127fc640 1 --2- 172.21.15.177:0/3769180553 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901413f5f0 0x7f9014151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f90137fe640 1 -- 172.21.15.177:0/3769180553 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901413f5f0 msgr2=0x7f9014151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f90137fe640 1 --2- 172.21.15.177:0/3769180553 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901413f5f0 0x7f9014151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f90137fe640 1 -- 172.21.15.177:0/3769180553 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9014071d90 msgr2=0x7f9014150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f90137fe640 1 --2- 172.21.15.177:0/3769180553 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9014071d90 0x7f9014150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f90137fe640 1 -- 172.21.15.177:0/3769180553 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90080094d0 con 0x7f901415adb0 2023-11-28T20:09:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f90137fe640 1 --2- 172.21.15.177:0/3769180553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901415adb0 0x7f90140b33a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f900c009fa0 tx=0x7f900c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f8ffbfff640 1 -- 172.21.15.177:0/3769180553 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c003ba0 con 0x7f901415adb0 2023-11-28T20:09:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f8ffbfff640 1 -- 172.21.15.177:0/3769180553 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c00f040 con 0x7f901415adb0 2023-11-28T20:09:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f8ffbfff640 1 -- 172.21.15.177:0/3769180553 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c004030 con 0x7f901415adb0 2023-11-28T20:09:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f901985a640 1 -- 172.21.15.177:0/3769180553 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90140b3df0 con 0x7f901415adb0 2023-11-28T20:09:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f901985a640 1 -- 172.21.15.177:0/3769180553 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9014136740 con 0x7f901415adb0 2023-11-28T20:09:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.057+0000 7f901985a640 1 -- 172.21.15.177:0/3769180553 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90140b3fe0 con 0x7f901415adb0 2023-11-28T20:09:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.061+0000 7f8ffbfff640 1 -- 172.21.15.177:0/3769180553 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f900c004190 con 0x7f901415adb0 2023-11-28T20:09:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.061+0000 7f8ffbfff640 1 --2- 172.21.15.177:0/3769180553 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9000066470 0x7f9000068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.061+0000 7f8ffbfff640 1 -- 172.21.15.177:0/3769180553 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f900c0843c0 con 0x7f901415adb0 2023-11-28T20:09:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.061+0000 7f9012ffd640 1 --2- 172.21.15.177:0/3769180553 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9000066470 0x7f9000068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.061+0000 7f9012ffd640 1 --2- 172.21.15.177:0/3769180553 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9000066470 0x7f9000068930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f901413b750 tx=0x7f9004009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:23.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.065+0000 7f8ffbfff640 1 -- 172.21.15.177:0/3769180553 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f900c0516c0 con 0x7f901415adb0 2023-11-28T20:09:23.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.213+0000 7f901985a640 1 -- 172.21.15.177:0/3769180553 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90140693d0 con 0x7f901415adb0 2023-11-28T20:09:23.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.213+0000 7f8ffbfff640 1 -- 172.21.15.177:0/3769180553 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f900c054ce0 con 0x7f901415adb0 2023-11-28T20:09:23.218 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:09:23.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.217+0000 7f901985a640 1 -- 172.21.15.177:0/3769180553 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9000066470 msgr2=0x7f9000068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.217+0000 7f901985a640 1 --2- 172.21.15.177:0/3769180553 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9000066470 0x7f9000068930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f901413b750 tx=0x7f9004009040 comp rx=0 tx=0).stop 2023-11-28T20:09:23.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.217+0000 7f901985a640 1 -- 172.21.15.177:0/3769180553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901415adb0 msgr2=0x7f90140b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.217+0000 7f901985a640 1 --2- 172.21.15.177:0/3769180553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901415adb0 0x7f90140b33a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f900c009fa0 tx=0x7f900c00d560 comp rx=0 tx=0).stop 2023-11-28T20:09:23.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.217+0000 7f901985a640 1 -- 172.21.15.177:0/3769180553 shutdown_connections 2023-11-28T20:09:23.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.217+0000 7f901985a640 1 --2- 172.21.15.177:0/3769180553 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9000066470 0x7f9000068930 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.217+0000 7f901985a640 1 --2- 172.21.15.177:0/3769180553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901415adb0 0x7f90140b33a0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.217+0000 7f901985a640 1 --2- 172.21.15.177:0/3769180553 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901413f5f0 0x7f9014151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.217+0000 7f901985a640 1 --2- 172.21.15.177:0/3769180553 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9014071d90 0x7f9014150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.217+0000 7f901985a640 1 -- 172.21.15.177:0/3769180553 >> 172.21.15.177:0/3769180553 conn(0x7f90140b0cc0 msgr2=0x7f901415c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:23.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.217+0000 7f901985a640 1 -- 172.21.15.177:0/3769180553 shutdown_connections 2023-11-28T20:09:23.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.217+0000 7f901985a640 1 -- 172.21.15.177:0/3769180553 wait complete. 2023-11-28T20:09:23.239 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:09:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.377+0000 7f5acab65640 1 Processor -- start 2023-11-28T20:09:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.377+0000 7f5acab65640 1 -- start start 2023-11-28T20:09:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.377+0000 7f5acab65640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5ac4071d90 0x7f5ac4072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.377+0000 7f5acab65640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ac413f5f0 0x7f5ac40ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.377+0000 7f5acab65640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac413d2b0 con 0x7f5ac415adb0 2023-11-28T20:09:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.377+0000 7f5acab65640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac4140520 con 0x7f5ac413f5f0 2023-11-28T20:09:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.377+0000 7f5acab65640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac40cd7f0 con 0x7f5ac4071d90 2023-11-28T20:09:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.377+0000 7f5ac9102640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ac413f5f0 0x7f5ac40ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.377+0000 7f5ac9102640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ac413f5f0 0x7f5ac40ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39540/0 (socket says 172.21.15.177:39540) 2023-11-28T20:09:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.377+0000 7f5ac9102640 1 -- 172.21.15.177:0/3524247762 learned_addr learned my addr 172.21.15.177:0/3524247762 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.377+0000 7f5ac8901640 1 --2- 172.21.15.177:0/3524247762 >> v2:172.21.15.195:3300/0 conn(0x7f5ac4071d90 0x7f5ac4072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.377+0000 7f5ac9102640 1 -- 172.21.15.177:0/3524247762 >> v2:172.21.15.195:3300/0 conn(0x7f5ac4071d90 msgr2=0x7f5ac4072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.377+0000 7f5ac9102640 1 --2- 172.21.15.177:0/3524247762 >> v2:172.21.15.195:3300/0 conn(0x7f5ac4071d90 0x7f5ac4072170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.377+0000 7f5ac9102640 1 -- 172.21.15.177:0/3524247762 >> v1:172.21.15.195:6789/0 conn(0x7f5ac415adb0 legacy=0x7f5ac413d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.377+0000 7f5ac9102640 1 -- 172.21.15.177:0/3524247762 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac40cdd70 con 0x7f5ac413f5f0 2023-11-28T20:09:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.381+0000 7f5ac9102640 1 --2- 172.21.15.177:0/3524247762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac413f5f0 0x7f5ac40ce200 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40b1d80 tx=0x7f5abc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a1e0f614eca9de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.381+0000 7f5ac37fe640 1 -- 172.21.15.177:0/3524247762 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0a5890 con 0x7f5ac413f5f0 2023-11-28T20:09:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.381+0000 7f5ac37fe640 1 -- 172.21.15.177:0/3524247762 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc0a59f0 con 0x7f5ac413f5f0 2023-11-28T20:09:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.381+0000 7f5ac37fe640 1 -- 172.21.15.177:0/3524247762 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0a5d80 con 0x7f5ac413f5f0 2023-11-28T20:09:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.381+0000 7f5acab65640 1 -- 172.21.15.177:0/3524247762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac413f5f0 msgr2=0x7f5ac40ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.381+0000 7f5acab65640 1 --2- 172.21.15.177:0/3524247762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac413f5f0 0x7f5ac40ce200 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40b1d80 tx=0x7f5abc01c9d0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.381+0000 7f5acab65640 1 -- 172.21.15.177:0/3524247762 shutdown_connections 2023-11-28T20:09:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.381+0000 7f5acab65640 1 --2- 172.21.15.177:0/3524247762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac413f5f0 0x7f5ac40ce200 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.381+0000 7f5acab65640 1 --2- 172.21.15.177:0/3524247762 >> v2:172.21.15.195:3300/0 conn(0x7f5ac4071d90 0x7f5ac4072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.381+0000 7f5acab65640 1 -- 172.21.15.177:0/3524247762 >> 172.21.15.177:0/3524247762 conn(0x7f5ac40b0cc0 msgr2=0x7f5ac40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.381+0000 7f5acab65640 1 -- 172.21.15.177:0/3524247762 shutdown_connections 2023-11-28T20:09:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.381+0000 7f5acab65640 1 -- 172.21.15.177:0/3524247762 wait complete. 2023-11-28T20:09:23.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5acab65640 1 Processor -- start 2023-11-28T20:09:23.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5acab65640 1 -- start start 2023-11-28T20:09:23.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5acab65640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ac4071d90 0x7f5ac40a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5acab65640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ac413f5f0 0x7f5ac4150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5acab65640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac415adb0 0x7f5ac41f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5acab65640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40a8970 con 0x7f5ac415adb0 2023-11-28T20:09:23.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5acab65640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac4140c30 con 0x7f5ac4071d90 2023-11-28T20:09:23.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5acab65640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac4140f10 con 0x7f5ac413f5f0 2023-11-28T20:09:23.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5ac9102640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac415adb0 0x7f5ac41f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5ac9102640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac415adb0 0x7f5ac41f6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39546/0 (socket says 172.21.15.177:39546) 2023-11-28T20:09:23.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5ac9102640 1 -- 172.21.15.177:0/2215547533 learned_addr learned my addr 172.21.15.177:0/2215547533 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:23.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5ac8901640 1 --2- 172.21.15.177:0/2215547533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ac4071d90 0x7f5ac40a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5ac3fff640 1 --2- 172.21.15.177:0/2215547533 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ac413f5f0 0x7f5ac4150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5ac9102640 1 -- 172.21.15.177:0/2215547533 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ac413f5f0 msgr2=0x7f5ac4150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5ac9102640 1 --2- 172.21.15.177:0/2215547533 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ac413f5f0 0x7f5ac4150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5ac9102640 1 -- 172.21.15.177:0/2215547533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ac4071d90 msgr2=0x7f5ac40a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5ac9102640 1 --2- 172.21.15.177:0/2215547533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ac4071d90 0x7f5ac40a8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5ac9102640 1 -- 172.21.15.177:0/2215547533 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc009b30 con 0x7f5ac415adb0 2023-11-28T20:09:23.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5ac9102640 1 --2- 172.21.15.177:0/2215547533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac415adb0 0x7f5ac41f6900 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0195e0 tx=0x7f5abc019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:23.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5ac17fa640 1 -- 172.21.15.177:0/2215547533 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0b8880 con 0x7f5ac415adb0 2023-11-28T20:09:23.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5ac17fa640 1 -- 172.21.15.177:0/2215547533 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc0b89e0 con 0x7f5ac415adb0 2023-11-28T20:09:23.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5ac17fa640 1 -- 172.21.15.177:0/2215547533 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0b8dd0 con 0x7f5ac415adb0 2023-11-28T20:09:23.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5acab65640 1 -- 172.21.15.177:0/2215547533 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac41411f0 con 0x7f5ac415adb0 2023-11-28T20:09:23.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5acab65640 1 -- 172.21.15.177:0/2215547533 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac41417b0 con 0x7f5ac415adb0 2023-11-28T20:09:23.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.385+0000 7f5acab65640 1 -- 172.21.15.177:0/2215547533 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac41419a0 con 0x7f5ac415adb0 2023-11-28T20:09:23.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.389+0000 7f5ac17fa640 1 -- 172.21.15.177:0/2215547533 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5abc0c3460 con 0x7f5ac415adb0 2023-11-28T20:09:23.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.389+0000 7f5ac17fa640 1 --2- 172.21.15.177:0/2215547533 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5aa8066470 0x7f5aa8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.389+0000 7f5ac17fa640 1 -- 172.21.15.177:0/2215547533 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f5abc11f910 con 0x7f5ac415adb0 2023-11-28T20:09:23.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.389+0000 7f5ac8901640 1 --2- 172.21.15.177:0/2215547533 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5aa8066470 0x7f5aa8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.389+0000 7f5ac8901640 1 --2- 172.21.15.177:0/2215547533 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5aa8066470 0x7f5aa8068930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009ac0 tx=0x7f5ab8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:23.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.393+0000 7f5ac17fa640 1 -- 172.21.15.177:0/2215547533 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5abc0ecd40 con 0x7f5ac415adb0 2023-11-28T20:09:23.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.545+0000 7f5acab65640 1 -- 172.21.15.177:0/2215547533 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ac40693d0 con 0x7f5ac415adb0 2023-11-28T20:09:23.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.545+0000 7f5ac17fa640 1 -- 172.21.15.177:0/2215547533 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5abc0f0360 con 0x7f5ac415adb0 2023-11-28T20:09:23.548 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:09:23.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.545+0000 7f5acab65640 1 -- 172.21.15.177:0/2215547533 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5aa8066470 msgr2=0x7f5aa8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.545+0000 7f5acab65640 1 --2- 172.21.15.177:0/2215547533 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5aa8066470 0x7f5aa8068930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009ac0 tx=0x7f5ab8009190 comp rx=0 tx=0).stop 2023-11-28T20:09:23.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.545+0000 7f5acab65640 1 -- 172.21.15.177:0/2215547533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac415adb0 msgr2=0x7f5ac41f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.545+0000 7f5acab65640 1 --2- 172.21.15.177:0/2215547533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac415adb0 0x7f5ac41f6900 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0195e0 tx=0x7f5abc019770 comp rx=0 tx=0).stop 2023-11-28T20:09:23.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.545+0000 7f5acab65640 1 -- 172.21.15.177:0/2215547533 shutdown_connections 2023-11-28T20:09:23.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.545+0000 7f5acab65640 1 --2- 172.21.15.177:0/2215547533 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5aa8066470 0x7f5aa8068930 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.545+0000 7f5acab65640 1 --2- 172.21.15.177:0/2215547533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac415adb0 0x7f5ac41f6900 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.545+0000 7f5acab65640 1 --2- 172.21.15.177:0/2215547533 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ac413f5f0 0x7f5ac4150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.545+0000 7f5acab65640 1 --2- 172.21.15.177:0/2215547533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ac4071d90 0x7f5ac40a8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.545+0000 7f5acab65640 1 -- 172.21.15.177:0/2215547533 >> 172.21.15.177:0/2215547533 conn(0x7f5ac40b0cc0 msgr2=0x7f5ac415cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:23.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.545+0000 7f5acab65640 1 -- 172.21.15.177:0/2215547533 shutdown_connections 2023-11-28T20:09:23.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.545+0000 7f5acab65640 1 -- 172.21.15.177:0/2215547533 wait complete. 2023-11-28T20:09:23.570 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-11-28T20:09:23.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd6515aa640 1 Processor -- start 2023-11-28T20:09:23.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd6515aa640 1 -- start start 2023-11-28T20:09:23.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd6515aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd64c15d2a0 0x7fd64c0b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd6515aa640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd64c0b61c0 0x7fd64c0d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd6515aa640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd64c0b5240 0x7fd64c0b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd6515aa640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64c0b5c10 con 0x7fd64c0b61c0 2023-11-28T20:09:23.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd6515aa640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64c0b75f0 con 0x7fd64c0b5240 2023-11-28T20:09:23.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd6515aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c0b91a0 con 0x7fd64c15d2a0 2023-11-28T20:09:23.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd64a7fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd64c0b61c0 0x7fd64c0d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd64a7fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd64c0b61c0 0x7fd64c0d1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39562/0 (socket says 172.21.15.177:39562) 2023-11-28T20:09:23.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd64a7fc640 1 -- 172.21.15.177:0/2114912903 learned_addr learned my addr 172.21.15.177:0/2114912903 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:23.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd64b7fe640 1 --2- 172.21.15.177:0/2114912903 >> v2:172.21.15.195:3300/0 conn(0x7fd64c0b5240 0x7fd64c0b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd64affd640 1 --2- 172.21.15.177:0/2114912903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd64c15d2a0 0x7fd64c0b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd64a7fc640 1 -- 172.21.15.177:0/2114912903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd64c15d2a0 msgr2=0x7fd64c0b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:23.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd64a7fc640 1 --2- 172.21.15.177:0/2114912903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd64c15d2a0 0x7fd64c0b8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd64a7fc640 1 -- 172.21.15.177:0/2114912903 >> v2:172.21.15.195:3300/0 conn(0x7fd64c0b5240 msgr2=0x7fd64c0b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:23.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd64a7fc640 1 --2- 172.21.15.177:0/2114912903 >> v2:172.21.15.195:3300/0 conn(0x7fd64c0b5240 0x7fd64c0b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.709+0000 7fd64a7fc640 1 -- 172.21.15.177:0/2114912903 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c0b69e0 con 0x7fd64c0b61c0 2023-11-28T20:09:23.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.713+0000 7fd64a7fc640 1 --2- 172.21.15.177:0/2114912903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd64c0b61c0 0x7fd64c0d1500 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd64c0c6b20 tx=0x7fd64001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85159c5f87466629 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.713+0000 7fd649ffb640 1 -- 172.21.15.177:0/2114912903 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6400a89b0 con 0x7fd64c0b61c0 2023-11-28T20:09:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.713+0000 7fd649ffb640 1 -- 172.21.15.177:0/2114912903 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6400a8b10 con 0x7fd64c0b61c0 2023-11-28T20:09:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.713+0000 7fd649ffb640 1 -- 172.21.15.177:0/2114912903 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6400a8ea0 con 0x7fd64c0b61c0 2023-11-28T20:09:23.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.713+0000 7fd6515aa640 1 -- 172.21.15.177:0/2114912903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd64c0b61c0 msgr2=0x7fd64c0d1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.713+0000 7fd6515aa640 1 --2- 172.21.15.177:0/2114912903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd64c0b61c0 0x7fd64c0d1500 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd64c0c6b20 tx=0x7fd64001ecf0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.713+0000 7fd6515aa640 1 -- 172.21.15.177:0/2114912903 shutdown_connections 2023-11-28T20:09:23.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.713+0000 7fd6515aa640 1 --2- 172.21.15.177:0/2114912903 >> v2:172.21.15.195:3300/0 conn(0x7fd64c0b5240 0x7fd64c0b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.713+0000 7fd6515aa640 1 --2- 172.21.15.177:0/2114912903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd64c0b61c0 0x7fd64c0d1500 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.713+0000 7fd6515aa640 1 --2- 172.21.15.177:0/2114912903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd64c15d2a0 0x7fd64c0b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.713+0000 7fd6515aa640 1 -- 172.21.15.177:0/2114912903 >> 172.21.15.177:0/2114912903 conn(0x7fd64c072060 msgr2=0x7fd64c072470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:23.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.713+0000 7fd6515aa640 1 -- 172.21.15.177:0/2114912903 shutdown_connections 2023-11-28T20:09:23.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.713+0000 7fd6515aa640 1 -- 172.21.15.177:0/2114912903 wait complete. 2023-11-28T20:09:23.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd6515aa640 1 Processor -- start 2023-11-28T20:09:23.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd6515aa640 1 -- start start 2023-11-28T20:09:23.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd6515aa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd64c0b5240 0x7fd64c1556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd6515aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd64c0b61c0 0x7fd64c15d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd6515aa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd64c15d2a0 0x7fd64c15dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd6515aa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c15ff00 con 0x7fd64c15d2a0 2023-11-28T20:09:23.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd6515aa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c0caeb0 con 0x7fd64c0b5240 2023-11-28T20:09:23.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd6515aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c0cb190 con 0x7fd64c0b61c0 2023-11-28T20:09:23.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd64b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd64c15d2a0 0x7fd64c15dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd64b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd64c15d2a0 0x7fd64c15dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39570/0 (socket says 172.21.15.177:39570) 2023-11-28T20:09:23.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd64b7fe640 1 -- 172.21.15.177:0/4240286807 learned_addr learned my addr 172.21.15.177:0/4240286807 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:23.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd64affd640 1 --2- 172.21.15.177:0/4240286807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd64c0b5240 0x7fd64c1556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd64a7fc640 1 --2- 172.21.15.177:0/4240286807 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd64c0b61c0 0x7fd64c15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd64b7fe640 1 -- 172.21.15.177:0/4240286807 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd64c0b61c0 msgr2=0x7fd64c15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd64b7fe640 1 --2- 172.21.15.177:0/4240286807 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd64c0b61c0 0x7fd64c15d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd64b7fe640 1 -- 172.21.15.177:0/4240286807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd64c0b5240 msgr2=0x7fd64c1556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd64b7fe640 1 --2- 172.21.15.177:0/4240286807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd64c0b5240 0x7fd64c1556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd64b7fe640 1 -- 172.21.15.177:0/4240286807 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6400094d0 con 0x7fd64c15d2a0 2023-11-28T20:09:23.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd64b7fe640 1 --2- 172.21.15.177:0/4240286807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd64c15d2a0 0x7fd64c15dc50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd644007d20 tx=0x7fd64400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:23.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd6337fe640 1 -- 172.21.15.177:0/4240286807 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644014420 con 0x7fd64c15d2a0 2023-11-28T20:09:23.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd6337fe640 1 -- 172.21.15.177:0/4240286807 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6440145a0 con 0x7fd64c15d2a0 2023-11-28T20:09:23.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd6337fe640 1 -- 172.21.15.177:0/4240286807 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644014950 con 0x7fd64c15d2a0 2023-11-28T20:09:23.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd6515aa640 1 -- 172.21.15.177:0/4240286807 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64c0cb470 con 0x7fd64c15d2a0 2023-11-28T20:09:23.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.717+0000 7fd6515aa640 1 -- 172.21.15.177:0/4240286807 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64c0cba30 con 0x7fd64c15d2a0 2023-11-28T20:09:23.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.721+0000 7fd6515aa640 1 -- 172.21.15.177:0/4240286807 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64c0cbc20 con 0x7fd64c15d2a0 2023-11-28T20:09:23.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.721+0000 7fd6337fe640 1 -- 172.21.15.177:0/4240286807 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd644014ab0 con 0x7fd64c15d2a0 2023-11-28T20:09:23.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.721+0000 7fd6337fe640 1 --2- 172.21.15.177:0/4240286807 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd638066470 0x7fd638068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:23.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.721+0000 7fd6337fe640 1 -- 172.21.15.177:0/4240286807 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fd644084820 con 0x7fd64c15d2a0 2023-11-28T20:09:23.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.721+0000 7fd64affd640 1 --2- 172.21.15.177:0/4240286807 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd638066470 0x7fd638068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:23.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.721+0000 7fd64affd640 1 --2- 172.21.15.177:0/4240286807 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd638066470 0x7fd638068930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd63c007a60 tx=0x7fd63c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:23.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.725+0000 7fd6337fe640 1 -- 172.21.15.177:0/4240286807 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd644051b20 con 0x7fd64c15d2a0 2023-11-28T20:09:23.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.877+0000 7fd6515aa640 1 -- 172.21.15.177:0/4240286807 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fd64c0693d0 con 0x7fd64c15d2a0 2023-11-28T20:09:23.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.877+0000 7fd6337fe640 1 -- 172.21.15.177:0/4240286807 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v36) v1 ==== 97+0+11 (secure 0 0 0) 0x7fd644055140 con 0x7fd64c15d2a0 2023-11-28T20:09:23.881 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:09:23.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.881+0000 7fd6515aa640 1 -- 172.21.15.177:0/4240286807 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd638066470 msgr2=0x7fd638068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.881+0000 7fd6515aa640 1 --2- 172.21.15.177:0/4240286807 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd638066470 0x7fd638068930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd63c007a60 tx=0x7fd63c008040 comp rx=0 tx=0).stop 2023-11-28T20:09:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.881+0000 7fd6515aa640 1 -- 172.21.15.177:0/4240286807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd64c15d2a0 msgr2=0x7fd64c15dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.881+0000 7fd6515aa640 1 --2- 172.21.15.177:0/4240286807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd64c15d2a0 0x7fd64c15dc50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd644007d20 tx=0x7fd64400e4b0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.881+0000 7fd6515aa640 1 -- 172.21.15.177:0/4240286807 shutdown_connections 2023-11-28T20:09:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.881+0000 7fd6515aa640 1 --2- 172.21.15.177:0/4240286807 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd638066470 0x7fd638068930 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.881+0000 7fd6515aa640 1 --2- 172.21.15.177:0/4240286807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd64c15d2a0 0x7fd64c15dc50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.881+0000 7fd6515aa640 1 --2- 172.21.15.177:0/4240286807 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd64c0b61c0 0x7fd64c15d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.881+0000 7fd6515aa640 1 --2- 172.21.15.177:0/4240286807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd64c0b5240 0x7fd64c1556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.881+0000 7fd6515aa640 1 -- 172.21.15.177:0/4240286807 >> 172.21.15.177:0/4240286807 conn(0x7fd64c072060 msgr2=0x7fd64c15af00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.881+0000 7fd6515aa640 1 -- 172.21.15.177:0/4240286807 shutdown_connections 2023-11-28T20:09:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:23.881+0000 7fd6515aa640 1 -- 172.21.15.177:0/4240286807 wait complete. 2023-11-28T20:09:23.902 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:09:24.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.037+0000 7f40a845a640 1 Processor -- start 2023-11-28T20:09:24.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.037+0000 7f40a845a640 1 -- start start 2023-11-28T20:09:24.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.037+0000 7f40a845a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40a0144840 0x7f40a006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:24.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.037+0000 7f40a845a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f40a0072180 0x7f40a006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:24.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.037+0000 7f40a845a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a00710e0 con 0x7f40a0070460 2023-11-28T20:09:24.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.037+0000 7f40a845a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a015f010 con 0x7f40a0072180 2023-11-28T20:09:24.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.037+0000 7f40a845a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a00713c0 con 0x7f40a0144840 2023-11-28T20:09:24.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.037+0000 7f40a59f5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f40a0072180 0x7f40a006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:24.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.041+0000 7f40a59f5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f40a0072180 0x7f40a006c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39580/0 (socket says 172.21.15.177:39580) 2023-11-28T20:09:24.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.041+0000 7f40a59f5640 1 -- 172.21.15.177:0/3225388711 learned_addr learned my addr 172.21.15.177:0/3225388711 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:24.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.041+0000 7f40a61f6640 1 --2- 172.21.15.177:0/3225388711 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40a0144840 0x7f40a006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:24.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.041+0000 7f40a59f5640 1 -- 172.21.15.177:0/3225388711 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40a0144840 msgr2=0x7f40a006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:24.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.041+0000 7f40a59f5640 1 --2- 172.21.15.177:0/3225388711 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40a0144840 0x7f40a006c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.041+0000 7f40a59f5640 1 -- 172.21.15.177:0/3225388711 >> v1:172.21.15.195:6789/0 conn(0x7f40a0070460 legacy=0x7f40a00708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:24.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.041+0000 7f40a59f5640 1 -- 172.21.15.177:0/3225388711 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a00716a0 con 0x7f40a0072180 2023-11-28T20:09:24.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.041+0000 7f40a59f5640 1 --2- 172.21.15.177:0/3225388711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a0072180 0x7f40a006c800 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4090009870 tx=0x7f409001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9964f823022c0c01 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:24.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.041+0000 7f40a51f4640 1 -- 172.21.15.177:0/3225388711 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40900aa670 con 0x7f40a0072180 2023-11-28T20:09:24.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.041+0000 7f40a51f4640 1 -- 172.21.15.177:0/3225388711 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40900aa7d0 con 0x7f40a0072180 2023-11-28T20:09:24.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.041+0000 7f40a51f4640 1 -- 172.21.15.177:0/3225388711 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40900aab60 con 0x7f40a0072180 2023-11-28T20:09:24.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 -- 172.21.15.177:0/3225388711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a0072180 msgr2=0x7f40a006c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:24.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 --2- 172.21.15.177:0/3225388711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a0072180 0x7f40a006c800 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4090009870 tx=0x7f409001c510 comp rx=0 tx=0).stop 2023-11-28T20:09:24.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 -- 172.21.15.177:0/3225388711 shutdown_connections 2023-11-28T20:09:24.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 --2- 172.21.15.177:0/3225388711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a0072180 0x7f40a006c800 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 --2- 172.21.15.177:0/3225388711 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40a0144840 0x7f40a006c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 -- 172.21.15.177:0/3225388711 >> 172.21.15.177:0/3225388711 conn(0x7f40a006a530 msgr2=0x7f40a006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:24.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 -- 172.21.15.177:0/3225388711 shutdown_connections 2023-11-28T20:09:24.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 -- 172.21.15.177:0/3225388711 wait complete. 2023-11-28T20:09:24.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 Processor -- start 2023-11-28T20:09:24.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 -- start start 2023-11-28T20:09:24.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a0070460 0x7f40a013eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:24.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40a0072180 0x7f40a0164550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:24.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40a0144840 0x7f40a0159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:24.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a0147430 con 0x7f40a0070460 2023-11-28T20:09:24.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a01499c0 con 0x7f40a0072180 2023-11-28T20:09:24.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a845a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a0149ca0 con 0x7f40a0144840 2023-11-28T20:09:24.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a61f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a0070460 0x7f40a013eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:24.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a61f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a0070460 0x7f40a013eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39584/0 (socket says 172.21.15.177:39584) 2023-11-28T20:09:24.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a61f6640 1 -- 172.21.15.177:0/1959711864 learned_addr learned my addr 172.21.15.177:0/1959711864 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:24.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a59f5640 1 --2- 172.21.15.177:0/1959711864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40a0072180 0x7f40a0164550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:24.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a69f7640 1 --2- 172.21.15.177:0/1959711864 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40a0144840 0x7f40a0159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:24.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a61f6640 1 -- 172.21.15.177:0/1959711864 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40a0144840 msgr2=0x7f40a0159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:24.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a61f6640 1 --2- 172.21.15.177:0/1959711864 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40a0144840 0x7f40a0159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a61f6640 1 -- 172.21.15.177:0/1959711864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40a0072180 msgr2=0x7f40a0164550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:24.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a61f6640 1 --2- 172.21.15.177:0/1959711864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40a0072180 0x7f40a0164550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.045+0000 7f40a61f6640 1 -- 172.21.15.177:0/1959711864 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40900094d0 con 0x7f40a0070460 2023-11-28T20:09:24.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.049+0000 7f40a61f6640 1 --2- 172.21.15.177:0/1959711864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a0070460 0x7f40a013eb20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f409c00e870 tx=0x7f409c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:24.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.049+0000 7f4096ffd640 1 -- 172.21.15.177:0/1959711864 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c009510 con 0x7f40a0070460 2023-11-28T20:09:24.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.049+0000 7f4096ffd640 1 -- 172.21.15.177:0/1959711864 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c00eec0 con 0x7f40a0070460 2023-11-28T20:09:24.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.049+0000 7f40a845a640 1 -- 172.21.15.177:0/1959711864 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a0149f80 con 0x7f40a0070460 2023-11-28T20:09:24.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.049+0000 7f4096ffd640 1 -- 172.21.15.177:0/1959711864 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c00cb40 con 0x7f40a0070460 2023-11-28T20:09:24.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.049+0000 7f40a845a640 1 -- 172.21.15.177:0/1959711864 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a013f060 con 0x7f40a0070460 2023-11-28T20:09:24.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.049+0000 7f40a845a640 1 -- 172.21.15.177:0/1959711864 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a006d170 con 0x7f40a0070460 2023-11-28T20:09:24.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.049+0000 7f4096ffd640 1 -- 172.21.15.177:0/1959711864 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f409c00cca0 con 0x7f40a0070460 2023-11-28T20:09:24.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.049+0000 7f4096ffd640 1 --2- 172.21.15.177:0/1959711864 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4084066470 0x7f4084068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:24.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.049+0000 7f4096ffd640 1 -- 172.21.15.177:0/1959711864 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f409c084000 con 0x7f40a0070460 2023-11-28T20:09:24.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.049+0000 7f40a59f5640 1 --2- 172.21.15.177:0/1959711864 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4084066470 0x7f4084068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:24.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.053+0000 7f40a59f5640 1 --2- 172.21.15.177:0/1959711864 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4084066470 0x7f4084068930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f40900ae000 tx=0x7f40900b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:24.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.053+0000 7f4096ffd640 1 -- 172.21.15.177:0/1959711864 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f409c051430 con 0x7f40a0070460 2023-11-28T20:09:24.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.213+0000 7f40a845a640 1 -- 172.21.15.177:0/1959711864 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f40a0069420 con 0x7f40a0070460 2023-11-28T20:09:24.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.217+0000 7f4096ffd640 1 -- 172.21.15.177:0/1959711864 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f409c054a50 con 0x7f40a0070460 2023-11-28T20:09:24.219 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:09:24.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.217+0000 7f40a845a640 1 -- 172.21.15.177:0/1959711864 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4084066470 msgr2=0x7f4084068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:24.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.217+0000 7f40a845a640 1 --2- 172.21.15.177:0/1959711864 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4084066470 0x7f4084068930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f40900ae000 tx=0x7f40900b5040 comp rx=0 tx=0).stop 2023-11-28T20:09:24.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.217+0000 7f40a845a640 1 -- 172.21.15.177:0/1959711864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a0070460 msgr2=0x7f40a013eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:24.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.217+0000 7f40a845a640 1 --2- 172.21.15.177:0/1959711864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a0070460 0x7f40a013eb20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f409c00e870 tx=0x7f409c00ec70 comp rx=0 tx=0).stop 2023-11-28T20:09:24.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.217+0000 7f40a845a640 1 -- 172.21.15.177:0/1959711864 shutdown_connections 2023-11-28T20:09:24.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.217+0000 7f40a845a640 1 --2- 172.21.15.177:0/1959711864 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4084066470 0x7f4084068930 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.217+0000 7f40a845a640 1 --2- 172.21.15.177:0/1959711864 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40a0144840 0x7f40a0159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.217+0000 7f40a845a640 1 --2- 172.21.15.177:0/1959711864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40a0072180 0x7f40a0164550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.217+0000 7f40a845a640 1 --2- 172.21.15.177:0/1959711864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a0070460 0x7f40a013eb20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.217+0000 7f40a845a640 1 -- 172.21.15.177:0/1959711864 >> 172.21.15.177:0/1959711864 conn(0x7f40a006a530 msgr2=0x7f40a0165140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:24.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.217+0000 7f40a845a640 1 -- 172.21.15.177:0/1959711864 shutdown_connections 2023-11-28T20:09:24.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.217+0000 7f40a845a640 1 -- 172.21.15.177:0/1959711864 wait complete. 2023-11-28T20:09:24.239 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-11-28T20:09:24.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:24.240 DEBUG:teuthology.orchestra.run.smithi177:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:24.258 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[50055]: fuse finished with error 0 and tester_r 0 2023-11-28T20:09:24.261 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:09:24.360 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:09:24.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:24.360 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T20:09:24.370 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2023-11-28T20:09:24.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.553+0000 7fcdb1f72640 1 Processor -- start 2023-11-28T20:09:24.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.553+0000 7fcdb1f72640 1 -- start start 2023-11-28T20:09:24.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.557+0000 7fcdb1f72640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcdac143d10 0x7fcdac15f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:24.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.557+0000 7fcdb1f72640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcdac0b42d0 0x7fcdac0b4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:24.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.557+0000 7fcdb1f72640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdac1446f0 con 0x7fcdac070480 2023-11-28T20:09:24.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.557+0000 7fcdb1f72640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac071590 con 0x7fcdac143d10 2023-11-28T20:09:24.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.557+0000 7fcdb1f72640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac0b4cc0 con 0x7fcdac0b42d0 2023-11-28T20:09:24.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.557+0000 7fcdab7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcdac143d10 0x7fcdac15f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:24.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.557+0000 7fcdab7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcdac143d10 0x7fcdac15f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39588/0 (socket says 172.21.15.177:39588) 2023-11-28T20:09:24.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.557+0000 7fcdab7fe640 1 -- 172.21.15.177:0/332658752 learned_addr learned my addr 172.21.15.177:0/332658752 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:24.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.557+0000 7fcdabfff640 1 --2- 172.21.15.177:0/332658752 >> v2:172.21.15.195:3300/0 conn(0x7fcdac0b42d0 0x7fcdac0b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:24.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.557+0000 7fcdab7fe640 1 -- 172.21.15.177:0/332658752 >> v2:172.21.15.195:3300/0 conn(0x7fcdac0b42d0 msgr2=0x7fcdac0b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:24.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.557+0000 7fcdab7fe640 1 --2- 172.21.15.177:0/332658752 >> v2:172.21.15.195:3300/0 conn(0x7fcdac0b42d0 0x7fcdac0b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.557+0000 7fcdab7fe640 1 -- 172.21.15.177:0/332658752 >> v1:172.21.15.195:6789/0 conn(0x7fcdac070480 legacy=0x7fcdac15b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:24.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.557+0000 7fcdab7fe640 1 -- 172.21.15.177:0/332658752 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac070910 con 0x7fcdac143d10 2023-11-28T20:09:24.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.561+0000 7fcdab7fe640 1 --2- 172.21.15.177:0/332658752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdac143d10 0x7fcdac15f600 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcdac144e60 tx=0x7fcd9c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff28c871a09ce58 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:24.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.561+0000 7fcdaa7fc640 1 -- 172.21.15.177:0/332658752 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c0ab600 con 0x7fcdac143d10 2023-11-28T20:09:24.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.561+0000 7fcdaa7fc640 1 -- 172.21.15.177:0/332658752 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c0a7050 con 0x7fcdac143d10 2023-11-28T20:09:24.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.561+0000 7fcdaa7fc640 1 -- 172.21.15.177:0/332658752 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c0ab980 con 0x7fcdac143d10 2023-11-28T20:09:24.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.561+0000 7fcdb1f72640 1 -- 172.21.15.177:0/332658752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdac143d10 msgr2=0x7fcdac15f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:24.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.561+0000 7fcdb1f72640 1 --2- 172.21.15.177:0/332658752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdac143d10 0x7fcdac15f600 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcdac144e60 tx=0x7fcd9c01c430 comp rx=0 tx=0).stop 2023-11-28T20:09:24.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.561+0000 7fcdb1f72640 1 -- 172.21.15.177:0/332658752 shutdown_connections 2023-11-28T20:09:24.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.561+0000 7fcdb1f72640 1 --2- 172.21.15.177:0/332658752 >> v2:172.21.15.195:3300/0 conn(0x7fcdac0b42d0 0x7fcdac0b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.561+0000 7fcdb1f72640 1 --2- 172.21.15.177:0/332658752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdac143d10 0x7fcdac15f600 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.561+0000 7fcdb1f72640 1 -- 172.21.15.177:0/332658752 >> 172.21.15.177:0/332658752 conn(0x7fcdac0b0cc0 msgr2=0x7fcdac0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:24.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.561+0000 7fcdb1f72640 1 -- 172.21.15.177:0/332658752 shutdown_connections 2023-11-28T20:09:24.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.561+0000 7fcdb1f72640 1 -- 172.21.15.177:0/332658752 wait complete. 2023-11-28T20:09:24.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.561+0000 7fcdb1f72640 1 Processor -- start 2023-11-28T20:09:24.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdb1f72640 1 -- start start 2023-11-28T20:09:24.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdb1f72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcdac0b42d0 0x7fcdac1422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdb1f72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdac143d10 0x7fcdac134200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdb1f72640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac13eb20 0x7fcdac15a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdb1f72640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac135660 con 0x7fcdac143d10 2023-11-28T20:09:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdb1f72640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac134740 con 0x7fcdac13eb20 2023-11-28T20:09:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdb1f72640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac1349e0 con 0x7fcdac0b42d0 2023-11-28T20:09:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdaaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdac143d10 0x7fcdac134200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdab7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcdac0b42d0 0x7fcdac1422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdaaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdac143d10 0x7fcdac134200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39598/0 (socket says 172.21.15.177:39598) 2023-11-28T20:09:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdaaffd640 1 -- 172.21.15.177:0/4240736918 learned_addr learned my addr 172.21.15.177:0/4240736918 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdabfff640 1 --2- 172.21.15.177:0/4240736918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac13eb20 0x7fcdac15a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdaaffd640 1 -- 172.21.15.177:0/4240736918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcdac0b42d0 msgr2=0x7fcdac1422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:24.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdaaffd640 1 --2- 172.21.15.177:0/4240736918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcdac0b42d0 0x7fcdac1422e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdaaffd640 1 -- 172.21.15.177:0/4240736918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac13eb20 msgr2=0x7fcdac15a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:24.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdaaffd640 1 --2- 172.21.15.177:0/4240736918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac13eb20 0x7fcdac15a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdaaffd640 1 -- 172.21.15.177:0/4240736918 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c0094d0 con 0x7fcdac143d10 2023-11-28T20:09:24.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdabfff640 1 --2- 172.21.15.177:0/4240736918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac13eb20 0x7fcdac15a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:24.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdaaffd640 1 --2- 172.21.15.177:0/4240736918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdac143d10 0x7fcdac134200 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcda000b410 tx=0x7fcda000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:24.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcd93fff640 1 -- 172.21.15.177:0/4240736918 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0004020 con 0x7fcdac143d10 2023-11-28T20:09:24.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcd93fff640 1 -- 172.21.15.177:0/4240736918 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda0004180 con 0x7fcdac143d10 2023-11-28T20:09:24.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdb1f72640 1 -- 172.21.15.177:0/4240736918 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac134cc0 con 0x7fcdac143d10 2023-11-28T20:09:24.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcd93fff640 1 -- 172.21.15.177:0/4240736918 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0011630 con 0x7fcdac143d10 2023-11-28T20:09:24.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdb1f72640 1 -- 172.21.15.177:0/4240736918 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac135280 con 0x7fcdac143d10 2023-11-28T20:09:24.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.565+0000 7fcdb1f72640 1 -- 172.21.15.177:0/4240736918 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac069440 con 0x7fcdac143d10 2023-11-28T20:09:24.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.569+0000 7fcd93fff640 1 -- 172.21.15.177:0/4240736918 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcda0011790 con 0x7fcdac143d10 2023-11-28T20:09:24.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.569+0000 7fcd93fff640 1 --2- 172.21.15.177:0/4240736918 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcd98066470 0x7fcd98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:24.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.569+0000 7fcd93fff640 1 -- 172.21.15.177:0/4240736918 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fcda0083cc0 con 0x7fcdac143d10 2023-11-28T20:09:24.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.569+0000 7fcdab7fe640 1 --2- 172.21.15.177:0/4240736918 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcd98066470 0x7fcd98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:24.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.569+0000 7fcdab7fe640 1 --2- 172.21.15.177:0/4240736918 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcd98066470 0x7fcd98068930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0ad000 tx=0x7fcd9c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:24.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.573+0000 7fcd93fff640 1 -- 172.21.15.177:0/4240736918 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcda008a080 con 0x7fcdac143d10 2023-11-28T20:09:24.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.773+0000 7fcdb1f72640 1 -- 172.21.15.177:0/4240736918 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fcdac0b1990 con 0x7fcdac143d10 2023-11-28T20:09:24.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.777+0000 7fcd93fff640 1 -- 172.21.15.177:0/4240736918 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v18) v1 ==== 184+0+141 (secure 0 0 0) 0x7fcda00150e0 con 0x7fcdac143d10 2023-11-28T20:09:24.781 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-11-28T20:09:24.781 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZl+2t5KxAAc/J7x+fjSQR4IkIQJ/X8sw== 2023-11-28T20:09:24.781 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-11-28T20:09:24.781 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-11-28T20:09:24.781 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw pool=cephfs_data" 2023-11-28T20:09:24.782 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-11-28T20:09:24.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.781+0000 7fcdb1f72640 1 -- 172.21.15.177:0/4240736918 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcd98066470 msgr2=0x7fcd98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:24.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.781+0000 7fcdb1f72640 1 --2- 172.21.15.177:0/4240736918 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcd98066470 0x7fcd98068930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0ad000 tx=0x7fcd9c0a6000 comp rx=0 tx=0).stop 2023-11-28T20:09:24.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.781+0000 7fcdb1f72640 1 -- 172.21.15.177:0/4240736918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdac143d10 msgr2=0x7fcdac134200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:24.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.781+0000 7fcdb1f72640 1 --2- 172.21.15.177:0/4240736918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdac143d10 0x7fcdac134200 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcda000b410 tx=0x7fcda000b8d0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.781+0000 7fcdb1f72640 1 -- 172.21.15.177:0/4240736918 shutdown_connections 2023-11-28T20:09:24.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.781+0000 7fcdb1f72640 1 --2- 172.21.15.177:0/4240736918 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcd98066470 0x7fcd98068930 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.781+0000 7fcdb1f72640 1 --2- 172.21.15.177:0/4240736918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac13eb20 0x7fcdac15a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.781+0000 7fcdb1f72640 1 --2- 172.21.15.177:0/4240736918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdac143d10 0x7fcdac134200 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.781+0000 7fcdb1f72640 1 --2- 172.21.15.177:0/4240736918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcdac0b42d0 0x7fcdac1422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:24.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.781+0000 7fcdb1f72640 1 -- 172.21.15.177:0/4240736918 >> 172.21.15.177:0/4240736918 conn(0x7fcdac0b0cc0 msgr2=0x7fcdac06c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:24.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.781+0000 7fcdb1f72640 1 -- 172.21.15.177:0/4240736918 shutdown_connections 2023-11-28T20:09:24.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:24.781+0000 7fcdb1f72640 1 -- 172.21.15.177:0/4240736918 wait complete. 2023-11-28T20:09:24.803 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T20:09:24.803 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:09:24.917 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:09:25.012 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T20:09:25.013 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:09:25.013 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:09:25.022 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354508k,nr_inodes=4088627,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=883 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T20:09:25.022 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:09:25.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:25.022 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T20:09:25.074 INFO:teuthology.orchestra.run.smithi177.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-28T20:09:25.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:09:25.075 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:09:25.075 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:09:25.086 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2702 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T20:09:25.086 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:09:25.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:25.087 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T20:09:25.142 INFO:teuthology.orchestra.run.smithi195.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T20:09:25.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:09:25.143 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:09:25.143 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:09:25.152 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354508k,nr_inodes=4088627,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=883 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T20:09:25.153 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:09:25.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:25.153 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T20:09:25.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:09:25.204 INFO:teuthology.orchestra.run.smithi177.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T20:09:25.205 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:09:25.205 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:09:25.214 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2702 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T20:09:25.214 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:09:25.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:25.215 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T20:09:25.266 INFO:teuthology.orchestra.run.smithi195.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T20:09:25.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:09:25.267 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:09:25.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.401+0000 7f59f6ec9640 1 Processor -- start 2023-11-28T20:09:25.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.401+0000 7f59f6ec9640 1 -- start start 2023-11-28T20:09:25.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.401+0000 7f59f6ec9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f59f0144840 0x7f59f006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:25.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.401+0000 7f59f6ec9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f59f0072180 0x7f59f006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:25.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.401+0000 7f59f6ec9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f00710e0 con 0x7f59f0070460 2023-11-28T20:09:25.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.401+0000 7f59f6ec9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f015f010 con 0x7f59f0144840 2023-11-28T20:09:25.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.401+0000 7f59f6ec9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f00713c0 con 0x7f59f0072180 2023-11-28T20:09:25.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.405+0000 7f59f4c65640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f59f0144840 0x7f59f006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:25.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.405+0000 7f59f4c65640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f59f0144840 0x7f59f006c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39604/0 (socket says 172.21.15.177:39604) 2023-11-28T20:09:25.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.405+0000 7f59f4c65640 1 -- 172.21.15.177:0/512569079 learned_addr learned my addr 172.21.15.177:0/512569079 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:25.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.405+0000 7f59effff640 1 --2- 172.21.15.177:0/512569079 >> v2:172.21.15.195:3300/0 conn(0x7f59f0072180 0x7f59f006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:25.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.405+0000 7f59f4c65640 1 -- 172.21.15.177:0/512569079 >> v2:172.21.15.195:3300/0 conn(0x7f59f0072180 msgr2=0x7f59f006c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:25.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.405+0000 7f59f4c65640 1 --2- 172.21.15.177:0/512569079 >> v2:172.21.15.195:3300/0 conn(0x7f59f0072180 0x7f59f006c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.405+0000 7f59f4c65640 1 -- 172.21.15.177:0/512569079 >> v1:172.21.15.195:6789/0 conn(0x7f59f0070460 legacy=0x7f59f0070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:25.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.405+0000 7f59f4c65640 1 -- 172.21.15.177:0/512569079 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f00716a0 con 0x7f59f0144840 2023-11-28T20:09:25.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.405+0000 7f59f4c65640 1 --2- 172.21.15.177:0/512569079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59f0144840 0x7f59f006c2c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f59f006d140 tx=0x7f59e401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4056a5eaf1c7bb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:25.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.405+0000 7f59ef7fe640 1 -- 172.21.15.177:0/512569079 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e40aa430 con 0x7f59f0144840 2023-11-28T20:09:25.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.405+0000 7f59ef7fe640 1 -- 172.21.15.177:0/512569079 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e40aa590 con 0x7f59f0144840 2023-11-28T20:09:25.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.405+0000 7f59ef7fe640 1 -- 172.21.15.177:0/512569079 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e40aa920 con 0x7f59f0144840 2023-11-28T20:09:25.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 -- 172.21.15.177:0/512569079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59f0144840 msgr2=0x7f59f006c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:25.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 --2- 172.21.15.177:0/512569079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59f0144840 0x7f59f006c2c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f59f006d140 tx=0x7f59e401c4d0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 -- 172.21.15.177:0/512569079 shutdown_connections 2023-11-28T20:09:25.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 --2- 172.21.15.177:0/512569079 >> v2:172.21.15.195:3300/0 conn(0x7f59f0072180 0x7f59f006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 --2- 172.21.15.177:0/512569079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59f0144840 0x7f59f006c2c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 -- 172.21.15.177:0/512569079 >> 172.21.15.177:0/512569079 conn(0x7f59f006a530 msgr2=0x7f59f006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:25.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 -- 172.21.15.177:0/512569079 shutdown_connections 2023-11-28T20:09:25.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 -- 172.21.15.177:0/512569079 wait complete. 2023-11-28T20:09:25.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 Processor -- start 2023-11-28T20:09:25.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 -- start start 2023-11-28T20:09:25.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59f0070460 0x7f59f0164de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:25.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59f0072180 0x7f59f0158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:25.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59f0144840 0x7f59f0141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:25.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f0138c80 con 0x7f59f0144840 2023-11-28T20:09:25.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f0138630 con 0x7f59f0072180 2023-11-28T20:09:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f6ec9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f0141590 con 0x7f59f0070460 2023-11-28T20:09:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f5466640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59f0144840 0x7f59f0141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f5466640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59f0144840 0x7f59f0141d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39606/0 (socket says 172.21.15.177:39606) 2023-11-28T20:09:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f5466640 1 -- 172.21.15.177:0/3331551393 learned_addr learned my addr 172.21.15.177:0/3331551393 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f4c65640 1 --2- 172.21.15.177:0/3331551393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59f0070460 0x7f59f0164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59effff640 1 --2- 172.21.15.177:0/3331551393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59f0072180 0x7f59f0158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.409+0000 7f59f5466640 1 -- 172.21.15.177:0/3331551393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59f0070460 msgr2=0x7f59f0164de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.413+0000 7f59f5466640 1 --2- 172.21.15.177:0/3331551393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59f0070460 0x7f59f0164de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.413+0000 7f59f5466640 1 -- 172.21.15.177:0/3331551393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59f0072180 msgr2=0x7f59f0158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.413+0000 7f59f5466640 1 --2- 172.21.15.177:0/3331551393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59f0072180 0x7f59f0158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.413+0000 7f59f5466640 1 -- 172.21.15.177:0/3331551393 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e40094d0 con 0x7f59f0144840 2023-11-28T20:09:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.413+0000 7f59f5466640 1 --2- 172.21.15.177:0/3331551393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59f0144840 0x7f59f0141d70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f59e800c770 tx=0x7f59e800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.413+0000 7f59ed7fa640 1 -- 172.21.15.177:0/3331551393 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8003b80 con 0x7f59f0144840 2023-11-28T20:09:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.413+0000 7f59ed7fa640 1 -- 172.21.15.177:0/3331551393 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e8003ce0 con 0x7f59f0144840 2023-11-28T20:09:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.413+0000 7f59ed7fa640 1 -- 172.21.15.177:0/3331551393 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e800aa90 con 0x7f59f0144840 2023-11-28T20:09:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.413+0000 7f59f6ec9640 1 -- 172.21.15.177:0/3331551393 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f015e050 con 0x7f59f0144840 2023-11-28T20:09:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.413+0000 7f59f6ec9640 1 -- 172.21.15.177:0/3331551393 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f0165320 con 0x7f59f0144840 2023-11-28T20:09:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.413+0000 7f59f6ec9640 1 -- 172.21.15.177:0/3331551393 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f0069440 con 0x7f59f0144840 2023-11-28T20:09:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.413+0000 7f59ed7fa640 1 -- 172.21.15.177:0/3331551393 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f59e800abf0 con 0x7f59f0144840 2023-11-28T20:09:25.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.413+0000 7f59ed7fa640 1 --2- 172.21.15.177:0/3331551393 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f59d40664a0 0x7f59d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:25.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.413+0000 7f59ed7fa640 1 -- 172.21.15.177:0/3331551393 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f59e8083cd0 con 0x7f59f0144840 2023-11-28T20:09:25.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.413+0000 7f59f4c65640 1 --2- 172.21.15.177:0/3331551393 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f59d40664a0 0x7f59d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:25.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.417+0000 7f59f4c65640 1 --2- 172.21.15.177:0/3331551393 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f59d40664a0 0x7f59d4068960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f59e40ae000 tx=0x7f59e40b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:25.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.417+0000 7f59ed7fa640 1 -- 172.21.15.177:0/3331551393 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f59e8051060 con 0x7f59f0144840 2023-11-28T20:09:25.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.601+0000 7f59f6ec9640 1 -- 172.21.15.177:0/3331551393 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59f006d170 con 0x7f59f0144840 2023-11-28T20:09:25.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.605+0000 7f59ed7fa640 1 -- 172.21.15.177:0/3331551393 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4924 (secure 0 0 0) 0x7f59e8054680 con 0x7f59f0144840 2023-11-28T20:09:25.607 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:25.607 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2829857708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2829857708},{"type":"v1","addr":"172.21.15.177:6836","nonce":2829857708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5101,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/916709103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":916709103},{"type":"v1","addr":"172.21.15.195:6834","nonce":916709103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1987123637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1987123637},{"type":"v1","addr":"172.21.15.195:6835","nonce":1987123637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:08:39.405256+0000","modified":"2023-11-28T20:08:53.633079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/3143070912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":3143070912},{"type":"v1","addr":"172.21.15.177:6837","nonce":3143070912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T20:09:25.607 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 18 2023-11-28T20:09:25.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.605+0000 7f59f6ec9640 1 -- 172.21.15.177:0/3331551393 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f59d40664a0 msgr2=0x7f59d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:25.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.605+0000 7f59f6ec9640 1 --2- 172.21.15.177:0/3331551393 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f59d40664a0 0x7f59d4068960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f59e40ae000 tx=0x7f59e40b5040 comp rx=0 tx=0).stop 2023-11-28T20:09:25.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.605+0000 7f59f6ec9640 1 -- 172.21.15.177:0/3331551393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59f0144840 msgr2=0x7f59f0141d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:25.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.605+0000 7f59f6ec9640 1 --2- 172.21.15.177:0/3331551393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59f0144840 0x7f59f0141d70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f59e800c770 tx=0x7f59e800cc30 comp rx=0 tx=0).stop 2023-11-28T20:09:25.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.605+0000 7f59f6ec9640 1 -- 172.21.15.177:0/3331551393 shutdown_connections 2023-11-28T20:09:25.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.605+0000 7f59f6ec9640 1 --2- 172.21.15.177:0/3331551393 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f59d40664a0 0x7f59d4068960 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.605+0000 7f59f6ec9640 1 --2- 172.21.15.177:0/3331551393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59f0144840 0x7f59f0141d70 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.605+0000 7f59f6ec9640 1 --2- 172.21.15.177:0/3331551393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59f0072180 0x7f59f0158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.605+0000 7f59f6ec9640 1 --2- 172.21.15.177:0/3331551393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59f0070460 0x7f59f0164de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.605+0000 7f59f6ec9640 1 -- 172.21.15.177:0/3331551393 >> 172.21.15.177:0/3331551393 conn(0x7f59f006a530 msgr2=0x7f59f006c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:25.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.605+0000 7f59f6ec9640 1 -- 172.21.15.177:0/3331551393 shutdown_connections 2023-11-28T20:09:25.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.605+0000 7f59f6ec9640 1 -- 172.21.15.177:0/3331551393 wait complete. 2023-11-28T20:09:25.628 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:09:25.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba28846640 1 Processor -- start 2023-11-28T20:09:25.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba28846640 1 -- start start 2023-11-28T20:09:25.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba28846640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fba24143b80 0x7fba241442a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:25.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba28846640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba240712c0 con 0x7fba241447e0 2023-11-28T20:09:25.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba28846640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba240706b0 con 0x7fba2406dc40 2023-11-28T20:09:25.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba28846640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba24070990 con 0x7fba24143b80 2023-11-28T20:09:25.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba1bfff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fba241447e0 0x7fba2406d530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44644/0 (socket says 172.21.15.177:44644) 2023-11-28T20:09:25.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba1bfff640 1 -- 172.21.15.177:0/2768959340 learned_addr learned my addr 172.21.15.177:0/2768959340 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:25.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba2259c640 1 --2- 172.21.15.177:0/2768959340 >> v2:172.21.15.195:3300/0 conn(0x7fba24143b80 0x7fba241442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:25.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322492873 0 0) 0x7fba240712c0 con 0x7fba241447e0 2023-11-28T20:09:25.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba10003530 con 0x7fba241447e0 2023-11-28T20:09:25.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522185298 0 0) 0x7fba240706b0 con 0x7fba2406dc40 2023-11-28T20:09:25.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba240712c0 con 0x7fba2406dc40 2023-11-28T20:09:25.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1725095071 0 0) 0x7fba10003530 con 0x7fba241447e0 2023-11-28T20:09:25.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 >> v2:172.21.15.195:3300/0 conn(0x7fba24143b80 msgr2=0x7fba241442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:25.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 --2- 172.21.15.177:0/2768959340 >> v2:172.21.15.195:3300/0 conn(0x7fba24143b80 0x7fba241442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 >> v1:172.21.15.195:6789/0 conn(0x7fba2406dc40 legacy=0x7fba24071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:25.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba24070c70 con 0x7fba241447e0 2023-11-28T20:09:25.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7fba0c001680 con 0x7fba241447e0 2023-11-28T20:09:25.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 >> v1:172.21.15.177:6789/0 conn(0x7fba241447e0 legacy=0x7fba2406d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:25.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 --2- 172.21.15.177:0/2768959340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba10003b10 0x7fba10003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:25.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 --2- 172.21.15.177:0/2768959340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba100047d0 0x7fba10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:25.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 --2- 172.21.15.177:0/2768959340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba10005190 0x7fba1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:25.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba24070990 con 0x7fba10005190 2023-11-28T20:09:25.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1000c010 con 0x7fba10003b10 2023-11-28T20:09:25.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1000c1d0 con 0x7fba100047d0 2023-11-28T20:09:25.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba22d9d640 1 --2- 172.21.15.177:0/2768959340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba10005190 0x7fba1000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:25.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba2259c640 1 --2- 172.21.15.177:0/2768959340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba10003b10 0x7fba10003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:25.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.765+0000 7fba1bfff640 1 --2- 172.21.15.177:0/2768959340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba100047d0 0x7fba10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:25.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba22d9d640 1 -- 172.21.15.177:0/2768959340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba100047d0 msgr2=0x7fba10004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:25.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba22d9d640 1 --2- 172.21.15.177:0/2768959340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba100047d0 0x7fba10004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba22d9d640 1 -- 172.21.15.177:0/2768959340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba10003b10 msgr2=0x7fba10003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:25.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba22d9d640 1 --2- 172.21.15.177:0/2768959340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba10003b10 0x7fba10003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba22d9d640 1 -- 172.21.15.177:0/2768959340 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba10003530 con 0x7fba10005190 2023-11-28T20:09:25.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba22d9d640 1 -- 172.21.15.177:0/2768959340 reap_dead start 2023-11-28T20:09:25.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba22d9d640 1 --2- 172.21.15.177:0/2768959340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba10005190 0x7fba1000b990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fba240cbea0 tx=0x7fba1c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81db674a4f490a22 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:25.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c003b80 con 0x7fba10005190 2023-11-28T20:09:25.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1c003ce0 con 0x7fba10005190 2023-11-28T20:09:25.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba21d9b640 1 -- 172.21.15.177:0/2768959340 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c005310 con 0x7fba10005190 2023-11-28T20:09:25.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba28846640 1 -- 172.21.15.177:0/2768959340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba10005190 msgr2=0x7fba1000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:25.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba28846640 1 --2- 172.21.15.177:0/2768959340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba10005190 0x7fba1000b990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fba240cbea0 tx=0x7fba1c01c8c0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba28846640 1 -- 172.21.15.177:0/2768959340 shutdown_connections 2023-11-28T20:09:25.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba28846640 1 --2- 172.21.15.177:0/2768959340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba10005190 0x7fba1000b990 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba28846640 1 -- 172.21.15.177:0/2768959340 >> 172.21.15.177:0/2768959340 conn(0x7fba2406ab30 msgr2=0x7fba240b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:25.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba28846640 1 -- 172.21.15.177:0/2768959340 shutdown_connections 2023-11-28T20:09:25.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.769+0000 7fba28846640 1 -- 172.21.15.177:0/2768959340 wait complete. 2023-11-28T20:09:25.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba28846640 1 Processor -- start 2023-11-28T20:09:25.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba28846640 1 -- start start 2023-11-28T20:09:25.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba28846640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba10005190 0x7fba2413c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:25.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba28846640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba2415aa40 0x7fba240a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:25.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba28846640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba240a9d90 0x7fba240aa240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:25.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba28846640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba240aa780 con 0x7fba10005190 2023-11-28T20:09:25.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba28846640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba240a9640 con 0x7fba2415aa40 2023-11-28T20:09:25.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba28846640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba240a8da0 con 0x7fba240a9d90 2023-11-28T20:09:25.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba2259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba10005190 0x7fba2413c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:25.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba2259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba10005190 0x7fba2413c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39618/0 (socket says 172.21.15.177:39618) 2023-11-28T20:09:25.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba2259c640 1 -- 172.21.15.177:0/1480890421 learned_addr learned my addr 172.21.15.177:0/1480890421 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:25.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba1bfff640 1 --2- 172.21.15.177:0/1480890421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba2415aa40 0x7fba240a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:25.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba22d9d640 1 --2- 172.21.15.177:0/1480890421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba240a9d90 0x7fba240aa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:25.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba2259c640 1 -- 172.21.15.177:0/1480890421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba240a9d90 msgr2=0x7fba240aa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:25.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba2259c640 1 --2- 172.21.15.177:0/1480890421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba240a9d90 0x7fba240aa240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba2259c640 1 -- 172.21.15.177:0/1480890421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba2415aa40 msgr2=0x7fba240a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:25.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba2259c640 1 --2- 172.21.15.177:0/1480890421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba2415aa40 0x7fba240a8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba2259c640 1 -- 172.21.15.177:0/1480890421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba240a9080 con 0x7fba10005190 2023-11-28T20:09:25.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba2259c640 1 --2- 172.21.15.177:0/1480890421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba10005190 0x7fba2413c530 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fba14011960 tx=0x7fba14011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:25.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba1affd640 1 -- 172.21.15.177:0/1480890421 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1400faf0 con 0x7fba10005190 2023-11-28T20:09:25.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba1affd640 1 -- 172.21.15.177:0/1480890421 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1400fc50 con 0x7fba10005190 2023-11-28T20:09:25.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.773+0000 7fba1affd640 1 -- 172.21.15.177:0/1480890421 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14014440 con 0x7fba10005190 2023-11-28T20:09:25.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.777+0000 7fba28846640 1 -- 172.21.15.177:0/1480890421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba240a9360 con 0x7fba10005190 2023-11-28T20:09:25.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.777+0000 7fba28846640 1 -- 172.21.15.177:0/1480890421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2413ca70 con 0x7fba10005190 2023-11-28T20:09:25.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.777+0000 7fba28846640 1 -- 172.21.15.177:0/1480890421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2413f7b0 con 0x7fba10005190 2023-11-28T20:09:25.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.777+0000 7fba1affd640 1 -- 172.21.15.177:0/1480890421 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fba140145a0 con 0x7fba10005190 2023-11-28T20:09:25.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.777+0000 7fba1affd640 1 --2- 172.21.15.177:0/1480890421 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fba040664a0 0x7fba04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:25.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.777+0000 7fba1affd640 1 -- 172.21.15.177:0/1480890421 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fba140847c0 con 0x7fba10005190 2023-11-28T20:09:25.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.777+0000 7fba1bfff640 1 --2- 172.21.15.177:0/1480890421 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fba040664a0 0x7fba04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:25.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.777+0000 7fba1bfff640 1 --2- 172.21.15.177:0/1480890421 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fba040664a0 0x7fba04068960 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001650 tx=0x7fba0c0015e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:25.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.781+0000 7fba1affd640 1 -- 172.21.15.177:0/1480890421 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba2413f7b0 con 0x7fba10005190 2023-11-28T20:09:25.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.933+0000 7fba28846640 1 -- 172.21.15.177:0/1480890421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba24070320 con 0x7fba10005190 2023-11-28T20:09:25.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.933+0000 7fba1affd640 1 -- 172.21.15.177:0/1480890421 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18408 (secure 0 0 0) 0x7fba24070320 con 0x7fba10005190 2023-11-28T20:09:25.938 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:25.938 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":36,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:55.264752+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:08:37.943771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T20:08:38.396895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2023-11-28T20:08:52.500186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:09:25.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.937+0000 7fba28846640 1 -- 172.21.15.177:0/1480890421 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fba040664a0 msgr2=0x7fba04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:25.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.937+0000 7fba28846640 1 --2- 172.21.15.177:0/1480890421 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fba040664a0 0x7fba04068960 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001650 tx=0x7fba0c0015e0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.937+0000 7fba28846640 1 -- 172.21.15.177:0/1480890421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba10005190 msgr2=0x7fba2413c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:25.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.937+0000 7fba28846640 1 --2- 172.21.15.177:0/1480890421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba10005190 0x7fba2413c530 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fba14011960 tx=0x7fba14011e20 comp rx=0 tx=0).stop 2023-11-28T20:09:25.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.937+0000 7fba28846640 1 -- 172.21.15.177:0/1480890421 shutdown_connections 2023-11-28T20:09:25.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.937+0000 7fba28846640 1 --2- 172.21.15.177:0/1480890421 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fba040664a0 0x7fba04068960 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.937+0000 7fba28846640 1 --2- 172.21.15.177:0/1480890421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba240a9d90 0x7fba240aa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.937+0000 7fba28846640 1 --2- 172.21.15.177:0/1480890421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba2415aa40 0x7fba240a8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.937+0000 7fba28846640 1 --2- 172.21.15.177:0/1480890421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba10005190 0x7fba2413c530 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:25.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.937+0000 7fba28846640 1 -- 172.21.15.177:0/1480890421 >> 172.21.15.177:0/1480890421 conn(0x7fba2406ab30 msgr2=0x7fba240cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:25.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.937+0000 7fba28846640 1 -- 172.21.15.177:0/1480890421 shutdown_connections 2023-11-28T20:09:25.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:25.937+0000 7fba28846640 1 -- 172.21.15.177:0/1480890421 wait complete. 2023-11-28T20:09:25.960 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:08:37.943771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:08:38.396895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2023-11-28T20:08:52.500186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:09:25.960 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:09:26.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.097+0000 7f8f89c79640 1 Processor -- start 2023-11-28T20:09:26.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.097+0000 7f8f89c79640 1 -- start start 2023-11-28T20:09:26.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.097+0000 7f8f89c79640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f84071d90 0x7f8f84072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.097+0000 7f8f89c79640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8f8415adb0 0x7f8f8413d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.097+0000 7f8f89c79640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8f8413f5f0 0x7f8f840ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.097+0000 7f8f89c79640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f84140520 con 0x7f8f8415adb0 2023-11-28T20:09:26.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.097+0000 7f8f89c79640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f840cd7f0 con 0x7f8f8413f5f0 2023-11-28T20:09:26.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.097+0000 7f8f89c79640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8413d2b0 con 0x7f8f84071d90 2023-11-28T20:09:26.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.097+0000 7f8f82ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8f8415adb0 0x7f8f8413d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.101+0000 7f8f82ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8f8415adb0 0x7f8f8413d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39624/0 (socket says 172.21.15.177:39624) 2023-11-28T20:09:26.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.101+0000 7f8f82ffd640 1 -- 172.21.15.177:0/2750190923 learned_addr learned my addr 172.21.15.177:0/2750190923 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:26.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.101+0000 7f8f837fe640 1 --2- 172.21.15.177:0/2750190923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f84071d90 0x7f8f84072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.101+0000 7f8f83fff640 1 --2- 172.21.15.177:0/2750190923 >> v2:172.21.15.195:3300/0 conn(0x7f8f8413f5f0 0x7f8f840ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.101+0000 7f8f82ffd640 1 -- 172.21.15.177:0/2750190923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f84071d90 msgr2=0x7f8f84072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:26.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.101+0000 7f8f82ffd640 1 --2- 172.21.15.177:0/2750190923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f84071d90 0x7f8f84072170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.101+0000 7f8f82ffd640 1 -- 172.21.15.177:0/2750190923 >> v2:172.21.15.195:3300/0 conn(0x7f8f8413f5f0 msgr2=0x7f8f840ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:26.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.101+0000 7f8f82ffd640 1 --2- 172.21.15.177:0/2750190923 >> v2:172.21.15.195:3300/0 conn(0x7f8f8413f5f0 0x7f8f840ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.101+0000 7f8f82ffd640 1 -- 172.21.15.177:0/2750190923 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f840cdd70 con 0x7f8f8415adb0 2023-11-28T20:09:26.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.101+0000 7f8f83fff640 1 --2- 172.21.15.177:0/2750190923 >> v2:172.21.15.195:3300/0 conn(0x7f8f8413f5f0 0x7f8f840ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:26.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.101+0000 7f8f82ffd640 1 --2- 172.21.15.177:0/2750190923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f8415adb0 0x7f8f8413d560 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8f84070380 tx=0x7f8f7801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe5556ed3044a85 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:26.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.101+0000 7f8f827fc640 1 -- 172.21.15.177:0/2750190923 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f780aa620 con 0x7f8f8415adb0 2023-11-28T20:09:26.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.101+0000 7f8f827fc640 1 -- 172.21.15.177:0/2750190923 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f780aa780 con 0x7f8f8415adb0 2023-11-28T20:09:26.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.101+0000 7f8f827fc640 1 -- 172.21.15.177:0/2750190923 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f780aab10 con 0x7f8f8415adb0 2023-11-28T20:09:26.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 -- 172.21.15.177:0/2750190923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f8415adb0 msgr2=0x7f8f8413d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 --2- 172.21.15.177:0/2750190923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f8415adb0 0x7f8f8413d560 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8f84070380 tx=0x7f8f7801c500 comp rx=0 tx=0).stop 2023-11-28T20:09:26.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 -- 172.21.15.177:0/2750190923 shutdown_connections 2023-11-28T20:09:26.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 --2- 172.21.15.177:0/2750190923 >> v2:172.21.15.195:3300/0 conn(0x7f8f8413f5f0 0x7f8f840ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 --2- 172.21.15.177:0/2750190923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f8415adb0 0x7f8f8413d560 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 --2- 172.21.15.177:0/2750190923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f84071d90 0x7f8f84072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 -- 172.21.15.177:0/2750190923 >> 172.21.15.177:0/2750190923 conn(0x7f8f840b0cc0 msgr2=0x7f8f840b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:26.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 -- 172.21.15.177:0/2750190923 shutdown_connections 2023-11-28T20:09:26.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 -- 172.21.15.177:0/2750190923 wait complete. 2023-11-28T20:09:26.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 Processor -- start 2023-11-28T20:09:26.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 -- start start 2023-11-28T20:09:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f84071d90 0x7f8f84150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f8413f5f0 0x7f8f84141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f8415adb0 0x7f8f84132420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f84140810 con 0x7f8f84071d90 2023-11-28T20:09:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8413a840 con 0x7f8f8415adb0 2023-11-28T20:09:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f89c79640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8413ab20 con 0x7f8f8413f5f0 2023-11-28T20:09:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f837fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f84071d90 0x7f8f84150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f837fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f84071d90 0x7f8f84150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39638/0 (socket says 172.21.15.177:39638) 2023-11-28T20:09:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f837fe640 1 -- 172.21.15.177:0/3015081975 learned_addr learned my addr 172.21.15.177:0/3015081975 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f82ffd640 1 --2- 172.21.15.177:0/3015081975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f8413f5f0 0x7f8f84141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f83fff640 1 --2- 172.21.15.177:0/3015081975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f8415adb0 0x7f8f84132420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f837fe640 1 -- 172.21.15.177:0/3015081975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f8413f5f0 msgr2=0x7f8f84141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f837fe640 1 --2- 172.21.15.177:0/3015081975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f8413f5f0 0x7f8f84141c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f837fe640 1 -- 172.21.15.177:0/3015081975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f8415adb0 msgr2=0x7f8f84132420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f837fe640 1 --2- 172.21.15.177:0/3015081975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f8415adb0 0x7f8f84132420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f837fe640 1 -- 172.21.15.177:0/3015081975 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f780094d0 con 0x7f8f84071d90 2023-11-28T20:09:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.105+0000 7f8f83fff640 1 --2- 172.21.15.177:0/3015081975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f8415adb0 0x7f8f84132420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.109+0000 7f8f837fe640 1 --2- 172.21.15.177:0/3015081975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f84071d90 0x7f8f84150f30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400d800 tx=0x7f8f7400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.109+0000 7f8f6bfff640 1 -- 172.21.15.177:0/3015081975 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7400b6c0 con 0x7f8f84071d90 2023-11-28T20:09:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.109+0000 7f8f6bfff640 1 -- 172.21.15.177:0/3015081975 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7400b820 con 0x7f8f84071d90 2023-11-28T20:09:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.109+0000 7f8f6bfff640 1 -- 172.21.15.177:0/3015081975 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7400bb90 con 0x7f8f84071d90 2023-11-28T20:09:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.109+0000 7f8f89c79640 1 -- 172.21.15.177:0/3015081975 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8413ae00 con 0x7f8f84071d90 2023-11-28T20:09:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.109+0000 7f8f89c79640 1 -- 172.21.15.177:0/3015081975 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8413a3f0 con 0x7f8f84071d90 2023-11-28T20:09:26.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.109+0000 7f8f89c79640 1 -- 172.21.15.177:0/3015081975 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8413a5e0 con 0x7f8f84071d90 2023-11-28T20:09:26.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.109+0000 7f8f6bfff640 1 -- 172.21.15.177:0/3015081975 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f7400bcf0 con 0x7f8f84071d90 2023-11-28T20:09:26.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.109+0000 7f8f6bfff640 1 --2- 172.21.15.177:0/3015081975 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8f70066470 0x7f8f70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.109+0000 7f8f6bfff640 1 -- 172.21.15.177:0/3015081975 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f8f74084560 con 0x7f8f84071d90 2023-11-28T20:09:26.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.109+0000 7f8f82ffd640 1 --2- 172.21.15.177:0/3015081975 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8f70066470 0x7f8f70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.113+0000 7f8f82ffd640 1 --2- 172.21.15.177:0/3015081975 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8f70066470 0x7f8f70068930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8f780ae000 tx=0x7f8f780b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:26.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.113+0000 7f8f6bfff640 1 -- 172.21.15.177:0/3015081975 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f740517b0 con 0x7f8f84071d90 2023-11-28T20:09:26.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.265+0000 7f8f89c79640 1 -- 172.21.15.177:0/3015081975 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f840693d0 con 0x7f8f84071d90 2023-11-28T20:09:26.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.265+0000 7f8f6bfff640 1 -- 172.21.15.177:0/3015081975 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f74054dd0 con 0x7f8f84071d90 2023-11-28T20:09:26.267 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:09:26.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.265+0000 7f8f89c79640 1 -- 172.21.15.177:0/3015081975 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8f70066470 msgr2=0x7f8f70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.265+0000 7f8f89c79640 1 --2- 172.21.15.177:0/3015081975 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8f70066470 0x7f8f70068930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8f780ae000 tx=0x7f8f780b5040 comp rx=0 tx=0).stop 2023-11-28T20:09:26.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.265+0000 7f8f89c79640 1 -- 172.21.15.177:0/3015081975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f84071d90 msgr2=0x7f8f84150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.265+0000 7f8f89c79640 1 --2- 172.21.15.177:0/3015081975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f84071d90 0x7f8f84150f30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400d800 tx=0x7f8f7400dcc0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.265+0000 7f8f89c79640 1 -- 172.21.15.177:0/3015081975 shutdown_connections 2023-11-28T20:09:26.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.265+0000 7f8f89c79640 1 --2- 172.21.15.177:0/3015081975 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8f70066470 0x7f8f70068930 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.265+0000 7f8f89c79640 1 --2- 172.21.15.177:0/3015081975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f8415adb0 0x7f8f84132420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.265+0000 7f8f89c79640 1 --2- 172.21.15.177:0/3015081975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f8413f5f0 0x7f8f84141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.265+0000 7f8f89c79640 1 --2- 172.21.15.177:0/3015081975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f84071d90 0x7f8f84150f30 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.265+0000 7f8f89c79640 1 -- 172.21.15.177:0/3015081975 >> 172.21.15.177:0/3015081975 conn(0x7f8f840b0cc0 msgr2=0x7f8f8415bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:26.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.265+0000 7f8f89c79640 1 -- 172.21.15.177:0/3015081975 shutdown_connections 2023-11-28T20:09:26.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.265+0000 7f8f89c79640 1 -- 172.21.15.177:0/3015081975 wait complete. 2023-11-28T20:09:26.290 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:09:26.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.429+0000 7fbab89b8640 1 Processor -- start 2023-11-28T20:09:26.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.429+0000 7fbab89b8640 1 -- start start 2023-11-28T20:09:26.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.429+0000 7fbab89b8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbab415adb0 0x7fbab413d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.429+0000 7fbab89b8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbab413f5f0 0x7fbab40ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.429+0000 7fbab89b8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab413d2b0 con 0x7fbab4071d90 2023-11-28T20:09:26.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.429+0000 7fbab89b8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab4140520 con 0x7fbab415adb0 2023-11-28T20:09:26.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.429+0000 7fbab89b8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab40cd7f0 con 0x7fbab413f5f0 2023-11-28T20:09:26.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.429+0000 7fbab1d9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbab415adb0 0x7fbab413d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.429+0000 7fbab1d9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbab415adb0 0x7fbab413d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39646/0 (socket says 172.21.15.177:39646) 2023-11-28T20:09:26.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.429+0000 7fbab1d9b640 1 -- 172.21.15.177:0/544793439 learned_addr learned my addr 172.21.15.177:0/544793439 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:26.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.429+0000 7fbab2d9d640 1 --2- 172.21.15.177:0/544793439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbab413f5f0 0x7fbab40ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.429+0000 7fbab1d9b640 1 -- 172.21.15.177:0/544793439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbab413f5f0 msgr2=0x7fbab40ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:26.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.429+0000 7fbab1d9b640 1 --2- 172.21.15.177:0/544793439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbab413f5f0 0x7fbab40ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.429+0000 7fbab1d9b640 1 -- 172.21.15.177:0/544793439 >> v1:172.21.15.195:6789/0 conn(0x7fbab4071d90 legacy=0x7fbab4072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:26.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.429+0000 7fbab1d9b640 1 -- 172.21.15.177:0/544793439 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab40cdd70 con 0x7fbab415adb0 2023-11-28T20:09:26.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.433+0000 7fbab1d9b640 1 --2- 172.21.15.177:0/544793439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbab415adb0 0x7fbab413d560 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009870 tx=0x7fbaa801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f55587a3afca50 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:26.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.433+0000 7fbab159a640 1 -- 172.21.15.177:0/544793439 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa80aa670 con 0x7fbab415adb0 2023-11-28T20:09:26.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.433+0000 7fbab159a640 1 -- 172.21.15.177:0/544793439 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa80aa7d0 con 0x7fbab415adb0 2023-11-28T20:09:26.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.433+0000 7fbab159a640 1 -- 172.21.15.177:0/544793439 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa80aab60 con 0x7fbab415adb0 2023-11-28T20:09:26.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.433+0000 7fbab89b8640 1 -- 172.21.15.177:0/544793439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbab415adb0 msgr2=0x7fbab413d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.433+0000 7fbab89b8640 1 --2- 172.21.15.177:0/544793439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbab415adb0 0x7fbab413d560 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009870 tx=0x7fbaa801c510 comp rx=0 tx=0).stop 2023-11-28T20:09:26.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.433+0000 7fbab89b8640 1 -- 172.21.15.177:0/544793439 shutdown_connections 2023-11-28T20:09:26.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.433+0000 7fbab89b8640 1 --2- 172.21.15.177:0/544793439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbab413f5f0 0x7fbab40ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.433+0000 7fbab89b8640 1 --2- 172.21.15.177:0/544793439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbab415adb0 0x7fbab413d560 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.433+0000 7fbab89b8640 1 -- 172.21.15.177:0/544793439 >> 172.21.15.177:0/544793439 conn(0x7fbab40b0cc0 msgr2=0x7fbab40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:26.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.433+0000 7fbab89b8640 1 -- 172.21.15.177:0/544793439 shutdown_connections 2023-11-28T20:09:26.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.433+0000 7fbab89b8640 1 -- 172.21.15.177:0/544793439 wait complete. 2023-11-28T20:09:26.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab89b8640 1 Processor -- start 2023-11-28T20:09:26.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab89b8640 1 -- start start 2023-11-28T20:09:26.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab89b8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbab4071d90 0x7fbab41428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab89b8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbab413f5f0 0x7fbab40afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab89b8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbab415adb0 0x7fbab40b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab89b8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab4154560 con 0x7fbab415adb0 2023-11-28T20:09:26.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab89b8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab41516c0 con 0x7fbab413f5f0 2023-11-28T20:09:26.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab89b8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab41519a0 con 0x7fbab4071d90 2023-11-28T20:09:26.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab2d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbab415adb0 0x7fbab40b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab2d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbab415adb0 0x7fbab40b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39658/0 (socket says 172.21.15.177:39658) 2023-11-28T20:09:26.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab2d9d640 1 -- 172.21.15.177:0/1012975012 learned_addr learned my addr 172.21.15.177:0/1012975012 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:26.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab1d9b640 1 --2- 172.21.15.177:0/1012975012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbab413f5f0 0x7fbab40afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab259c640 1 --2- 172.21.15.177:0/1012975012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbab4071d90 0x7fbab41428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab2d9d640 1 -- 172.21.15.177:0/1012975012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbab4071d90 msgr2=0x7fbab41428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab2d9d640 1 --2- 172.21.15.177:0/1012975012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbab4071d90 0x7fbab41428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab2d9d640 1 -- 172.21.15.177:0/1012975012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbab413f5f0 msgr2=0x7fbab40afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab2d9d640 1 --2- 172.21.15.177:0/1012975012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbab413f5f0 0x7fbab40afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab2d9d640 1 -- 172.21.15.177:0/1012975012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa80094d0 con 0x7fbab415adb0 2023-11-28T20:09:26.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab1d9b640 1 --2- 172.21.15.177:0/1012975012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbab413f5f0 0x7fbab40afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:26.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab2d9d640 1 --2- 172.21.15.177:0/1012975012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbab415adb0 0x7fbab40b0320 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbaac007e40 tx=0x7fbaac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:26.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbaa2ffd640 1 -- 172.21.15.177:0/1012975012 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac014620 con 0x7fbab415adb0 2023-11-28T20:09:26.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbaa2ffd640 1 -- 172.21.15.177:0/1012975012 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac00ee90 con 0x7fbab415adb0 2023-11-28T20:09:26.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab89b8640 1 -- 172.21.15.177:0/1012975012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab4151c80 con 0x7fbab415adb0 2023-11-28T20:09:26.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbaa2ffd640 1 -- 172.21.15.177:0/1012975012 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0149e0 con 0x7fbab415adb0 2023-11-28T20:09:26.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab89b8640 1 -- 172.21.15.177:0/1012975012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab4152240 con 0x7fbab415adb0 2023-11-28T20:09:26.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.437+0000 7fbab89b8640 1 -- 172.21.15.177:0/1012975012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab40693d0 con 0x7fbab415adb0 2023-11-28T20:09:26.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.441+0000 7fbaa2ffd640 1 -- 172.21.15.177:0/1012975012 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbaac014b40 con 0x7fbab415adb0 2023-11-28T20:09:26.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.441+0000 7fbaa2ffd640 1 --2- 172.21.15.177:0/1012975012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fba94066470 0x7fba94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.441+0000 7fbaa2ffd640 1 -- 172.21.15.177:0/1012975012 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fbaac0849c0 con 0x7fbab415adb0 2023-11-28T20:09:26.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.441+0000 7fbab259c640 1 --2- 172.21.15.177:0/1012975012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fba94066470 0x7fba94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.441+0000 7fbab259c640 1 --2- 172.21.15.177:0/1012975012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fba94066470 0x7fba94068930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbab40cc890 tx=0x7fbaa4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:26.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.445+0000 7fbaa2ffd640 1 -- 172.21.15.177:0/1012975012 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbaac051ca0 con 0x7fbab415adb0 2023-11-28T20:09:26.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.597+0000 7fbab89b8640 1 -- 172.21.15.177:0/1012975012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbab4152430 con 0x7fbab415adb0 2023-11-28T20:09:26.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.597+0000 7fbaa2ffd640 1 -- 172.21.15.177:0/1012975012 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbaac0552c0 con 0x7fbab415adb0 2023-11-28T20:09:26.600 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:09:26.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.597+0000 7fbab89b8640 1 -- 172.21.15.177:0/1012975012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fba94066470 msgr2=0x7fba94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.597+0000 7fbab89b8640 1 --2- 172.21.15.177:0/1012975012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fba94066470 0x7fba94068930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbab40cc890 tx=0x7fbaa4009040 comp rx=0 tx=0).stop 2023-11-28T20:09:26.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.597+0000 7fbab89b8640 1 -- 172.21.15.177:0/1012975012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbab415adb0 msgr2=0x7fbab40b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.597+0000 7fbab89b8640 1 --2- 172.21.15.177:0/1012975012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbab415adb0 0x7fbab40b0320 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbaac007e40 tx=0x7fbaac00e4b0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.597+0000 7fbab89b8640 1 -- 172.21.15.177:0/1012975012 shutdown_connections 2023-11-28T20:09:26.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.597+0000 7fbab89b8640 1 --2- 172.21.15.177:0/1012975012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fba94066470 0x7fba94068930 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.597+0000 7fbab89b8640 1 --2- 172.21.15.177:0/1012975012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbab415adb0 0x7fbab40b0320 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.597+0000 7fbab89b8640 1 --2- 172.21.15.177:0/1012975012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbab413f5f0 0x7fbab40afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.597+0000 7fbab89b8640 1 --2- 172.21.15.177:0/1012975012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbab4071d90 0x7fbab41428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.597+0000 7fbab89b8640 1 -- 172.21.15.177:0/1012975012 >> 172.21.15.177:0/1012975012 conn(0x7fbab40b0cc0 msgr2=0x7fbab40af560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:26.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.597+0000 7fbab89b8640 1 -- 172.21.15.177:0/1012975012 shutdown_connections 2023-11-28T20:09:26.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.597+0000 7fbab89b8640 1 -- 172.21.15.177:0/1012975012 wait complete. 2023-11-28T20:09:26.621 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:09:26.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febf5a17640 1 Processor -- start 2023-11-28T20:09:26.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febf5a17640 1 -- start start 2023-11-28T20:09:26.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febf5a17640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7febf00b3c50 0x7febf0159af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febf5a17640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7febf0070500 0x7febf00709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febf5a17640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf006dc60 con 0x7febf006e0f0 2023-11-28T20:09:26.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febf5a17640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf0070ef0 con 0x7febf00b3c50 2023-11-28T20:09:26.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febf5a17640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf006d050 con 0x7febf0070500 2023-11-28T20:09:26.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febe67fc640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7febf006e0f0 0x7febf006c870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44646/0 (socket says 172.21.15.177:44646) 2023-11-28T20:09:26.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febeeffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7febf00b3c50 0x7febf0159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febe67fc640 1 -- 172.21.15.177:0/470527497 learned_addr learned my addr 172.21.15.177:0/470527497 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:26.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febef7fe640 1 --2- 172.21.15.177:0/470527497 >> v2:172.21.15.195:3300/0 conn(0x7febf0070500 0x7febf00709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febeeffd640 1 -- 172.21.15.177:0/470527497 >> v2:172.21.15.195:3300/0 conn(0x7febf0070500 msgr2=0x7febf00709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:26.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febeeffd640 1 --2- 172.21.15.177:0/470527497 >> v2:172.21.15.195:3300/0 conn(0x7febf0070500 0x7febf00709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febeeffd640 1 -- 172.21.15.177:0/470527497 >> v1:172.21.15.177:6789/0 conn(0x7febf006e0f0 legacy=0x7febf006c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febeeffd640 1 -- 172.21.15.177:0/470527497 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf006d330 con 0x7febf00b3c50 2023-11-28T20:09:26.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.761+0000 7febee7fc640 1 -- 172.21.15.177:0/470527497 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636972755 0 0) 0x7febf006dc60 con 0x7febf006e0f0 2023-11-28T20:09:26.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.765+0000 7febeeffd640 1 --2- 172.21.15.177:0/470527497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf00b3c50 0x7febf0159af0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7febf01576c0 tx=0x7febe001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4921b0b1e1297b11 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:26.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.765+0000 7febee7fc640 1 -- 172.21.15.177:0/470527497 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe00a5890 con 0x7febf00b3c50 2023-11-28T20:09:26.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.765+0000 7febee7fc640 1 -- 172.21.15.177:0/470527497 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe00a59f0 con 0x7febf00b3c50 2023-11-28T20:09:26.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.765+0000 7febee7fc640 1 -- 172.21.15.177:0/470527497 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe00a5d80 con 0x7febf00b3c50 2023-11-28T20:09:26.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.765+0000 7febf5a17640 1 -- 172.21.15.177:0/470527497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf00b3c50 msgr2=0x7febf0159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.765+0000 7febf5a17640 1 --2- 172.21.15.177:0/470527497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf00b3c50 0x7febf0159af0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7febf01576c0 tx=0x7febe001c850 comp rx=0 tx=0).stop 2023-11-28T20:09:26.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.765+0000 7febf5a17640 1 -- 172.21.15.177:0/470527497 shutdown_connections 2023-11-28T20:09:26.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.765+0000 7febf5a17640 1 --2- 172.21.15.177:0/470527497 >> v2:172.21.15.195:3300/0 conn(0x7febf0070500 0x7febf00709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.765+0000 7febf5a17640 1 --2- 172.21.15.177:0/470527497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf00b3c50 0x7febf0159af0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.765+0000 7febf5a17640 1 -- 172.21.15.177:0/470527497 >> 172.21.15.177:0/470527497 conn(0x7febf00b0920 msgr2=0x7febf00b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:26.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.765+0000 7febf5a17640 1 -- 172.21.15.177:0/470527497 shutdown_connections 2023-11-28T20:09:26.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.765+0000 7febf5a17640 1 -- 172.21.15.177:0/470527497 wait complete. 2023-11-28T20:09:26.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.765+0000 7febf5a17640 1 Processor -- start 2023-11-28T20:09:26.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febf5a17640 1 -- start start 2023-11-28T20:09:26.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febf5a17640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febf006e0f0 0x7febf009c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febf5a17640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf0070500 0x7febf014f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febf5a17640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf00b3c50 0x7febf00c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febf5a17640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf009b350 con 0x7febf00b3c50 2023-11-28T20:09:26.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febf5a17640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf009b630 con 0x7febf0070500 2023-11-28T20:09:26.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febf5a17640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf009b910 con 0x7febf006e0f0 2023-11-28T20:09:26.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febef7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf00b3c50 0x7febf00c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febef7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf00b3c50 0x7febf00c3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39688/0 (socket says 172.21.15.177:39688) 2023-11-28T20:09:26.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febef7fe640 1 -- 172.21.15.177:0/893899329 learned_addr learned my addr 172.21.15.177:0/893899329 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:26.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febeeffd640 1 --2- 172.21.15.177:0/893899329 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febf006e0f0 0x7febf009c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febe67fc640 1 --2- 172.21.15.177:0/893899329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf0070500 0x7febf014f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febef7fe640 1 -- 172.21.15.177:0/893899329 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febf006e0f0 msgr2=0x7febf009c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febef7fe640 1 --2- 172.21.15.177:0/893899329 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febf006e0f0 0x7febf009c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febef7fe640 1 -- 172.21.15.177:0/893899329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf0070500 msgr2=0x7febf014f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febef7fe640 1 --2- 172.21.15.177:0/893899329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf0070500 0x7febf014f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febef7fe640 1 -- 172.21.15.177:0/893899329 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe0009a70 con 0x7febf00b3c50 2023-11-28T20:09:26.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febef7fe640 1 --2- 172.21.15.177:0/893899329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf00b3c50 0x7febf00c3da0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7febe800d800 tx=0x7febe800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:26.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febecff9640 1 -- 172.21.15.177:0/893899329 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe800b6c0 con 0x7febf00b3c50 2023-11-28T20:09:26.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febecff9640 1 -- 172.21.15.177:0/893899329 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe800b820 con 0x7febf00b3c50 2023-11-28T20:09:26.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febf5a17640 1 -- 172.21.15.177:0/893899329 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf009bbf0 con 0x7febf00b3c50 2023-11-28T20:09:26.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febecff9640 1 -- 172.21.15.177:0/893899329 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe800bbd0 con 0x7febf00b3c50 2023-11-28T20:09:26.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febf5a17640 1 -- 172.21.15.177:0/893899329 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf014f920 con 0x7febf00b3c50 2023-11-28T20:09:26.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.769+0000 7febf5a17640 1 -- 172.21.15.177:0/893899329 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf009d080 con 0x7febf00b3c50 2023-11-28T20:09:26.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.773+0000 7febecff9640 1 -- 172.21.15.177:0/893899329 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7febe800bd30 con 0x7febf00b3c50 2023-11-28T20:09:26.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.773+0000 7febecff9640 1 --2- 172.21.15.177:0/893899329 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7febd0066470 0x7febd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:26.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.773+0000 7febecff9640 1 -- 172.21.15.177:0/893899329 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7febe8084600 con 0x7febf00b3c50 2023-11-28T20:09:26.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.773+0000 7febeeffd640 1 --2- 172.21.15.177:0/893899329 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7febd0066470 0x7febd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:26.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.773+0000 7febeeffd640 1 --2- 172.21.15.177:0/893899329 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7febd0066470 0x7febd0068930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7febe00af000 tx=0x7febe00a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:26.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.777+0000 7febecff9640 1 -- 172.21.15.177:0/893899329 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7febe8051850 con 0x7febf00b3c50 2023-11-28T20:09:26.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.925+0000 7febf5a17640 1 -- 172.21.15.177:0/893899329 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7febf00cda70 con 0x7febf00b3c50 2023-11-28T20:09:26.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.925+0000 7febecff9640 1 -- 172.21.15.177:0/893899329 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7febe8054e70 con 0x7febf00b3c50 2023-11-28T20:09:26.930 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:09:26.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.929+0000 7febf5a17640 1 -- 172.21.15.177:0/893899329 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7febd0066470 msgr2=0x7febd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.929+0000 7febf5a17640 1 --2- 172.21.15.177:0/893899329 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7febd0066470 0x7febd0068930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7febe00af000 tx=0x7febe00a7070 comp rx=0 tx=0).stop 2023-11-28T20:09:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.929+0000 7febf5a17640 1 -- 172.21.15.177:0/893899329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf00b3c50 msgr2=0x7febf00c3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.929+0000 7febf5a17640 1 --2- 172.21.15.177:0/893899329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf00b3c50 0x7febf00c3da0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7febe800d800 tx=0x7febe800dcc0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.929+0000 7febf5a17640 1 -- 172.21.15.177:0/893899329 shutdown_connections 2023-11-28T20:09:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.929+0000 7febf5a17640 1 --2- 172.21.15.177:0/893899329 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7febd0066470 0x7febd0068930 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.929+0000 7febf5a17640 1 --2- 172.21.15.177:0/893899329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf00b3c50 0x7febf00c3da0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.929+0000 7febf5a17640 1 --2- 172.21.15.177:0/893899329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf0070500 0x7febf014f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.929+0000 7febf5a17640 1 --2- 172.21.15.177:0/893899329 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febf006e0f0 0x7febf009c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.929+0000 7febf5a17640 1 -- 172.21.15.177:0/893899329 >> 172.21.15.177:0/893899329 conn(0x7febf00b0920 msgr2=0x7febf0153110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.929+0000 7febf5a17640 1 -- 172.21.15.177:0/893899329 shutdown_connections 2023-11-28T20:09:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:26.929+0000 7febf5a17640 1 -- 172.21.15.177:0/893899329 wait complete. 2023-11-28T20:09:26.951 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-11-28T20:09:27.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.089+0000 7f4620d1d640 1 Processor -- start 2023-11-28T20:09:27.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.089+0000 7f4620d1d640 1 -- start start 2023-11-28T20:09:27.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.093+0000 7f4620d1d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f461c071d90 0x7f461c072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.093+0000 7f4620d1d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f461c13f5f0 0x7f461c0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.093+0000 7f4620d1d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c13d2b0 con 0x7f461c15adb0 2023-11-28T20:09:27.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.093+0000 7f4620d1d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c140520 con 0x7f461c13f5f0 2023-11-28T20:09:27.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.093+0000 7f4620d1d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c0cd7f0 con 0x7f461c071d90 2023-11-28T20:09:27.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.093+0000 7f461ad9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f461c13f5f0 0x7f461c0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.093+0000 7f461ad9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f461c13f5f0 0x7f461c0ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39690/0 (socket says 172.21.15.177:39690) 2023-11-28T20:09:27.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.093+0000 7f461ad9d640 1 -- 172.21.15.177:0/292414527 learned_addr learned my addr 172.21.15.177:0/292414527 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:27.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.093+0000 7f461a59c640 1 --2- 172.21.15.177:0/292414527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f461c071d90 0x7f461c072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.093+0000 7f461ad9d640 1 -- 172.21.15.177:0/292414527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f461c071d90 msgr2=0x7f461c072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:27.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.093+0000 7f461ad9d640 1 --2- 172.21.15.177:0/292414527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f461c071d90 0x7f461c072170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.093+0000 7f461ad9d640 1 -- 172.21.15.177:0/292414527 >> v1:172.21.15.195:6789/0 conn(0x7f461c15adb0 legacy=0x7f461c13d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.093+0000 7f461ad9d640 1 -- 172.21.15.177:0/292414527 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c0cdd70 con 0x7f461c13f5f0 2023-11-28T20:09:27.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.093+0000 7f461ad9d640 1 --2- 172.21.15.177:0/292414527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f461c13f5f0 0x7f461c0ce200 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f461400bb10 tx=0x7f461401ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0710e94fb278a4f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:27.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.097+0000 7f4619d9b640 1 -- 172.21.15.177:0/292414527 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46140a7be0 con 0x7f461c13f5f0 2023-11-28T20:09:27.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.097+0000 7f4619d9b640 1 -- 172.21.15.177:0/292414527 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46140a7d40 con 0x7f461c13f5f0 2023-11-28T20:09:27.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.097+0000 7f4619d9b640 1 -- 172.21.15.177:0/292414527 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46140af660 con 0x7f461c13f5f0 2023-11-28T20:09:27.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.097+0000 7f4620d1d640 1 -- 172.21.15.177:0/292414527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f461c13f5f0 msgr2=0x7f461c0ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.097+0000 7f4620d1d640 1 --2- 172.21.15.177:0/292414527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f461c13f5f0 0x7f461c0ce200 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f461400bb10 tx=0x7f461401ec10 comp rx=0 tx=0).stop 2023-11-28T20:09:27.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.097+0000 7f4620d1d640 1 -- 172.21.15.177:0/292414527 shutdown_connections 2023-11-28T20:09:27.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.097+0000 7f4620d1d640 1 --2- 172.21.15.177:0/292414527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f461c13f5f0 0x7f461c0ce200 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.097+0000 7f4620d1d640 1 --2- 172.21.15.177:0/292414527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f461c071d90 0x7f461c072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.097+0000 7f4620d1d640 1 -- 172.21.15.177:0/292414527 >> 172.21.15.177:0/292414527 conn(0x7f461c0b0cc0 msgr2=0x7f461c0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:27.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.097+0000 7f4620d1d640 1 -- 172.21.15.177:0/292414527 shutdown_connections 2023-11-28T20:09:27.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.097+0000 7f4620d1d640 1 -- 172.21.15.177:0/292414527 wait complete. 2023-11-28T20:09:27.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.097+0000 7f4620d1d640 1 Processor -- start 2023-11-28T20:09:27.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.097+0000 7f4620d1d640 1 -- start start 2023-11-28T20:09:27.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.097+0000 7f4620d1d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f461c071d90 0x7f461c0ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f4620d1d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f461c13f5f0 0x7f461c139a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f4620d1d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f461c15adb0 0x7f461c13c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f4620d1d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c0adb50 con 0x7f461c15adb0 2023-11-28T20:09:27.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f4620d1d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c1649d0 con 0x7f461c13f5f0 2023-11-28T20:09:27.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f4620d1d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c0acf40 con 0x7f461c071d90 2023-11-28T20:09:27.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f461ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f461c15adb0 0x7f461c13c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f4611d9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f461c13f5f0 0x7f461c139a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f461a59c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f461c071d90 0x7f461c0ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f461ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f461c15adb0 0x7f461c13c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39704/0 (socket says 172.21.15.177:39704) 2023-11-28T20:09:27.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f461ad9d640 1 -- 172.21.15.177:0/3337755271 learned_addr learned my addr 172.21.15.177:0/3337755271 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:27.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f461ad9d640 1 -- 172.21.15.177:0/3337755271 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f461c071d90 msgr2=0x7f461c0ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f461ad9d640 1 --2- 172.21.15.177:0/3337755271 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f461c071d90 0x7f461c0ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f461ad9d640 1 -- 172.21.15.177:0/3337755271 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f461c13f5f0 msgr2=0x7f461c139a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f461ad9d640 1 --2- 172.21.15.177:0/3337755271 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f461c13f5f0 0x7f461c139a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f461ad9d640 1 -- 172.21.15.177:0/3337755271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461400b770 con 0x7f461c15adb0 2023-11-28T20:09:27.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f461ad9d640 1 --2- 172.21.15.177:0/3337755271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f461c15adb0 0x7f461c13c350 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f461400bb10 tx=0x7f461401b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:27.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f46137fe640 1 -- 172.21.15.177:0/3337755271 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46140ba660 con 0x7f461c15adb0 2023-11-28T20:09:27.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f46137fe640 1 -- 172.21.15.177:0/3337755271 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46140ba7c0 con 0x7f461c15adb0 2023-11-28T20:09:27.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f4620d1d640 1 -- 172.21.15.177:0/3337755271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461c0ad220 con 0x7f461c15adb0 2023-11-28T20:09:27.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f46137fe640 1 -- 172.21.15.177:0/3337755271 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46140bab70 con 0x7f461c15adb0 2023-11-28T20:09:27.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f4620d1d640 1 -- 172.21.15.177:0/3337755271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461c0ad7e0 con 0x7f461c15adb0 2023-11-28T20:09:27.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f4620d1d640 1 -- 172.21.15.177:0/3337755271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461c0add00 con 0x7f461c15adb0 2023-11-28T20:09:27.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.101+0000 7f46137fe640 1 -- 172.21.15.177:0/3337755271 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f46140c33b0 con 0x7f461c15adb0 2023-11-28T20:09:27.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.105+0000 7f46137fe640 1 --2- 172.21.15.177:0/3337755271 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45fc066470 0x7f45fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.105+0000 7f46137fe640 1 -- 172.21.15.177:0/3337755271 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f461411f160 con 0x7f461c15adb0 2023-11-28T20:09:27.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.105+0000 7f461a59c640 1 --2- 172.21.15.177:0/3337755271 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45fc066470 0x7f45fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.105+0000 7f461a59c640 1 --2- 172.21.15.177:0/3337755271 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45fc066470 0x7f45fc068930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f460c0113e0 tx=0x7f460c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:27.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.109+0000 7f46137fe640 1 -- 172.21.15.177:0/3337755271 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f461c0add00 con 0x7f461c15adb0 2023-11-28T20:09:27.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.257+0000 7f4620d1d640 1 -- 172.21.15.177:0/3337755271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f461c0add00 con 0x7f461c15adb0 2023-11-28T20:09:27.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.257+0000 7f46137fe640 1 -- 172.21.15.177:0/3337755271 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v36) v1 ==== 97+0+11 (secure 0 0 0) 0x7f461c0add00 con 0x7f461c15adb0 2023-11-28T20:09:27.260 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:09:27.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.257+0000 7f4620d1d640 1 -- 172.21.15.177:0/3337755271 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45fc066470 msgr2=0x7f45fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.257+0000 7f4620d1d640 1 --2- 172.21.15.177:0/3337755271 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45fc066470 0x7f45fc068930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f460c0113e0 tx=0x7f460c00b040 comp rx=0 tx=0).stop 2023-11-28T20:09:27.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.257+0000 7f4620d1d640 1 -- 172.21.15.177:0/3337755271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f461c15adb0 msgr2=0x7f461c13c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.257+0000 7f4620d1d640 1 --2- 172.21.15.177:0/3337755271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f461c15adb0 0x7f461c13c350 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f461400bb10 tx=0x7f461401b9b0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.257+0000 7f4620d1d640 1 -- 172.21.15.177:0/3337755271 shutdown_connections 2023-11-28T20:09:27.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.257+0000 7f4620d1d640 1 --2- 172.21.15.177:0/3337755271 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45fc066470 0x7f45fc068930 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.257+0000 7f4620d1d640 1 --2- 172.21.15.177:0/3337755271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f461c15adb0 0x7f461c13c350 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.257+0000 7f4620d1d640 1 --2- 172.21.15.177:0/3337755271 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f461c13f5f0 0x7f461c139a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.257+0000 7f4620d1d640 1 --2- 172.21.15.177:0/3337755271 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f461c071d90 0x7f461c0ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.257+0000 7f4620d1d640 1 -- 172.21.15.177:0/3337755271 >> 172.21.15.177:0/3337755271 conn(0x7f461c0b0cc0 msgr2=0x7f461c13dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:27.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.257+0000 7f4620d1d640 1 -- 172.21.15.177:0/3337755271 shutdown_connections 2023-11-28T20:09:27.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.261+0000 7f4620d1d640 1 -- 172.21.15.177:0/3337755271 wait complete. 2023-11-28T20:09:27.282 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:09:27.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f5643372640 1 Processor -- start 2023-11-28T20:09:27.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f5643372640 1 -- start start 2023-11-28T20:09:27.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f5643372640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f563c06c9d0 0x7f563c070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f5643372640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f563c072180 0x7f563c0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f5643372640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563c0710e0 con 0x7f563c144840 2023-11-28T20:09:27.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f5643372640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563c15f010 con 0x7f563c072180 2023-11-28T20:09:27.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f5643372640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c070ee0 con 0x7f563c06c9d0 2023-11-28T20:09:27.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f564190f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f563c072180 0x7f563c0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f564110e640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f563c144840 0x7f563c06c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44652/0 (socket says 172.21.15.177:44652) 2023-11-28T20:09:27.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f564110e640 1 -- 172.21.15.177:0/4051474858 learned_addr learned my addr 172.21.15.177:0/4051474858 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:27.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f564190f640 1 -- 172.21.15.177:0/4051474858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f563c06c9d0 msgr2=0x7f563c070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:27.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f564090d640 1 --2- 172.21.15.177:0/4051474858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f563c06c9d0 0x7f563c070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f564190f640 1 --2- 172.21.15.177:0/4051474858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f563c06c9d0 0x7f563c070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f5633fff640 1 -- 172.21.15.177:0/4051474858 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390978024 0 0) 0x7f563c0710e0 con 0x7f563c144840 2023-11-28T20:09:27.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f564190f640 1 -- 172.21.15.177:0/4051474858 >> v1:172.21.15.177:6789/0 conn(0x7f563c144840 legacy=0x7f563c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f564190f640 1 -- 172.21.15.177:0/4051474858 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c0713c0 con 0x7f563c072180 2023-11-28T20:09:27.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.417+0000 7f564090d640 1 --2- 172.21.15.177:0/4051474858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f563c06c9d0 0x7f563c070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:27.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.421+0000 7f564190f640 1 --2- 172.21.15.177:0/4051474858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f563c072180 0x7f563c0709a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5634009d90 tx=0x7f563401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b857681c03d3fe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:27.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.421+0000 7f5633fff640 1 -- 172.21.15.177:0/4051474858 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56340a59e0 con 0x7f563c072180 2023-11-28T20:09:27.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.421+0000 7f5633fff640 1 -- 172.21.15.177:0/4051474858 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56340a5b40 con 0x7f563c072180 2023-11-28T20:09:27.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.421+0000 7f5633fff640 1 -- 172.21.15.177:0/4051474858 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56340ad440 con 0x7f563c072180 2023-11-28T20:09:27.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.421+0000 7f5643372640 1 -- 172.21.15.177:0/4051474858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f563c072180 msgr2=0x7f563c0709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.421+0000 7f5643372640 1 --2- 172.21.15.177:0/4051474858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f563c072180 0x7f563c0709a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5634009d90 tx=0x7f563401c920 comp rx=0 tx=0).stop 2023-11-28T20:09:27.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.421+0000 7f5643372640 1 -- 172.21.15.177:0/4051474858 shutdown_connections 2023-11-28T20:09:27.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.421+0000 7f5643372640 1 --2- 172.21.15.177:0/4051474858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f563c072180 0x7f563c0709a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.421+0000 7f5643372640 1 --2- 172.21.15.177:0/4051474858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f563c06c9d0 0x7f563c070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.421+0000 7f5643372640 1 -- 172.21.15.177:0/4051474858 >> 172.21.15.177:0/4051474858 conn(0x7f563c06a530 msgr2=0x7f563c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:27.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.421+0000 7f5643372640 1 -- 172.21.15.177:0/4051474858 shutdown_connections 2023-11-28T20:09:27.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.421+0000 7f5643372640 1 -- 172.21.15.177:0/4051474858 wait complete. 2023-11-28T20:09:27.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f5643372640 1 Processor -- start 2023-11-28T20:09:27.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f5643372640 1 -- start start 2023-11-28T20:09:27.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f5643372640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f563c06c9d0 0x7f563c0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f5643372640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f563c072180 0x7f563c0ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f5643372640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f563c144840 0x7f563c142740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f5643372640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0b2be0 con 0x7f563c06c9d0 2023-11-28T20:09:27.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f5643372640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0b2ec0 con 0x7f563c072180 2023-11-28T20:09:27.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f5643372640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0b31a0 con 0x7f563c144840 2023-11-28T20:09:27.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f564110e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f563c06c9d0 0x7f563c0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f564110e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f563c06c9d0 0x7f563c0b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39712/0 (socket says 172.21.15.177:39712) 2023-11-28T20:09:27.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f564110e640 1 -- 172.21.15.177:0/2465984974 learned_addr learned my addr 172.21.15.177:0/2465984974 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:27.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f564190f640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f563c144840 0x7f563c142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f564090d640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f563c072180 0x7f563c0ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f564110e640 1 -- 172.21.15.177:0/2465984974 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f563c144840 msgr2=0x7f563c142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f564110e640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f563c144840 0x7f563c142740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f564110e640 1 -- 172.21.15.177:0/2465984974 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f563c072180 msgr2=0x7f563c0ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f564110e640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f563c072180 0x7f563c0ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f564110e640 1 -- 172.21.15.177:0/2465984974 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5634009a70 con 0x7f563c06c9d0 2023-11-28T20:09:27.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f564090d640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f563c072180 0x7f563c0ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:27.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f564190f640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f563c144840 0x7f563c142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:27.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f564110e640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f563c06c9d0 0x7f563c0b3c80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f563800c480 tx=0x7f563800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:27.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f5631ffb640 1 -- 172.21.15.177:0/2465984974 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56380074e0 con 0x7f563c06c9d0 2023-11-28T20:09:27.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f5631ffb640 1 -- 172.21.15.177:0/2465984974 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638007660 con 0x7f563c06c9d0 2023-11-28T20:09:27.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f5643372640 1 -- 172.21.15.177:0/2465984974 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c0b3480 con 0x7f563c06c9d0 2023-11-28T20:09:27.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f5631ffb640 1 -- 172.21.15.177:0/2465984974 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638004a30 con 0x7f563c06c9d0 2023-11-28T20:09:27.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f5643372640 1 -- 172.21.15.177:0/2465984974 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563c13cd70 con 0x7f563c06c9d0 2023-11-28T20:09:27.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.425+0000 7f5643372640 1 -- 172.21.15.177:0/2465984974 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563c069440 con 0x7f563c06c9d0 2023-11-28T20:09:27.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.429+0000 7f5631ffb640 1 -- 172.21.15.177:0/2465984974 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5638004b90 con 0x7f563c06c9d0 2023-11-28T20:09:27.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.429+0000 7f5631ffb640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5620066470 0x7f5620068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.429+0000 7f5631ffb640 1 -- 172.21.15.177:0/2465984974 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f5638083130 con 0x7f563c06c9d0 2023-11-28T20:09:27.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.429+0000 7f564090d640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5620066470 0x7f5620068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.429+0000 7f564090d640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5620066470 0x7f5620068930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f563c165040 tx=0x7f562c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:27.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.433+0000 7f5631ffb640 1 -- 172.21.15.177:0/2465984974 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5638053f40 con 0x7f563c06c9d0 2023-11-28T20:09:27.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.617+0000 7f5643372640 1 -- 172.21.15.177:0/2465984974 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f563c06d170 con 0x7f563c06c9d0 2023-11-28T20:09:27.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.617+0000 7f5631ffb640 1 -- 172.21.15.177:0/2465984974 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4924 (secure 0 0 0) 0x7f5638053ad0 con 0x7f563c06c9d0 2023-11-28T20:09:27.620 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:27.620 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2829857708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2829857708},{"type":"v1","addr":"172.21.15.177:6836","nonce":2829857708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5101,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/916709103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":916709103},{"type":"v1","addr":"172.21.15.195:6834","nonce":916709103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1987123637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1987123637},{"type":"v1","addr":"172.21.15.195:6835","nonce":1987123637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:08:39.405256+0000","modified":"2023-11-28T20:08:53.633079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/3143070912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":3143070912},{"type":"v1","addr":"172.21.15.177:6837","nonce":3143070912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T20:09:27.621 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 18 2023-11-28T20:09:27.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.617+0000 7f5643372640 1 -- 172.21.15.177:0/2465984974 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5620066470 msgr2=0x7f5620068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.617+0000 7f5643372640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5620066470 0x7f5620068930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f563c165040 tx=0x7f562c008040 comp rx=0 tx=0).stop 2023-11-28T20:09:27.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.617+0000 7f5643372640 1 -- 172.21.15.177:0/2465984974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f563c06c9d0 msgr2=0x7f563c0b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.617+0000 7f5643372640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f563c06c9d0 0x7f563c0b3c80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f563800c480 tx=0x7f563800c940 comp rx=0 tx=0).stop 2023-11-28T20:09:27.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.617+0000 7f5643372640 1 -- 172.21.15.177:0/2465984974 shutdown_connections 2023-11-28T20:09:27.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.617+0000 7f5643372640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5620066470 0x7f5620068930 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.617+0000 7f5643372640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f563c144840 0x7f563c142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.617+0000 7f5643372640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f563c072180 0x7f563c0ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.617+0000 7f5643372640 1 --2- 172.21.15.177:0/2465984974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f563c06c9d0 0x7f563c0b3c80 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.617+0000 7f5643372640 1 -- 172.21.15.177:0/2465984974 >> 172.21.15.177:0/2465984974 conn(0x7f563c06a530 msgr2=0x7f563c13e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:27.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.621+0000 7f5643372640 1 -- 172.21.15.177:0/2465984974 shutdown_connections 2023-11-28T20:09:27.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.621+0000 7f5643372640 1 -- 172.21.15.177:0/2465984974 wait complete. 2023-11-28T20:09:27.641 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:09:27.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3bb157640 1 Processor -- start 2023-11-28T20:09:27.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3bb157640 1 -- start start 2023-11-28T20:09:27.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3bb157640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc3b40b35b0 0x7fc3b40d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3bb157640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc3b40cfe90 0x7fc3b415f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3bb157640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b40d3880 con 0x7fc3b40b3c70 2023-11-28T20:09:27.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3bb157640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b40d4090 con 0x7fc3b40cfe90 2023-11-28T20:09:27.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3bb157640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b40cdc80 con 0x7fc3b40b35b0 2023-11-28T20:09:27.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3b96f4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc3b40cfe90 0x7fc3b415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3b3fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc3b40b3c70 0x7fc3b40cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44660/0 (socket says 172.21.15.177:44660) 2023-11-28T20:09:27.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3b3fff640 1 -- 172.21.15.177:0/2508403600 learned_addr learned my addr 172.21.15.177:0/2508403600 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:27.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3b8ef3640 1 --2- 172.21.15.177:0/2508403600 >> v2:172.21.15.195:3300/0 conn(0x7fc3b40b35b0 0x7fc3b40d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3b96f4640 1 -- 172.21.15.177:0/2508403600 >> v2:172.21.15.195:3300/0 conn(0x7fc3b40b35b0 msgr2=0x7fc3b40d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:27.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3b96f4640 1 --2- 172.21.15.177:0/2508403600 >> v2:172.21.15.195:3300/0 conn(0x7fc3b40b35b0 0x7fc3b40d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3b96f4640 1 -- 172.21.15.177:0/2508403600 >> v1:172.21.15.177:6789/0 conn(0x7fc3b40b3c70 legacy=0x7fc3b40cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3b96f4640 1 -- 172.21.15.177:0/2508403600 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b40d3ad0 con 0x7fc3b40cfe90 2023-11-28T20:09:27.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.777+0000 7fc3b8ef3640 1 --2- 172.21.15.177:0/2508403600 >> v2:172.21.15.195:3300/0 conn(0x7fc3b40b35b0 0x7fc3b40d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:27.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.781+0000 7fc3b96f4640 1 --2- 172.21.15.177:0/2508403600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3b40cfe90 0x7fc3b415f060 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc3b408c9e0 tx=0x7fc3ac01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908ef0316e3d22a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:27.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.781+0000 7fc3b37fe640 1 -- 172.21.15.177:0/2508403600 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0a59d0 con 0x7fc3b40cfe90 2023-11-28T20:09:27.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.781+0000 7fc3b37fe640 1 -- 172.21.15.177:0/2508403600 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ac0a5b30 con 0x7fc3b40cfe90 2023-11-28T20:09:27.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.781+0000 7fc3b37fe640 1 -- 172.21.15.177:0/2508403600 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0ad440 con 0x7fc3b40cfe90 2023-11-28T20:09:27.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.781+0000 7fc3bb157640 1 -- 172.21.15.177:0/2508403600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3b40cfe90 msgr2=0x7fc3b415f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.781+0000 7fc3bb157640 1 --2- 172.21.15.177:0/2508403600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3b40cfe90 0x7fc3b415f060 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc3b408c9e0 tx=0x7fc3ac01c910 comp rx=0 tx=0).stop 2023-11-28T20:09:27.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.781+0000 7fc3bb157640 1 -- 172.21.15.177:0/2508403600 shutdown_connections 2023-11-28T20:09:27.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.781+0000 7fc3bb157640 1 --2- 172.21.15.177:0/2508403600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3b40cfe90 0x7fc3b415f060 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.781+0000 7fc3bb157640 1 --2- 172.21.15.177:0/2508403600 >> v2:172.21.15.195:3300/0 conn(0x7fc3b40b35b0 0x7fc3b40d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.781+0000 7fc3bb157640 1 -- 172.21.15.177:0/2508403600 >> 172.21.15.177:0/2508403600 conn(0x7fc3b409c4b0 msgr2=0x7fc3b40d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:27.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.781+0000 7fc3bb157640 1 -- 172.21.15.177:0/2508403600 shutdown_connections 2023-11-28T20:09:27.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.781+0000 7fc3bb157640 1 -- 172.21.15.177:0/2508403600 wait complete. 2023-11-28T20:09:27.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3bb157640 1 Processor -- start 2023-11-28T20:09:27.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3bb157640 1 -- start start 2023-11-28T20:09:27.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3bb157640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3b40b35b0 0x7fc3b409cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3bb157640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3b40b3c70 0x7fc3b4159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3bb157640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3b40cfe90 0x7fc3b41f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3bb157640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b409ff20 con 0x7fc3b40b35b0 2023-11-28T20:09:27.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3bb157640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b409d5b0 con 0x7fc3b40cfe90 2023-11-28T20:09:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3bb157640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b409d890 con 0x7fc3b40b3c70 2023-11-28T20:09:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b8ef3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3b40b35b0 0x7fc3b409cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b8ef3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3b40b35b0 0x7fc3b409cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39732/0 (socket says 172.21.15.177:39732) 2023-11-28T20:09:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b8ef3640 1 -- 172.21.15.177:0/3925597183 learned_addr learned my addr 172.21.15.177:0/3925597183 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b3fff640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3b40b3c70 0x7fc3b4159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b96f4640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3b40cfe90 0x7fc3b41f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b8ef3640 1 -- 172.21.15.177:0/3925597183 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3b40b3c70 msgr2=0x7fc3b4159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b8ef3640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3b40b3c70 0x7fc3b4159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b8ef3640 1 -- 172.21.15.177:0/3925597183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3b40cfe90 msgr2=0x7fc3b41f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b8ef3640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3b40cfe90 0x7fc3b41f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b8ef3640 1 -- 172.21.15.177:0/3925597183 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac009a70 con 0x7fc3b40b35b0 2023-11-28T20:09:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b96f4640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3b40cfe90 0x7fc3b41f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:27.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b3fff640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3b40b3c70 0x7fc3b4159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:27.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b8ef3640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3b40b35b0 0x7fc3b409cf20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800e810 tx=0x7fc3a800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:27.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b17fa640 1 -- 172.21.15.177:0/3925597183 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a800c8d0 con 0x7fc3b40b35b0 2023-11-28T20:09:27.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b17fa640 1 -- 172.21.15.177:0/3925597183 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a800ca30 con 0x7fc3b40b35b0 2023-11-28T20:09:27.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3b17fa640 1 -- 172.21.15.177:0/3925597183 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a800cdc0 con 0x7fc3b40b35b0 2023-11-28T20:09:27.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3bb157640 1 -- 172.21.15.177:0/3925597183 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b409db70 con 0x7fc3b40b35b0 2023-11-28T20:09:27.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.785+0000 7fc3bb157640 1 -- 172.21.15.177:0/3925597183 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b409e130 con 0x7fc3b40b35b0 2023-11-28T20:09:27.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.789+0000 7fc3bb157640 1 -- 172.21.15.177:0/3925597183 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b4069440 con 0x7fc3b40b35b0 2023-11-28T20:09:27.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.789+0000 7fc3b17fa640 1 -- 172.21.15.177:0/3925597183 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc3a8013410 con 0x7fc3b40b35b0 2023-11-28T20:09:27.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.789+0000 7fc3b17fa640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc398066470 0x7fc398068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:27.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.789+0000 7fc3b17fa640 1 -- 172.21.15.177:0/3925597183 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fc3a8083eb0 con 0x7fc3b40b35b0 2023-11-28T20:09:27.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.789+0000 7fc3b3fff640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc398066470 0x7fc398068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:27.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.789+0000 7fc3b3fff640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc398066470 0x7fc398068930 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40cb270 tx=0x7fc3a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:27.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.793+0000 7fc3b17fa640 1 -- 172.21.15.177:0/3925597183 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc3a8051100 con 0x7fc3b40b35b0 2023-11-28T20:09:27.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.941+0000 7fc3bb157640 1 -- 172.21.15.177:0/3925597183 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3b409c9f0 con 0x7fc3b40b35b0 2023-11-28T20:09:27.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.945+0000 7fc3b17fa640 1 -- 172.21.15.177:0/3925597183 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18408 (secure 0 0 0) 0x7fc3a8009480 con 0x7fc3b40b35b0 2023-11-28T20:09:27.947 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:27.948 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":36,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:55.264752+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:08:37.943771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T20:08:38.396895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2023-11-28T20:08:52.500186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:09:27.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.945+0000 7fc3bb157640 1 -- 172.21.15.177:0/3925597183 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc398066470 msgr2=0x7fc398068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.945+0000 7fc3bb157640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc398066470 0x7fc398068930 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40cb270 tx=0x7fc3a0009040 comp rx=0 tx=0).stop 2023-11-28T20:09:27.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.945+0000 7fc3bb157640 1 -- 172.21.15.177:0/3925597183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3b40b35b0 msgr2=0x7fc3b409cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:27.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.945+0000 7fc3bb157640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3b40b35b0 0x7fc3b409cf20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800e810 tx=0x7fc3a800ecd0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.945+0000 7fc3bb157640 1 -- 172.21.15.177:0/3925597183 shutdown_connections 2023-11-28T20:09:27.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.945+0000 7fc3bb157640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc398066470 0x7fc398068930 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.945+0000 7fc3bb157640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3b40cfe90 0x7fc3b41f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.945+0000 7fc3bb157640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3b40b3c70 0x7fc3b4159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.945+0000 7fc3bb157640 1 --2- 172.21.15.177:0/3925597183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3b40b35b0 0x7fc3b409cf20 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:27.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.945+0000 7fc3bb157640 1 -- 172.21.15.177:0/3925597183 >> 172.21.15.177:0/3925597183 conn(0x7fc3b409c4b0 msgr2=0x7fc3b40cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:27.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.945+0000 7fc3bb157640 1 -- 172.21.15.177:0/3925597183 shutdown_connections 2023-11-28T20:09:27.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:27.945+0000 7fc3bb157640 1 -- 172.21.15.177:0/3925597183 wait complete. 2023-11-28T20:09:27.969 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T20:09:27.969 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:09:28.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa01dc9e640 1 Processor -- start 2023-11-28T20:09:28.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa01dc9e640 1 -- start start 2023-11-28T20:09:28.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa01dc9e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa01813cf30 0x7fa01806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa01dc9e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa01806c800 0x7fa01815a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa01dc9e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01815b3a0 con 0x7fa01815ab70 2023-11-28T20:09:28.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa01dc9e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01813d310 con 0x7fa01806c800 2023-11-28T20:09:28.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa01dc9e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0181404e0 con 0x7fa01813cf30 2023-11-28T20:09:28.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa016ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa01806c800 0x7fa01815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa017fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fa01815ab70 0x7fa018071570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:44670/0 (socket says 172.21.15.177:44670) 2023-11-28T20:09:28.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa017fff640 1 -- 172.21.15.177:0/137959860 learned_addr learned my addr 172.21.15.177:0/137959860 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:28.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa0177fe640 1 --2- 172.21.15.177:0/137959860 >> v2:172.21.15.195:3300/0 conn(0x7fa01813cf30 0x7fa01806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa016ffd640 1 -- 172.21.15.177:0/137959860 >> v2:172.21.15.195:3300/0 conn(0x7fa01813cf30 msgr2=0x7fa01806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:28.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa016ffd640 1 --2- 172.21.15.177:0/137959860 >> v2:172.21.15.195:3300/0 conn(0x7fa01813cf30 0x7fa01806c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa016ffd640 1 -- 172.21.15.177:0/137959860 >> v1:172.21.15.177:6789/0 conn(0x7fa01815ab70 legacy=0x7fa018071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa016ffd640 1 -- 172.21.15.177:0/137959860 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01813f720 con 0x7fa01806c800 2023-11-28T20:09:28.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa0167fc640 1 -- 172.21.15.177:0/137959860 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708116242 0 0) 0x7fa01815b3a0 con 0x7fa01815ab70 2023-11-28T20:09:28.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.109+0000 7fa0177fe640 1 --2- 172.21.15.177:0/137959860 >> v2:172.21.15.195:3300/0 conn(0x7fa01813cf30 0x7fa01806c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:28.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.113+0000 7fa016ffd640 1 --2- 172.21.15.177:0/137959860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa01806c800 0x7fa01815a630 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa01806b510 tx=0x7fa00c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afa5c7669b0c1ac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:28.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.113+0000 7fa0167fc640 1 -- 172.21.15.177:0/137959860 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c0ab600 con 0x7fa01806c800 2023-11-28T20:09:28.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.113+0000 7fa0167fc640 1 -- 172.21.15.177:0/137959860 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c0a7050 con 0x7fa01806c800 2023-11-28T20:09:28.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.113+0000 7fa0167fc640 1 -- 172.21.15.177:0/137959860 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c0ab980 con 0x7fa01806c800 2023-11-28T20:09:28.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.113+0000 7fa01dc9e640 1 -- 172.21.15.177:0/137959860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa01806c800 msgr2=0x7fa01815a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.113+0000 7fa01dc9e640 1 --2- 172.21.15.177:0/137959860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa01806c800 0x7fa01815a630 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa01806b510 tx=0x7fa00c01c3b0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.113+0000 7fa01dc9e640 1 -- 172.21.15.177:0/137959860 shutdown_connections 2023-11-28T20:09:28.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.113+0000 7fa01dc9e640 1 --2- 172.21.15.177:0/137959860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa01806c800 0x7fa01815a630 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.113+0000 7fa01dc9e640 1 --2- 172.21.15.177:0/137959860 >> v2:172.21.15.195:3300/0 conn(0x7fa01813cf30 0x7fa01806c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.113+0000 7fa01dc9e640 1 -- 172.21.15.177:0/137959860 >> 172.21.15.177:0/137959860 conn(0x7fa01806a530 msgr2=0x7fa01806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:28.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.113+0000 7fa01dc9e640 1 -- 172.21.15.177:0/137959860 shutdown_connections 2023-11-28T20:09:28.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.113+0000 7fa01dc9e640 1 -- 172.21.15.177:0/137959860 wait complete. 2023-11-28T20:09:28.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa01dc9e640 1 Processor -- start 2023-11-28T20:09:28.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa01dc9e640 1 -- start start 2023-11-28T20:09:28.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa01dc9e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa01806c800 0x7fa018138bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa01dc9e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa01813cf30 0x7fa018135590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa01dc9e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa01815ab70 0x7fa018136fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa01dc9e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa018138730 con 0x7fa01815ab70 2023-11-28T20:09:28.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa01dc9e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa018135ad0 con 0x7fa01813cf30 2023-11-28T20:09:28.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa01dc9e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa018137b20 con 0x7fa01806c800 2023-11-28T20:09:28.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa017fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa01815ab70 0x7fa018136fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa017fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa01815ab70 0x7fa018136fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39746/0 (socket says 172.21.15.177:39746) 2023-11-28T20:09:28.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa017fff640 1 -- 172.21.15.177:0/1904403898 learned_addr learned my addr 172.21.15.177:0/1904403898 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:28.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa0177fe640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa01806c800 0x7fa018138bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa016ffd640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa01813cf30 0x7fa018135590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa017fff640 1 -- 172.21.15.177:0/1904403898 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa01806c800 msgr2=0x7fa018138bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa017fff640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa01806c800 0x7fa018138bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa017fff640 1 -- 172.21.15.177:0/1904403898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa01813cf30 msgr2=0x7fa018135590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa017fff640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa01813cf30 0x7fa018135590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa017fff640 1 -- 172.21.15.177:0/1904403898 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c009420 con 0x7fa01815ab70 2023-11-28T20:09:28.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa016ffd640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa01813cf30 0x7fa018135590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:28.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa0177fe640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa01806c800 0x7fa018138bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:28.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa017fff640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa01815ab70 0x7fa018136fb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa01000c780 tx=0x7fa01000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:28.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7f9ffffff640 1 -- 172.21.15.177:0/1904403898 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01000ce90 con 0x7fa01815ab70 2023-11-28T20:09:28.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7f9ffffff640 1 -- 172.21.15.177:0/1904403898 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01000a640 con 0x7fa01815ab70 2023-11-28T20:09:28.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7f9ffffff640 1 -- 172.21.15.177:0/1904403898 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01000a9d0 con 0x7fa01815ab70 2023-11-28T20:09:28.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa01dc9e640 1 -- 172.21.15.177:0/1904403898 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa018137e00 con 0x7fa01815ab70 2023-11-28T20:09:28.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa01dc9e640 1 -- 172.21.15.177:0/1904403898 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0181383c0 con 0x7fa01815ab70 2023-11-28T20:09:28.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.117+0000 7fa01dc9e640 1 -- 172.21.15.177:0/1904403898 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa018069440 con 0x7fa01815ab70 2023-11-28T20:09:28.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.121+0000 7f9ffffff640 1 -- 172.21.15.177:0/1904403898 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa01000ab30 con 0x7fa01815ab70 2023-11-28T20:09:28.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.121+0000 7f9ffffff640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa004066470 0x7fa004068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.121+0000 7f9ffffff640 1 -- 172.21.15.177:0/1904403898 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fa0100835e0 con 0x7fa01815ab70 2023-11-28T20:09:28.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.121+0000 7fa0177fe640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa004066470 0x7fa004068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.121+0000 7fa0177fe640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa004066470 0x7fa004068930 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa008008890 tx=0x7fa008008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:28.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.125+0000 7f9ffffff640 1 -- 172.21.15.177:0/1904403898 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa010050830 con 0x7fa01815ab70 2023-11-28T20:09:28.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.305+0000 7fa01dc9e640 1 -- 172.21.15.177:0/1904403898 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa018138870 con 0x7fa01815ab70 2023-11-28T20:09:28.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.305+0000 7f9ffffff640 1 -- 172.21.15.177:0/1904403898 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4924 (secure 0 0 0) 0x7fa010018090 con 0x7fa01815ab70 2023-11-28T20:09:28.309 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:28.309 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2829857708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2829857708},{"type":"v1","addr":"172.21.15.177:6836","nonce":2829857708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5101,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/916709103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":916709103},{"type":"v1","addr":"172.21.15.195:6834","nonce":916709103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1987123637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1987123637},{"type":"v1","addr":"172.21.15.195:6835","nonce":1987123637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:08:39.405256+0000","modified":"2023-11-28T20:08:53.633079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/3143070912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":3143070912},{"type":"v1","addr":"172.21.15.177:6837","nonce":3143070912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T20:09:28.309 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 18 2023-11-28T20:09:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.309+0000 7fa01dc9e640 1 -- 172.21.15.177:0/1904403898 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa004066470 msgr2=0x7fa004068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.309+0000 7fa01dc9e640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa004066470 0x7fa004068930 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa008008890 tx=0x7fa008008040 comp rx=0 tx=0).stop 2023-11-28T20:09:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.309+0000 7fa01dc9e640 1 -- 172.21.15.177:0/1904403898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa01815ab70 msgr2=0x7fa018136fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.309+0000 7fa01dc9e640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa01815ab70 0x7fa018136fb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa01000c780 tx=0x7fa01000cc40 comp rx=0 tx=0).stop 2023-11-28T20:09:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.309+0000 7fa01dc9e640 1 -- 172.21.15.177:0/1904403898 shutdown_connections 2023-11-28T20:09:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.309+0000 7fa01dc9e640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa004066470 0x7fa004068930 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.309+0000 7fa01dc9e640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa01815ab70 0x7fa018136fb0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.309+0000 7fa01dc9e640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa01813cf30 0x7fa018135590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.309+0000 7fa01dc9e640 1 --2- 172.21.15.177:0/1904403898 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa01806c800 0x7fa018138bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.309+0000 7fa01dc9e640 1 -- 172.21.15.177:0/1904403898 >> 172.21.15.177:0/1904403898 conn(0x7fa01806a530 msgr2=0x7fa018139210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.309+0000 7fa01dc9e640 1 -- 172.21.15.177:0/1904403898 shutdown_connections 2023-11-28T20:09:28.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.309+0000 7fa01dc9e640 1 -- 172.21.15.177:0/1904403898 wait complete. 2023-11-28T20:09:28.330 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:09:28.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1716a09640 1 Processor -- start 2023-11-28T20:09:28.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1716a09640 1 -- start start 2023-11-28T20:09:28.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1716a09640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17100d0400 0x7f1710161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1716a09640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1710161750 0x7f1710161ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1716a09640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17100c6fc0 con 0x7f17100cf910 2023-11-28T20:09:28.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1716a09640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17100cf060 con 0x7f1710161750 2023-11-28T20:09:28.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1716a09640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17101620e0 con 0x7f17100d0400 2023-11-28T20:09:28.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1715206640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17100d0400 0x7f1710161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1715206640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17100d0400 0x7f1710161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:59950/0 (socket says 172.21.15.177:59950) 2023-11-28T20:09:28.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1715206640 1 -- 172.21.15.177:0/1715689980 learned_addr learned my addr 172.21.15.177:0/1715689980 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:28.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1715a07640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f17100cf910 0x7f17100cfcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:47324/0 (socket says 172.21.15.177:47324) 2023-11-28T20:09:28.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1716208640 1 --2- 172.21.15.177:0/1715689980 >> v2:172.21.15.195:3300/0 conn(0x7f1710161750 0x7f1710161ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1715206640 1 -- 172.21.15.177:0/1715689980 >> v2:172.21.15.195:3300/0 conn(0x7f1710161750 msgr2=0x7f1710161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:28.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1715206640 1 --2- 172.21.15.177:0/1715689980 >> v2:172.21.15.195:3300/0 conn(0x7f1710161750 0x7f1710161ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1715206640 1 -- 172.21.15.177:0/1715689980 >> v1:172.21.15.195:6789/0 conn(0x7f17100cf910 legacy=0x7f17100cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.469+0000 7f1715206640 1 -- 172.21.15.177:0/1715689980 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17100ceaa0 con 0x7f17100d0400 2023-11-28T20:09:28.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.473+0000 7f1715206640 1 --2- 172.21.15.177:0/1715689980 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17100d0400 0x7f1710161210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1700009870 tx=0x7f170001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=569bafa333e2cf33 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:28.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.473+0000 7f1714a05640 1 -- 172.21.15.177:0/1715689980 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000ab680 con 0x7f17100d0400 2023-11-28T20:09:28.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.473+0000 7f1714a05640 1 -- 172.21.15.177:0/1715689980 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17000ab7e0 con 0x7f17100d0400 2023-11-28T20:09:28.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.473+0000 7f1714a05640 1 -- 172.21.15.177:0/1715689980 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000abb70 con 0x7f17100d0400 2023-11-28T20:09:28.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.473+0000 7f1716a09640 1 -- 172.21.15.177:0/1715689980 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17100d0400 msgr2=0x7f1710161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.473+0000 7f1716a09640 1 --2- 172.21.15.177:0/1715689980 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17100d0400 0x7f1710161210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1700009870 tx=0x7f170001c480 comp rx=0 tx=0).stop 2023-11-28T20:09:28.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.473+0000 7f1716a09640 1 -- 172.21.15.177:0/1715689980 shutdown_connections 2023-11-28T20:09:28.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.473+0000 7f1716a09640 1 --2- 172.21.15.177:0/1715689980 >> v2:172.21.15.195:3300/0 conn(0x7f1710161750 0x7f1710161ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.473+0000 7f1716a09640 1 --2- 172.21.15.177:0/1715689980 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17100d0400 0x7f1710161210 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.473+0000 7f1716a09640 1 -- 172.21.15.177:0/1715689980 >> 172.21.15.177:0/1715689980 conn(0x7f17100d2f60 msgr2=0x7f17100d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:28.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.473+0000 7f1716a09640 1 -- 172.21.15.177:0/1715689980 shutdown_connections 2023-11-28T20:09:28.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.473+0000 7f1716a09640 1 -- 172.21.15.177:0/1715689980 wait complete. 2023-11-28T20:09:28.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1716a09640 1 Processor -- start 2023-11-28T20:09:28.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1716a09640 1 -- start start 2023-11-28T20:09:28.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1716a09640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17100cf910 0x7f17100cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1716a09640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17100d0400 0x7f171015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1716a09640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1710161750 0x7f171015e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1716a09640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17100cc9b0 con 0x7f17100d0400 2023-11-28T20:09:28.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1716a09640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17100cabc0 con 0x7f1710161750 2023-11-28T20:09:28.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1716a09640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17100caea0 con 0x7f17100cf910 2023-11-28T20:09:28.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1715206640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17100d0400 0x7f171015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1715206640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17100d0400 0x7f171015dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:39762/0 (socket says 172.21.15.177:39762) 2023-11-28T20:09:28.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1715206640 1 -- 172.21.15.177:0/744454213 learned_addr learned my addr 172.21.15.177:0/744454213 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:28.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1715a07640 1 --2- 172.21.15.177:0/744454213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17100cf910 0x7f17100cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1716208640 1 --2- 172.21.15.177:0/744454213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1710161750 0x7f171015e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1715206640 1 -- 172.21.15.177:0/744454213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17100cf910 msgr2=0x7f17100cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1715206640 1 --2- 172.21.15.177:0/744454213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17100cf910 0x7f17100cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1715206640 1 -- 172.21.15.177:0/744454213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1710161750 msgr2=0x7f171015e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1715206640 1 --2- 172.21.15.177:0/744454213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1710161750 0x7f171015e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1715206640 1 -- 172.21.15.177:0/744454213 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17000094d0 con 0x7f17100d0400 2023-11-28T20:09:28.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1715206640 1 --2- 172.21.15.177:0/744454213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17100d0400 0x7f171015dca0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f17000ad040 tx=0x7f170001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:28.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f17067fc640 1 -- 172.21.15.177:0/744454213 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000b4800 con 0x7f17100d0400 2023-11-28T20:09:28.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f17067fc640 1 -- 172.21.15.177:0/744454213 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17000b4960 con 0x7f17100d0400 2023-11-28T20:09:28.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f17067fc640 1 -- 172.21.15.177:0/744454213 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000b4d10 con 0x7f17100d0400 2023-11-28T20:09:28.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1716a09640 1 -- 172.21.15.177:0/744454213 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17100cb180 con 0x7f17100d0400 2023-11-28T20:09:28.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1716a09640 1 -- 172.21.15.177:0/744454213 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17100cb740 con 0x7f17100d0400 2023-11-28T20:09:28.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.477+0000 7f1716a09640 1 -- 172.21.15.177:0/744454213 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17100cb930 con 0x7f17100d0400 2023-11-28T20:09:28.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.481+0000 7f17067fc640 1 -- 172.21.15.177:0/744454213 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f17000b3380 con 0x7f17100d0400 2023-11-28T20:09:28.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.481+0000 7f17067fc640 1 --2- 172.21.15.177:0/744454213 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f16f4066470 0x7f16f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.481+0000 7f17067fc640 1 -- 172.21.15.177:0/744454213 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f170011e9e0 con 0x7f17100d0400 2023-11-28T20:09:28.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.481+0000 7f1715a07640 1 --2- 172.21.15.177:0/744454213 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f16f4066470 0x7f16f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.481+0000 7f1715a07640 1 --2- 172.21.15.177:0/744454213 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f16f4066470 0x7f16f4068930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f170c000f70 tx=0x7f170c007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:28.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.485+0000 7f17067fc640 1 -- 172.21.15.177:0/744454213 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17000ebce0 con 0x7f17100d0400 2023-11-28T20:09:28.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.665+0000 7f1716a09640 1 -- 172.21.15.177:0/744454213 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17100cafe0 con 0x7f17100d0400 2023-11-28T20:09:28.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.665+0000 7f17067fc640 1 -- 172.21.15.177:0/744454213 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4924 (secure 0 0 0) 0x7f17100cafe0 con 0x7f17100d0400 2023-11-28T20:09:28.670 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:28.670 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2829857708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2829857708},{"type":"v1","addr":"172.21.15.177:6836","nonce":2829857708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5101,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/916709103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":916709103},{"type":"v1","addr":"172.21.15.195:6834","nonce":916709103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1987123637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1987123637},{"type":"v1","addr":"172.21.15.195:6835","nonce":1987123637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:08:39.405256+0000","modified":"2023-11-28T20:08:53.633079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/3143070912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":3143070912},{"type":"v1","addr":"172.21.15.177:6837","nonce":3143070912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T20:09:28.670 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 18 2023-11-28T20:09:28.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.669+0000 7f1716a09640 1 -- 172.21.15.177:0/744454213 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f16f4066470 msgr2=0x7f16f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.669+0000 7f1716a09640 1 --2- 172.21.15.177:0/744454213 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f16f4066470 0x7f16f4068930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f170c000f70 tx=0x7f170c007e90 comp rx=0 tx=0).stop 2023-11-28T20:09:28.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.669+0000 7f1716a09640 1 -- 172.21.15.177:0/744454213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17100d0400 msgr2=0x7f171015dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.669+0000 7f1716a09640 1 --2- 172.21.15.177:0/744454213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17100d0400 0x7f171015dca0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f17000ad040 tx=0x7f170001acc0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.669+0000 7f1716a09640 1 -- 172.21.15.177:0/744454213 shutdown_connections 2023-11-28T20:09:28.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.669+0000 7f1716a09640 1 --2- 172.21.15.177:0/744454213 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f16f4066470 0x7f16f4068930 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.669+0000 7f1716a09640 1 --2- 172.21.15.177:0/744454213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1710161750 0x7f171015e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.669+0000 7f1716a09640 1 --2- 172.21.15.177:0/744454213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17100d0400 0x7f171015dca0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.669+0000 7f1716a09640 1 --2- 172.21.15.177:0/744454213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17100cf910 0x7f17100cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.669+0000 7f1716a09640 1 -- 172.21.15.177:0/744454213 >> 172.21.15.177:0/744454213 conn(0x7f17100d2f60 msgr2=0x7f171015d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:28.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.669+0000 7f1716a09640 1 -- 172.21.15.177:0/744454213 shutdown_connections 2023-11-28T20:09:28.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.669+0000 7f1716a09640 1 -- 172.21.15.177:0/744454213 wait complete. 2023-11-28T20:09:28.691 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:09:28.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829912a640 1 Processor -- start 2023-11-28T20:09:28.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829912a640 1 -- start start 2023-11-28T20:09:28.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829912a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8294070b70 0x7f8294165fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829912a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82940710e0 con 0x7f829406c9d0 2023-11-28T20:09:28.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829912a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82940713c0 con 0x7f8294144840 2023-11-28T20:09:28.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829912a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829415f010 con 0x7f8294070b70 2023-11-28T20:09:28.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829259c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f829406c9d0 0x7f8294070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51020/0 (socket says 172.21.15.177:51020) 2023-11-28T20:09:28.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829259c640 1 -- 172.21.15.177:0/3661377764 learned_addr learned my addr 172.21.15.177:0/3661377764 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:28.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8291d9b640 1 -- 172.21.15.177:0/3661377764 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664715633 0 0) 0x7f82940710e0 con 0x7f829406c9d0 2023-11-28T20:09:28.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8291d9b640 1 -- 172.21.15.177:0/3661377764 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f827c003530 con 0x7f829406c9d0 2023-11-28T20:09:28.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829359e640 1 --2- 172.21.15.177:0/3661377764 >> v2:172.21.15.195:3300/0 conn(0x7f8294070b70 0x7f8294165fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8291d9b640 1 -- 172.21.15.177:0/3661377764 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 203471532 0 0) 0x7f827c003530 con 0x7f829406c9d0 2023-11-28T20:09:28.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8291d9b640 1 -- 172.21.15.177:0/3661377764 >> v2:172.21.15.195:3300/0 conn(0x7f8294070b70 msgr2=0x7f8294165fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:28.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8291d9b640 1 --2- 172.21.15.177:0/3661377764 >> v2:172.21.15.195:3300/0 conn(0x7f8294070b70 0x7f8294165fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8291d9b640 1 -- 172.21.15.177:0/3661377764 >> v1:172.21.15.195:6789/0 conn(0x7f8294144840 legacy=0x7f829406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8291d9b640 1 -- 172.21.15.177:0/3661377764 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940716a0 con 0x7f829406c9d0 2023-11-28T20:09:28.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8291d9b640 1 -- 172.21.15.177:0/3661377764 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f8288001680 con 0x7f829406c9d0 2023-11-28T20:09:28.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8291d9b640 1 -- 172.21.15.177:0/3661377764 >> v1:172.21.15.177:6789/0 conn(0x7f829406c9d0 legacy=0x7f8294070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8291d9b640 1 --2- 172.21.15.177:0/3661377764 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f827c0039d0 0x7f827c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8291d9b640 1 --2- 172.21.15.177:0/3661377764 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f827c0047d0 0x7f827c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8291d9b640 1 --2- 172.21.15.177:0/3661377764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f827c005190 0x7f827c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8291d9b640 1 -- 172.21.15.177:0/3661377764 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c00c060 con 0x7f827c005190 2023-11-28T20:09:28.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8291d9b640 1 -- 172.21.15.177:0/3661377764 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c00c1d0 con 0x7f827c0047d0 2023-11-28T20:09:28.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8291d9b640 1 -- 172.21.15.177:0/3661377764 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827c00c390 con 0x7f827c0039d0 2023-11-28T20:09:28.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829359e640 1 --2- 172.21.15.177:0/3661377764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f827c005190 0x7f827c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829259c640 1 --2- 172.21.15.177:0/3661377764 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f827c0047d0 0x7f827c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f8292d9d640 1 --2- 172.21.15.177:0/3661377764 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f827c0039d0 0x7f827c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829359e640 1 -- 172.21.15.177:0/3661377764 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f827c0039d0 msgr2=0x7f827c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:28.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829359e640 1 --2- 172.21.15.177:0/3661377764 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f827c0039d0 0x7f827c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829359e640 1 -- 172.21.15.177:0/3661377764 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f827c0047d0 msgr2=0x7f827c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:28.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829359e640 1 --2- 172.21.15.177:0/3661377764 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f827c0047d0 0x7f827c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829359e640 1 -- 172.21.15.177:0/3661377764 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c003530 con 0x7f827c005190 2023-11-28T20:09:28.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.825+0000 7f829259c640 1 --2- 172.21.15.177:0/3661377764 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f827c0047d0 0x7f827c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:28.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.829+0000 7f829359e640 1 -- 172.21.15.177:0/3661377764 reap_dead start 2023-11-28T20:09:28.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.829+0000 7f829359e640 1 --2- 172.21.15.177:0/3661377764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f827c005190 0x7f827c00b990 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f828c009fc0 tx=0x7f828c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89969b3056f4c48c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:28.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.829+0000 7f8291d9b640 1 -- 172.21.15.177:0/3661377764 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0a5cb0 con 0x7f827c005190 2023-11-28T20:09:28.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.829+0000 7f8291d9b640 1 -- 172.21.15.177:0/3661377764 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c00f040 con 0x7f827c005190 2023-11-28T20:09:28.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.829+0000 7f8291d9b640 1 -- 172.21.15.177:0/3661377764 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c003be0 con 0x7f827c005190 2023-11-28T20:09:28.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.829+0000 7f829912a640 1 -- 172.21.15.177:0/3661377764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f827c005190 msgr2=0x7f827c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.829+0000 7f829912a640 1 --2- 172.21.15.177:0/3661377764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f827c005190 0x7f827c00b990 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f828c009fc0 tx=0x7f828c01cca0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.829+0000 7f829912a640 1 -- 172.21.15.177:0/3661377764 shutdown_connections 2023-11-28T20:09:28.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.829+0000 7f829912a640 1 --2- 172.21.15.177:0/3661377764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f827c005190 0x7f827c00b990 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.829+0000 7f829912a640 1 -- 172.21.15.177:0/3661377764 >> 172.21.15.177:0/3661377764 conn(0x7f829406a530 msgr2=0x7f829406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:28.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.829+0000 7f829912a640 1 -- 172.21.15.177:0/3661377764 shutdown_connections 2023-11-28T20:09:28.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.829+0000 7f829912a640 1 -- 172.21.15.177:0/3661377764 wait complete. 2023-11-28T20:09:28.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829912a640 1 Processor -- start 2023-11-28T20:09:28.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829912a640 1 -- start start 2023-11-28T20:09:28.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829912a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f827c005190 0x7f829413e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829912a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82940b20c0 0x7f829413bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829912a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82940c9a30 0x7f82940c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829912a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82940b33d0 con 0x7f82940c9a30 2023-11-28T20:09:28.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829912a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82940b2520 con 0x7f82940b20c0 2023-11-28T20:09:28.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829912a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82940ca3f0 con 0x7f827c005190 2023-11-28T20:09:28.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82940c9a30 0x7f82940c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82940c9a30 0x7f82940c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55258/0 (socket says 172.21.15.177:55258) 2023-11-28T20:09:28.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829359e640 1 -- 172.21.15.177:0/3722215779 learned_addr learned my addr 172.21.15.177:0/3722215779 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:28.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f8292d9d640 1 --2- 172.21.15.177:0/3722215779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f827c005190 0x7f829413e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829259c640 1 --2- 172.21.15.177:0/3722215779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82940b20c0 0x7f829413bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829359e640 1 -- 172.21.15.177:0/3722215779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f827c005190 msgr2=0x7f829413e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829359e640 1 --2- 172.21.15.177:0/3722215779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f827c005190 0x7f829413e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829359e640 1 -- 172.21.15.177:0/3722215779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82940b20c0 msgr2=0x7f829413bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829359e640 1 --2- 172.21.15.177:0/3722215779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82940b20c0 0x7f829413bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829359e640 1 -- 172.21.15.177:0/3722215779 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829413dc40 con 0x7f82940c9a30 2023-11-28T20:09:28.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829359e640 1 --2- 172.21.15.177:0/3722215779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82940c9a30 0x7f82940c9eb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f828c0987d0 tx=0x7f828c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:28.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f827b7fe640 1 -- 172.21.15.177:0/3722215779 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0aed40 con 0x7f82940c9a30 2023-11-28T20:09:28.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f827b7fe640 1 -- 172.21.15.177:0/3722215779 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c0aeec0 con 0x7f82940c9a30 2023-11-28T20:09:28.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f829912a640 1 -- 172.21.15.177:0/3722215779 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82940b2750 con 0x7f82940c9a30 2023-11-28T20:09:28.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.833+0000 7f827b7fe640 1 -- 172.21.15.177:0/3722215779 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c003be0 con 0x7f82940c9a30 2023-11-28T20:09:28.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.837+0000 7f829912a640 1 -- 172.21.15.177:0/3722215779 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82940b2d10 con 0x7f82940c9a30 2023-11-28T20:09:28.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.837+0000 7f829912a640 1 -- 172.21.15.177:0/3722215779 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82940b3510 con 0x7f82940c9a30 2023-11-28T20:09:28.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.837+0000 7f827b7fe640 1 -- 172.21.15.177:0/3722215779 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f828c003d40 con 0x7f82940c9a30 2023-11-28T20:09:28.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.837+0000 7f827b7fe640 1 --2- 172.21.15.177:0/3722215779 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f82800664a0 0x7f8280068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:28.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.837+0000 7f827b7fe640 1 -- 172.21.15.177:0/3722215779 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f828c0a6e40 con 0x7f82940c9a30 2023-11-28T20:09:28.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.837+0000 7f8292d9d640 1 --2- 172.21.15.177:0/3722215779 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f82800664a0 0x7f8280068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:28.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.837+0000 7f8292d9d640 1 --2- 172.21.15.177:0/3722215779 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f82800664a0 0x7f8280068960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8284000c10 tx=0x7f8284009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:28.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.841+0000 7f827b7fe640 1 -- 172.21.15.177:0/3722215779 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f82940b3510 con 0x7f82940c9a30 2023-11-28T20:09:28.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.989+0000 7f829912a640 1 -- 172.21.15.177:0/3722215779 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82940b3510 con 0x7f82940c9a30 2023-11-28T20:09:28.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.993+0000 7f827b7fe640 1 -- 172.21.15.177:0/3722215779 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18408 (secure 0 0 0) 0x7f82940b3510 con 0x7f82940c9a30 2023-11-28T20:09:28.996 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:28.996 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":36,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:08:55.264752+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:08:37.943771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T20:08:38.396895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2023-11-28T20:08:52.500186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:09:28.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.993+0000 7f829912a640 1 -- 172.21.15.177:0/3722215779 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f82800664a0 msgr2=0x7f8280068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.993+0000 7f829912a640 1 --2- 172.21.15.177:0/3722215779 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f82800664a0 0x7f8280068960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8284000c10 tx=0x7f8284009040 comp rx=0 tx=0).stop 2023-11-28T20:09:28.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.993+0000 7f829912a640 1 -- 172.21.15.177:0/3722215779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82940c9a30 msgr2=0x7f82940c9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:28.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.993+0000 7f829912a640 1 --2- 172.21.15.177:0/3722215779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82940c9a30 0x7f82940c9eb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f828c0987d0 tx=0x7f828c009750 comp rx=0 tx=0).stop 2023-11-28T20:09:28.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.993+0000 7f829912a640 1 -- 172.21.15.177:0/3722215779 shutdown_connections 2023-11-28T20:09:28.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.993+0000 7f829912a640 1 --2- 172.21.15.177:0/3722215779 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f82800664a0 0x7f8280068960 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.993+0000 7f829912a640 1 --2- 172.21.15.177:0/3722215779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82940c9a30 0x7f82940c9eb0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.993+0000 7f829912a640 1 --2- 172.21.15.177:0/3722215779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82940b20c0 0x7f829413bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.993+0000 7f829912a640 1 --2- 172.21.15.177:0/3722215779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f827c005190 0x7f829413e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:28.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.993+0000 7f829912a640 1 -- 172.21.15.177:0/3722215779 >> 172.21.15.177:0/3722215779 conn(0x7f829406a530 msgr2=0x7f8294070460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:28.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.993+0000 7f829912a640 1 -- 172.21.15.177:0/3722215779 shutdown_connections 2023-11-28T20:09:28.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:28.993+0000 7f829912a640 1 -- 172.21.15.177:0/3722215779 wait complete. 2023-11-28T20:09:29.017 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T20:09:29.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.153+0000 7f273e1c4640 1 Processor -- start 2023-11-28T20:09:29.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.153+0000 7f273e1c4640 1 -- start start 2023-11-28T20:09:29.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.153+0000 7f273e1c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f273815d200 0x7f27380d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:29.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.153+0000 7f273e1c4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f27380d1160 0x7f27380cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:29.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.153+0000 7f273e1c4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27380b29f0 con 0x7f27380d15a0 2023-11-28T20:09:29.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.153+0000 7f273e1c4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27380d1b00 con 0x7f27380d1160 2023-11-28T20:09:29.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.153+0000 7f273e1c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27380d1de0 con 0x7f273815d200 2023-11-28T20:09:29.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.153+0000 7f2736ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f27380d1160 0x7f27380cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:29.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.153+0000 7f2736ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f27380d1160 0x7f27380cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55272/0 (socket says 172.21.15.177:55272) 2023-11-28T20:09:29.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.153+0000 7f2736ffd640 1 -- 172.21.15.177:0/1631012545 learned_addr learned my addr 172.21.15.177:0/1631012545 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:29.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.153+0000 7f27377fe640 1 --2- 172.21.15.177:0/1631012545 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f273815d200 0x7f27380d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:29.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.153+0000 7f2736ffd640 1 -- 172.21.15.177:0/1631012545 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f273815d200 msgr2=0x7f27380d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:29.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.153+0000 7f2736ffd640 1 --2- 172.21.15.177:0/1631012545 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f273815d200 0x7f27380d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:29.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.153+0000 7f2736ffd640 1 -- 172.21.15.177:0/1631012545 >> v1:172.21.15.195:6789/0 conn(0x7f27380d15a0 legacy=0x7f273806b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:29.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.153+0000 7f2736ffd640 1 -- 172.21.15.177:0/1631012545 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27380d20c0 con 0x7f27380d1160 2023-11-28T20:09:29.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.157+0000 7f2736ffd640 1 --2- 172.21.15.177:0/1631012545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27380d1160 0x7f27380cddf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f272c009870 tx=0x7f272c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de683c7021127ea5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:29.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.157+0000 7f27367fc640 1 -- 172.21.15.177:0/1631012545 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c0a8a30 con 0x7f27380d1160 2023-11-28T20:09:29.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.157+0000 7f27367fc640 1 -- 172.21.15.177:0/1631012545 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c0a8b90 con 0x7f27380d1160 2023-11-28T20:09:29.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.157+0000 7f27367fc640 1 -- 172.21.15.177:0/1631012545 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c0b0440 con 0x7f27380d1160 2023-11-28T20:09:29.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.157+0000 7f273e1c4640 1 -- 172.21.15.177:0/1631012545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27380d1160 msgr2=0x7f27380cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:29.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.157+0000 7f273e1c4640 1 --2- 172.21.15.177:0/1631012545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27380d1160 0x7f27380cddf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f272c009870 tx=0x7f272c01ed30 comp rx=0 tx=0).stop 2023-11-28T20:09:29.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.157+0000 7f273e1c4640 1 -- 172.21.15.177:0/1631012545 shutdown_connections 2023-11-28T20:09:29.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.157+0000 7f273e1c4640 1 --2- 172.21.15.177:0/1631012545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27380d1160 0x7f27380cddf0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:29.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.157+0000 7f273e1c4640 1 --2- 172.21.15.177:0/1631012545 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f273815d200 0x7f27380d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:29.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.157+0000 7f273e1c4640 1 -- 172.21.15.177:0/1631012545 >> 172.21.15.177:0/1631012545 conn(0x7f2738072260 msgr2=0x7f27380cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:29.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.157+0000 7f273e1c4640 1 -- 172.21.15.177:0/1631012545 shutdown_connections 2023-11-28T20:09:29.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.157+0000 7f273e1c4640 1 -- 172.21.15.177:0/1631012545 wait complete. 2023-11-28T20:09:29.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f273e1c4640 1 Processor -- start 2023-11-28T20:09:29.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f273e1c4640 1 -- start start 2023-11-28T20:09:29.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f273e1c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27380d1160 0x7f27380c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:29.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f273e1c4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27380d15a0 0x7f273815fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:29.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f273e1c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f273815d200 0x7f27380b8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:29.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f273e1c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27380c7980 con 0x7f273815d200 2023-11-28T20:09:29.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f273e1c4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27380c6d70 con 0x7f27380d15a0 2023-11-28T20:09:29.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f273e1c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27380c7050 con 0x7f27380d1160 2023-11-28T20:09:29.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f2737fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f273815d200 0x7f27380b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:29.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f2737fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f273815d200 0x7f27380b8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55276/0 (socket says 172.21.15.177:55276) 2023-11-28T20:09:29.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f2737fff640 1 -- 172.21.15.177:0/2271297866 learned_addr learned my addr 172.21.15.177:0/2271297866 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:29.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f2736ffd640 1 --2- 172.21.15.177:0/2271297866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27380d15a0 0x7f273815fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:29.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f27377fe640 1 --2- 172.21.15.177:0/2271297866 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27380d1160 0x7f27380c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:29.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f2737fff640 1 -- 172.21.15.177:0/2271297866 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27380d1160 msgr2=0x7f27380c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:29.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f2737fff640 1 --2- 172.21.15.177:0/2271297866 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27380d1160 0x7f27380c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:29.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f2737fff640 1 -- 172.21.15.177:0/2271297866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27380d15a0 msgr2=0x7f273815fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:29.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f2737fff640 1 --2- 172.21.15.177:0/2271297866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27380d15a0 0x7f273815fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:29.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f2737fff640 1 -- 172.21.15.177:0/2271297866 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c0094d0 con 0x7f273815d200 2023-11-28T20:09:29.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f2737fff640 1 --2- 172.21.15.177:0/2271297866 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f273815d200 0x7f27380b8040 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f273000c7a0 tx=0x7f273000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:29.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f271ffff640 1 -- 172.21.15.177:0/2271297866 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2730003b80 con 0x7f273815d200 2023-11-28T20:09:29.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f271ffff640 1 -- 172.21.15.177:0/2271297866 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2730003ce0 con 0x7f273815d200 2023-11-28T20:09:29.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f271ffff640 1 -- 172.21.15.177:0/2271297866 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273000aa30 con 0x7f273815d200 2023-11-28T20:09:29.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f273e1c4640 1 -- 172.21.15.177:0/2271297866 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27380c7330 con 0x7f273815d200 2023-11-28T20:09:29.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.161+0000 7f273e1c4640 1 -- 172.21.15.177:0/2271297866 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273815ffa0 con 0x7f273815d200 2023-11-28T20:09:29.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.165+0000 7f273e1c4640 1 -- 172.21.15.177:0/2271297866 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27380c7af0 con 0x7f273815d200 2023-11-28T20:09:29.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.165+0000 7f271ffff640 1 -- 172.21.15.177:0/2271297866 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f273000ab90 con 0x7f273815d200 2023-11-28T20:09:29.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.165+0000 7f271ffff640 1 --2- 172.21.15.177:0/2271297866 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2724066470 0x7f2724068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:29.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.165+0000 7f271ffff640 1 -- 172.21.15.177:0/2271297866 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f2730083cf0 con 0x7f273815d200 2023-11-28T20:09:29.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.165+0000 7f27377fe640 1 --2- 172.21.15.177:0/2271297866 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2724066470 0x7f2724068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:29.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.165+0000 7f27377fe640 1 --2- 172.21.15.177:0/2271297866 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2724066470 0x7f2724068930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2728009ac0 tx=0x7f2728009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:29.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.169+0000 7f271ffff640 1 -- 172.21.15.177:0/2271297866 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2730051080 con 0x7f273815d200 2023-11-28T20:09:29.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.349+0000 7f273e1c4640 1 -- 172.21.15.177:0/2271297866 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2738069440 con 0x7f273815d200 2023-11-28T20:09:29.354 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-11-28T20:09:29.353+0000 7f79a8741640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T20:09:29.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.353+0000 7f271ffff640 1 -- 172.21.15.177:0/2271297866 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f27300546a0 con 0x7f273815d200 2023-11-28T20:09:29.357 INFO:teuthology.orchestra.run.smithi177.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T20:09:29.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.357+0000 7f273e1c4640 1 -- 172.21.15.177:0/2271297866 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2724066470 msgr2=0x7f2724068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:29.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.357+0000 7f273e1c4640 1 --2- 172.21.15.177:0/2271297866 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2724066470 0x7f2724068930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2728009ac0 tx=0x7f2728009190 comp rx=0 tx=0).stop 2023-11-28T20:09:29.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.357+0000 7f273e1c4640 1 -- 172.21.15.177:0/2271297866 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f273815d200 msgr2=0x7f27380b8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:29.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.357+0000 7f273e1c4640 1 --2- 172.21.15.177:0/2271297866 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f273815d200 0x7f27380b8040 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f273000c7a0 tx=0x7f273000cc60 comp rx=0 tx=0).stop 2023-11-28T20:09:29.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.357+0000 7f273e1c4640 1 -- 172.21.15.177:0/2271297866 shutdown_connections 2023-11-28T20:09:29.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.357+0000 7f273e1c4640 1 --2- 172.21.15.177:0/2271297866 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2724066470 0x7f2724068930 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:29.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.357+0000 7f273e1c4640 1 --2- 172.21.15.177:0/2271297866 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f273815d200 0x7f27380b8040 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:29.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.357+0000 7f273e1c4640 1 --2- 172.21.15.177:0/2271297866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27380d15a0 0x7f273815fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:29.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.357+0000 7f273e1c4640 1 --2- 172.21.15.177:0/2271297866 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27380d1160 0x7f27380c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:29.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.357+0000 7f273e1c4640 1 -- 172.21.15.177:0/2271297866 >> 172.21.15.177:0/2271297866 conn(0x7f2738072260 msgr2=0x7f27380b6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:29.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.357+0000 7f273e1c4640 1 -- 172.21.15.177:0/2271297866 shutdown_connections 2023-11-28T20:09:29.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.357+0000 7f273e1c4640 1 -- 172.21.15.177:0/2271297866 wait complete. 2023-11-28T20:09:29.368 INFO:tasks.ceph.mds.a.smithi177.stderr: -3538> 2023-11-28T20:08:44.846+0000 7fa6e40ab640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:09:29.381 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T20:09:29.418 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-11-28T20:09:29.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.525+0000 7f0a25e09640 1 Processor -- start 2023-11-28T20:09:29.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.525+0000 7f0a25e09640 1 -- start start 2023-11-28T20:09:29.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.525+0000 7f0a25e09640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a20158ca0 0x7f0a2015eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:29.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.525+0000 7f0a25e09640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0a200b42d0 0x7f0a200b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:29.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.525+0000 7f0a25e09640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a200b4c40 con 0x7f0a200cba10 2023-11-28T20:09:29.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.525+0000 7f0a25e09640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2015b670 con 0x7f0a200b42d0 2023-11-28T20:09:29.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.525+0000 7f0a25e09640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2015c510 con 0x7f0a20158ca0 2023-11-28T20:09:29.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.525+0000 7f0a1f7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a20158ca0 0x7f0a2015eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:29.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.525+0000 7f0a1f7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a20158ca0 0x7f0a2015eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:32830/0 (socket says 172.21.15.177:32830) 2023-11-28T20:09:29.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.525+0000 7f0a1f7fe640 1 -- 172.21.15.177:0/1192825614 learned_addr learned my addr 172.21.15.177:0/1192825614 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:29.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.525+0000 7f0a1ffff640 1 --2- 172.21.15.177:0/1192825614 >> v2:172.21.15.195:3300/0 conn(0x7f0a200b42d0 0x7f0a200b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:29.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.525+0000 7f0a1f7fe640 1 -- 172.21.15.177:0/1192825614 >> v2:172.21.15.195:3300/0 conn(0x7f0a200b42d0 msgr2=0x7f0a200b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:29.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.525+0000 7f0a1f7fe640 1 --2- 172.21.15.177:0/1192825614 >> v2:172.21.15.195:3300/0 conn(0x7f0a200b42d0 0x7f0a200b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:29.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.525+0000 7f0a1f7fe640 1 -- 172.21.15.177:0/1192825614 >> v1:172.21.15.195:6789/0 conn(0x7f0a200cba10 legacy=0x7f0a2015be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:29.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.525+0000 7f0a1f7fe640 1 -- 172.21.15.177:0/1192825614 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2015f410 con 0x7f0a20158ca0 2023-11-28T20:09:29.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.529+0000 7f0a1f7fe640 1 --2- 172.21.15.177:0/1192825614 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a20158ca0 0x7f0a2015eb50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009870 tx=0x7f0a1001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=406fd15bd876e7f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:29.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.529+0000 7f0a1e7fc640 1 -- 172.21.15.177:0/1192825614 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100aa670 con 0x7f0a20158ca0 2023-11-28T20:09:29.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.529+0000 7f0a1e7fc640 1 -- 172.21.15.177:0/1192825614 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a100aa7d0 con 0x7f0a20158ca0 2023-11-28T20:09:29.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.529+0000 7f0a1e7fc640 1 -- 172.21.15.177:0/1192825614 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100aab60 con 0x7f0a20158ca0 2023-11-28T20:09:29.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.529+0000 7f0a25e09640 1 -- 172.21.15.177:0/1192825614 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a20158ca0 msgr2=0x7f0a2015eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:29.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.529+0000 7f0a25e09640 1 --2- 172.21.15.177:0/1192825614 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a20158ca0 0x7f0a2015eb50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009870 tx=0x7f0a1001c510 comp rx=0 tx=0).stop 2023-11-28T20:09:29.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a25e09640 1 -- 172.21.15.177:0/1192825614 shutdown_connections 2023-11-28T20:09:29.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a25e09640 1 --2- 172.21.15.177:0/1192825614 >> v2:172.21.15.195:3300/0 conn(0x7f0a200b42d0 0x7f0a200b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:29.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a25e09640 1 --2- 172.21.15.177:0/1192825614 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a20158ca0 0x7f0a2015eb50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:29.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a25e09640 1 -- 172.21.15.177:0/1192825614 >> 172.21.15.177:0/1192825614 conn(0x7f0a200b0cc0 msgr2=0x7f0a200b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:29.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a25e09640 1 -- 172.21.15.177:0/1192825614 shutdown_connections 2023-11-28T20:09:29.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a25e09640 1 -- 172.21.15.177:0/1192825614 wait complete. 2023-11-28T20:09:29.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a25e09640 1 Processor -- start 2023-11-28T20:09:29.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a25e09640 1 -- start start 2023-11-28T20:09:29.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a25e09640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a200b42d0 0x7f0a201406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:29.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a25e09640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a200cba10 0x7f0a2013d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:29.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a25e09640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a20158ca0 0x7f0a200cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:29.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a25e09640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a20140c00 con 0x7f0a200cba10 2023-11-28T20:09:29.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a25e09640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a20157260 con 0x7f0a20158ca0 2023-11-28T20:09:29.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a25e09640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a20157540 con 0x7f0a200b42d0 2023-11-28T20:09:29.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a1effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a200cba10 0x7f0a2013d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:29.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a1effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a200cba10 0x7f0a2013d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55304/0 (socket says 172.21.15.177:55304) 2023-11-28T20:09:29.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a1effd640 1 -- 172.21.15.177:0/2265334339 learned_addr learned my addr 172.21.15.177:0/2265334339 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:29.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a1f7fe640 1 --2- 172.21.15.177:0/2265334339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a200b42d0 0x7f0a201406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:29.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a1ffff640 1 --2- 172.21.15.177:0/2265334339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a20158ca0 0x7f0a200cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:29.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a1effd640 1 -- 172.21.15.177:0/2265334339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a200b42d0 msgr2=0x7f0a201406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:29.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a1effd640 1 --2- 172.21.15.177:0/2265334339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a200b42d0 0x7f0a201406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:29.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a1effd640 1 -- 172.21.15.177:0/2265334339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a20158ca0 msgr2=0x7f0a200cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:29.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a1effd640 1 --2- 172.21.15.177:0/2265334339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a20158ca0 0x7f0a200cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:29.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a1effd640 1 -- 172.21.15.177:0/2265334339 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a100094d0 con 0x7f0a200cba10 2023-11-28T20:09:29.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.533+0000 7f0a1effd640 1 --2- 172.21.15.177:0/2265334339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a200cba10 0x7f0a2013d380 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400c370 tx=0x7f0a1400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:29.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.537+0000 7f0a07fff640 1 -- 172.21.15.177:0/2265334339 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a140052d0 con 0x7f0a200cba10 2023-11-28T20:09:29.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.537+0000 7f0a07fff640 1 -- 172.21.15.177:0/2265334339 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a14005430 con 0x7f0a200cba10 2023-11-28T20:09:29.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.537+0000 7f0a07fff640 1 -- 172.21.15.177:0/2265334339 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14003820 con 0x7f0a200cba10 2023-11-28T20:09:29.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.537+0000 7f0a25e09640 1 -- 172.21.15.177:0/2265334339 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a20157820 con 0x7f0a200cba10 2023-11-28T20:09:29.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.537+0000 7f0a25e09640 1 -- 172.21.15.177:0/2265334339 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a20157de0 con 0x7f0a200cba10 2023-11-28T20:09:29.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.537+0000 7f0a25e09640 1 -- 172.21.15.177:0/2265334339 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a20158000 con 0x7f0a200cba10 2023-11-28T20:09:29.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.537+0000 7f0a07fff640 1 -- 172.21.15.177:0/2265334339 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0a14003980 con 0x7f0a200cba10 2023-11-28T20:09:29.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.537+0000 7f0a07fff640 1 --2- 172.21.15.177:0/2265334339 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0a0c066470 0x7f0a0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:29.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.541+0000 7f0a07fff640 1 -- 172.21.15.177:0/2265334339 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6190+0+0 (secure 0 0 0) 0x7f0a14083570 con 0x7f0a200cba10 2023-11-28T20:09:29.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.541+0000 7f0a1f7fe640 1 --2- 172.21.15.177:0/2265334339 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0a0c066470 0x7f0a0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:29.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.541+0000 7f0a1f7fe640 1 --2- 172.21.15.177:0/2265334339 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0a0c066470 0x7f0a0c068930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0a100ae000 tx=0x7f0a100b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:29.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.545+0000 7f0a07fff640 1 -- 172.21.15.177:0/2265334339 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0a14050820 con 0x7f0a200cba10 2023-11-28T20:09:29.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:29.725+0000 7f0a25e09640 1 -- 172.21.15.177:0/2265334339 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0a2015f010 con 0x7f0a200cba10 2023-11-28T20:09:30.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.361+0000 7f0a07fff640 1 -- 172.21.15.177:0/2265334339 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0a14053e40 con 0x7f0a200cba10 2023-11-28T20:09:30.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.361+0000 7f0a25e09640 1 -- 172.21.15.177:0/2265334339 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0a0c066470 msgr2=0x7f0a0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:30.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.361+0000 7f0a25e09640 1 --2- 172.21.15.177:0/2265334339 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0a0c066470 0x7f0a0c068930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0a100ae000 tx=0x7f0a100b5040 comp rx=0 tx=0).stop 2023-11-28T20:09:30.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.361+0000 7f0a25e09640 1 -- 172.21.15.177:0/2265334339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a200cba10 msgr2=0x7f0a2013d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:30.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.361+0000 7f0a25e09640 1 --2- 172.21.15.177:0/2265334339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a200cba10 0x7f0a2013d380 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400c370 tx=0x7f0a1400c830 comp rx=0 tx=0).stop 2023-11-28T20:09:30.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.361+0000 7f0a25e09640 1 -- 172.21.15.177:0/2265334339 shutdown_connections 2023-11-28T20:09:30.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.361+0000 7f0a25e09640 1 --2- 172.21.15.177:0/2265334339 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0a0c066470 0x7f0a0c068930 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:30.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.361+0000 7f0a25e09640 1 --2- 172.21.15.177:0/2265334339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a20158ca0 0x7f0a200cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:30.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.361+0000 7f0a25e09640 1 --2- 172.21.15.177:0/2265334339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a200cba10 0x7f0a2013d380 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:30.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.361+0000 7f0a25e09640 1 --2- 172.21.15.177:0/2265334339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a200b42d0 0x7f0a201406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:30.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.361+0000 7f0a25e09640 1 -- 172.21.15.177:0/2265334339 >> 172.21.15.177:0/2265334339 conn(0x7f0a200b0cc0 msgr2=0x7f0a20164060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:30.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.365+0000 7f0a25e09640 1 -- 172.21.15.177:0/2265334339 shutdown_connections 2023-11-28T20:09:30.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.365+0000 7f0a25e09640 1 -- 172.21.15.177:0/2265334339 wait complete. 2023-11-28T20:09:30.388 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T20:09:30.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c4380640 1 Processor -- start 2023-11-28T20:09:30.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c4380640 1 -- start start 2023-11-28T20:09:30.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c4380640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f39bc0cce60 0x7f39bc0cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:30.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c4380640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f39bc0cdf30 0x7f39bc0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:30.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c4380640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39bc15b6e0 con 0x7f39bc06c6e0 2023-11-28T20:09:30.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c4380640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc0ce8d0 con 0x7f39bc0cce60 2023-11-28T20:09:30.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c4380640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc0cd780 con 0x7f39bc0cdf30 2023-11-28T20:09:30.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c211c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f39bc0cce60 0x7f39bc0cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:30.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c291d640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f39bc06c6e0 0x7f39bc06cb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51036/0 (socket says 172.21.15.177:51036) 2023-11-28T20:09:30.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c291d640 1 -- 172.21.15.177:0/3185437108 learned_addr learned my addr 172.21.15.177:0/3185437108 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:30.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c191b640 1 --2- 172.21.15.177:0/3185437108 >> v2:172.21.15.195:3300/0 conn(0x7f39bc0cdf30 0x7f39bc0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:30.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c211c640 1 -- 172.21.15.177:0/3185437108 >> v2:172.21.15.195:3300/0 conn(0x7f39bc0cdf30 msgr2=0x7f39bc0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:30.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c211c640 1 --2- 172.21.15.177:0/3185437108 >> v2:172.21.15.195:3300/0 conn(0x7f39bc0cdf30 0x7f39bc0ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:30.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c211c640 1 -- 172.21.15.177:0/3185437108 >> v1:172.21.15.177:6789/0 conn(0x7f39bc06c6e0 legacy=0x7f39bc06cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:30.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c211c640 1 -- 172.21.15.177:0/3185437108 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc0cb550 con 0x7f39bc0cce60 2023-11-28T20:09:30.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c111a640 1 -- 172.21.15.177:0/3185437108 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938611876 0 0) 0x7f39bc15b6e0 con 0x7f39bc06c6e0 2023-11-28T20:09:30.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.569+0000 7f39c191b640 1 --2- 172.21.15.177:0/3185437108 >> v2:172.21.15.195:3300/0 conn(0x7f39bc0cdf30 0x7f39bc0ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:30.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.573+0000 7f39c211c640 1 --2- 172.21.15.177:0/3185437108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc0cce60 0x7f39bc0cd240 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f39bc15ed70 tx=0x7f39b801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ef745221bf436e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:30.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.573+0000 7f39c111a640 1 -- 172.21.15.177:0/3185437108 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b80ab600 con 0x7f39bc0cce60 2023-11-28T20:09:30.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.573+0000 7f39c111a640 1 -- 172.21.15.177:0/3185437108 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b80a7050 con 0x7f39bc0cce60 2023-11-28T20:09:30.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.573+0000 7f39c111a640 1 -- 172.21.15.177:0/3185437108 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b80ab980 con 0x7f39bc0cce60 2023-11-28T20:09:30.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.573+0000 7f39c4380640 1 -- 172.21.15.177:0/3185437108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc0cce60 msgr2=0x7f39bc0cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:30.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.573+0000 7f39c4380640 1 --2- 172.21.15.177:0/3185437108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc0cce60 0x7f39bc0cd240 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f39bc15ed70 tx=0x7f39b801c430 comp rx=0 tx=0).stop 2023-11-28T20:09:30.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.573+0000 7f39c4380640 1 -- 172.21.15.177:0/3185437108 shutdown_connections 2023-11-28T20:09:30.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.573+0000 7f39c4380640 1 --2- 172.21.15.177:0/3185437108 >> v2:172.21.15.195:3300/0 conn(0x7f39bc0cdf30 0x7f39bc0ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:30.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.573+0000 7f39c4380640 1 --2- 172.21.15.177:0/3185437108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc0cce60 0x7f39bc0cd240 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:30.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.573+0000 7f39c4380640 1 -- 172.21.15.177:0/3185437108 >> 172.21.15.177:0/3185437108 conn(0x7f39bc0b0c50 msgr2=0x7f39bc0b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:30.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.573+0000 7f39c4380640 1 -- 172.21.15.177:0/3185437108 shutdown_connections 2023-11-28T20:09:30.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.573+0000 7f39c4380640 1 -- 172.21.15.177:0/3185437108 wait complete. 2023-11-28T20:09:30.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c4380640 1 Processor -- start 2023-11-28T20:09:30.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c4380640 1 -- start start 2023-11-28T20:09:30.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c4380640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39bc06c6e0 0x7f39bc0ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:30.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c4380640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc0cce60 0x7f39bc14be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:30.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c4380640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39bc0cdf30 0x7f39bc14ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:30.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c4380640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc0ac340 con 0x7f39bc0cce60 2023-11-28T20:09:30.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c4380640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc0ad2c0 con 0x7f39bc06c6e0 2023-11-28T20:09:30.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c4380640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc0ad5a0 con 0x7f39bc0cdf30 2023-11-28T20:09:30.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c191b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc0cce60 0x7f39bc14be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:30.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c191b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc0cce60 0x7f39bc14be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55320/0 (socket says 172.21.15.177:55320) 2023-11-28T20:09:30.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c211c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39bc06c6e0 0x7f39bc0ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:30.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c191b640 1 -- 172.21.15.177:0/4268899360 learned_addr learned my addr 172.21.15.177:0/4268899360 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:30.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c291d640 1 --2- 172.21.15.177:0/4268899360 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39bc0cdf30 0x7f39bc14ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:30.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c191b640 1 -- 172.21.15.177:0/4268899360 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39bc0cdf30 msgr2=0x7f39bc14ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:30.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c191b640 1 --2- 172.21.15.177:0/4268899360 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39bc0cdf30 0x7f39bc14ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:30.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c191b640 1 -- 172.21.15.177:0/4268899360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39bc06c6e0 msgr2=0x7f39bc0ac7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:30.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c191b640 1 --2- 172.21.15.177:0/4268899360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39bc06c6e0 0x7f39bc0ac7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:30.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c191b640 1 -- 172.21.15.177:0/4268899360 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b8009420 con 0x7f39bc0cce60 2023-11-28T20:09:30.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.577+0000 7f39c191b640 1 --2- 172.21.15.177:0/4268899360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc0cce60 0x7f39bc14be50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00c7f0 tx=0x7f39ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:30.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.581+0000 7f39b2ffd640 1 -- 172.21.15.177:0/4268899360 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac007820 con 0x7f39bc0cce60 2023-11-28T20:09:30.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.581+0000 7f39b2ffd640 1 -- 172.21.15.177:0/4268899360 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac007980 con 0x7f39bc0cce60 2023-11-28T20:09:30.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.581+0000 7f39b2ffd640 1 -- 172.21.15.177:0/4268899360 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac007cf0 con 0x7f39bc0cce60 2023-11-28T20:09:30.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.581+0000 7f39c4380640 1 -- 172.21.15.177:0/4268899360 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39bc0abfd0 con 0x7f39bc0cce60 2023-11-28T20:09:30.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.581+0000 7f39c4380640 1 -- 172.21.15.177:0/4268899360 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc0ad880 con 0x7f39bc0cce60 2023-11-28T20:09:30.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.581+0000 7f39c4380640 1 -- 172.21.15.177:0/4268899360 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39bc04e850 con 0x7f39bc0cce60 2023-11-28T20:09:30.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.585+0000 7f39b2ffd640 1 -- 172.21.15.177:0/4268899360 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f39ac0113f0 con 0x7f39bc0cce60 2023-11-28T20:09:30.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.585+0000 7f39b2ffd640 1 --2- 172.21.15.177:0/4268899360 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39a0066470 0x7f39a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:30.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.585+0000 7f39b2ffd640 1 -- 172.21.15.177:0/4268899360 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6190+0+0 (secure 0 0 0) 0x7f39ac084350 con 0x7f39bc0cce60 2023-11-28T20:09:30.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.585+0000 7f39c211c640 1 --2- 172.21.15.177:0/4268899360 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39a0066470 0x7f39a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:30.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.585+0000 7f39c211c640 1 --2- 172.21.15.177:0/4268899360 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39a0066470 0x7f39a0068930 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f39b80ad000 tx=0x7f39b80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:30.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.589+0000 7f39b2ffd640 1 -- 172.21.15.177:0/4268899360 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f39ac051600 con 0x7f39bc0cce60 2023-11-28T20:09:30.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:30.737+0000 7f39c4380640 1 -- 172.21.15.177:0/4268899360 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f39bc0ca080 con 0x7f39bc0cce60 2023-11-28T20:09:31.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.585+0000 7f39b2ffd640 1 -- 172.21.15.177:0/4268899360 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7f39ac054c20 con 0x7f39bc0cce60 2023-11-28T20:09:31.589 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' removed 2023-11-28T20:09:31.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.589+0000 7f39c4380640 1 -- 172.21.15.177:0/4268899360 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39a0066470 msgr2=0x7f39a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:31.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.589+0000 7f39c4380640 1 --2- 172.21.15.177:0/4268899360 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39a0066470 0x7f39a0068930 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f39b80ad000 tx=0x7f39b80a6000 comp rx=0 tx=0).stop 2023-11-28T20:09:31.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.589+0000 7f39c4380640 1 -- 172.21.15.177:0/4268899360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc0cce60 msgr2=0x7f39bc14be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:31.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.589+0000 7f39c4380640 1 --2- 172.21.15.177:0/4268899360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc0cce60 0x7f39bc14be50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00c7f0 tx=0x7f39ac00ccb0 comp rx=0 tx=0).stop 2023-11-28T20:09:31.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.589+0000 7f39c4380640 1 -- 172.21.15.177:0/4268899360 shutdown_connections 2023-11-28T20:09:31.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.589+0000 7f39c4380640 1 --2- 172.21.15.177:0/4268899360 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39a0066470 0x7f39a0068930 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:31.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.589+0000 7f39c4380640 1 --2- 172.21.15.177:0/4268899360 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39bc0cdf30 0x7f39bc14ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:31.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.589+0000 7f39c4380640 1 --2- 172.21.15.177:0/4268899360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc0cce60 0x7f39bc14be50 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:31.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.589+0000 7f39c4380640 1 --2- 172.21.15.177:0/4268899360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39bc06c6e0 0x7f39bc0ac7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:31.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.589+0000 7f39c4380640 1 -- 172.21.15.177:0/4268899360 >> 172.21.15.177:0/4268899360 conn(0x7f39bc0b0c50 msgr2=0x7f39bc0cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:31.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.589+0000 7f39c4380640 1 -- 172.21.15.177:0/4268899360 shutdown_connections 2023-11-28T20:09:31.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.589+0000 7f39c4380640 1 -- 172.21.15.177:0/4268899360 wait complete. 2023-11-28T20:09:31.616 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T20:09:31.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.761+0000 7fa3c75c4640 1 Processor -- start 2023-11-28T20:09:31.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.761+0000 7fa3c75c4640 1 -- start start 2023-11-28T20:09:31.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.765+0000 7fa3c75c4640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa3c00cce60 0x7fa3c00cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:31.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.765+0000 7fa3c75c4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa3c00cdf30 0x7fa3c00ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:31.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.765+0000 7fa3c75c4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c015b6e0 con 0x7fa3c006c6e0 2023-11-28T20:09:31.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.765+0000 7fa3c75c4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c00ce8d0 con 0x7fa3c00cdf30 2023-11-28T20:09:31.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.765+0000 7fa3c75c4640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c00cd780 con 0x7fa3c00cce60 2023-11-28T20:09:31.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.765+0000 7fa3c4b5f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa3c00cdf30 0x7fa3c00ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:31.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.765+0000 7fa3c5b61640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fa3c006c6e0 0x7fa3c006cb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51042/0 (socket says 172.21.15.177:51042) 2023-11-28T20:09:31.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.765+0000 7fa3c5b61640 1 -- 172.21.15.177:0/2496550590 learned_addr learned my addr 172.21.15.177:0/2496550590 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:31.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.765+0000 7fa3c4b5f640 1 -- 172.21.15.177:0/2496550590 >> v2:172.21.15.195:3300/0 conn(0x7fa3c00cce60 msgr2=0x7fa3c00cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:31.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.765+0000 7fa3c5360640 1 --2- 172.21.15.177:0/2496550590 >> v2:172.21.15.195:3300/0 conn(0x7fa3c00cce60 0x7fa3c00cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:31.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.765+0000 7fa3c4b5f640 1 --2- 172.21.15.177:0/2496550590 >> v2:172.21.15.195:3300/0 conn(0x7fa3c00cce60 0x7fa3c00cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:31.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.765+0000 7fa3b7fff640 1 -- 172.21.15.177:0/2496550590 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833926605 0 0) 0x7fa3c015b6e0 con 0x7fa3c006c6e0 2023-11-28T20:09:31.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.765+0000 7fa3c4b5f640 1 -- 172.21.15.177:0/2496550590 >> v1:172.21.15.177:6789/0 conn(0x7fa3c006c6e0 legacy=0x7fa3c006cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:31.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.765+0000 7fa3c4b5f640 1 -- 172.21.15.177:0/2496550590 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c00cb550 con 0x7fa3c00cdf30 2023-11-28T20:09:31.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.765+0000 7fa3c5360640 1 --2- 172.21.15.177:0/2496550590 >> v2:172.21.15.195:3300/0 conn(0x7fa3c00cce60 0x7fa3c00cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:31.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.769+0000 7fa3c4b5f640 1 --2- 172.21.15.177:0/2496550590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c00cdf30 0x7fa3c00ce390 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00c9670 tx=0x7fa3b001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ccf992a8f9940 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:31.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.769+0000 7fa3b7fff640 1 -- 172.21.15.177:0/2496550590 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b00ab600 con 0x7fa3c00cdf30 2023-11-28T20:09:31.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.769+0000 7fa3b7fff640 1 -- 172.21.15.177:0/2496550590 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b00a7050 con 0x7fa3c00cdf30 2023-11-28T20:09:31.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.769+0000 7fa3b7fff640 1 -- 172.21.15.177:0/2496550590 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b00ab980 con 0x7fa3c00cdf30 2023-11-28T20:09:31.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.769+0000 7fa3c75c4640 1 -- 172.21.15.177:0/2496550590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c00cdf30 msgr2=0x7fa3c00ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:31.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.769+0000 7fa3c75c4640 1 --2- 172.21.15.177:0/2496550590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c00cdf30 0x7fa3c00ce390 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00c9670 tx=0x7fa3b001c430 comp rx=0 tx=0).stop 2023-11-28T20:09:31.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.769+0000 7fa3c75c4640 1 -- 172.21.15.177:0/2496550590 shutdown_connections 2023-11-28T20:09:31.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.769+0000 7fa3c75c4640 1 --2- 172.21.15.177:0/2496550590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c00cdf30 0x7fa3c00ce390 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:31.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.769+0000 7fa3c75c4640 1 --2- 172.21.15.177:0/2496550590 >> v2:172.21.15.195:3300/0 conn(0x7fa3c00cce60 0x7fa3c00cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:31.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.769+0000 7fa3c75c4640 1 -- 172.21.15.177:0/2496550590 >> 172.21.15.177:0/2496550590 conn(0x7fa3c00b0c50 msgr2=0x7fa3c00b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:31.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.769+0000 7fa3c75c4640 1 -- 172.21.15.177:0/2496550590 shutdown_connections 2023-11-28T20:09:31.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.769+0000 7fa3c75c4640 1 -- 172.21.15.177:0/2496550590 wait complete. 2023-11-28T20:09:31.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.769+0000 7fa3c75c4640 1 Processor -- start 2023-11-28T20:09:31.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.769+0000 7fa3c75c4640 1 -- start start 2023-11-28T20:09:31.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c75c4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3c006c6e0 0x7fa3c0153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:31.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c75c4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3c00cce60 0x7fa3c00b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:31.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c75c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c00cdf30 0x7fa3c0154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:31.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c75c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c00b2590 con 0x7fa3c00cdf30 2023-11-28T20:09:31.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c75c4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c00b2b50 con 0x7fa3c006c6e0 2023-11-28T20:09:31.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c75c4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c01543f0 con 0x7fa3c00cce60 2023-11-28T20:09:31.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c5b61640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c00cdf30 0x7fa3c0154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:31.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c5b61640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c00cdf30 0x7fa3c0154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55350/0 (socket says 172.21.15.177:55350) 2023-11-28T20:09:31.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c5b61640 1 -- 172.21.15.177:0/2909144115 learned_addr learned my addr 172.21.15.177:0/2909144115 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:31.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c4b5f640 1 --2- 172.21.15.177:0/2909144115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3c00cce60 0x7fa3c00b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:31.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c5360640 1 --2- 172.21.15.177:0/2909144115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3c006c6e0 0x7fa3c0153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:31.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c5b61640 1 -- 172.21.15.177:0/2909144115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3c00cce60 msgr2=0x7fa3c00b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:31.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c5b61640 1 --2- 172.21.15.177:0/2909144115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3c00cce60 0x7fa3c00b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:31.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c5b61640 1 -- 172.21.15.177:0/2909144115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3c006c6e0 msgr2=0x7fa3c0153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:31.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c5b61640 1 --2- 172.21.15.177:0/2909144115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3c006c6e0 0x7fa3c0153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:31.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c5b61640 1 -- 172.21.15.177:0/2909144115 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0009420 con 0x7fa3c00cdf30 2023-11-28T20:09:31.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c5b61640 1 --2- 172.21.15.177:0/2909144115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c00cdf30 0x7fa3c0154610 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8001570 tx=0x7fa3b800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:31.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3b5ffb640 1 -- 172.21.15.177:0/2909144115 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800cea0 con 0x7fa3c00cdf30 2023-11-28T20:09:31.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3b5ffb640 1 -- 172.21.15.177:0/2909144115 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b800a5e0 con 0x7fa3c00cdf30 2023-11-28T20:09:31.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3b5ffb640 1 -- 172.21.15.177:0/2909144115 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800a990 con 0x7fa3c00cdf30 2023-11-28T20:09:31.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c75c4640 1 -- 172.21.15.177:0/2909144115 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c00b40a0 con 0x7fa3c00cdf30 2023-11-28T20:09:31.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c75c4640 1 -- 172.21.15.177:0/2909144115 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c00b3080 con 0x7fa3c00cdf30 2023-11-28T20:09:31.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.773+0000 7fa3c75c4640 1 -- 172.21.15.177:0/2909144115 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c004e850 con 0x7fa3c00cdf30 2023-11-28T20:09:31.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.777+0000 7fa3b5ffb640 1 -- 172.21.15.177:0/2909144115 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa3b800aaf0 con 0x7fa3c00cdf30 2023-11-28T20:09:31.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.777+0000 7fa3b5ffb640 1 --2- 172.21.15.177:0/2909144115 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa3a4066470 0x7fa3a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:31.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.777+0000 7fa3b5ffb640 1 -- 172.21.15.177:0/2909144115 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5752+0+0 (secure 0 0 0) 0x7fa3b8083320 con 0x7fa3c00cdf30 2023-11-28T20:09:31.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.777+0000 7fa3c5360640 1 --2- 172.21.15.177:0/2909144115 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa3a4066470 0x7fa3a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:31.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.777+0000 7fa3c5360640 1 --2- 172.21.15.177:0/2909144115 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa3a4066470 0x7fa3a4068930 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00ab60 tx=0x7fa3bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:31.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.781+0000 7fa3b5ffb640 1 -- 172.21.15.177:0/2909144115 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3b8050820 con 0x7fa3c00cdf30 2023-11-28T20:09:31.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:31.929+0000 7fa3c75c4640 1 -- 172.21.15.177:0/2909144115 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa3c00ca080 con 0x7fa3c00cdf30 2023-11-28T20:09:32.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.589+0000 7fa3b5ffb640 1 -- 172.21.15.177:0/2909144115 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa3b80180d0 con 0x7fa3c00cdf30 2023-11-28T20:09:32.591 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' removed 2023-11-28T20:09:32.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.589+0000 7fa3c75c4640 1 -- 172.21.15.177:0/2909144115 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa3a4066470 msgr2=0x7fa3a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:32.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.589+0000 7fa3c75c4640 1 --2- 172.21.15.177:0/2909144115 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa3a4066470 0x7fa3a4068930 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00ab60 tx=0x7fa3bc008040 comp rx=0 tx=0).stop 2023-11-28T20:09:32.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.589+0000 7fa3c75c4640 1 -- 172.21.15.177:0/2909144115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c00cdf30 msgr2=0x7fa3c0154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:32.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.589+0000 7fa3c75c4640 1 --2- 172.21.15.177:0/2909144115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c00cdf30 0x7fa3c0154610 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8001570 tx=0x7fa3b800cc50 comp rx=0 tx=0).stop 2023-11-28T20:09:32.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.589+0000 7fa3c75c4640 1 -- 172.21.15.177:0/2909144115 shutdown_connections 2023-11-28T20:09:32.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.589+0000 7fa3c75c4640 1 --2- 172.21.15.177:0/2909144115 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa3a4066470 0x7fa3a4068930 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:32.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.589+0000 7fa3c75c4640 1 --2- 172.21.15.177:0/2909144115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c00cdf30 0x7fa3c0154610 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:32.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.589+0000 7fa3c75c4640 1 --2- 172.21.15.177:0/2909144115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3c00cce60 0x7fa3c00b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:32.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.589+0000 7fa3c75c4640 1 --2- 172.21.15.177:0/2909144115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3c006c6e0 0x7fa3c0153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:32.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.589+0000 7fa3c75c4640 1 -- 172.21.15.177:0/2909144115 >> 172.21.15.177:0/2909144115 conn(0x7fa3c00b0c50 msgr2=0x7fa3c0158420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:32.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.589+0000 7fa3c75c4640 1 -- 172.21.15.177:0/2909144115 shutdown_connections 2023-11-28T20:09:32.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.589+0000 7fa3c75c4640 1 -- 172.21.15.177:0/2909144115 wait complete. 2023-11-28T20:09:32.622 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2023-11-28T20:09:32.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.761+0000 7fe1925aa640 1 Processor -- start 2023-11-28T20:09:32.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.761+0000 7fe1925aa640 1 -- start start 2023-11-28T20:09:32.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.765+0000 7fe1925aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c0cd570 0x7fe18c0c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:32.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.765+0000 7fe1925aa640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe18c0cb0c0 0x7fe18c070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:32.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.765+0000 7fe1925aa640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c159f80 con 0x7fe18c159ba0 2023-11-28T20:09:32.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.765+0000 7fe1925aa640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18c0cb550 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.765+0000 7fe1925aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c0ce460 con 0x7fe18c0cd570 2023-11-28T20:09:32.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.765+0000 7fe190b47640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe18c0cb0c0 0x7fe18c070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:32.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.765+0000 7fe190b47640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe18c0cb0c0 0x7fe18c070580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55354/0 (socket says 172.21.15.177:55354) 2023-11-28T20:09:32.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.765+0000 7fe190b47640 1 -- 172.21.15.177:0/1315028229 learned_addr learned my addr 172.21.15.177:0/1315028229 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:32.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.765+0000 7fe18b7fe640 1 --2- 172.21.15.177:0/1315028229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c0cd570 0x7fe18c0c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:32.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.765+0000 7fe190b47640 1 -- 172.21.15.177:0/1315028229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c0cd570 msgr2=0x7fe18c0c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:32.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.765+0000 7fe190b47640 1 --2- 172.21.15.177:0/1315028229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c0cd570 0x7fe18c0c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:32.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.765+0000 7fe190b47640 1 -- 172.21.15.177:0/1315028229 >> v1:172.21.15.195:6789/0 conn(0x7fe18c159ba0 legacy=0x7fe18c0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:32.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.765+0000 7fe190b47640 1 -- 172.21.15.177:0/1315028229 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c0cda30 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.765+0000 7fe190b47640 1 --2- 172.21.15.177:0/1315028229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18c0cb0c0 0x7fe18c070580 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe184009e50 tx=0x7fe18401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1109b594e8c54e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:32.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.765+0000 7fe18affd640 1 -- 172.21.15.177:0/1315028229 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1840a7a40 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe18affd640 1 -- 172.21.15.177:0/1315028229 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1840a7ba0 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe18affd640 1 -- 172.21.15.177:0/1315028229 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1840af3f0 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 -- 172.21.15.177:0/1315028229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18c0cb0c0 msgr2=0x7fe18c070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:32.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 --2- 172.21.15.177:0/1315028229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18c0cb0c0 0x7fe18c070580 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe184009e50 tx=0x7fe18401ebf0 comp rx=0 tx=0).stop 2023-11-28T20:09:32.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 -- 172.21.15.177:0/1315028229 shutdown_connections 2023-11-28T20:09:32.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 --2- 172.21.15.177:0/1315028229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18c0cb0c0 0x7fe18c070580 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:32.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 --2- 172.21.15.177:0/1315028229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c0cd570 0x7fe18c0c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:32.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 -- 172.21.15.177:0/1315028229 >> 172.21.15.177:0/1315028229 conn(0x7fe18c0b0c50 msgr2=0x7fe18c0b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:32.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 -- 172.21.15.177:0/1315028229 shutdown_connections 2023-11-28T20:09:32.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 -- 172.21.15.177:0/1315028229 wait complete. 2023-11-28T20:09:32.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 Processor -- start 2023-11-28T20:09:32.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 -- start start 2023-11-28T20:09:32.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18c0cb0c0 0x7fe18c150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:32.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c0cd570 0x7fe18c155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:32.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c159ba0 0x7fe18c1fa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:32.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c15d120 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c154ab0 con 0x7fe18c159ba0 2023-11-28T20:09:32.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe1925aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c154d90 con 0x7fe18c0cd570 2023-11-28T20:09:32.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe18bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18c0cb0c0 0x7fe18c150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:32.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe18bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18c0cb0c0 0x7fe18c150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55370/0 (socket says 172.21.15.177:55370) 2023-11-28T20:09:32.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe18bfff640 1 -- 172.21.15.177:0/4196133175 learned_addr learned my addr 172.21.15.177:0/4196133175 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:32.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.769+0000 7fe18b7fe640 1 --2- 172.21.15.177:0/4196133175 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c0cd570 0x7fe18c155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:32.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe190b47640 1 --2- 172.21.15.177:0/4196133175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c159ba0 0x7fe18c1fa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:32.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe18bfff640 1 -- 172.21.15.177:0/4196133175 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c0cd570 msgr2=0x7fe18c155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:32.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe18bfff640 1 --2- 172.21.15.177:0/4196133175 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c0cd570 0x7fe18c155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:32.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe18bfff640 1 -- 172.21.15.177:0/4196133175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c159ba0 msgr2=0x7fe18c1fa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:32.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe18bfff640 1 --2- 172.21.15.177:0/4196133175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c159ba0 0x7fe18c1fa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:32.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe18bfff640 1 -- 172.21.15.177:0/4196133175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe184009b30 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe190b47640 1 --2- 172.21.15.177:0/4196133175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c159ba0 0x7fe18c1fa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:32.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe18bfff640 1 --2- 172.21.15.177:0/4196133175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18c0cb0c0 0x7fe18c150dc0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe17c00c3c0 tx=0x7fe17c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:32.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe188ff9640 1 -- 172.21.15.177:0/4196133175 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0052d0 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe188ff9640 1 -- 172.21.15.177:0/4196133175 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c005430 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe188ff9640 1 -- 172.21.15.177:0/4196133175 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c003840 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe1925aa640 1 -- 172.21.15.177:0/4196133175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18c155070 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe1925aa640 1 -- 172.21.15.177:0/4196133175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18c15add0 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe1925aa640 1 -- 172.21.15.177:0/4196133175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18c04e850 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe188ff9640 1 -- 172.21.15.177:0/4196133175 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe17c0039a0 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe188ff9640 1 --2- 172.21.15.177:0/4196133175 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe178066470 0x7fe178068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:32.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe188ff9640 1 -- 172.21.15.177:0/4196133175 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5338+0+0 (secure 0 0 0) 0x7fe17c083190 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.773+0000 7fe18b7fe640 1 --2- 172.21.15.177:0/4196133175 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe178066470 0x7fe178068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:32.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.777+0000 7fe18b7fe640 1 --2- 172.21.15.177:0/4196133175 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe178066470 0x7fe178068930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0adc30 tx=0x7fe180008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:32.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.777+0000 7fe188ff9640 1 -- 172.21.15.177:0/4196133175 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe17c050820 con 0x7fe18c0cb0c0 2023-11-28T20:09:32.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:32.937+0000 7fe1925aa640 1 -- 172.21.15.177:0/4196133175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe18c0693d0 con 0x7fe18c0cb0c0 2023-11-28T20:09:33.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.605+0000 7fe188ff9640 1 -- 172.21.15.177:0/4196133175 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v40) v1 ==== 160+0+0 (secure 0 0 0) 0x7fe17c053e40 con 0x7fe18c0cb0c0 2023-11-28T20:09:33.607 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'data_new' removed 2023-11-28T20:09:33.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.605+0000 7fe1925aa640 1 -- 172.21.15.177:0/4196133175 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe178066470 msgr2=0x7fe178068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:33.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.605+0000 7fe1925aa640 1 --2- 172.21.15.177:0/4196133175 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe178066470 0x7fe178068930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0adc30 tx=0x7fe180008040 comp rx=0 tx=0).stop 2023-11-28T20:09:33.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.605+0000 7fe1925aa640 1 -- 172.21.15.177:0/4196133175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18c0cb0c0 msgr2=0x7fe18c150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:33.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.605+0000 7fe1925aa640 1 --2- 172.21.15.177:0/4196133175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18c0cb0c0 0x7fe18c150dc0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe17c00c3c0 tx=0x7fe17c00c880 comp rx=0 tx=0).stop 2023-11-28T20:09:33.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.605+0000 7fe1925aa640 1 -- 172.21.15.177:0/4196133175 shutdown_connections 2023-11-28T20:09:33.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.605+0000 7fe1925aa640 1 --2- 172.21.15.177:0/4196133175 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe178066470 0x7fe178068930 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:33.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.605+0000 7fe1925aa640 1 --2- 172.21.15.177:0/4196133175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c159ba0 0x7fe18c1fa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:33.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.605+0000 7fe1925aa640 1 --2- 172.21.15.177:0/4196133175 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c0cd570 0x7fe18c155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:33.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.605+0000 7fe1925aa640 1 --2- 172.21.15.177:0/4196133175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe18c0cb0c0 0x7fe18c150dc0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:33.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.605+0000 7fe1925aa640 1 -- 172.21.15.177:0/4196133175 >> 172.21.15.177:0/4196133175 conn(0x7fe18c0b0c50 msgr2=0x7fe18c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:33.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.605+0000 7fe1925aa640 1 -- 172.21.15.177:0/4196133175 shutdown_connections 2023-11-28T20:09:33.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.605+0000 7fe1925aa640 1 -- 172.21.15.177:0/4196133175 wait complete. 2023-11-28T20:09:33.634 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T20:09:33.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faef67aa640 1 Processor -- start 2023-11-28T20:09:33.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faef67aa640 1 -- start start 2023-11-28T20:09:33.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faef67aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faef013f5f0 0x7faef00ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:33.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faef67aa640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef013d2b0 con 0x7faef015adb0 2023-11-28T20:09:33.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faef67aa640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef00cdd70 con 0x7faef0071d90 2023-11-28T20:09:33.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faef67aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef0140520 con 0x7faef013f5f0 2023-11-28T20:09:33.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faeef7fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7faef015adb0 0x7faef013d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51052/0 (socket says 172.21.15.177:51052) 2023-11-28T20:09:33.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faeef7fe640 1 -- 172.21.15.177:0/1457248551 learned_addr learned my addr 172.21.15.177:0/1457248551 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:33.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faef4d47640 1 --2- 172.21.15.177:0/1457248551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faef013f5f0 0x7faef00ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:33.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faeeeffd640 1 -- 172.21.15.177:0/1457248551 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427019274 0 0) 0x7faef013d2b0 con 0x7faef015adb0 2023-11-28T20:09:33.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faeeeffd640 1 -- 172.21.15.177:0/1457248551 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed8003530 con 0x7faef015adb0 2023-11-28T20:09:33.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faeeeffd640 1 -- 172.21.15.177:0/1457248551 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611735066 0 0) 0x7faef00cdd70 con 0x7faef0071d90 2023-11-28T20:09:33.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faeeeffd640 1 -- 172.21.15.177:0/1457248551 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef013d2b0 con 0x7faef0071d90 2023-11-28T20:09:33.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faef4d47640 1 -- 172.21.15.177:0/1457248551 >> v1:172.21.15.195:6789/0 conn(0x7faef0071d90 legacy=0x7faef0072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:33.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faef4d47640 1 -- 172.21.15.177:0/1457248551 >> v1:172.21.15.177:6789/0 conn(0x7faef015adb0 legacy=0x7faef013d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:33.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.773+0000 7faef4d47640 1 -- 172.21.15.177:0/1457248551 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef013ff60 con 0x7faef013f5f0 2023-11-28T20:09:33.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.777+0000 7faef4d47640 1 --2- 172.21.15.177:0/1457248551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faef013f5f0 0x7faef00ce200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faee8009dc0 tx=0x7faee801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf24d613ba34ff8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:33.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.777+0000 7faeeeffd640 1 -- 172.21.15.177:0/1457248551 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80a5920 con 0x7faef013f5f0 2023-11-28T20:09:33.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.777+0000 7faeeeffd640 1 -- 172.21.15.177:0/1457248551 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee80a5a80 con 0x7faef013f5f0 2023-11-28T20:09:33.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.777+0000 7faeeeffd640 1 -- 172.21.15.177:0/1457248551 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80a5e10 con 0x7faef013f5f0 2023-11-28T20:09:33.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.777+0000 7faef67aa640 1 -- 172.21.15.177:0/1457248551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faef013f5f0 msgr2=0x7faef00ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:33.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.777+0000 7faef67aa640 1 --2- 172.21.15.177:0/1457248551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faef013f5f0 0x7faef00ce200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faee8009dc0 tx=0x7faee801c970 comp rx=0 tx=0).stop 2023-11-28T20:09:33.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.777+0000 7faef67aa640 1 -- 172.21.15.177:0/1457248551 shutdown_connections 2023-11-28T20:09:33.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.777+0000 7faef67aa640 1 --2- 172.21.15.177:0/1457248551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faef013f5f0 0x7faef00ce200 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:33.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.777+0000 7faef67aa640 1 -- 172.21.15.177:0/1457248551 >> 172.21.15.177:0/1457248551 conn(0x7faef00b0cc0 msgr2=0x7faef00b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:33.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.777+0000 7faef67aa640 1 -- 172.21.15.177:0/1457248551 shutdown_connections 2023-11-28T20:09:33.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.777+0000 7faef67aa640 1 -- 172.21.15.177:0/1457248551 wait complete. 2023-11-28T20:09:33.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faef67aa640 1 Processor -- start 2023-11-28T20:09:33.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faef67aa640 1 -- start start 2023-11-28T20:09:33.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faef67aa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faef0071d90 0x7faef013dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:33.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faef67aa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faef013f5f0 0x7faef0137af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:33.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faef67aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faef015adb0 0x7faef01f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:33.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faef67aa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef0143470 con 0x7faef0071d90 2023-11-28T20:09:33.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faef67aa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef00afbf0 con 0x7faef013f5f0 2023-11-28T20:09:33.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faef67aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef00af650 con 0x7faef015adb0 2023-11-28T20:09:33.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faeeffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faef0071d90 0x7faef013dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:33.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faeeffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faef0071d90 0x7faef013dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55376/0 (socket says 172.21.15.177:55376) 2023-11-28T20:09:33.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faeeffff640 1 -- 172.21.15.177:0/3893779779 learned_addr learned my addr 172.21.15.177:0/3893779779 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:33.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faef4d47640 1 --2- 172.21.15.177:0/3893779779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faef015adb0 0x7faef01f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:33.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faeef7fe640 1 --2- 172.21.15.177:0/3893779779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faef013f5f0 0x7faef0137af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:33.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faeeffff640 1 -- 172.21.15.177:0/3893779779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faef015adb0 msgr2=0x7faef01f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:33.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faeeffff640 1 --2- 172.21.15.177:0/3893779779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faef015adb0 0x7faef01f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:33.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faeeffff640 1 -- 172.21.15.177:0/3893779779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faef013f5f0 msgr2=0x7faef0137af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:33.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faeeffff640 1 --2- 172.21.15.177:0/3893779779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faef013f5f0 0x7faef0137af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:33.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faeeffff640 1 -- 172.21.15.177:0/3893779779 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee8009a70 con 0x7faef0071d90 2023-11-28T20:09:33.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faef4d47640 1 --2- 172.21.15.177:0/3893779779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faef015adb0 0x7faef01f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:09:33.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faeeffff640 1 --2- 172.21.15.177:0/3893779779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faef0071d90 0x7faef013dd20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7faee000c490 tx=0x7faee000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:33.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faeecff9640 1 -- 172.21.15.177:0/3893779779 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee00052d0 con 0x7faef0071d90 2023-11-28T20:09:33.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faeecff9640 1 -- 172.21.15.177:0/3893779779 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee0005430 con 0x7faef0071d90 2023-11-28T20:09:33.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faef67aa640 1 -- 172.21.15.177:0/3893779779 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef0142cc0 con 0x7faef0071d90 2023-11-28T20:09:33.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faeecff9640 1 -- 172.21.15.177:0/3893779779 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee0012870 con 0x7faef0071d90 2023-11-28T20:09:33.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.781+0000 7faef67aa640 1 -- 172.21.15.177:0/3893779779 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef0143890 con 0x7faef0071d90 2023-11-28T20:09:33.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.785+0000 7faef67aa640 1 -- 172.21.15.177:0/3893779779 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef01431d0 con 0x7faef0071d90 2023-11-28T20:09:33.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.785+0000 7faeecff9640 1 -- 172.21.15.177:0/3893779779 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faee00129d0 con 0x7faef0071d90 2023-11-28T20:09:33.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.785+0000 7faeecff9640 1 --2- 172.21.15.177:0/3893779779 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faedc066470 0x7faedc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:33.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.785+0000 7faeecff9640 1 -- 172.21.15.177:0/3893779779 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7faee00835d0 con 0x7faef0071d90 2023-11-28T20:09:33.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.785+0000 7faeef7fe640 1 --2- 172.21.15.177:0/3893779779 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faedc066470 0x7faedc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:33.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.785+0000 7faeef7fe640 1 --2- 172.21.15.177:0/3893779779 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faedc066470 0x7faedc068930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faef015c020 tx=0x7faee4007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:33.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.789+0000 7faeecff9640 1 -- 172.21.15.177:0/3893779779 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faef01431d0 con 0x7faef0071d90 2023-11-28T20:09:33.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.941+0000 7faef67aa640 1 -- 172.21.15.177:0/3893779779 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7faef01435b0 con 0x7faef0071d90 2023-11-28T20:09:33.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.945+0000 7faeecff9640 1 -- 172.21.15.177:0/3893779779 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7faef01435b0 con 0x7faef0071d90 2023-11-28T20:09:33.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.945+0000 7faef67aa640 1 -- 172.21.15.177:0/3893779779 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faedc066470 msgr2=0x7faedc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:33.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.945+0000 7faef67aa640 1 --2- 172.21.15.177:0/3893779779 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faedc066470 0x7faedc068930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faef015c020 tx=0x7faee4007d40 comp rx=0 tx=0).stop 2023-11-28T20:09:33.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.945+0000 7faef67aa640 1 -- 172.21.15.177:0/3893779779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faef0071d90 msgr2=0x7faef013dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:33.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.945+0000 7faef67aa640 1 --2- 172.21.15.177:0/3893779779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faef0071d90 0x7faef013dd20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7faee000c490 tx=0x7faee000c950 comp rx=0 tx=0).stop 2023-11-28T20:09:33.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.945+0000 7faef67aa640 1 -- 172.21.15.177:0/3893779779 shutdown_connections 2023-11-28T20:09:33.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.945+0000 7faef67aa640 1 --2- 172.21.15.177:0/3893779779 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faedc066470 0x7faedc068930 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:33.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.945+0000 7faef67aa640 1 --2- 172.21.15.177:0/3893779779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faef015adb0 0x7faef01f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:33.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.945+0000 7faef67aa640 1 --2- 172.21.15.177:0/3893779779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faef013f5f0 0x7faef0137af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:33.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.945+0000 7faef67aa640 1 --2- 172.21.15.177:0/3893779779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faef0071d90 0x7faef013dd20 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:33.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.945+0000 7faef67aa640 1 -- 172.21.15.177:0/3893779779 >> 172.21.15.177:0/3893779779 conn(0x7faef00b0cc0 msgr2=0x7faef00cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:33.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.945+0000 7faef67aa640 1 -- 172.21.15.177:0/3893779779 shutdown_connections 2023-11-28T20:09:33.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:33.945+0000 7faef67aa640 1 -- 172.21.15.177:0/3893779779 wait complete. 2023-11-28T20:09:33.969 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-11-28T20:09:34.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f136eefd640 1 Processor -- start 2023-11-28T20:09:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f136eefd640 1 -- start start 2023-11-28T20:09:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f136eefd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1368144840 0x7f136806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f136eefd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13680710e0 con 0x7f1368070b70 2023-11-28T20:09:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f136eefd640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13680713c0 con 0x7f1368072180 2023-11-28T20:09:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f136eefd640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136815f010 con 0x7f1368144840 2023-11-28T20:09:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f136d49a640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f1368070b70 0x7f136815b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51066/0 (socket says 172.21.15.177:51066) 2023-11-28T20:09:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f136d49a640 1 -- 172.21.15.177:0/273188084 learned_addr learned my addr 172.21.15.177:0/273188084 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f136cc99640 1 --2- 172.21.15.177:0/273188084 >> v2:172.21.15.195:3300/0 conn(0x7f1368144840 0x7f136806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f13677fe640 1 -- 172.21.15.177:0/273188084 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316483568 0 0) 0x7f13680710e0 con 0x7f1368070b70 2023-11-28T20:09:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f13677fe640 1 -- 172.21.15.177:0/273188084 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1358003530 con 0x7f1368070b70 2023-11-28T20:09:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f13677fe640 1 -- 172.21.15.177:0/273188084 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508306947 0 0) 0x7f13680713c0 con 0x7f1368072180 2023-11-28T20:09:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f13677fe640 1 -- 172.21.15.177:0/273188084 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13680710e0 con 0x7f1368072180 2023-11-28T20:09:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f13677fe640 1 -- 172.21.15.177:0/273188084 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 921728016 0 0) 0x7f1358003530 con 0x7f1368070b70 2023-11-28T20:09:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f136cc99640 1 -- 172.21.15.177:0/273188084 >> v1:172.21.15.195:6789/0 conn(0x7f1368072180 legacy=0x7f1368070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f136cc99640 1 -- 172.21.15.177:0/273188084 >> v1:172.21.15.177:6789/0 conn(0x7f1368070b70 legacy=0x7f136815b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.105+0000 7f136cc99640 1 -- 172.21.15.177:0/273188084 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13680716a0 con 0x7f1368144840 2023-11-28T20:09:34.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.109+0000 7f136cc99640 1 --2- 172.21.15.177:0/273188084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1368144840 0x7f136806c2c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f135c0097c0 tx=0x7f135c01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26b93f097ccec044 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:34.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.109+0000 7f13677fe640 1 -- 172.21.15.177:0/273188084 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360001a00 con 0x7f1368144840 2023-11-28T20:09:34.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.109+0000 7f13677fe640 1 -- 172.21.15.177:0/273188084 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c0a7050 con 0x7f1368144840 2023-11-28T20:09:34.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.109+0000 7f13677fe640 1 -- 172.21.15.177:0/273188084 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c0ab620 con 0x7f1368144840 2023-11-28T20:09:34.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.109+0000 7f136eefd640 1 -- 172.21.15.177:0/273188084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1368144840 msgr2=0x7f136806c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:34.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.109+0000 7f136eefd640 1 --2- 172.21.15.177:0/273188084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1368144840 0x7f136806c2c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f135c0097c0 tx=0x7f135c01c370 comp rx=0 tx=0).stop 2023-11-28T20:09:34.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.109+0000 7f136eefd640 1 -- 172.21.15.177:0/273188084 shutdown_connections 2023-11-28T20:09:34.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.109+0000 7f136eefd640 1 --2- 172.21.15.177:0/273188084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1368144840 0x7f136806c2c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.109+0000 7f136eefd640 1 -- 172.21.15.177:0/273188084 >> 172.21.15.177:0/273188084 conn(0x7f136806a530 msgr2=0x7f136806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:34.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.109+0000 7f136eefd640 1 -- 172.21.15.177:0/273188084 shutdown_connections 2023-11-28T20:09:34.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.109+0000 7f136eefd640 1 -- 172.21.15.177:0/273188084 wait complete. 2023-11-28T20:09:34.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f136eefd640 1 Processor -- start 2023-11-28T20:09:34.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f136eefd640 1 -- start start 2023-11-28T20:09:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f136eefd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1368070b70 0x7f1368159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f136eefd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1368072180 0x7f1368159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f136eefd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1368144840 0x7f136815d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f136eefd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136813ea00 con 0x7f1368072180 2023-11-28T20:09:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f136eefd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136813eca0 con 0x7f1368070b70 2023-11-28T20:09:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f136eefd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136813ef80 con 0x7f1368144840 2023-11-28T20:09:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f1367fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1368072180 0x7f1368159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f1367fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1368072180 0x7f1368159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55388/0 (socket says 172.21.15.177:55388) 2023-11-28T20:09:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f1367fff640 1 -- 172.21.15.177:0/1591433900 learned_addr learned my addr 172.21.15.177:0/1591433900 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f136d49a640 1 --2- 172.21.15.177:0/1591433900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1368144840 0x7f136815d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f136cc99640 1 --2- 172.21.15.177:0/1591433900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1368070b70 0x7f1368159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f1367fff640 1 -- 172.21.15.177:0/1591433900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1368144840 msgr2=0x7f136815d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f1367fff640 1 --2- 172.21.15.177:0/1591433900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1368144840 0x7f136815d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f1367fff640 1 -- 172.21.15.177:0/1591433900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1368070b70 msgr2=0x7f1368159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f1367fff640 1 --2- 172.21.15.177:0/1591433900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1368070b70 0x7f1368159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f1367fff640 1 -- 172.21.15.177:0/1591433900 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c009420 con 0x7f1368072180 2023-11-28T20:09:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f1367fff640 1 --2- 172.21.15.177:0/1591433900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1368072180 0x7f1368159920 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f135400c500 tx=0x7f135400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f13657fa640 1 -- 172.21.15.177:0/1591433900 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540052d0 con 0x7f1368072180 2023-11-28T20:09:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f13657fa640 1 -- 172.21.15.177:0/1591433900 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1354005430 con 0x7f1368072180 2023-11-28T20:09:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f13657fa640 1 -- 172.21.15.177:0/1591433900 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354012870 con 0x7f1368072180 2023-11-28T20:09:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f136eefd640 1 -- 172.21.15.177:0/1591433900 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136813cec0 con 0x7f1368072180 2023-11-28T20:09:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f136eefd640 1 -- 172.21.15.177:0/1591433900 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136813f410 con 0x7f1368072180 2023-11-28T20:09:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.113+0000 7f136eefd640 1 -- 172.21.15.177:0/1591433900 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13680cd460 con 0x7f1368072180 2023-11-28T20:09:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.117+0000 7f13657fa640 1 -- 172.21.15.177:0/1591433900 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13540129d0 con 0x7f1368072180 2023-11-28T20:09:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.117+0000 7f13657fa640 1 --2- 172.21.15.177:0/1591433900 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f134c066470 0x7f134c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.117+0000 7f13657fa640 1 -- 172.21.15.177:0/1591433900 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f13540836d0 con 0x7f1368072180 2023-11-28T20:09:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.117+0000 7f136cc99640 1 --2- 172.21.15.177:0/1591433900 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f134c066470 0x7f134c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:34.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.117+0000 7f136cc99640 1 --2- 172.21.15.177:0/1591433900 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f134c066470 0x7f134c068930 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f135c0ad000 tx=0x7f135c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:34.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.121+0000 7f13657fa640 1 -- 172.21.15.177:0/1591433900 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1354050f10 con 0x7f1368072180 2023-11-28T20:09:34.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.325+0000 7f136eefd640 1 -- 172.21.15.177:0/1591433900 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f136813f0f0 con 0x7f1368072180 2023-11-28T20:09:34.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.605+0000 7f13657fa640 1 -- 172.21.15.177:0/1591433900 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v131) v1 ==== 147+0+0 (secure 0 0 0) 0x7f1354054530 con 0x7f1368072180 2023-11-28T20:09:34.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.609+0000 7f136eefd640 1 -- 172.21.15.177:0/1591433900 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f134c066470 msgr2=0x7f134c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:34.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.609+0000 7f136eefd640 1 --2- 172.21.15.177:0/1591433900 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f134c066470 0x7f134c068930 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f135c0ad000 tx=0x7f135c0a6000 comp rx=0 tx=0).stop 2023-11-28T20:09:34.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.609+0000 7f136eefd640 1 -- 172.21.15.177:0/1591433900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1368072180 msgr2=0x7f1368159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:34.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.609+0000 7f136eefd640 1 --2- 172.21.15.177:0/1591433900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1368072180 0x7f1368159920 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f135400c500 tx=0x7f135400c9c0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.609+0000 7f136eefd640 1 -- 172.21.15.177:0/1591433900 shutdown_connections 2023-11-28T20:09:34.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.609+0000 7f136eefd640 1 --2- 172.21.15.177:0/1591433900 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f134c066470 0x7f134c068930 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.609+0000 7f136eefd640 1 --2- 172.21.15.177:0/1591433900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1368144840 0x7f136815d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.609+0000 7f136eefd640 1 --2- 172.21.15.177:0/1591433900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1368072180 0x7f1368159920 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.609+0000 7f136eefd640 1 --2- 172.21.15.177:0/1591433900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1368070b70 0x7f1368159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.609+0000 7f136eefd640 1 -- 172.21.15.177:0/1591433900 >> 172.21.15.177:0/1591433900 conn(0x7f136806a530 msgr2=0x7f13680b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:34.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.609+0000 7f136eefd640 1 -- 172.21.15.177:0/1591433900 shutdown_connections 2023-11-28T20:09:34.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.609+0000 7f136eefd640 1 -- 172.21.15.177:0/1591433900 wait complete. 2023-11-28T20:09:34.636 INFO:tasks.cephfs_test_runner:That a client who does not have the capability for setting ... ok 2023-11-28T20:09:34.636 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-11-28T20:09:34.636 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:09:34.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.769+0000 7f9040565640 1 Processor -- start 2023-11-28T20:09:34.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.769+0000 7f9040565640 1 -- start start 2023-11-28T20:09:34.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.773+0000 7f9040565640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9038144840 0x7f903806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:34.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.773+0000 7f9040565640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9038072180 0x7f903806c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:34.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.773+0000 7f9040565640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90380710e0 con 0x7f9038070460 2023-11-28T20:09:34.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.773+0000 7f9040565640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903815f010 con 0x7f9038144840 2023-11-28T20:09:34.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.773+0000 7f9040565640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90380713c0 con 0x7f9038072180 2023-11-28T20:09:34.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.773+0000 7f903e301640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9038144840 0x7f903806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:34.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.773+0000 7f903e301640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9038144840 0x7f903806c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55394/0 (socket says 172.21.15.177:55394) 2023-11-28T20:09:34.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.773+0000 7f903e301640 1 -- 172.21.15.177:0/370296438 learned_addr learned my addr 172.21.15.177:0/370296438 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:34.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.773+0000 7f903db00640 1 --2- 172.21.15.177:0/370296438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9038072180 0x7f903806c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:34.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.773+0000 7f903e301640 1 -- 172.21.15.177:0/370296438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9038072180 msgr2=0x7f903806c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:34.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.773+0000 7f903e301640 1 --2- 172.21.15.177:0/370296438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9038072180 0x7f903806c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.773+0000 7f903e301640 1 -- 172.21.15.177:0/370296438 >> v1:172.21.15.195:6789/0 conn(0x7f9038070460 legacy=0x7f90380708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:34.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.773+0000 7f903e301640 1 -- 172.21.15.177:0/370296438 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90380716a0 con 0x7f9038144840 2023-11-28T20:09:34.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.773+0000 7f903db00640 1 --2- 172.21.15.177:0/370296438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9038072180 0x7f903806c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:34.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.777+0000 7f903e301640 1 --2- 172.21.15.177:0/370296438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9038144840 0x7f903806c2c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9034009870 tx=0x7f903401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3098d47a4123899 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:34.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.777+0000 7f903d2ff640 1 -- 172.21.15.177:0/370296438 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340aa670 con 0x7f9038144840 2023-11-28T20:09:34.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.777+0000 7f903d2ff640 1 -- 172.21.15.177:0/370296438 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90340aa7d0 con 0x7f9038144840 2023-11-28T20:09:34.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.777+0000 7f903d2ff640 1 -- 172.21.15.177:0/370296438 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340aab60 con 0x7f9038144840 2023-11-28T20:09:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.777+0000 7f9040565640 1 -- 172.21.15.177:0/370296438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9038144840 msgr2=0x7f903806c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.777+0000 7f9040565640 1 --2- 172.21.15.177:0/370296438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9038144840 0x7f903806c2c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9034009870 tx=0x7f903401c510 comp rx=0 tx=0).stop 2023-11-28T20:09:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.777+0000 7f9040565640 1 -- 172.21.15.177:0/370296438 shutdown_connections 2023-11-28T20:09:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.777+0000 7f9040565640 1 --2- 172.21.15.177:0/370296438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9038072180 0x7f903806c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.777+0000 7f9040565640 1 --2- 172.21.15.177:0/370296438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9038144840 0x7f903806c2c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.777+0000 7f9040565640 1 -- 172.21.15.177:0/370296438 >> 172.21.15.177:0/370296438 conn(0x7f903806a530 msgr2=0x7f903806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.777+0000 7f9040565640 1 -- 172.21.15.177:0/370296438 shutdown_connections 2023-11-28T20:09:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.777+0000 7f9040565640 1 -- 172.21.15.177:0/370296438 wait complete. 2023-11-28T20:09:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.777+0000 7f9040565640 1 Processor -- start 2023-11-28T20:09:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.777+0000 7f9040565640 1 -- start start 2023-11-28T20:09:34.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f9040565640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9038070460 0x7f903815fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:34.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f9040565640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9038072180 0x7f903813a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:34.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f9040565640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9038144840 0x7f903813f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:34.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f9040565640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90381419f0 con 0x7f9038072180 2023-11-28T20:09:34.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f9040565640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9038141c60 con 0x7f9038070460 2023-11-28T20:09:34.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f9040565640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9038141f40 con 0x7f9038144840 2023-11-28T20:09:34.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f903db00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9038072180 0x7f903813a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:34.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f903db00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9038072180 0x7f903813a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55396/0 (socket says 172.21.15.177:55396) 2023-11-28T20:09:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f903db00640 1 -- 172.21.15.177:0/3788566254 learned_addr learned my addr 172.21.15.177:0/3788566254 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f903e301640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9038070460 0x7f903815fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f903db00640 1 -- 172.21.15.177:0/3788566254 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9038144840 msgr2=0x7f903813f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f903eb02640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9038144840 0x7f903813f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f903db00640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9038144840 0x7f903813f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f903db00640 1 -- 172.21.15.177:0/3788566254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9038070460 msgr2=0x7f903815fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f903db00640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9038070460 0x7f903815fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f903db00640 1 -- 172.21.15.177:0/3788566254 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90340094d0 con 0x7f9038072180 2023-11-28T20:09:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f903eb02640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9038144840 0x7f903813f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:34.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f903e301640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9038070460 0x7f903815fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:34.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f903db00640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9038072180 0x7f903813a800 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f902800c7f0 tx=0x7f902800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:34.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f902effd640 1 -- 172.21.15.177:0/3788566254 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902800cea0 con 0x7f9038072180 2023-11-28T20:09:34.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f902effd640 1 -- 172.21.15.177:0/3788566254 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9028007a30 con 0x7f9038072180 2023-11-28T20:09:34.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f902effd640 1 -- 172.21.15.177:0/3788566254 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9028007de0 con 0x7f9038072180 2023-11-28T20:09:34.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f9040565640 1 -- 172.21.15.177:0/3788566254 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9038142220 con 0x7f9038072180 2023-11-28T20:09:34.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f9040565640 1 -- 172.21.15.177:0/3788566254 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903813ad40 con 0x7f9038072180 2023-11-28T20:09:34.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f9040565640 1 -- 172.21.15.177:0/3788566254 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90380cb1d0 con 0x7f9038072180 2023-11-28T20:09:34.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.781+0000 7f902effd640 1 -- 172.21.15.177:0/3788566254 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f90280113f0 con 0x7f9038072180 2023-11-28T20:09:34.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.785+0000 7f902effd640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f901c066470 0x7f901c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:34.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.785+0000 7f902effd640 1 -- 172.21.15.177:0/3788566254 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9028083e00 con 0x7f9038072180 2023-11-28T20:09:34.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.785+0000 7f903e301640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f901c066470 0x7f901c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:34.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.785+0000 7f903e301640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f901c066470 0x7f901c068930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f90340ae000 tx=0x7f90340a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:34.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.789+0000 7f902effd640 1 -- 172.21.15.177:0/3788566254 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90280514e0 con 0x7f9038072180 2023-11-28T20:09:34.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.937+0000 7f9040565640 1 -- 172.21.15.177:0/3788566254 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9038069440 con 0x7f9038072180 2023-11-28T20:09:34.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.937+0000 7f902effd640 1 -- 172.21.15.177:0/3788566254 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+13048 (secure 0 0 0) 0x7f9028054b00 con 0x7f9038072180 2023-11-28T20:09:34.942 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:34.942 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":40,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:09:33.601899+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.177:6837/3143070912":"2023-11-29T20:09:29.354587+0000","172.21.15.177:6835/3143070912":"2023-11-29T20:09:29.354587+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:09:34.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.941+0000 7f9040565640 1 -- 172.21.15.177:0/3788566254 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f901c066470 msgr2=0x7f901c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:34.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.941+0000 7f9040565640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f901c066470 0x7f901c068930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f90340ae000 tx=0x7f90340a7000 comp rx=0 tx=0).stop 2023-11-28T20:09:34.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.941+0000 7f9040565640 1 -- 172.21.15.177:0/3788566254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9038072180 msgr2=0x7f903813a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:34.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.941+0000 7f9040565640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9038072180 0x7f903813a800 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f902800c7f0 tx=0x7f902800ccb0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.941+0000 7f9040565640 1 -- 172.21.15.177:0/3788566254 shutdown_connections 2023-11-28T20:09:34.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.941+0000 7f9040565640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f901c066470 0x7f901c068930 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.941+0000 7f9040565640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9038144840 0x7f903813f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.941+0000 7f9040565640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9038072180 0x7f903813a800 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.941+0000 7f9040565640 1 --2- 172.21.15.177:0/3788566254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9038070460 0x7f903815fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:34.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.941+0000 7f9040565640 1 -- 172.21.15.177:0/3788566254 >> 172.21.15.177:0/3788566254 conn(0x7f903806a530 msgr2=0x7f903806c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:34.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.941+0000 7f9040565640 1 -- 172.21.15.177:0/3788566254 shutdown_connections 2023-11-28T20:09:34.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:34.941+0000 7f9040565640 1 -- 172.21.15.177:0/3788566254 wait complete. 2023-11-28T20:09:34.963 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:09:34.963 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:09:35.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.101+0000 7fc1eb49c640 1 Processor -- start 2023-11-28T20:09:35.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.101+0000 7fc1eb49c640 1 -- start start 2023-11-28T20:09:35.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.101+0000 7fc1eb49c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e4158ca0 0x7fc1e415eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:35.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.101+0000 7fc1eb49c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e415b670 con 0x7fc1e40cba10 2023-11-28T20:09:35.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.101+0000 7fc1eb49c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e415c510 con 0x7fc1e40b42d0 2023-11-28T20:09:35.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.101+0000 7fc1eb49c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e415f410 con 0x7fc1e4158ca0 2023-11-28T20:09:35.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.101+0000 7fc1e8a37640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc1e40cba10 0x7fc1e415be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51068/0 (socket says 172.21.15.177:51068) 2023-11-28T20:09:35.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.101+0000 7fc1e8a37640 1 -- 172.21.15.177:0/1879468412 learned_addr learned my addr 172.21.15.177:0/1879468412 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:35.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.101+0000 7fc1e9238640 1 --2- 172.21.15.177:0/1879468412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e4158ca0 0x7fc1e415eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:35.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.105+0000 7fc1dbfff640 1 -- 172.21.15.177:0/1879468412 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474643751 0 0) 0x7fc1e415b670 con 0x7fc1e40cba10 2023-11-28T20:09:35.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.105+0000 7fc1dbfff640 1 -- 172.21.15.177:0/1879468412 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d0003530 con 0x7fc1e40cba10 2023-11-28T20:09:35.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.105+0000 7fc1dbfff640 1 -- 172.21.15.177:0/1879468412 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674416219 0 0) 0x7fc1e415c510 con 0x7fc1e40b42d0 2023-11-28T20:09:35.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.105+0000 7fc1dbfff640 1 -- 172.21.15.177:0/1879468412 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e415b670 con 0x7fc1e40b42d0 2023-11-28T20:09:35.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.105+0000 7fc1e9238640 1 -- 172.21.15.177:0/1879468412 >> v1:172.21.15.195:6789/0 conn(0x7fc1e40b42d0 legacy=0x7fc1e40703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:35.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.105+0000 7fc1dbfff640 1 -- 172.21.15.177:0/1879468412 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4152223053 0 0) 0x7fc1d0003530 con 0x7fc1e40cba10 2023-11-28T20:09:35.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.105+0000 7fc1e9238640 1 -- 172.21.15.177:0/1879468412 >> v1:172.21.15.177:6789/0 conn(0x7fc1e40cba10 legacy=0x7fc1e415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:35.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.105+0000 7fc1e9238640 1 -- 172.21.15.177:0/1879468412 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e415f6f0 con 0x7fc1e4158ca0 2023-11-28T20:09:35.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.105+0000 7fc1e9238640 1 --2- 172.21.15.177:0/1879468412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e4158ca0 0x7fc1e415eb50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00097f0 tx=0x7fc1e001c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f03d1560b3b3efa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:35.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.105+0000 7fc1dbfff640 1 -- 172.21.15.177:0/1879468412 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4001680 con 0x7fc1e4158ca0 2023-11-28T20:09:35.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.105+0000 7fc1dbfff640 1 -- 172.21.15.177:0/1879468412 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e00a7050 con 0x7fc1e4158ca0 2023-11-28T20:09:35.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.105+0000 7fc1dbfff640 1 -- 172.21.15.177:0/1879468412 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0004250 con 0x7fc1e4158ca0 2023-11-28T20:09:35.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1eb49c640 1 -- 172.21.15.177:0/1879468412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e4158ca0 msgr2=0x7fc1e415eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:35.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1eb49c640 1 --2- 172.21.15.177:0/1879468412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e4158ca0 0x7fc1e415eb50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00097f0 tx=0x7fc1e001c3b0 comp rx=0 tx=0).stop 2023-11-28T20:09:35.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1eb49c640 1 -- 172.21.15.177:0/1879468412 shutdown_connections 2023-11-28T20:09:35.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1eb49c640 1 --2- 172.21.15.177:0/1879468412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e4158ca0 0x7fc1e415eb50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:35.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1eb49c640 1 -- 172.21.15.177:0/1879468412 >> 172.21.15.177:0/1879468412 conn(0x7fc1e40b0cc0 msgr2=0x7fc1e40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:35.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1eb49c640 1 -- 172.21.15.177:0/1879468412 shutdown_connections 2023-11-28T20:09:35.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1eb49c640 1 -- 172.21.15.177:0/1879468412 wait complete. 2023-11-28T20:09:35.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1eb49c640 1 Processor -- start 2023-11-28T20:09:35.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1eb49c640 1 -- start start 2023-11-28T20:09:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1eb49c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e40b42d0 0x7fc1e40b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1eb49c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1e40cba10 0x7fc1e40ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1eb49c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e4158ca0 0x7fc1e40ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1eb49c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e4150240 con 0x7fc1e40cba10 2023-11-28T20:09:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1eb49c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e41510a0 con 0x7fc1e40b42d0 2023-11-28T20:09:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1eb49c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e4151530 con 0x7fc1e4158ca0 2023-11-28T20:09:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1e8a37640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1e40cba10 0x7fc1e40ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1e9238640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e40b42d0 0x7fc1e40b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1e8a37640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1e40cba10 0x7fc1e40ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55398/0 (socket says 172.21.15.177:55398) 2023-11-28T20:09:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1e8a37640 1 -- 172.21.15.177:0/1011819270 learned_addr learned my addr 172.21.15.177:0/1011819270 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1e9a39640 1 --2- 172.21.15.177:0/1011819270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e4158ca0 0x7fc1e40ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1e8a37640 1 -- 172.21.15.177:0/1011819270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e4158ca0 msgr2=0x7fc1e40ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1e8a37640 1 --2- 172.21.15.177:0/1011819270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e4158ca0 0x7fc1e40ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1e8a37640 1 -- 172.21.15.177:0/1011819270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e40b42d0 msgr2=0x7fc1e40b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1e8a37640 1 --2- 172.21.15.177:0/1011819270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e40b42d0 0x7fc1e40b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1e8a37640 1 -- 172.21.15.177:0/1011819270 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e0009420 con 0x7fc1e40cba10 2023-11-28T20:09:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.109+0000 7fc1e9238640 1 --2- 172.21.15.177:0/1011819270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e40b42d0 0x7fc1e40b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:09:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.113+0000 7fc1e8a37640 1 --2- 172.21.15.177:0/1011819270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1e40cba10 0x7fc1e40ae0b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400c750 tx=0x7fc1d400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.113+0000 7fc1d9ffb640 1 -- 172.21.15.177:0/1011819270 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4005af0 con 0x7fc1e40cba10 2023-11-28T20:09:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.113+0000 7fc1d9ffb640 1 -- 172.21.15.177:0/1011819270 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d4005c50 con 0x7fc1e40cba10 2023-11-28T20:09:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.113+0000 7fc1eb49c640 1 -- 172.21.15.177:0/1011819270 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e40b4c70 con 0x7fc1e40cba10 2023-11-28T20:09:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.113+0000 7fc1d9ffb640 1 -- 172.21.15.177:0/1011819270 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4007070 con 0x7fc1e40cba10 2023-11-28T20:09:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.113+0000 7fc1eb49c640 1 -- 172.21.15.177:0/1011819270 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e4150770 con 0x7fc1e40cba10 2023-11-28T20:09:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.113+0000 7fc1eb49c640 1 -- 172.21.15.177:0/1011819270 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e4073cf0 con 0x7fc1e40cba10 2023-11-28T20:09:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.113+0000 7fc1d9ffb640 1 -- 172.21.15.177:0/1011819270 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc1d40071d0 con 0x7fc1e40cba10 2023-11-28T20:09:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.113+0000 7fc1d9ffb640 1 --2- 172.21.15.177:0/1011819270 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1c8066470 0x7fc1c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.113+0000 7fc1d9ffb640 1 -- 172.21.15.177:0/1011819270 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc1d4083260 con 0x7fc1e40cba10 2023-11-28T20:09:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.113+0000 7fc1e9238640 1 --2- 172.21.15.177:0/1011819270 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1c8066470 0x7fc1c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.117+0000 7fc1e9238640 1 --2- 172.21.15.177:0/1011819270 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1c8066470 0x7fc1c8068930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00ad000 tx=0x7fc1e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:35.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.117+0000 7fc1d9ffb640 1 -- 172.21.15.177:0/1011819270 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc1e4073cf0 con 0x7fc1e40cba10 2023-11-28T20:09:35.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.269+0000 7fc1eb49c640 1 -- 172.21.15.177:0/1011819270 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1e4073cf0 con 0x7fc1e40cba10 2023-11-28T20:09:35.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.269+0000 7fc1d9ffb640 1 -- 172.21.15.177:0/1011819270 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1e4073cf0 con 0x7fc1e40cba10 2023-11-28T20:09:35.273 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:09:35.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.273+0000 7fc1eb49c640 1 -- 172.21.15.177:0/1011819270 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1c8066470 msgr2=0x7fc1c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:35.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.273+0000 7fc1eb49c640 1 --2- 172.21.15.177:0/1011819270 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1c8066470 0x7fc1c8068930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00ad000 tx=0x7fc1e0008040 comp rx=0 tx=0).stop 2023-11-28T20:09:35.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.273+0000 7fc1eb49c640 1 -- 172.21.15.177:0/1011819270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1e40cba10 msgr2=0x7fc1e40ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:35.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.273+0000 7fc1eb49c640 1 --2- 172.21.15.177:0/1011819270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1e40cba10 0x7fc1e40ae0b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400c750 tx=0x7fc1d400cc10 comp rx=0 tx=0).stop 2023-11-28T20:09:35.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.273+0000 7fc1eb49c640 1 -- 172.21.15.177:0/1011819270 shutdown_connections 2023-11-28T20:09:35.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.273+0000 7fc1eb49c640 1 --2- 172.21.15.177:0/1011819270 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc1c8066470 0x7fc1c8068930 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:35.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.273+0000 7fc1eb49c640 1 --2- 172.21.15.177:0/1011819270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e4158ca0 0x7fc1e40ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:35.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.273+0000 7fc1eb49c640 1 --2- 172.21.15.177:0/1011819270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1e40cba10 0x7fc1e40ae0b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:35.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.273+0000 7fc1eb49c640 1 --2- 172.21.15.177:0/1011819270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e40b42d0 0x7fc1e40b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:35.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.273+0000 7fc1eb49c640 1 -- 172.21.15.177:0/1011819270 >> 172.21.15.177:0/1011819270 conn(0x7fc1e40b0cc0 msgr2=0x7fc1e414f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:35.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.273+0000 7fc1eb49c640 1 -- 172.21.15.177:0/1011819270 shutdown_connections 2023-11-28T20:09:35.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.273+0000 7fc1eb49c640 1 -- 172.21.15.177:0/1011819270 wait complete. 2023-11-28T20:09:35.294 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-11-28T20:09:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9cc4bb640 1 Processor -- start 2023-11-28T20:09:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9cc4bb640 1 -- start start 2023-11-28T20:09:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9cc4bb640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc9c406c9d0 0x7fc9c4070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9cc4bb640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c4072180 0x7fc9c40709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9cc4bb640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c40710e0 con 0x7fc9c4144840 2023-11-28T20:09:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9cc4bb640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c415f010 con 0x7fc9c406c9d0 2023-11-28T20:09:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9cc4bb640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c4070ee0 con 0x7fc9c4072180 2023-11-28T20:09:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9caa58640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c4072180 0x7fc9c40709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9c9a56640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc9c406c9d0 0x7fc9c4070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:35.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9caa58640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c4072180 0x7fc9c40709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:32926/0 (socket says 172.21.15.177:32926) 2023-11-28T20:09:35.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9caa58640 1 -- 172.21.15.177:0/1757731334 learned_addr learned my addr 172.21.15.177:0/1757731334 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:35.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9ca257640 1 --1- 172.21.15.177:0/1757731334 >> v1:172.21.15.195:6789/0 conn(0x7fc9c4144840 0x7fc9c406c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:48298/0 (socket says 172.21.15.177:48298) 2023-11-28T20:09:35.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9c9a56640 1 -- 172.21.15.177:0/1757731334 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c4072180 msgr2=0x7fc9c40709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:35.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9c9a56640 1 --2- 172.21.15.177:0/1757731334 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c4072180 0x7fc9c40709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:35.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9c9a56640 1 -- 172.21.15.177:0/1757731334 >> v1:172.21.15.195:6789/0 conn(0x7fc9c4144840 legacy=0x7fc9c406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:35.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9c9a56640 1 -- 172.21.15.177:0/1757731334 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c40713c0 con 0x7fc9c406c9d0 2023-11-28T20:09:35.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.429+0000 7fc9caa58640 1 --2- 172.21.15.177:0/1757731334 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c4072180 0x7fc9c40709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:09:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.433+0000 7fc9c9a56640 1 --2- 172.21.15.177:0/1757731334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c406c9d0 0x7fc9c4070460 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40097c0 tx=0x7fc9b401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1b2fe57d5e80570 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.433+0000 7fc9c9255640 1 -- 172.21.15.177:0/1757731334 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40ab650 con 0x7fc9c406c9d0 2023-11-28T20:09:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.433+0000 7fc9c9255640 1 -- 172.21.15.177:0/1757731334 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b40ab7b0 con 0x7fc9c406c9d0 2023-11-28T20:09:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.433+0000 7fc9c9255640 1 -- 172.21.15.177:0/1757731334 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40abb40 con 0x7fc9c406c9d0 2023-11-28T20:09:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.433+0000 7fc9cc4bb640 1 -- 172.21.15.177:0/1757731334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c406c9d0 msgr2=0x7fc9c4070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.433+0000 7fc9cc4bb640 1 --2- 172.21.15.177:0/1757731334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c406c9d0 0x7fc9c4070460 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40097c0 tx=0x7fc9b401c450 comp rx=0 tx=0).stop 2023-11-28T20:09:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.433+0000 7fc9cc4bb640 1 -- 172.21.15.177:0/1757731334 shutdown_connections 2023-11-28T20:09:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.433+0000 7fc9cc4bb640 1 --2- 172.21.15.177:0/1757731334 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c4072180 0x7fc9c40709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.433+0000 7fc9cc4bb640 1 --2- 172.21.15.177:0/1757731334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c406c9d0 0x7fc9c4070460 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.433+0000 7fc9cc4bb640 1 -- 172.21.15.177:0/1757731334 >> 172.21.15.177:0/1757731334 conn(0x7fc9c406a530 msgr2=0x7fc9c406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.433+0000 7fc9cc4bb640 1 -- 172.21.15.177:0/1757731334 shutdown_connections 2023-11-28T20:09:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.433+0000 7fc9cc4bb640 1 -- 172.21.15.177:0/1757731334 wait complete. 2023-11-28T20:09:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9cc4bb640 1 Processor -- start 2023-11-28T20:09:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9cc4bb640 1 -- start start 2023-11-28T20:09:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9cc4bb640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c406c9d0 0x7fc9c415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9cc4bb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c4072180 0x7fc9c413a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9cc4bb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c4144840 0x7fc9c40b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9cc4bb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c415adf0 con 0x7fc9c4144840 2023-11-28T20:09:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9cc4bb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c413b5c0 con 0x7fc9c4072180 2023-11-28T20:09:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9cc4bb640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c413b000 con 0x7fc9c406c9d0 2023-11-28T20:09:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9caa58640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c4144840 0x7fc9c40b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9caa58640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c4144840 0x7fc9c40b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55408/0 (socket says 172.21.15.177:55408) 2023-11-28T20:09:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9caa58640 1 -- 172.21.15.177:0/1390961715 learned_addr learned my addr 172.21.15.177:0/1390961715 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9ca257640 1 --2- 172.21.15.177:0/1390961715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c406c9d0 0x7fc9c415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9c9a56640 1 --2- 172.21.15.177:0/1390961715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c4072180 0x7fc9c413a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9caa58640 1 -- 172.21.15.177:0/1390961715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c406c9d0 msgr2=0x7fc9c415a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9caa58640 1 --2- 172.21.15.177:0/1390961715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c406c9d0 0x7fc9c415a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9caa58640 1 -- 172.21.15.177:0/1390961715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c4072180 msgr2=0x7fc9c413a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9caa58640 1 --2- 172.21.15.177:0/1390961715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c4072180 0x7fc9c413a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9caa58640 1 -- 172.21.15.177:0/1390961715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc009b30 con 0x7fc9c4144840 2023-11-28T20:09:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.437+0000 7fc9caa58640 1 --2- 172.21.15.177:0/1390961715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c4144840 0x7fc9c40b0ca0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00efc0 tx=0x7fc9bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.441+0000 7fc9baffd640 1 -- 172.21.15.177:0/1390961715 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc018070 con 0x7fc9c4144840 2023-11-28T20:09:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.441+0000 7fc9baffd640 1 -- 172.21.15.177:0/1390961715 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc00f040 con 0x7fc9c4144840 2023-11-28T20:09:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.441+0000 7fc9baffd640 1 -- 172.21.15.177:0/1390961715 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc00ce00 con 0x7fc9c4144840 2023-11-28T20:09:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.441+0000 7fc9cc4bb640 1 -- 172.21.15.177:0/1390961715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b4009420 con 0x7fc9c4144840 2023-11-28T20:09:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.441+0000 7fc9cc4bb640 1 -- 172.21.15.177:0/1390961715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c413cd50 con 0x7fc9c4144840 2023-11-28T20:09:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.441+0000 7fc9cc4bb640 1 -- 172.21.15.177:0/1390961715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c40cb1d0 con 0x7fc9c4144840 2023-11-28T20:09:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.441+0000 7fc9baffd640 1 -- 172.21.15.177:0/1390961715 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc9bc014480 con 0x7fc9c4144840 2023-11-28T20:09:35.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.441+0000 7fc9baffd640 1 --2- 172.21.15.177:0/1390961715 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc9a8066470 0x7fc9a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:35.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.441+0000 7fc9baffd640 1 -- 172.21.15.177:0/1390961715 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc9bc083d70 con 0x7fc9c4144840 2023-11-28T20:09:35.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.441+0000 7fc9ca257640 1 --2- 172.21.15.177:0/1390961715 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc9a8066470 0x7fc9a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:35.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.445+0000 7fc9ca257640 1 --2- 172.21.15.177:0/1390961715 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc9a8066470 0x7fc9a8068930 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0000f70 tx=0x7fc9c0007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:35.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.445+0000 7fc9baffd640 1 -- 172.21.15.177:0/1390961715 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc9bc051590 con 0x7fc9c4144840 2023-11-28T20:09:35.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:35.653+0000 7fc9cc4bb640 1 -- 172.21.15.177:0/1390961715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7fc9c4069440 con 0x7fc9c4144840 2023-11-28T20:09:36.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.613+0000 7fc9baffd640 1 -- 172.21.15.177:0/1390961715 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v133) v1 ==== 137+0+0 (secure 0 0 0) 0x7fc9bc054bb0 con 0x7fc9c4144840 2023-11-28T20:09:36.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.617+0000 7fc9cc4bb640 1 -- 172.21.15.177:0/1390961715 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc9a8066470 msgr2=0x7fc9a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:36.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.617+0000 7fc9cc4bb640 1 --2- 172.21.15.177:0/1390961715 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc9a8066470 0x7fc9a8068930 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0000f70 tx=0x7fc9c0007e50 comp rx=0 tx=0).stop 2023-11-28T20:09:36.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.617+0000 7fc9cc4bb640 1 -- 172.21.15.177:0/1390961715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c4144840 msgr2=0x7fc9c40b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:36.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.617+0000 7fc9cc4bb640 1 --2- 172.21.15.177:0/1390961715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c4144840 0x7fc9c40b0ca0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00efc0 tx=0x7fc9bc00c490 comp rx=0 tx=0).stop 2023-11-28T20:09:36.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.617+0000 7fc9cc4bb640 1 -- 172.21.15.177:0/1390961715 shutdown_connections 2023-11-28T20:09:36.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.617+0000 7fc9cc4bb640 1 --2- 172.21.15.177:0/1390961715 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc9a8066470 0x7fc9a8068930 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:36.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.617+0000 7fc9cc4bb640 1 --2- 172.21.15.177:0/1390961715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c4144840 0x7fc9c40b0ca0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:36.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.617+0000 7fc9cc4bb640 1 --2- 172.21.15.177:0/1390961715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c4072180 0x7fc9c413a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:36.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.617+0000 7fc9cc4bb640 1 --2- 172.21.15.177:0/1390961715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c406c9d0 0x7fc9c415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:36.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.617+0000 7fc9cc4bb640 1 -- 172.21.15.177:0/1390961715 >> 172.21.15.177:0/1390961715 conn(0x7fc9c406a530 msgr2=0x7fc9c4165260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:36.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.617+0000 7fc9cc4bb640 1 -- 172.21.15.177:0/1390961715 shutdown_connections 2023-11-28T20:09:36.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.617+0000 7fc9cc4bb640 1 -- 172.21.15.177:0/1390961715 wait complete. 2023-11-28T20:09:36.642 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T20:09:36.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30eea79640 1 Processor -- start 2023-11-28T20:09:36.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30eea79640 1 -- start start 2023-11-28T20:09:36.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30eea79640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30e813f5f0 0x7f30e80ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:36.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30eea79640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e813d2b0 con 0x7f30e8071d90 2023-11-28T20:09:36.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30eea79640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e80cdd70 con 0x7f30e815adb0 2023-11-28T20:09:36.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30eea79640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e8140520 con 0x7f30e813f5f0 2023-11-28T20:09:36.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30ec815640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f30e8071d90 0x7f30e8072170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51072/0 (socket says 172.21.15.177:51072) 2023-11-28T20:09:36.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30ec815640 1 -- 172.21.15.177:0/4174679302 learned_addr learned my addr 172.21.15.177:0/4174679302 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:36.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30ed016640 1 --2- 172.21.15.177:0/4174679302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30e813f5f0 0x7f30e80ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:36.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30e77fe640 1 -- 172.21.15.177:0/4174679302 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081526971 0 0) 0x7f30e813d2b0 con 0x7f30e8071d90 2023-11-28T20:09:36.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30e77fe640 1 -- 172.21.15.177:0/4174679302 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30d8003530 con 0x7f30e8071d90 2023-11-28T20:09:36.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30e77fe640 1 -- 172.21.15.177:0/4174679302 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407975036 0 0) 0x7f30e80cdd70 con 0x7f30e815adb0 2023-11-28T20:09:36.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30e77fe640 1 -- 172.21.15.177:0/4174679302 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30e813d2b0 con 0x7f30e815adb0 2023-11-28T20:09:36.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30ed016640 1 -- 172.21.15.177:0/4174679302 >> v1:172.21.15.195:6789/0 conn(0x7f30e815adb0 legacy=0x7f30e813d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:36.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30ed016640 1 -- 172.21.15.177:0/4174679302 >> v1:172.21.15.177:6789/0 conn(0x7f30e8071d90 legacy=0x7f30e8072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:36.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.785+0000 7f30ed016640 1 -- 172.21.15.177:0/4174679302 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e813ff60 con 0x7f30e813f5f0 2023-11-28T20:09:36.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.789+0000 7f30ed016640 1 --2- 172.21.15.177:0/4174679302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30e813f5f0 0x7f30e80ce200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f30e0009dc0 tx=0x7f30e001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b98db411262f7ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:36.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.789+0000 7f30e77fe640 1 -- 172.21.15.177:0/4174679302 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e00a5920 con 0x7f30e813f5f0 2023-11-28T20:09:36.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.789+0000 7f30e77fe640 1 -- 172.21.15.177:0/4174679302 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e00a5a80 con 0x7f30e813f5f0 2023-11-28T20:09:36.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.789+0000 7f30e77fe640 1 -- 172.21.15.177:0/4174679302 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e00a5e10 con 0x7f30e813f5f0 2023-11-28T20:09:36.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.789+0000 7f30eea79640 1 -- 172.21.15.177:0/4174679302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30e813f5f0 msgr2=0x7f30e80ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:36.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.789+0000 7f30eea79640 1 --2- 172.21.15.177:0/4174679302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30e813f5f0 0x7f30e80ce200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f30e0009dc0 tx=0x7f30e001c970 comp rx=0 tx=0).stop 2023-11-28T20:09:36.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.789+0000 7f30eea79640 1 -- 172.21.15.177:0/4174679302 shutdown_connections 2023-11-28T20:09:36.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.789+0000 7f30eea79640 1 --2- 172.21.15.177:0/4174679302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30e813f5f0 0x7f30e80ce200 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:36.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.789+0000 7f30eea79640 1 -- 172.21.15.177:0/4174679302 >> 172.21.15.177:0/4174679302 conn(0x7f30e80b0cc0 msgr2=0x7f30e80b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:36.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.789+0000 7f30eea79640 1 -- 172.21.15.177:0/4174679302 shutdown_connections 2023-11-28T20:09:36.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.789+0000 7f30eea79640 1 -- 172.21.15.177:0/4174679302 wait complete. 2023-11-28T20:09:36.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30eea79640 1 Processor -- start 2023-11-28T20:09:36.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30eea79640 1 -- start start 2023-11-28T20:09:36.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30eea79640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30e8071d90 0x7f30e813ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:36.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30eea79640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e813f5f0 0x7f30e80b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:36.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30eea79640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30e815adb0 0x7f30e8153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:36.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30eea79640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e8141a20 con 0x7f30e813f5f0 2023-11-28T20:09:36.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30eea79640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e80b45b0 con 0x7f30e815adb0 2023-11-28T20:09:36.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30eea79640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e80b42e0 con 0x7f30e8071d90 2023-11-28T20:09:36.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30e7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e813f5f0 0x7f30e80b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:36.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30e7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e813f5f0 0x7f30e80b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55410/0 (socket says 172.21.15.177:55410) 2023-11-28T20:09:36.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30e7fff640 1 -- 172.21.15.177:0/3778302426 learned_addr learned my addr 172.21.15.177:0/3778302426 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:36.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30ed016640 1 --2- 172.21.15.177:0/3778302426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30e815adb0 0x7f30e8153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:36.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30ec815640 1 --2- 172.21.15.177:0/3778302426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30e8071d90 0x7f30e813ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:36.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30e7fff640 1 -- 172.21.15.177:0/3778302426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30e8071d90 msgr2=0x7f30e813ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:36.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30e7fff640 1 --2- 172.21.15.177:0/3778302426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30e8071d90 0x7f30e813ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:36.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30e7fff640 1 -- 172.21.15.177:0/3778302426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30e815adb0 msgr2=0x7f30e8153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:36.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30e7fff640 1 --2- 172.21.15.177:0/3778302426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30e815adb0 0x7f30e8153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:36.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30e7fff640 1 -- 172.21.15.177:0/3778302426 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e0009a70 con 0x7f30e813f5f0 2023-11-28T20:09:36.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30e7fff640 1 --2- 172.21.15.177:0/3778302426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e813f5f0 0x7f30e80b3da0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f30d400c490 tx=0x7f30d400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:36.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30e57fa640 1 -- 172.21.15.177:0/3778302426 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d40052d0 con 0x7f30e813f5f0 2023-11-28T20:09:36.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30e57fa640 1 -- 172.21.15.177:0/3778302426 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d4005430 con 0x7f30e813f5f0 2023-11-28T20:09:36.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30e57fa640 1 -- 172.21.15.177:0/3778302426 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d4012870 con 0x7f30e813f5f0 2023-11-28T20:09:36.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30eea79640 1 -- 172.21.15.177:0/3778302426 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e80b4870 con 0x7f30e813f5f0 2023-11-28T20:09:36.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30eea79640 1 -- 172.21.15.177:0/3778302426 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e81542d0 con 0x7f30e813f5f0 2023-11-28T20:09:36.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.793+0000 7f30eea79640 1 -- 172.21.15.177:0/3778302426 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e80693d0 con 0x7f30e813f5f0 2023-11-28T20:09:36.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.797+0000 7f30e57fa640 1 -- 172.21.15.177:0/3778302426 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f30d40129d0 con 0x7f30e813f5f0 2023-11-28T20:09:36.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.797+0000 7f30e57fa640 1 --2- 172.21.15.177:0/3778302426 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f30cc066470 0x7f30cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:36.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.797+0000 7f30e57fa640 1 -- 172.21.15.177:0/3778302426 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f30d40836b0 con 0x7f30e813f5f0 2023-11-28T20:09:36.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.797+0000 7f30ec815640 1 --2- 172.21.15.177:0/3778302426 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f30cc066470 0x7f30cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:36.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.797+0000 7f30ec815640 1 --2- 172.21.15.177:0/3778302426 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f30cc066470 0x7f30cc068930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0011f0 tx=0x7f30dc007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:36.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.801+0000 7f30e57fa640 1 -- 172.21.15.177:0/3778302426 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30d4050e40 con 0x7f30e813f5f0 2023-11-28T20:09:36.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.949+0000 7f30eea79640 1 -- 172.21.15.177:0/3778302426 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f30e806e710 con 0x7f30e813f5f0 2023-11-28T20:09:36.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.957+0000 7f30e57fa640 1 -- 172.21.15.177:0/3778302426 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f30d4054460 con 0x7f30e813f5f0 2023-11-28T20:09:36.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.957+0000 7f30eea79640 1 -- 172.21.15.177:0/3778302426 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f30cc066470 msgr2=0x7f30cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:36.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.957+0000 7f30eea79640 1 --2- 172.21.15.177:0/3778302426 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f30cc066470 0x7f30cc068930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0011f0 tx=0x7f30dc007d40 comp rx=0 tx=0).stop 2023-11-28T20:09:36.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.957+0000 7f30eea79640 1 -- 172.21.15.177:0/3778302426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e813f5f0 msgr2=0x7f30e80b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:36.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.957+0000 7f30eea79640 1 --2- 172.21.15.177:0/3778302426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e813f5f0 0x7f30e80b3da0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f30d400c490 tx=0x7f30d400c950 comp rx=0 tx=0).stop 2023-11-28T20:09:36.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.957+0000 7f30eea79640 1 -- 172.21.15.177:0/3778302426 shutdown_connections 2023-11-28T20:09:36.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.957+0000 7f30eea79640 1 --2- 172.21.15.177:0/3778302426 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f30cc066470 0x7f30cc068930 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:36.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.957+0000 7f30eea79640 1 --2- 172.21.15.177:0/3778302426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30e815adb0 0x7f30e8153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:36.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.957+0000 7f30eea79640 1 --2- 172.21.15.177:0/3778302426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e813f5f0 0x7f30e80b3da0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:36.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.957+0000 7f30eea79640 1 --2- 172.21.15.177:0/3778302426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30e8071d90 0x7f30e813ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:36.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.957+0000 7f30eea79640 1 -- 172.21.15.177:0/3778302426 >> 172.21.15.177:0/3778302426 conn(0x7f30e80b0cc0 msgr2=0x7f30e813b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:36.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.957+0000 7f30eea79640 1 -- 172.21.15.177:0/3778302426 shutdown_connections 2023-11-28T20:09:36.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:36.957+0000 7f30eea79640 1 -- 172.21.15.177:0/3778302426 wait complete. 2023-11-28T20:09:36.982 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T20:09:36.983 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:09:37.081 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:09:37.177 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T20:09:37.177 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:09:37.177 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:09:37.186 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354508k,nr_inodes=4088627,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=883 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T20:09:37.189 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:09:37.189 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:09:37.199 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2702 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T20:09:37.199 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:09:37.199 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:09:37.243 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354508k,nr_inodes=4088627,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=883 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T20:09:37.243 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:09:37.243 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:09:37.252 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2702 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T20:09:37.252 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T20:09:37.253 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:09:37.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f6268b93640 1 Processor -- start 2023-11-28T20:09:37.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f6268b93640 1 -- start start 2023-11-28T20:09:37.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f6268b93640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6264160ca0 0x7f62640cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:37.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f6268b93640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f62640ce680 0x7f62640b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:37.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f6268b93640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62640cf130 con 0x7f62641608c0 2023-11-28T20:09:37.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f6268b93640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62640ceb70 con 0x7f62640ce680 2023-11-28T20:09:37.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f6268b93640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62640cee50 con 0x7f6264160ca0 2023-11-28T20:09:37.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f62637fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f62641608c0 0x7f62640cf510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51078/0 (socket says 172.21.15.177:51078) 2023-11-28T20:09:37.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f62637fe640 1 -- 172.21.15.177:0/2594748787 learned_addr learned my addr 172.21.15.177:0/2594748787 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:37.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f6263fff640 1 --2- 172.21.15.177:0/2594748787 >> v2:172.21.15.177:3300/0 conn(0x7f62640ce680 0x7f62640b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:37.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f6262ffd640 1 --2- 172.21.15.177:0/2594748787 >> v2:172.21.15.195:3300/0 conn(0x7f6264160ca0 0x7f62640cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:37.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f62627fc640 1 -- 172.21.15.177:0/2594748787 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278621146 0 0) 0x7f62640cf130 con 0x7f62641608c0 2023-11-28T20:09:37.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f62627fc640 1 -- 172.21.15.177:0/2594748787 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f624c003530 con 0x7f62641608c0 2023-11-28T20:09:37.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f6263fff640 1 -- 172.21.15.177:0/2594748787 >> v2:172.21.15.195:3300/0 conn(0x7f6264160ca0 msgr2=0x7f62640cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:37.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f6263fff640 1 --2- 172.21.15.177:0/2594748787 >> v2:172.21.15.195:3300/0 conn(0x7f6264160ca0 0x7f62640cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:37.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f6263fff640 1 -- 172.21.15.177:0/2594748787 >> v1:172.21.15.177:6789/0 conn(0x7f62641608c0 legacy=0x7f62640cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:37.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.425+0000 7f6263fff640 1 -- 172.21.15.177:0/2594748787 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62640b29e0 con 0x7f62640ce680 2023-11-28T20:09:37.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.429+0000 7f6263fff640 1 --2- 172.21.15.177:0/2594748787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62640ce680 0x7f62640b31e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f62640c6ad0 tx=0x7f625c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91755cae9a5c76b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:37.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.429+0000 7f62627fc640 1 -- 172.21.15.177:0/2594748787 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c0a59c0 con 0x7f62640ce680 2023-11-28T20:09:37.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.429+0000 7f62627fc640 1 -- 172.21.15.177:0/2594748787 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62640d20f0 con 0x7f62640ce680 2023-11-28T20:09:37.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.429+0000 7f62627fc640 1 -- 172.21.15.177:0/2594748787 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c0a5d20 con 0x7f62640ce680 2023-11-28T20:09:37.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.429+0000 7f6268b93640 1 -- 172.21.15.177:0/2594748787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62640ce680 msgr2=0x7f62640b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:37.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.429+0000 7f6268b93640 1 --2- 172.21.15.177:0/2594748787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62640ce680 0x7f62640b31e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f62640c6ad0 tx=0x7f625c01c8e0 comp rx=0 tx=0).stop 2023-11-28T20:09:37.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.429+0000 7f6268b93640 1 -- 172.21.15.177:0/2594748787 shutdown_connections 2023-11-28T20:09:37.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.429+0000 7f6268b93640 1 --2- 172.21.15.177:0/2594748787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62640ce680 0x7f62640b31e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:37.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.429+0000 7f6268b93640 1 --2- 172.21.15.177:0/2594748787 >> v2:172.21.15.195:3300/0 conn(0x7f6264160ca0 0x7f62640cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:37.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.429+0000 7f6268b93640 1 -- 172.21.15.177:0/2594748787 >> 172.21.15.177:0/2594748787 conn(0x7f62640d2fd0 msgr2=0x7f62640d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:37.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.429+0000 7f6268b93640 1 -- 172.21.15.177:0/2594748787 shutdown_connections 2023-11-28T20:09:37.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.429+0000 7f6268b93640 1 -- 172.21.15.177:0/2594748787 wait complete. 2023-11-28T20:09:37.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.429+0000 7f6268b93640 1 Processor -- start 2023-11-28T20:09:37.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f6268b93640 1 -- start start 2023-11-28T20:09:37.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f6268b93640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62640ce680 0x7f62641553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:37.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f6268b93640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62641608c0 0x7f62640c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:37.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f6268b93640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6264160ca0 0x7f626415eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:37.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f6268b93640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62640cc830 con 0x7f62640ce680 2023-11-28T20:09:37.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f6268b93640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62640cbc20 con 0x7f6264160ca0 2023-11-28T20:09:37.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f6268b93640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62640cbf00 con 0x7f62641608c0 2023-11-28T20:09:37.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f62637fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62640ce680 0x7f62641553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:37.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f62637fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62640ce680 0x7f62641553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55430/0 (socket says 172.21.15.177:55430) 2023-11-28T20:09:37.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f62637fe640 1 -- 172.21.15.177:0/3661665782 learned_addr learned my addr 172.21.15.177:0/3661665782 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:37.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f6263fff640 1 --2- 172.21.15.177:0/3661665782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6264160ca0 0x7f626415eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:37.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f62637fe640 1 -- 172.21.15.177:0/3661665782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62641608c0 msgr2=0x7f62640c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:37.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f62637fe640 1 --2- 172.21.15.177:0/3661665782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62641608c0 0x7f62640c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:37.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f62637fe640 1 -- 172.21.15.177:0/3661665782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6264160ca0 msgr2=0x7f626415eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:37.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f62637fe640 1 --2- 172.21.15.177:0/3661665782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6264160ca0 0x7f626415eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:37.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f62637fe640 1 -- 172.21.15.177:0/3661665782 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c009a70 con 0x7f62640ce680 2023-11-28T20:09:37.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f6263fff640 1 --2- 172.21.15.177:0/3661665782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6264160ca0 0x7f626415eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:37.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f62637fe640 1 --2- 172.21.15.177:0/3661665782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62640ce680 0x7f62641553f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f625400c450 tx=0x7f625400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:37.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f624bfff640 1 -- 172.21.15.177:0/3661665782 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254005cf0 con 0x7f62640ce680 2023-11-28T20:09:37.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f624bfff640 1 -- 172.21.15.177:0/3661665782 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6254005e50 con 0x7f62640ce680 2023-11-28T20:09:37.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f6268b93640 1 -- 172.21.15.177:0/3661665782 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62640cc1e0 con 0x7f62640ce680 2023-11-28T20:09:37.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f624bfff640 1 -- 172.21.15.177:0/3661665782 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254007290 con 0x7f62640ce680 2023-11-28T20:09:37.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f6268b93640 1 -- 172.21.15.177:0/3661665782 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62640c9c50 con 0x7f62640ce680 2023-11-28T20:09:37.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.433+0000 7f6268b93640 1 -- 172.21.15.177:0/3661665782 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62640c9ea0 con 0x7f62640ce680 2023-11-28T20:09:37.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.437+0000 7f624bfff640 1 -- 172.21.15.177:0/3661665782 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f62540073f0 con 0x7f62640ce680 2023-11-28T20:09:37.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.437+0000 7f624bfff640 1 --2- 172.21.15.177:0/3661665782 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6250066470 0x7f6250068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:37.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.437+0000 7f624bfff640 1 -- 172.21.15.177:0/3661665782 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6254083160 con 0x7f62640ce680 2023-11-28T20:09:37.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.437+0000 7f6262ffd640 1 --2- 172.21.15.177:0/3661665782 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6250066470 0x7f6250068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:37.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.437+0000 7f6262ffd640 1 --2- 172.21.15.177:0/3661665782 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6250066470 0x7f6250068930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f626406bab0 tx=0x7f6258009520 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:37.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.441+0000 7f624bfff640 1 -- 172.21.15.177:0/3661665782 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f62540508d0 con 0x7f62640ce680 2023-11-28T20:09:37.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.621+0000 7f6268b93640 1 -- 172.21.15.177:0/3661665782 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62640a1000 con 0x7f62640ce680 2023-11-28T20:09:37.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.621+0000 7f624bfff640 1 -- 172.21.15.177:0/3661665782 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f6254017090 con 0x7f62640ce680 2023-11-28T20:09:37.626 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:37.626 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2829857708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2829857708},{"type":"v1","addr":"172.21.15.177:6836","nonce":2829857708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5101,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/916709103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":916709103},{"type":"v1","addr":"172.21.15.195:6834","nonce":916709103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1987123637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1987123637},{"type":"v1","addr":"172.21.15.195:6835","nonce":1987123637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5814,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/326102992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":326102992},{"type":"v1","addr":"172.21.15.177:6837","nonce":326102992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[]} 2023-11-28T20:09:37.626 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 20 2023-11-28T20:09:37.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.625+0000 7f6268b93640 1 -- 172.21.15.177:0/3661665782 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6250066470 msgr2=0x7f6250068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:37.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.625+0000 7f6268b93640 1 --2- 172.21.15.177:0/3661665782 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6250066470 0x7f6250068930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f626406bab0 tx=0x7f6258009520 comp rx=0 tx=0).stop 2023-11-28T20:09:37.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.625+0000 7f6268b93640 1 -- 172.21.15.177:0/3661665782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62640ce680 msgr2=0x7f62641553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:37.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.625+0000 7f6268b93640 1 --2- 172.21.15.177:0/3661665782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62640ce680 0x7f62641553f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f625400c450 tx=0x7f625400c910 comp rx=0 tx=0).stop 2023-11-28T20:09:37.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.625+0000 7f6268b93640 1 -- 172.21.15.177:0/3661665782 shutdown_connections 2023-11-28T20:09:37.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.625+0000 7f6268b93640 1 --2- 172.21.15.177:0/3661665782 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6250066470 0x7f6250068930 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:37.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.625+0000 7f6268b93640 1 --2- 172.21.15.177:0/3661665782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6264160ca0 0x7f626415eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:37.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.625+0000 7f6268b93640 1 --2- 172.21.15.177:0/3661665782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62641608c0 0x7f62640c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:37.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.625+0000 7f6268b93640 1 --2- 172.21.15.177:0/3661665782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62640ce680 0x7f62641553f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:37.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.625+0000 7f6268b93640 1 -- 172.21.15.177:0/3661665782 >> 172.21.15.177:0/3661665782 conn(0x7f62640d2fd0 msgr2=0x7f62640d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:37.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.625+0000 7f6268b93640 1 -- 172.21.15.177:0/3661665782 shutdown_connections 2023-11-28T20:09:37.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.625+0000 7f6268b93640 1 -- 172.21.15.177:0/3661665782 wait complete. 2023-11-28T20:09:37.647 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T20:09:37.647 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T20:09:37.647 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T20:09:37.648 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:09:37.648 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T20:09:37.648 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T20:09:37.648 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T20:09:37.648 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:09:37.648 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T20:09:37.648 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T20:09:37.649 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T20:09:37.649 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:09:37.649 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T20:09:37.649 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T20:09:37.649 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T20:09:37.649 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:09:37.662 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T20:09:37.662 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T20:09:37.663 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T20:09:37.664 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T20:09:37.665 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T20:09:37.665 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T20:09:37.665 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T20:09:37.666 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T20:09:37.709 INFO:tasks.ceph.mds.b:Started 2023-11-28T20:09:37.709 DEBUG:teuthology.parallel:result is None 2023-11-28T20:09:37.711 INFO:tasks.ceph.mds.d:Started 2023-11-28T20:09:37.711 DEBUG:teuthology.parallel:result is None 2023-11-28T20:09:37.713 INFO:tasks.ceph.mds.c:Started 2023-11-28T20:09:37.713 DEBUG:teuthology.parallel:result is None 2023-11-28T20:09:37.715 INFO:tasks.ceph.mds.a:Started 2023-11-28T20:09:37.715 DEBUG:teuthology.parallel:result is None 2023-11-28T20:09:37.715 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T20:09:37.800 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-11-28T20:09:37.801 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2023-11-28T20:09:37.802 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2023-11-28T20:09:37.802 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-11-28T20:09:37.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a45f8640 1 Processor -- start 2023-11-28T20:09:37.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a45f8640 1 -- start start 2023-11-28T20:09:37.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a45f8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f709c15d200 0x7f709c0d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:37.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a45f8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f709c0d1160 0x7f709c0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:37.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a45f8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c0b29f0 con 0x7f709c0d15a0 2023-11-28T20:09:37.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a45f8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c0d1b00 con 0x7f709c15d200 2023-11-28T20:09:37.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a45f8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c0d1de0 con 0x7f709c0d1160 2023-11-28T20:09:37.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a2394640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f709c15d200 0x7f709c0d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:37.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a2b95640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f709c0d15a0 0x7f709c06b5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:51090/0 (socket says 172.21.15.177:51090) 2023-11-28T20:09:37.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a2b95640 1 -- 172.21.15.177:0/1049792442 learned_addr learned my addr 172.21.15.177:0/1049792442 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:37.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a1b93640 1 --2- 172.21.15.177:0/1049792442 >> v2:172.21.15.195:3300/0 conn(0x7f709c0d1160 0x7f709c0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:37.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a2394640 1 -- 172.21.15.177:0/1049792442 >> v2:172.21.15.195:3300/0 conn(0x7f709c0d1160 msgr2=0x7f709c0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:37.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a2394640 1 --2- 172.21.15.177:0/1049792442 >> v2:172.21.15.195:3300/0 conn(0x7f709c0d1160 0x7f709c0cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:37.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a2394640 1 -- 172.21.15.177:0/1049792442 >> v1:172.21.15.177:6789/0 conn(0x7f709c0d15a0 legacy=0x7f709c06b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:37.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a2394640 1 -- 172.21.15.177:0/1049792442 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c0d20c0 con 0x7f709c15d200 2023-11-28T20:09:37.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.857+0000 7f70a1392640 1 -- 172.21.15.177:0/1049792442 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249142582 0 0) 0x7f709c0b29f0 con 0x7f709c0d15a0 2023-11-28T20:09:37.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.861+0000 7f70a2394640 1 --2- 172.21.15.177:0/1049792442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c15d200 0x7f709c0d2ba0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f709c0d41c0 tx=0x7f709801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8728d7db78460e22 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:37.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.861+0000 7f70a1392640 1 -- 172.21.15.177:0/1049792442 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980a8950 con 0x7f709c15d200 2023-11-28T20:09:37.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.861+0000 7f70a1392640 1 -- 172.21.15.177:0/1049792442 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70980a8ab0 con 0x7f709c15d200 2023-11-28T20:09:37.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.861+0000 7f70a1392640 1 -- 172.21.15.177:0/1049792442 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980a8e40 con 0x7f709c15d200 2023-11-28T20:09:37.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.861+0000 7f70a45f8640 1 -- 172.21.15.177:0/1049792442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c15d200 msgr2=0x7f709c0d2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:37.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.861+0000 7f70a45f8640 1 --2- 172.21.15.177:0/1049792442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c15d200 0x7f709c0d2ba0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f709c0d41c0 tx=0x7f709801ec50 comp rx=0 tx=0).stop 2023-11-28T20:09:37.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.861+0000 7f70a45f8640 1 -- 172.21.15.177:0/1049792442 shutdown_connections 2023-11-28T20:09:37.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.861+0000 7f70a45f8640 1 --2- 172.21.15.177:0/1049792442 >> v2:172.21.15.195:3300/0 conn(0x7f709c0d1160 0x7f709c0cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:37.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.861+0000 7f70a45f8640 1 --2- 172.21.15.177:0/1049792442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c15d200 0x7f709c0d2ba0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:37.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.861+0000 7f70a45f8640 1 -- 172.21.15.177:0/1049792442 >> 172.21.15.177:0/1049792442 conn(0x7f709c072260 msgr2=0x7f709c0cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:37.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.861+0000 7f70a45f8640 1 -- 172.21.15.177:0/1049792442 shutdown_connections 2023-11-28T20:09:37.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.861+0000 7f70a45f8640 1 -- 172.21.15.177:0/1049792442 wait complete. 2023-11-28T20:09:37.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a45f8640 1 Processor -- start 2023-11-28T20:09:37.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a45f8640 1 -- start start 2023-11-28T20:09:37.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a45f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c0d1160 0x7f709c155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:37.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a45f8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c0d15a0 0x7f709c1efa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:37.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a45f8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c15d200 0x7f709c1effb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:37.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a45f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c1f3640 con 0x7f709c0d1160 2023-11-28T20:09:37.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a45f8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c1f3a60 con 0x7f709c0d15a0 2023-11-28T20:09:37.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a45f8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c1f04f0 con 0x7f709c15d200 2023-11-28T20:09:37.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a2394640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c0d1160 0x7f709c155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:37.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a2394640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c0d1160 0x7f709c155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55476/0 (socket says 172.21.15.177:55476) 2023-11-28T20:09:37.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a2394640 1 -- 172.21.15.177:0/3382013665 learned_addr learned my addr 172.21.15.177:0/3382013665 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:37.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a1b93640 1 --2- 172.21.15.177:0/3382013665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c0d15a0 0x7f709c1efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:37.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a2b95640 1 --2- 172.21.15.177:0/3382013665 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c15d200 0x7f709c1effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:37.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a2394640 1 -- 172.21.15.177:0/3382013665 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c15d200 msgr2=0x7f709c1effb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:37.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a2394640 1 --2- 172.21.15.177:0/3382013665 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c15d200 0x7f709c1effb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:37.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a2394640 1 -- 172.21.15.177:0/3382013665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c0d15a0 msgr2=0x7f709c1efa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:37.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a2394640 1 --2- 172.21.15.177:0/3382013665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c0d15a0 0x7f709c1efa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:37.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a2394640 1 -- 172.21.15.177:0/3382013665 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7098009420 con 0x7f709c0d1160 2023-11-28T20:09:37.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a2394640 1 --2- 172.21.15.177:0/3382013665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c0d1160 0x7f709c155de0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f709801c880 tx=0x7f709801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:37.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f7092ffd640 1 -- 172.21.15.177:0/3382013665 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980b0dd0 con 0x7f709c0d1160 2023-11-28T20:09:37.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f7092ffd640 1 -- 172.21.15.177:0/3382013665 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70980b9430 con 0x7f709c0d1160 2023-11-28T20:09:37.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a45f8640 1 -- 172.21.15.177:0/3382013665 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c1f2a10 con 0x7f709c0d1160 2023-11-28T20:09:37.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f7092ffd640 1 -- 172.21.15.177:0/3382013665 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980b97e0 con 0x7f709c0d1160 2023-11-28T20:09:37.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a45f8640 1 -- 172.21.15.177:0/3382013665 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c1f2f80 con 0x7f709c0d1160 2023-11-28T20:09:37.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.865+0000 7f70a45f8640 1 -- 172.21.15.177:0/3382013665 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c1f3780 con 0x7f709c0d1160 2023-11-28T20:09:37.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.869+0000 7f7092ffd640 1 -- 172.21.15.177:0/3382013665 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f70980b7040 con 0x7f709c0d1160 2023-11-28T20:09:37.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.869+0000 7f7092ffd640 1 --2- 172.21.15.177:0/3382013665 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7080066470 0x7f7080068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:37.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.869+0000 7f7092ffd640 1 -- 172.21.15.177:0/3382013665 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f70981215d0 con 0x7f709c0d1160 2023-11-28T20:09:37.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.869+0000 7f70a1b93640 1 --2- 172.21.15.177:0/3382013665 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7080066470 0x7f7080068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:37.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.869+0000 7f70a1b93640 1 --2- 172.21.15.177:0/3382013665 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7080066470 0x7f7080068930 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f709c0c9800 tx=0x7f708c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:37.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:37.873+0000 7f7092ffd640 1 -- 172.21.15.177:0/3382013665 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f709c1f3780 con 0x7f709c0d1160 2023-11-28T20:09:38.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:38.041+0000 7f70a45f8640 1 -- 172.21.15.177:0/3382013665 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f709c069440 con 0x7f709c0d1160 2023-11-28T20:09:38.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:38.973+0000 7f7092ffd640 1 -- 172.21.15.177:0/3382013665 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v45) v1 ==== 97+0+0 (secure 0 0 0) 0x7f70980eedf0 con 0x7f709c0d1160 2023-11-28T20:09:38.975 INFO:teuthology.orchestra.run.smithi177.stderr: removed all blocklist entries 2023-11-28T20:09:38.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:38.973+0000 7f70a45f8640 1 -- 172.21.15.177:0/3382013665 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7080066470 msgr2=0x7f7080068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:38.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:38.973+0000 7f70a45f8640 1 --2- 172.21.15.177:0/3382013665 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7080066470 0x7f7080068930 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f709c0c9800 tx=0x7f708c009190 comp rx=0 tx=0).stop 2023-11-28T20:09:38.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:38.973+0000 7f70a45f8640 1 -- 172.21.15.177:0/3382013665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c0d1160 msgr2=0x7f709c155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:38.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:38.973+0000 7f70a45f8640 1 --2- 172.21.15.177:0/3382013665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c0d1160 0x7f709c155de0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f709801c880 tx=0x7f709801b9f0 comp rx=0 tx=0).stop 2023-11-28T20:09:38.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:38.973+0000 7f70a45f8640 1 -- 172.21.15.177:0/3382013665 shutdown_connections 2023-11-28T20:09:38.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:38.973+0000 7f70a45f8640 1 --2- 172.21.15.177:0/3382013665 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7080066470 0x7f7080068930 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:38.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:38.973+0000 7f70a45f8640 1 --2- 172.21.15.177:0/3382013665 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c15d200 0x7f709c1effb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:38.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:38.973+0000 7f70a45f8640 1 --2- 172.21.15.177:0/3382013665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c0d15a0 0x7f709c1efa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:38.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:38.973+0000 7f70a45f8640 1 --2- 172.21.15.177:0/3382013665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c0d1160 0x7f709c155de0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:38.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:38.973+0000 7f70a45f8640 1 -- 172.21.15.177:0/3382013665 >> 172.21.15.177:0/3382013665 conn(0x7f709c072260 msgr2=0x7f709c0b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:38.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:38.973+0000 7f70a45f8640 1 -- 172.21.15.177:0/3382013665 shutdown_connections 2023-11-28T20:09:38.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:38.973+0000 7f70a45f8640 1 -- 172.21.15.177:0/3382013665 wait complete. 2023-11-28T20:09:39.001 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T20:09:39.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facc7209640 1 Processor -- start 2023-11-28T20:09:39.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facc7209640 1 -- start start 2023-11-28T20:09:39.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facc7209640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7facc006c9d0 0x7facc0070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facc7209640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7facc0072180 0x7facc00709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facc7209640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc00710e0 con 0x7facc0144840 2023-11-28T20:09:39.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facc7209640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc015f010 con 0x7facc006c9d0 2023-11-28T20:09:39.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facc7209640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc0070ee0 con 0x7facc0072180 2023-11-28T20:09:39.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facb7fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7facc006c9d0 0x7facc0070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facc4fa5640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7facc0144840 0x7facc006c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47242/0 (socket says 172.21.15.177:47242) 2023-11-28T20:09:39.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facc4fa5640 1 -- 172.21.15.177:0/669925074 learned_addr learned my addr 172.21.15.177:0/669925074 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:39.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facc57a6640 1 --2- 172.21.15.177:0/669925074 >> v2:172.21.15.195:3300/0 conn(0x7facc0072180 0x7facc00709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facb7fff640 1 -- 172.21.15.177:0/669925074 >> v2:172.21.15.195:3300/0 conn(0x7facc0072180 msgr2=0x7facc00709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:39.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facb7fff640 1 --2- 172.21.15.177:0/669925074 >> v2:172.21.15.195:3300/0 conn(0x7facc0072180 0x7facc00709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facb7fff640 1 -- 172.21.15.177:0/669925074 >> v1:172.21.15.177:6789/0 conn(0x7facc0144840 legacy=0x7facc006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facb77fe640 1 -- 172.21.15.177:0/669925074 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185520201 0 0) 0x7facc00710e0 con 0x7facc0144840 2023-11-28T20:09:39.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.141+0000 7facb7fff640 1 -- 172.21.15.177:0/669925074 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc00713c0 con 0x7facc006c9d0 2023-11-28T20:09:39.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.145+0000 7facb7fff640 1 --2- 172.21.15.177:0/669925074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc006c9d0 0x7facc0070460 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7facc006e6e0 tx=0x7facb001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc2ef2cfabf663 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:39.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.145+0000 7facb77fe640 1 -- 172.21.15.177:0/669925074 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb00a7070 con 0x7facc006c9d0 2023-11-28T20:09:39.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.145+0000 7facb77fe640 1 -- 172.21.15.177:0/669925074 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb00ab430 con 0x7facc006c9d0 2023-11-28T20:09:39.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.145+0000 7facb77fe640 1 -- 172.21.15.177:0/669925074 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb00ab7c0 con 0x7facc006c9d0 2023-11-28T20:09:39.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.145+0000 7facc7209640 1 -- 172.21.15.177:0/669925074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc006c9d0 msgr2=0x7facc0070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.145+0000 7facc7209640 1 --2- 172.21.15.177:0/669925074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc006c9d0 0x7facc0070460 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7facc006e6e0 tx=0x7facb001c430 comp rx=0 tx=0).stop 2023-11-28T20:09:39.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.145+0000 7facc7209640 1 -- 172.21.15.177:0/669925074 shutdown_connections 2023-11-28T20:09:39.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.145+0000 7facc7209640 1 --2- 172.21.15.177:0/669925074 >> v2:172.21.15.195:3300/0 conn(0x7facc0072180 0x7facc00709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.145+0000 7facc7209640 1 --2- 172.21.15.177:0/669925074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc006c9d0 0x7facc0070460 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.145+0000 7facc7209640 1 -- 172.21.15.177:0/669925074 >> 172.21.15.177:0/669925074 conn(0x7facc006a530 msgr2=0x7facc006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:39.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.145+0000 7facc7209640 1 -- 172.21.15.177:0/669925074 shutdown_connections 2023-11-28T20:09:39.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.145+0000 7facc7209640 1 -- 172.21.15.177:0/669925074 wait complete. 2023-11-28T20:09:39.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc7209640 1 Processor -- start 2023-11-28T20:09:39.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc7209640 1 -- start start 2023-11-28T20:09:39.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc7209640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc006c9d0 0x7facc013f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc7209640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc0072180 0x7facc01f8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc7209640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc0144840 0x7facc0141250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc7209640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc013a050 con 0x7facc006c9d0 2023-11-28T20:09:39.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc7209640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc00b0270 con 0x7facc0144840 2023-11-28T20:09:39.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc7209640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc01f9d70 con 0x7facc0072180 2023-11-28T20:09:39.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc4fa5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc006c9d0 0x7facc013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc4fa5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc006c9d0 0x7facc013f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47678/0 (socket says 172.21.15.177:47678) 2023-11-28T20:09:39.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc4fa5640 1 -- 172.21.15.177:0/2877985840 learned_addr learned my addr 172.21.15.177:0/2877985840 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:39.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc57a6640 1 --2- 172.21.15.177:0/2877985840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc0144840 0x7facc0141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facb7fff640 1 --2- 172.21.15.177:0/2877985840 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc0072180 0x7facc01f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc4fa5640 1 -- 172.21.15.177:0/2877985840 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc0072180 msgr2=0x7facc01f8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc4fa5640 1 --2- 172.21.15.177:0/2877985840 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc0072180 0x7facc01f8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc4fa5640 1 -- 172.21.15.177:0/2877985840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc0144840 msgr2=0x7facc0141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc4fa5640 1 --2- 172.21.15.177:0/2877985840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc0144840 0x7facc0141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc4fa5640 1 -- 172.21.15.177:0/2877985840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb0009420 con 0x7facc006c9d0 2023-11-28T20:09:39.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc4fa5640 1 --2- 172.21.15.177:0/2877985840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc006c9d0 0x7facc013f660 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7facbc00c480 tx=0x7facbc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:39.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facb57fa640 1 -- 172.21.15.177:0/2877985840 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc0074e0 con 0x7facc006c9d0 2023-11-28T20:09:39.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facb57fa640 1 -- 172.21.15.177:0/2877985840 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc007660 con 0x7facc006c9d0 2023-11-28T20:09:39.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facb57fa640 1 -- 172.21.15.177:0/2877985840 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc004a30 con 0x7facc006c9d0 2023-11-28T20:09:39.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc7209640 1 -- 172.21.15.177:0/2877985840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc01f94d0 con 0x7facc006c9d0 2023-11-28T20:09:39.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.149+0000 7facc7209640 1 -- 172.21.15.177:0/2877985840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc01f9a90 con 0x7facc006c9d0 2023-11-28T20:09:39.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.153+0000 7facc7209640 1 -- 172.21.15.177:0/2877985840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc0069440 con 0x7facc006c9d0 2023-11-28T20:09:39.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.153+0000 7facb57fa640 1 -- 172.21.15.177:0/2877985840 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7facbc004b90 con 0x7facc006c9d0 2023-11-28T20:09:39.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.153+0000 7facb57fa640 1 --2- 172.21.15.177:0/2877985840 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7facac066470 0x7facac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.153+0000 7facb57fa640 1 -- 172.21.15.177:0/2877985840 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7facbc082ca0 con 0x7facc006c9d0 2023-11-28T20:09:39.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.153+0000 7facb7fff640 1 --2- 172.21.15.177:0/2877985840 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7facac066470 0x7facac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.153+0000 7facb7fff640 1 --2- 172.21.15.177:0/2877985840 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7facac066470 0x7facac068930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7facb00af000 tx=0x7facb00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:39.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.157+0000 7facb57fa640 1 -- 172.21.15.177:0/2877985840 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7facbc050510 con 0x7facc006c9d0 2023-11-28T20:09:39.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.357+0000 7facc7209640 1 -- 172.21.15.177:0/2877985840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7facc015ae70 con 0x7facc006c9d0 2023-11-28T20:09:39.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.357+0000 7facb57fa640 1 -- 172.21.15.177:0/2877985840 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5298 (secure 0 0 0) 0x7facbc018090 con 0x7facc006c9d0 2023-11-28T20:09:39.359 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:39.359 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:09:39.359 INFO:teuthology.orchestra.run.smithi177.stdout: "auth_dump": [ 2023-11-28T20:09:39.359 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.360 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.a", 2023-11-28T20:09:39.360 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlT2itExAAiboY3RykwKkdHHvSX89FMg==", 2023-11-28T20:09:39.360 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.360 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:09:39.360 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-11-28T20:09:39.360 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-11-28T20:09:39.360 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:09:39.360 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.360 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.360 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.360 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.b", 2023-11-28T20:09:39.360 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlXOfvHxAAxtE7/5YjkCT81r/R33CimA==", 2023-11-28T20:09:39.361 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.361 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:09:39.361 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-11-28T20:09:39.361 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-11-28T20:09:39.361 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:09:39.361 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.361 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.361 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.361 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.c", 2023-11-28T20:09:39.361 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZllwEQGxAAIZbBHVfQ7S698b34X58EoQ==", 2023-11-28T20:09:39.361 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.361 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:09:39.362 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-11-28T20:09:39.362 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-11-28T20:09:39.362 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:09:39.362 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.362 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.362 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.362 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.d", 2023-11-28T20:09:39.362 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlQ3phJxAAO3C3l75cY24gpt5A4fkNzw==", 2023-11-28T20:09:39.362 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.362 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:09:39.362 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-11-28T20:09:39.362 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-11-28T20:09:39.363 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:09:39.363 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.363 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.363 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.0", 2023-11-28T20:09:39.363 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBWSGZl6J/iBRAAaHtCcQTA4eByPVZs3gabUA==", 2023-11-28T20:09:39.363 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.363 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:09:39.363 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:09:39.363 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:09:39.363 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.363 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.365 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.1", 2023-11-28T20:09:39.365 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBZSGZlsadjDBAAzMr5eUjea1EK53hskbXjnA==", 2023-11-28T20:09:39.365 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.365 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:09:39.365 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:09:39.365 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:09:39.366 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.366 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.366 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.366 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.2", 2023-11-28T20:09:39.366 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBdSGZloPsrKBAAGjlzPhk/tJwOSjuWQkePaA==", 2023-11-28T20:09:39.366 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.366 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:09:39.366 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:09:39.366 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:09:39.366 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.366 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.366 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.367 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.3", 2023-11-28T20:09:39.367 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBgSGZlm8hhMBAAlJNZgd37p89WH4x/64TEmg==", 2023-11-28T20:09:39.367 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.367 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:09:39.367 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:09:39.367 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:09:39.367 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.367 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.367 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.4", 2023-11-28T20:09:39.367 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBlSGZlFVMqAxAAT/EhE4C6jEDYQewJ//aUyg==", 2023-11-28T20:09:39.367 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.368 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:09:39.368 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:09:39.368 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:09:39.368 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.368 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.368 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.368 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.5", 2023-11-28T20:09:39.368 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBoSGZlwv67CRAArT/ZRS25JQ6UrtviY01mqA==", 2023-11-28T20:09:39.368 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.368 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:09:39.368 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:09:39.368 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:09:39.368 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.369 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.369 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.369 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.6", 2023-11-28T20:09:39.369 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBrSGZlKNlhEBAAV+M35LEhu8Gam1Rf0rekxQ==", 2023-11-28T20:09:39.369 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.369 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:09:39.369 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:09:39.369 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:09:39.369 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.369 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.369 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.369 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.7", 2023-11-28T20:09:39.370 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBuSGZl5kj9FhAA3+3ARqIw80zr9Tkv+hQMNA==", 2023-11-28T20:09:39.370 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.370 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-28T20:09:39.370 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-28T20:09:39.370 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:09:39.370 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.370 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.370 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.0", 2023-11-28T20:09:39.370 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZl+2t5KxAAc/J7x+fjSQR4IkIQJ/X8sw==", 2023-11-28T20:09:39.370 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.371 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:09:39.371 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow r", 2023-11-28T20:09:39.371 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-28T20:09:39.371 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.371 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.371 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.371 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.1", 2023-11-28T20:09:39.371 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlOyYqNRAAPICNuyLDmazDLHBbbNJH2w==", 2023-11-28T20:09:39.371 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.371 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:09:39.371 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-11-28T20:09:39.371 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-11-28T20:09:39.371 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-11-28T20:09:39.372 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.372 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.372 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.372 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.2", 2023-11-28T20:09:39.372 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlkxWhMRAAWgwPbTkk7I2652ytEyZhMQ==", 2023-11-28T20:09:39.372 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.372 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:09:39.372 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-11-28T20:09:39.372 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-11-28T20:09:39.373 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-11-28T20:09:39.373 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.373 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.373 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.3", 2023-11-28T20:09:39.373 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlcbtmOxAA/IaYtuh4NdUQ+WVwAGmD+w==", 2023-11-28T20:09:39.373 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.373 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-28T20:09:39.373 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-11-28T20:09:39.373 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-11-28T20:09:39.373 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-11-28T20:09:39.373 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.374 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.admin", 2023-11-28T20:09:39.374 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBRSGZlj3FoLhAAmuuH/X0zkO/oeN6Ypa0Wmw==", 2023-11-28T20:09:39.374 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.374 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-11-28T20:09:39.374 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-11-28T20:09:39.374 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-11-28T20:09:39.374 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:09:39.374 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.375 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.x", 2023-11-28T20:09:39.375 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlx9l8CxAAZ3ZNX9zYEgw8kzA5dLPB5A==", 2023-11-28T20:09:39.375 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.375 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-11-28T20:09:39.375 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-11-28T20:09:39.375 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:09:39.375 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:39.375 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:39.375 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.y", 2023-11-28T20:09:39.375 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBSSGZlR0mhBxAAvFcVR6gwEEezMfUCJfsFwg==", 2023-11-28T20:09:39.375 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-28T20:09:39.376 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-11-28T20:09:39.376 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-11-28T20:09:39.376 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-28T20:09:39.376 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.376 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:39.376 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-11-28T20:09:39.376 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:09:39.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.357+0000 7facc7209640 1 -- 172.21.15.177:0/2877985840 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7facac066470 msgr2=0x7facac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.357+0000 7facc7209640 1 --2- 172.21.15.177:0/2877985840 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7facac066470 0x7facac068930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7facb00af000 tx=0x7facb00a7000 comp rx=0 tx=0).stop 2023-11-28T20:09:39.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.357+0000 7facc7209640 1 -- 172.21.15.177:0/2877985840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc006c9d0 msgr2=0x7facc013f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.357+0000 7facc7209640 1 --2- 172.21.15.177:0/2877985840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc006c9d0 0x7facc013f660 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7facbc00c480 tx=0x7facbc00c940 comp rx=0 tx=0).stop 2023-11-28T20:09:39.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.357+0000 7facc7209640 1 -- 172.21.15.177:0/2877985840 shutdown_connections 2023-11-28T20:09:39.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.357+0000 7facc7209640 1 --2- 172.21.15.177:0/2877985840 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7facac066470 0x7facac068930 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.357+0000 7facc7209640 1 --2- 172.21.15.177:0/2877985840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc0144840 0x7facc0141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.357+0000 7facc7209640 1 --2- 172.21.15.177:0/2877985840 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc0072180 0x7facc01f8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.357+0000 7facc7209640 1 --2- 172.21.15.177:0/2877985840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc006c9d0 0x7facc013f660 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.357+0000 7facc7209640 1 -- 172.21.15.177:0/2877985840 >> 172.21.15.177:0/2877985840 conn(0x7facc006a530 msgr2=0x7facc0070460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:39.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.357+0000 7facc7209640 1 -- 172.21.15.177:0/2877985840 shutdown_connections 2023-11-28T20:09:39.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.357+0000 7facc7209640 1 -- 172.21.15.177:0/2877985840 wait complete. 2023-11-28T20:09:39.380 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:09:39.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d4229b640 1 Processor -- start 2023-11-28T20:09:39.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d4229b640 1 -- start start 2023-11-28T20:09:39.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d4229b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d3c0cf430 0x7f1d3c0cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d4229b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c0cc7a0 con 0x7f1d3c0ce410 2023-11-28T20:09:39.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d4229b640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c0cd600 con 0x7f1d3c15ce90 2023-11-28T20:09:39.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d4229b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0ce8a0 con 0x7f1d3c0cf430 2023-11-28T20:09:39.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d41a9a640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f1d3c0ce410 0x7f1d3c166ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47252/0 (socket says 172.21.15.177:47252) 2023-11-28T20:09:39.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d41a9a640 1 -- 172.21.15.177:0/3409899982 learned_addr learned my addr 172.21.15.177:0/3409899982 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:39.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d40a98640 1 --2- 172.21.15.177:0/3409899982 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d3c0cf430 0x7f1d3c0cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d33fff640 1 -- 172.21.15.177:0/3409899982 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725566579 0 0) 0x7f1d3c0cc7a0 con 0x7f1d3c0ce410 2023-11-28T20:09:39.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d33fff640 1 -- 172.21.15.177:0/3409899982 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d28003530 con 0x7f1d3c0ce410 2023-11-28T20:09:39.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d33fff640 1 -- 172.21.15.177:0/3409899982 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6978485 0 0) 0x7f1d3c0cd600 con 0x7f1d3c15ce90 2023-11-28T20:09:39.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d33fff640 1 -- 172.21.15.177:0/3409899982 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d3c0cc7a0 con 0x7f1d3c15ce90 2023-11-28T20:09:39.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d40a98640 1 -- 172.21.15.177:0/3409899982 >> v1:172.21.15.195:6789/0 conn(0x7f1d3c15ce90 legacy=0x7f1d3c0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d40a98640 1 -- 172.21.15.177:0/3409899982 >> v1:172.21.15.177:6789/0 conn(0x7f1d3c0ce410 legacy=0x7f1d3c166ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.517+0000 7f1d40a98640 1 -- 172.21.15.177:0/3409899982 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c0cc9f0 con 0x7f1d3c0cf430 2023-11-28T20:09:39.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.521+0000 7f1d40a98640 1 --2- 172.21.15.177:0/3409899982 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d3c0cf430 0x7f1d3c0cded0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0097f0 tx=0x7f1d2c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8480ca5d34ca6957 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:39.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.521+0000 7f1d33fff640 1 -- 172.21.15.177:0/3409899982 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c0aa5f0 con 0x7f1d3c0cf430 2023-11-28T20:09:39.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.521+0000 7f1d33fff640 1 -- 172.21.15.177:0/3409899982 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c0aa750 con 0x7f1d3c0cf430 2023-11-28T20:09:39.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.521+0000 7f1d33fff640 1 -- 172.21.15.177:0/3409899982 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c0aaae0 con 0x7f1d3c0cf430 2023-11-28T20:09:39.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.521+0000 7f1d4229b640 1 -- 172.21.15.177:0/3409899982 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d3c0cf430 msgr2=0x7f1d3c0cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.521+0000 7f1d4229b640 1 --2- 172.21.15.177:0/3409899982 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d3c0cf430 0x7f1d3c0cded0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0097f0 tx=0x7f1d2c01c490 comp rx=0 tx=0).stop 2023-11-28T20:09:39.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.521+0000 7f1d4229b640 1 -- 172.21.15.177:0/3409899982 shutdown_connections 2023-11-28T20:09:39.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.521+0000 7f1d4229b640 1 --2- 172.21.15.177:0/3409899982 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d3c0cf430 0x7f1d3c0cded0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.521+0000 7f1d4229b640 1 -- 172.21.15.177:0/3409899982 >> 172.21.15.177:0/3409899982 conn(0x7f1d3c0b0920 msgr2=0x7f1d3c0b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:39.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.521+0000 7f1d4229b640 1 -- 172.21.15.177:0/3409899982 shutdown_connections 2023-11-28T20:09:39.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.521+0000 7f1d4229b640 1 -- 172.21.15.177:0/3409899982 wait complete. 2023-11-28T20:09:39.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d4229b640 1 Processor -- start 2023-11-28T20:09:39.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d4229b640 1 -- start start 2023-11-28T20:09:39.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d4229b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d3c0ce410 0x7f1d3c1465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d4229b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d3c15ce90 0x7f1d3c15b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d4229b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d3c09b620 0x7f1d3c157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d4229b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c09a580 con 0x7f1d3c09b620 2023-11-28T20:09:39.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d4229b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c09a860 con 0x7f1d3c15ce90 2023-11-28T20:09:39.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d4229b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c09ab40 con 0x7f1d3c0ce410 2023-11-28T20:09:39.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d41a9a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d3c09b620 0x7f1d3c157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d40a98640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d3c15ce90 0x7f1d3c15b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d41a9a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d3c09b620 0x7f1d3c157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47682/0 (socket says 172.21.15.177:47682) 2023-11-28T20:09:39.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d41299640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d3c0ce410 0x7f1d3c1465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d41a9a640 1 -- 172.21.15.177:0/3188334904 learned_addr learned my addr 172.21.15.177:0/3188334904 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:39.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d41a9a640 1 -- 172.21.15.177:0/3188334904 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d3c0ce410 msgr2=0x7f1d3c1465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d41a9a640 1 --2- 172.21.15.177:0/3188334904 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d3c0ce410 0x7f1d3c1465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d41a9a640 1 -- 172.21.15.177:0/3188334904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d3c15ce90 msgr2=0x7f1d3c15b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d41a9a640 1 --2- 172.21.15.177:0/3188334904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d3c15ce90 0x7f1d3c15b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d41a9a640 1 -- 172.21.15.177:0/3188334904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c009420 con 0x7f1d3c09b620 2023-11-28T20:09:39.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d40a98640 1 --2- 172.21.15.177:0/3188334904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d3c15ce90 0x7f1d3c15b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:09:39.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d41a9a640 1 --2- 172.21.15.177:0/3188334904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d3c09b620 0x7f1d3c157f60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400caa0 tx=0x7f1d3400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:39.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d31ffb640 1 -- 172.21.15.177:0/3188334904 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3400ac00 con 0x7f1d3c09b620 2023-11-28T20:09:39.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d31ffb640 1 -- 172.21.15.177:0/3188334904 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3400ad80 con 0x7f1d3c09b620 2023-11-28T20:09:39.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d31ffb640 1 -- 172.21.15.177:0/3188334904 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34012640 con 0x7f1d3c09b620 2023-11-28T20:09:39.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d4229b640 1 -- 172.21.15.177:0/3188334904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3c09ae20 con 0x7f1d3c09b620 2023-11-28T20:09:39.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.525+0000 7f1d4229b640 1 -- 172.21.15.177:0/3188334904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3c146b00 con 0x7f1d3c09b620 2023-11-28T20:09:39.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.529+0000 7f1d4229b640 1 -- 172.21.15.177:0/3188334904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3c09d080 con 0x7f1d3c09b620 2023-11-28T20:09:39.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.529+0000 7f1d31ffb640 1 -- 172.21.15.177:0/3188334904 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1d34007070 con 0x7f1d3c09b620 2023-11-28T20:09:39.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.529+0000 7f1d31ffb640 1 --2- 172.21.15.177:0/3188334904 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1d20066470 0x7f1d20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.529+0000 7f1d31ffb640 1 -- 172.21.15.177:0/3188334904 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1d34083a90 con 0x7f1d3c09b620 2023-11-28T20:09:39.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.529+0000 7f1d41299640 1 --2- 172.21.15.177:0/3188334904 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1d20066470 0x7f1d20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.529+0000 7f1d41299640 1 --2- 172.21.15.177:0/3188334904 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1d20066470 0x7f1d20068930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1d380011f0 tx=0x7f1d38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:39.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.533+0000 7f1d31ffb640 1 -- 172.21.15.177:0/3188334904 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d34051270 con 0x7f1d3c09b620 2023-11-28T20:09:39.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.685+0000 7f1d4229b640 1 -- 172.21.15.177:0/3188334904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d3c04e930 con 0x7f1d3c09b620 2023-11-28T20:09:39.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.685+0000 7f1d31ffb640 1 -- 172.21.15.177:0/3188334904 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+12917 (secure 0 0 0) 0x7f1d34017090 con 0x7f1d3c09b620 2023-11-28T20:09:39.689 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:39.689 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":45,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:09:38.972286+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:09:39.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.689+0000 7f1d4229b640 1 -- 172.21.15.177:0/3188334904 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1d20066470 msgr2=0x7f1d20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.689+0000 7f1d4229b640 1 --2- 172.21.15.177:0/3188334904 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1d20066470 0x7f1d20068930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1d380011f0 tx=0x7f1d38009040 comp rx=0 tx=0).stop 2023-11-28T20:09:39.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.689+0000 7f1d4229b640 1 -- 172.21.15.177:0/3188334904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d3c09b620 msgr2=0x7f1d3c157f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.689+0000 7f1d4229b640 1 --2- 172.21.15.177:0/3188334904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d3c09b620 0x7f1d3c157f60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400caa0 tx=0x7f1d3400cf60 comp rx=0 tx=0).stop 2023-11-28T20:09:39.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.689+0000 7f1d4229b640 1 -- 172.21.15.177:0/3188334904 shutdown_connections 2023-11-28T20:09:39.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.689+0000 7f1d4229b640 1 --2- 172.21.15.177:0/3188334904 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1d20066470 0x7f1d20068930 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.689+0000 7f1d4229b640 1 --2- 172.21.15.177:0/3188334904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d3c09b620 0x7f1d3c157f60 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.689+0000 7f1d4229b640 1 --2- 172.21.15.177:0/3188334904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d3c15ce90 0x7f1d3c15b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.689+0000 7f1d4229b640 1 --2- 172.21.15.177:0/3188334904 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d3c0ce410 0x7f1d3c1465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.689+0000 7f1d4229b640 1 -- 172.21.15.177:0/3188334904 >> 172.21.15.177:0/3188334904 conn(0x7f1d3c0b0920 msgr2=0x7f1d3c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:39.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.689+0000 7f1d4229b640 1 -- 172.21.15.177:0/3188334904 shutdown_connections 2023-11-28T20:09:39.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.689+0000 7f1d4229b640 1 -- 172.21.15.177:0/3188334904 wait complete. 2023-11-28T20:09:39.710 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:09:39.710 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:09:39.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.845+0000 7f585ead6640 1 Processor -- start 2023-11-28T20:09:39.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.849+0000 7f585ead6640 1 -- start start 2023-11-28T20:09:39.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.849+0000 7f585ead6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5858145ea0 0x7f5858160de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.849+0000 7f585ead6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5858146a60 0x7f5858161320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.849+0000 7f585ead6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58580b2390 con 0x7f58580ac840 2023-11-28T20:09:39.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.849+0000 7f585ead6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5858146510 con 0x7f5858146a60 2023-11-28T20:09:39.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.849+0000 7f585ead6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58580b2060 con 0x7f5858145ea0 2023-11-28T20:09:39.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.849+0000 7f585d073640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5858146a60 0x7f5858161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.849+0000 7f585d073640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5858146a60 0x7f5858161320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47698/0 (socket says 172.21.15.177:47698) 2023-11-28T20:09:39.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.849+0000 7f585d073640 1 -- 172.21.15.177:0/1992304162 learned_addr learned my addr 172.21.15.177:0/1992304162 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:39.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.849+0000 7f585c872640 1 --2- 172.21.15.177:0/1992304162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5858145ea0 0x7f5858160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.849+0000 7f585d073640 1 -- 172.21.15.177:0/1992304162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5858145ea0 msgr2=0x7f5858160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:39.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.849+0000 7f585d073640 1 --2- 172.21.15.177:0/1992304162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5858145ea0 0x7f5858160de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.849+0000 7f585d073640 1 -- 172.21.15.177:0/1992304162 >> v1:172.21.15.195:6789/0 conn(0x7f58580ac840 legacy=0x7f5858070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.849+0000 7f585d073640 1 -- 172.21.15.177:0/1992304162 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58581467b0 con 0x7f5858146a60 2023-11-28T20:09:39.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.853+0000 7f585d073640 1 --2- 172.21.15.177:0/1992304162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5858146a60 0x7f5858161320 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5850009e50 tx=0x7f585001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed252c529297c75 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:39.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.853+0000 7f584f7fe640 1 -- 172.21.15.177:0/1992304162 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500a57f0 con 0x7f5858146a60 2023-11-28T20:09:39.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.853+0000 7f584f7fe640 1 -- 172.21.15.177:0/1992304162 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58500a5950 con 0x7f5858146a60 2023-11-28T20:09:39.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.853+0000 7f584f7fe640 1 -- 172.21.15.177:0/1992304162 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500a5ce0 con 0x7f5858146a60 2023-11-28T20:09:39.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.853+0000 7f585ead6640 1 -- 172.21.15.177:0/1992304162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5858146a60 msgr2=0x7f5858161320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.853+0000 7f585ead6640 1 --2- 172.21.15.177:0/1992304162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5858146a60 0x7f5858161320 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5850009e50 tx=0x7f585001ca10 comp rx=0 tx=0).stop 2023-11-28T20:09:39.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.853+0000 7f585ead6640 1 -- 172.21.15.177:0/1992304162 shutdown_connections 2023-11-28T20:09:39.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.853+0000 7f585ead6640 1 --2- 172.21.15.177:0/1992304162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5858146a60 0x7f5858161320 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.853+0000 7f585ead6640 1 --2- 172.21.15.177:0/1992304162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5858145ea0 0x7f5858160de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.853+0000 7f585ead6640 1 -- 172.21.15.177:0/1992304162 >> 172.21.15.177:0/1992304162 conn(0x7f58580b0cc0 msgr2=0x7f58580b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:39.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.853+0000 7f585ead6640 1 -- 172.21.15.177:0/1992304162 shutdown_connections 2023-11-28T20:09:39.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.853+0000 7f585ead6640 1 -- 172.21.15.177:0/1992304162 wait complete. 2023-11-28T20:09:39.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.853+0000 7f585ead6640 1 Processor -- start 2023-11-28T20:09:39.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.853+0000 7f585ead6640 1 -- start start 2023-11-28T20:09:39.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585ead6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58580ac840 0x7f585815bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585ead6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5858145ea0 0x7f5858147070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585ead6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5858146a60 0x7f5858144900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585ead6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585815c500 con 0x7f5858146a60 2023-11-28T20:09:39.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585ead6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5858144e40 con 0x7f58580ac840 2023-11-28T20:09:39.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585ead6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585815c220 con 0x7f5858145ea0 2023-11-28T20:09:39.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585d073640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5858146a60 0x7f5858144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585d073640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5858146a60 0x7f5858144900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47706/0 (socket says 172.21.15.177:47706) 2023-11-28T20:09:39.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585d073640 1 -- 172.21.15.177:0/3709359309 learned_addr learned my addr 172.21.15.177:0/3709359309 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:39.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f584ffff640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5858145ea0 0x7f5858147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585c872640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58580ac840 0x7f585815bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585d073640 1 -- 172.21.15.177:0/3709359309 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5858145ea0 msgr2=0x7f5858147070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585d073640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5858145ea0 0x7f5858147070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585d073640 1 -- 172.21.15.177:0/3709359309 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58580ac840 msgr2=0x7f585815bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:39.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585d073640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58580ac840 0x7f585815bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:39.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585d073640 1 -- 172.21.15.177:0/3709359309 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5850009b30 con 0x7f5858146a60 2023-11-28T20:09:39.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f584ffff640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5858145ea0 0x7f5858147070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:39.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585c872640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58580ac840 0x7f585815bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:39.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585d073640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5858146a60 0x7f5858144900 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f585001a640 tx=0x7f58500197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:39.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f584d7fa640 1 -- 172.21.15.177:0/3709359309 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500b8640 con 0x7f5858146a60 2023-11-28T20:09:39.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f584d7fa640 1 -- 172.21.15.177:0/3709359309 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58500b87a0 con 0x7f5858146a60 2023-11-28T20:09:39.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585ead6640 1 -- 172.21.15.177:0/3709359309 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585815ead0 con 0x7f5858146a60 2023-11-28T20:09:39.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f584d7fa640 1 -- 172.21.15.177:0/3709359309 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500b8b90 con 0x7f5858146a60 2023-11-28T20:09:39.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585ead6640 1 -- 172.21.15.177:0/3709359309 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585815f090 con 0x7f5858146a60 2023-11-28T20:09:39.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.857+0000 7f585ead6640 1 -- 172.21.15.177:0/3709359309 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585806d2d0 con 0x7f5858146a60 2023-11-28T20:09:39.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.861+0000 7f584d7fa640 1 -- 172.21.15.177:0/3709359309 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f58500b8cf0 con 0x7f5858146a60 2023-11-28T20:09:39.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.861+0000 7f584d7fa640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f58440664a0 0x7f5844068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:39.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.861+0000 7f584d7fa640 1 -- 172.21.15.177:0/3709359309 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f585011e990 con 0x7f5858146a60 2023-11-28T20:09:39.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.861+0000 7f585c872640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f58440664a0 0x7f5844068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:39.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.861+0000 7f585c872640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f58440664a0 0x7f5844068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5854009a40 tx=0x7f5854008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:39.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:39.865+0000 7f584d7fa640 1 -- 172.21.15.177:0/3709359309 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58500ec0c0 con 0x7f5858146a60 2023-11-28T20:09:40.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.017+0000 7f585ead6640 1 -- 172.21.15.177:0/3709359309 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58580693d0 con 0x7f5858146a60 2023-11-28T20:09:40.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.017+0000 7f584d7fa640 1 -- 172.21.15.177:0/3709359309 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58500ef6e0 con 0x7f5858146a60 2023-11-28T20:09:40.022 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:09:40.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.021+0000 7f585ead6640 1 -- 172.21.15.177:0/3709359309 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f58440664a0 msgr2=0x7f5844068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:40.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.021+0000 7f585ead6640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f58440664a0 0x7f5844068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5854009a40 tx=0x7f5854008040 comp rx=0 tx=0).stop 2023-11-28T20:09:40.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.021+0000 7f585ead6640 1 -- 172.21.15.177:0/3709359309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5858146a60 msgr2=0x7f5858144900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:40.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.021+0000 7f585ead6640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5858146a60 0x7f5858144900 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f585001a640 tx=0x7f58500197b0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.021+0000 7f585ead6640 1 -- 172.21.15.177:0/3709359309 shutdown_connections 2023-11-28T20:09:40.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.021+0000 7f585ead6640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f58440664a0 0x7f5844068960 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.021+0000 7f585ead6640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5858146a60 0x7f5858144900 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.021+0000 7f585ead6640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5858145ea0 0x7f5858147070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.021+0000 7f585ead6640 1 --2- 172.21.15.177:0/3709359309 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58580ac840 0x7f585815bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.021+0000 7f585ead6640 1 -- 172.21.15.177:0/3709359309 >> 172.21.15.177:0/3709359309 conn(0x7f58580b0cc0 msgr2=0x7f58580af290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:40.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.021+0000 7f585ead6640 1 -- 172.21.15.177:0/3709359309 shutdown_connections 2023-11-28T20:09:40.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.021+0000 7f585ead6640 1 -- 172.21.15.177:0/3709359309 wait complete. 2023-11-28T20:09:40.043 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T20:09:40.122 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:09:40.127 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:09:40.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.181+0000 7f91bfcfd640 1 Processor -- start 2023-11-28T20:09:40.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.181+0000 7f91bfcfd640 1 -- start start 2023-11-28T20:09:40.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.181+0000 7f91bfcfd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f91b8140180 0x7f91b8071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:40.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.181+0000 7f91bfcfd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91b806c770 0x7f91b8070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:40.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.181+0000 7f91bfcfd640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b806cbe0 con 0x7f91b806c2c0 2023-11-28T20:09:40.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.181+0000 7f91bfcfd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b81408c0 con 0x7f91b8140180 2023-11-28T20:09:40.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.181+0000 7f91bfcfd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b815db80 con 0x7f91b806c770 2023-11-28T20:09:40.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.181+0000 7f91bda99640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f91b8140180 0x7f91b8071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:40.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.181+0000 7f91bda99640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f91b8140180 0x7f91b8071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47716/0 (socket says 172.21.15.177:47716) 2023-11-28T20:09:40.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.181+0000 7f91bda99640 1 -- 172.21.15.177:0/1027664227 learned_addr learned my addr 172.21.15.177:0/1027664227 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:40.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.181+0000 7f91be29a640 1 --2- 172.21.15.177:0/1027664227 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91b806c770 0x7f91b8070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:40.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.181+0000 7f91bda99640 1 -- 172.21.15.177:0/1027664227 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91b806c770 msgr2=0x7f91b8070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:40.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.181+0000 7f91bda99640 1 --2- 172.21.15.177:0/1027664227 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91b806c770 0x7f91b8070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.181+0000 7f91bda99640 1 -- 172.21.15.177:0/1027664227 >> v1:172.21.15.195:6789/0 conn(0x7f91b806c2c0 legacy=0x7f91b8070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:40.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.181+0000 7f91bda99640 1 -- 172.21.15.177:0/1027664227 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b815de60 con 0x7f91b8140180 2023-11-28T20:09:40.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.185+0000 7f91bda99640 1 --2- 172.21.15.177:0/1027664227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91b8140180 0x7f91b8071f20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009870 tx=0x7f91b401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea00b44b807a827d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:40.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.185+0000 7f91bca97640 1 -- 172.21.15.177:0/1027664227 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40aa670 con 0x7f91b8140180 2023-11-28T20:09:40.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.185+0000 7f91bca97640 1 -- 172.21.15.177:0/1027664227 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b40aa7d0 con 0x7f91b8140180 2023-11-28T20:09:40.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.185+0000 7f91bca97640 1 -- 172.21.15.177:0/1027664227 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40aab60 con 0x7f91b8140180 2023-11-28T20:09:40.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.185+0000 7f91bfcfd640 1 -- 172.21.15.177:0/1027664227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91b8140180 msgr2=0x7f91b8071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:40.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.185+0000 7f91bfcfd640 1 --2- 172.21.15.177:0/1027664227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91b8140180 0x7f91b8071f20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009870 tx=0x7f91b401c510 comp rx=0 tx=0).stop 2023-11-28T20:09:40.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.185+0000 7f91bfcfd640 1 -- 172.21.15.177:0/1027664227 shutdown_connections 2023-11-28T20:09:40.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.185+0000 7f91bfcfd640 1 --2- 172.21.15.177:0/1027664227 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91b806c770 0x7f91b8070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.185+0000 7f91bfcfd640 1 --2- 172.21.15.177:0/1027664227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91b8140180 0x7f91b8071f20 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.185+0000 7f91bfcfd640 1 -- 172.21.15.177:0/1027664227 >> 172.21.15.177:0/1027664227 conn(0x7f91b806a530 msgr2=0x7f91b806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:40.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.185+0000 7f91bfcfd640 1 -- 172.21.15.177:0/1027664227 shutdown_connections 2023-11-28T20:09:40.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.185+0000 7f91bfcfd640 1 -- 172.21.15.177:0/1027664227 wait complete. 2023-11-28T20:09:40.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bfcfd640 1 Processor -- start 2023-11-28T20:09:40.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bfcfd640 1 -- start start 2023-11-28T20:09:40.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bfcfd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91b806c2c0 0x7f91b8155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:40.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bfcfd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91b806c770 0x7f91b813f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:40.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bfcfd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91b8140180 0x7f91b8131540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:40.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bfcfd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b81573c0 con 0x7f91b806c770 2023-11-28T20:09:40.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bfcfd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b8156130 con 0x7f91b806c2c0 2023-11-28T20:09:40.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bfcfd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b8156410 con 0x7f91b8140180 2023-11-28T20:09:40.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bd298640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91b806c770 0x7f91b813f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:40.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bd298640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91b806c770 0x7f91b813f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47732/0 (socket says 172.21.15.177:47732) 2023-11-28T20:09:40.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bd298640 1 -- 172.21.15.177:0/3853855998 learned_addr learned my addr 172.21.15.177:0/3853855998 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:40.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91be29a640 1 --2- 172.21.15.177:0/3853855998 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91b8140180 0x7f91b8131540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:40.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bda99640 1 --2- 172.21.15.177:0/3853855998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91b806c2c0 0x7f91b8155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:40.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bd298640 1 -- 172.21.15.177:0/3853855998 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91b8140180 msgr2=0x7f91b8131540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:40.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bd298640 1 --2- 172.21.15.177:0/3853855998 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91b8140180 0x7f91b8131540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bd298640 1 -- 172.21.15.177:0/3853855998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91b806c2c0 msgr2=0x7f91b8155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:40.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bd298640 1 --2- 172.21.15.177:0/3853855998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91b806c2c0 0x7f91b8155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bd298640 1 -- 172.21.15.177:0/3853855998 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b40094d0 con 0x7f91b806c770 2023-11-28T20:09:40.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bd298640 1 --2- 172.21.15.177:0/3853855998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91b806c770 0x7f91b813f720 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f91a800c500 tx=0x7f91a800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:40.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91ae7fc640 1 -- 172.21.15.177:0/3853855998 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8005220 con 0x7f91b806c770 2023-11-28T20:09:40.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91ae7fc640 1 -- 172.21.15.177:0/3853855998 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a8005380 con 0x7f91b806c770 2023-11-28T20:09:40.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bfcfd640 1 -- 172.21.15.177:0/3853855998 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b81566f0 con 0x7f91b806c770 2023-11-28T20:09:40.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91ae7fc640 1 -- 172.21.15.177:0/3853855998 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8007270 con 0x7f91b806c770 2023-11-28T20:09:40.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.189+0000 7f91bfcfd640 1 -- 172.21.15.177:0/3853855998 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b8156cb0 con 0x7f91b806c770 2023-11-28T20:09:40.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.193+0000 7f91bfcfd640 1 -- 172.21.15.177:0/3853855998 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b8069440 con 0x7f91b806c770 2023-11-28T20:09:40.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.193+0000 7f91ae7fc640 1 -- 172.21.15.177:0/3853855998 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91a80073d0 con 0x7f91b806c770 2023-11-28T20:09:40.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.193+0000 7f91ae7fc640 1 --2- 172.21.15.177:0/3853855998 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f919c066470 0x7f919c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:40.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.193+0000 7f91ae7fc640 1 -- 172.21.15.177:0/3853855998 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f91a8083300 con 0x7f91b806c770 2023-11-28T20:09:40.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.193+0000 7f91bda99640 1 --2- 172.21.15.177:0/3853855998 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f919c066470 0x7f919c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:40.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.193+0000 7f91bda99640 1 --2- 172.21.15.177:0/3853855998 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f919c066470 0x7f919c068930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f91b40ae000 tx=0x7f91b40b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:40.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.197+0000 7f91ae7fc640 1 -- 172.21.15.177:0/3853855998 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91a8050b70 con 0x7f91b806c770 2023-11-28T20:09:40.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.349+0000 7f91bfcfd640 1 -- 172.21.15.177:0/3853855998 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f91b8156e40 con 0x7f91b806c770 2023-11-28T20:09:40.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.349+0000 7f91ae7fc640 1 -- 172.21.15.177:0/3853855998 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v45) v1 ==== 84+0+65 (secure 0 0 0) 0x7f91a8054190 con 0x7f91b806c770 2023-11-28T20:09:40.353 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:40.353 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-11-28T20:09:40.353 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-28T20:09:40.353 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-11-28T20:09:40.354 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-11-28T20:09:40.354 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:40.354 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-11-28T20:09:40.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.353+0000 7f91bfcfd640 1 -- 172.21.15.177:0/3853855998 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f919c066470 msgr2=0x7f919c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:40.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.353+0000 7f91bfcfd640 1 --2- 172.21.15.177:0/3853855998 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f919c066470 0x7f919c068930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f91b40ae000 tx=0x7f91b40b5040 comp rx=0 tx=0).stop 2023-11-28T20:09:40.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.353+0000 7f91bfcfd640 1 -- 172.21.15.177:0/3853855998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91b806c770 msgr2=0x7f91b813f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:40.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.353+0000 7f91bfcfd640 1 --2- 172.21.15.177:0/3853855998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91b806c770 0x7f91b813f720 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f91a800c500 tx=0x7f91a800c9c0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.353+0000 7f91bfcfd640 1 -- 172.21.15.177:0/3853855998 shutdown_connections 2023-11-28T20:09:40.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.353+0000 7f91bfcfd640 1 --2- 172.21.15.177:0/3853855998 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f919c066470 0x7f919c068930 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.353+0000 7f91bfcfd640 1 --2- 172.21.15.177:0/3853855998 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91b8140180 0x7f91b8131540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.353+0000 7f91bfcfd640 1 --2- 172.21.15.177:0/3853855998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91b806c770 0x7f91b813f720 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.353+0000 7f91bfcfd640 1 --2- 172.21.15.177:0/3853855998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91b806c2c0 0x7f91b8155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.353+0000 7f91bfcfd640 1 -- 172.21.15.177:0/3853855998 >> 172.21.15.177:0/3853855998 conn(0x7f91b806a530 msgr2=0x7f91b8140bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:40.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.353+0000 7f91bfcfd640 1 -- 172.21.15.177:0/3853855998 shutdown_connections 2023-11-28T20:09:40.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.353+0000 7f91bfcfd640 1 -- 172.21.15.177:0/3853855998 wait complete. 2023-11-28T20:09:40.374 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T20:09:40.374 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T20:09:40.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.557+0000 7f10dbc54640 1 Processor -- start 2023-11-28T20:09:40.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.557+0000 7f10dbc54640 1 -- start start 2023-11-28T20:09:40.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.557+0000 7f10dbc54640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f10d40cce60 0x7f10d40ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:40.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.557+0000 7f10dbc54640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d40cea20 con 0x7f10d41654f0 2023-11-28T20:09:40.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.557+0000 7f10dbc54640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d4165250 con 0x7f10d4164e70 2023-11-28T20:09:40.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.557+0000 7f10dbc54640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d40cd440 con 0x7f10d40cce60 2023-11-28T20:09:40.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.557+0000 7f10da1f1640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f10d41654f0 0x7f10d4165900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47264/0 (socket says 172.21.15.177:47264) 2023-11-28T20:09:40.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.557+0000 7f10da1f1640 1 -- 172.21.15.177:0/2750052416 learned_addr learned my addr 172.21.15.177:0/2750052416 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:40.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.557+0000 7f10d91ef640 1 --2- 172.21.15.177:0/2750052416 >> v2:172.21.15.177:3300/0 conn(0x7f10d40cce60 0x7f10d40ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:40.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.557+0000 7f10d89ee640 1 -- 172.21.15.177:0/2750052416 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626343359 0 0) 0x7f10cc0014a0 con 0x7f10d41654f0 2023-11-28T20:09:40.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.557+0000 7f10d89ee640 1 -- 172.21.15.177:0/2750052416 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c0003530 con 0x7f10d41654f0 2023-11-28T20:09:40.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.557+0000 7f10d91ef640 1 -- 172.21.15.177:0/2750052416 >> v1:172.21.15.195:6789/0 conn(0x7f10d4164e70 legacy=0x7f10d40b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:40.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.557+0000 7f10d91ef640 1 -- 172.21.15.177:0/2750052416 >> v1:172.21.15.177:6789/0 conn(0x7f10d41654f0 legacy=0x7f10d4165900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:40.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.557+0000 7f10d91ef640 1 -- 172.21.15.177:0/2750052416 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d40cd720 con 0x7f10d40cce60 2023-11-28T20:09:40.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.561+0000 7f10d91ef640 1 --2- 172.21.15.177:0/2750052416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d40cce60 0x7f10d40ce4e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f10c40097c0 tx=0x7f10c401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c306db37622bdb6f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:40.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.561+0000 7f10d89ee640 1 -- 172.21.15.177:0/2750052416 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c40ac620 con 0x7f10d40cce60 2023-11-28T20:09:40.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.561+0000 7f10d89ee640 1 -- 172.21.15.177:0/2750052416 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c40ac780 con 0x7f10d40cce60 2023-11-28T20:09:40.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.561+0000 7f10d89ee640 1 -- 172.21.15.177:0/2750052416 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c40acb10 con 0x7f10d40cce60 2023-11-28T20:09:40.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.561+0000 7f10dbc54640 1 -- 172.21.15.177:0/2750052416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d40cce60 msgr2=0x7f10d40ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:40.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.561+0000 7f10dbc54640 1 --2- 172.21.15.177:0/2750052416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d40cce60 0x7f10d40ce4e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f10c40097c0 tx=0x7f10c401c3c0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.561+0000 7f10dbc54640 1 -- 172.21.15.177:0/2750052416 shutdown_connections 2023-11-28T20:09:40.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.561+0000 7f10dbc54640 1 --2- 172.21.15.177:0/2750052416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d40cce60 0x7f10d40ce4e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.561+0000 7f10dbc54640 1 -- 172.21.15.177:0/2750052416 >> 172.21.15.177:0/2750052416 conn(0x7f10d40b0c50 msgr2=0x7f10d40b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:40.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.561+0000 7f10dbc54640 1 -- 172.21.15.177:0/2750052416 shutdown_connections 2023-11-28T20:09:40.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.561+0000 7f10dbc54640 1 -- 172.21.15.177:0/2750052416 wait complete. 2023-11-28T20:09:40.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10dbc54640 1 Processor -- start 2023-11-28T20:09:40.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10dbc54640 1 -- start start 2023-11-28T20:09:40.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10dbc54640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d40cce60 0x7f10d4160d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:40.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10dbc54640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4164e70 0x7f10d40abf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:40.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10dbc54640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d41654f0 0x7f10d415fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:40.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10dbc54640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d40ad390 con 0x7f10d41654f0 2023-11-28T20:09:40.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10dbc54640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d414fd70 con 0x7f10d4164e70 2023-11-28T20:09:40.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10dbc54640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d40ac470 con 0x7f10d40cce60 2023-11-28T20:09:40.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10da1f1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d41654f0 0x7f10d415fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:40.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10da1f1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d41654f0 0x7f10d415fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47756/0 (socket says 172.21.15.177:47756) 2023-11-28T20:09:40.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10da1f1640 1 -- 172.21.15.177:0/1096998477 learned_addr learned my addr 172.21.15.177:0/1096998477 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:40.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10d91ef640 1 --2- 172.21.15.177:0/1096998477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4164e70 0x7f10d40abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:40.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10d99f0640 1 --2- 172.21.15.177:0/1096998477 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d40cce60 0x7f10d4160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:40.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10da1f1640 1 -- 172.21.15.177:0/1096998477 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d40cce60 msgr2=0x7f10d4160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:40.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10da1f1640 1 --2- 172.21.15.177:0/1096998477 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d40cce60 0x7f10d4160d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10da1f1640 1 -- 172.21.15.177:0/1096998477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4164e70 msgr2=0x7f10d40abf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:40.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10da1f1640 1 --2- 172.21.15.177:0/1096998477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4164e70 0x7f10d40abf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:40.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10da1f1640 1 -- 172.21.15.177:0/1096998477 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c4009420 con 0x7f10d41654f0 2023-11-28T20:09:40.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10da1f1640 1 --2- 172.21.15.177:0/1096998477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d41654f0 0x7f10d415fa70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00cae0 tx=0x7f10cc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:40.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10ca7fc640 1 -- 172.21.15.177:0/1096998477 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc00ac40 con 0x7f10d41654f0 2023-11-28T20:09:40.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10ca7fc640 1 -- 172.21.15.177:0/1096998477 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc00ada0 con 0x7f10d41654f0 2023-11-28T20:09:40.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10ca7fc640 1 -- 172.21.15.177:0/1096998477 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc012620 con 0x7f10d41654f0 2023-11-28T20:09:40.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10dbc54640 1 -- 172.21.15.177:0/1096998477 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d40ac710 con 0x7f10d41654f0 2023-11-28T20:09:40.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.565+0000 7f10dbc54640 1 -- 172.21.15.177:0/1096998477 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d40accd0 con 0x7f10d41654f0 2023-11-28T20:09:40.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.569+0000 7f10dbc54640 1 -- 172.21.15.177:0/1096998477 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d404e850 con 0x7f10d41654f0 2023-11-28T20:09:40.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.569+0000 7f10ca7fc640 1 -- 172.21.15.177:0/1096998477 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f10cc007070 con 0x7f10d41654f0 2023-11-28T20:09:40.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.569+0000 7f10ca7fc640 1 --2- 172.21.15.177:0/1096998477 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10b8066470 0x7f10b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:40.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.569+0000 7f10ca7fc640 1 -- 172.21.15.177:0/1096998477 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f10cc083920 con 0x7f10d41654f0 2023-11-28T20:09:40.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.569+0000 7f10d99f0640 1 --2- 172.21.15.177:0/1096998477 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10b8066470 0x7f10b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:40.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.569+0000 7f10d99f0640 1 --2- 172.21.15.177:0/1096998477 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10b8066470 0x7f10b8068930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f10d0007fd0 tx=0x7f10d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:40.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.573+0000 7f10ca7fc640 1 -- 172.21.15.177:0/1096998477 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10cc051110 con 0x7f10d41654f0 2023-11-28T20:09:40.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:40.729+0000 7f10dbc54640 1 -- 172.21.15.177:0/1096998477 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f10d40ad4d0 con 0x7f10d41654f0 2023-11-28T20:09:41.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.633+0000 7f10ca7fc640 1 -- 172.21.15.177:0/1096998477 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v46) v1 ==== 138+0+0 (secure 0 0 0) 0x7f10d40ad4d0 con 0x7f10d41654f0 2023-11-28T20:09:41.638 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-11-28T20:09:41.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.637+0000 7f10dbc54640 1 -- 172.21.15.177:0/1096998477 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10b8066470 msgr2=0x7f10b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:41.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.637+0000 7f10dbc54640 1 --2- 172.21.15.177:0/1096998477 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10b8066470 0x7f10b8068930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f10d0007fd0 tx=0x7f10d0009040 comp rx=0 tx=0).stop 2023-11-28T20:09:41.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.637+0000 7f10dbc54640 1 -- 172.21.15.177:0/1096998477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d41654f0 msgr2=0x7f10d415fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:41.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.637+0000 7f10dbc54640 1 --2- 172.21.15.177:0/1096998477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d41654f0 0x7f10d415fa70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00cae0 tx=0x7f10cc00a060 comp rx=0 tx=0).stop 2023-11-28T20:09:41.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.637+0000 7f10dbc54640 1 -- 172.21.15.177:0/1096998477 shutdown_connections 2023-11-28T20:09:41.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.637+0000 7f10dbc54640 1 --2- 172.21.15.177:0/1096998477 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f10b8066470 0x7f10b8068930 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:41.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.637+0000 7f10dbc54640 1 --2- 172.21.15.177:0/1096998477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d41654f0 0x7f10d415fa70 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:41.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.637+0000 7f10dbc54640 1 --2- 172.21.15.177:0/1096998477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4164e70 0x7f10d40abf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:41.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.637+0000 7f10dbc54640 1 --2- 172.21.15.177:0/1096998477 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10d40cce60 0x7f10d4160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:41.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.637+0000 7f10dbc54640 1 -- 172.21.15.177:0/1096998477 >> 172.21.15.177:0/1096998477 conn(0x7f10d40b0c50 msgr2=0x7f10d40b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:41.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.641+0000 7f10dbc54640 1 -- 172.21.15.177:0/1096998477 shutdown_connections 2023-11-28T20:09:41.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.641+0000 7f10dbc54640 1 -- 172.21.15.177:0/1096998477 wait complete. 2023-11-28T20:09:41.669 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T20:09:41.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.813+0000 7f6cacfaa640 1 Processor -- start 2023-11-28T20:09:41.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.813+0000 7f6cacfaa640 1 -- start start 2023-11-28T20:09:41.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.813+0000 7f6cacfaa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca8070480 0x7f6ca815b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:41.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.813+0000 7f6cacfaa640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6ca80b42d0 0x7f6ca80b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:41.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.813+0000 7f6cacfaa640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca81446f0 con 0x7f6ca8143d10 2023-11-28T20:09:41.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.813+0000 7f6cacfaa640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca8071590 con 0x7f6ca80b42d0 2023-11-28T20:09:41.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.813+0000 7f6cacfaa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80b4ca0 con 0x7f6ca8070480 2023-11-28T20:09:41.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.817+0000 7f6c9dd9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca8070480 0x7f6ca815b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:41.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.817+0000 7f6ca6d9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6ca80b42d0 0x7f6ca80b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:41.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.817+0000 7f6ca659c640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f6ca8143d10 0x7f6ca815f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:34356/0 (socket says 172.21.15.177:34356) 2023-11-28T20:09:41.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.817+0000 7f6ca659c640 1 -- 172.21.15.177:0/2938929780 learned_addr learned my addr 172.21.15.177:0/2938929780 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:41.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.817+0000 7f6ca5d9b640 1 -- 172.21.15.177:0/2938929780 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531825635 0 0) 0x7f6ca81446f0 con 0x7f6ca8143d10 2023-11-28T20:09:41.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.817+0000 7f6ca5d9b640 1 -- 172.21.15.177:0/2938929780 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c94003530 con 0x7f6ca8143d10 2023-11-28T20:09:41.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.817+0000 7f6c9dd9b640 1 -- 172.21.15.177:0/2938929780 >> v2:172.21.15.195:3300/0 conn(0x7f6ca80b42d0 msgr2=0x7f6ca80b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:41.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.817+0000 7f6c9dd9b640 1 --2- 172.21.15.177:0/2938929780 >> v2:172.21.15.195:3300/0 conn(0x7f6ca80b42d0 0x7f6ca80b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:41.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.817+0000 7f6c9dd9b640 1 -- 172.21.15.177:0/2938929780 >> v1:172.21.15.195:6789/0 conn(0x7f6ca8143d10 legacy=0x7f6ca815f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:41.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.817+0000 7f6c9dd9b640 1 -- 172.21.15.177:0/2938929780 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca8070910 con 0x7f6ca8070480 2023-11-28T20:09:41.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.817+0000 7f6ca6d9d640 1 --2- 172.21.15.177:0/2938929780 >> v2:172.21.15.195:3300/0 conn(0x7f6ca80b42d0 0x7f6ca80b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:09:41.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.817+0000 7f6c9dd9b640 1 --2- 172.21.15.177:0/2938929780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca8070480 0x7f6ca815b5e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c900097c0 tx=0x7f6c9001c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df49904fb0201ca7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:41.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.817+0000 7f6ca5d9b640 1 -- 172.21.15.177:0/2938929780 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900ab600 con 0x7f6ca8070480 2023-11-28T20:09:41.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.817+0000 7f6ca5d9b640 1 -- 172.21.15.177:0/2938929780 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900a7050 con 0x7f6ca8070480 2023-11-28T20:09:41.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.817+0000 7f6ca5d9b640 1 -- 172.21.15.177:0/2938929780 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900ab980 con 0x7f6ca8070480 2023-11-28T20:09:41.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 -- 172.21.15.177:0/2938929780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca8070480 msgr2=0x7f6ca815b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:41.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 --2- 172.21.15.177:0/2938929780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca8070480 0x7f6ca815b5e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c900097c0 tx=0x7f6c9001c330 comp rx=0 tx=0).stop 2023-11-28T20:09:41.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 -- 172.21.15.177:0/2938929780 shutdown_connections 2023-11-28T20:09:41.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 --2- 172.21.15.177:0/2938929780 >> v2:172.21.15.195:3300/0 conn(0x7f6ca80b42d0 0x7f6ca80b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:41.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 --2- 172.21.15.177:0/2938929780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca8070480 0x7f6ca815b5e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:41.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 -- 172.21.15.177:0/2938929780 >> 172.21.15.177:0/2938929780 conn(0x7f6ca80b0cc0 msgr2=0x7f6ca80b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:41.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 -- 172.21.15.177:0/2938929780 shutdown_connections 2023-11-28T20:09:41.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 -- 172.21.15.177:0/2938929780 wait complete. 2023-11-28T20:09:41.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 Processor -- start 2023-11-28T20:09:41.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 -- start start 2023-11-28T20:09:41.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ca80b42d0 0x7f6ca81657f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:41.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ca8143d10 0x7f6ca81472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:41.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca815a950 0x7f6ca81646c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:41.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca81597e0 con 0x7f6ca8143d10 2023-11-28T20:09:41.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8147c10 con 0x7f6ca80b42d0 2023-11-28T20:09:41.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6cacfaa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8147ef0 con 0x7f6ca815a950 2023-11-28T20:09:41.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6c9dd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ca8143d10 0x7f6ca81472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:41.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6c9dd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ca8143d10 0x7f6ca81472e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47758/0 (socket says 172.21.15.177:47758) 2023-11-28T20:09:41.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.821+0000 7f6c9dd9b640 1 -- 172.21.15.177:0/2225310324 learned_addr learned my addr 172.21.15.177:0/2225310324 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:41.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6ca659c640 1 --2- 172.21.15.177:0/2225310324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ca80b42d0 0x7f6ca81657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:41.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6ca6d9d640 1 --2- 172.21.15.177:0/2225310324 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca815a950 0x7f6ca81646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:41.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6ca6d9d640 1 -- 172.21.15.177:0/2225310324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ca80b42d0 msgr2=0x7f6ca81657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:41.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6ca6d9d640 1 --2- 172.21.15.177:0/2225310324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ca80b42d0 0x7f6ca81657f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:41.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6ca6d9d640 1 -- 172.21.15.177:0/2225310324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ca8143d10 msgr2=0x7f6ca81472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:41.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6ca6d9d640 1 --2- 172.21.15.177:0/2225310324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ca8143d10 0x7f6ca81472e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:41.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6ca6d9d640 1 -- 172.21.15.177:0/2225310324 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca0009a70 con 0x7f6ca815a950 2023-11-28T20:09:41.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6c9dd9b640 1 --2- 172.21.15.177:0/2225310324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ca8143d10 0x7f6ca81472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:09:41.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6ca6d9d640 1 --2- 172.21.15.177:0/2225310324 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca815a950 0x7f6ca81646c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000efc0 tx=0x7f6ca000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:41.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6c9f7fe640 1 -- 172.21.15.177:0/2225310324 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca000cd30 con 0x7f6ca815a950 2023-11-28T20:09:41.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6c9f7fe640 1 -- 172.21.15.177:0/2225310324 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca000f040 con 0x7f6ca815a950 2023-11-28T20:09:41.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6c9f7fe640 1 -- 172.21.15.177:0/2225310324 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0003be0 con 0x7f6ca815a950 2023-11-28T20:09:41.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6cacfaa640 1 -- 172.21.15.177:0/2225310324 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c90009420 con 0x7f6ca815a950 2023-11-28T20:09:41.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6cacfaa640 1 -- 172.21.15.177:0/2225310324 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca8159400 con 0x7f6ca815a950 2023-11-28T20:09:41.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6cacfaa640 1 -- 172.21.15.177:0/2225310324 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca8069440 con 0x7f6ca815a950 2023-11-28T20:09:41.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.825+0000 7f6c9f7fe640 1 -- 172.21.15.177:0/2225310324 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ca0014480 con 0x7f6ca815a950 2023-11-28T20:09:41.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.829+0000 7f6c9f7fe640 1 --2- 172.21.15.177:0/2225310324 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6c88066470 0x7f6c88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:41.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.829+0000 7f6c9f7fe640 1 -- 172.21.15.177:0/2225310324 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6ca00851e0 con 0x7f6ca815a950 2023-11-28T20:09:41.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.829+0000 7f6ca659c640 1 --2- 172.21.15.177:0/2225310324 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6c88066470 0x7f6c88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:41.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.829+0000 7f6ca659c640 1 --2- 172.21.15.177:0/2225310324 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6c88066470 0x7f6c88068930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6c980011f0 tx=0x7f6c98007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:41.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.833+0000 7f6c9f7fe640 1 -- 172.21.15.177:0/2225310324 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6ca0052960 con 0x7f6ca815a950 2023-11-28T20:09:41.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:41.981+0000 7f6cacfaa640 1 -- 172.21.15.177:0/2225310324 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6ca8148030 con 0x7f6ca815a950 2023-11-28T20:09:42.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.649+0000 7f6c9f7fe640 1 -- 172.21.15.177:0/2225310324 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v47) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6ca8148030 con 0x7f6ca815a950 2023-11-28T20:09:42.658 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-11-28T20:09:42.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.665+0000 7f6cacfaa640 1 -- 172.21.15.177:0/2225310324 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6c88066470 msgr2=0x7f6c88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:42.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.665+0000 7f6cacfaa640 1 --2- 172.21.15.177:0/2225310324 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6c88066470 0x7f6c88068930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6c980011f0 tx=0x7f6c98007d40 comp rx=0 tx=0).stop 2023-11-28T20:09:42.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.665+0000 7f6cacfaa640 1 -- 172.21.15.177:0/2225310324 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca815a950 msgr2=0x7f6ca81646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:42.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.665+0000 7f6cacfaa640 1 --2- 172.21.15.177:0/2225310324 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca815a950 0x7f6ca81646c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000efc0 tx=0x7f6ca000c490 comp rx=0 tx=0).stop 2023-11-28T20:09:42.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.669+0000 7f6cacfaa640 1 -- 172.21.15.177:0/2225310324 shutdown_connections 2023-11-28T20:09:42.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.669+0000 7f6cacfaa640 1 --2- 172.21.15.177:0/2225310324 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6c88066470 0x7f6c88068930 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:42.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.669+0000 7f6cacfaa640 1 --2- 172.21.15.177:0/2225310324 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca815a950 0x7f6ca81646c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:42.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.669+0000 7f6cacfaa640 1 --2- 172.21.15.177:0/2225310324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ca8143d10 0x7f6ca81472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:42.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.669+0000 7f6cacfaa640 1 --2- 172.21.15.177:0/2225310324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ca80b42d0 0x7f6ca81657f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:42.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.669+0000 7f6cacfaa640 1 -- 172.21.15.177:0/2225310324 >> 172.21.15.177:0/2225310324 conn(0x7f6ca80b0cc0 msgr2=0x7f6ca813a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:42.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.669+0000 7f6cacfaa640 1 -- 172.21.15.177:0/2225310324 shutdown_connections 2023-11-28T20:09:42.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.673+0000 7f6cacfaa640 1 -- 172.21.15.177:0/2225310324 wait complete. 2023-11-28T20:09:42.701 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T20:09:42.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.841+0000 7ff8d1c79640 1 Processor -- start 2023-11-28T20:09:42.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.841+0000 7ff8d1c79640 1 -- start start 2023-11-28T20:09:42.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8d1c79640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8cc0cba10 0x7ff8cc15be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:42.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8d1c79640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff8cc0b42d0 0x7ff8cc0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:42.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8d1c79640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8cc0b4c40 con 0x7ff8cc158ca0 2023-11-28T20:09:42.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8d1c79640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8cc15b670 con 0x7ff8cc0b42d0 2023-11-28T20:09:42.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8d1c79640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc15f410 con 0x7ff8cc0cba10 2023-11-28T20:09:42.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8cb7fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ff8cc158ca0 0x7ff8cc15eb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47268/0 (socket says 172.21.15.177:47268) 2023-11-28T20:09:42.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8cb7fe640 1 -- 172.21.15.177:0/3365255684 learned_addr learned my addr 172.21.15.177:0/3365255684 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:42.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8cbfff640 1 --2- 172.21.15.177:0/3365255684 >> v2:172.21.15.177:3300/0 conn(0x7ff8cc0b42d0 0x7ff8cc0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:42.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8caffd640 1 --2- 172.21.15.177:0/3365255684 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8cc0cba10 0x7ff8cc15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:42.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8ca7fc640 1 -- 172.21.15.177:0/3365255684 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649265065 0 0) 0x7ff8cc0b4c40 con 0x7ff8cc158ca0 2023-11-28T20:09:42.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8ca7fc640 1 -- 172.21.15.177:0/3365255684 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8b4003530 con 0x7ff8cc158ca0 2023-11-28T20:09:42.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8cbfff640 1 -- 172.21.15.177:0/3365255684 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8cc0cba10 msgr2=0x7ff8cc15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:42.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8cbfff640 1 --2- 172.21.15.177:0/3365255684 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8cc0cba10 0x7ff8cc15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:42.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8cbfff640 1 -- 172.21.15.177:0/3365255684 >> v1:172.21.15.177:6789/0 conn(0x7ff8cc158ca0 legacy=0x7ff8cc15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:42.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8cbfff640 1 -- 172.21.15.177:0/3365255684 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc15f6f0 con 0x7ff8cc0b42d0 2023-11-28T20:09:42.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.845+0000 7ff8cbfff640 1 --2- 172.21.15.177:0/3365255684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8cc0b42d0 0x7ff8cc0b4700 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009d90 tx=0x7ff8c401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a453179807d2cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:42.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8ca7fc640 1 -- 172.21.15.177:0/3365255684 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40a5920 con 0x7ff8cc0b42d0 2023-11-28T20:09:42.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8ca7fc640 1 -- 172.21.15.177:0/3365255684 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c40a5a80 con 0x7ff8cc0b42d0 2023-11-28T20:09:42.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8ca7fc640 1 -- 172.21.15.177:0/3365255684 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40a5df0 con 0x7ff8cc0b42d0 2023-11-28T20:09:42.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 -- 172.21.15.177:0/3365255684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8cc0b42d0 msgr2=0x7ff8cc0b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:42.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 --2- 172.21.15.177:0/3365255684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8cc0b42d0 0x7ff8cc0b4700 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009d90 tx=0x7ff8c401c950 comp rx=0 tx=0).stop 2023-11-28T20:09:42.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 -- 172.21.15.177:0/3365255684 shutdown_connections 2023-11-28T20:09:42.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 --2- 172.21.15.177:0/3365255684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8cc0b42d0 0x7ff8cc0b4700 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:42.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 --2- 172.21.15.177:0/3365255684 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8cc0cba10 0x7ff8cc15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:42.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 -- 172.21.15.177:0/3365255684 >> 172.21.15.177:0/3365255684 conn(0x7ff8cc0b0cc0 msgr2=0x7ff8cc0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:42.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 -- 172.21.15.177:0/3365255684 shutdown_connections 2023-11-28T20:09:42.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 -- 172.21.15.177:0/3365255684 wait complete. 2023-11-28T20:09:42.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 Processor -- start 2023-11-28T20:09:42.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 -- start start 2023-11-28T20:09:42.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8cc0b42d0 0x7ff8cc1576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:42.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8cc0cba10 0x7ff8cc145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:42.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8cc158ca0 0x7ff8cc1564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:42.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc14ed90 con 0x7ff8cc0b42d0 2023-11-28T20:09:42.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc157c00 con 0x7ff8cc0cba10 2023-11-28T20:09:42.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8d1c79640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc14e110 con 0x7ff8cc158ca0 2023-11-28T20:09:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.849+0000 7ff8cb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8cc0b42d0 0x7ff8cc1576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8cb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8cc0b42d0 0x7ff8cc1576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47772/0 (socket says 172.21.15.177:47772) 2023-11-28T20:09:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8cb7fe640 1 -- 172.21.15.177:0/3959648452 learned_addr learned my addr 172.21.15.177:0/3959648452 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8cbfff640 1 --2- 172.21.15.177:0/3959648452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8cc158ca0 0x7ff8cc1564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8cb7fe640 1 -- 172.21.15.177:0/3959648452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8cc158ca0 msgr2=0x7ff8cc1564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8cb7fe640 1 --2- 172.21.15.177:0/3959648452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8cc158ca0 0x7ff8cc1564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8cb7fe640 1 -- 172.21.15.177:0/3959648452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8cc0cba10 msgr2=0x7ff8cc145fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8cb7fe640 1 --2- 172.21.15.177:0/3959648452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8cc0cba10 0x7ff8cc145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8cb7fe640 1 -- 172.21.15.177:0/3959648452 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4009a70 con 0x7ff8cc0b42d0 2023-11-28T20:09:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8cbfff640 1 --2- 172.21.15.177:0/3959648452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8cc158ca0 0x7ff8cc1564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8cb7fe640 1 --2- 172.21.15.177:0/3959648452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8cc0b42d0 0x7ff8cc1576c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0010f0 tx=0x7ff8bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:42.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8b3fff640 1 -- 172.21.15.177:0/3959648452 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc005cf0 con 0x7ff8cc0b42d0 2023-11-28T20:09:42.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8b3fff640 1 -- 172.21.15.177:0/3959648452 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc005e70 con 0x7ff8cc0b42d0 2023-11-28T20:09:42.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8d1c79640 1 -- 172.21.15.177:0/3959648452 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc14e3f0 con 0x7ff8cc0b42d0 2023-11-28T20:09:42.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8b3fff640 1 -- 172.21.15.177:0/3959648452 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0072d0 con 0x7ff8cc0b42d0 2023-11-28T20:09:42.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8d1c79640 1 -- 172.21.15.177:0/3959648452 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc14e9b0 con 0x7ff8cc0b42d0 2023-11-28T20:09:42.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8d1c79640 1 -- 172.21.15.177:0/3959648452 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc0693d0 con 0x7ff8cc0b42d0 2023-11-28T20:09:42.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.853+0000 7ff8b3fff640 1 -- 172.21.15.177:0/3959648452 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff8bc007430 con 0x7ff8cc0b42d0 2023-11-28T20:09:42.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.857+0000 7ff8b3fff640 1 --2- 172.21.15.177:0/3959648452 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff8b8066470 0x7ff8b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:42.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.857+0000 7ff8b3fff640 1 -- 172.21.15.177:0/3959648452 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5609+0+0 (secure 0 0 0) 0x7ff8bc0838b0 con 0x7ff8cc0b42d0 2023-11-28T20:09:42.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.857+0000 7ff8caffd640 1 --2- 172.21.15.177:0/3959648452 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff8b8066470 0x7ff8b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:42.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.857+0000 7ff8caffd640 1 --2- 172.21.15.177:0/3959648452 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff8b8066470 0x7ff8b8068930 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0006aa0 tx=0x7ff8c0006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:42.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:42.857+0000 7ff8b3fff640 1 -- 172.21.15.177:0/3959648452 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff8bc050e70 con 0x7ff8cc0b42d0 2023-11-28T20:09:43.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.041+0000 7ff8d1c79640 1 -- 172.21.15.177:0/3959648452 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff8cc073cf0 con 0x7ff8cc0b42d0 2023-11-28T20:09:43.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.661+0000 7ff8b3fff640 1 -- 172.21.15.177:0/3959648452 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v22) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff8cc073cf0 con 0x7ff8cc0b42d0 2023-11-28T20:09:43.667 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 7 and data pool 8 2023-11-28T20:09:43.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.673+0000 7ff8d1c79640 1 -- 172.21.15.177:0/3959648452 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff8b8066470 msgr2=0x7ff8b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:43.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.673+0000 7ff8d1c79640 1 --2- 172.21.15.177:0/3959648452 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff8b8066470 0x7ff8b8068930 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0006aa0 tx=0x7ff8c0006a30 comp rx=0 tx=0).stop 2023-11-28T20:09:43.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.673+0000 7ff8d1c79640 1 -- 172.21.15.177:0/3959648452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8cc0b42d0 msgr2=0x7ff8cc1576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:43.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.673+0000 7ff8d1c79640 1 --2- 172.21.15.177:0/3959648452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8cc0b42d0 0x7ff8cc1576c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0010f0 tx=0x7ff8bc00c8f0 comp rx=0 tx=0).stop 2023-11-28T20:09:43.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.673+0000 7ff8d1c79640 1 -- 172.21.15.177:0/3959648452 shutdown_connections 2023-11-28T20:09:43.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.673+0000 7ff8d1c79640 1 --2- 172.21.15.177:0/3959648452 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff8b8066470 0x7ff8b8068930 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:43.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.673+0000 7ff8d1c79640 1 --2- 172.21.15.177:0/3959648452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8cc158ca0 0x7ff8cc1564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:43.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.673+0000 7ff8d1c79640 1 --2- 172.21.15.177:0/3959648452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8cc0cba10 0x7ff8cc145fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:43.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.673+0000 7ff8d1c79640 1 --2- 172.21.15.177:0/3959648452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8cc0b42d0 0x7ff8cc1576c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:43.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.673+0000 7ff8d1c79640 1 -- 172.21.15.177:0/3959648452 >> 172.21.15.177:0/3959648452 conn(0x7ff8cc0b0cc0 msgr2=0x7ff8cc157e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:43.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.677+0000 7ff8d1c79640 1 -- 172.21.15.177:0/3959648452 shutdown_connections 2023-11-28T20:09:43.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.681+0000 7ff8d1c79640 1 -- 172.21.15.177:0/3959648452 wait complete. 2023-11-28T20:09:43.713 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:09:43.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa77fb8640 1 Processor -- start 2023-11-28T20:09:43.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa77fb8640 1 -- start start 2023-11-28T20:09:43.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa77fb8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faa7015bc90 0x7faa7006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa77fb8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa7015c070 0x7faa7006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa77fb8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7faa70145250 0x7faa70145700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa77fb8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa70145fc0 con 0x7faa70145250 2023-11-28T20:09:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa77fb8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa701462a0 con 0x7faa7015bc90 2023-11-28T20:09:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa77fb8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa70146580 con 0x7faa7015c070 2023-11-28T20:09:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa76555640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7faa70145250 0x7faa70145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa76555640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7faa70145250 0x7faa70145700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47784/0 (socket says 172.21.15.177:47784) 2023-11-28T20:09:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa76555640 1 -- 172.21.15.177:0/2680983099 learned_addr learned my addr 172.21.15.177:0/2680983099 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa75d54640 1 --2- 172.21.15.177:0/2680983099 >> v2:172.21.15.195:3300/0 conn(0x7faa7015bc90 0x7faa7006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa75553640 1 --2- 172.21.15.177:0/2680983099 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa7015c070 0x7faa7006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa76555640 1 -- 172.21.15.177:0/2680983099 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa7015c070 msgr2=0x7faa7006c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa76555640 1 --2- 172.21.15.177:0/2680983099 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa7015c070 0x7faa7006c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa76555640 1 -- 172.21.15.177:0/2680983099 >> v2:172.21.15.195:3300/0 conn(0x7faa7015bc90 msgr2=0x7faa7006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:43.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa76555640 1 --2- 172.21.15.177:0/2680983099 >> v2:172.21.15.195:3300/0 conn(0x7faa7015bc90 0x7faa7006c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:43.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.849+0000 7faa76555640 1 -- 172.21.15.177:0/2680983099 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa70146860 con 0x7faa70145250 2023-11-28T20:09:43.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.853+0000 7faa76555640 1 --2- 172.21.15.177:0/2680983099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa70145250 0x7faa70145700 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7faa70074af0 tx=0x7faa6801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f892beac72013479 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:43.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.853+0000 7faa74d52640 1 -- 172.21.15.177:0/2680983099 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa680a5840 con 0x7faa70145250 2023-11-28T20:09:43.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.853+0000 7faa74d52640 1 -- 172.21.15.177:0/2680983099 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa680a59a0 con 0x7faa70145250 2023-11-28T20:09:43.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.853+0000 7faa74d52640 1 -- 172.21.15.177:0/2680983099 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa680a5d30 con 0x7faa70145250 2023-11-28T20:09:43.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.853+0000 7faa77fb8640 1 -- 172.21.15.177:0/2680983099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa70145250 msgr2=0x7faa70145700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:43.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.853+0000 7faa77fb8640 1 --2- 172.21.15.177:0/2680983099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa70145250 0x7faa70145700 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7faa70074af0 tx=0x7faa6801c9a0 comp rx=0 tx=0).stop 2023-11-28T20:09:43.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.853+0000 7faa77fb8640 1 -- 172.21.15.177:0/2680983099 shutdown_connections 2023-11-28T20:09:43.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.853+0000 7faa77fb8640 1 --2- 172.21.15.177:0/2680983099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa70145250 0x7faa70145700 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:43.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.853+0000 7faa77fb8640 1 --2- 172.21.15.177:0/2680983099 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa7015c070 0x7faa7006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:43.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.853+0000 7faa77fb8640 1 --2- 172.21.15.177:0/2680983099 >> v2:172.21.15.195:3300/0 conn(0x7faa7015bc90 0x7faa7006c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:43.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.853+0000 7faa77fb8640 1 -- 172.21.15.177:0/2680983099 >> 172.21.15.177:0/2680983099 conn(0x7faa7006a530 msgr2=0x7faa7006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:43.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.853+0000 7faa77fb8640 1 -- 172.21.15.177:0/2680983099 shutdown_connections 2023-11-28T20:09:43.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.853+0000 7faa77fb8640 1 -- 172.21.15.177:0/2680983099 wait complete. 2023-11-28T20:09:43.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa77fb8640 1 Processor -- start 2023-11-28T20:09:43.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa77fb8640 1 -- start start 2023-11-28T20:09:43.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa77fb8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa70145250 0x7faa70161530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:43.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa77fb8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa7015bc90 0x7faa7013eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:43.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa77fb8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa7015c070 0x7faa70161e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:43.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa77fb8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa70159130 con 0x7faa7015bc90 2023-11-28T20:09:43.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa77fb8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa701596f0 con 0x7faa70145250 2023-11-28T20:09:43.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa77fb8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa70143d70 con 0x7faa7015c070 2023-11-28T20:09:43.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa75553640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa7015bc90 0x7faa7013eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:43.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa75553640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa7015bc90 0x7faa7013eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47796/0 (socket says 172.21.15.177:47796) 2023-11-28T20:09:43.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa75553640 1 -- 172.21.15.177:0/16482195 learned_addr learned my addr 172.21.15.177:0/16482195 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:43.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa75d54640 1 --2- 172.21.15.177:0/16482195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa70145250 0x7faa70161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:43.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa76555640 1 --2- 172.21.15.177:0/16482195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa7015c070 0x7faa70161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:43.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa75553640 1 -- 172.21.15.177:0/16482195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa7015c070 msgr2=0x7faa70161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:43.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa75553640 1 --2- 172.21.15.177:0/16482195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa7015c070 0x7faa70161e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:43.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa75553640 1 -- 172.21.15.177:0/16482195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa70145250 msgr2=0x7faa70161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:43.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa75553640 1 --2- 172.21.15.177:0/16482195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa70145250 0x7faa70161530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:43.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa75553640 1 -- 172.21.15.177:0/16482195 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa68009b30 con 0x7faa7015bc90 2023-11-28T20:09:43.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa75553640 1 --2- 172.21.15.177:0/16482195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa7015bc90 0x7faa7013eb80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7faa6000e870 tx=0x7faa6000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:43.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa667fc640 1 -- 172.21.15.177:0/16482195 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60009510 con 0x7faa7015bc90 2023-11-28T20:09:43.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa667fc640 1 -- 172.21.15.177:0/16482195 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6000eec0 con 0x7faa7015bc90 2023-11-28T20:09:43.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa77fb8640 1 -- 172.21.15.177:0/16482195 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa70144050 con 0x7faa7015bc90 2023-11-28T20:09:43.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa667fc640 1 -- 172.21.15.177:0/16482195 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000cb40 con 0x7faa7015bc90 2023-11-28T20:09:43.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa77fb8640 1 -- 172.21.15.177:0/16482195 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa70159380 con 0x7faa7015bc90 2023-11-28T20:09:43.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.857+0000 7faa77fb8640 1 -- 172.21.15.177:0/16482195 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa70069440 con 0x7faa7015bc90 2023-11-28T20:09:43.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.861+0000 7faa667fc640 1 -- 172.21.15.177:0/16482195 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa6000cca0 con 0x7faa7015bc90 2023-11-28T20:09:43.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.861+0000 7faa667fc640 1 --2- 172.21.15.177:0/16482195 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faa540664a0 0x7faa54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:43.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.861+0000 7faa667fc640 1 -- 172.21.15.177:0/16482195 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa60084280 con 0x7faa7015bc90 2023-11-28T20:09:43.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.861+0000 7faa75d54640 1 --2- 172.21.15.177:0/16482195 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faa540664a0 0x7faa54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:43.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.861+0000 7faa75d54640 1 --2- 172.21.15.177:0/16482195 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faa540664a0 0x7faa54068960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faa700704d0 tx=0x7faa6c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:43.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:43.865+0000 7faa667fc640 1 -- 172.21.15.177:0/16482195 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa60051710 con 0x7faa7015bc90 2023-11-28T20:09:44.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.017+0000 7faa77fb8640 1 -- 172.21.15.177:0/16482195 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa70070500 con 0x7faa7015bc90 2023-11-28T20:09:44.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.017+0000 7faa667fc640 1 -- 172.21.15.177:0/16482195 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16642 (secure 0 0 0) 0x7faa60054d30 con 0x7faa7015bc90 2023-11-28T20:09:44.022 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:44.022 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":48,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:09:43.045812+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:09:40.777720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T20:09:42.029277+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:09:44.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.021+0000 7faa77fb8640 1 -- 172.21.15.177:0/16482195 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faa540664a0 msgr2=0x7faa54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:44.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.021+0000 7faa77fb8640 1 --2- 172.21.15.177:0/16482195 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faa540664a0 0x7faa54068960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faa700704d0 tx=0x7faa6c009190 comp rx=0 tx=0).stop 2023-11-28T20:09:44.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.021+0000 7faa77fb8640 1 -- 172.21.15.177:0/16482195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa7015bc90 msgr2=0x7faa7013eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:44.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.021+0000 7faa77fb8640 1 --2- 172.21.15.177:0/16482195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa7015bc90 0x7faa7013eb80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7faa6000e870 tx=0x7faa6000ec70 comp rx=0 tx=0).stop 2023-11-28T20:09:44.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.021+0000 7faa77fb8640 1 -- 172.21.15.177:0/16482195 shutdown_connections 2023-11-28T20:09:44.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.021+0000 7faa77fb8640 1 --2- 172.21.15.177:0/16482195 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7faa540664a0 0x7faa54068960 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.021+0000 7faa77fb8640 1 --2- 172.21.15.177:0/16482195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa7015c070 0x7faa70161e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.021+0000 7faa77fb8640 1 --2- 172.21.15.177:0/16482195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa7015bc90 0x7faa7013eb80 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.021+0000 7faa77fb8640 1 --2- 172.21.15.177:0/16482195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa70145250 0x7faa70161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.021+0000 7faa77fb8640 1 -- 172.21.15.177:0/16482195 >> 172.21.15.177:0/16482195 conn(0x7faa7006a530 msgr2=0x7faa700cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:44.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.021+0000 7faa77fb8640 1 -- 172.21.15.177:0/16482195 shutdown_connections 2023-11-28T20:09:44.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.021+0000 7faa77fb8640 1 -- 172.21.15.177:0/16482195 wait complete. 2023-11-28T20:09:44.043 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:09:44.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.177+0000 7feb92180640 1 Processor -- start 2023-11-28T20:09:44.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.177+0000 7feb92180640 1 -- start start 2023-11-28T20:09:44.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.177+0000 7feb92180640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8c06c9d0 0x7feb8c070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:44.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.177+0000 7feb92180640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7feb8c072180 0x7feb8c0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:44.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.177+0000 7feb92180640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8c0710e0 con 0x7feb8c144840 2023-11-28T20:09:44.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.177+0000 7feb92180640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8c15f010 con 0x7feb8c072180 2023-11-28T20:09:44.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.177+0000 7feb92180640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c070ee0 con 0x7feb8c06c9d0 2023-11-28T20:09:44.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.177+0000 7feb8b7fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7feb8c144840 0x7feb8c06c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47278/0 (socket says 172.21.15.177:47278) 2023-11-28T20:09:44.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.181+0000 7feb8b7fe640 1 -- 172.21.15.177:0/1177925538 learned_addr learned my addr 172.21.15.177:0/1177925538 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:44.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.181+0000 7feb8bfff640 1 --2- 172.21.15.177:0/1177925538 >> v2:172.21.15.195:3300/0 conn(0x7feb8c072180 0x7feb8c0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:44.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.181+0000 7feb8affd640 1 --2- 172.21.15.177:0/1177925538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8c06c9d0 0x7feb8c070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:44.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.181+0000 7feb8a7fc640 1 -- 172.21.15.177:0/1177925538 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038610075 0 0) 0x7feb8c0710e0 con 0x7feb8c144840 2023-11-28T20:09:44.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.181+0000 7feb8a7fc640 1 -- 172.21.15.177:0/1177925538 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb74003530 con 0x7feb8c144840 2023-11-28T20:09:44.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.181+0000 7feb8affd640 1 -- 172.21.15.177:0/1177925538 >> v2:172.21.15.195:3300/0 conn(0x7feb8c072180 msgr2=0x7feb8c0709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:44.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.181+0000 7feb8affd640 1 --2- 172.21.15.177:0/1177925538 >> v2:172.21.15.195:3300/0 conn(0x7feb8c072180 0x7feb8c0709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.181+0000 7feb8affd640 1 -- 172.21.15.177:0/1177925538 >> v1:172.21.15.177:6789/0 conn(0x7feb8c144840 legacy=0x7feb8c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:44.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.181+0000 7feb8affd640 1 -- 172.21.15.177:0/1177925538 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c0713c0 con 0x7feb8c06c9d0 2023-11-28T20:09:44.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.181+0000 7feb8affd640 1 --2- 172.21.15.177:0/1177925538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8c06c9d0 0x7feb8c070460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feb800097c0 tx=0x7feb8001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b10f551406fa9697 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:44.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.181+0000 7feb8a7fc640 1 -- 172.21.15.177:0/1177925538 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800ab650 con 0x7feb8c06c9d0 2023-11-28T20:09:44.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.181+0000 7feb8a7fc640 1 -- 172.21.15.177:0/1177925538 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb800ab7b0 con 0x7feb8c06c9d0 2023-11-28T20:09:44.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.181+0000 7feb8a7fc640 1 -- 172.21.15.177:0/1177925538 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800abb40 con 0x7feb8c06c9d0 2023-11-28T20:09:44.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 -- 172.21.15.177:0/1177925538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8c06c9d0 msgr2=0x7feb8c070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:44.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 --2- 172.21.15.177:0/1177925538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8c06c9d0 0x7feb8c070460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feb800097c0 tx=0x7feb8001c450 comp rx=0 tx=0).stop 2023-11-28T20:09:44.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 -- 172.21.15.177:0/1177925538 shutdown_connections 2023-11-28T20:09:44.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 --2- 172.21.15.177:0/1177925538 >> v2:172.21.15.195:3300/0 conn(0x7feb8c072180 0x7feb8c0709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 --2- 172.21.15.177:0/1177925538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8c06c9d0 0x7feb8c070460 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 -- 172.21.15.177:0/1177925538 >> 172.21.15.177:0/1177925538 conn(0x7feb8c06a530 msgr2=0x7feb8c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:44.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 -- 172.21.15.177:0/1177925538 shutdown_connections 2023-11-28T20:09:44.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 -- 172.21.15.177:0/1177925538 wait complete. 2023-11-28T20:09:44.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 Processor -- start 2023-11-28T20:09:44.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 -- start start 2023-11-28T20:09:44.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8c06c9d0 0x7feb8c1f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:44.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb8c072180 0x7feb8c13d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:44.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb8c144840 0x7feb8c13d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:44.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c0c4940 con 0x7feb8c072180 2023-11-28T20:09:44.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c0b3440 con 0x7feb8c144840 2023-11-28T20:09:44.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb92180640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c0c4b90 con 0x7feb8c06c9d0 2023-11-28T20:09:44.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb8affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb8c072180 0x7feb8c13d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:44.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb8affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb8c072180 0x7feb8c13d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47802/0 (socket says 172.21.15.177:47802) 2023-11-28T20:09:44.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.185+0000 7feb8affd640 1 -- 172.21.15.177:0/752884826 learned_addr learned my addr 172.21.15.177:0/752884826 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:44.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb8b7fe640 1 --2- 172.21.15.177:0/752884826 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8c06c9d0 0x7feb8c1f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:44.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb8bfff640 1 --2- 172.21.15.177:0/752884826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb8c144840 0x7feb8c13d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:44.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb8affd640 1 -- 172.21.15.177:0/752884826 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8c06c9d0 msgr2=0x7feb8c1f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:44.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb8affd640 1 --2- 172.21.15.177:0/752884826 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8c06c9d0 0x7feb8c1f5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb8affd640 1 -- 172.21.15.177:0/752884826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb8c144840 msgr2=0x7feb8c13d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:44.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb8affd640 1 --2- 172.21.15.177:0/752884826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb8c144840 0x7feb8c13d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb8affd640 1 -- 172.21.15.177:0/752884826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb80009420 con 0x7feb8c072180 2023-11-28T20:09:44.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb8affd640 1 --2- 172.21.15.177:0/752884826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb8c072180 0x7feb8c13d180 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7feb800ad040 tx=0x7feb8001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:44.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb73fff640 1 -- 172.21.15.177:0/752884826 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800bf610 con 0x7feb8c072180 2023-11-28T20:09:44.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb73fff640 1 -- 172.21.15.177:0/752884826 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb800bf7b0 con 0x7feb8c072180 2023-11-28T20:09:44.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb73fff640 1 -- 172.21.15.177:0/752884826 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800bfb60 con 0x7feb8c072180 2023-11-28T20:09:44.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb92180640 1 -- 172.21.15.177:0/752884826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8c0c4e70 con 0x7feb8c072180 2023-11-28T20:09:44.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb92180640 1 -- 172.21.15.177:0/752884826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8c1f6340 con 0x7feb8c072180 2023-11-28T20:09:44.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb92180640 1 -- 172.21.15.177:0/752884826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8c069440 con 0x7feb8c072180 2023-11-28T20:09:44.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb73fff640 1 -- 172.21.15.177:0/752884826 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb800b5400 con 0x7feb8c072180 2023-11-28T20:09:44.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb73fff640 1 --2- 172.21.15.177:0/752884826 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7feb78066470 0x7feb78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:44.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb73fff640 1 -- 172.21.15.177:0/752884826 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb8011e860 con 0x7feb8c072180 2023-11-28T20:09:44.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.189+0000 7feb8b7fe640 1 --2- 172.21.15.177:0/752884826 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7feb78066470 0x7feb78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:44.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.193+0000 7feb8b7fe640 1 --2- 172.21.15.177:0/752884826 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7feb78066470 0x7feb78068930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0011f0 tx=0x7feb7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:44.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.193+0000 7feb73fff640 1 -- 172.21.15.177:0/752884826 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb800ebc40 con 0x7feb8c072180 2023-11-28T20:09:44.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.345+0000 7feb92180640 1 -- 172.21.15.177:0/752884826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb8c0c5320 con 0x7feb8c072180 2023-11-28T20:09:44.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.345+0000 7feb73fff640 1 -- 172.21.15.177:0/752884826 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16642 (secure 0 0 0) 0x7feb800ef260 con 0x7feb8c072180 2023-11-28T20:09:44.349 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:44.349 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":48,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:09:43.045812+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:09:40.777720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T20:09:42.029277+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:09:44.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.345+0000 7feb92180640 1 -- 172.21.15.177:0/752884826 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7feb78066470 msgr2=0x7feb78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:44.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.349+0000 7feb92180640 1 --2- 172.21.15.177:0/752884826 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7feb78066470 0x7feb78068930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0011f0 tx=0x7feb7c009040 comp rx=0 tx=0).stop 2023-11-28T20:09:44.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.349+0000 7feb92180640 1 -- 172.21.15.177:0/752884826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb8c072180 msgr2=0x7feb8c13d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:44.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.349+0000 7feb92180640 1 --2- 172.21.15.177:0/752884826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb8c072180 0x7feb8c13d180 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7feb800ad040 tx=0x7feb8001ac90 comp rx=0 tx=0).stop 2023-11-28T20:09:44.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.349+0000 7feb92180640 1 -- 172.21.15.177:0/752884826 shutdown_connections 2023-11-28T20:09:44.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.349+0000 7feb92180640 1 --2- 172.21.15.177:0/752884826 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7feb78066470 0x7feb78068930 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.349+0000 7feb92180640 1 --2- 172.21.15.177:0/752884826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb8c144840 0x7feb8c13d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.349+0000 7feb92180640 1 --2- 172.21.15.177:0/752884826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb8c072180 0x7feb8c13d180 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.349+0000 7feb92180640 1 --2- 172.21.15.177:0/752884826 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8c06c9d0 0x7feb8c1f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.349+0000 7feb92180640 1 -- 172.21.15.177:0/752884826 >> 172.21.15.177:0/752884826 conn(0x7feb8c06a530 msgr2=0x7feb8c15de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:44.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.349+0000 7feb92180640 1 -- 172.21.15.177:0/752884826 shutdown_connections 2023-11-28T20:09:44.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.349+0000 7feb92180640 1 -- 172.21.15.177:0/752884826 wait complete. 2023-11-28T20:09:44.370 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T20:09:44.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.505+0000 7f45881f5640 1 Processor -- start 2023-11-28T20:09:44.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.505+0000 7f45881f5640 1 -- start start 2023-11-28T20:09:44.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.509+0000 7f45881f5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f45800cba10 0x7f458015be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:44.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.509+0000 7f45881f5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45800b42d0 0x7f45800b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:44.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.509+0000 7f45881f5640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45800b4c60 con 0x7f4580158ca0 2023-11-28T20:09:44.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.509+0000 7f45881f5640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458015b670 con 0x7f45800cba10 2023-11-28T20:09:44.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.509+0000 7f45881f5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458015f410 con 0x7f45800b42d0 2023-11-28T20:09:44.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.509+0000 7f4585790640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f45800cba10 0x7f458015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:44.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.509+0000 7f4586792640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45800b42d0 0x7f45800b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:44.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.509+0000 7f4585790640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f45800cba10 0x7f458015be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:36116/0 (socket says 172.21.15.177:36116) 2023-11-28T20:09:44.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.509+0000 7f4586792640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45800b42d0 0x7f45800b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:49108/0 (socket says 172.21.15.177:49108) 2023-11-28T20:09:44.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.509+0000 7f4585790640 1 -- 172.21.15.177:0/2023032067 learned_addr learned my addr 172.21.15.177:0/2023032067 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:44.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.509+0000 7f4585790640 1 -- 172.21.15.177:0/2023032067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45800b42d0 msgr2=0x7f45800b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:44.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.509+0000 7f4585790640 1 --2- 172.21.15.177:0/2023032067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45800b42d0 0x7f45800b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.509+0000 7f4585790640 1 -- 172.21.15.177:0/2023032067 >> v1:172.21.15.195:6789/0 conn(0x7f4580158ca0 legacy=0x7f458015eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:44.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.509+0000 7f4585790640 1 -- 172.21.15.177:0/2023032067 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458015f6f0 con 0x7f45800cba10 2023-11-28T20:09:44.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.509+0000 7f4584f8f640 1 -- 172.21.15.177:0/2023032067 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198495902 0 0) 0x7f457c001120 con 0x7f4580158ca0 2023-11-28T20:09:44.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.513+0000 7f4585790640 1 --2- 172.21.15.177:0/2023032067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45800cba10 0x7f458015be00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4570009870 tx=0x7f457001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69df998986357317 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:44.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.513+0000 7f4584f8f640 1 -- 172.21.15.177:0/2023032067 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700ab650 con 0x7f45800cba10 2023-11-28T20:09:44.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.513+0000 7f4584f8f640 1 -- 172.21.15.177:0/2023032067 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45700ab7b0 con 0x7f45800cba10 2023-11-28T20:09:44.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.513+0000 7f4584f8f640 1 -- 172.21.15.177:0/2023032067 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700abb40 con 0x7f45800cba10 2023-11-28T20:09:44.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.513+0000 7f45881f5640 1 -- 172.21.15.177:0/2023032067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45800cba10 msgr2=0x7f458015be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:44.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.513+0000 7f45881f5640 1 --2- 172.21.15.177:0/2023032067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45800cba10 0x7f458015be00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4570009870 tx=0x7f457001c540 comp rx=0 tx=0).stop 2023-11-28T20:09:44.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.513+0000 7f45881f5640 1 -- 172.21.15.177:0/2023032067 shutdown_connections 2023-11-28T20:09:44.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.513+0000 7f45881f5640 1 --2- 172.21.15.177:0/2023032067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45800b42d0 0x7f45800b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.513+0000 7f45881f5640 1 --2- 172.21.15.177:0/2023032067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45800cba10 0x7f458015be00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.513+0000 7f45881f5640 1 -- 172.21.15.177:0/2023032067 >> 172.21.15.177:0/2023032067 conn(0x7f45800b0cc0 msgr2=0x7f45800b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:44.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.513+0000 7f45881f5640 1 -- 172.21.15.177:0/2023032067 shutdown_connections 2023-11-28T20:09:44.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.513+0000 7f45881f5640 1 -- 172.21.15.177:0/2023032067 wait complete. 2023-11-28T20:09:44.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.513+0000 7f45881f5640 1 Processor -- start 2023-11-28T20:09:44.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f45881f5640 1 -- start start 2023-11-28T20:09:44.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f45881f5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45800b42d0 0x7f45800a86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:44.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f45881f5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45800cba10 0x7f4580153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:44.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f45881f5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4580158ca0 0x7f458014e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:44.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f45881f5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800a8c30 con 0x7f45800cba10 2023-11-28T20:09:44.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f45881f5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458015de10 con 0x7f45800b42d0 2023-11-28T20:09:44.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f45881f5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4580150f00 con 0x7f4580158ca0 2023-11-28T20:09:44.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f4585790640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45800cba10 0x7f4580153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:44.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f4585790640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45800cba10 0x7f4580153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47816/0 (socket says 172.21.15.177:47816) 2023-11-28T20:09:44.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f4585790640 1 -- 172.21.15.177:0/1041015258 learned_addr learned my addr 172.21.15.177:0/1041015258 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:44.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f4586792640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4580158ca0 0x7f458014e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:44.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f4585f91640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45800b42d0 0x7f45800a86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:44.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f4585790640 1 -- 172.21.15.177:0/1041015258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4580158ca0 msgr2=0x7f458014e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:44.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f4585790640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4580158ca0 0x7f458014e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f4585790640 1 -- 172.21.15.177:0/1041015258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45800b42d0 msgr2=0x7f45800a86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:44.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f4585790640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45800b42d0 0x7f45800a86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:44.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f4585790640 1 -- 172.21.15.177:0/1041015258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45700094d0 con 0x7f45800cba10 2023-11-28T20:09:44.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f4586792640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4580158ca0 0x7f458014e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:44.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f4585f91640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45800b42d0 0x7f45800a86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:44.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f4585790640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45800cba10 0x7f4580153340 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f45700ad040 tx=0x7f457001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:44.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f45767fc640 1 -- 172.21.15.177:0/1041015258 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700b4800 con 0x7f45800cba10 2023-11-28T20:09:44.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f45767fc640 1 -- 172.21.15.177:0/1041015258 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45700b4960 con 0x7f45800cba10 2023-11-28T20:09:44.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f45881f5640 1 -- 172.21.15.177:0/1041015258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45801511e0 con 0x7f45800cba10 2023-11-28T20:09:44.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f45767fc640 1 -- 172.21.15.177:0/1041015258 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700b4d10 con 0x7f45800cba10 2023-11-28T20:09:44.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f45881f5640 1 -- 172.21.15.177:0/1041015258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4580153880 con 0x7f45800cba10 2023-11-28T20:09:44.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.517+0000 7f45881f5640 1 -- 172.21.15.177:0/1041015258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4580150d60 con 0x7f45800cba10 2023-11-28T20:09:44.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.521+0000 7f45767fc640 1 -- 172.21.15.177:0/1041015258 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f45700c7390 con 0x7f45800cba10 2023-11-28T20:09:44.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.521+0000 7f45767fc640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45640664a0 0x7f4564068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:44.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.521+0000 7f45767fc640 1 -- 172.21.15.177:0/1041015258 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f457011e8e0 con 0x7f45800cba10 2023-11-28T20:09:44.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.521+0000 7f4585f91640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45640664a0 0x7f4564068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:44.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.521+0000 7f4585f91640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45640664a0 0x7f4564068960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f457c000f70 tx=0x7f457c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:44.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.525+0000 7f45767fc640 1 -- 172.21.15.177:0/1041015258 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4580150d60 con 0x7f45800cba10 2023-11-28T20:09:44.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:44.709+0000 7f45881f5640 1 -- 172.21.15.177:0/1041015258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4580150d60 con 0x7f45800cba10 2023-11-28T20:09:45.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.672+0000 7f45767fc640 1 -- 172.21.15.177:0/1041015258 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4580150d60 con 0x7f45800cba10 2023-11-28T20:09:45.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.676+0000 7f45881f5640 1 -- 172.21.15.177:0/1041015258 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45640664a0 msgr2=0x7f4564068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:45.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.676+0000 7f45881f5640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45640664a0 0x7f4564068960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f457c000f70 tx=0x7f457c009040 comp rx=0 tx=0).stop 2023-11-28T20:09:45.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.676+0000 7f45881f5640 1 -- 172.21.15.177:0/1041015258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45800cba10 msgr2=0x7f4580153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:45.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.676+0000 7f45881f5640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45800cba10 0x7f4580153340 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f45700ad040 tx=0x7f457001ad80 comp rx=0 tx=0).stop 2023-11-28T20:09:45.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.676+0000 7f45881f5640 1 -- 172.21.15.177:0/1041015258 shutdown_connections 2023-11-28T20:09:45.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.676+0000 7f45881f5640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45640664a0 0x7f4564068960 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:45.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.676+0000 7f45881f5640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4580158ca0 0x7f458014e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:45.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.676+0000 7f45881f5640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45800cba10 0x7f4580153340 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:45.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.676+0000 7f45881f5640 1 --2- 172.21.15.177:0/1041015258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45800b42d0 0x7f45800a86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:45.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.676+0000 7f45881f5640 1 -- 172.21.15.177:0/1041015258 >> 172.21.15.177:0/1041015258 conn(0x7f45800b0cc0 msgr2=0x7f45800b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:45.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.676+0000 7f45881f5640 1 -- 172.21.15.177:0/1041015258 shutdown_connections 2023-11-28T20:09:45.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.676+0000 7f45881f5640 1 -- 172.21.15.177:0/1041015258 wait complete. 2023-11-28T20:09:45.704 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T20:09:45.704 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T20:09:45.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.844+0000 7f0178b2a640 1 Processor -- start 2023-11-28T20:09:45.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.844+0000 7f0178b2a640 1 -- start start 2023-11-28T20:09:45.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.844+0000 7f0178b2a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f01740cba10 0x7f017415be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:45.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.844+0000 7f0178b2a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f01740b42d0 0x7f01740b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:45.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.844+0000 7f0178b2a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01740b4c60 con 0x7f0174158ca0 2023-11-28T20:09:45.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.844+0000 7f0178b2a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017415b670 con 0x7f01740cba10 2023-11-28T20:09:45.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.844+0000 7f0178b2a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017415f410 con 0x7f01740b42d0 2023-11-28T20:09:45.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.848+0000 7f0169d9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f01740cba10 0x7f017415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:45.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.848+0000 7f0169d9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f01740cba10 0x7f017415be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47824/0 (socket says 172.21.15.177:47824) 2023-11-28T20:09:45.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.848+0000 7f0169d9b640 1 -- 172.21.15.177:0/3056918474 learned_addr learned my addr 172.21.15.177:0/3056918474 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:45.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.848+0000 7f0172d9d640 1 --2- 172.21.15.177:0/3056918474 >> v2:172.21.15.195:3300/0 conn(0x7f01740b42d0 0x7f01740b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:45.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.848+0000 7f0169d9b640 1 -- 172.21.15.177:0/3056918474 >> v2:172.21.15.195:3300/0 conn(0x7f01740b42d0 msgr2=0x7f01740b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:45.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.848+0000 7f0169d9b640 1 --2- 172.21.15.177:0/3056918474 >> v2:172.21.15.195:3300/0 conn(0x7f01740b42d0 0x7f01740b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:45.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.848+0000 7f0169d9b640 1 -- 172.21.15.177:0/3056918474 >> v1:172.21.15.195:6789/0 conn(0x7f0174158ca0 legacy=0x7f017415eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:45.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.848+0000 7f0169d9b640 1 -- 172.21.15.177:0/3056918474 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017415f6f0 con 0x7f01740cba10 2023-11-28T20:09:45.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.848+0000 7f0172d9d640 1 --2- 172.21.15.177:0/3056918474 >> v2:172.21.15.195:3300/0 conn(0x7f01740b42d0 0x7f01740b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:45.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.848+0000 7f0169d9b640 1 --2- 172.21.15.177:0/3056918474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01740cba10 0x7f017415be00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f01740cb970 tx=0x7f015c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d1d13aa0b9c145 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:45.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.848+0000 7f0171d9b640 1 -- 172.21.15.177:0/3056918474 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c0ab610 con 0x7f01740cba10 2023-11-28T20:09:45.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.848+0000 7f0171d9b640 1 -- 172.21.15.177:0/3056918474 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015c0ab770 con 0x7f01740cba10 2023-11-28T20:09:45.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.848+0000 7f0171d9b640 1 -- 172.21.15.177:0/3056918474 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c0abb00 con 0x7f01740cba10 2023-11-28T20:09:45.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 -- 172.21.15.177:0/3056918474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01740cba10 msgr2=0x7f017415be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:45.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 --2- 172.21.15.177:0/3056918474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01740cba10 0x7f017415be00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f01740cb970 tx=0x7f015c01c500 comp rx=0 tx=0).stop 2023-11-28T20:09:45.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 -- 172.21.15.177:0/3056918474 shutdown_connections 2023-11-28T20:09:45.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 --2- 172.21.15.177:0/3056918474 >> v2:172.21.15.195:3300/0 conn(0x7f01740b42d0 0x7f01740b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:45.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 --2- 172.21.15.177:0/3056918474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01740cba10 0x7f017415be00 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:45.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 -- 172.21.15.177:0/3056918474 >> 172.21.15.177:0/3056918474 conn(0x7f01740b0cc0 msgr2=0x7f01740b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:45.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 -- 172.21.15.177:0/3056918474 shutdown_connections 2023-11-28T20:09:45.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 -- 172.21.15.177:0/3056918474 wait complete. 2023-11-28T20:09:45.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 Processor -- start 2023-11-28T20:09:45.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 -- start start 2023-11-28T20:09:45.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01740b42d0 0x7f01740cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:45.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01740cba10 0x7f0174151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:45.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0174158ca0 0x7f0174151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:45.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0174147370 con 0x7f01740cba10 2023-11-28T20:09:45.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01740b21f0 con 0x7f01740b42d0 2023-11-28T20:09:45.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0178b2a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01740b24d0 con 0x7f0174158ca0 2023-11-28T20:09:45.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0169d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01740cba10 0x7f0174151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:45.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0169d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01740cba10 0x7f0174151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47836/0 (socket says 172.21.15.177:47836) 2023-11-28T20:09:45.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.852+0000 7f0169d9b640 1 -- 172.21.15.177:0/962712661 learned_addr learned my addr 172.21.15.177:0/962712661 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:45.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f0172d9d640 1 --2- 172.21.15.177:0/962712661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0174158ca0 0x7f0174151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:45.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f017259c640 1 --2- 172.21.15.177:0/962712661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01740b42d0 0x7f01740cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:45.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f0169d9b640 1 -- 172.21.15.177:0/962712661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0174158ca0 msgr2=0x7f0174151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:45.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f0169d9b640 1 --2- 172.21.15.177:0/962712661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0174158ca0 0x7f0174151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:45.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f0169d9b640 1 -- 172.21.15.177:0/962712661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01740b42d0 msgr2=0x7f01740cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:45.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f0169d9b640 1 --2- 172.21.15.177:0/962712661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01740b42d0 0x7f01740cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:45.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f0169d9b640 1 -- 172.21.15.177:0/962712661 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c0094d0 con 0x7f01740cba10 2023-11-28T20:09:45.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f0169d9b640 1 --2- 172.21.15.177:0/962712661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01740cba10 0x7f0174151880 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f015c019110 tx=0x7f015c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:45.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f016b7fe640 1 -- 172.21.15.177:0/962712661 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c0ab610 con 0x7f01740cba10 2023-11-28T20:09:45.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f016b7fe640 1 -- 172.21.15.177:0/962712661 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015c0b4800 con 0x7f01740cba10 2023-11-28T20:09:45.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f016b7fe640 1 -- 172.21.15.177:0/962712661 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c0b4bb0 con 0x7f01740cba10 2023-11-28T20:09:45.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f0178b2a640 1 -- 172.21.15.177:0/962712661 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01740b27b0 con 0x7f01740cba10 2023-11-28T20:09:45.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f0178b2a640 1 -- 172.21.15.177:0/962712661 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01740b2d70 con 0x7f01740cba10 2023-11-28T20:09:45.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f0178b2a640 1 -- 172.21.15.177:0/962712661 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01740693d0 con 0x7f01740cba10 2023-11-28T20:09:45.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f016b7fe640 1 -- 172.21.15.177:0/962712661 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f015c0b4d10 con 0x7f01740cba10 2023-11-28T20:09:45.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f016b7fe640 1 --2- 172.21.15.177:0/962712661 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f01540664a0 0x7f0154068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:45.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f016b7fe640 1 -- 172.21.15.177:0/962712661 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f015c11e470 con 0x7f01740cba10 2023-11-28T20:09:45.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.856+0000 7f017259c640 1 --2- 172.21.15.177:0/962712661 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f01540664a0 0x7f0154068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:45.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.860+0000 7f017259c640 1 --2- 172.21.15.177:0/962712661 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f01540664a0 0x7f0154068960 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01640012f0 tx=0x7f0164009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:45.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:45.860+0000 7f016b7fe640 1 -- 172.21.15.177:0/962712661 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f015c0eb900 con 0x7f01740cba10 2023-11-28T20:09:46.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.044+0000 7f0178b2a640 1 -- 172.21.15.177:0/962712661 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f01740b1990 con 0x7f01740cba10 2023-11-28T20:09:46.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.676+0000 7f016b7fe640 1 -- 172.21.15.177:0/962712661 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f015c0eef20 con 0x7f01740cba10 2023-11-28T20:09:46.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.680+0000 7f0178b2a640 1 -- 172.21.15.177:0/962712661 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f01540664a0 msgr2=0x7f0154068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:46.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.680+0000 7f0178b2a640 1 --2- 172.21.15.177:0/962712661 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f01540664a0 0x7f0154068960 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01640012f0 tx=0x7f0164009040 comp rx=0 tx=0).stop 2023-11-28T20:09:46.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.680+0000 7f0178b2a640 1 -- 172.21.15.177:0/962712661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01740cba10 msgr2=0x7f0174151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:46.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.680+0000 7f0178b2a640 1 --2- 172.21.15.177:0/962712661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01740cba10 0x7f0174151880 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f015c019110 tx=0x7f015c01ad40 comp rx=0 tx=0).stop 2023-11-28T20:09:46.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.680+0000 7f0178b2a640 1 -- 172.21.15.177:0/962712661 shutdown_connections 2023-11-28T20:09:46.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.680+0000 7f0178b2a640 1 --2- 172.21.15.177:0/962712661 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f01540664a0 0x7f0154068960 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:46.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.680+0000 7f0178b2a640 1 --2- 172.21.15.177:0/962712661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0174158ca0 0x7f0174151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:46.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.680+0000 7f0178b2a640 1 --2- 172.21.15.177:0/962712661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01740cba10 0x7f0174151880 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:46.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.680+0000 7f0178b2a640 1 --2- 172.21.15.177:0/962712661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01740b42d0 0x7f01740cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:46.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.680+0000 7f0178b2a640 1 -- 172.21.15.177:0/962712661 >> 172.21.15.177:0/962712661 conn(0x7f01740b0cc0 msgr2=0x7f0174156bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:46.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.680+0000 7f0178b2a640 1 -- 172.21.15.177:0/962712661 shutdown_connections 2023-11-28T20:09:46.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.680+0000 7f0178b2a640 1 -- 172.21.15.177:0/962712661 wait complete. 2023-11-28T20:09:46.707 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T20:09:46.707 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:09:46.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.844+0000 7f898d6c9640 1 Processor -- start 2023-11-28T20:09:46.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.844+0000 7f898d6c9640 1 -- start start 2023-11-28T20:09:46.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.844+0000 7f898d6c9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8988160870 0x7f89880d2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:46.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.844+0000 7f898d6c9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89880d0d70 con 0x7f89880cdb20 2023-11-28T20:09:46.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.844+0000 7f898d6c9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89880b6940 con 0x7f89880b51a0 2023-11-28T20:09:46.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.844+0000 7f898d6c9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8988160c50 con 0x7f8988160870 2023-11-28T20:09:46.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.848+0000 7f897e7fc640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f89880cdb20 0x7f89880b6230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47292/0 (socket says 172.21.15.177:47292) 2023-11-28T20:09:46.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.848+0000 7f8986ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8988160870 0x7f89880d2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:46.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.848+0000 7f897e7fc640 1 -- 172.21.15.177:0/2161632398 learned_addr learned my addr 172.21.15.177:0/2161632398 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:46.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.848+0000 7f8986ffd640 1 -- 172.21.15.177:0/2161632398 >> v1:172.21.15.195:6789/0 conn(0x7f89880b51a0 legacy=0x7f89880b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:46.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.848+0000 7f8986ffd640 1 -- 172.21.15.177:0/2161632398 >> v1:172.21.15.177:6789/0 conn(0x7f89880cdb20 legacy=0x7f89880b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:46.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.848+0000 7f8986ffd640 1 -- 172.21.15.177:0/2161632398 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89880ce2e0 con 0x7f8988160870 2023-11-28T20:09:46.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.848+0000 7f89867fc640 1 -- 172.21.15.177:0/2161632398 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37305909 0 0) 0x7f89880d0d70 con 0x7f89880cdb20 2023-11-28T20:09:46.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.848+0000 7f8986ffd640 1 --2- 172.21.15.177:0/2161632398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8988160870 0x7f89880d2b10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f89780097c0 tx=0x7f897801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda65db0f40b77e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:46.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.848+0000 7f89867fc640 1 -- 172.21.15.177:0/2161632398 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780ab600 con 0x7f8988160870 2023-11-28T20:09:46.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f89867fc640 1 -- 172.21.15.177:0/2161632398 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89780a7050 con 0x7f8988160870 2023-11-28T20:09:46.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f89867fc640 1 -- 172.21.15.177:0/2161632398 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780ab980 con 0x7f8988160870 2023-11-28T20:09:46.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f898d6c9640 1 -- 172.21.15.177:0/2161632398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8988160870 msgr2=0x7f89880d2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:46.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f898d6c9640 1 --2- 172.21.15.177:0/2161632398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8988160870 0x7f89880d2b10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f89780097c0 tx=0x7f897801c440 comp rx=0 tx=0).stop 2023-11-28T20:09:46.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f898d6c9640 1 -- 172.21.15.177:0/2161632398 shutdown_connections 2023-11-28T20:09:46.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f898d6c9640 1 --2- 172.21.15.177:0/2161632398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8988160870 0x7f89880d2b10 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:46.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f898d6c9640 1 -- 172.21.15.177:0/2161632398 >> 172.21.15.177:0/2161632398 conn(0x7f8988072060 msgr2=0x7f8988072470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:46.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f898d6c9640 1 -- 172.21.15.177:0/2161632398 shutdown_connections 2023-11-28T20:09:46.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f898d6c9640 1 -- 172.21.15.177:0/2161632398 wait complete. 2023-11-28T20:09:46.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f898d6c9640 1 Processor -- start 2023-11-28T20:09:46.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f898d6c9640 1 -- start start 2023-11-28T20:09:46.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f898d6c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89880b51a0 0x7f898814bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:46.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f898d6c9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89880cdb20 0x7f898814d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:46.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f898d6c9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8988160870 0x7f89880c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:46.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f898d6c9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8988150270 con 0x7f8988160870 2023-11-28T20:09:46.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f898d6c9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898814fcf0 con 0x7f89880cdb20 2023-11-28T20:09:46.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.852+0000 7f898d6c9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898814c550 con 0x7f89880b51a0 2023-11-28T20:09:46.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f89877fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8988160870 0x7f89880c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:46.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f897e7fc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89880cdb20 0x7f898814d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:46.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f8986ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89880b51a0 0x7f898814bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:46.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f897e7fc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89880cdb20 0x7f898814d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:36150/0 (socket says 172.21.15.177:36150) 2023-11-28T20:09:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f89877fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8988160870 0x7f89880c63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47856/0 (socket says 172.21.15.177:47856) 2023-11-28T20:09:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f897e7fc640 1 -- 172.21.15.177:0/4251025032 learned_addr learned my addr 172.21.15.177:0/4251025032 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f89877fe640 1 -- 172.21.15.177:0/4251025032 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89880b51a0 msgr2=0x7f898814bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f89877fe640 1 --2- 172.21.15.177:0/4251025032 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89880b51a0 0x7f898814bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f89877fe640 1 -- 172.21.15.177:0/4251025032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89880cdb20 msgr2=0x7f898814d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f89877fe640 1 --2- 172.21.15.177:0/4251025032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89880cdb20 0x7f898814d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f89877fe640 1 -- 172.21.15.177:0/4251025032 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8978009420 con 0x7f8988160870 2023-11-28T20:09:46.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f89877fe640 1 --2- 172.21.15.177:0/4251025032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8988160870 0x7f89880c63c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f898000be00 tx=0x7f898000bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:46.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f897ffff640 1 -- 172.21.15.177:0/4251025032 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898000ce70 con 0x7f8988160870 2023-11-28T20:09:46.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f897ffff640 1 -- 172.21.15.177:0/4251025032 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8980003980 con 0x7f8988160870 2023-11-28T20:09:46.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f898d6c9640 1 -- 172.21.15.177:0/4251025032 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898814ff90 con 0x7f8988160870 2023-11-28T20:09:46.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f897ffff640 1 -- 172.21.15.177:0/4251025032 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980003d70 con 0x7f8988160870 2023-11-28T20:09:46.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f898d6c9640 1 -- 172.21.15.177:0/4251025032 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898814df30 con 0x7f8988160870 2023-11-28T20:09:46.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f898d6c9640 1 -- 172.21.15.177:0/4251025032 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8988151740 con 0x7f8988160870 2023-11-28T20:09:46.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f897ffff640 1 -- 172.21.15.177:0/4251025032 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8980003ef0 con 0x7f8988160870 2023-11-28T20:09:46.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.856+0000 7f897ffff640 1 --2- 172.21.15.177:0/4251025032 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8968066470 0x7f8968068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:46.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.860+0000 7f897ffff640 1 -- 172.21.15.177:0/4251025032 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8980083d80 con 0x7f8988160870 2023-11-28T20:09:46.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.860+0000 7f8986ffd640 1 --2- 172.21.15.177:0/4251025032 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8968066470 0x7f8968068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:46.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.860+0000 7f8986ffd640 1 --2- 172.21.15.177:0/4251025032 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8968066470 0x7f8968068930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f89780ad000 tx=0x7f89780a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:46.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:46.864+0000 7f897ffff640 1 -- 172.21.15.177:0/4251025032 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8988151740 con 0x7f8988160870 2023-11-28T20:09:47.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.040+0000 7f898d6c9640 1 -- 172.21.15.177:0/4251025032 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89880cdf30 con 0x7f8988160870 2023-11-28T20:09:47.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.044+0000 7f897ffff640 1 -- 172.21.15.177:0/4251025032 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f89880cdf30 con 0x7f8988160870 2023-11-28T20:09:47.046 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:47.047 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1822043740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1822043740},{"type":"v1","addr":"172.21.15.195:6835","nonce":1822043740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5713,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3889128653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3889128653},{"type":"v1","addr":"172.21.15.195:6834","nonce":3889128653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5898,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2574151536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2574151536},{"type":"v1","addr":"172.21.15.177:6835","nonce":2574151536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:09:43.046143+0000","modified":"2023-11-28T20:09:46.049118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/198543116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":198543116},{"type":"v1","addr":"172.21.15.177:6837","nonce":198543116}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T20:09:47.047 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 26 2023-11-28T20:09:47.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.044+0000 7f898d6c9640 1 -- 172.21.15.177:0/4251025032 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8968066470 msgr2=0x7f8968068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.044+0000 7f898d6c9640 1 --2- 172.21.15.177:0/4251025032 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8968066470 0x7f8968068930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f89780ad000 tx=0x7f89780a6000 comp rx=0 tx=0).stop 2023-11-28T20:09:47.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.044+0000 7f898d6c9640 1 -- 172.21.15.177:0/4251025032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8988160870 msgr2=0x7f89880c63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.044+0000 7f898d6c9640 1 --2- 172.21.15.177:0/4251025032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8988160870 0x7f89880c63c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f898000be00 tx=0x7f898000bef0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.044+0000 7f898d6c9640 1 -- 172.21.15.177:0/4251025032 shutdown_connections 2023-11-28T20:09:47.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.044+0000 7f898d6c9640 1 --2- 172.21.15.177:0/4251025032 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8968066470 0x7f8968068930 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.044+0000 7f898d6c9640 1 --2- 172.21.15.177:0/4251025032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8988160870 0x7f89880c63c0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.044+0000 7f898d6c9640 1 --2- 172.21.15.177:0/4251025032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89880cdb20 0x7f898814d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.044+0000 7f898d6c9640 1 --2- 172.21.15.177:0/4251025032 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89880b51a0 0x7f898814bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.044+0000 7f898d6c9640 1 -- 172.21.15.177:0/4251025032 >> 172.21.15.177:0/4251025032 conn(0x7f8988072060 msgr2=0x7f8988150610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:47.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.044+0000 7f898d6c9640 1 -- 172.21.15.177:0/4251025032 shutdown_connections 2023-11-28T20:09:47.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.044+0000 7f898d6c9640 1 -- 172.21.15.177:0/4251025032 wait complete. 2023-11-28T20:09:47.068 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:09:47.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.200+0000 7fefd03c3640 1 Processor -- start 2023-11-28T20:09:47.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.200+0000 7fefd03c3640 1 -- start start 2023-11-28T20:09:47.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.200+0000 7fefd03c3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fefc806d530 0x7fefc806d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.200+0000 7fefd03c3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefc8071750 0x7fefc8071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.200+0000 7fefd03c3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc806ded0 con 0x7fefc8143b80 2023-11-28T20:09:47.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.200+0000 7fefd03c3640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc80712c0 con 0x7fefc806d530 2023-11-28T20:09:47.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.200+0000 7fefd03c3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc80706b0 con 0x7fefc8071750 2023-11-28T20:09:47.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.204+0000 7fefce960640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefc8071750 0x7fefc8071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.204+0000 7fefcd95e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fefc806d530 0x7fefc806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.204+0000 7fefce960640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefc8071750 0x7fefc8071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:49154/0 (socket says 172.21.15.177:49154) 2023-11-28T20:09:47.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.204+0000 7fefce960640 1 -- 172.21.15.177:0/3614838563 learned_addr learned my addr 172.21.15.177:0/3614838563 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:47.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.204+0000 7fefcd95e640 1 --2- 172.21.15.177:0/3614838563 >> v2:172.21.15.195:3300/0 conn(0x7fefc806d530 0x7fefc806d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:36164/0 (socket says 172.21.15.177:36164) 2023-11-28T20:09:47.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.204+0000 7fefce960640 1 -- 172.21.15.177:0/3614838563 >> v2:172.21.15.195:3300/0 conn(0x7fefc806d530 msgr2=0x7fefc806d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:47.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.204+0000 7fefce960640 1 --2- 172.21.15.177:0/3614838563 >> v2:172.21.15.195:3300/0 conn(0x7fefc806d530 0x7fefc806d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.204+0000 7fefce960640 1 -- 172.21.15.177:0/3614838563 >> v1:172.21.15.195:6789/0 conn(0x7fefc8143b80 legacy=0x7fefc81442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.204+0000 7fefce960640 1 -- 172.21.15.177:0/3614838563 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc8070990 con 0x7fefc8071750 2023-11-28T20:09:47.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.204+0000 7fefce960640 1 --2- 172.21.15.177:0/3614838563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefc8071750 0x7fefc8071be0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009e50 tx=0x7fefc001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cd3fd0befc60158 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:47.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.204+0000 7fefcd15d640 1 -- 172.21.15.177:0/3614838563 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc00a58a0 con 0x7fefc8071750 2023-11-28T20:09:47.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.204+0000 7fefcd15d640 1 -- 172.21.15.177:0/3614838563 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc00a5a00 con 0x7fefc8071750 2023-11-28T20:09:47.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.204+0000 7fefcd15d640 1 -- 172.21.15.177:0/3614838563 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc00a5d90 con 0x7fefc8071750 2023-11-28T20:09:47.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 -- 172.21.15.177:0/3614838563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefc8071750 msgr2=0x7fefc8071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 --2- 172.21.15.177:0/3614838563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefc8071750 0x7fefc8071be0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009e50 tx=0x7fefc001c9e0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 -- 172.21.15.177:0/3614838563 shutdown_connections 2023-11-28T20:09:47.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 --2- 172.21.15.177:0/3614838563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefc8071750 0x7fefc8071be0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 --2- 172.21.15.177:0/3614838563 >> v2:172.21.15.195:3300/0 conn(0x7fefc806d530 0x7fefc806d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 -- 172.21.15.177:0/3614838563 >> 172.21.15.177:0/3614838563 conn(0x7fefc806ab30 msgr2=0x7fefc80b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:47.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 -- 172.21.15.177:0/3614838563 shutdown_connections 2023-11-28T20:09:47.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 -- 172.21.15.177:0/3614838563 wait complete. 2023-11-28T20:09:47.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 Processor -- start 2023-11-28T20:09:47.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 -- start start 2023-11-28T20:09:47.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefc806d530 0x7fefc8150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefc8071750 0x7fefc8157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefc8143b80 0x7fefc80cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc8151f80 con 0x7fefc8143b80 2023-11-28T20:09:47.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc8133cf0 con 0x7fefc8071750 2023-11-28T20:09:47.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefd03c3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc8152240 con 0x7fefc806d530 2023-11-28T20:09:47.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefce960640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefc8143b80 0x7fefc80cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefce960640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefc8143b80 0x7fefc80cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47866/0 (socket says 172.21.15.177:47866) 2023-11-28T20:09:47.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefce960640 1 -- 172.21.15.177:0/3518324962 learned_addr learned my addr 172.21.15.177:0/3518324962 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:47.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefcd95e640 1 --2- 172.21.15.177:0/3518324962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefc8071750 0x7fefc8157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.208+0000 7fefce15f640 1 --2- 172.21.15.177:0/3518324962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefc806d530 0x7fefc8150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefcd95e640 1 -- 172.21.15.177:0/3518324962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefc806d530 msgr2=0x7fefc8150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefcd95e640 1 --2- 172.21.15.177:0/3518324962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefc806d530 0x7fefc8150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefcd95e640 1 -- 172.21.15.177:0/3518324962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefc8143b80 msgr2=0x7fefc80cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefcd95e640 1 --2- 172.21.15.177:0/3518324962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefc8143b80 0x7fefc80cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefcd95e640 1 -- 172.21.15.177:0/3518324962 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc0009b30 con 0x7fefc8071750 2023-11-28T20:09:47.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefce960640 1 --2- 172.21.15.177:0/3518324962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefc8143b80 0x7fefc80cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:09:47.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefcd95e640 1 --2- 172.21.15.177:0/3518324962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefc8071750 0x7fefc8157bb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fefb800e870 tx=0x7fefb800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:47.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefbeffd640 1 -- 172.21.15.177:0/3518324962 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb80095d0 con 0x7fefc8071750 2023-11-28T20:09:47.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefbeffd640 1 -- 172.21.15.177:0/3518324962 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb800c940 con 0x7fefc8071750 2023-11-28T20:09:47.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefbeffd640 1 -- 172.21.15.177:0/3518324962 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb800ccb0 con 0x7fefc8071750 2023-11-28T20:09:47.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefd03c3640 1 -- 172.21.15.177:0/3518324962 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc8152520 con 0x7fefc8071750 2023-11-28T20:09:47.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefd03c3640 1 -- 172.21.15.177:0/3518324962 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc8133fb0 con 0x7fefc8071750 2023-11-28T20:09:47.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefd03c3640 1 -- 172.21.15.177:0/3518324962 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc8134170 con 0x7fefc8071750 2023-11-28T20:09:47.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefbeffd640 1 -- 172.21.15.177:0/3518324962 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fefb8013470 con 0x7fefc8071750 2023-11-28T20:09:47.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefbeffd640 1 --2- 172.21.15.177:0/3518324962 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fefac066470 0x7fefac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefbeffd640 1 -- 172.21.15.177:0/3518324962 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefb8083ed0 con 0x7fefc8071750 2023-11-28T20:09:47.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.212+0000 7fefce15f640 1 --2- 172.21.15.177:0/3518324962 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fefac066470 0x7fefac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.216+0000 7fefce15f640 1 --2- 172.21.15.177:0/3518324962 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fefac066470 0x7fefac068930 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fefc4007fd0 tx=0x7fefc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:47.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.220+0000 7fefbeffd640 1 -- 172.21.15.177:0/3518324962 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fefb8051490 con 0x7fefc8071750 2023-11-28T20:09:47.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.368+0000 7fefd03c3640 1 -- 172.21.15.177:0/3518324962 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefc8070320 con 0x7fefc8071750 2023-11-28T20:09:47.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.368+0000 7fefbeffd640 1 -- 172.21.15.177:0/3518324962 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fefc8070320 con 0x7fefc8071750 2023-11-28T20:09:47.374 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:47.374 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":49,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:09:44.664848+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:09:40.777720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T20:09:42.029277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:09:47.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.372+0000 7fefd03c3640 1 -- 172.21.15.177:0/3518324962 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fefac066470 msgr2=0x7fefac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.372+0000 7fefd03c3640 1 --2- 172.21.15.177:0/3518324962 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fefac066470 0x7fefac068930 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fefc4007fd0 tx=0x7fefc4009040 comp rx=0 tx=0).stop 2023-11-28T20:09:47.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.372+0000 7fefd03c3640 1 -- 172.21.15.177:0/3518324962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefc8071750 msgr2=0x7fefc8157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.372+0000 7fefd03c3640 1 --2- 172.21.15.177:0/3518324962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefc8071750 0x7fefc8157bb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fefb800e870 tx=0x7fefb800ed30 comp rx=0 tx=0).stop 2023-11-28T20:09:47.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.372+0000 7fefd03c3640 1 -- 172.21.15.177:0/3518324962 shutdown_connections 2023-11-28T20:09:47.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.372+0000 7fefd03c3640 1 --2- 172.21.15.177:0/3518324962 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fefac066470 0x7fefac068930 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.372+0000 7fefd03c3640 1 --2- 172.21.15.177:0/3518324962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefc8143b80 0x7fefc80cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.372+0000 7fefd03c3640 1 --2- 172.21.15.177:0/3518324962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefc8071750 0x7fefc8157bb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.372+0000 7fefd03c3640 1 --2- 172.21.15.177:0/3518324962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefc806d530 0x7fefc8150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.372+0000 7fefd03c3640 1 -- 172.21.15.177:0/3518324962 >> 172.21.15.177:0/3518324962 conn(0x7fefc806ab30 msgr2=0x7fefc813ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:47.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.372+0000 7fefd03c3640 1 -- 172.21.15.177:0/3518324962 shutdown_connections 2023-11-28T20:09:47.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.372+0000 7fefd03c3640 1 -- 172.21.15.177:0/3518324962 wait complete. 2023-11-28T20:09:47.395 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T20:09:47.396 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:09:47.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1ffd2a640 1 Processor -- start 2023-11-28T20:09:47.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1ffd2a640 1 -- start start 2023-11-28T20:09:47.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1ffd2a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe1f806c9d0 0x7fe1f815a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1ffd2a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1f815ab70 0x7fe1f80cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1ffd2a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f815b3a0 con 0x7fe1f813cf30 2023-11-28T20:09:47.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1ffd2a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f813d310 con 0x7fe1f806c9d0 2023-11-28T20:09:47.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1ffd2a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f81404e0 con 0x7fe1f815ab70 2023-11-28T20:09:47.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fdac6640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe1f813cf30 0x7fe1f806c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47304/0 (socket says 172.21.15.177:47304) 2023-11-28T20:09:47.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fdac6640 1 -- 172.21.15.177:0/1922225463 learned_addr learned my addr 172.21.15.177:0/1922225463 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:47.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fd2c5640 1 --2- 172.21.15.177:0/1922225463 >> v2:172.21.15.195:3300/0 conn(0x7fe1f806c9d0 0x7fe1f815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fe2c7640 1 --2- 172.21.15.177:0/1922225463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1f815ab70 0x7fe1f80cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 -- 172.21.15.177:0/1922225463 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069181468 0 0) 0x7fe1f815b3a0 con 0x7fe1f813cf30 2023-11-28T20:09:47.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 -- 172.21.15.177:0/1922225463 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1e4003530 con 0x7fe1f813cf30 2023-11-28T20:09:47.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 -- 172.21.15.177:0/1922225463 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 316191490 0 0) 0x7fe1e4003530 con 0x7fe1f813cf30 2023-11-28T20:09:47.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 -- 172.21.15.177:0/1922225463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1f815ab70 msgr2=0x7fe1f80cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:47.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 --2- 172.21.15.177:0/1922225463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1f815ab70 0x7fe1f80cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 -- 172.21.15.177:0/1922225463 >> v2:172.21.15.195:3300/0 conn(0x7fe1f806c9d0 msgr2=0x7fe1f815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:47.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 --2- 172.21.15.177:0/1922225463 >> v2:172.21.15.195:3300/0 conn(0x7fe1f806c9d0 0x7fe1f815a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 -- 172.21.15.177:0/1922225463 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f813f720 con 0x7fe1f813cf30 2023-11-28T20:09:47.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 -- 172.21.15.177:0/1922225463 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7fe1f4001680 con 0x7fe1f813cf30 2023-11-28T20:09:47.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 -- 172.21.15.177:0/1922225463 >> v1:172.21.15.177:6789/0 conn(0x7fe1f813cf30 legacy=0x7fe1f806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 --2- 172.21.15.177:0/1922225463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1e40039b0 0x7fe1e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 --2- 172.21.15.177:0/1922225463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1f815ab70 0x7fe1e40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 --2- 172.21.15.177:0/1922225463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e4004d10 0x7fe1e4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 -- 172.21.15.177:0/1922225463 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f81404e0 con 0x7fe1e4004d10 2023-11-28T20:09:47.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 -- 172.21.15.177:0/1922225463 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e400b990 con 0x7fe1e40039b0 2023-11-28T20:09:47.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fcac4640 1 -- 172.21.15.177:0/1922225463 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e400bb50 con 0x7fe1f815ab70 2023-11-28T20:09:47.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fe2c7640 1 --2- 172.21.15.177:0/1922225463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e4004d10 0x7fe1e4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fdac6640 1 --2- 172.21.15.177:0/1922225463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1e40039b0 0x7fe1e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fd2c5640 1 --2- 172.21.15.177:0/1922225463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1f815ab70 0x7fe1e40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fe2c7640 1 -- 172.21.15.177:0/1922225463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1f815ab70 msgr2=0x7fe1e40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:47.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fe2c7640 1 --2- 172.21.15.177:0/1922225463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1f815ab70 0x7fe1e40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fe2c7640 1 -- 172.21.15.177:0/1922225463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1e40039b0 msgr2=0x7fe1e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:47.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fe2c7640 1 --2- 172.21.15.177:0/1922225463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1e40039b0 0x7fe1e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.532+0000 7fe1fe2c7640 1 -- 172.21.15.177:0/1922225463 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4003530 con 0x7fe1e4004d10 2023-11-28T20:09:47.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.536+0000 7fe1fe2c7640 1 --2- 172.21.15.177:0/1922225463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e4004d10 0x7fe1e4005190 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009fc0 tx=0x7fe1f001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f447865139f8a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:47.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.536+0000 7fe1fcac4640 1 -- 172.21.15.177:0/1922225463 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f00a5c70 con 0x7fe1e4004d10 2023-11-28T20:09:47.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.536+0000 7fe1fcac4640 1 -- 172.21.15.177:0/1922225463 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f000f040 con 0x7fe1e4004d10 2023-11-28T20:09:47.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.536+0000 7fe1fcac4640 1 -- 172.21.15.177:0/1922225463 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f00ad440 con 0x7fe1e4004d10 2023-11-28T20:09:47.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.536+0000 7fe1ffd2a640 1 -- 172.21.15.177:0/1922225463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e4004d10 msgr2=0x7fe1e4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.536+0000 7fe1ffd2a640 1 --2- 172.21.15.177:0/1922225463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e4004d10 0x7fe1e4005190 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009fc0 tx=0x7fe1f001cc60 comp rx=0 tx=0).stop 2023-11-28T20:09:47.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.536+0000 7fe1fe2c7640 1 -- 172.21.15.177:0/1922225463 reap_dead start 2023-11-28T20:09:47.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.536+0000 7fe1ffd2a640 1 -- 172.21.15.177:0/1922225463 shutdown_connections 2023-11-28T20:09:47.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.536+0000 7fe1ffd2a640 1 -- 172.21.15.177:0/1922225463 >> 172.21.15.177:0/1922225463 conn(0x7fe1f806a530 msgr2=0x7fe1f806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:47.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.536+0000 7fe1ffd2a640 1 -- 172.21.15.177:0/1922225463 shutdown_connections 2023-11-28T20:09:47.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.536+0000 7fe1ffd2a640 1 -- 172.21.15.177:0/1922225463 wait complete. 2023-11-28T20:09:47.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1ffd2a640 1 Processor -- start 2023-11-28T20:09:47.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1ffd2a640 1 -- start start 2023-11-28T20:09:47.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1ffd2a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1e4004d10 0x7fe1f80b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1ffd2a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1f80b1d20 0x7fe1f8137c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1ffd2a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1f8138500 0x7fe1f81390e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1ffd2a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f80b2870 con 0x7fe1f80b1d20 2023-11-28T20:09:47.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1ffd2a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f8159d00 con 0x7fe1f8138500 2023-11-28T20:09:47.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1ffd2a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f8159fe0 con 0x7fe1e4004d10 2023-11-28T20:09:47.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1fd2c5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1f80b1d20 0x7fe1f8137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1fd2c5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1f80b1d20 0x7fe1f8137c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47876/0 (socket says 172.21.15.177:47876) 2023-11-28T20:09:47.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1fd2c5640 1 -- 172.21.15.177:0/1552925778 learned_addr learned my addr 172.21.15.177:0/1552925778 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:47.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1fdac6640 1 --2- 172.21.15.177:0/1552925778 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1e4004d10 0x7fe1f80b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1fe2c7640 1 --2- 172.21.15.177:0/1552925778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1f8138500 0x7fe1f81390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1fd2c5640 1 -- 172.21.15.177:0/1552925778 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1e4004d10 msgr2=0x7fe1f80b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1fd2c5640 1 --2- 172.21.15.177:0/1552925778 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1e4004d10 0x7fe1f80b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1fd2c5640 1 -- 172.21.15.177:0/1552925778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1f8138500 msgr2=0x7fe1f81390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1fd2c5640 1 --2- 172.21.15.177:0/1552925778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1f8138500 0x7fe1f81390e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1fd2c5640 1 -- 172.21.15.177:0/1552925778 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f80b21b0 con 0x7fe1f80b1d20 2023-11-28T20:09:47.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1fd2c5640 1 --2- 172.21.15.177:0/1552925778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1f80b1d20 0x7fe1f8137c30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe1e80119d0 tx=0x7fe1e8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:47.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1ee7fc640 1 -- 172.21.15.177:0/1552925778 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e800fb50 con 0x7fe1f80b1d20 2023-11-28T20:09:47.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1ee7fc640 1 -- 172.21.15.177:0/1552925778 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e800fcb0 con 0x7fe1f80b1d20 2023-11-28T20:09:47.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.540+0000 7fe1ee7fc640 1 -- 172.21.15.177:0/1552925778 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8014440 con 0x7fe1f80b1d20 2023-11-28T20:09:47.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.544+0000 7fe1ffd2a640 1 -- 172.21.15.177:0/1552925778 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f80b2490 con 0x7fe1f80b1d20 2023-11-28T20:09:47.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.544+0000 7fe1ffd2a640 1 -- 172.21.15.177:0/1552925778 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f8159990 con 0x7fe1f80b1d20 2023-11-28T20:09:47.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.544+0000 7fe1ffd2a640 1 -- 172.21.15.177:0/1552925778 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f8069440 con 0x7fe1f80b1d20 2023-11-28T20:09:47.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.544+0000 7fe1ee7fc640 1 -- 172.21.15.177:0/1552925778 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe1e80145a0 con 0x7fe1f80b1d20 2023-11-28T20:09:47.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.544+0000 7fe1ee7fc640 1 --2- 172.21.15.177:0/1552925778 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe1dc066470 0x7fe1dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.544+0000 7fe1ee7fc640 1 -- 172.21.15.177:0/1552925778 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1e8084820 con 0x7fe1f80b1d20 2023-11-28T20:09:47.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.544+0000 7fe1fdac6640 1 --2- 172.21.15.177:0/1552925778 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe1dc066470 0x7fe1dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.548+0000 7fe1fdac6640 1 --2- 172.21.15.177:0/1552925778 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe1dc066470 0x7fe1dc068930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4001060 tx=0x7fe1f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:47.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.548+0000 7fe1ee7fc640 1 -- 172.21.15.177:0/1552925778 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1e8051c00 con 0x7fe1f80b1d20 2023-11-28T20:09:47.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.700+0000 7fe1ffd2a640 1 -- 172.21.15.177:0/1552925778 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1f813ffc0 con 0x7fe1dc066470 2023-11-28T20:09:47.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.708+0000 7fe1ee7fc640 1 -- 172.21.15.177:0/1552925778 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283905 (secure 0 0 0) 0x7fe1f4005730 con 0x7fe1dc066470 2023-11-28T20:09:47.716 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:47.718 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:09:47.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.712+0000 7fe1ffd2a640 1 -- 172.21.15.177:0/1552925778 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe1dc066470 msgr2=0x7fe1dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.712+0000 7fe1ffd2a640 1 --2- 172.21.15.177:0/1552925778 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe1dc066470 0x7fe1dc068930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4001060 tx=0x7fe1f4009040 comp rx=0 tx=0).stop 2023-11-28T20:09:47.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.712+0000 7fe1ffd2a640 1 -- 172.21.15.177:0/1552925778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1f80b1d20 msgr2=0x7fe1f8137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.712+0000 7fe1ffd2a640 1 --2- 172.21.15.177:0/1552925778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1f80b1d20 0x7fe1f8137c30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe1e80119d0 tx=0x7fe1e8011e90 comp rx=0 tx=0).stop 2023-11-28T20:09:47.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.712+0000 7fe1ffd2a640 1 -- 172.21.15.177:0/1552925778 shutdown_connections 2023-11-28T20:09:47.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.712+0000 7fe1ffd2a640 1 --2- 172.21.15.177:0/1552925778 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe1dc066470 0x7fe1dc068930 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.712+0000 7fe1ffd2a640 1 --2- 172.21.15.177:0/1552925778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1f8138500 0x7fe1f81390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.712+0000 7fe1ffd2a640 1 --2- 172.21.15.177:0/1552925778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1f80b1d20 0x7fe1f8137c30 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.712+0000 7fe1ffd2a640 1 --2- 172.21.15.177:0/1552925778 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1e4004d10 0x7fe1f80b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.712+0000 7fe1ffd2a640 1 -- 172.21.15.177:0/1552925778 >> 172.21.15.177:0/1552925778 conn(0x7fe1f806a530 msgr2=0x7fe1f80ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:47.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.712+0000 7fe1ffd2a640 1 -- 172.21.15.177:0/1552925778 shutdown_connections 2023-11-28T20:09:47.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.712+0000 7fe1ffd2a640 1 -- 172.21.15.177:0/1552925778 wait complete. 2023-11-28T20:09:47.736 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-11-28T20:09:47.443010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242472,"kb_used_data":5500,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754732248,"statfs":{"total":773094113280,"available":772845821952,"internally_reserved":0,"allocated":5632000,"data_stored":3006477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.804330"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665732+0000","last_change":"2023-11-28T20:09:42.665732+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665732+0000","last_undegraded":"2023-11-28T20:09:42.665732+0000","last_fullsized":"2023-11-28T20:09:42.665732+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653516+0000","last_change":"2023-11-28T20:09:42.653516+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653516+0000","last_undegraded":"2023-11-28T20:09:42.653516+0000","last_fullsized":"2023-11-28T20:09:42.653516+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.671505+0000","last_change":"2023-11-28T20:09:42.671505+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.671505+0000","last_undegraded":"2023-11-28T20:09:42.671505+0000","last_fullsized":"2023-11-28T20:09:42.671505+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651363+0000","last_change":"2023-11-28T20:09:42.651363+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651363+0000","last_undegraded":"2023-11-28T20:09:42.651363+0000","last_fullsized":"2023-11-28T20:09:42.651363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657723+0000","last_change":"2023-11-28T20:09:42.657723+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657723+0000","last_undegraded":"2023-11-28T20:09:42.657723+0000","last_fullsized":"2023-11-28T20:09:42.657723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.667791+0000","last_change":"2023-11-28T20:09:42.667791+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.667791+0000","last_undegraded":"2023-11-28T20:09:42.667791+0000","last_fullsized":"2023-11-28T20:09:42.667791+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.671313+0000","last_change":"2023-11-28T20:09:42.671313+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.671313+0000","last_undegraded":"2023-11-28T20:09:42.671313+0000","last_fullsized":"2023-11-28T20:09:42.671313+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653717+0000","last_change":"2023-11-28T20:09:42.653717+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653717+0000","last_undegraded":"2023-11-28T20:09:42.653717+0000","last_fullsized":"2023-11-28T20:09:42.653717+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655070+0000","last_change":"2023-11-28T20:09:42.655070+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655070+0000","last_undegraded":"2023-11-28T20:09:42.655070+0000","last_fullsized":"2023-11-28T20:09:42.655070+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.661316+0000","last_change":"2023-11-28T20:09:42.661316+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.661316+0000","last_undegraded":"2023-11-28T20:09:42.661316+0000","last_fullsized":"2023-11-28T20:09:42.661316+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657445+0000","last_change":"2023-11-28T20:09:42.657445+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657445+0000","last_undegraded":"2023-11-28T20:09:42.657445+0000","last_fullsized":"2023-11-28T20:09:42.657445+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653436+0000","last_change":"2023-11-28T20:09:42.653436+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653436+0000","last_undegraded":"2023-11-28T20:09:42.653436+0000","last_fullsized":"2023-11-28T20:09:42.653436+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.666052+0000","last_change":"2023-11-28T20:09:42.666052+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.666052+0000","last_undegraded":"2023-11-28T20:09:42.666052+0000","last_fullsized":"2023-11-28T20:09:42.666052+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.669868+0000","last_change":"2023-11-28T20:09:42.669868+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.669868+0000","last_undegraded":"2023-11-28T20:09:42.669868+0000","last_fullsized":"2023-11-28T20:09:42.669868+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651748+0000","last_change":"2023-11-28T20:09:42.651748+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651748+0000","last_undegraded":"2023-11-28T20:09:42.651748+0000","last_fullsized":"2023-11-28T20:09:42.651748+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665343+0000","last_change":"2023-11-28T20:09:42.665343+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665343+0000","last_undegraded":"2023-11-28T20:09:42.665343+0000","last_fullsized":"2023-11-28T20:09:42.665343+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.669366+0000","last_change":"2023-11-28T20:09:42.669366+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.669366+0000","last_undegraded":"2023-11-28T20:09:42.669366+0000","last_fullsized":"2023-11-28T20:09:42.669366+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652918+0000","last_change":"2023-11-28T20:09:42.652918+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652918+0000","last_undegraded":"2023-11-28T20:09:42.652918+0000","last_fullsized":"2023-11-28T20:09:42.652918+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.666333+0000","last_change":"2023-11-28T20:09:42.666333+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.666333+0000","last_undegraded":"2023-11-28T20:09:42.666333+0000","last_fullsized":"2023-11-28T20:09:42.666333+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.660299+0000","last_change":"2023-11-28T20:09:42.660299+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.660299+0000","last_undegraded":"2023-11-28T20:09:42.660299+0000","last_fullsized":"2023-11-28T20:09:42.660299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.663550+0000","last_change":"2023-11-28T20:09:42.663550+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.663550+0000","last_undegraded":"2023-11-28T20:09:42.663550+0000","last_fullsized":"2023-11-28T20:09:42.663550+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652494+0000","last_change":"2023-11-28T20:09:42.652494+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652494+0000","last_undegraded":"2023-11-28T20:09:42.652494+0000","last_fullsized":"2023-11-28T20:09:42.652494+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656884+0000","last_change":"2023-11-28T20:09:42.656884+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656884+0000","last_undegraded":"2023-11-28T20:09:42.656884+0000","last_fullsized":"2023-11-28T20:09:42.656884+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.663670+0000","last_change":"2023-11-28T20:09:42.663670+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.663670+0000","last_undegraded":"2023-11-28T20:09:42.663670+0000","last_fullsized":"2023-11-28T20:09:42.663670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.663409+0000","last_change":"2023-11-28T20:09:42.663409+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.663409+0000","last_undegraded":"2023-11-28T20:09:42.663409+0000","last_fullsized":"2023-11-28T20:09:42.663409+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655654+0000","last_change":"2023-11-28T20:09:42.655654+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655654+0000","last_undegraded":"2023-11-28T20:09:42.655654+0000","last_fullsized":"2023-11-28T20:09:42.655654+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.658550+0000","last_change":"2023-11-28T20:09:42.658550+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.658550+0000","last_undegraded":"2023-11-28T20:09:42.658550+0000","last_fullsized":"2023-11-28T20:09:42.658550+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.658235+0000","last_change":"2023-11-28T20:09:42.658235+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.658235+0000","last_undegraded":"2023-11-28T20:09:42.658235+0000","last_fullsized":"2023-11-28T20:09:42.658235+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.662648+0000","last_change":"2023-11-28T20:09:42.662648+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.662648+0000","last_undegraded":"2023-11-28T20:09:42.662648+0000","last_fullsized":"2023-11-28T20:09:42.662648+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651286+0000","last_change":"2023-11-28T20:09:42.651286+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651286+0000","last_undegraded":"2023-11-28T20:09:42.651286+0000","last_fullsized":"2023-11-28T20:09:42.651286+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.662994+0000","last_change":"2023-11-28T20:09:42.662994+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.662994+0000","last_undegraded":"2023-11-28T20:09:42.662994+0000","last_fullsized":"2023-11-28T20:09:42.662994+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655851+0000","last_change":"2023-11-28T20:09:42.655851+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655851+0000","last_undegraded":"2023-11-28T20:09:42.655851+0000","last_fullsized":"2023-11-28T20:09:42.655851+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651779+0000","last_change":"2023-11-28T20:09:42.651779+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651779+0000","last_undegraded":"2023-11-28T20:09:42.651779+0000","last_fullsized":"2023-11-28T20:09:42.651779+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669340+0000","last_change":"2023-11-28T20:09:42.666794+0000","last_active":"2023-11-28T20:09:42.669340+0000","last_peered":"2023-11-28T20:09:42.669340+0000","last_clean":"2023-11-28T20:09:42.669340+0000","last_became_active":"2023-11-28T20:09:42.666513+0000","last_became_peered":"2023-11-28T20:09:42.666513+0000","last_unstale":"2023-11-28T20:09:42.669340+0000","last_undegraded":"2023-11-28T20:09:42.669340+0000","last_fullsized":"2023-11-28T20:09:42.669340+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:51:59.917389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.654974+0000","last_change":"2023-11-28T20:09:42.654974+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.654974+0000","last_undegraded":"2023-11-28T20:09:42.654974+0000","last_fullsized":"2023-11-28T20:09:42.654974+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.679490+0000","last_change":"2023-11-28T20:09:42.674692+0000","last_active":"2023-11-28T20:09:42.679490+0000","last_peered":"2023-11-28T20:09:42.679490+0000","last_clean":"2023-11-28T20:09:42.679490+0000","last_became_active":"2023-11-28T20:09:42.674364+0000","last_became_peered":"2023-11-28T20:09:42.674364+0000","last_unstale":"2023-11-28T20:09:42.679490+0000","last_undegraded":"2023-11-28T20:09:42.679490+0000","last_fullsized":"2023-11-28T20:09:42.679490+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:32:26.336595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657485+0000","last_change":"2023-11-28T20:09:42.657485+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657485+0000","last_undegraded":"2023-11-28T20:09:42.657485+0000","last_fullsized":"2023-11-28T20:09:42.657485+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677675+0000","last_change":"2023-11-28T20:09:42.670599+0000","last_active":"2023-11-28T20:09:42.677675+0000","last_peered":"2023-11-28T20:09:42.677675+0000","last_clean":"2023-11-28T20:09:42.677675+0000","last_became_active":"2023-11-28T20:09:42.670216+0000","last_became_peered":"2023-11-28T20:09:42.670216+0000","last_unstale":"2023-11-28T20:09:42.677675+0000","last_undegraded":"2023-11-28T20:09:42.677675+0000","last_fullsized":"2023-11-28T20:09:42.677675+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:15.217653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653400+0000","last_change":"2023-11-28T20:09:42.653400+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653400+0000","last_undegraded":"2023-11-28T20:09:42.653400+0000","last_fullsized":"2023-11-28T20:09:42.653400+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675698+0000","last_change":"2023-11-28T20:09:42.674101+0000","last_active":"2023-11-28T20:09:42.675698+0000","last_peered":"2023-11-28T20:09:42.675698+0000","last_clean":"2023-11-28T20:09:42.675698+0000","last_became_active":"2023-11-28T20:09:42.673725+0000","last_became_peered":"2023-11-28T20:09:42.673725+0000","last_unstale":"2023-11-28T20:09:42.675698+0000","last_undegraded":"2023-11-28T20:09:42.675698+0000","last_fullsized":"2023-11-28T20:09:42.675698+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:49.634142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656518+0000","last_change":"2023-11-28T20:09:42.656518+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656518+0000","last_undegraded":"2023-11-28T20:09:42.656518+0000","last_fullsized":"2023-11-28T20:09:42.656518+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.674971+0000","last_change":"2023-11-28T20:09:42.664506+0000","last_active":"2023-11-28T20:09:42.674971+0000","last_peered":"2023-11-28T20:09:42.674971+0000","last_clean":"2023-11-28T20:09:42.674971+0000","last_became_active":"2023-11-28T20:09:42.664199+0000","last_became_peered":"2023-11-28T20:09:42.664199+0000","last_unstale":"2023-11-28T20:09:42.674971+0000","last_undegraded":"2023-11-28T20:09:42.674971+0000","last_fullsized":"2023-11-28T20:09:42.674971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:32:26.336595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651336+0000","last_change":"2023-11-28T20:09:42.651336+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651336+0000","last_undegraded":"2023-11-28T20:09:42.651336+0000","last_fullsized":"2023-11-28T20:09:42.651336+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.671611+0000","last_change":"2023-11-28T20:09:42.670093+0000","last_active":"2023-11-28T20:09:42.671611+0000","last_peered":"2023-11-28T20:09:42.671611+0000","last_clean":"2023-11-28T20:09:42.671611+0000","last_became_active":"2023-11-28T20:09:42.669832+0000","last_became_peered":"2023-11-28T20:09:42.669832+0000","last_unstale":"2023-11-28T20:09:42.671611+0000","last_undegraded":"2023-11-28T20:09:42.671611+0000","last_fullsized":"2023-11-28T20:09:42.671611+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:17.280206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.654604+0000","last_change":"2023-11-28T20:09:42.654604+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.654604+0000","last_undegraded":"2023-11-28T20:09:42.654604+0000","last_fullsized":"2023-11-28T20:09:42.654604+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669576+0000","last_change":"2023-11-28T20:09:42.666410+0000","last_active":"2023-11-28T20:09:42.669576+0000","last_peered":"2023-11-28T20:09:42.669576+0000","last_clean":"2023-11-28T20:09:42.669576+0000","last_became_active":"2023-11-28T20:09:42.666065+0000","last_became_peered":"2023-11-28T20:09:42.666065+0000","last_unstale":"2023-11-28T20:09:42.669576+0000","last_undegraded":"2023-11-28T20:09:42.669576+0000","last_fullsized":"2023-11-28T20:09:42.669576+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:07:05.109326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652208+0000","last_change":"2023-11-28T20:09:42.652208+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652208+0000","last_undegraded":"2023-11-28T20:09:42.652208+0000","last_fullsized":"2023-11-28T20:09:42.652208+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677174+0000","last_change":"2023-11-28T20:09:42.671231+0000","last_active":"2023-11-28T20:09:42.677174+0000","last_peered":"2023-11-28T20:09:42.677174+0000","last_clean":"2023-11-28T20:09:42.677174+0000","last_became_active":"2023-11-28T20:09:42.670957+0000","last_became_peered":"2023-11-28T20:09:42.670957+0000","last_unstale":"2023-11-28T20:09:42.677174+0000","last_undegraded":"2023-11-28T20:09:42.677174+0000","last_fullsized":"2023-11-28T20:09:42.677174+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:44:35.411601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655348+0000","last_change":"2023-11-28T20:09:42.655348+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655348+0000","last_undegraded":"2023-11-28T20:09:42.655348+0000","last_fullsized":"2023-11-28T20:09:42.655348+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669018+0000","last_change":"2023-11-28T20:09:42.666932+0000","last_active":"2023-11-28T20:09:42.669018+0000","last_peered":"2023-11-28T20:09:42.669018+0000","last_clean":"2023-11-28T20:09:42.669018+0000","last_became_active":"2023-11-28T20:09:42.666671+0000","last_became_peered":"2023-11-28T20:09:42.666671+0000","last_unstale":"2023-11-28T20:09:42.669018+0000","last_undegraded":"2023-11-28T20:09:42.669018+0000","last_fullsized":"2023-11-28T20:09:42.669018+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:25.757605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655579+0000","last_change":"2023-11-28T20:09:42.655579+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655579+0000","last_undegraded":"2023-11-28T20:09:42.655579+0000","last_fullsized":"2023-11-28T20:09:42.655579+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.681208+0000","last_change":"2023-11-28T20:09:42.680303+0000","last_active":"2023-11-28T20:09:42.681208+0000","last_peered":"2023-11-28T20:09:42.681208+0000","last_clean":"2023-11-28T20:09:42.681208+0000","last_became_active":"2023-11-28T20:09:42.680028+0000","last_became_peered":"2023-11-28T20:09:42.680028+0000","last_unstale":"2023-11-28T20:09:42.681208+0000","last_undegraded":"2023-11-28T20:09:42.681208+0000","last_fullsized":"2023-11-28T20:09:42.681208+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:44:35.411601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656821+0000","last_change":"2023-11-28T20:09:42.656821+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656821+0000","last_undegraded":"2023-11-28T20:09:42.656821+0000","last_fullsized":"2023-11-28T20:09:42.656821+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675415+0000","last_change":"2023-11-28T20:09:42.674301+0000","last_active":"2023-11-28T20:09:42.675415+0000","last_peered":"2023-11-28T20:09:42.675415+0000","last_clean":"2023-11-28T20:09:42.675415+0000","last_became_active":"2023-11-28T20:09:42.673651+0000","last_became_peered":"2023-11-28T20:09:42.673651+0000","last_unstale":"2023-11-28T20:09:42.675415+0000","last_undegraded":"2023-11-28T20:09:42.675415+0000","last_fullsized":"2023-11-28T20:09:42.675415+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:48:37.397331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657154+0000","last_change":"2023-11-28T20:09:42.657154+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657154+0000","last_undegraded":"2023-11-28T20:09:42.657154+0000","last_fullsized":"2023-11-28T20:09:42.657154+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677439+0000","last_change":"2023-11-28T20:09:42.669553+0000","last_active":"2023-11-28T20:09:42.677439+0000","last_peered":"2023-11-28T20:09:42.677439+0000","last_clean":"2023-11-28T20:09:42.677439+0000","last_became_active":"2023-11-28T20:09:42.667456+0000","last_became_peered":"2023-11-28T20:09:42.667456+0000","last_unstale":"2023-11-28T20:09:42.677439+0000","last_undegraded":"2023-11-28T20:09:42.677439+0000","last_fullsized":"2023-11-28T20:09:42.677439+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:59.639535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656210+0000","last_change":"2023-11-28T20:09:42.656210+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656210+0000","last_undegraded":"2023-11-28T20:09:42.656210+0000","last_fullsized":"2023-11-28T20:09:42.656210+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.679813+0000","last_change":"2023-11-28T20:09:42.675080+0000","last_active":"2023-11-28T20:09:42.679813+0000","last_peered":"2023-11-28T20:09:42.679813+0000","last_clean":"2023-11-28T20:09:42.679813+0000","last_became_active":"2023-11-28T20:09:42.674739+0000","last_became_peered":"2023-11-28T20:09:42.674739+0000","last_unstale":"2023-11-28T20:09:42.679813+0000","last_undegraded":"2023-11-28T20:09:42.679813+0000","last_fullsized":"2023-11-28T20:09:42.679813+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:35.259118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656222+0000","last_change":"2023-11-28T20:09:42.656222+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656222+0000","last_undegraded":"2023-11-28T20:09:42.656222+0000","last_fullsized":"2023-11-28T20:09:42.656222+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676458+0000","last_change":"2023-11-28T20:09:42.675061+0000","last_active":"2023-11-28T20:09:42.676458+0000","last_peered":"2023-11-28T20:09:42.676458+0000","last_clean":"2023-11-28T20:09:42.676458+0000","last_became_active":"2023-11-28T20:09:42.674720+0000","last_became_peered":"2023-11-28T20:09:42.674720+0000","last_unstale":"2023-11-28T20:09:42.676458+0000","last_undegraded":"2023-11-28T20:09:42.676458+0000","last_fullsized":"2023-11-28T20:09:42.676458+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:42.147183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655167+0000","last_change":"2023-11-28T20:09:42.655167+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655167+0000","last_undegraded":"2023-11-28T20:09:42.655167+0000","last_fullsized":"2023-11-28T20:09:42.655167+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669881+0000","last_change":"2023-11-28T20:09:42.668166+0000","last_active":"2023-11-28T20:09:42.669881+0000","last_peered":"2023-11-28T20:09:42.669881+0000","last_clean":"2023-11-28T20:09:42.669881+0000","last_became_active":"2023-11-28T20:09:42.666450+0000","last_became_peered":"2023-11-28T20:09:42.666450+0000","last_unstale":"2023-11-28T20:09:42.669881+0000","last_undegraded":"2023-11-28T20:09:42.669881+0000","last_fullsized":"2023-11-28T20:09:42.669881+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:51.354290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.662115+0000","last_change":"2023-11-28T20:09:42.662115+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.662115+0000","last_undegraded":"2023-11-28T20:09:42.662115+0000","last_fullsized":"2023-11-28T20:09:42.662115+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.674322+0000","last_change":"2023-11-28T20:09:42.667815+0000","last_active":"2023-11-28T20:09:42.674322+0000","last_peered":"2023-11-28T20:09:42.674322+0000","last_clean":"2023-11-28T20:09:42.674322+0000","last_became_active":"2023-11-28T20:09:42.667502+0000","last_became_peered":"2023-11-28T20:09:42.667502+0000","last_unstale":"2023-11-28T20:09:42.674322+0000","last_undegraded":"2023-11-28T20:09:42.674322+0000","last_fullsized":"2023-11-28T20:09:42.674322+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:50.363442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652373+0000","last_change":"2023-11-28T20:09:42.652373+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652373+0000","last_undegraded":"2023-11-28T20:09:42.652373+0000","last_fullsized":"2023-11-28T20:09:42.652373+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.678297+0000","last_change":"2023-11-28T20:09:42.673577+0000","last_active":"2023-11-28T20:09:42.678297+0000","last_peered":"2023-11-28T20:09:42.678297+0000","last_clean":"2023-11-28T20:09:42.678297+0000","last_became_active":"2023-11-28T20:09:42.673263+0000","last_became_peered":"2023-11-28T20:09:42.673263+0000","last_unstale":"2023-11-28T20:09:42.678297+0000","last_undegraded":"2023-11-28T20:09:42.678297+0000","last_fullsized":"2023-11-28T20:09:42.678297+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:17.507022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.664092+0000","last_change":"2023-11-28T20:09:42.664092+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.664092+0000","last_undegraded":"2023-11-28T20:09:42.664092+0000","last_fullsized":"2023-11-28T20:09:42.664092+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675461+0000","last_change":"2023-11-28T20:09:42.666698+0000","last_active":"2023-11-28T20:09:42.675461+0000","last_peered":"2023-11-28T20:09:42.675461+0000","last_clean":"2023-11-28T20:09:42.675461+0000","last_became_active":"2023-11-28T20:09:42.666428+0000","last_became_peered":"2023-11-28T20:09:42.666428+0000","last_unstale":"2023-11-28T20:09:42.675461+0000","last_undegraded":"2023-11-28T20:09:42.675461+0000","last_fullsized":"2023-11-28T20:09:42.675461+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:45:52.810926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656322+0000","last_change":"2023-11-28T20:09:42.656322+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656322+0000","last_undegraded":"2023-11-28T20:09:42.656322+0000","last_fullsized":"2023-11-28T20:09:42.656322+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.674525+0000","last_change":"2023-11-28T20:09:42.672595+0000","last_active":"2023-11-28T20:09:42.674525+0000","last_peered":"2023-11-28T20:09:42.674525+0000","last_clean":"2023-11-28T20:09:42.674525+0000","last_became_active":"2023-11-28T20:09:42.672270+0000","last_became_peered":"2023-11-28T20:09:42.672270+0000","last_unstale":"2023-11-28T20:09:42.674525+0000","last_undegraded":"2023-11-28T20:09:42.674525+0000","last_fullsized":"2023-11-28T20:09:42.674525+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:48.596264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.664887+0000","last_change":"2023-11-28T20:09:42.664887+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.664887+0000","last_undegraded":"2023-11-28T20:09:42.664887+0000","last_fullsized":"2023-11-28T20:09:42.664887+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676982+0000","last_change":"2023-11-28T20:09:42.675538+0000","last_active":"2023-11-28T20:09:42.676982+0000","last_peered":"2023-11-28T20:09:42.676982+0000","last_clean":"2023-11-28T20:09:42.676982+0000","last_became_active":"2023-11-28T20:09:42.675139+0000","last_became_peered":"2023-11-28T20:09:42.675139+0000","last_unstale":"2023-11-28T20:09:42.676982+0000","last_undegraded":"2023-11-28T20:09:42.676982+0000","last_fullsized":"2023-11-28T20:09:42.676982+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:08.633227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655761+0000","last_change":"2023-11-28T20:09:42.655761+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655761+0000","last_undegraded":"2023-11-28T20:09:42.655761+0000","last_fullsized":"2023-11-28T20:09:42.655761+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.673712+0000","last_change":"2023-11-28T20:09:42.668264+0000","last_active":"2023-11-28T20:09:42.673712+0000","last_peered":"2023-11-28T20:09:42.673712+0000","last_clean":"2023-11-28T20:09:42.673712+0000","last_became_active":"2023-11-28T20:09:42.667948+0000","last_became_peered":"2023-11-28T20:09:42.667948+0000","last_unstale":"2023-11-28T20:09:42.673712+0000","last_undegraded":"2023-11-28T20:09:42.673712+0000","last_fullsized":"2023-11-28T20:09:42.673712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:24:57.386846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.661047+0000","last_change":"2023-11-28T20:09:42.661047+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.661047+0000","last_undegraded":"2023-11-28T20:09:42.661047+0000","last_fullsized":"2023-11-28T20:09:42.661047+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.673371+0000","last_change":"2023-11-28T20:09:42.660838+0000","last_active":"2023-11-28T20:09:42.673371+0000","last_peered":"2023-11-28T20:09:42.673371+0000","last_clean":"2023-11-28T20:09:42.673371+0000","last_became_active":"2023-11-28T20:09:42.660549+0000","last_became_peered":"2023-11-28T20:09:42.660549+0000","last_unstale":"2023-11-28T20:09:42.673371+0000","last_undegraded":"2023-11-28T20:09:42.673371+0000","last_fullsized":"2023-11-28T20:09:42.673371+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:08:58.244467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655535+0000","last_change":"2023-11-28T20:09:42.655535+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655535+0000","last_undegraded":"2023-11-28T20:09:42.655535+0000","last_fullsized":"2023-11-28T20:09:42.655535+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.680719+0000","last_change":"2023-11-28T20:09:42.678274+0000","last_active":"2023-11-28T20:09:42.680719+0000","last_peered":"2023-11-28T20:09:42.680719+0000","last_clean":"2023-11-28T20:09:42.680719+0000","last_became_active":"2023-11-28T20:09:42.677974+0000","last_became_peered":"2023-11-28T20:09:42.677974+0000","last_unstale":"2023-11-28T20:09:42.680719+0000","last_undegraded":"2023-11-28T20:09:42.680719+0000","last_fullsized":"2023-11-28T20:09:42.680719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:15.217653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665153+0000","last_change":"2023-11-28T20:09:42.665153+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665153+0000","last_undegraded":"2023-11-28T20:09:42.665153+0000","last_fullsized":"2023-11-28T20:09:42.665153+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675534+0000","last_change":"2023-11-28T20:09:42.664555+0000","last_active":"2023-11-28T20:09:42.675534+0000","last_peered":"2023-11-28T20:09:42.675534+0000","last_clean":"2023-11-28T20:09:42.675534+0000","last_became_active":"2023-11-28T20:09:42.663496+0000","last_became_peered":"2023-11-28T20:09:42.663496+0000","last_unstale":"2023-11-28T20:09:42.675534+0000","last_undegraded":"2023-11-28T20:09:42.675534+0000","last_fullsized":"2023-11-28T20:09:42.675534+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:54:38.995754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655397+0000","last_change":"2023-11-28T20:09:42.655397+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655397+0000","last_undegraded":"2023-11-28T20:09:42.655397+0000","last_fullsized":"2023-11-28T20:09:42.655397+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677759+0000","last_change":"2023-11-28T20:09:42.676899+0000","last_active":"2023-11-28T20:09:42.677759+0000","last_peered":"2023-11-28T20:09:42.677759+0000","last_clean":"2023-11-28T20:09:42.677759+0000","last_became_active":"2023-11-28T20:09:42.676592+0000","last_became_peered":"2023-11-28T20:09:42.676592+0000","last_unstale":"2023-11-28T20:09:42.677759+0000","last_undegraded":"2023-11-28T20:09:42.677759+0000","last_fullsized":"2023-11-28T20:09:42.677759+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:19:24.863349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665542+0000","last_change":"2023-11-28T20:09:42.665542+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665542+0000","last_undegraded":"2023-11-28T20:09:42.665542+0000","last_fullsized":"2023-11-28T20:09:42.665542+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676170+0000","last_change":"2023-11-28T20:09:42.675569+0000","last_active":"2023-11-28T20:09:42.676170+0000","last_peered":"2023-11-28T20:09:42.676170+0000","last_clean":"2023-11-28T20:09:42.676170+0000","last_became_active":"2023-11-28T20:09:42.675111+0000","last_became_peered":"2023-11-28T20:09:42.675111+0000","last_unstale":"2023-11-28T20:09:42.676170+0000","last_undegraded":"2023-11-28T20:09:42.676170+0000","last_fullsized":"2023-11-28T20:09:42.676170+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:18.357434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652625+0000","last_change":"2023-11-28T20:09:42.652625+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652625+0000","last_undegraded":"2023-11-28T20:09:42.652625+0000","last_fullsized":"2023-11-28T20:09:42.652625+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.680754+0000","last_change":"2023-11-28T20:09:42.678609+0000","last_active":"2023-11-28T20:09:42.680754+0000","last_peered":"2023-11-28T20:09:42.680754+0000","last_clean":"2023-11-28T20:09:42.680754+0000","last_became_active":"2023-11-28T20:09:42.677536+0000","last_became_peered":"2023-11-28T20:09:42.677536+0000","last_unstale":"2023-11-28T20:09:42.680754+0000","last_undegraded":"2023-11-28T20:09:42.680754+0000","last_fullsized":"2023-11-28T20:09:42.680754+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:23.158269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.658790+0000","last_change":"2023-11-28T20:09:42.658790+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.658790+0000","last_undegraded":"2023-11-28T20:09:42.658790+0000","last_fullsized":"2023-11-28T20:09:42.658790+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676514+0000","last_change":"2023-11-28T20:09:42.669065+0000","last_active":"2023-11-28T20:09:42.676514+0000","last_peered":"2023-11-28T20:09:42.676514+0000","last_clean":"2023-11-28T20:09:42.676514+0000","last_became_active":"2023-11-28T20:09:42.668745+0000","last_became_peered":"2023-11-28T20:09:42.668745+0000","last_unstale":"2023-11-28T20:09:42.676514+0000","last_undegraded":"2023-11-28T20:09:42.676514+0000","last_fullsized":"2023-11-28T20:09:42.676514+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:11.506826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657749+0000","last_change":"2023-11-28T20:09:42.657749+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657749+0000","last_undegraded":"2023-11-28T20:09:42.657749+0000","last_fullsized":"2023-11-28T20:09:42.657749+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676636+0000","last_change":"2023-11-28T20:09:42.671311+0000","last_active":"2023-11-28T20:09:42.676636+0000","last_peered":"2023-11-28T20:09:42.676636+0000","last_clean":"2023-11-28T20:09:42.676636+0000","last_became_active":"2023-11-28T20:09:42.671023+0000","last_became_peered":"2023-11-28T20:09:42.671023+0000","last_unstale":"2023-11-28T20:09:42.676636+0000","last_undegraded":"2023-11-28T20:09:42.676636+0000","last_fullsized":"2023-11-28T20:09:42.676636+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:12.823637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656090+0000","last_change":"2023-11-28T20:09:42.656090+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656090+0000","last_undegraded":"2023-11-28T20:09:42.656090+0000","last_fullsized":"2023-11-28T20:09:42.656090+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675522+0000","last_change":"2023-11-28T20:09:42.673420+0000","last_active":"2023-11-28T20:09:42.675522+0000","last_peered":"2023-11-28T20:09:42.675522+0000","last_clean":"2023-11-28T20:09:42.675522+0000","last_became_active":"2023-11-28T20:09:42.673075+0000","last_became_peered":"2023-11-28T20:09:42.673075+0000","last_unstale":"2023-11-28T20:09:42.675522+0000","last_undegraded":"2023-11-28T20:09:42.675522+0000","last_fullsized":"2023-11-28T20:09:42.675522+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:49:07.928868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.654549+0000","last_change":"2023-11-28T20:09:42.654549+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.654549+0000","last_undegraded":"2023-11-28T20:09:42.654549+0000","last_fullsized":"2023-11-28T20:09:42.654549+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669078+0000","last_change":"2023-11-28T20:09:42.667295+0000","last_active":"2023-11-28T20:09:42.669078+0000","last_peered":"2023-11-28T20:09:42.669078+0000","last_clean":"2023-11-28T20:09:42.669078+0000","last_became_active":"2023-11-28T20:09:42.666932+0000","last_became_peered":"2023-11-28T20:09:42.666932+0000","last_unstale":"2023-11-28T20:09:42.669078+0000","last_undegraded":"2023-11-28T20:09:42.669078+0000","last_fullsized":"2023-11-28T20:09:42.669078+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:39.371885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655863+0000","last_change":"2023-11-28T20:09:42.655863+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655863+0000","last_undegraded":"2023-11-28T20:09:42.655863+0000","last_fullsized":"2023-11-28T20:09:42.655863+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.679019+0000","last_change":"2023-11-28T20:09:42.674280+0000","last_active":"2023-11-28T20:09:42.679019+0000","last_peered":"2023-11-28T20:09:42.679019+0000","last_clean":"2023-11-28T20:09:42.679019+0000","last_became_active":"2023-11-28T20:09:42.673979+0000","last_became_peered":"2023-11-28T20:09:42.673979+0000","last_unstale":"2023-11-28T20:09:42.679019+0000","last_undegraded":"2023-11-28T20:09:42.679019+0000","last_fullsized":"2023-11-28T20:09:42.679019+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:24:57.386846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":189,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T20:09:41.647031+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:09:41.647031+0000","last_peered":"2023-11-28T20:09:41.647031+0000","last_clean":"2023-11-28T20:09:41.647031+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:09:41.647031+0000","last_undegraded":"2023-11-28T20:09:41.647031+0000","last_fullsized":"2023-11-28T20:09:41.647031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1150976,"data_stored":819370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.438,"5min":0.313,"15min":0.313},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.56200000000000006,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.032,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.70699999999999996}]},{"osd":1,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.65400000000000003},"min":{"1min":0.49199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94399999999999995,"5min":1.161,"15min":1.161},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0009999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97899999999999998,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.60299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61899999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0209999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.68799999999999994}]},{"osd":4,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.44500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.505,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.63800000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.48799999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.502},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.495,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.76200000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.58899999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.054,"5min":1.272,"15min":1.272},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.79200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.44500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.80800000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.69999999999999996,"15min":0.68500000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.748,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.79200000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.65400000000000003},"min":{"1min":0.501,"5min":0.498,"15min":0.498},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.60999999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5819999999999999,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.125,"5min":1.357,"15min":1.357},"last":0.75},{"interface":"front","average":{"1min":1.006,"5min":0.80600000000000005,"15min":0.77200000000000002},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":6.2249999999999996,"5min":6.2249999999999996,"15min":6.2249999999999996},"last":0.70199999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.0789999999999997,"5min":4.0789999999999997,"15min":4.0789999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":0.81899999999999995,"15min":0.77700000000000002},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":8.6159999999999997,"5min":8.6159999999999997,"15min":8.6159999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.83299999999999996,"15min":0.82099999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.81799999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.84399999999999997,"15min":0.84199999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.86199999999999999,"15min":0.85799999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.72899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.78900000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61199999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.629},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65900000000000003,"15min":0.66000000000000003},"min":{"1min":0.47199999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.879,"5min":1.083,"15min":1.083},"last":0.66200000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.052,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69799999999999995,"15min":0.70099999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84399999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73299999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65300000000000002,"15min":0.66200000000000003},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.503},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81299999999999994,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70299999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77800000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82999999999999996,"5min":0.997,"15min":0.997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92400000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.749}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67900000000000005,"15min":0.68600000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.78100000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.751},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71399999999999997,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85599999999999998,"5min":1.361,"15min":1.361},"last":0.76500000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68799999999999994},"min":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.81799999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.79500000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86899999999999999,"5min":1.04,"15min":1.04},"last":0.83199999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.56699999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.83999999999999997,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88100000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.45400000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85699999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":1.038,"15min":1.038},"last":0.59599999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.84299999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.91400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93100000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.86099999999999999,"15min":0.877},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98899999999999999,"5min":1.353,"15min":1.353},"last":0.63500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.02,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.68100000000000005,"15min":0.72199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76000000000000001,"5min":6.016,"15min":6.016},"last":0.29299999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2170000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.40600000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94799999999999995,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.44},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0549999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.49299999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0009999999999999,"5min":5.8810000000000002,"15min":5.8810000000000002},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.038,"5min":1.405,"15min":1.405},"last":0.92400000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79800000000000004,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.119,"5min":1.585,"15min":1.585},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.97299999999999998,"15min":1.0129999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.042,"5min":5.9349999999999996,"15min":5.9349999999999996},"last":0.84699999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95699999999999996,"5min":1.361,"15min":1.361},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.55500000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0900000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.90300000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.94999999999999996,"15min":0.98799999999999999},"min":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.262,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0620000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.88200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.80800000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.442},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.54300000000000004,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.626}]},{"osd":1,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.3140000000000001,"5min":5.3140000000000001,"15min":5.3140000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":3.7650000000000001,"5min":3.7650000000000001,"15min":3.7650000000000001},"last":0.502}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":5.3460000000000001,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.54500000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3580000000000001,"5min":1.415,"15min":1.415},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.81699999999999995,"15min":0.80700000000000005},"min":{"1min":0.54500000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.8090000000000002,"5min":3.8090000000000002,"15min":3.8090000000000002},"last":0.79100000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.2809999999999997,"5min":5.2809999999999997,"15min":5.2809999999999997},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88800000000000001,"15min":0.88400000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.5369999999999999,"5min":4.5369999999999999,"15min":4.5369999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.88700000000000001,"15min":0.86599999999999999},"min":{"1min":0.56799999999999995,"5min":0.496,"15min":0.496},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.84499999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.88,"15min":0.874},"min":{"1min":0.56999999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":3.863,"5min":3.863,"15min":3.863},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.90300000000000002,"15min":0.88600000000000001},"min":{"1min":0.627,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":5.2460000000000004,"5min":5.2460000000000004,"15min":5.2460000000000004},"last":0.81499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":544768,"data_stored":222727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.60499999999999998,"15min":0.63900000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.627,"15min":0.66100000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.58199999999999996}]},{"osd":2,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.64800000000000002,"15min":0.68300000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79900000000000004,"5min":4.9909999999999997,"15min":4.9909999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.68100000000000005,"15min":0.71899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56699999999999995,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.39000000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":1.389,"15min":1.389},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.67000000000000004,"15min":0.70399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.48599999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.503,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":1.145,"15min":1.145},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.93500000000000005,"15min":0.96599999999999997},"min":{"1min":0.59899999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90600000000000003,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":1.321}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.91400000000000003,"15min":0.95499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90600000000000003,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":0.748},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.89100000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.232}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.94799999999999995,"15min":0.99099999999999999},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.89800000000000002,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.80900000000000005,"15min":0.81799999999999995},"min":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.92400000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.3069999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0009999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.94699999999999995,"15min":0.98499999999999999},"min":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.93100000000000005,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":1.2509999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1150976,"data_stored":819370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.50700000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.753,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59299999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.48799999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.998,"5min":1.052,"15min":1.052},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92100000000000004,"5min":1.006,"15min":1.006},"last":0.80000000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88900000000000001,"5min":1.524,"15min":1.524},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.97999999999999998,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70199999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.624,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.84199999999999997,"5min":1.214,"15min":1.214},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97399999999999998,"5min":1.415,"15min":1.415},"last":0.77000000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95599999999999996,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93899999999999995,"5min":1.099,"15min":1.099},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:09:47.742 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:09:47.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c271e6640 1 Processor -- start 2023-11-28T20:09:47.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c271e6640 1 -- start start 2023-11-28T20:09:47.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c271e6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2c200b4760 0x7f2c200d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c271e6640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2c200b4b40 0x7f2c200d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c271e6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2015d7c0 con 0x7f2c20142c00 2023-11-28T20:09:47.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c271e6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c20161dc0 con 0x7f2c200b4760 2023-11-28T20:09:47.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c271e6640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c20143760 con 0x7f2c200b4b40 2023-11-28T20:09:47.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c24f82640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2c200b4760 0x7f2c200d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c24f82640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2c200b4760 0x7f2c200d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47878/0 (socket says 172.21.15.177:47878) 2023-11-28T20:09:47.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c24f82640 1 -- 172.21.15.177:0/2667424174 learned_addr learned my addr 172.21.15.177:0/2667424174 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:47.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c1ffff640 1 --2- 172.21.15.177:0/2667424174 >> v2:172.21.15.195:3300/0 conn(0x7f2c200b4b40 0x7f2c200d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c24f82640 1 -- 172.21.15.177:0/2667424174 >> v2:172.21.15.195:3300/0 conn(0x7f2c200b4b40 msgr2=0x7f2c200d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:47.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c24f82640 1 --2- 172.21.15.177:0/2667424174 >> v2:172.21.15.195:3300/0 conn(0x7f2c200b4b40 0x7f2c200d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c24f82640 1 -- 172.21.15.177:0/2667424174 >> v1:172.21.15.195:6789/0 conn(0x7f2c20142c00 legacy=0x7f2c20143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:47.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c24f82640 1 -- 172.21.15.177:0/2667424174 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c20140930 con 0x7f2c200b4760 2023-11-28T20:09:47.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.912+0000 7f2c1ffff640 1 --2- 172.21.15.177:0/2667424174 >> v2:172.21.15.195:3300/0 conn(0x7f2c200b4b40 0x7f2c200d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:47.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.916+0000 7f2c24f82640 1 --2- 172.21.15.177:0/2667424174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c200b4760 0x7f2c200d10a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2c2006d820 tx=0x7f2c1401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f720683604b5913c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:47.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.916+0000 7f2c1f7fe640 1 -- 172.21.15.177:0/2667424174 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140ab600 con 0x7f2c200b4760 2023-11-28T20:09:47.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.916+0000 7f2c1f7fe640 1 -- 172.21.15.177:0/2667424174 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c140a7050 con 0x7f2c200b4760 2023-11-28T20:09:47.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.916+0000 7f2c1f7fe640 1 -- 172.21.15.177:0/2667424174 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140ab980 con 0x7f2c200b4760 2023-11-28T20:09:47.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.916+0000 7f2c271e6640 1 -- 172.21.15.177:0/2667424174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c200b4760 msgr2=0x7f2c200d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.916+0000 7f2c271e6640 1 --2- 172.21.15.177:0/2667424174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c200b4760 0x7f2c200d10a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2c2006d820 tx=0x7f2c1401c500 comp rx=0 tx=0).stop 2023-11-28T20:09:47.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.916+0000 7f2c271e6640 1 -- 172.21.15.177:0/2667424174 shutdown_connections 2023-11-28T20:09:47.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.916+0000 7f2c271e6640 1 --2- 172.21.15.177:0/2667424174 >> v2:172.21.15.195:3300/0 conn(0x7f2c200b4b40 0x7f2c200d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.916+0000 7f2c271e6640 1 --2- 172.21.15.177:0/2667424174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c200b4760 0x7f2c200d10a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.916+0000 7f2c271e6640 1 -- 172.21.15.177:0/2667424174 >> 172.21.15.177:0/2667424174 conn(0x7f2c2006a530 msgr2=0x7f2c2006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:47.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.916+0000 7f2c271e6640 1 -- 172.21.15.177:0/2667424174 shutdown_connections 2023-11-28T20:09:47.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.916+0000 7f2c271e6640 1 -- 172.21.15.177:0/2667424174 wait complete. 2023-11-28T20:09:47.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c271e6640 1 Processor -- start 2023-11-28T20:09:47.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c271e6640 1 -- start start 2023-11-28T20:09:47.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c271e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c200b4760 0x7f2c201639f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c271e6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c200b4b40 0x7f2c2013bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c271e6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c20142c00 0x7f2c2013c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c271e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2015b2d0 con 0x7f2c200b4760 2023-11-28T20:09:47.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c271e6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2015a650 con 0x7f2c200b4b40 2023-11-28T20:09:47.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c271e6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2015a930 con 0x7f2c20142c00 2023-11-28T20:09:47.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c24f82640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c200b4760 0x7f2c201639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c24f82640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c200b4760 0x7f2c201639f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47894/0 (socket says 172.21.15.177:47894) 2023-11-28T20:09:47.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c24f82640 1 -- 172.21.15.177:0/3120258161 learned_addr learned my addr 172.21.15.177:0/3120258161 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:47.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c25783640 1 --2- 172.21.15.177:0/3120258161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c20142c00 0x7f2c2013c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c1ffff640 1 --2- 172.21.15.177:0/3120258161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c200b4b40 0x7f2c2013bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c24f82640 1 -- 172.21.15.177:0/3120258161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c20142c00 msgr2=0x7f2c2013c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c24f82640 1 --2- 172.21.15.177:0/3120258161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c20142c00 0x7f2c2013c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c24f82640 1 -- 172.21.15.177:0/3120258161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c200b4b40 msgr2=0x7f2c2013bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:47.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c24f82640 1 --2- 172.21.15.177:0/3120258161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c200b4b40 0x7f2c2013bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:47.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c24f82640 1 -- 172.21.15.177:0/3120258161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c140094d0 con 0x7f2c200b4760 2023-11-28T20:09:47.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c24f82640 1 --2- 172.21.15.177:0/3120258161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c200b4760 0x7f2c201639f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2c140ae040 tx=0x7f2c140192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:47.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c1d7fa640 1 -- 172.21.15.177:0/3120258161 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140b4440 con 0x7f2c200b4760 2023-11-28T20:09:47.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c1d7fa640 1 -- 172.21.15.177:0/3120258161 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c140b45a0 con 0x7f2c200b4760 2023-11-28T20:09:47.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c1d7fa640 1 -- 172.21.15.177:0/3120258161 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140b4930 con 0x7f2c200b4760 2023-11-28T20:09:47.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c271e6640 1 -- 172.21.15.177:0/3120258161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2015ac10 con 0x7f2c200b4760 2023-11-28T20:09:47.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.920+0000 7f2c271e6640 1 -- 172.21.15.177:0/3120258161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2013cf90 con 0x7f2c200b4760 2023-11-28T20:09:47.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.924+0000 7f2c271e6640 1 -- 172.21.15.177:0/3120258161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2015b410 con 0x7f2c200b4760 2023-11-28T20:09:47.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.924+0000 7f2c1d7fa640 1 -- 172.21.15.177:0/3120258161 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2c140b2070 con 0x7f2c200b4760 2023-11-28T20:09:47.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.924+0000 7f2c1d7fa640 1 --2- 172.21.15.177:0/3120258161 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2c04066470 0x7f2c04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:47.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.924+0000 7f2c1d7fa640 1 -- 172.21.15.177:0/3120258161 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c1411dcb0 con 0x7f2c200b4760 2023-11-28T20:09:47.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.924+0000 7f2c1ffff640 1 --2- 172.21.15.177:0/3120258161 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2c04066470 0x7f2c04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:47.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.924+0000 7f2c1ffff640 1 --2- 172.21.15.177:0/3120258161 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2c04066470 0x7f2c04068930 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2c2006b020 tx=0x7f2c0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:47.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:47.928+0000 7f2c1d7fa640 1 -- 172.21.15.177:0/3120258161 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2c140eb1d0 con 0x7f2c200b4760 2023-11-28T20:09:48.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.072+0000 7f2c271e6640 1 -- 172.21.15.177:0/3120258161 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c2006d680 con 0x7f2c04066470 2023-11-28T20:09:48.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.080+0000 7f2c1d7fa640 1 -- 172.21.15.177:0/3120258161 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283905 (secure 0 0 0) 0x7f2c2006d680 con 0x7f2c04066470 2023-11-28T20:09:48.088 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:48.089 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:09:48.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.084+0000 7f2c271e6640 1 -- 172.21.15.177:0/3120258161 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2c04066470 msgr2=0x7f2c04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:48.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.084+0000 7f2c271e6640 1 --2- 172.21.15.177:0/3120258161 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2c04066470 0x7f2c04068930 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2c2006b020 tx=0x7f2c0c008040 comp rx=0 tx=0).stop 2023-11-28T20:09:48.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.084+0000 7f2c271e6640 1 -- 172.21.15.177:0/3120258161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c200b4760 msgr2=0x7f2c201639f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:48.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.084+0000 7f2c271e6640 1 --2- 172.21.15.177:0/3120258161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c200b4760 0x7f2c201639f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2c140ae040 tx=0x7f2c140192a0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.084+0000 7f2c271e6640 1 -- 172.21.15.177:0/3120258161 shutdown_connections 2023-11-28T20:09:48.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.084+0000 7f2c271e6640 1 --2- 172.21.15.177:0/3120258161 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2c04066470 0x7f2c04068930 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.084+0000 7f2c271e6640 1 --2- 172.21.15.177:0/3120258161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c20142c00 0x7f2c2013c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.084+0000 7f2c271e6640 1 --2- 172.21.15.177:0/3120258161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c200b4b40 0x7f2c2013bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.084+0000 7f2c271e6640 1 --2- 172.21.15.177:0/3120258161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c200b4760 0x7f2c201639f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.084+0000 7f2c271e6640 1 -- 172.21.15.177:0/3120258161 >> 172.21.15.177:0/3120258161 conn(0x7f2c2006a530 msgr2=0x7f2c2013d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:48.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.084+0000 7f2c271e6640 1 -- 172.21.15.177:0/3120258161 shutdown_connections 2023-11-28T20:09:48.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.084+0000 7f2c271e6640 1 -- 172.21.15.177:0/3120258161 wait complete. 2023-11-28T20:09:48.108 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-11-28T20:09:47.443010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242472,"kb_used_data":5500,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754732248,"statfs":{"total":773094113280,"available":772845821952,"internally_reserved":0,"allocated":5632000,"data_stored":3006477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.804330"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665732+0000","last_change":"2023-11-28T20:09:42.665732+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665732+0000","last_undegraded":"2023-11-28T20:09:42.665732+0000","last_fullsized":"2023-11-28T20:09:42.665732+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653516+0000","last_change":"2023-11-28T20:09:42.653516+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653516+0000","last_undegraded":"2023-11-28T20:09:42.653516+0000","last_fullsized":"2023-11-28T20:09:42.653516+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.671505+0000","last_change":"2023-11-28T20:09:42.671505+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.671505+0000","last_undegraded":"2023-11-28T20:09:42.671505+0000","last_fullsized":"2023-11-28T20:09:42.671505+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651363+0000","last_change":"2023-11-28T20:09:42.651363+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651363+0000","last_undegraded":"2023-11-28T20:09:42.651363+0000","last_fullsized":"2023-11-28T20:09:42.651363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657723+0000","last_change":"2023-11-28T20:09:42.657723+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657723+0000","last_undegraded":"2023-11-28T20:09:42.657723+0000","last_fullsized":"2023-11-28T20:09:42.657723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.667791+0000","last_change":"2023-11-28T20:09:42.667791+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.667791+0000","last_undegraded":"2023-11-28T20:09:42.667791+0000","last_fullsized":"2023-11-28T20:09:42.667791+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.671313+0000","last_change":"2023-11-28T20:09:42.671313+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.671313+0000","last_undegraded":"2023-11-28T20:09:42.671313+0000","last_fullsized":"2023-11-28T20:09:42.671313+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653717+0000","last_change":"2023-11-28T20:09:42.653717+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653717+0000","last_undegraded":"2023-11-28T20:09:42.653717+0000","last_fullsized":"2023-11-28T20:09:42.653717+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655070+0000","last_change":"2023-11-28T20:09:42.655070+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655070+0000","last_undegraded":"2023-11-28T20:09:42.655070+0000","last_fullsized":"2023-11-28T20:09:42.655070+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.661316+0000","last_change":"2023-11-28T20:09:42.661316+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.661316+0000","last_undegraded":"2023-11-28T20:09:42.661316+0000","last_fullsized":"2023-11-28T20:09:42.661316+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657445+0000","last_change":"2023-11-28T20:09:42.657445+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657445+0000","last_undegraded":"2023-11-28T20:09:42.657445+0000","last_fullsized":"2023-11-28T20:09:42.657445+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653436+0000","last_change":"2023-11-28T20:09:42.653436+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653436+0000","last_undegraded":"2023-11-28T20:09:42.653436+0000","last_fullsized":"2023-11-28T20:09:42.653436+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.666052+0000","last_change":"2023-11-28T20:09:42.666052+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.666052+0000","last_undegraded":"2023-11-28T20:09:42.666052+0000","last_fullsized":"2023-11-28T20:09:42.666052+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.669868+0000","last_change":"2023-11-28T20:09:42.669868+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.669868+0000","last_undegraded":"2023-11-28T20:09:42.669868+0000","last_fullsized":"2023-11-28T20:09:42.669868+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651748+0000","last_change":"2023-11-28T20:09:42.651748+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651748+0000","last_undegraded":"2023-11-28T20:09:42.651748+0000","last_fullsized":"2023-11-28T20:09:42.651748+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665343+0000","last_change":"2023-11-28T20:09:42.665343+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665343+0000","last_undegraded":"2023-11-28T20:09:42.665343+0000","last_fullsized":"2023-11-28T20:09:42.665343+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.669366+0000","last_change":"2023-11-28T20:09:42.669366+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.669366+0000","last_undegraded":"2023-11-28T20:09:42.669366+0000","last_fullsized":"2023-11-28T20:09:42.669366+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652918+0000","last_change":"2023-11-28T20:09:42.652918+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652918+0000","last_undegraded":"2023-11-28T20:09:42.652918+0000","last_fullsized":"2023-11-28T20:09:42.652918+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.666333+0000","last_change":"2023-11-28T20:09:42.666333+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.666333+0000","last_undegraded":"2023-11-28T20:09:42.666333+0000","last_fullsized":"2023-11-28T20:09:42.666333+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.660299+0000","last_change":"2023-11-28T20:09:42.660299+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.660299+0000","last_undegraded":"2023-11-28T20:09:42.660299+0000","last_fullsized":"2023-11-28T20:09:42.660299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.663550+0000","last_change":"2023-11-28T20:09:42.663550+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.663550+0000","last_undegraded":"2023-11-28T20:09:42.663550+0000","last_fullsized":"2023-11-28T20:09:42.663550+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652494+0000","last_change":"2023-11-28T20:09:42.652494+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652494+0000","last_undegraded":"2023-11-28T20:09:42.652494+0000","last_fullsized":"2023-11-28T20:09:42.652494+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656884+0000","last_change":"2023-11-28T20:09:42.656884+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656884+0000","last_undegraded":"2023-11-28T20:09:42.656884+0000","last_fullsized":"2023-11-28T20:09:42.656884+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.663670+0000","last_change":"2023-11-28T20:09:42.663670+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.663670+0000","last_undegraded":"2023-11-28T20:09:42.663670+0000","last_fullsized":"2023-11-28T20:09:42.663670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.663409+0000","last_change":"2023-11-28T20:09:42.663409+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.663409+0000","last_undegraded":"2023-11-28T20:09:42.663409+0000","last_fullsized":"2023-11-28T20:09:42.663409+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655654+0000","last_change":"2023-11-28T20:09:42.655654+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655654+0000","last_undegraded":"2023-11-28T20:09:42.655654+0000","last_fullsized":"2023-11-28T20:09:42.655654+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.658550+0000","last_change":"2023-11-28T20:09:42.658550+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.658550+0000","last_undegraded":"2023-11-28T20:09:42.658550+0000","last_fullsized":"2023-11-28T20:09:42.658550+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.658235+0000","last_change":"2023-11-28T20:09:42.658235+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.658235+0000","last_undegraded":"2023-11-28T20:09:42.658235+0000","last_fullsized":"2023-11-28T20:09:42.658235+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.662648+0000","last_change":"2023-11-28T20:09:42.662648+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.662648+0000","last_undegraded":"2023-11-28T20:09:42.662648+0000","last_fullsized":"2023-11-28T20:09:42.662648+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651286+0000","last_change":"2023-11-28T20:09:42.651286+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651286+0000","last_undegraded":"2023-11-28T20:09:42.651286+0000","last_fullsized":"2023-11-28T20:09:42.651286+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.662994+0000","last_change":"2023-11-28T20:09:42.662994+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.662994+0000","last_undegraded":"2023-11-28T20:09:42.662994+0000","last_fullsized":"2023-11-28T20:09:42.662994+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655851+0000","last_change":"2023-11-28T20:09:42.655851+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655851+0000","last_undegraded":"2023-11-28T20:09:42.655851+0000","last_fullsized":"2023-11-28T20:09:42.655851+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651779+0000","last_change":"2023-11-28T20:09:42.651779+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651779+0000","last_undegraded":"2023-11-28T20:09:42.651779+0000","last_fullsized":"2023-11-28T20:09:42.651779+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669340+0000","last_change":"2023-11-28T20:09:42.666794+0000","last_active":"2023-11-28T20:09:42.669340+0000","last_peered":"2023-11-28T20:09:42.669340+0000","last_clean":"2023-11-28T20:09:42.669340+0000","last_became_active":"2023-11-28T20:09:42.666513+0000","last_became_peered":"2023-11-28T20:09:42.666513+0000","last_unstale":"2023-11-28T20:09:42.669340+0000","last_undegraded":"2023-11-28T20:09:42.669340+0000","last_fullsized":"2023-11-28T20:09:42.669340+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:51:59.917389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.654974+0000","last_change":"2023-11-28T20:09:42.654974+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.654974+0000","last_undegraded":"2023-11-28T20:09:42.654974+0000","last_fullsized":"2023-11-28T20:09:42.654974+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.679490+0000","last_change":"2023-11-28T20:09:42.674692+0000","last_active":"2023-11-28T20:09:42.679490+0000","last_peered":"2023-11-28T20:09:42.679490+0000","last_clean":"2023-11-28T20:09:42.679490+0000","last_became_active":"2023-11-28T20:09:42.674364+0000","last_became_peered":"2023-11-28T20:09:42.674364+0000","last_unstale":"2023-11-28T20:09:42.679490+0000","last_undegraded":"2023-11-28T20:09:42.679490+0000","last_fullsized":"2023-11-28T20:09:42.679490+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:32:26.336595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657485+0000","last_change":"2023-11-28T20:09:42.657485+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657485+0000","last_undegraded":"2023-11-28T20:09:42.657485+0000","last_fullsized":"2023-11-28T20:09:42.657485+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677675+0000","last_change":"2023-11-28T20:09:42.670599+0000","last_active":"2023-11-28T20:09:42.677675+0000","last_peered":"2023-11-28T20:09:42.677675+0000","last_clean":"2023-11-28T20:09:42.677675+0000","last_became_active":"2023-11-28T20:09:42.670216+0000","last_became_peered":"2023-11-28T20:09:42.670216+0000","last_unstale":"2023-11-28T20:09:42.677675+0000","last_undegraded":"2023-11-28T20:09:42.677675+0000","last_fullsized":"2023-11-28T20:09:42.677675+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:15.217653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653400+0000","last_change":"2023-11-28T20:09:42.653400+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653400+0000","last_undegraded":"2023-11-28T20:09:42.653400+0000","last_fullsized":"2023-11-28T20:09:42.653400+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675698+0000","last_change":"2023-11-28T20:09:42.674101+0000","last_active":"2023-11-28T20:09:42.675698+0000","last_peered":"2023-11-28T20:09:42.675698+0000","last_clean":"2023-11-28T20:09:42.675698+0000","last_became_active":"2023-11-28T20:09:42.673725+0000","last_became_peered":"2023-11-28T20:09:42.673725+0000","last_unstale":"2023-11-28T20:09:42.675698+0000","last_undegraded":"2023-11-28T20:09:42.675698+0000","last_fullsized":"2023-11-28T20:09:42.675698+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:49.634142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656518+0000","last_change":"2023-11-28T20:09:42.656518+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656518+0000","last_undegraded":"2023-11-28T20:09:42.656518+0000","last_fullsized":"2023-11-28T20:09:42.656518+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.674971+0000","last_change":"2023-11-28T20:09:42.664506+0000","last_active":"2023-11-28T20:09:42.674971+0000","last_peered":"2023-11-28T20:09:42.674971+0000","last_clean":"2023-11-28T20:09:42.674971+0000","last_became_active":"2023-11-28T20:09:42.664199+0000","last_became_peered":"2023-11-28T20:09:42.664199+0000","last_unstale":"2023-11-28T20:09:42.674971+0000","last_undegraded":"2023-11-28T20:09:42.674971+0000","last_fullsized":"2023-11-28T20:09:42.674971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:32:26.336595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651336+0000","last_change":"2023-11-28T20:09:42.651336+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651336+0000","last_undegraded":"2023-11-28T20:09:42.651336+0000","last_fullsized":"2023-11-28T20:09:42.651336+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.671611+0000","last_change":"2023-11-28T20:09:42.670093+0000","last_active":"2023-11-28T20:09:42.671611+0000","last_peered":"2023-11-28T20:09:42.671611+0000","last_clean":"2023-11-28T20:09:42.671611+0000","last_became_active":"2023-11-28T20:09:42.669832+0000","last_became_peered":"2023-11-28T20:09:42.669832+0000","last_unstale":"2023-11-28T20:09:42.671611+0000","last_undegraded":"2023-11-28T20:09:42.671611+0000","last_fullsized":"2023-11-28T20:09:42.671611+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:17.280206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.654604+0000","last_change":"2023-11-28T20:09:42.654604+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.654604+0000","last_undegraded":"2023-11-28T20:09:42.654604+0000","last_fullsized":"2023-11-28T20:09:42.654604+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669576+0000","last_change":"2023-11-28T20:09:42.666410+0000","last_active":"2023-11-28T20:09:42.669576+0000","last_peered":"2023-11-28T20:09:42.669576+0000","last_clean":"2023-11-28T20:09:42.669576+0000","last_became_active":"2023-11-28T20:09:42.666065+0000","last_became_peered":"2023-11-28T20:09:42.666065+0000","last_unstale":"2023-11-28T20:09:42.669576+0000","last_undegraded":"2023-11-28T20:09:42.669576+0000","last_fullsized":"2023-11-28T20:09:42.669576+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:07:05.109326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652208+0000","last_change":"2023-11-28T20:09:42.652208+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652208+0000","last_undegraded":"2023-11-28T20:09:42.652208+0000","last_fullsized":"2023-11-28T20:09:42.652208+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677174+0000","last_change":"2023-11-28T20:09:42.671231+0000","last_active":"2023-11-28T20:09:42.677174+0000","last_peered":"2023-11-28T20:09:42.677174+0000","last_clean":"2023-11-28T20:09:42.677174+0000","last_became_active":"2023-11-28T20:09:42.670957+0000","last_became_peered":"2023-11-28T20:09:42.670957+0000","last_unstale":"2023-11-28T20:09:42.677174+0000","last_undegraded":"2023-11-28T20:09:42.677174+0000","last_fullsized":"2023-11-28T20:09:42.677174+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:44:35.411601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655348+0000","last_change":"2023-11-28T20:09:42.655348+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655348+0000","last_undegraded":"2023-11-28T20:09:42.655348+0000","last_fullsized":"2023-11-28T20:09:42.655348+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669018+0000","last_change":"2023-11-28T20:09:42.666932+0000","last_active":"2023-11-28T20:09:42.669018+0000","last_peered":"2023-11-28T20:09:42.669018+0000","last_clean":"2023-11-28T20:09:42.669018+0000","last_became_active":"2023-11-28T20:09:42.666671+0000","last_became_peered":"2023-11-28T20:09:42.666671+0000","last_unstale":"2023-11-28T20:09:42.669018+0000","last_undegraded":"2023-11-28T20:09:42.669018+0000","last_fullsized":"2023-11-28T20:09:42.669018+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:25.757605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655579+0000","last_change":"2023-11-28T20:09:42.655579+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655579+0000","last_undegraded":"2023-11-28T20:09:42.655579+0000","last_fullsized":"2023-11-28T20:09:42.655579+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.681208+0000","last_change":"2023-11-28T20:09:42.680303+0000","last_active":"2023-11-28T20:09:42.681208+0000","last_peered":"2023-11-28T20:09:42.681208+0000","last_clean":"2023-11-28T20:09:42.681208+0000","last_became_active":"2023-11-28T20:09:42.680028+0000","last_became_peered":"2023-11-28T20:09:42.680028+0000","last_unstale":"2023-11-28T20:09:42.681208+0000","last_undegraded":"2023-11-28T20:09:42.681208+0000","last_fullsized":"2023-11-28T20:09:42.681208+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:44:35.411601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656821+0000","last_change":"2023-11-28T20:09:42.656821+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656821+0000","last_undegraded":"2023-11-28T20:09:42.656821+0000","last_fullsized":"2023-11-28T20:09:42.656821+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675415+0000","last_change":"2023-11-28T20:09:42.674301+0000","last_active":"2023-11-28T20:09:42.675415+0000","last_peered":"2023-11-28T20:09:42.675415+0000","last_clean":"2023-11-28T20:09:42.675415+0000","last_became_active":"2023-11-28T20:09:42.673651+0000","last_became_peered":"2023-11-28T20:09:42.673651+0000","last_unstale":"2023-11-28T20:09:42.675415+0000","last_undegraded":"2023-11-28T20:09:42.675415+0000","last_fullsized":"2023-11-28T20:09:42.675415+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:48:37.397331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657154+0000","last_change":"2023-11-28T20:09:42.657154+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657154+0000","last_undegraded":"2023-11-28T20:09:42.657154+0000","last_fullsized":"2023-11-28T20:09:42.657154+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677439+0000","last_change":"2023-11-28T20:09:42.669553+0000","last_active":"2023-11-28T20:09:42.677439+0000","last_peered":"2023-11-28T20:09:42.677439+0000","last_clean":"2023-11-28T20:09:42.677439+0000","last_became_active":"2023-11-28T20:09:42.667456+0000","last_became_peered":"2023-11-28T20:09:42.667456+0000","last_unstale":"2023-11-28T20:09:42.677439+0000","last_undegraded":"2023-11-28T20:09:42.677439+0000","last_fullsized":"2023-11-28T20:09:42.677439+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:59.639535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656210+0000","last_change":"2023-11-28T20:09:42.656210+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656210+0000","last_undegraded":"2023-11-28T20:09:42.656210+0000","last_fullsized":"2023-11-28T20:09:42.656210+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.679813+0000","last_change":"2023-11-28T20:09:42.675080+0000","last_active":"2023-11-28T20:09:42.679813+0000","last_peered":"2023-11-28T20:09:42.679813+0000","last_clean":"2023-11-28T20:09:42.679813+0000","last_became_active":"2023-11-28T20:09:42.674739+0000","last_became_peered":"2023-11-28T20:09:42.674739+0000","last_unstale":"2023-11-28T20:09:42.679813+0000","last_undegraded":"2023-11-28T20:09:42.679813+0000","last_fullsized":"2023-11-28T20:09:42.679813+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:35.259118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656222+0000","last_change":"2023-11-28T20:09:42.656222+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656222+0000","last_undegraded":"2023-11-28T20:09:42.656222+0000","last_fullsized":"2023-11-28T20:09:42.656222+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676458+0000","last_change":"2023-11-28T20:09:42.675061+0000","last_active":"2023-11-28T20:09:42.676458+0000","last_peered":"2023-11-28T20:09:42.676458+0000","last_clean":"2023-11-28T20:09:42.676458+0000","last_became_active":"2023-11-28T20:09:42.674720+0000","last_became_peered":"2023-11-28T20:09:42.674720+0000","last_unstale":"2023-11-28T20:09:42.676458+0000","last_undegraded":"2023-11-28T20:09:42.676458+0000","last_fullsized":"2023-11-28T20:09:42.676458+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:42.147183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655167+0000","last_change":"2023-11-28T20:09:42.655167+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655167+0000","last_undegraded":"2023-11-28T20:09:42.655167+0000","last_fullsized":"2023-11-28T20:09:42.655167+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669881+0000","last_change":"2023-11-28T20:09:42.668166+0000","last_active":"2023-11-28T20:09:42.669881+0000","last_peered":"2023-11-28T20:09:42.669881+0000","last_clean":"2023-11-28T20:09:42.669881+0000","last_became_active":"2023-11-28T20:09:42.666450+0000","last_became_peered":"2023-11-28T20:09:42.666450+0000","last_unstale":"2023-11-28T20:09:42.669881+0000","last_undegraded":"2023-11-28T20:09:42.669881+0000","last_fullsized":"2023-11-28T20:09:42.669881+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:51.354290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.662115+0000","last_change":"2023-11-28T20:09:42.662115+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.662115+0000","last_undegraded":"2023-11-28T20:09:42.662115+0000","last_fullsized":"2023-11-28T20:09:42.662115+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.674322+0000","last_change":"2023-11-28T20:09:42.667815+0000","last_active":"2023-11-28T20:09:42.674322+0000","last_peered":"2023-11-28T20:09:42.674322+0000","last_clean":"2023-11-28T20:09:42.674322+0000","last_became_active":"2023-11-28T20:09:42.667502+0000","last_became_peered":"2023-11-28T20:09:42.667502+0000","last_unstale":"2023-11-28T20:09:42.674322+0000","last_undegraded":"2023-11-28T20:09:42.674322+0000","last_fullsized":"2023-11-28T20:09:42.674322+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:50.363442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652373+0000","last_change":"2023-11-28T20:09:42.652373+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652373+0000","last_undegraded":"2023-11-28T20:09:42.652373+0000","last_fullsized":"2023-11-28T20:09:42.652373+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.678297+0000","last_change":"2023-11-28T20:09:42.673577+0000","last_active":"2023-11-28T20:09:42.678297+0000","last_peered":"2023-11-28T20:09:42.678297+0000","last_clean":"2023-11-28T20:09:42.678297+0000","last_became_active":"2023-11-28T20:09:42.673263+0000","last_became_peered":"2023-11-28T20:09:42.673263+0000","last_unstale":"2023-11-28T20:09:42.678297+0000","last_undegraded":"2023-11-28T20:09:42.678297+0000","last_fullsized":"2023-11-28T20:09:42.678297+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:17.507022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.664092+0000","last_change":"2023-11-28T20:09:42.664092+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.664092+0000","last_undegraded":"2023-11-28T20:09:42.664092+0000","last_fullsized":"2023-11-28T20:09:42.664092+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675461+0000","last_change":"2023-11-28T20:09:42.666698+0000","last_active":"2023-11-28T20:09:42.675461+0000","last_peered":"2023-11-28T20:09:42.675461+0000","last_clean":"2023-11-28T20:09:42.675461+0000","last_became_active":"2023-11-28T20:09:42.666428+0000","last_became_peered":"2023-11-28T20:09:42.666428+0000","last_unstale":"2023-11-28T20:09:42.675461+0000","last_undegraded":"2023-11-28T20:09:42.675461+0000","last_fullsized":"2023-11-28T20:09:42.675461+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:45:52.810926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656322+0000","last_change":"2023-11-28T20:09:42.656322+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656322+0000","last_undegraded":"2023-11-28T20:09:42.656322+0000","last_fullsized":"2023-11-28T20:09:42.656322+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.674525+0000","last_change":"2023-11-28T20:09:42.672595+0000","last_active":"2023-11-28T20:09:42.674525+0000","last_peered":"2023-11-28T20:09:42.674525+0000","last_clean":"2023-11-28T20:09:42.674525+0000","last_became_active":"2023-11-28T20:09:42.672270+0000","last_became_peered":"2023-11-28T20:09:42.672270+0000","last_unstale":"2023-11-28T20:09:42.674525+0000","last_undegraded":"2023-11-28T20:09:42.674525+0000","last_fullsized":"2023-11-28T20:09:42.674525+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:48.596264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.664887+0000","last_change":"2023-11-28T20:09:42.664887+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.664887+0000","last_undegraded":"2023-11-28T20:09:42.664887+0000","last_fullsized":"2023-11-28T20:09:42.664887+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676982+0000","last_change":"2023-11-28T20:09:42.675538+0000","last_active":"2023-11-28T20:09:42.676982+0000","last_peered":"2023-11-28T20:09:42.676982+0000","last_clean":"2023-11-28T20:09:42.676982+0000","last_became_active":"2023-11-28T20:09:42.675139+0000","last_became_peered":"2023-11-28T20:09:42.675139+0000","last_unstale":"2023-11-28T20:09:42.676982+0000","last_undegraded":"2023-11-28T20:09:42.676982+0000","last_fullsized":"2023-11-28T20:09:42.676982+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:08.633227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655761+0000","last_change":"2023-11-28T20:09:42.655761+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655761+0000","last_undegraded":"2023-11-28T20:09:42.655761+0000","last_fullsized":"2023-11-28T20:09:42.655761+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.673712+0000","last_change":"2023-11-28T20:09:42.668264+0000","last_active":"2023-11-28T20:09:42.673712+0000","last_peered":"2023-11-28T20:09:42.673712+0000","last_clean":"2023-11-28T20:09:42.673712+0000","last_became_active":"2023-11-28T20:09:42.667948+0000","last_became_peered":"2023-11-28T20:09:42.667948+0000","last_unstale":"2023-11-28T20:09:42.673712+0000","last_undegraded":"2023-11-28T20:09:42.673712+0000","last_fullsized":"2023-11-28T20:09:42.673712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:24:57.386846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.661047+0000","last_change":"2023-11-28T20:09:42.661047+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.661047+0000","last_undegraded":"2023-11-28T20:09:42.661047+0000","last_fullsized":"2023-11-28T20:09:42.661047+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.673371+0000","last_change":"2023-11-28T20:09:42.660838+0000","last_active":"2023-11-28T20:09:42.673371+0000","last_peered":"2023-11-28T20:09:42.673371+0000","last_clean":"2023-11-28T20:09:42.673371+0000","last_became_active":"2023-11-28T20:09:42.660549+0000","last_became_peered":"2023-11-28T20:09:42.660549+0000","last_unstale":"2023-11-28T20:09:42.673371+0000","last_undegraded":"2023-11-28T20:09:42.673371+0000","last_fullsized":"2023-11-28T20:09:42.673371+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:08:58.244467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655535+0000","last_change":"2023-11-28T20:09:42.655535+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655535+0000","last_undegraded":"2023-11-28T20:09:42.655535+0000","last_fullsized":"2023-11-28T20:09:42.655535+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.680719+0000","last_change":"2023-11-28T20:09:42.678274+0000","last_active":"2023-11-28T20:09:42.680719+0000","last_peered":"2023-11-28T20:09:42.680719+0000","last_clean":"2023-11-28T20:09:42.680719+0000","last_became_active":"2023-11-28T20:09:42.677974+0000","last_became_peered":"2023-11-28T20:09:42.677974+0000","last_unstale":"2023-11-28T20:09:42.680719+0000","last_undegraded":"2023-11-28T20:09:42.680719+0000","last_fullsized":"2023-11-28T20:09:42.680719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:15.217653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665153+0000","last_change":"2023-11-28T20:09:42.665153+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665153+0000","last_undegraded":"2023-11-28T20:09:42.665153+0000","last_fullsized":"2023-11-28T20:09:42.665153+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675534+0000","last_change":"2023-11-28T20:09:42.664555+0000","last_active":"2023-11-28T20:09:42.675534+0000","last_peered":"2023-11-28T20:09:42.675534+0000","last_clean":"2023-11-28T20:09:42.675534+0000","last_became_active":"2023-11-28T20:09:42.663496+0000","last_became_peered":"2023-11-28T20:09:42.663496+0000","last_unstale":"2023-11-28T20:09:42.675534+0000","last_undegraded":"2023-11-28T20:09:42.675534+0000","last_fullsized":"2023-11-28T20:09:42.675534+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:54:38.995754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655397+0000","last_change":"2023-11-28T20:09:42.655397+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655397+0000","last_undegraded":"2023-11-28T20:09:42.655397+0000","last_fullsized":"2023-11-28T20:09:42.655397+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677759+0000","last_change":"2023-11-28T20:09:42.676899+0000","last_active":"2023-11-28T20:09:42.677759+0000","last_peered":"2023-11-28T20:09:42.677759+0000","last_clean":"2023-11-28T20:09:42.677759+0000","last_became_active":"2023-11-28T20:09:42.676592+0000","last_became_peered":"2023-11-28T20:09:42.676592+0000","last_unstale":"2023-11-28T20:09:42.677759+0000","last_undegraded":"2023-11-28T20:09:42.677759+0000","last_fullsized":"2023-11-28T20:09:42.677759+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:19:24.863349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665542+0000","last_change":"2023-11-28T20:09:42.665542+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665542+0000","last_undegraded":"2023-11-28T20:09:42.665542+0000","last_fullsized":"2023-11-28T20:09:42.665542+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676170+0000","last_change":"2023-11-28T20:09:42.675569+0000","last_active":"2023-11-28T20:09:42.676170+0000","last_peered":"2023-11-28T20:09:42.676170+0000","last_clean":"2023-11-28T20:09:42.676170+0000","last_became_active":"2023-11-28T20:09:42.675111+0000","last_became_peered":"2023-11-28T20:09:42.675111+0000","last_unstale":"2023-11-28T20:09:42.676170+0000","last_undegraded":"2023-11-28T20:09:42.676170+0000","last_fullsized":"2023-11-28T20:09:42.676170+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:18.357434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652625+0000","last_change":"2023-11-28T20:09:42.652625+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652625+0000","last_undegraded":"2023-11-28T20:09:42.652625+0000","last_fullsized":"2023-11-28T20:09:42.652625+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.680754+0000","last_change":"2023-11-28T20:09:42.678609+0000","last_active":"2023-11-28T20:09:42.680754+0000","last_peered":"2023-11-28T20:09:42.680754+0000","last_clean":"2023-11-28T20:09:42.680754+0000","last_became_active":"2023-11-28T20:09:42.677536+0000","last_became_peered":"2023-11-28T20:09:42.677536+0000","last_unstale":"2023-11-28T20:09:42.680754+0000","last_undegraded":"2023-11-28T20:09:42.680754+0000","last_fullsized":"2023-11-28T20:09:42.680754+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:23.158269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.658790+0000","last_change":"2023-11-28T20:09:42.658790+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.658790+0000","last_undegraded":"2023-11-28T20:09:42.658790+0000","last_fullsized":"2023-11-28T20:09:42.658790+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676514+0000","last_change":"2023-11-28T20:09:42.669065+0000","last_active":"2023-11-28T20:09:42.676514+0000","last_peered":"2023-11-28T20:09:42.676514+0000","last_clean":"2023-11-28T20:09:42.676514+0000","last_became_active":"2023-11-28T20:09:42.668745+0000","last_became_peered":"2023-11-28T20:09:42.668745+0000","last_unstale":"2023-11-28T20:09:42.676514+0000","last_undegraded":"2023-11-28T20:09:42.676514+0000","last_fullsized":"2023-11-28T20:09:42.676514+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:11.506826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657749+0000","last_change":"2023-11-28T20:09:42.657749+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657749+0000","last_undegraded":"2023-11-28T20:09:42.657749+0000","last_fullsized":"2023-11-28T20:09:42.657749+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676636+0000","last_change":"2023-11-28T20:09:42.671311+0000","last_active":"2023-11-28T20:09:42.676636+0000","last_peered":"2023-11-28T20:09:42.676636+0000","last_clean":"2023-11-28T20:09:42.676636+0000","last_became_active":"2023-11-28T20:09:42.671023+0000","last_became_peered":"2023-11-28T20:09:42.671023+0000","last_unstale":"2023-11-28T20:09:42.676636+0000","last_undegraded":"2023-11-28T20:09:42.676636+0000","last_fullsized":"2023-11-28T20:09:42.676636+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:12.823637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656090+0000","last_change":"2023-11-28T20:09:42.656090+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656090+0000","last_undegraded":"2023-11-28T20:09:42.656090+0000","last_fullsized":"2023-11-28T20:09:42.656090+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675522+0000","last_change":"2023-11-28T20:09:42.673420+0000","last_active":"2023-11-28T20:09:42.675522+0000","last_peered":"2023-11-28T20:09:42.675522+0000","last_clean":"2023-11-28T20:09:42.675522+0000","last_became_active":"2023-11-28T20:09:42.673075+0000","last_became_peered":"2023-11-28T20:09:42.673075+0000","last_unstale":"2023-11-28T20:09:42.675522+0000","last_undegraded":"2023-11-28T20:09:42.675522+0000","last_fullsized":"2023-11-28T20:09:42.675522+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:49:07.928868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.654549+0000","last_change":"2023-11-28T20:09:42.654549+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.654549+0000","last_undegraded":"2023-11-28T20:09:42.654549+0000","last_fullsized":"2023-11-28T20:09:42.654549+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669078+0000","last_change":"2023-11-28T20:09:42.667295+0000","last_active":"2023-11-28T20:09:42.669078+0000","last_peered":"2023-11-28T20:09:42.669078+0000","last_clean":"2023-11-28T20:09:42.669078+0000","last_became_active":"2023-11-28T20:09:42.666932+0000","last_became_peered":"2023-11-28T20:09:42.666932+0000","last_unstale":"2023-11-28T20:09:42.669078+0000","last_undegraded":"2023-11-28T20:09:42.669078+0000","last_fullsized":"2023-11-28T20:09:42.669078+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:39.371885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655863+0000","last_change":"2023-11-28T20:09:42.655863+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655863+0000","last_undegraded":"2023-11-28T20:09:42.655863+0000","last_fullsized":"2023-11-28T20:09:42.655863+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.679019+0000","last_change":"2023-11-28T20:09:42.674280+0000","last_active":"2023-11-28T20:09:42.679019+0000","last_peered":"2023-11-28T20:09:42.679019+0000","last_clean":"2023-11-28T20:09:42.679019+0000","last_became_active":"2023-11-28T20:09:42.673979+0000","last_became_peered":"2023-11-28T20:09:42.673979+0000","last_unstale":"2023-11-28T20:09:42.679019+0000","last_undegraded":"2023-11-28T20:09:42.679019+0000","last_fullsized":"2023-11-28T20:09:42.679019+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:24:57.386846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":189,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T20:09:41.647031+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:09:41.647031+0000","last_peered":"2023-11-28T20:09:41.647031+0000","last_clean":"2023-11-28T20:09:41.647031+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:09:41.647031+0000","last_undegraded":"2023-11-28T20:09:41.647031+0000","last_fullsized":"2023-11-28T20:09:41.647031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1150976,"data_stored":819370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.438,"5min":0.313,"15min":0.313},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.56200000000000006,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.032,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.70699999999999996}]},{"osd":1,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.65400000000000003},"min":{"1min":0.49199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94399999999999995,"5min":1.161,"15min":1.161},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0009999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97899999999999998,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.60299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61899999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0209999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.68799999999999994}]},{"osd":4,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.44500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.505,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.63800000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.48799999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.502},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.495,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.76200000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.58899999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.054,"5min":1.272,"15min":1.272},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.79200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.44500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.80800000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.69999999999999996,"15min":0.68500000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.748,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.79200000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.65400000000000003},"min":{"1min":0.501,"5min":0.498,"15min":0.498},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.60999999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5819999999999999,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.125,"5min":1.357,"15min":1.357},"last":0.75},{"interface":"front","average":{"1min":1.006,"5min":0.80600000000000005,"15min":0.77200000000000002},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":6.2249999999999996,"5min":6.2249999999999996,"15min":6.2249999999999996},"last":0.70199999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.0789999999999997,"5min":4.0789999999999997,"15min":4.0789999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":0.81899999999999995,"15min":0.77700000000000002},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":8.6159999999999997,"5min":8.6159999999999997,"15min":8.6159999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.83299999999999996,"15min":0.82099999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.81799999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.84399999999999997,"15min":0.84199999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.86199999999999999,"15min":0.85799999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.72899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.78900000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61199999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.629},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65900000000000003,"15min":0.66000000000000003},"min":{"1min":0.47199999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.879,"5min":1.083,"15min":1.083},"last":0.66200000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.052,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69799999999999995,"15min":0.70099999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84399999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73299999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65300000000000002,"15min":0.66200000000000003},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.503},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81299999999999994,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70299999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77800000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82999999999999996,"5min":0.997,"15min":0.997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92400000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.749}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67900000000000005,"15min":0.68600000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.78100000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.751},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71399999999999997,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85599999999999998,"5min":1.361,"15min":1.361},"last":0.76500000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68799999999999994},"min":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.81799999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.79500000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86899999999999999,"5min":1.04,"15min":1.04},"last":0.83199999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.56699999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.83999999999999997,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88100000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.45400000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85699999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":1.038,"15min":1.038},"last":0.59599999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.84299999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.91400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93100000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.86099999999999999,"15min":0.877},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98899999999999999,"5min":1.353,"15min":1.353},"last":0.63500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.02,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.68100000000000005,"15min":0.72199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76000000000000001,"5min":6.016,"15min":6.016},"last":0.29299999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2170000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.40600000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94799999999999995,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.44},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0549999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.49299999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0009999999999999,"5min":5.8810000000000002,"15min":5.8810000000000002},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.038,"5min":1.405,"15min":1.405},"last":0.92400000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79800000000000004,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.119,"5min":1.585,"15min":1.585},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.97299999999999998,"15min":1.0129999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.042,"5min":5.9349999999999996,"15min":5.9349999999999996},"last":0.84699999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95699999999999996,"5min":1.361,"15min":1.361},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.55500000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0900000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.90300000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.94999999999999996,"15min":0.98799999999999999},"min":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.262,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0620000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.88200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.80800000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.442},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.54300000000000004,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.626}]},{"osd":1,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.3140000000000001,"5min":5.3140000000000001,"15min":5.3140000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":3.7650000000000001,"5min":3.7650000000000001,"15min":3.7650000000000001},"last":0.502}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":5.3460000000000001,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.54500000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3580000000000001,"5min":1.415,"15min":1.415},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.81699999999999995,"15min":0.80700000000000005},"min":{"1min":0.54500000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.8090000000000002,"5min":3.8090000000000002,"15min":3.8090000000000002},"last":0.79100000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.2809999999999997,"5min":5.2809999999999997,"15min":5.2809999999999997},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88800000000000001,"15min":0.88400000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.5369999999999999,"5min":4.5369999999999999,"15min":4.5369999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.88700000000000001,"15min":0.86599999999999999},"min":{"1min":0.56799999999999995,"5min":0.496,"15min":0.496},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.84499999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.88,"15min":0.874},"min":{"1min":0.56999999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":3.863,"5min":3.863,"15min":3.863},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.90300000000000002,"15min":0.88600000000000001},"min":{"1min":0.627,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":5.2460000000000004,"5min":5.2460000000000004,"15min":5.2460000000000004},"last":0.81499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":544768,"data_stored":222727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.60499999999999998,"15min":0.63900000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.627,"15min":0.66100000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.58199999999999996}]},{"osd":2,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.64800000000000002,"15min":0.68300000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79900000000000004,"5min":4.9909999999999997,"15min":4.9909999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.68100000000000005,"15min":0.71899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56699999999999995,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.39000000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":1.389,"15min":1.389},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.67000000000000004,"15min":0.70399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.48599999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.503,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":1.145,"15min":1.145},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.93500000000000005,"15min":0.96599999999999997},"min":{"1min":0.59899999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90600000000000003,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":1.321}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.91400000000000003,"15min":0.95499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90600000000000003,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":0.748},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.89100000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.232}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.94799999999999995,"15min":0.99099999999999999},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.89800000000000002,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.80900000000000005,"15min":0.81799999999999995},"min":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.92400000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.3069999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0009999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.94699999999999995,"15min":0.98499999999999999},"min":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.93100000000000005,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":1.2509999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1150976,"data_stored":819370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.50700000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.753,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59299999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.48799999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.998,"5min":1.052,"15min":1.052},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92100000000000004,"5min":1.006,"15min":1.006},"last":0.80000000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88900000000000001,"5min":1.524,"15min":1.524},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.97999999999999998,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70199999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.624,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.84199999999999997,"5min":1.214,"15min":1.214},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97399999999999998,"5min":1.415,"15min":1.415},"last":0.77000000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95599999999999996,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93899999999999995,"5min":1.099,"15min":1.099},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:09:48.112 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:09:48.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.284+0000 7fc17bf80640 1 Processor -- start 2023-11-28T20:09:48.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.284+0000 7fc17bf80640 1 -- start start 2023-11-28T20:09:48.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.284+0000 7fc17bf80640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc1740cfe90 0x7fc1740d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:48.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.284+0000 7fc17bf80640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc1740b3c70 0x7fc17415f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:48.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.284+0000 7fc17bf80640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1740d3880 con 0x7fc1740b35b0 2023-11-28T20:09:48.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.284+0000 7fc17bf80640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1740d4090 con 0x7fc1740cfe90 2023-11-28T20:09:48.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.284+0000 7fc17bf80640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1740cdc80 con 0x7fc1740b3c70 2023-11-28T20:09:48.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.284+0000 7fc17951b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc1740cfe90 0x7fc1740d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:48.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.284+0000 7fc17951b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc1740cfe90 0x7fc1740d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47900/0 (socket says 172.21.15.177:47900) 2023-11-28T20:09:48.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.284+0000 7fc17951b640 1 -- 172.21.15.177:0/2021296824 learned_addr learned my addr 172.21.15.177:0/2021296824 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:48.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.284+0000 7fc17a51d640 1 --2- 172.21.15.177:0/2021296824 >> v2:172.21.15.195:3300/0 conn(0x7fc1740b3c70 0x7fc17415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:48.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.284+0000 7fc17951b640 1 -- 172.21.15.177:0/2021296824 >> v2:172.21.15.195:3300/0 conn(0x7fc1740b3c70 msgr2=0x7fc17415f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:48.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.284+0000 7fc17951b640 1 --2- 172.21.15.177:0/2021296824 >> v2:172.21.15.195:3300/0 conn(0x7fc1740b3c70 0x7fc17415f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.284+0000 7fc17951b640 1 -- 172.21.15.177:0/2021296824 >> v1:172.21.15.195:6789/0 conn(0x7fc1740b35b0 legacy=0x7fc1740cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:48.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.284+0000 7fc17951b640 1 -- 172.21.15.177:0/2021296824 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740d3ad0 con 0x7fc1740cfe90 2023-11-28T20:09:48.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.288+0000 7fc17951b640 1 --2- 172.21.15.177:0/2021296824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1740cfe90 0x7fc1740d0f50 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc1740d2ae0 tx=0x7fc16401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460c9423af724b36 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:48.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.288+0000 7fc178d1a640 1 -- 172.21.15.177:0/2021296824 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1640aa660 con 0x7fc1740cfe90 2023-11-28T20:09:48.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.288+0000 7fc178d1a640 1 -- 172.21.15.177:0/2021296824 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1640aa7c0 con 0x7fc1740cfe90 2023-11-28T20:09:48.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.288+0000 7fc178d1a640 1 -- 172.21.15.177:0/2021296824 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1640aab50 con 0x7fc1740cfe90 2023-11-28T20:09:48.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.288+0000 7fc17bf80640 1 -- 172.21.15.177:0/2021296824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1740cfe90 msgr2=0x7fc1740d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:48.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.288+0000 7fc17bf80640 1 --2- 172.21.15.177:0/2021296824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1740cfe90 0x7fc1740d0f50 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc1740d2ae0 tx=0x7fc16401c500 comp rx=0 tx=0).stop 2023-11-28T20:09:48.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.288+0000 7fc17bf80640 1 -- 172.21.15.177:0/2021296824 shutdown_connections 2023-11-28T20:09:48.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.288+0000 7fc17bf80640 1 --2- 172.21.15.177:0/2021296824 >> v2:172.21.15.195:3300/0 conn(0x7fc1740b3c70 0x7fc17415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.288+0000 7fc17bf80640 1 --2- 172.21.15.177:0/2021296824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1740cfe90 0x7fc1740d0f50 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.288+0000 7fc17bf80640 1 -- 172.21.15.177:0/2021296824 >> 172.21.15.177:0/2021296824 conn(0x7fc17409c4b0 msgr2=0x7fc1740d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:48.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.288+0000 7fc17bf80640 1 -- 172.21.15.177:0/2021296824 shutdown_connections 2023-11-28T20:09:48.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.288+0000 7fc17bf80640 1 -- 172.21.15.177:0/2021296824 wait complete. 2023-11-28T20:09:48.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17bf80640 1 Processor -- start 2023-11-28T20:09:48.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17bf80640 1 -- start start 2023-11-28T20:09:48.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17bf80640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1740b35b0 0x7fc1740b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:48.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17bf80640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1740b3c70 0x7fc17415b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:48.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17bf80640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1740cfe90 0x7fc174159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:48.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17bf80640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17415b670 con 0x7fc1740cfe90 2023-11-28T20:09:48.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17bf80640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17415b880 con 0x7fc1740b3c70 2023-11-28T20:09:48.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17bf80640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740ccb90 con 0x7fc1740b35b0 2023-11-28T20:09:48.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17a51d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1740cfe90 0x7fc174159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:48.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17a51d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1740cfe90 0x7fc174159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47906/0 (socket says 172.21.15.177:47906) 2023-11-28T20:09:48.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17a51d640 1 -- 172.21.15.177:0/3090458171 learned_addr learned my addr 172.21.15.177:0/3090458171 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:48.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc179d1c640 1 --2- 172.21.15.177:0/3090458171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1740b35b0 0x7fc1740b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:48.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17951b640 1 --2- 172.21.15.177:0/3090458171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1740b3c70 0x7fc17415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:48.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17a51d640 1 -- 172.21.15.177:0/3090458171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1740b35b0 msgr2=0x7fc1740b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:48.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17a51d640 1 --2- 172.21.15.177:0/3090458171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1740b35b0 0x7fc1740b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17a51d640 1 -- 172.21.15.177:0/3090458171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1740b3c70 msgr2=0x7fc17415b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:48.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17a51d640 1 --2- 172.21.15.177:0/3090458171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1740b3c70 0x7fc17415b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17a51d640 1 -- 172.21.15.177:0/3090458171 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1640094d0 con 0x7fc1740cfe90 2023-11-28T20:09:48.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17a51d640 1 --2- 172.21.15.177:0/3090458171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1740cfe90 0x7fc174159ba0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc16c007d90 tx=0x7fc16c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:48.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc16a7fc640 1 -- 172.21.15.177:0/3090458171 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c014420 con 0x7fc1740cfe90 2023-11-28T20:09:48.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc16a7fc640 1 -- 172.21.15.177:0/3090458171 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c0145a0 con 0x7fc1740cfe90 2023-11-28T20:09:48.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc16a7fc640 1 -- 172.21.15.177:0/3090458171 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c014950 con 0x7fc1740cfe90 2023-11-28T20:09:48.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17bf80640 1 -- 172.21.15.177:0/3090458171 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1740cbdd0 con 0x7fc1740cfe90 2023-11-28T20:09:48.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17bf80640 1 -- 172.21.15.177:0/3090458171 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1740cc390 con 0x7fc1740cfe90 2023-11-28T20:09:48.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.292+0000 7fc17bf80640 1 -- 172.21.15.177:0/3090458171 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc174069440 con 0x7fc1740cfe90 2023-11-28T20:09:48.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.296+0000 7fc16a7fc640 1 -- 172.21.15.177:0/3090458171 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc16c014ab0 con 0x7fc1740cfe90 2023-11-28T20:09:48.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.296+0000 7fc16a7fc640 1 --2- 172.21.15.177:0/3090458171 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc158066470 0x7fc158068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:48.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.296+0000 7fc16a7fc640 1 -- 172.21.15.177:0/3090458171 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc16c084720 con 0x7fc1740cfe90 2023-11-28T20:09:48.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.296+0000 7fc179d1c640 1 --2- 172.21.15.177:0/3090458171 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc158066470 0x7fc158068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:48.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.296+0000 7fc179d1c640 1 --2- 172.21.15.177:0/3090458171 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc158066470 0x7fc158068930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc170007fd0 tx=0x7fc170009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:48.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.300+0000 7fc16a7fc640 1 -- 172.21.15.177:0/3090458171 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc16c051bb0 con 0x7fc1740cfe90 2023-11-28T20:09:48.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.448+0000 7fc17bf80640 1 -- 172.21.15.177:0/3090458171 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1740b3990 con 0x7fc158066470 2023-11-28T20:09:48.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.452+0000 7fc16a7fc640 1 -- 172.21.15.177:0/3090458171 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283905 (secure 0 0 0) 0x7fc1700014f0 con 0x7fc158066470 2023-11-28T20:09:48.467 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:48.469 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:09:48.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.456+0000 7fc17bf80640 1 -- 172.21.15.177:0/3090458171 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc158066470 msgr2=0x7fc158068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:48.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.456+0000 7fc17bf80640 1 --2- 172.21.15.177:0/3090458171 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc158066470 0x7fc158068930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc170007fd0 tx=0x7fc170009040 comp rx=0 tx=0).stop 2023-11-28T20:09:48.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.456+0000 7fc17bf80640 1 -- 172.21.15.177:0/3090458171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1740cfe90 msgr2=0x7fc174159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:48.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.456+0000 7fc17bf80640 1 --2- 172.21.15.177:0/3090458171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1740cfe90 0x7fc174159ba0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc16c007d90 tx=0x7fc16c00e4b0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.456+0000 7fc17bf80640 1 -- 172.21.15.177:0/3090458171 shutdown_connections 2023-11-28T20:09:48.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.456+0000 7fc17bf80640 1 --2- 172.21.15.177:0/3090458171 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc158066470 0x7fc158068930 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.456+0000 7fc17bf80640 1 --2- 172.21.15.177:0/3090458171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1740cfe90 0x7fc174159ba0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.456+0000 7fc17bf80640 1 --2- 172.21.15.177:0/3090458171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1740b3c70 0x7fc17415b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.456+0000 7fc17bf80640 1 --2- 172.21.15.177:0/3090458171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1740b35b0 0x7fc1740b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.456+0000 7fc17bf80640 1 -- 172.21.15.177:0/3090458171 >> 172.21.15.177:0/3090458171 conn(0x7fc17409c4b0 msgr2=0x7fc1740cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:48.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.456+0000 7fc17bf80640 1 -- 172.21.15.177:0/3090458171 shutdown_connections 2023-11-28T20:09:48.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.456+0000 7fc17bf80640 1 -- 172.21.15.177:0/3090458171 wait complete. 2023-11-28T20:09:48.483 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-11-28T20:09:47.443010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242472,"kb_used_data":5500,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754732248,"statfs":{"total":773094113280,"available":772845821952,"internally_reserved":0,"allocated":5632000,"data_stored":3006477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.804330"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665732+0000","last_change":"2023-11-28T20:09:42.665732+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665732+0000","last_undegraded":"2023-11-28T20:09:42.665732+0000","last_fullsized":"2023-11-28T20:09:42.665732+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653516+0000","last_change":"2023-11-28T20:09:42.653516+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653516+0000","last_undegraded":"2023-11-28T20:09:42.653516+0000","last_fullsized":"2023-11-28T20:09:42.653516+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.671505+0000","last_change":"2023-11-28T20:09:42.671505+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.671505+0000","last_undegraded":"2023-11-28T20:09:42.671505+0000","last_fullsized":"2023-11-28T20:09:42.671505+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651363+0000","last_change":"2023-11-28T20:09:42.651363+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651363+0000","last_undegraded":"2023-11-28T20:09:42.651363+0000","last_fullsized":"2023-11-28T20:09:42.651363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657723+0000","last_change":"2023-11-28T20:09:42.657723+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657723+0000","last_undegraded":"2023-11-28T20:09:42.657723+0000","last_fullsized":"2023-11-28T20:09:42.657723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.667791+0000","last_change":"2023-11-28T20:09:42.667791+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.667791+0000","last_undegraded":"2023-11-28T20:09:42.667791+0000","last_fullsized":"2023-11-28T20:09:42.667791+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.671313+0000","last_change":"2023-11-28T20:09:42.671313+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.671313+0000","last_undegraded":"2023-11-28T20:09:42.671313+0000","last_fullsized":"2023-11-28T20:09:42.671313+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653717+0000","last_change":"2023-11-28T20:09:42.653717+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653717+0000","last_undegraded":"2023-11-28T20:09:42.653717+0000","last_fullsized":"2023-11-28T20:09:42.653717+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655070+0000","last_change":"2023-11-28T20:09:42.655070+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655070+0000","last_undegraded":"2023-11-28T20:09:42.655070+0000","last_fullsized":"2023-11-28T20:09:42.655070+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.661316+0000","last_change":"2023-11-28T20:09:42.661316+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.661316+0000","last_undegraded":"2023-11-28T20:09:42.661316+0000","last_fullsized":"2023-11-28T20:09:42.661316+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657445+0000","last_change":"2023-11-28T20:09:42.657445+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657445+0000","last_undegraded":"2023-11-28T20:09:42.657445+0000","last_fullsized":"2023-11-28T20:09:42.657445+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653436+0000","last_change":"2023-11-28T20:09:42.653436+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653436+0000","last_undegraded":"2023-11-28T20:09:42.653436+0000","last_fullsized":"2023-11-28T20:09:42.653436+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.666052+0000","last_change":"2023-11-28T20:09:42.666052+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.666052+0000","last_undegraded":"2023-11-28T20:09:42.666052+0000","last_fullsized":"2023-11-28T20:09:42.666052+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.669868+0000","last_change":"2023-11-28T20:09:42.669868+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.669868+0000","last_undegraded":"2023-11-28T20:09:42.669868+0000","last_fullsized":"2023-11-28T20:09:42.669868+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651748+0000","last_change":"2023-11-28T20:09:42.651748+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651748+0000","last_undegraded":"2023-11-28T20:09:42.651748+0000","last_fullsized":"2023-11-28T20:09:42.651748+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665343+0000","last_change":"2023-11-28T20:09:42.665343+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665343+0000","last_undegraded":"2023-11-28T20:09:42.665343+0000","last_fullsized":"2023-11-28T20:09:42.665343+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.669366+0000","last_change":"2023-11-28T20:09:42.669366+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.669366+0000","last_undegraded":"2023-11-28T20:09:42.669366+0000","last_fullsized":"2023-11-28T20:09:42.669366+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652918+0000","last_change":"2023-11-28T20:09:42.652918+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652918+0000","last_undegraded":"2023-11-28T20:09:42.652918+0000","last_fullsized":"2023-11-28T20:09:42.652918+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.666333+0000","last_change":"2023-11-28T20:09:42.666333+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.666333+0000","last_undegraded":"2023-11-28T20:09:42.666333+0000","last_fullsized":"2023-11-28T20:09:42.666333+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.660299+0000","last_change":"2023-11-28T20:09:42.660299+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.660299+0000","last_undegraded":"2023-11-28T20:09:42.660299+0000","last_fullsized":"2023-11-28T20:09:42.660299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.663550+0000","last_change":"2023-11-28T20:09:42.663550+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.663550+0000","last_undegraded":"2023-11-28T20:09:42.663550+0000","last_fullsized":"2023-11-28T20:09:42.663550+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652494+0000","last_change":"2023-11-28T20:09:42.652494+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652494+0000","last_undegraded":"2023-11-28T20:09:42.652494+0000","last_fullsized":"2023-11-28T20:09:42.652494+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656884+0000","last_change":"2023-11-28T20:09:42.656884+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656884+0000","last_undegraded":"2023-11-28T20:09:42.656884+0000","last_fullsized":"2023-11-28T20:09:42.656884+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.663670+0000","last_change":"2023-11-28T20:09:42.663670+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.663670+0000","last_undegraded":"2023-11-28T20:09:42.663670+0000","last_fullsized":"2023-11-28T20:09:42.663670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.663409+0000","last_change":"2023-11-28T20:09:42.663409+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.663409+0000","last_undegraded":"2023-11-28T20:09:42.663409+0000","last_fullsized":"2023-11-28T20:09:42.663409+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655654+0000","last_change":"2023-11-28T20:09:42.655654+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655654+0000","last_undegraded":"2023-11-28T20:09:42.655654+0000","last_fullsized":"2023-11-28T20:09:42.655654+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.658550+0000","last_change":"2023-11-28T20:09:42.658550+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.658550+0000","last_undegraded":"2023-11-28T20:09:42.658550+0000","last_fullsized":"2023-11-28T20:09:42.658550+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.658235+0000","last_change":"2023-11-28T20:09:42.658235+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.658235+0000","last_undegraded":"2023-11-28T20:09:42.658235+0000","last_fullsized":"2023-11-28T20:09:42.658235+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.662648+0000","last_change":"2023-11-28T20:09:42.662648+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.662648+0000","last_undegraded":"2023-11-28T20:09:42.662648+0000","last_fullsized":"2023-11-28T20:09:42.662648+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651286+0000","last_change":"2023-11-28T20:09:42.651286+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651286+0000","last_undegraded":"2023-11-28T20:09:42.651286+0000","last_fullsized":"2023-11-28T20:09:42.651286+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.662994+0000","last_change":"2023-11-28T20:09:42.662994+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.662994+0000","last_undegraded":"2023-11-28T20:09:42.662994+0000","last_fullsized":"2023-11-28T20:09:42.662994+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655851+0000","last_change":"2023-11-28T20:09:42.655851+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655851+0000","last_undegraded":"2023-11-28T20:09:42.655851+0000","last_fullsized":"2023-11-28T20:09:42.655851+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651779+0000","last_change":"2023-11-28T20:09:42.651779+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651779+0000","last_undegraded":"2023-11-28T20:09:42.651779+0000","last_fullsized":"2023-11-28T20:09:42.651779+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669340+0000","last_change":"2023-11-28T20:09:42.666794+0000","last_active":"2023-11-28T20:09:42.669340+0000","last_peered":"2023-11-28T20:09:42.669340+0000","last_clean":"2023-11-28T20:09:42.669340+0000","last_became_active":"2023-11-28T20:09:42.666513+0000","last_became_peered":"2023-11-28T20:09:42.666513+0000","last_unstale":"2023-11-28T20:09:42.669340+0000","last_undegraded":"2023-11-28T20:09:42.669340+0000","last_fullsized":"2023-11-28T20:09:42.669340+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:51:59.917389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.654974+0000","last_change":"2023-11-28T20:09:42.654974+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.654974+0000","last_undegraded":"2023-11-28T20:09:42.654974+0000","last_fullsized":"2023-11-28T20:09:42.654974+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.679490+0000","last_change":"2023-11-28T20:09:42.674692+0000","last_active":"2023-11-28T20:09:42.679490+0000","last_peered":"2023-11-28T20:09:42.679490+0000","last_clean":"2023-11-28T20:09:42.679490+0000","last_became_active":"2023-11-28T20:09:42.674364+0000","last_became_peered":"2023-11-28T20:09:42.674364+0000","last_unstale":"2023-11-28T20:09:42.679490+0000","last_undegraded":"2023-11-28T20:09:42.679490+0000","last_fullsized":"2023-11-28T20:09:42.679490+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:32:26.336595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657485+0000","last_change":"2023-11-28T20:09:42.657485+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657485+0000","last_undegraded":"2023-11-28T20:09:42.657485+0000","last_fullsized":"2023-11-28T20:09:42.657485+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677675+0000","last_change":"2023-11-28T20:09:42.670599+0000","last_active":"2023-11-28T20:09:42.677675+0000","last_peered":"2023-11-28T20:09:42.677675+0000","last_clean":"2023-11-28T20:09:42.677675+0000","last_became_active":"2023-11-28T20:09:42.670216+0000","last_became_peered":"2023-11-28T20:09:42.670216+0000","last_unstale":"2023-11-28T20:09:42.677675+0000","last_undegraded":"2023-11-28T20:09:42.677675+0000","last_fullsized":"2023-11-28T20:09:42.677675+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:15.217653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653400+0000","last_change":"2023-11-28T20:09:42.653400+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653400+0000","last_undegraded":"2023-11-28T20:09:42.653400+0000","last_fullsized":"2023-11-28T20:09:42.653400+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675698+0000","last_change":"2023-11-28T20:09:42.674101+0000","last_active":"2023-11-28T20:09:42.675698+0000","last_peered":"2023-11-28T20:09:42.675698+0000","last_clean":"2023-11-28T20:09:42.675698+0000","last_became_active":"2023-11-28T20:09:42.673725+0000","last_became_peered":"2023-11-28T20:09:42.673725+0000","last_unstale":"2023-11-28T20:09:42.675698+0000","last_undegraded":"2023-11-28T20:09:42.675698+0000","last_fullsized":"2023-11-28T20:09:42.675698+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:49.634142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656518+0000","last_change":"2023-11-28T20:09:42.656518+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656518+0000","last_undegraded":"2023-11-28T20:09:42.656518+0000","last_fullsized":"2023-11-28T20:09:42.656518+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.674971+0000","last_change":"2023-11-28T20:09:42.664506+0000","last_active":"2023-11-28T20:09:42.674971+0000","last_peered":"2023-11-28T20:09:42.674971+0000","last_clean":"2023-11-28T20:09:42.674971+0000","last_became_active":"2023-11-28T20:09:42.664199+0000","last_became_peered":"2023-11-28T20:09:42.664199+0000","last_unstale":"2023-11-28T20:09:42.674971+0000","last_undegraded":"2023-11-28T20:09:42.674971+0000","last_fullsized":"2023-11-28T20:09:42.674971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:32:26.336595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651336+0000","last_change":"2023-11-28T20:09:42.651336+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651336+0000","last_undegraded":"2023-11-28T20:09:42.651336+0000","last_fullsized":"2023-11-28T20:09:42.651336+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.671611+0000","last_change":"2023-11-28T20:09:42.670093+0000","last_active":"2023-11-28T20:09:42.671611+0000","last_peered":"2023-11-28T20:09:42.671611+0000","last_clean":"2023-11-28T20:09:42.671611+0000","last_became_active":"2023-11-28T20:09:42.669832+0000","last_became_peered":"2023-11-28T20:09:42.669832+0000","last_unstale":"2023-11-28T20:09:42.671611+0000","last_undegraded":"2023-11-28T20:09:42.671611+0000","last_fullsized":"2023-11-28T20:09:42.671611+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:17.280206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.654604+0000","last_change":"2023-11-28T20:09:42.654604+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.654604+0000","last_undegraded":"2023-11-28T20:09:42.654604+0000","last_fullsized":"2023-11-28T20:09:42.654604+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669576+0000","last_change":"2023-11-28T20:09:42.666410+0000","last_active":"2023-11-28T20:09:42.669576+0000","last_peered":"2023-11-28T20:09:42.669576+0000","last_clean":"2023-11-28T20:09:42.669576+0000","last_became_active":"2023-11-28T20:09:42.666065+0000","last_became_peered":"2023-11-28T20:09:42.666065+0000","last_unstale":"2023-11-28T20:09:42.669576+0000","last_undegraded":"2023-11-28T20:09:42.669576+0000","last_fullsized":"2023-11-28T20:09:42.669576+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:07:05.109326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652208+0000","last_change":"2023-11-28T20:09:42.652208+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652208+0000","last_undegraded":"2023-11-28T20:09:42.652208+0000","last_fullsized":"2023-11-28T20:09:42.652208+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677174+0000","last_change":"2023-11-28T20:09:42.671231+0000","last_active":"2023-11-28T20:09:42.677174+0000","last_peered":"2023-11-28T20:09:42.677174+0000","last_clean":"2023-11-28T20:09:42.677174+0000","last_became_active":"2023-11-28T20:09:42.670957+0000","last_became_peered":"2023-11-28T20:09:42.670957+0000","last_unstale":"2023-11-28T20:09:42.677174+0000","last_undegraded":"2023-11-28T20:09:42.677174+0000","last_fullsized":"2023-11-28T20:09:42.677174+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:44:35.411601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655348+0000","last_change":"2023-11-28T20:09:42.655348+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655348+0000","last_undegraded":"2023-11-28T20:09:42.655348+0000","last_fullsized":"2023-11-28T20:09:42.655348+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669018+0000","last_change":"2023-11-28T20:09:42.666932+0000","last_active":"2023-11-28T20:09:42.669018+0000","last_peered":"2023-11-28T20:09:42.669018+0000","last_clean":"2023-11-28T20:09:42.669018+0000","last_became_active":"2023-11-28T20:09:42.666671+0000","last_became_peered":"2023-11-28T20:09:42.666671+0000","last_unstale":"2023-11-28T20:09:42.669018+0000","last_undegraded":"2023-11-28T20:09:42.669018+0000","last_fullsized":"2023-11-28T20:09:42.669018+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:25.757605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655579+0000","last_change":"2023-11-28T20:09:42.655579+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655579+0000","last_undegraded":"2023-11-28T20:09:42.655579+0000","last_fullsized":"2023-11-28T20:09:42.655579+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.681208+0000","last_change":"2023-11-28T20:09:42.680303+0000","last_active":"2023-11-28T20:09:42.681208+0000","last_peered":"2023-11-28T20:09:42.681208+0000","last_clean":"2023-11-28T20:09:42.681208+0000","last_became_active":"2023-11-28T20:09:42.680028+0000","last_became_peered":"2023-11-28T20:09:42.680028+0000","last_unstale":"2023-11-28T20:09:42.681208+0000","last_undegraded":"2023-11-28T20:09:42.681208+0000","last_fullsized":"2023-11-28T20:09:42.681208+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:44:35.411601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656821+0000","last_change":"2023-11-28T20:09:42.656821+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656821+0000","last_undegraded":"2023-11-28T20:09:42.656821+0000","last_fullsized":"2023-11-28T20:09:42.656821+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675415+0000","last_change":"2023-11-28T20:09:42.674301+0000","last_active":"2023-11-28T20:09:42.675415+0000","last_peered":"2023-11-28T20:09:42.675415+0000","last_clean":"2023-11-28T20:09:42.675415+0000","last_became_active":"2023-11-28T20:09:42.673651+0000","last_became_peered":"2023-11-28T20:09:42.673651+0000","last_unstale":"2023-11-28T20:09:42.675415+0000","last_undegraded":"2023-11-28T20:09:42.675415+0000","last_fullsized":"2023-11-28T20:09:42.675415+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:48:37.397331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657154+0000","last_change":"2023-11-28T20:09:42.657154+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657154+0000","last_undegraded":"2023-11-28T20:09:42.657154+0000","last_fullsized":"2023-11-28T20:09:42.657154+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677439+0000","last_change":"2023-11-28T20:09:42.669553+0000","last_active":"2023-11-28T20:09:42.677439+0000","last_peered":"2023-11-28T20:09:42.677439+0000","last_clean":"2023-11-28T20:09:42.677439+0000","last_became_active":"2023-11-28T20:09:42.667456+0000","last_became_peered":"2023-11-28T20:09:42.667456+0000","last_unstale":"2023-11-28T20:09:42.677439+0000","last_undegraded":"2023-11-28T20:09:42.677439+0000","last_fullsized":"2023-11-28T20:09:42.677439+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:59.639535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656210+0000","last_change":"2023-11-28T20:09:42.656210+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656210+0000","last_undegraded":"2023-11-28T20:09:42.656210+0000","last_fullsized":"2023-11-28T20:09:42.656210+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.679813+0000","last_change":"2023-11-28T20:09:42.675080+0000","last_active":"2023-11-28T20:09:42.679813+0000","last_peered":"2023-11-28T20:09:42.679813+0000","last_clean":"2023-11-28T20:09:42.679813+0000","last_became_active":"2023-11-28T20:09:42.674739+0000","last_became_peered":"2023-11-28T20:09:42.674739+0000","last_unstale":"2023-11-28T20:09:42.679813+0000","last_undegraded":"2023-11-28T20:09:42.679813+0000","last_fullsized":"2023-11-28T20:09:42.679813+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:35.259118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656222+0000","last_change":"2023-11-28T20:09:42.656222+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656222+0000","last_undegraded":"2023-11-28T20:09:42.656222+0000","last_fullsized":"2023-11-28T20:09:42.656222+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676458+0000","last_change":"2023-11-28T20:09:42.675061+0000","last_active":"2023-11-28T20:09:42.676458+0000","last_peered":"2023-11-28T20:09:42.676458+0000","last_clean":"2023-11-28T20:09:42.676458+0000","last_became_active":"2023-11-28T20:09:42.674720+0000","last_became_peered":"2023-11-28T20:09:42.674720+0000","last_unstale":"2023-11-28T20:09:42.676458+0000","last_undegraded":"2023-11-28T20:09:42.676458+0000","last_fullsized":"2023-11-28T20:09:42.676458+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:42.147183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655167+0000","last_change":"2023-11-28T20:09:42.655167+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655167+0000","last_undegraded":"2023-11-28T20:09:42.655167+0000","last_fullsized":"2023-11-28T20:09:42.655167+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669881+0000","last_change":"2023-11-28T20:09:42.668166+0000","last_active":"2023-11-28T20:09:42.669881+0000","last_peered":"2023-11-28T20:09:42.669881+0000","last_clean":"2023-11-28T20:09:42.669881+0000","last_became_active":"2023-11-28T20:09:42.666450+0000","last_became_peered":"2023-11-28T20:09:42.666450+0000","last_unstale":"2023-11-28T20:09:42.669881+0000","last_undegraded":"2023-11-28T20:09:42.669881+0000","last_fullsized":"2023-11-28T20:09:42.669881+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:51.354290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.662115+0000","last_change":"2023-11-28T20:09:42.662115+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.662115+0000","last_undegraded":"2023-11-28T20:09:42.662115+0000","last_fullsized":"2023-11-28T20:09:42.662115+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.674322+0000","last_change":"2023-11-28T20:09:42.667815+0000","last_active":"2023-11-28T20:09:42.674322+0000","last_peered":"2023-11-28T20:09:42.674322+0000","last_clean":"2023-11-28T20:09:42.674322+0000","last_became_active":"2023-11-28T20:09:42.667502+0000","last_became_peered":"2023-11-28T20:09:42.667502+0000","last_unstale":"2023-11-28T20:09:42.674322+0000","last_undegraded":"2023-11-28T20:09:42.674322+0000","last_fullsized":"2023-11-28T20:09:42.674322+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:50.363442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652373+0000","last_change":"2023-11-28T20:09:42.652373+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652373+0000","last_undegraded":"2023-11-28T20:09:42.652373+0000","last_fullsized":"2023-11-28T20:09:42.652373+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.678297+0000","last_change":"2023-11-28T20:09:42.673577+0000","last_active":"2023-11-28T20:09:42.678297+0000","last_peered":"2023-11-28T20:09:42.678297+0000","last_clean":"2023-11-28T20:09:42.678297+0000","last_became_active":"2023-11-28T20:09:42.673263+0000","last_became_peered":"2023-11-28T20:09:42.673263+0000","last_unstale":"2023-11-28T20:09:42.678297+0000","last_undegraded":"2023-11-28T20:09:42.678297+0000","last_fullsized":"2023-11-28T20:09:42.678297+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:17.507022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.664092+0000","last_change":"2023-11-28T20:09:42.664092+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.664092+0000","last_undegraded":"2023-11-28T20:09:42.664092+0000","last_fullsized":"2023-11-28T20:09:42.664092+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675461+0000","last_change":"2023-11-28T20:09:42.666698+0000","last_active":"2023-11-28T20:09:42.675461+0000","last_peered":"2023-11-28T20:09:42.675461+0000","last_clean":"2023-11-28T20:09:42.675461+0000","last_became_active":"2023-11-28T20:09:42.666428+0000","last_became_peered":"2023-11-28T20:09:42.666428+0000","last_unstale":"2023-11-28T20:09:42.675461+0000","last_undegraded":"2023-11-28T20:09:42.675461+0000","last_fullsized":"2023-11-28T20:09:42.675461+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:45:52.810926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656322+0000","last_change":"2023-11-28T20:09:42.656322+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656322+0000","last_undegraded":"2023-11-28T20:09:42.656322+0000","last_fullsized":"2023-11-28T20:09:42.656322+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.674525+0000","last_change":"2023-11-28T20:09:42.672595+0000","last_active":"2023-11-28T20:09:42.674525+0000","last_peered":"2023-11-28T20:09:42.674525+0000","last_clean":"2023-11-28T20:09:42.674525+0000","last_became_active":"2023-11-28T20:09:42.672270+0000","last_became_peered":"2023-11-28T20:09:42.672270+0000","last_unstale":"2023-11-28T20:09:42.674525+0000","last_undegraded":"2023-11-28T20:09:42.674525+0000","last_fullsized":"2023-11-28T20:09:42.674525+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:48.596264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.664887+0000","last_change":"2023-11-28T20:09:42.664887+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.664887+0000","last_undegraded":"2023-11-28T20:09:42.664887+0000","last_fullsized":"2023-11-28T20:09:42.664887+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676982+0000","last_change":"2023-11-28T20:09:42.675538+0000","last_active":"2023-11-28T20:09:42.676982+0000","last_peered":"2023-11-28T20:09:42.676982+0000","last_clean":"2023-11-28T20:09:42.676982+0000","last_became_active":"2023-11-28T20:09:42.675139+0000","last_became_peered":"2023-11-28T20:09:42.675139+0000","last_unstale":"2023-11-28T20:09:42.676982+0000","last_undegraded":"2023-11-28T20:09:42.676982+0000","last_fullsized":"2023-11-28T20:09:42.676982+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:08.633227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655761+0000","last_change":"2023-11-28T20:09:42.655761+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655761+0000","last_undegraded":"2023-11-28T20:09:42.655761+0000","last_fullsized":"2023-11-28T20:09:42.655761+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.673712+0000","last_change":"2023-11-28T20:09:42.668264+0000","last_active":"2023-11-28T20:09:42.673712+0000","last_peered":"2023-11-28T20:09:42.673712+0000","last_clean":"2023-11-28T20:09:42.673712+0000","last_became_active":"2023-11-28T20:09:42.667948+0000","last_became_peered":"2023-11-28T20:09:42.667948+0000","last_unstale":"2023-11-28T20:09:42.673712+0000","last_undegraded":"2023-11-28T20:09:42.673712+0000","last_fullsized":"2023-11-28T20:09:42.673712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:24:57.386846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.661047+0000","last_change":"2023-11-28T20:09:42.661047+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.661047+0000","last_undegraded":"2023-11-28T20:09:42.661047+0000","last_fullsized":"2023-11-28T20:09:42.661047+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.673371+0000","last_change":"2023-11-28T20:09:42.660838+0000","last_active":"2023-11-28T20:09:42.673371+0000","last_peered":"2023-11-28T20:09:42.673371+0000","last_clean":"2023-11-28T20:09:42.673371+0000","last_became_active":"2023-11-28T20:09:42.660549+0000","last_became_peered":"2023-11-28T20:09:42.660549+0000","last_unstale":"2023-11-28T20:09:42.673371+0000","last_undegraded":"2023-11-28T20:09:42.673371+0000","last_fullsized":"2023-11-28T20:09:42.673371+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:08:58.244467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655535+0000","last_change":"2023-11-28T20:09:42.655535+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655535+0000","last_undegraded":"2023-11-28T20:09:42.655535+0000","last_fullsized":"2023-11-28T20:09:42.655535+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.680719+0000","last_change":"2023-11-28T20:09:42.678274+0000","last_active":"2023-11-28T20:09:42.680719+0000","last_peered":"2023-11-28T20:09:42.680719+0000","last_clean":"2023-11-28T20:09:42.680719+0000","last_became_active":"2023-11-28T20:09:42.677974+0000","last_became_peered":"2023-11-28T20:09:42.677974+0000","last_unstale":"2023-11-28T20:09:42.680719+0000","last_undegraded":"2023-11-28T20:09:42.680719+0000","last_fullsized":"2023-11-28T20:09:42.680719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:15.217653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665153+0000","last_change":"2023-11-28T20:09:42.665153+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665153+0000","last_undegraded":"2023-11-28T20:09:42.665153+0000","last_fullsized":"2023-11-28T20:09:42.665153+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675534+0000","last_change":"2023-11-28T20:09:42.664555+0000","last_active":"2023-11-28T20:09:42.675534+0000","last_peered":"2023-11-28T20:09:42.675534+0000","last_clean":"2023-11-28T20:09:42.675534+0000","last_became_active":"2023-11-28T20:09:42.663496+0000","last_became_peered":"2023-11-28T20:09:42.663496+0000","last_unstale":"2023-11-28T20:09:42.675534+0000","last_undegraded":"2023-11-28T20:09:42.675534+0000","last_fullsized":"2023-11-28T20:09:42.675534+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:54:38.995754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655397+0000","last_change":"2023-11-28T20:09:42.655397+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655397+0000","last_undegraded":"2023-11-28T20:09:42.655397+0000","last_fullsized":"2023-11-28T20:09:42.655397+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677759+0000","last_change":"2023-11-28T20:09:42.676899+0000","last_active":"2023-11-28T20:09:42.677759+0000","last_peered":"2023-11-28T20:09:42.677759+0000","last_clean":"2023-11-28T20:09:42.677759+0000","last_became_active":"2023-11-28T20:09:42.676592+0000","last_became_peered":"2023-11-28T20:09:42.676592+0000","last_unstale":"2023-11-28T20:09:42.677759+0000","last_undegraded":"2023-11-28T20:09:42.677759+0000","last_fullsized":"2023-11-28T20:09:42.677759+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:19:24.863349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665542+0000","last_change":"2023-11-28T20:09:42.665542+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665542+0000","last_undegraded":"2023-11-28T20:09:42.665542+0000","last_fullsized":"2023-11-28T20:09:42.665542+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676170+0000","last_change":"2023-11-28T20:09:42.675569+0000","last_active":"2023-11-28T20:09:42.676170+0000","last_peered":"2023-11-28T20:09:42.676170+0000","last_clean":"2023-11-28T20:09:42.676170+0000","last_became_active":"2023-11-28T20:09:42.675111+0000","last_became_peered":"2023-11-28T20:09:42.675111+0000","last_unstale":"2023-11-28T20:09:42.676170+0000","last_undegraded":"2023-11-28T20:09:42.676170+0000","last_fullsized":"2023-11-28T20:09:42.676170+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:18.357434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652625+0000","last_change":"2023-11-28T20:09:42.652625+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652625+0000","last_undegraded":"2023-11-28T20:09:42.652625+0000","last_fullsized":"2023-11-28T20:09:42.652625+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.680754+0000","last_change":"2023-11-28T20:09:42.678609+0000","last_active":"2023-11-28T20:09:42.680754+0000","last_peered":"2023-11-28T20:09:42.680754+0000","last_clean":"2023-11-28T20:09:42.680754+0000","last_became_active":"2023-11-28T20:09:42.677536+0000","last_became_peered":"2023-11-28T20:09:42.677536+0000","last_unstale":"2023-11-28T20:09:42.680754+0000","last_undegraded":"2023-11-28T20:09:42.680754+0000","last_fullsized":"2023-11-28T20:09:42.680754+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:23.158269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.658790+0000","last_change":"2023-11-28T20:09:42.658790+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.658790+0000","last_undegraded":"2023-11-28T20:09:42.658790+0000","last_fullsized":"2023-11-28T20:09:42.658790+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676514+0000","last_change":"2023-11-28T20:09:42.669065+0000","last_active":"2023-11-28T20:09:42.676514+0000","last_peered":"2023-11-28T20:09:42.676514+0000","last_clean":"2023-11-28T20:09:42.676514+0000","last_became_active":"2023-11-28T20:09:42.668745+0000","last_became_peered":"2023-11-28T20:09:42.668745+0000","last_unstale":"2023-11-28T20:09:42.676514+0000","last_undegraded":"2023-11-28T20:09:42.676514+0000","last_fullsized":"2023-11-28T20:09:42.676514+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:11.506826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657749+0000","last_change":"2023-11-28T20:09:42.657749+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657749+0000","last_undegraded":"2023-11-28T20:09:42.657749+0000","last_fullsized":"2023-11-28T20:09:42.657749+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676636+0000","last_change":"2023-11-28T20:09:42.671311+0000","last_active":"2023-11-28T20:09:42.676636+0000","last_peered":"2023-11-28T20:09:42.676636+0000","last_clean":"2023-11-28T20:09:42.676636+0000","last_became_active":"2023-11-28T20:09:42.671023+0000","last_became_peered":"2023-11-28T20:09:42.671023+0000","last_unstale":"2023-11-28T20:09:42.676636+0000","last_undegraded":"2023-11-28T20:09:42.676636+0000","last_fullsized":"2023-11-28T20:09:42.676636+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:12.823637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656090+0000","last_change":"2023-11-28T20:09:42.656090+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656090+0000","last_undegraded":"2023-11-28T20:09:42.656090+0000","last_fullsized":"2023-11-28T20:09:42.656090+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675522+0000","last_change":"2023-11-28T20:09:42.673420+0000","last_active":"2023-11-28T20:09:42.675522+0000","last_peered":"2023-11-28T20:09:42.675522+0000","last_clean":"2023-11-28T20:09:42.675522+0000","last_became_active":"2023-11-28T20:09:42.673075+0000","last_became_peered":"2023-11-28T20:09:42.673075+0000","last_unstale":"2023-11-28T20:09:42.675522+0000","last_undegraded":"2023-11-28T20:09:42.675522+0000","last_fullsized":"2023-11-28T20:09:42.675522+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:49:07.928868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.654549+0000","last_change":"2023-11-28T20:09:42.654549+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.654549+0000","last_undegraded":"2023-11-28T20:09:42.654549+0000","last_fullsized":"2023-11-28T20:09:42.654549+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669078+0000","last_change":"2023-11-28T20:09:42.667295+0000","last_active":"2023-11-28T20:09:42.669078+0000","last_peered":"2023-11-28T20:09:42.669078+0000","last_clean":"2023-11-28T20:09:42.669078+0000","last_became_active":"2023-11-28T20:09:42.666932+0000","last_became_peered":"2023-11-28T20:09:42.666932+0000","last_unstale":"2023-11-28T20:09:42.669078+0000","last_undegraded":"2023-11-28T20:09:42.669078+0000","last_fullsized":"2023-11-28T20:09:42.669078+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:39.371885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655863+0000","last_change":"2023-11-28T20:09:42.655863+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655863+0000","last_undegraded":"2023-11-28T20:09:42.655863+0000","last_fullsized":"2023-11-28T20:09:42.655863+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.679019+0000","last_change":"2023-11-28T20:09:42.674280+0000","last_active":"2023-11-28T20:09:42.679019+0000","last_peered":"2023-11-28T20:09:42.679019+0000","last_clean":"2023-11-28T20:09:42.679019+0000","last_became_active":"2023-11-28T20:09:42.673979+0000","last_became_peered":"2023-11-28T20:09:42.673979+0000","last_unstale":"2023-11-28T20:09:42.679019+0000","last_undegraded":"2023-11-28T20:09:42.679019+0000","last_fullsized":"2023-11-28T20:09:42.679019+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:24:57.386846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":189,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T20:09:41.647031+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:09:41.647031+0000","last_peered":"2023-11-28T20:09:41.647031+0000","last_clean":"2023-11-28T20:09:41.647031+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:09:41.647031+0000","last_undegraded":"2023-11-28T20:09:41.647031+0000","last_fullsized":"2023-11-28T20:09:41.647031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1150976,"data_stored":819370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.438,"5min":0.313,"15min":0.313},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.56200000000000006,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.032,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.70699999999999996}]},{"osd":1,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.65400000000000003},"min":{"1min":0.49199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94399999999999995,"5min":1.161,"15min":1.161},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0009999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97899999999999998,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.60299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61899999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0209999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.68799999999999994}]},{"osd":4,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.44500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.505,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.63800000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.48799999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.502},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.495,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.76200000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.58899999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.054,"5min":1.272,"15min":1.272},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.79200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.44500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.80800000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.69999999999999996,"15min":0.68500000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.748,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.79200000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.65400000000000003},"min":{"1min":0.501,"5min":0.498,"15min":0.498},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.60999999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5819999999999999,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.125,"5min":1.357,"15min":1.357},"last":0.75},{"interface":"front","average":{"1min":1.006,"5min":0.80600000000000005,"15min":0.77200000000000002},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":6.2249999999999996,"5min":6.2249999999999996,"15min":6.2249999999999996},"last":0.70199999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.0789999999999997,"5min":4.0789999999999997,"15min":4.0789999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":0.81899999999999995,"15min":0.77700000000000002},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":8.6159999999999997,"5min":8.6159999999999997,"15min":8.6159999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.83299999999999996,"15min":0.82099999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.81799999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.84399999999999997,"15min":0.84199999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.86199999999999999,"15min":0.85799999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.72899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.78900000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61199999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.629},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65900000000000003,"15min":0.66000000000000003},"min":{"1min":0.47199999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.879,"5min":1.083,"15min":1.083},"last":0.66200000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.052,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69799999999999995,"15min":0.70099999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84399999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73299999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65300000000000002,"15min":0.66200000000000003},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.503},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81299999999999994,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70299999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77800000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82999999999999996,"5min":0.997,"15min":0.997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92400000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.749}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67900000000000005,"15min":0.68600000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.78100000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.751},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71399999999999997,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85599999999999998,"5min":1.361,"15min":1.361},"last":0.76500000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68799999999999994},"min":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.81799999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.79500000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86899999999999999,"5min":1.04,"15min":1.04},"last":0.83199999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.56699999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.83999999999999997,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88100000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.45400000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85699999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":1.038,"15min":1.038},"last":0.59599999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.84299999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.91400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93100000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.86099999999999999,"15min":0.877},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98899999999999999,"5min":1.353,"15min":1.353},"last":0.63500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.02,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.68100000000000005,"15min":0.72199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76000000000000001,"5min":6.016,"15min":6.016},"last":0.29299999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2170000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.40600000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94799999999999995,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.44},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0549999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.49299999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0009999999999999,"5min":5.8810000000000002,"15min":5.8810000000000002},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.038,"5min":1.405,"15min":1.405},"last":0.92400000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79800000000000004,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.119,"5min":1.585,"15min":1.585},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.97299999999999998,"15min":1.0129999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.042,"5min":5.9349999999999996,"15min":5.9349999999999996},"last":0.84699999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95699999999999996,"5min":1.361,"15min":1.361},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.55500000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0900000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.90300000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.94999999999999996,"15min":0.98799999999999999},"min":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.262,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0620000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.88200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.80800000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.442},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.54300000000000004,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.626}]},{"osd":1,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.3140000000000001,"5min":5.3140000000000001,"15min":5.3140000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":3.7650000000000001,"5min":3.7650000000000001,"15min":3.7650000000000001},"last":0.502}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":5.3460000000000001,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.54500000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3580000000000001,"5min":1.415,"15min":1.415},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.81699999999999995,"15min":0.80700000000000005},"min":{"1min":0.54500000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.8090000000000002,"5min":3.8090000000000002,"15min":3.8090000000000002},"last":0.79100000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.2809999999999997,"5min":5.2809999999999997,"15min":5.2809999999999997},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88800000000000001,"15min":0.88400000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.5369999999999999,"5min":4.5369999999999999,"15min":4.5369999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.88700000000000001,"15min":0.86599999999999999},"min":{"1min":0.56799999999999995,"5min":0.496,"15min":0.496},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.84499999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.88,"15min":0.874},"min":{"1min":0.56999999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":3.863,"5min":3.863,"15min":3.863},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.90300000000000002,"15min":0.88600000000000001},"min":{"1min":0.627,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":5.2460000000000004,"5min":5.2460000000000004,"15min":5.2460000000000004},"last":0.81499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":544768,"data_stored":222727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.60499999999999998,"15min":0.63900000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.627,"15min":0.66100000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.58199999999999996}]},{"osd":2,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.64800000000000002,"15min":0.68300000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79900000000000004,"5min":4.9909999999999997,"15min":4.9909999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.68100000000000005,"15min":0.71899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56699999999999995,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.39000000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":1.389,"15min":1.389},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.67000000000000004,"15min":0.70399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.48599999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.503,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":1.145,"15min":1.145},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.93500000000000005,"15min":0.96599999999999997},"min":{"1min":0.59899999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90600000000000003,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":1.321}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.91400000000000003,"15min":0.95499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90600000000000003,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":0.748},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.89100000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.232}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.94799999999999995,"15min":0.99099999999999999},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.89800000000000002,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.80900000000000005,"15min":0.81799999999999995},"min":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.92400000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.3069999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0009999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.94699999999999995,"15min":0.98499999999999999},"min":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.93100000000000005,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":1.2509999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1150976,"data_stored":819370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.50700000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.753,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59299999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.48799999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.998,"5min":1.052,"15min":1.052},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92100000000000004,"5min":1.006,"15min":1.006},"last":0.80000000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88900000000000001,"5min":1.524,"15min":1.524},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.97999999999999998,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70199999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.624,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.84199999999999997,"5min":1.214,"15min":1.214},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97399999999999998,"5min":1.415,"15min":1.415},"last":0.77000000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95599999999999996,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93899999999999995,"5min":1.099,"15min":1.099},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:09:48.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2023-11-28T20:09:48.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.665732+0000', 'last_change': '2023-11-28T20:09:42.665732+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.665732+0000', 'last_undegraded': '2023-11-28T20:09:42.665732+0000', 'last_fullsized': '2023-11-28T20:09:42.665732+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:09:48.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-11-28T20:09:48.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.653516+0000', 'last_change': '2023-11-28T20:09:42.653516+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.653516+0000', 'last_undegraded': '2023-11-28T20:09:42.653516+0000', 'last_fullsized': '2023-11-28T20:09:42.653516+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:09:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-11-28T20:09:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.671505+0000', 'last_change': '2023-11-28T20:09:42.671505+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.671505+0000', 'last_undegraded': '2023-11-28T20:09:42.671505+0000', 'last_fullsized': '2023-11-28T20:09:42.671505+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:09:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2023-11-28T20:09:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.651363+0000', 'last_change': '2023-11-28T20:09:42.651363+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.651363+0000', 'last_undegraded': '2023-11-28T20:09:42.651363+0000', 'last_fullsized': '2023-11-28T20:09:42.651363+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:09:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-11-28T20:09:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.657723+0000', 'last_change': '2023-11-28T20:09:42.657723+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.657723+0000', 'last_undegraded': '2023-11-28T20:09:42.657723+0000', 'last_fullsized': '2023-11-28T20:09:42.657723+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:09:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2023-11-28T20:09:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.667791+0000', 'last_change': '2023-11-28T20:09:42.667791+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.667791+0000', 'last_undegraded': '2023-11-28T20:09:42.667791+0000', 'last_fullsized': '2023-11-28T20:09:42.667791+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:09:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-11-28T20:09:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.671313+0000', 'last_change': '2023-11-28T20:09:42.671313+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.671313+0000', 'last_undegraded': '2023-11-28T20:09:42.671313+0000', 'last_fullsized': '2023-11-28T20:09:42.671313+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:09:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-11-28T20:09:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.653717+0000', 'last_change': '2023-11-28T20:09:42.653717+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.653717+0000', 'last_undegraded': '2023-11-28T20:09:42.653717+0000', 'last_fullsized': '2023-11-28T20:09:42.653717+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:09:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-11-28T20:09:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.655070+0000', 'last_change': '2023-11-28T20:09:42.655070+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.655070+0000', 'last_undegraded': '2023-11-28T20:09:42.655070+0000', 'last_fullsized': '2023-11-28T20:09:42.655070+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:09:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2023-11-28T20:09:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.661316+0000', 'last_change': '2023-11-28T20:09:42.661316+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.661316+0000', 'last_undegraded': '2023-11-28T20:09:42.661316+0000', 'last_fullsized': '2023-11-28T20:09:42.661316+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:09:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2023-11-28T20:09:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.657445+0000', 'last_change': '2023-11-28T20:09:42.657445+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.657445+0000', 'last_undegraded': '2023-11-28T20:09:42.657445+0000', 'last_fullsized': '2023-11-28T20:09:42.657445+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:09:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-11-28T20:09:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.653436+0000', 'last_change': '2023-11-28T20:09:42.653436+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.653436+0000', 'last_undegraded': '2023-11-28T20:09:42.653436+0000', 'last_fullsized': '2023-11-28T20:09:42.653436+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:09:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2023-11-28T20:09:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.666052+0000', 'last_change': '2023-11-28T20:09:42.666052+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.666052+0000', 'last_undegraded': '2023-11-28T20:09:42.666052+0000', 'last_fullsized': '2023-11-28T20:09:42.666052+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:09:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2023-11-28T20:09:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.669868+0000', 'last_change': '2023-11-28T20:09:42.669868+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.669868+0000', 'last_undegraded': '2023-11-28T20:09:42.669868+0000', 'last_fullsized': '2023-11-28T20:09:42.669868+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:09:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2023-11-28T20:09:48.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.651748+0000', 'last_change': '2023-11-28T20:09:42.651748+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.651748+0000', 'last_undegraded': '2023-11-28T20:09:42.651748+0000', 'last_fullsized': '2023-11-28T20:09:42.651748+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:09:48.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2023-11-28T20:09:48.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.665343+0000', 'last_change': '2023-11-28T20:09:42.665343+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.665343+0000', 'last_undegraded': '2023-11-28T20:09:42.665343+0000', 'last_fullsized': '2023-11-28T20:09:42.665343+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:09:48.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2023-11-28T20:09:48.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.669366+0000', 'last_change': '2023-11-28T20:09:42.669366+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.669366+0000', 'last_undegraded': '2023-11-28T20:09:42.669366+0000', 'last_fullsized': '2023-11-28T20:09:42.669366+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:09:48.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2023-11-28T20:09:48.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.652918+0000', 'last_change': '2023-11-28T20:09:42.652918+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.652918+0000', 'last_undegraded': '2023-11-28T20:09:42.652918+0000', 'last_fullsized': '2023-11-28T20:09:42.652918+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:09:48.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-11-28T20:09:48.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.666333+0000', 'last_change': '2023-11-28T20:09:42.666333+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.666333+0000', 'last_undegraded': '2023-11-28T20:09:42.666333+0000', 'last_fullsized': '2023-11-28T20:09:42.666333+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:09:48.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-11-28T20:09:48.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.660299+0000', 'last_change': '2023-11-28T20:09:42.660299+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.660299+0000', 'last_undegraded': '2023-11-28T20:09:42.660299+0000', 'last_fullsized': '2023-11-28T20:09:42.660299+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:09:48.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-11-28T20:09:48.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.663550+0000', 'last_change': '2023-11-28T20:09:42.663550+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.663550+0000', 'last_undegraded': '2023-11-28T20:09:42.663550+0000', 'last_fullsized': '2023-11-28T20:09:42.663550+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:09:48.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-11-28T20:09:48.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.652494+0000', 'last_change': '2023-11-28T20:09:42.652494+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.652494+0000', 'last_undegraded': '2023-11-28T20:09:42.652494+0000', 'last_fullsized': '2023-11-28T20:09:42.652494+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:09:48.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-11-28T20:09:48.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.656884+0000', 'last_change': '2023-11-28T20:09:42.656884+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.656884+0000', 'last_undegraded': '2023-11-28T20:09:42.656884+0000', 'last_fullsized': '2023-11-28T20:09:42.656884+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:09:48.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-11-28T20:09:48.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.663670+0000', 'last_change': '2023-11-28T20:09:42.663670+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.663670+0000', 'last_undegraded': '2023-11-28T20:09:42.663670+0000', 'last_fullsized': '2023-11-28T20:09:42.663670+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:09:48.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2023-11-28T20:09:48.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.663409+0000', 'last_change': '2023-11-28T20:09:42.663409+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.663409+0000', 'last_undegraded': '2023-11-28T20:09:42.663409+0000', 'last_fullsized': '2023-11-28T20:09:42.663409+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:09:48.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-11-28T20:09:48.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.655654+0000', 'last_change': '2023-11-28T20:09:42.655654+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.655654+0000', 'last_undegraded': '2023-11-28T20:09:42.655654+0000', 'last_fullsized': '2023-11-28T20:09:42.655654+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:09:48.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2023-11-28T20:09:48.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.658550+0000', 'last_change': '2023-11-28T20:09:42.658550+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.658550+0000', 'last_undegraded': '2023-11-28T20:09:42.658550+0000', 'last_fullsized': '2023-11-28T20:09:42.658550+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:09:48.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-11-28T20:09:48.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.658235+0000', 'last_change': '2023-11-28T20:09:42.658235+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.658235+0000', 'last_undegraded': '2023-11-28T20:09:42.658235+0000', 'last_fullsized': '2023-11-28T20:09:42.658235+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:09:48.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2023-11-28T20:09:48.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.662648+0000', 'last_change': '2023-11-28T20:09:42.662648+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.662648+0000', 'last_undegraded': '2023-11-28T20:09:42.662648+0000', 'last_fullsized': '2023-11-28T20:09:42.662648+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:09:48.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-11-28T20:09:48.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.651286+0000', 'last_change': '2023-11-28T20:09:42.651286+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.651286+0000', 'last_undegraded': '2023-11-28T20:09:42.651286+0000', 'last_fullsized': '2023-11-28T20:09:42.651286+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:09:48.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-11-28T20:09:48.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.662994+0000', 'last_change': '2023-11-28T20:09:42.662994+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.662994+0000', 'last_undegraded': '2023-11-28T20:09:42.662994+0000', 'last_fullsized': '2023-11-28T20:09:42.662994+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:09:48.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2023-11-28T20:09:48.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.655851+0000', 'last_change': '2023-11-28T20:09:42.655851+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.655851+0000', 'last_undegraded': '2023-11-28T20:09:42.655851+0000', 'last_fullsized': '2023-11-28T20:09:42.655851+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:09:48.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-11-28T20:09:48.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.651779+0000', 'last_change': '2023-11-28T20:09:42.651779+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.651779+0000', 'last_undegraded': '2023-11-28T20:09:42.651779+0000', 'last_fullsized': '2023-11-28T20:09:42.651779+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:09:48.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-11-28T20:09:48.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.654974+0000', 'last_change': '2023-11-28T20:09:42.654974+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.654974+0000', 'last_undegraded': '2023-11-28T20:09:42.654974+0000', 'last_fullsized': '2023-11-28T20:09:42.654974+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:09:48.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-11-28T20:09:48.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.657485+0000', 'last_change': '2023-11-28T20:09:42.657485+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.657485+0000', 'last_undegraded': '2023-11-28T20:09:42.657485+0000', 'last_fullsized': '2023-11-28T20:09:42.657485+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:09:48.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-11-28T20:09:48.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.653400+0000', 'last_change': '2023-11-28T20:09:42.653400+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.653400+0000', 'last_undegraded': '2023-11-28T20:09:42.653400+0000', 'last_fullsized': '2023-11-28T20:09:42.653400+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:09:48.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-11-28T20:09:48.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.656518+0000', 'last_change': '2023-11-28T20:09:42.656518+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.656518+0000', 'last_undegraded': '2023-11-28T20:09:42.656518+0000', 'last_fullsized': '2023-11-28T20:09:42.656518+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:09:48.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-11-28T20:09:48.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.651336+0000', 'last_change': '2023-11-28T20:09:42.651336+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.651336+0000', 'last_undegraded': '2023-11-28T20:09:42.651336+0000', 'last_fullsized': '2023-11-28T20:09:42.651336+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:09:48.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-11-28T20:09:48.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.654604+0000', 'last_change': '2023-11-28T20:09:42.654604+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.654604+0000', 'last_undegraded': '2023-11-28T20:09:42.654604+0000', 'last_fullsized': '2023-11-28T20:09:42.654604+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:09:48.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-11-28T20:09:48.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.652208+0000', 'last_change': '2023-11-28T20:09:42.652208+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.652208+0000', 'last_undegraded': '2023-11-28T20:09:42.652208+0000', 'last_fullsized': '2023-11-28T20:09:42.652208+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:09:48.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-11-28T20:09:48.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.655348+0000', 'last_change': '2023-11-28T20:09:42.655348+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.655348+0000', 'last_undegraded': '2023-11-28T20:09:42.655348+0000', 'last_fullsized': '2023-11-28T20:09:42.655348+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:09:48.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-11-28T20:09:48.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.655579+0000', 'last_change': '2023-11-28T20:09:42.655579+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.655579+0000', 'last_undegraded': '2023-11-28T20:09:42.655579+0000', 'last_fullsized': '2023-11-28T20:09:42.655579+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:09:48.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-11-28T20:09:48.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.656821+0000', 'last_change': '2023-11-28T20:09:42.656821+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.656821+0000', 'last_undegraded': '2023-11-28T20:09:42.656821+0000', 'last_fullsized': '2023-11-28T20:09:42.656821+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:09:48.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-11-28T20:09:48.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.657154+0000', 'last_change': '2023-11-28T20:09:42.657154+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.657154+0000', 'last_undegraded': '2023-11-28T20:09:42.657154+0000', 'last_fullsized': '2023-11-28T20:09:42.657154+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:09:48.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-11-28T20:09:48.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.656210+0000', 'last_change': '2023-11-28T20:09:42.656210+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.656210+0000', 'last_undegraded': '2023-11-28T20:09:42.656210+0000', 'last_fullsized': '2023-11-28T20:09:42.656210+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:09:48.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-11-28T20:09:48.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.656222+0000', 'last_change': '2023-11-28T20:09:42.656222+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.656222+0000', 'last_undegraded': '2023-11-28T20:09:42.656222+0000', 'last_fullsized': '2023-11-28T20:09:42.656222+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:09:48.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-11-28T20:09:48.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.655167+0000', 'last_change': '2023-11-28T20:09:42.655167+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.655167+0000', 'last_undegraded': '2023-11-28T20:09:42.655167+0000', 'last_fullsized': '2023-11-28T20:09:42.655167+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:09:48.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-11-28T20:09:48.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.662115+0000', 'last_change': '2023-11-28T20:09:42.662115+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.662115+0000', 'last_undegraded': '2023-11-28T20:09:42.662115+0000', 'last_fullsized': '2023-11-28T20:09:42.662115+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:09:48.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-11-28T20:09:48.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.652373+0000', 'last_change': '2023-11-28T20:09:42.652373+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.652373+0000', 'last_undegraded': '2023-11-28T20:09:42.652373+0000', 'last_fullsized': '2023-11-28T20:09:42.652373+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:09:48.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-11-28T20:09:48.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.664092+0000', 'last_change': '2023-11-28T20:09:42.664092+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.664092+0000', 'last_undegraded': '2023-11-28T20:09:42.664092+0000', 'last_fullsized': '2023-11-28T20:09:42.664092+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:09:48.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-11-28T20:09:48.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.656322+0000', 'last_change': '2023-11-28T20:09:42.656322+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.656322+0000', 'last_undegraded': '2023-11-28T20:09:42.656322+0000', 'last_fullsized': '2023-11-28T20:09:42.656322+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:09:48.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-11-28T20:09:48.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.664887+0000', 'last_change': '2023-11-28T20:09:42.664887+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.664887+0000', 'last_undegraded': '2023-11-28T20:09:42.664887+0000', 'last_fullsized': '2023-11-28T20:09:42.664887+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:09:48.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-11-28T20:09:48.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.655761+0000', 'last_change': '2023-11-28T20:09:42.655761+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.655761+0000', 'last_undegraded': '2023-11-28T20:09:42.655761+0000', 'last_fullsized': '2023-11-28T20:09:42.655761+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:09:48.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-11-28T20:09:48.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.661047+0000', 'last_change': '2023-11-28T20:09:42.661047+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.661047+0000', 'last_undegraded': '2023-11-28T20:09:42.661047+0000', 'last_fullsized': '2023-11-28T20:09:42.661047+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:09:48.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-11-28T20:09:48.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.655535+0000', 'last_change': '2023-11-28T20:09:42.655535+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.655535+0000', 'last_undegraded': '2023-11-28T20:09:42.655535+0000', 'last_fullsized': '2023-11-28T20:09:42.655535+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:09:48.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-11-28T20:09:48.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.665153+0000', 'last_change': '2023-11-28T20:09:42.665153+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.665153+0000', 'last_undegraded': '2023-11-28T20:09:42.665153+0000', 'last_fullsized': '2023-11-28T20:09:42.665153+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:09:48.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-11-28T20:09:48.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.655397+0000', 'last_change': '2023-11-28T20:09:42.655397+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.655397+0000', 'last_undegraded': '2023-11-28T20:09:42.655397+0000', 'last_fullsized': '2023-11-28T20:09:42.655397+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:09:48.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-11-28T20:09:48.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.665542+0000', 'last_change': '2023-11-28T20:09:42.665542+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.665542+0000', 'last_undegraded': '2023-11-28T20:09:42.665542+0000', 'last_fullsized': '2023-11-28T20:09:42.665542+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:09:48.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-11-28T20:09:48.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.652625+0000', 'last_change': '2023-11-28T20:09:42.652625+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.652625+0000', 'last_undegraded': '2023-11-28T20:09:42.652625+0000', 'last_fullsized': '2023-11-28T20:09:42.652625+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:09:48.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-11-28T20:09:48.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.658790+0000', 'last_change': '2023-11-28T20:09:42.658790+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.658790+0000', 'last_undegraded': '2023-11-28T20:09:42.658790+0000', 'last_fullsized': '2023-11-28T20:09:42.658790+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:09:48.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-11-28T20:09:48.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.657749+0000', 'last_change': '2023-11-28T20:09:42.657749+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.657749+0000', 'last_undegraded': '2023-11-28T20:09:42.657749+0000', 'last_fullsized': '2023-11-28T20:09:42.657749+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:09:48.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-11-28T20:09:48.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.656090+0000', 'last_change': '2023-11-28T20:09:42.656090+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.656090+0000', 'last_undegraded': '2023-11-28T20:09:42.656090+0000', 'last_fullsized': '2023-11-28T20:09:42.656090+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:09:48.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-11-28T20:09:48.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.654549+0000', 'last_change': '2023-11-28T20:09:42.654549+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.654549+0000', 'last_undegraded': '2023-11-28T20:09:42.654549+0000', 'last_fullsized': '2023-11-28T20:09:42.654549+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:09:48.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-11-28T20:09:48.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:09:42.655863+0000', 'last_change': '2023-11-28T20:09:42.655863+0000', 'last_active': '2023-11-28T20:09:42.638418+0000', 'last_peered': '2023-11-28T20:09:42.638418+0000', 'last_clean': '2023-11-28T20:09:42.638418+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:09:42.655863+0000', 'last_undegraded': '2023-11-28T20:09:42.655863+0000', 'last_fullsized': '2023-11-28T20:09:42.655863+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'last_clean_scrub_stamp': '2023-11-28T20:09:42.638418+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:09:48.507 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T20:09:48.634 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-28T20:09:48.628+0000 7fac6dd78640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:09:48.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.660+0000 7f55399d1640 1 Processor -- start 2023-11-28T20:09:48.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.660+0000 7f55399d1640 1 -- start start 2023-11-28T20:09:48.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.660+0000 7f55399d1640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f55340b35b0 0x7f55340d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:48.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.660+0000 7f55399d1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f55340cfe90 0x7f553415f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:48.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.660+0000 7f55399d1640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55340d3880 con 0x7f55340b3c70 2023-11-28T20:09:48.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.660+0000 7f55399d1640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55340d4090 con 0x7f55340b35b0 2023-11-28T20:09:48.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.660+0000 7f55399d1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55340cdc80 con 0x7f55340cfe90 2023-11-28T20:09:48.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.660+0000 7f552bfff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f55340b3c70 0x7f55340cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47316/0 (socket says 172.21.15.177:47316) 2023-11-28T20:09:48.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.660+0000 7f5532ffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f55340b35b0 0x7f55340d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:48.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.660+0000 7f552bfff640 1 -- 172.21.15.177:0/3667595328 learned_addr learned my addr 172.21.15.177:0/3667595328 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:48.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.660+0000 7f55337fe640 1 --2- 172.21.15.177:0/3667595328 >> v2:172.21.15.195:3300/0 conn(0x7f55340cfe90 0x7f553415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:48.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.660+0000 7f5532ffd640 1 -- 172.21.15.177:0/3667595328 >> v2:172.21.15.195:3300/0 conn(0x7f55340cfe90 msgr2=0x7f553415f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:48.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.660+0000 7f5532ffd640 1 --2- 172.21.15.177:0/3667595328 >> v2:172.21.15.195:3300/0 conn(0x7f55340cfe90 0x7f553415f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.660+0000 7f5532ffd640 1 -- 172.21.15.177:0/3667595328 >> v1:172.21.15.177:6789/0 conn(0x7f55340b3c70 legacy=0x7f55340cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:48.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.660+0000 7f5532ffd640 1 -- 172.21.15.177:0/3667595328 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55340d3ad0 con 0x7f55340b35b0 2023-11-28T20:09:48.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.664+0000 7f5532ffd640 1 --2- 172.21.15.177:0/3667595328 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55340b35b0 0x7f55340d0f50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f55340b4ad0 tx=0x7f552401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf2ea44581b9241 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:48.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.664+0000 7f55327fc640 1 -- 172.21.15.177:0/3667595328 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240ab660 con 0x7f55340b35b0 2023-11-28T20:09:48.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.664+0000 7f55327fc640 1 -- 172.21.15.177:0/3667595328 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55240ab7c0 con 0x7f55340b35b0 2023-11-28T20:09:48.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.664+0000 7f55327fc640 1 -- 172.21.15.177:0/3667595328 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240abb50 con 0x7f55340b35b0 2023-11-28T20:09:48.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.664+0000 7f55399d1640 1 -- 172.21.15.177:0/3667595328 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55340b35b0 msgr2=0x7f55340d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:48.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.664+0000 7f55399d1640 1 --2- 172.21.15.177:0/3667595328 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55340b35b0 0x7f55340d0f50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f55340b4ad0 tx=0x7f552401c460 comp rx=0 tx=0).stop 2023-11-28T20:09:48.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.664+0000 7f55399d1640 1 -- 172.21.15.177:0/3667595328 shutdown_connections 2023-11-28T20:09:48.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.664+0000 7f55399d1640 1 --2- 172.21.15.177:0/3667595328 >> v2:172.21.15.195:3300/0 conn(0x7f55340cfe90 0x7f553415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.664+0000 7f55399d1640 1 --2- 172.21.15.177:0/3667595328 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55340b35b0 0x7f55340d0f50 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.664+0000 7f55399d1640 1 -- 172.21.15.177:0/3667595328 >> 172.21.15.177:0/3667595328 conn(0x7f553409c4b0 msgr2=0x7f55340d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:48.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.664+0000 7f55399d1640 1 -- 172.21.15.177:0/3667595328 shutdown_connections 2023-11-28T20:09:48.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.664+0000 7f55399d1640 1 -- 172.21.15.177:0/3667595328 wait complete. 2023-11-28T20:09:48.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f55399d1640 1 Processor -- start 2023-11-28T20:09:48.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f55399d1640 1 -- start start 2023-11-28T20:09:48.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f55399d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55340b35b0 0x7f55340cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:48.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f55399d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55340b3c70 0x7f55341589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:48.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f55399d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55340cfe90 0x7f553415d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:48.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f55399d1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55340b57f0 con 0x7f55340b3c70 2023-11-28T20:09:48.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f55399d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55340b5ad0 con 0x7f55340cfe90 2023-11-28T20:09:48.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f55399d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55340b5db0 con 0x7f55340b35b0 2023-11-28T20:09:48.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f552bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55340b3c70 0x7f55341589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:48.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f552bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55340b3c70 0x7f55341589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47918/0 (socket says 172.21.15.177:47918) 2023-11-28T20:09:48.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f552bfff640 1 -- 172.21.15.177:0/2111465903 learned_addr learned my addr 172.21.15.177:0/2111465903 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:48.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f55337fe640 1 --2- 172.21.15.177:0/2111465903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55340cfe90 0x7f553415d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:48.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f5532ffd640 1 --2- 172.21.15.177:0/2111465903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55340b35b0 0x7f55340cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:48.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f552bfff640 1 -- 172.21.15.177:0/2111465903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55340b35b0 msgr2=0x7f55340cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:48.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f552bfff640 1 --2- 172.21.15.177:0/2111465903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55340b35b0 0x7f55340cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f552bfff640 1 -- 172.21.15.177:0/2111465903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55340cfe90 msgr2=0x7f553415d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:48.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f552bfff640 1 --2- 172.21.15.177:0/2111465903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55340cfe90 0x7f553415d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f552bfff640 1 -- 172.21.15.177:0/2111465903 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524009420 con 0x7f55340b3c70 2023-11-28T20:09:48.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f55337fe640 1 --2- 172.21.15.177:0/2111465903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55340cfe90 0x7f553415d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:48.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f552bfff640 1 --2- 172.21.15.177:0/2111465903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55340b3c70 0x7f55341589e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f551c00c500 tx=0x7f551c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:48.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f5530ff9640 1 -- 172.21.15.177:0/2111465903 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c005cf0 con 0x7f55340b3c70 2023-11-28T20:09:48.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f5530ff9640 1 -- 172.21.15.177:0/2111465903 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c005e50 con 0x7f55340b3c70 2023-11-28T20:09:48.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f5530ff9640 1 -- 172.21.15.177:0/2111465903 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0072f0 con 0x7f55340b3c70 2023-11-28T20:09:48.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f55399d1640 1 -- 172.21.15.177:0/2111465903 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55340b6090 con 0x7f55340b3c70 2023-11-28T20:09:48.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.668+0000 7f55399d1640 1 -- 172.21.15.177:0/2111465903 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55340cb190 con 0x7f55340b3c70 2023-11-28T20:09:48.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.672+0000 7f55399d1640 1 -- 172.21.15.177:0/2111465903 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55340b6540 con 0x7f55340b3c70 2023-11-28T20:09:48.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.672+0000 7f5530ff9640 1 -- 172.21.15.177:0/2111465903 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f551c007450 con 0x7f55340b3c70 2023-11-28T20:09:48.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.672+0000 7f5530ff9640 1 --2- 172.21.15.177:0/2111465903 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5514066470 0x7f5514068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:48.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.672+0000 7f5530ff9640 1 -- 172.21.15.177:0/2111465903 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f551c083330 con 0x7f55340b3c70 2023-11-28T20:09:48.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.672+0000 7f5532ffd640 1 --2- 172.21.15.177:0/2111465903 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5514066470 0x7f5514068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:48.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.672+0000 7f5532ffd640 1 --2- 172.21.15.177:0/2111465903 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5514066470 0x7f5514068930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f55240af000 tx=0x7f55240a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:48.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.676+0000 7f5530ff9640 1 -- 172.21.15.177:0/2111465903 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f55340b6540 con 0x7f55340b3c70 2023-11-28T20:09:48.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.880+0000 7f55399d1640 1 -- 172.21.15.177:0/2111465903 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f55340b6540 con 0x7f55340b3c70 2023-11-28T20:09:48.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.880+0000 7f5530ff9640 1 -- 172.21.15.177:0/2111465903 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1194 (secure 0 0 0) 0x7f55340b6540 con 0x7f55340b3c70 2023-11-28T20:09:48.884 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:48.884 INFO:teuthology.orchestra.run.smithi177.stdout:{"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":152,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":49,"num_osds":8,"num_up_osds":8,"osd_up_since":1701202048,"num_in_osds":8,"osd_in_since":1701202039,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":248291328,"bytes_avail":772845821952,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":26,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5907}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-28T20:09:35.440767+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T20:09:48.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.880+0000 7f55399d1640 1 -- 172.21.15.177:0/2111465903 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5514066470 msgr2=0x7f5514068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:48.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.880+0000 7f55399d1640 1 --2- 172.21.15.177:0/2111465903 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5514066470 0x7f5514068930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f55240af000 tx=0x7f55240a7000 comp rx=0 tx=0).stop 2023-11-28T20:09:48.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.880+0000 7f55399d1640 1 -- 172.21.15.177:0/2111465903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55340b3c70 msgr2=0x7f55341589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:48.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.880+0000 7f55399d1640 1 --2- 172.21.15.177:0/2111465903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55340b3c70 0x7f55341589e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f551c00c500 tx=0x7f551c00c9c0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.880+0000 7f55399d1640 1 -- 172.21.15.177:0/2111465903 shutdown_connections 2023-11-28T20:09:48.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.880+0000 7f55399d1640 1 --2- 172.21.15.177:0/2111465903 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5514066470 0x7f5514068930 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.880+0000 7f55399d1640 1 --2- 172.21.15.177:0/2111465903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55340cfe90 0x7f553415d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.880+0000 7f55399d1640 1 --2- 172.21.15.177:0/2111465903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55340b3c70 0x7f55341589e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.880+0000 7f55399d1640 1 --2- 172.21.15.177:0/2111465903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55340b35b0 0x7f55340cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:48.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.880+0000 7f55399d1640 1 -- 172.21.15.177:0/2111465903 >> 172.21.15.177:0/2111465903 conn(0x7f553409c4b0 msgr2=0x7f55340b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:48.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.880+0000 7f55399d1640 1 -- 172.21.15.177:0/2111465903 shutdown_connections 2023-11-28T20:09:48.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:48.880+0000 7f55399d1640 1 -- 172.21.15.177:0/2111465903 wait complete. 2023-11-28T20:09:48.907 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T20:09:48.907 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:09:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.040+0000 7fe76db2a640 1 Processor -- start 2023-11-28T20:09:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.040+0000 7fe76db2a640 1 -- start start 2023-11-28T20:09:49.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.044+0000 7fe76db2a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe76806c9d0 0x7fe76815a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:49.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.044+0000 7fe76db2a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76815b3a0 con 0x7fe76813cf30 2023-11-28T20:09:49.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.044+0000 7fe76db2a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76813f720 con 0x7fe76815ab70 2023-11-28T20:09:49.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.044+0000 7fe76db2a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76813d310 con 0x7fe76806c9d0 2023-11-28T20:09:49.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.044+0000 7fe7677fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe76813cf30 0x7fe76806c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:42686/0 (socket says 172.21.15.177:42686) 2023-11-28T20:09:49.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.044+0000 7fe7677fe640 1 -- 172.21.15.177:0/2151199493 learned_addr learned my addr 172.21.15.177:0/2151199493 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:49.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.044+0000 7fe766ffd640 1 --2- 172.21.15.177:0/2151199493 >> v2:172.21.15.177:3300/0 conn(0x7fe76806c9d0 0x7fe76815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:49.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.044+0000 7fe7667fc640 1 -- 172.21.15.177:0/2151199493 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327343493 0 0) 0x7fe76815b3a0 con 0x7fe76813cf30 2023-11-28T20:09:49.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.044+0000 7fe7667fc640 1 -- 172.21.15.177:0/2151199493 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe750005740 con 0x7fe76813cf30 2023-11-28T20:09:49.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.044+0000 7fe766ffd640 1 -- 172.21.15.177:0/2151199493 >> v1:172.21.15.195:6789/0 conn(0x7fe76815ab70 legacy=0x7fe7680cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:49.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.044+0000 7fe766ffd640 1 -- 172.21.15.177:0/2151199493 >> v1:172.21.15.177:6789/0 conn(0x7fe76813cf30 legacy=0x7fe76806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:49.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.044+0000 7fe766ffd640 1 -- 172.21.15.177:0/2151199493 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76813fa00 con 0x7fe76806c9d0 2023-11-28T20:09:49.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.044+0000 7fe766ffd640 1 --2- 172.21.15.177:0/2151199493 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76806c9d0 0x7fe76815a630 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0097c0 tx=0x7fe75c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7007b3d0d33fa893 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:49.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe7667fc640 1 -- 172.21.15.177:0/2151199493 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0ab600 con 0x7fe76806c9d0 2023-11-28T20:09:49.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe7667fc640 1 -- 172.21.15.177:0/2151199493 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c0a7050 con 0x7fe76806c9d0 2023-11-28T20:09:49.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe7667fc640 1 -- 172.21.15.177:0/2151199493 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0ab960 con 0x7fe76806c9d0 2023-11-28T20:09:49.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe76db2a640 1 -- 172.21.15.177:0/2151199493 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76806c9d0 msgr2=0x7fe76815a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:49.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe76db2a640 1 --2- 172.21.15.177:0/2151199493 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76806c9d0 0x7fe76815a630 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0097c0 tx=0x7fe75c01c3f0 comp rx=0 tx=0).stop 2023-11-28T20:09:49.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe76db2a640 1 -- 172.21.15.177:0/2151199493 shutdown_connections 2023-11-28T20:09:49.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe76db2a640 1 --2- 172.21.15.177:0/2151199493 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76806c9d0 0x7fe76815a630 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:49.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe76db2a640 1 -- 172.21.15.177:0/2151199493 >> 172.21.15.177:0/2151199493 conn(0x7fe76806a530 msgr2=0x7fe76806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:49.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe76db2a640 1 -- 172.21.15.177:0/2151199493 shutdown_connections 2023-11-28T20:09:49.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe76db2a640 1 -- 172.21.15.177:0/2151199493 wait complete. 2023-11-28T20:09:49.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe76db2a640 1 Processor -- start 2023-11-28T20:09:49.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe76db2a640 1 -- start start 2023-11-28T20:09:49.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe76db2a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe76806c9d0 0x7fe768136180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:49.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe76db2a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe76813cf30 0x7fe76814b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:49.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe76db2a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76815ab70 0x7fe768145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:49.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe76db2a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe768146640 con 0x7fe76815ab70 2023-11-28T20:09:49.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe76db2a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe768146920 con 0x7fe76813cf30 2023-11-28T20:09:49.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.048+0000 7fe76db2a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76814a930 con 0x7fe76806c9d0 2023-11-28T20:09:49.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe767fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76815ab70 0x7fe768145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:49.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe767fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76815ab70 0x7fe768145bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51482/0 (socket says 172.21.15.177:51482) 2023-11-28T20:09:49.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe767fff640 1 -- 172.21.15.177:0/3608624406 learned_addr learned my addr 172.21.15.177:0/3608624406 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:49.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe7677fe640 1 --2- 172.21.15.177:0/3608624406 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe76806c9d0 0x7fe768136180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:49.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe766ffd640 1 --2- 172.21.15.177:0/3608624406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe76813cf30 0x7fe76814b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:49.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe767fff640 1 -- 172.21.15.177:0/3608624406 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe76806c9d0 msgr2=0x7fe768136180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:49.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe767fff640 1 --2- 172.21.15.177:0/3608624406 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe76806c9d0 0x7fe768136180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:49.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe767fff640 1 -- 172.21.15.177:0/3608624406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe76813cf30 msgr2=0x7fe76814b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:49.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe767fff640 1 --2- 172.21.15.177:0/3608624406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe76813cf30 0x7fe76814b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:49.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe767fff640 1 -- 172.21.15.177:0/3608624406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c009420 con 0x7fe76815ab70 2023-11-28T20:09:49.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe767fff640 1 --2- 172.21.15.177:0/3608624406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76815ab70 0x7fe768145bf0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe76000c730 tx=0x7fe76000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:49.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe74ffff640 1 -- 172.21.15.177:0/3608624406 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760003b80 con 0x7fe76815ab70 2023-11-28T20:09:49.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe74ffff640 1 -- 172.21.15.177:0/3608624406 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe760003ce0 con 0x7fe76815ab70 2023-11-28T20:09:49.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe76db2a640 1 -- 172.21.15.177:0/3608624406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76814ac10 con 0x7fe76815ab70 2023-11-28T20:09:49.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe74ffff640 1 -- 172.21.15.177:0/3608624406 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76000aa30 con 0x7fe76815ab70 2023-11-28T20:09:49.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe76db2a640 1 -- 172.21.15.177:0/3608624406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76814b840 con 0x7fe76815ab70 2023-11-28T20:09:49.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe76db2a640 1 -- 172.21.15.177:0/3608624406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe768146b60 con 0x7fe76815ab70 2023-11-28T20:09:49.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe74ffff640 1 -- 172.21.15.177:0/3608624406 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe76000ab90 con 0x7fe76815ab70 2023-11-28T20:09:49.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.052+0000 7fe74ffff640 1 --2- 172.21.15.177:0/3608624406 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe754066470 0x7fe754068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:49.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.056+0000 7fe74ffff640 1 -- 172.21.15.177:0/3608624406 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe760083ba0 con 0x7fe76815ab70 2023-11-28T20:09:49.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.056+0000 7fe7677fe640 1 --2- 172.21.15.177:0/3608624406 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe754066470 0x7fe754068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:49.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.056+0000 7fe7677fe640 1 --2- 172.21.15.177:0/3608624406 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe754066470 0x7fe754068930 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe7580011f0 tx=0x7fe758007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:49.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.060+0000 7fe74ffff640 1 -- 172.21.15.177:0/3608624406 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe768146b60 con 0x7fe76815ab70 2023-11-28T20:09:49.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.208+0000 7fe76db2a640 1 -- 172.21.15.177:0/3608624406 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe76814a7b0 con 0x7fe754066470 2023-11-28T20:09:49.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.216+0000 7fe74ffff640 1 -- 172.21.15.177:0/3608624406 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283905 (secure 0 0 0) 0x7fe758001510 con 0x7fe754066470 2023-11-28T20:09:49.221 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:49.223 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:09:49.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.216+0000 7fe76db2a640 1 -- 172.21.15.177:0/3608624406 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe754066470 msgr2=0x7fe754068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:49.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.216+0000 7fe76db2a640 1 --2- 172.21.15.177:0/3608624406 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe754066470 0x7fe754068930 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe7580011f0 tx=0x7fe758007d40 comp rx=0 tx=0).stop 2023-11-28T20:09:49.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.216+0000 7fe76db2a640 1 -- 172.21.15.177:0/3608624406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76815ab70 msgr2=0x7fe768145bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:49.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.216+0000 7fe76db2a640 1 --2- 172.21.15.177:0/3608624406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76815ab70 0x7fe768145bf0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe76000c730 tx=0x7fe76000cbf0 comp rx=0 tx=0).stop 2023-11-28T20:09:49.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.220+0000 7fe76db2a640 1 -- 172.21.15.177:0/3608624406 shutdown_connections 2023-11-28T20:09:49.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.220+0000 7fe76db2a640 1 --2- 172.21.15.177:0/3608624406 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe754066470 0x7fe754068930 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:49.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.220+0000 7fe76db2a640 1 --2- 172.21.15.177:0/3608624406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76815ab70 0x7fe768145bf0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:49.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.220+0000 7fe76db2a640 1 --2- 172.21.15.177:0/3608624406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe76813cf30 0x7fe76814b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:49.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.220+0000 7fe76db2a640 1 --2- 172.21.15.177:0/3608624406 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe76806c9d0 0x7fe768136180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:49.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.220+0000 7fe76db2a640 1 -- 172.21.15.177:0/3608624406 >> 172.21.15.177:0/3608624406 conn(0x7fe76806a530 msgr2=0x7fe76813ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:49.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.220+0000 7fe76db2a640 1 -- 172.21.15.177:0/3608624406 shutdown_connections 2023-11-28T20:09:49.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:49.220+0000 7fe76db2a640 1 -- 172.21.15.177:0/3608624406 wait complete. 2023-11-28T20:09:49.242 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-11-28T20:09:47.443010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242472,"kb_used_data":5500,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754732248,"statfs":{"total":773094113280,"available":772845821952,"internally_reserved":0,"allocated":5632000,"data_stored":3006477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.804330"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665732+0000","last_change":"2023-11-28T20:09:42.665732+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665732+0000","last_undegraded":"2023-11-28T20:09:42.665732+0000","last_fullsized":"2023-11-28T20:09:42.665732+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653516+0000","last_change":"2023-11-28T20:09:42.653516+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653516+0000","last_undegraded":"2023-11-28T20:09:42.653516+0000","last_fullsized":"2023-11-28T20:09:42.653516+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.671505+0000","last_change":"2023-11-28T20:09:42.671505+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.671505+0000","last_undegraded":"2023-11-28T20:09:42.671505+0000","last_fullsized":"2023-11-28T20:09:42.671505+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651363+0000","last_change":"2023-11-28T20:09:42.651363+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651363+0000","last_undegraded":"2023-11-28T20:09:42.651363+0000","last_fullsized":"2023-11-28T20:09:42.651363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657723+0000","last_change":"2023-11-28T20:09:42.657723+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657723+0000","last_undegraded":"2023-11-28T20:09:42.657723+0000","last_fullsized":"2023-11-28T20:09:42.657723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.667791+0000","last_change":"2023-11-28T20:09:42.667791+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.667791+0000","last_undegraded":"2023-11-28T20:09:42.667791+0000","last_fullsized":"2023-11-28T20:09:42.667791+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.671313+0000","last_change":"2023-11-28T20:09:42.671313+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.671313+0000","last_undegraded":"2023-11-28T20:09:42.671313+0000","last_fullsized":"2023-11-28T20:09:42.671313+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653717+0000","last_change":"2023-11-28T20:09:42.653717+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653717+0000","last_undegraded":"2023-11-28T20:09:42.653717+0000","last_fullsized":"2023-11-28T20:09:42.653717+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655070+0000","last_change":"2023-11-28T20:09:42.655070+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655070+0000","last_undegraded":"2023-11-28T20:09:42.655070+0000","last_fullsized":"2023-11-28T20:09:42.655070+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.661316+0000","last_change":"2023-11-28T20:09:42.661316+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.661316+0000","last_undegraded":"2023-11-28T20:09:42.661316+0000","last_fullsized":"2023-11-28T20:09:42.661316+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657445+0000","last_change":"2023-11-28T20:09:42.657445+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657445+0000","last_undegraded":"2023-11-28T20:09:42.657445+0000","last_fullsized":"2023-11-28T20:09:42.657445+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653436+0000","last_change":"2023-11-28T20:09:42.653436+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653436+0000","last_undegraded":"2023-11-28T20:09:42.653436+0000","last_fullsized":"2023-11-28T20:09:42.653436+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.666052+0000","last_change":"2023-11-28T20:09:42.666052+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.666052+0000","last_undegraded":"2023-11-28T20:09:42.666052+0000","last_fullsized":"2023-11-28T20:09:42.666052+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.669868+0000","last_change":"2023-11-28T20:09:42.669868+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.669868+0000","last_undegraded":"2023-11-28T20:09:42.669868+0000","last_fullsized":"2023-11-28T20:09:42.669868+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651748+0000","last_change":"2023-11-28T20:09:42.651748+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651748+0000","last_undegraded":"2023-11-28T20:09:42.651748+0000","last_fullsized":"2023-11-28T20:09:42.651748+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665343+0000","last_change":"2023-11-28T20:09:42.665343+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665343+0000","last_undegraded":"2023-11-28T20:09:42.665343+0000","last_fullsized":"2023-11-28T20:09:42.665343+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.669366+0000","last_change":"2023-11-28T20:09:42.669366+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.669366+0000","last_undegraded":"2023-11-28T20:09:42.669366+0000","last_fullsized":"2023-11-28T20:09:42.669366+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652918+0000","last_change":"2023-11-28T20:09:42.652918+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652918+0000","last_undegraded":"2023-11-28T20:09:42.652918+0000","last_fullsized":"2023-11-28T20:09:42.652918+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.666333+0000","last_change":"2023-11-28T20:09:42.666333+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.666333+0000","last_undegraded":"2023-11-28T20:09:42.666333+0000","last_fullsized":"2023-11-28T20:09:42.666333+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.660299+0000","last_change":"2023-11-28T20:09:42.660299+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.660299+0000","last_undegraded":"2023-11-28T20:09:42.660299+0000","last_fullsized":"2023-11-28T20:09:42.660299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.663550+0000","last_change":"2023-11-28T20:09:42.663550+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.663550+0000","last_undegraded":"2023-11-28T20:09:42.663550+0000","last_fullsized":"2023-11-28T20:09:42.663550+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652494+0000","last_change":"2023-11-28T20:09:42.652494+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652494+0000","last_undegraded":"2023-11-28T20:09:42.652494+0000","last_fullsized":"2023-11-28T20:09:42.652494+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656884+0000","last_change":"2023-11-28T20:09:42.656884+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656884+0000","last_undegraded":"2023-11-28T20:09:42.656884+0000","last_fullsized":"2023-11-28T20:09:42.656884+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.663670+0000","last_change":"2023-11-28T20:09:42.663670+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.663670+0000","last_undegraded":"2023-11-28T20:09:42.663670+0000","last_fullsized":"2023-11-28T20:09:42.663670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.663409+0000","last_change":"2023-11-28T20:09:42.663409+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.663409+0000","last_undegraded":"2023-11-28T20:09:42.663409+0000","last_fullsized":"2023-11-28T20:09:42.663409+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655654+0000","last_change":"2023-11-28T20:09:42.655654+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655654+0000","last_undegraded":"2023-11-28T20:09:42.655654+0000","last_fullsized":"2023-11-28T20:09:42.655654+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.658550+0000","last_change":"2023-11-28T20:09:42.658550+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.658550+0000","last_undegraded":"2023-11-28T20:09:42.658550+0000","last_fullsized":"2023-11-28T20:09:42.658550+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.658235+0000","last_change":"2023-11-28T20:09:42.658235+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.658235+0000","last_undegraded":"2023-11-28T20:09:42.658235+0000","last_fullsized":"2023-11-28T20:09:42.658235+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.662648+0000","last_change":"2023-11-28T20:09:42.662648+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.662648+0000","last_undegraded":"2023-11-28T20:09:42.662648+0000","last_fullsized":"2023-11-28T20:09:42.662648+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651286+0000","last_change":"2023-11-28T20:09:42.651286+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651286+0000","last_undegraded":"2023-11-28T20:09:42.651286+0000","last_fullsized":"2023-11-28T20:09:42.651286+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.662994+0000","last_change":"2023-11-28T20:09:42.662994+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.662994+0000","last_undegraded":"2023-11-28T20:09:42.662994+0000","last_fullsized":"2023-11-28T20:09:42.662994+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655851+0000","last_change":"2023-11-28T20:09:42.655851+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655851+0000","last_undegraded":"2023-11-28T20:09:42.655851+0000","last_fullsized":"2023-11-28T20:09:42.655851+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651779+0000","last_change":"2023-11-28T20:09:42.651779+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651779+0000","last_undegraded":"2023-11-28T20:09:42.651779+0000","last_fullsized":"2023-11-28T20:09:42.651779+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669340+0000","last_change":"2023-11-28T20:09:42.666794+0000","last_active":"2023-11-28T20:09:42.669340+0000","last_peered":"2023-11-28T20:09:42.669340+0000","last_clean":"2023-11-28T20:09:42.669340+0000","last_became_active":"2023-11-28T20:09:42.666513+0000","last_became_peered":"2023-11-28T20:09:42.666513+0000","last_unstale":"2023-11-28T20:09:42.669340+0000","last_undegraded":"2023-11-28T20:09:42.669340+0000","last_fullsized":"2023-11-28T20:09:42.669340+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:51:59.917389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.654974+0000","last_change":"2023-11-28T20:09:42.654974+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.654974+0000","last_undegraded":"2023-11-28T20:09:42.654974+0000","last_fullsized":"2023-11-28T20:09:42.654974+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.679490+0000","last_change":"2023-11-28T20:09:42.674692+0000","last_active":"2023-11-28T20:09:42.679490+0000","last_peered":"2023-11-28T20:09:42.679490+0000","last_clean":"2023-11-28T20:09:42.679490+0000","last_became_active":"2023-11-28T20:09:42.674364+0000","last_became_peered":"2023-11-28T20:09:42.674364+0000","last_unstale":"2023-11-28T20:09:42.679490+0000","last_undegraded":"2023-11-28T20:09:42.679490+0000","last_fullsized":"2023-11-28T20:09:42.679490+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:32:26.336595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657485+0000","last_change":"2023-11-28T20:09:42.657485+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657485+0000","last_undegraded":"2023-11-28T20:09:42.657485+0000","last_fullsized":"2023-11-28T20:09:42.657485+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677675+0000","last_change":"2023-11-28T20:09:42.670599+0000","last_active":"2023-11-28T20:09:42.677675+0000","last_peered":"2023-11-28T20:09:42.677675+0000","last_clean":"2023-11-28T20:09:42.677675+0000","last_became_active":"2023-11-28T20:09:42.670216+0000","last_became_peered":"2023-11-28T20:09:42.670216+0000","last_unstale":"2023-11-28T20:09:42.677675+0000","last_undegraded":"2023-11-28T20:09:42.677675+0000","last_fullsized":"2023-11-28T20:09:42.677675+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:15.217653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.653400+0000","last_change":"2023-11-28T20:09:42.653400+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.653400+0000","last_undegraded":"2023-11-28T20:09:42.653400+0000","last_fullsized":"2023-11-28T20:09:42.653400+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675698+0000","last_change":"2023-11-28T20:09:42.674101+0000","last_active":"2023-11-28T20:09:42.675698+0000","last_peered":"2023-11-28T20:09:42.675698+0000","last_clean":"2023-11-28T20:09:42.675698+0000","last_became_active":"2023-11-28T20:09:42.673725+0000","last_became_peered":"2023-11-28T20:09:42.673725+0000","last_unstale":"2023-11-28T20:09:42.675698+0000","last_undegraded":"2023-11-28T20:09:42.675698+0000","last_fullsized":"2023-11-28T20:09:42.675698+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:49.634142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656518+0000","last_change":"2023-11-28T20:09:42.656518+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656518+0000","last_undegraded":"2023-11-28T20:09:42.656518+0000","last_fullsized":"2023-11-28T20:09:42.656518+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.674971+0000","last_change":"2023-11-28T20:09:42.664506+0000","last_active":"2023-11-28T20:09:42.674971+0000","last_peered":"2023-11-28T20:09:42.674971+0000","last_clean":"2023-11-28T20:09:42.674971+0000","last_became_active":"2023-11-28T20:09:42.664199+0000","last_became_peered":"2023-11-28T20:09:42.664199+0000","last_unstale":"2023-11-28T20:09:42.674971+0000","last_undegraded":"2023-11-28T20:09:42.674971+0000","last_fullsized":"2023-11-28T20:09:42.674971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:32:26.336595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.651336+0000","last_change":"2023-11-28T20:09:42.651336+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.651336+0000","last_undegraded":"2023-11-28T20:09:42.651336+0000","last_fullsized":"2023-11-28T20:09:42.651336+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.671611+0000","last_change":"2023-11-28T20:09:42.670093+0000","last_active":"2023-11-28T20:09:42.671611+0000","last_peered":"2023-11-28T20:09:42.671611+0000","last_clean":"2023-11-28T20:09:42.671611+0000","last_became_active":"2023-11-28T20:09:42.669832+0000","last_became_peered":"2023-11-28T20:09:42.669832+0000","last_unstale":"2023-11-28T20:09:42.671611+0000","last_undegraded":"2023-11-28T20:09:42.671611+0000","last_fullsized":"2023-11-28T20:09:42.671611+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:17.280206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.654604+0000","last_change":"2023-11-28T20:09:42.654604+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.654604+0000","last_undegraded":"2023-11-28T20:09:42.654604+0000","last_fullsized":"2023-11-28T20:09:42.654604+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669576+0000","last_change":"2023-11-28T20:09:42.666410+0000","last_active":"2023-11-28T20:09:42.669576+0000","last_peered":"2023-11-28T20:09:42.669576+0000","last_clean":"2023-11-28T20:09:42.669576+0000","last_became_active":"2023-11-28T20:09:42.666065+0000","last_became_peered":"2023-11-28T20:09:42.666065+0000","last_unstale":"2023-11-28T20:09:42.669576+0000","last_undegraded":"2023-11-28T20:09:42.669576+0000","last_fullsized":"2023-11-28T20:09:42.669576+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:07:05.109326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652208+0000","last_change":"2023-11-28T20:09:42.652208+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652208+0000","last_undegraded":"2023-11-28T20:09:42.652208+0000","last_fullsized":"2023-11-28T20:09:42.652208+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677174+0000","last_change":"2023-11-28T20:09:42.671231+0000","last_active":"2023-11-28T20:09:42.677174+0000","last_peered":"2023-11-28T20:09:42.677174+0000","last_clean":"2023-11-28T20:09:42.677174+0000","last_became_active":"2023-11-28T20:09:42.670957+0000","last_became_peered":"2023-11-28T20:09:42.670957+0000","last_unstale":"2023-11-28T20:09:42.677174+0000","last_undegraded":"2023-11-28T20:09:42.677174+0000","last_fullsized":"2023-11-28T20:09:42.677174+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:44:35.411601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655348+0000","last_change":"2023-11-28T20:09:42.655348+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655348+0000","last_undegraded":"2023-11-28T20:09:42.655348+0000","last_fullsized":"2023-11-28T20:09:42.655348+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669018+0000","last_change":"2023-11-28T20:09:42.666932+0000","last_active":"2023-11-28T20:09:42.669018+0000","last_peered":"2023-11-28T20:09:42.669018+0000","last_clean":"2023-11-28T20:09:42.669018+0000","last_became_active":"2023-11-28T20:09:42.666671+0000","last_became_peered":"2023-11-28T20:09:42.666671+0000","last_unstale":"2023-11-28T20:09:42.669018+0000","last_undegraded":"2023-11-28T20:09:42.669018+0000","last_fullsized":"2023-11-28T20:09:42.669018+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:25.757605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655579+0000","last_change":"2023-11-28T20:09:42.655579+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655579+0000","last_undegraded":"2023-11-28T20:09:42.655579+0000","last_fullsized":"2023-11-28T20:09:42.655579+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.681208+0000","last_change":"2023-11-28T20:09:42.680303+0000","last_active":"2023-11-28T20:09:42.681208+0000","last_peered":"2023-11-28T20:09:42.681208+0000","last_clean":"2023-11-28T20:09:42.681208+0000","last_became_active":"2023-11-28T20:09:42.680028+0000","last_became_peered":"2023-11-28T20:09:42.680028+0000","last_unstale":"2023-11-28T20:09:42.681208+0000","last_undegraded":"2023-11-28T20:09:42.681208+0000","last_fullsized":"2023-11-28T20:09:42.681208+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:44:35.411601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656821+0000","last_change":"2023-11-28T20:09:42.656821+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656821+0000","last_undegraded":"2023-11-28T20:09:42.656821+0000","last_fullsized":"2023-11-28T20:09:42.656821+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675415+0000","last_change":"2023-11-28T20:09:42.674301+0000","last_active":"2023-11-28T20:09:42.675415+0000","last_peered":"2023-11-28T20:09:42.675415+0000","last_clean":"2023-11-28T20:09:42.675415+0000","last_became_active":"2023-11-28T20:09:42.673651+0000","last_became_peered":"2023-11-28T20:09:42.673651+0000","last_unstale":"2023-11-28T20:09:42.675415+0000","last_undegraded":"2023-11-28T20:09:42.675415+0000","last_fullsized":"2023-11-28T20:09:42.675415+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:48:37.397331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657154+0000","last_change":"2023-11-28T20:09:42.657154+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657154+0000","last_undegraded":"2023-11-28T20:09:42.657154+0000","last_fullsized":"2023-11-28T20:09:42.657154+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677439+0000","last_change":"2023-11-28T20:09:42.669553+0000","last_active":"2023-11-28T20:09:42.677439+0000","last_peered":"2023-11-28T20:09:42.677439+0000","last_clean":"2023-11-28T20:09:42.677439+0000","last_became_active":"2023-11-28T20:09:42.667456+0000","last_became_peered":"2023-11-28T20:09:42.667456+0000","last_unstale":"2023-11-28T20:09:42.677439+0000","last_undegraded":"2023-11-28T20:09:42.677439+0000","last_fullsized":"2023-11-28T20:09:42.677439+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:59.639535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656210+0000","last_change":"2023-11-28T20:09:42.656210+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656210+0000","last_undegraded":"2023-11-28T20:09:42.656210+0000","last_fullsized":"2023-11-28T20:09:42.656210+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.679813+0000","last_change":"2023-11-28T20:09:42.675080+0000","last_active":"2023-11-28T20:09:42.679813+0000","last_peered":"2023-11-28T20:09:42.679813+0000","last_clean":"2023-11-28T20:09:42.679813+0000","last_became_active":"2023-11-28T20:09:42.674739+0000","last_became_peered":"2023-11-28T20:09:42.674739+0000","last_unstale":"2023-11-28T20:09:42.679813+0000","last_undegraded":"2023-11-28T20:09:42.679813+0000","last_fullsized":"2023-11-28T20:09:42.679813+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:35.259118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656222+0000","last_change":"2023-11-28T20:09:42.656222+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656222+0000","last_undegraded":"2023-11-28T20:09:42.656222+0000","last_fullsized":"2023-11-28T20:09:42.656222+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676458+0000","last_change":"2023-11-28T20:09:42.675061+0000","last_active":"2023-11-28T20:09:42.676458+0000","last_peered":"2023-11-28T20:09:42.676458+0000","last_clean":"2023-11-28T20:09:42.676458+0000","last_became_active":"2023-11-28T20:09:42.674720+0000","last_became_peered":"2023-11-28T20:09:42.674720+0000","last_unstale":"2023-11-28T20:09:42.676458+0000","last_undegraded":"2023-11-28T20:09:42.676458+0000","last_fullsized":"2023-11-28T20:09:42.676458+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:42.147183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655167+0000","last_change":"2023-11-28T20:09:42.655167+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655167+0000","last_undegraded":"2023-11-28T20:09:42.655167+0000","last_fullsized":"2023-11-28T20:09:42.655167+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669881+0000","last_change":"2023-11-28T20:09:42.668166+0000","last_active":"2023-11-28T20:09:42.669881+0000","last_peered":"2023-11-28T20:09:42.669881+0000","last_clean":"2023-11-28T20:09:42.669881+0000","last_became_active":"2023-11-28T20:09:42.666450+0000","last_became_peered":"2023-11-28T20:09:42.666450+0000","last_unstale":"2023-11-28T20:09:42.669881+0000","last_undegraded":"2023-11-28T20:09:42.669881+0000","last_fullsized":"2023-11-28T20:09:42.669881+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:51.354290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.662115+0000","last_change":"2023-11-28T20:09:42.662115+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.662115+0000","last_undegraded":"2023-11-28T20:09:42.662115+0000","last_fullsized":"2023-11-28T20:09:42.662115+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.674322+0000","last_change":"2023-11-28T20:09:42.667815+0000","last_active":"2023-11-28T20:09:42.674322+0000","last_peered":"2023-11-28T20:09:42.674322+0000","last_clean":"2023-11-28T20:09:42.674322+0000","last_became_active":"2023-11-28T20:09:42.667502+0000","last_became_peered":"2023-11-28T20:09:42.667502+0000","last_unstale":"2023-11-28T20:09:42.674322+0000","last_undegraded":"2023-11-28T20:09:42.674322+0000","last_fullsized":"2023-11-28T20:09:42.674322+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:50.363442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652373+0000","last_change":"2023-11-28T20:09:42.652373+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652373+0000","last_undegraded":"2023-11-28T20:09:42.652373+0000","last_fullsized":"2023-11-28T20:09:42.652373+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.678297+0000","last_change":"2023-11-28T20:09:42.673577+0000","last_active":"2023-11-28T20:09:42.678297+0000","last_peered":"2023-11-28T20:09:42.678297+0000","last_clean":"2023-11-28T20:09:42.678297+0000","last_became_active":"2023-11-28T20:09:42.673263+0000","last_became_peered":"2023-11-28T20:09:42.673263+0000","last_unstale":"2023-11-28T20:09:42.678297+0000","last_undegraded":"2023-11-28T20:09:42.678297+0000","last_fullsized":"2023-11-28T20:09:42.678297+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:17.507022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.664092+0000","last_change":"2023-11-28T20:09:42.664092+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.664092+0000","last_undegraded":"2023-11-28T20:09:42.664092+0000","last_fullsized":"2023-11-28T20:09:42.664092+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675461+0000","last_change":"2023-11-28T20:09:42.666698+0000","last_active":"2023-11-28T20:09:42.675461+0000","last_peered":"2023-11-28T20:09:42.675461+0000","last_clean":"2023-11-28T20:09:42.675461+0000","last_became_active":"2023-11-28T20:09:42.666428+0000","last_became_peered":"2023-11-28T20:09:42.666428+0000","last_unstale":"2023-11-28T20:09:42.675461+0000","last_undegraded":"2023-11-28T20:09:42.675461+0000","last_fullsized":"2023-11-28T20:09:42.675461+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:45:52.810926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656322+0000","last_change":"2023-11-28T20:09:42.656322+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656322+0000","last_undegraded":"2023-11-28T20:09:42.656322+0000","last_fullsized":"2023-11-28T20:09:42.656322+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.674525+0000","last_change":"2023-11-28T20:09:42.672595+0000","last_active":"2023-11-28T20:09:42.674525+0000","last_peered":"2023-11-28T20:09:42.674525+0000","last_clean":"2023-11-28T20:09:42.674525+0000","last_became_active":"2023-11-28T20:09:42.672270+0000","last_became_peered":"2023-11-28T20:09:42.672270+0000","last_unstale":"2023-11-28T20:09:42.674525+0000","last_undegraded":"2023-11-28T20:09:42.674525+0000","last_fullsized":"2023-11-28T20:09:42.674525+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:48.596264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.664887+0000","last_change":"2023-11-28T20:09:42.664887+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.664887+0000","last_undegraded":"2023-11-28T20:09:42.664887+0000","last_fullsized":"2023-11-28T20:09:42.664887+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676982+0000","last_change":"2023-11-28T20:09:42.675538+0000","last_active":"2023-11-28T20:09:42.676982+0000","last_peered":"2023-11-28T20:09:42.676982+0000","last_clean":"2023-11-28T20:09:42.676982+0000","last_became_active":"2023-11-28T20:09:42.675139+0000","last_became_peered":"2023-11-28T20:09:42.675139+0000","last_unstale":"2023-11-28T20:09:42.676982+0000","last_undegraded":"2023-11-28T20:09:42.676982+0000","last_fullsized":"2023-11-28T20:09:42.676982+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:08.633227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655761+0000","last_change":"2023-11-28T20:09:42.655761+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655761+0000","last_undegraded":"2023-11-28T20:09:42.655761+0000","last_fullsized":"2023-11-28T20:09:42.655761+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.673712+0000","last_change":"2023-11-28T20:09:42.668264+0000","last_active":"2023-11-28T20:09:42.673712+0000","last_peered":"2023-11-28T20:09:42.673712+0000","last_clean":"2023-11-28T20:09:42.673712+0000","last_became_active":"2023-11-28T20:09:42.667948+0000","last_became_peered":"2023-11-28T20:09:42.667948+0000","last_unstale":"2023-11-28T20:09:42.673712+0000","last_undegraded":"2023-11-28T20:09:42.673712+0000","last_fullsized":"2023-11-28T20:09:42.673712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:24:57.386846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.661047+0000","last_change":"2023-11-28T20:09:42.661047+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.661047+0000","last_undegraded":"2023-11-28T20:09:42.661047+0000","last_fullsized":"2023-11-28T20:09:42.661047+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.673371+0000","last_change":"2023-11-28T20:09:42.660838+0000","last_active":"2023-11-28T20:09:42.673371+0000","last_peered":"2023-11-28T20:09:42.673371+0000","last_clean":"2023-11-28T20:09:42.673371+0000","last_became_active":"2023-11-28T20:09:42.660549+0000","last_became_peered":"2023-11-28T20:09:42.660549+0000","last_unstale":"2023-11-28T20:09:42.673371+0000","last_undegraded":"2023-11-28T20:09:42.673371+0000","last_fullsized":"2023-11-28T20:09:42.673371+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:08:58.244467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655535+0000","last_change":"2023-11-28T20:09:42.655535+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655535+0000","last_undegraded":"2023-11-28T20:09:42.655535+0000","last_fullsized":"2023-11-28T20:09:42.655535+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.680719+0000","last_change":"2023-11-28T20:09:42.678274+0000","last_active":"2023-11-28T20:09:42.680719+0000","last_peered":"2023-11-28T20:09:42.680719+0000","last_clean":"2023-11-28T20:09:42.680719+0000","last_became_active":"2023-11-28T20:09:42.677974+0000","last_became_peered":"2023-11-28T20:09:42.677974+0000","last_unstale":"2023-11-28T20:09:42.680719+0000","last_undegraded":"2023-11-28T20:09:42.680719+0000","last_fullsized":"2023-11-28T20:09:42.680719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:15.217653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665153+0000","last_change":"2023-11-28T20:09:42.665153+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665153+0000","last_undegraded":"2023-11-28T20:09:42.665153+0000","last_fullsized":"2023-11-28T20:09:42.665153+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675534+0000","last_change":"2023-11-28T20:09:42.664555+0000","last_active":"2023-11-28T20:09:42.675534+0000","last_peered":"2023-11-28T20:09:42.675534+0000","last_clean":"2023-11-28T20:09:42.675534+0000","last_became_active":"2023-11-28T20:09:42.663496+0000","last_became_peered":"2023-11-28T20:09:42.663496+0000","last_unstale":"2023-11-28T20:09:42.675534+0000","last_undegraded":"2023-11-28T20:09:42.675534+0000","last_fullsized":"2023-11-28T20:09:42.675534+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:54:38.995754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655397+0000","last_change":"2023-11-28T20:09:42.655397+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655397+0000","last_undegraded":"2023-11-28T20:09:42.655397+0000","last_fullsized":"2023-11-28T20:09:42.655397+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.677759+0000","last_change":"2023-11-28T20:09:42.676899+0000","last_active":"2023-11-28T20:09:42.677759+0000","last_peered":"2023-11-28T20:09:42.677759+0000","last_clean":"2023-11-28T20:09:42.677759+0000","last_became_active":"2023-11-28T20:09:42.676592+0000","last_became_peered":"2023-11-28T20:09:42.676592+0000","last_unstale":"2023-11-28T20:09:42.677759+0000","last_undegraded":"2023-11-28T20:09:42.677759+0000","last_fullsized":"2023-11-28T20:09:42.677759+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:19:24.863349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.665542+0000","last_change":"2023-11-28T20:09:42.665542+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.665542+0000","last_undegraded":"2023-11-28T20:09:42.665542+0000","last_fullsized":"2023-11-28T20:09:42.665542+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676170+0000","last_change":"2023-11-28T20:09:42.675569+0000","last_active":"2023-11-28T20:09:42.676170+0000","last_peered":"2023-11-28T20:09:42.676170+0000","last_clean":"2023-11-28T20:09:42.676170+0000","last_became_active":"2023-11-28T20:09:42.675111+0000","last_became_peered":"2023-11-28T20:09:42.675111+0000","last_unstale":"2023-11-28T20:09:42.676170+0000","last_undegraded":"2023-11-28T20:09:42.676170+0000","last_fullsized":"2023-11-28T20:09:42.676170+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:18.357434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.652625+0000","last_change":"2023-11-28T20:09:42.652625+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.652625+0000","last_undegraded":"2023-11-28T20:09:42.652625+0000","last_fullsized":"2023-11-28T20:09:42.652625+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.680754+0000","last_change":"2023-11-28T20:09:42.678609+0000","last_active":"2023-11-28T20:09:42.680754+0000","last_peered":"2023-11-28T20:09:42.680754+0000","last_clean":"2023-11-28T20:09:42.680754+0000","last_became_active":"2023-11-28T20:09:42.677536+0000","last_became_peered":"2023-11-28T20:09:42.677536+0000","last_unstale":"2023-11-28T20:09:42.680754+0000","last_undegraded":"2023-11-28T20:09:42.680754+0000","last_fullsized":"2023-11-28T20:09:42.680754+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:23.158269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.658790+0000","last_change":"2023-11-28T20:09:42.658790+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.658790+0000","last_undegraded":"2023-11-28T20:09:42.658790+0000","last_fullsized":"2023-11-28T20:09:42.658790+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676514+0000","last_change":"2023-11-28T20:09:42.669065+0000","last_active":"2023-11-28T20:09:42.676514+0000","last_peered":"2023-11-28T20:09:42.676514+0000","last_clean":"2023-11-28T20:09:42.676514+0000","last_became_active":"2023-11-28T20:09:42.668745+0000","last_became_peered":"2023-11-28T20:09:42.668745+0000","last_unstale":"2023-11-28T20:09:42.676514+0000","last_undegraded":"2023-11-28T20:09:42.676514+0000","last_fullsized":"2023-11-28T20:09:42.676514+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:11.506826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.657749+0000","last_change":"2023-11-28T20:09:42.657749+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.657749+0000","last_undegraded":"2023-11-28T20:09:42.657749+0000","last_fullsized":"2023-11-28T20:09:42.657749+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.676636+0000","last_change":"2023-11-28T20:09:42.671311+0000","last_active":"2023-11-28T20:09:42.676636+0000","last_peered":"2023-11-28T20:09:42.676636+0000","last_clean":"2023-11-28T20:09:42.676636+0000","last_became_active":"2023-11-28T20:09:42.671023+0000","last_became_peered":"2023-11-28T20:09:42.671023+0000","last_unstale":"2023-11-28T20:09:42.676636+0000","last_undegraded":"2023-11-28T20:09:42.676636+0000","last_fullsized":"2023-11-28T20:09:42.676636+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:12.823637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.656090+0000","last_change":"2023-11-28T20:09:42.656090+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.656090+0000","last_undegraded":"2023-11-28T20:09:42.656090+0000","last_fullsized":"2023-11-28T20:09:42.656090+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.675522+0000","last_change":"2023-11-28T20:09:42.673420+0000","last_active":"2023-11-28T20:09:42.675522+0000","last_peered":"2023-11-28T20:09:42.675522+0000","last_clean":"2023-11-28T20:09:42.675522+0000","last_became_active":"2023-11-28T20:09:42.673075+0000","last_became_peered":"2023-11-28T20:09:42.673075+0000","last_unstale":"2023-11-28T20:09:42.675522+0000","last_undegraded":"2023-11-28T20:09:42.675522+0000","last_fullsized":"2023-11-28T20:09:42.675522+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:49:07.928868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.654549+0000","last_change":"2023-11-28T20:09:42.654549+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.654549+0000","last_undegraded":"2023-11-28T20:09:42.654549+0000","last_fullsized":"2023-11-28T20:09:42.654549+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.669078+0000","last_change":"2023-11-28T20:09:42.667295+0000","last_active":"2023-11-28T20:09:42.669078+0000","last_peered":"2023-11-28T20:09:42.669078+0000","last_clean":"2023-11-28T20:09:42.669078+0000","last_became_active":"2023-11-28T20:09:42.666932+0000","last_became_peered":"2023-11-28T20:09:42.666932+0000","last_unstale":"2023-11-28T20:09:42.669078+0000","last_undegraded":"2023-11-28T20:09:42.669078+0000","last_fullsized":"2023-11-28T20:09:42.669078+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:39.371885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-11-28T20:09:42.655863+0000","last_change":"2023-11-28T20:09:42.655863+0000","last_active":"2023-11-28T20:09:42.638418+0000","last_peered":"2023-11-28T20:09:42.638418+0000","last_clean":"2023-11-28T20:09:42.638418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:09:42.655863+0000","last_undegraded":"2023-11-28T20:09:42.655863+0000","last_fullsized":"2023-11-28T20:09:42.655863+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T20:09:42.679019+0000","last_change":"2023-11-28T20:09:42.674280+0000","last_active":"2023-11-28T20:09:42.679019+0000","last_peered":"2023-11-28T20:09:42.679019+0000","last_clean":"2023-11-28T20:09:42.679019+0000","last_became_active":"2023-11-28T20:09:42.673979+0000","last_became_peered":"2023-11-28T20:09:42.673979+0000","last_unstale":"2023-11-28T20:09:42.679019+0000","last_undegraded":"2023-11-28T20:09:42.679019+0000","last_fullsized":"2023-11-28T20:09:42.679019+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:24:57.386846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":189,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T20:09:41.647031+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:09:41.647031+0000","last_peered":"2023-11-28T20:09:41.647031+0000","last_clean":"2023-11-28T20:09:41.647031+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:09:41.647031+0000","last_undegraded":"2023-11-28T20:09:41.647031+0000","last_fullsized":"2023-11-28T20:09:41.647031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1150976,"data_stored":819370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.438,"5min":0.313,"15min":0.313},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.56200000000000006,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.032,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.70699999999999996}]},{"osd":1,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.65400000000000003},"min":{"1min":0.49199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94399999999999995,"5min":1.161,"15min":1.161},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0009999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97899999999999998,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.60299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61899999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0209999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.68799999999999994}]},{"osd":4,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.44500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.505,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.63800000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.48799999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.502},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.495,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.76200000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.58899999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.054,"5min":1.272,"15min":1.272},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.79200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.44500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.80800000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.69999999999999996,"15min":0.68500000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.748,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.79200000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.65400000000000003},"min":{"1min":0.501,"5min":0.498,"15min":0.498},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.60999999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5819999999999999,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.125,"5min":1.357,"15min":1.357},"last":0.75},{"interface":"front","average":{"1min":1.006,"5min":0.80600000000000005,"15min":0.77200000000000002},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":6.2249999999999996,"5min":6.2249999999999996,"15min":6.2249999999999996},"last":0.70199999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.0789999999999997,"5min":4.0789999999999997,"15min":4.0789999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":0.81899999999999995,"15min":0.77700000000000002},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":8.6159999999999997,"5min":8.6159999999999997,"15min":8.6159999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.83299999999999996,"15min":0.82099999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.81799999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.84399999999999997,"15min":0.84199999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.86199999999999999,"15min":0.85799999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.72899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.78900000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61199999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.629},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65900000000000003,"15min":0.66000000000000003},"min":{"1min":0.47199999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.879,"5min":1.083,"15min":1.083},"last":0.66200000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.052,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69799999999999995,"15min":0.70099999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84399999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73299999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65300000000000002,"15min":0.66200000000000003},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.503},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81299999999999994,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70299999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77800000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82999999999999996,"5min":0.997,"15min":0.997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92400000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.749}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67900000000000005,"15min":0.68600000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.78100000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.751},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71399999999999997,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85599999999999998,"5min":1.361,"15min":1.361},"last":0.76500000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68799999999999994},"min":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.81799999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.79500000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86899999999999999,"5min":1.04,"15min":1.04},"last":0.83199999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.56699999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.83999999999999997,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88100000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.45400000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85699999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":1.038,"15min":1.038},"last":0.59599999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.84299999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.91400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93100000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.86099999999999999,"15min":0.877},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98899999999999999,"5min":1.353,"15min":1.353},"last":0.63500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.02,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.68100000000000005,"15min":0.72199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76000000000000001,"5min":6.016,"15min":6.016},"last":0.29299999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2170000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.40600000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94799999999999995,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.44},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0549999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.49299999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0009999999999999,"5min":5.8810000000000002,"15min":5.8810000000000002},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.038,"5min":1.405,"15min":1.405},"last":0.92400000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79800000000000004,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.119,"5min":1.585,"15min":1.585},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.97299999999999998,"15min":1.0129999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.042,"5min":5.9349999999999996,"15min":5.9349999999999996},"last":0.84699999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95699999999999996,"5min":1.361,"15min":1.361},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.55500000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0900000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.90300000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.94999999999999996,"15min":0.98799999999999999},"min":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.262,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0620000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.88200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":229002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.80800000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.442},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.54300000000000004,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.626}]},{"osd":1,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.3140000000000001,"5min":5.3140000000000001,"15min":5.3140000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":3.7650000000000001,"5min":3.7650000000000001,"15min":3.7650000000000001},"last":0.502}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":5.3460000000000001,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.54500000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3580000000000001,"5min":1.415,"15min":1.415},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.81699999999999995,"15min":0.80700000000000005},"min":{"1min":0.54500000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.8090000000000002,"5min":3.8090000000000002,"15min":3.8090000000000002},"last":0.79100000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.2809999999999997,"5min":5.2809999999999997,"15min":5.2809999999999997},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88800000000000001,"15min":0.88400000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.5369999999999999,"5min":4.5369999999999999,"15min":4.5369999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.88700000000000001,"15min":0.86599999999999999},"min":{"1min":0.56799999999999995,"5min":0.496,"15min":0.496},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.84499999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.88,"15min":0.874},"min":{"1min":0.56999999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":3.863,"5min":3.863,"15min":3.863},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.90300000000000002,"15min":0.88600000000000001},"min":{"1min":0.627,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":5.2460000000000004,"5min":5.2460000000000004,"15min":5.2460000000000004},"last":0.81499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":544768,"data_stored":222727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.60499999999999998,"15min":0.63900000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.627,"15min":0.66100000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.58199999999999996}]},{"osd":2,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.64800000000000002,"15min":0.68300000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79900000000000004,"5min":4.9909999999999997,"15min":4.9909999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.68100000000000005,"15min":0.71899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56699999999999995,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.39000000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":1.389,"15min":1.389},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.67000000000000004,"15min":0.70399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.48599999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.503,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":1.145,"15min":1.145},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.93500000000000005,"15min":0.96599999999999997},"min":{"1min":0.59899999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90600000000000003,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":1.321}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.91400000000000003,"15min":0.95499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90600000000000003,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":0.748},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.89100000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.232}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.94799999999999995,"15min":0.99099999999999999},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.89800000000000002,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.80900000000000005,"15min":0.81799999999999995},"min":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.92400000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.3069999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0009999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.94699999999999995,"15min":0.98499999999999999},"min":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.93100000000000005,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":1.2509999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1150976,"data_stored":819370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.50700000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.753,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59299999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.48799999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.998,"5min":1.052,"15min":1.052},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92100000000000004,"5min":1.006,"15min":1.006},"last":0.80000000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88900000000000001,"5min":1.524,"15min":1.524},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.97999999999999998,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70199999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.624,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.84199999999999997,"5min":1.214,"15min":1.214},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97399999999999998,"5min":1.415,"15min":1.415},"last":0.77000000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95599999999999996,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93899999999999995,"5min":1.099,"15min":1.099},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:09:52.250 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:09:52.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.396+0000 7f705605f640 1 Processor -- start 2023-11-28T20:09:52.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.396+0000 7f705605f640 1 -- start start 2023-11-28T20:09:52.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.396+0000 7f705605f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f705013cf30 0x7f705006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:52.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.396+0000 7f705605f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705015b3a0 con 0x7f705006c800 2023-11-28T20:09:52.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.396+0000 7f705605f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705006cc40 con 0x7f705015ad40 2023-11-28T20:09:52.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.396+0000 7f705605f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705013d310 con 0x7f705013cf30 2023-11-28T20:09:52.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.396+0000 7f7047fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f705006c800 0x7f705015a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:42692/0 (socket says 172.21.15.177:42692) 2023-11-28T20:09:52.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.396+0000 7f7047fff640 1 -- 172.21.15.177:0/1359642782 learned_addr learned my addr 172.21.15.177:0/1359642782 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:52.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.400+0000 7f704f7fe640 1 --2- 172.21.15.177:0/1359642782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f705013cf30 0x7f705006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:52.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.400+0000 7f704effd640 1 -- 172.21.15.177:0/1359642782 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258994475 0 0) 0x7f705015b3a0 con 0x7f705006c800 2023-11-28T20:09:52.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.400+0000 7f704effd640 1 -- 172.21.15.177:0/1359642782 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f703c003530 con 0x7f705006c800 2023-11-28T20:09:52.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.400+0000 7f704effd640 1 -- 172.21.15.177:0/1359642782 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957077061 0 0) 0x7f705006cc40 con 0x7f705015ad40 2023-11-28T20:09:52.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.400+0000 7f704effd640 1 -- 172.21.15.177:0/1359642782 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f705015b3a0 con 0x7f705015ad40 2023-11-28T20:09:52.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.400+0000 7f704f7fe640 1 -- 172.21.15.177:0/1359642782 >> v1:172.21.15.195:6789/0 conn(0x7f705015ad40 legacy=0x7f70500cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:52.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.400+0000 7f704f7fe640 1 -- 172.21.15.177:0/1359642782 >> v1:172.21.15.177:6789/0 conn(0x7f705006c800 legacy=0x7f705015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:52.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.400+0000 7f704f7fe640 1 -- 172.21.15.177:0/1359642782 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705013f720 con 0x7f705013cf30 2023-11-28T20:09:52.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.400+0000 7f704f7fe640 1 --2- 172.21.15.177:0/1359642782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f705013cf30 0x7f705006c2c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f70400097f0 tx=0x7f704001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2563b0e952590800 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:52.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.400+0000 7f704effd640 1 -- 172.21.15.177:0/1359642782 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70400ab600 con 0x7f705013cf30 2023-11-28T20:09:52.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.400+0000 7f704effd640 1 -- 172.21.15.177:0/1359642782 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70400a7050 con 0x7f705013cf30 2023-11-28T20:09:52.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.400+0000 7f704effd640 1 -- 172.21.15.177:0/1359642782 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70400ab980 con 0x7f705013cf30 2023-11-28T20:09:52.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f705605f640 1 -- 172.21.15.177:0/1359642782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f705013cf30 msgr2=0x7f705006c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:52.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f705605f640 1 --2- 172.21.15.177:0/1359642782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f705013cf30 0x7f705006c2c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f70400097f0 tx=0x7f704001c430 comp rx=0 tx=0).stop 2023-11-28T20:09:52.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f705605f640 1 -- 172.21.15.177:0/1359642782 shutdown_connections 2023-11-28T20:09:52.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f705605f640 1 --2- 172.21.15.177:0/1359642782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f705013cf30 0x7f705006c2c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:52.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f705605f640 1 -- 172.21.15.177:0/1359642782 >> 172.21.15.177:0/1359642782 conn(0x7f705006a530 msgr2=0x7f705006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:52.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f705605f640 1 -- 172.21.15.177:0/1359642782 shutdown_connections 2023-11-28T20:09:52.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f705605f640 1 -- 172.21.15.177:0/1359642782 wait complete. 2023-11-28T20:09:52.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f705605f640 1 Processor -- start 2023-11-28T20:09:52.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f705605f640 1 -- start start 2023-11-28T20:09:52.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f705605f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f705006c800 0x7f7050137850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:52.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f705605f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f705013cf30 0x7f7050154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:52.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f705605f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f705015ad40 0x7f7050071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:52.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f705605f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70501555d0 con 0x7f705006c800 2023-11-28T20:09:52.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f705605f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7050158600 con 0x7f705013cf30 2023-11-28T20:09:52.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f705605f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7050137d90 con 0x7f705015ad40 2023-11-28T20:09:52.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f704f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f705006c800 0x7f7050137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:52.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f704f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f705006c800 0x7f7050137850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51492/0 (socket says 172.21.15.177:51492) 2023-11-28T20:09:52.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f704f7fe640 1 -- 172.21.15.177:0/1733466212 learned_addr learned my addr 172.21.15.177:0/1733466212 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:52.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f7047fff640 1 --2- 172.21.15.177:0/1733466212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f705013cf30 0x7f7050154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:52.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f704ffff640 1 --2- 172.21.15.177:0/1733466212 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f705015ad40 0x7f7050071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:52.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f704f7fe640 1 -- 172.21.15.177:0/1733466212 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f705015ad40 msgr2=0x7f7050071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:52.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f704f7fe640 1 --2- 172.21.15.177:0/1733466212 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f705015ad40 0x7f7050071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:52.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f704f7fe640 1 -- 172.21.15.177:0/1733466212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f705013cf30 msgr2=0x7f7050154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:52.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f704f7fe640 1 --2- 172.21.15.177:0/1733466212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f705013cf30 0x7f7050154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:52.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.404+0000 7f704f7fe640 1 -- 172.21.15.177:0/1733466212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7040009420 con 0x7f705006c800 2023-11-28T20:09:52.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.408+0000 7f704f7fe640 1 --2- 172.21.15.177:0/1733466212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f705006c800 0x7f7050137850 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7040009740 tx=0x7f704001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:52.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.408+0000 7f704cff9640 1 -- 172.21.15.177:0/1733466212 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70400b7450 con 0x7f705006c800 2023-11-28T20:09:52.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.408+0000 7f704cff9640 1 -- 172.21.15.177:0/1733466212 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70400b75b0 con 0x7f705006c800 2023-11-28T20:09:52.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.408+0000 7f705605f640 1 -- 172.21.15.177:0/1733466212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70501557b0 con 0x7f705006c800 2023-11-28T20:09:52.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.408+0000 7f704cff9640 1 -- 172.21.15.177:0/1733466212 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70400b7960 con 0x7f705006c800 2023-11-28T20:09:52.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.408+0000 7f705605f640 1 -- 172.21.15.177:0/1733466212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7050155d70 con 0x7f705006c800 2023-11-28T20:09:52.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.408+0000 7f705605f640 1 -- 172.21.15.177:0/1733466212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7050070440 con 0x7f705006c800 2023-11-28T20:09:52.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.408+0000 7f704cff9640 1 -- 172.21.15.177:0/1733466212 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f70400b7ac0 con 0x7f705006c800 2023-11-28T20:09:52.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.408+0000 7f704cff9640 1 --2- 172.21.15.177:0/1733466212 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70300664a0 0x7f7030068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:52.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.408+0000 7f704cff9640 1 -- 172.21.15.177:0/1733466212 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f704011ded0 con 0x7f705006c800 2023-11-28T20:09:52.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.408+0000 7f7047fff640 1 --2- 172.21.15.177:0/1733466212 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70300664a0 0x7f7030068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:52.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.408+0000 7f7047fff640 1 --2- 172.21.15.177:0/1733466212 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70300664a0 0x7f7030068960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f705014c6f0 tx=0x7f7038007d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:52.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.412+0000 7f704cff9640 1 -- 172.21.15.177:0/1733466212 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7050070440 con 0x7f705006c800 2023-11-28T20:09:52.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.560+0000 7f705605f640 1 -- 172.21.15.177:0/1733466212 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7050070440 con 0x7f70300664a0 2023-11-28T20:09:52.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.568+0000 7f704cff9640 1 -- 172.21.15.177:0/1733466212 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289133 (secure 0 0 0) 0x7f7050070440 con 0x7f70300664a0 2023-11-28T20:09:52.576 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:52.578 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:09:52.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.572+0000 7f705605f640 1 -- 172.21.15.177:0/1733466212 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70300664a0 msgr2=0x7f7030068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:52.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.572+0000 7f705605f640 1 --2- 172.21.15.177:0/1733466212 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70300664a0 0x7f7030068960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f705014c6f0 tx=0x7f7038007d80 comp rx=0 tx=0).stop 2023-11-28T20:09:52.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.572+0000 7f705605f640 1 -- 172.21.15.177:0/1733466212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f705006c800 msgr2=0x7f7050137850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:52.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.572+0000 7f705605f640 1 --2- 172.21.15.177:0/1733466212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f705006c800 0x7f7050137850 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7040009740 tx=0x7f704001ac70 comp rx=0 tx=0).stop 2023-11-28T20:09:52.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.572+0000 7f705605f640 1 -- 172.21.15.177:0/1733466212 shutdown_connections 2023-11-28T20:09:52.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.572+0000 7f705605f640 1 --2- 172.21.15.177:0/1733466212 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f70300664a0 0x7f7030068960 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:52.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.572+0000 7f705605f640 1 --2- 172.21.15.177:0/1733466212 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f705015ad40 0x7f7050071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:52.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.572+0000 7f705605f640 1 --2- 172.21.15.177:0/1733466212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f705013cf30 0x7f7050154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:52.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.572+0000 7f705605f640 1 --2- 172.21.15.177:0/1733466212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f705006c800 0x7f7050137850 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:52.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.572+0000 7f705605f640 1 -- 172.21.15.177:0/1733466212 >> 172.21.15.177:0/1733466212 conn(0x7f705006a530 msgr2=0x7f705015c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:52.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.572+0000 7f705605f640 1 -- 172.21.15.177:0/1733466212 shutdown_connections 2023-11-28T20:09:52.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.572+0000 7f705605f640 1 -- 172.21.15.177:0/1733466212 wait complete. 2023-11-28T20:09:52.596 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-11-28T20:09:51.443767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242756,"kb_used_data":5768,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731964,"statfs":{"total":773094113280,"available":772845531136,"internally_reserved":0,"allocated":5906432,"data_stored":3122172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001729"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.675753+0000","last_change":"2023-11-28T20:09:43.679275+0000","last_active":"2023-11-28T20:09:44.675753+0000","last_peered":"2023-11-28T20:09:44.675753+0000","last_clean":"2023-11-28T20:09:44.675753+0000","last_became_active":"2023-11-28T20:09:43.678634+0000","last_became_peered":"2023-11-28T20:09:43.678634+0000","last_unstale":"2023-11-28T20:09:44.675753+0000","last_undegraded":"2023-11-28T20:09:44.675753+0000","last_fullsized":"2023-11-28T20:09:44.675753+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:48:38.405666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.905175+0000","last_change":"2023-11-28T20:09:43.678281+0000","last_active":"2023-11-28T20:09:44.905175+0000","last_peered":"2023-11-28T20:09:44.905175+0000","last_clean":"2023-11-28T20:09:44.905175+0000","last_became_active":"2023-11-28T20:09:43.677996+0000","last_became_peered":"2023-11-28T20:09:43.677996+0000","last_unstale":"2023-11-28T20:09:44.905175+0000","last_undegraded":"2023-11-28T20:09:44.905175+0000","last_fullsized":"2023-11-28T20:09:44.905175+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:03:06.529956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.194064+0000","last_change":"2023-11-28T20:09:43.680530+0000","last_active":"2023-11-28T20:09:45.194064+0000","last_peered":"2023-11-28T20:09:45.194064+0000","last_clean":"2023-11-28T20:09:45.194064+0000","last_became_active":"2023-11-28T20:09:43.679246+0000","last_became_peered":"2023-11-28T20:09:43.679246+0000","last_unstale":"2023-11-28T20:09:45.194064+0000","last_undegraded":"2023-11-28T20:09:45.194064+0000","last_fullsized":"2023-11-28T20:09:45.194064+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:52:08.788154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.904887+0000","last_change":"2023-11-28T20:09:43.668248+0000","last_active":"2023-11-28T20:09:44.904887+0000","last_peered":"2023-11-28T20:09:44.904887+0000","last_clean":"2023-11-28T20:09:44.904887+0000","last_became_active":"2023-11-28T20:09:43.667341+0000","last_became_peered":"2023-11-28T20:09:43.667341+0000","last_unstale":"2023-11-28T20:09:44.904887+0000","last_undegraded":"2023-11-28T20:09:44.904887+0000","last_fullsized":"2023-11-28T20:09:44.904887+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:01.871841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.917510+0000","last_change":"2023-11-28T20:09:43.674483+0000","last_active":"2023-11-28T20:09:45.917510+0000","last_peered":"2023-11-28T20:09:45.917510+0000","last_clean":"2023-11-28T20:09:45.917510+0000","last_became_active":"2023-11-28T20:09:43.674164+0000","last_became_peered":"2023-11-28T20:09:43.674164+0000","last_unstale":"2023-11-28T20:09:45.917510+0000","last_undegraded":"2023-11-28T20:09:45.917510+0000","last_fullsized":"2023-11-28T20:09:45.917510+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:08:56.639137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.676063+0000","last_change":"2023-11-28T20:09:43.671854+0000","last_active":"2023-11-28T20:09:44.676063+0000","last_peered":"2023-11-28T20:09:44.676063+0000","last_clean":"2023-11-28T20:09:44.676063+0000","last_became_active":"2023-11-28T20:09:43.671415+0000","last_became_peered":"2023-11-28T20:09:43.671415+0000","last_unstale":"2023-11-28T20:09:44.676063+0000","last_undegraded":"2023-11-28T20:09:44.676063+0000","last_fullsized":"2023-11-28T20:09:44.676063+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:13.831972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.193628+0000","last_change":"2023-11-28T20:09:43.671717+0000","last_active":"2023-11-28T20:09:45.193628+0000","last_peered":"2023-11-28T20:09:45.193628+0000","last_clean":"2023-11-28T20:09:45.193628+0000","last_became_active":"2023-11-28T20:09:43.671491+0000","last_became_peered":"2023-11-28T20:09:43.671491+0000","last_unstale":"2023-11-28T20:09:45.193628+0000","last_undegraded":"2023-11-28T20:09:45.193628+0000","last_fullsized":"2023-11-28T20:09:45.193628+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:08.490475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.676111+0000","last_change":"2023-11-28T20:09:43.691387+0000","last_active":"2023-11-28T20:09:44.676111+0000","last_peered":"2023-11-28T20:09:44.676111+0000","last_clean":"2023-11-28T20:09:44.676111+0000","last_became_active":"2023-11-28T20:09:43.689394+0000","last_became_peered":"2023-11-28T20:09:43.689394+0000","last_unstale":"2023-11-28T20:09:44.676111+0000","last_undegraded":"2023-11-28T20:09:44.676111+0000","last_fullsized":"2023-11-28T20:09:44.676111+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:46.527711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.677930+0000","last_change":"2023-11-28T20:09:43.680807+0000","last_active":"2023-11-28T20:09:44.677930+0000","last_peered":"2023-11-28T20:09:44.677930+0000","last_clean":"2023-11-28T20:09:44.677930+0000","last_became_active":"2023-11-28T20:09:43.680466+0000","last_became_peered":"2023-11-28T20:09:43.680466+0000","last_unstale":"2023-11-28T20:09:44.677930+0000","last_undegraded":"2023-11-28T20:09:44.677930+0000","last_fullsized":"2023-11-28T20:09:44.677930+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:01:11.271422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.675766+0000","last_change":"2023-11-28T20:09:43.666203+0000","last_active":"2023-11-28T20:09:44.675766+0000","last_peered":"2023-11-28T20:09:44.675766+0000","last_clean":"2023-11-28T20:09:44.675766+0000","last_became_active":"2023-11-28T20:09:43.665959+0000","last_became_peered":"2023-11-28T20:09:43.665959+0000","last_unstale":"2023-11-28T20:09:44.675766+0000","last_undegraded":"2023-11-28T20:09:44.675766+0000","last_fullsized":"2023-11-28T20:09:44.675766+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:26.765941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.676646+0000","last_change":"2023-11-28T20:09:43.673178+0000","last_active":"2023-11-28T20:09:44.676646+0000","last_peered":"2023-11-28T20:09:44.676646+0000","last_clean":"2023-11-28T20:09:44.676646+0000","last_became_active":"2023-11-28T20:09:43.672923+0000","last_became_peered":"2023-11-28T20:09:43.672923+0000","last_unstale":"2023-11-28T20:09:44.676646+0000","last_undegraded":"2023-11-28T20:09:44.676646+0000","last_fullsized":"2023-11-28T20:09:44.676646+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:52:00.925724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.677639+0000","last_change":"2023-11-28T20:09:43.677435+0000","last_active":"2023-11-28T20:09:44.677639+0000","last_peered":"2023-11-28T20:09:44.677639+0000","last_clean":"2023-11-28T20:09:44.677639+0000","last_became_active":"2023-11-28T20:09:43.677079+0000","last_became_peered":"2023-11-28T20:09:43.677079+0000","last_unstale":"2023-11-28T20:09:44.677639+0000","last_undegraded":"2023-11-28T20:09:44.677639+0000","last_fullsized":"2023-11-28T20:09:44.677639+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:34:55.274816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.676000+0000","last_change":"2023-11-28T20:09:43.666141+0000","last_active":"2023-11-28T20:09:44.676000+0000","last_peered":"2023-11-28T20:09:44.676000+0000","last_clean":"2023-11-28T20:09:44.676000+0000","last_became_active":"2023-11-28T20:09:43.665877+0000","last_became_peered":"2023-11-28T20:09:43.665877+0000","last_unstale":"2023-11-28T20:09:44.676000+0000","last_undegraded":"2023-11-28T20:09:44.676000+0000","last_fullsized":"2023-11-28T20:09:44.676000+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:58.635023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.193725+0000","last_change":"2023-11-28T20:09:43.680204+0000","last_active":"2023-11-28T20:09:45.193725+0000","last_peered":"2023-11-28T20:09:45.193725+0000","last_clean":"2023-11-28T20:09:45.193725+0000","last_became_active":"2023-11-28T20:09:43.679815+0000","last_became_peered":"2023-11-28T20:09:43.679815+0000","last_unstale":"2023-11-28T20:09:45.193725+0000","last_undegraded":"2023-11-28T20:09:45.193725+0000","last_fullsized":"2023-11-28T20:09:45.193725+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:08:23.520438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.904764+0000","last_change":"2023-11-28T20:09:43.678569+0000","last_active":"2023-11-28T20:09:44.904764+0000","last_peered":"2023-11-28T20:09:44.904764+0000","last_clean":"2023-11-28T20:09:44.904764+0000","last_became_active":"2023-11-28T20:09:43.677534+0000","last_became_peered":"2023-11-28T20:09:43.677534+0000","last_unstale":"2023-11-28T20:09:44.904764+0000","last_undegraded":"2023-11-28T20:09:44.904764+0000","last_fullsized":"2023-11-28T20:09:44.904764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:46.063070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.675624+0000","last_change":"2023-11-28T20:09:43.666808+0000","last_active":"2023-11-28T20:09:44.675624+0000","last_peered":"2023-11-28T20:09:44.675624+0000","last_clean":"2023-11-28T20:09:44.675624+0000","last_became_active":"2023-11-28T20:09:43.666597+0000","last_became_peered":"2023-11-28T20:09:43.666597+0000","last_unstale":"2023-11-28T20:09:44.675624+0000","last_undegraded":"2023-11-28T20:09:44.675624+0000","last_fullsized":"2023-11-28T20:09:44.675624+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:52.362625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.194176+0000","last_change":"2023-11-28T20:09:43.681506+0000","last_active":"2023-11-28T20:09:45.194176+0000","last_peered":"2023-11-28T20:09:45.194176+0000","last_clean":"2023-11-28T20:09:45.194176+0000","last_became_active":"2023-11-28T20:09:43.681041+0000","last_became_peered":"2023-11-28T20:09:43.681041+0000","last_unstale":"2023-11-28T20:09:45.194176+0000","last_undegraded":"2023-11-28T20:09:45.194176+0000","last_fullsized":"2023-11-28T20:09:45.194176+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:03:06.529956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.905295+0000","last_change":"2023-11-28T20:09:43.684615+0000","last_active":"2023-11-28T20:09:44.905295+0000","last_peered":"2023-11-28T20:09:44.905295+0000","last_clean":"2023-11-28T20:09:44.905295+0000","last_became_active":"2023-11-28T20:09:43.684308+0000","last_became_peered":"2023-11-28T20:09:43.684308+0000","last_unstale":"2023-11-28T20:09:44.905295+0000","last_undegraded":"2023-11-28T20:09:44.905295+0000","last_fullsized":"2023-11-28T20:09:44.905295+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:18:43.769705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.194033+0000","last_change":"2023-11-28T20:09:43.672792+0000","last_active":"2023-11-28T20:09:45.194033+0000","last_peered":"2023-11-28T20:09:45.194033+0000","last_clean":"2023-11-28T20:09:45.194033+0000","last_became_active":"2023-11-28T20:09:43.672241+0000","last_became_peered":"2023-11-28T20:09:43.672241+0000","last_unstale":"2023-11-28T20:09:45.194033+0000","last_undegraded":"2023-11-28T20:09:45.194033+0000","last_fullsized":"2023-11-28T20:09:45.194033+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:46.063070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.749430+0000","last_change":"2023-11-28T20:09:43.675838+0000","last_active":"2023-11-28T20:09:45.749430+0000","last_peered":"2023-11-28T20:09:45.749430+0000","last_clean":"2023-11-28T20:09:45.749430+0000","last_became_active":"2023-11-28T20:09:43.675293+0000","last_became_peered":"2023-11-28T20:09:43.675293+0000","last_unstale":"2023-11-28T20:09:45.749430+0000","last_undegraded":"2023-11-28T20:09:45.749430+0000","last_fullsized":"2023-11-28T20:09:45.749430+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:42.808900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.749357+0000","last_change":"2023-11-28T20:09:43.673247+0000","last_active":"2023-11-28T20:09:45.749357+0000","last_peered":"2023-11-28T20:09:45.749357+0000","last_clean":"2023-11-28T20:09:45.749357+0000","last_became_active":"2023-11-28T20:09:43.672879+0000","last_became_peered":"2023-11-28T20:09:43.672879+0000","last_unstale":"2023-11-28T20:09:45.749357+0000","last_undegraded":"2023-11-28T20:09:45.749357+0000","last_fullsized":"2023-11-28T20:09:45.749357+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:12:49.307101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.676614+0000","last_change":"2023-11-28T20:09:43.685217+0000","last_active":"2023-11-28T20:09:44.676614+0000","last_peered":"2023-11-28T20:09:44.676614+0000","last_clean":"2023-11-28T20:09:44.676614+0000","last_became_active":"2023-11-28T20:09:43.684907+0000","last_became_peered":"2023-11-28T20:09:43.684907+0000","last_unstale":"2023-11-28T20:09:44.676614+0000","last_undegraded":"2023-11-28T20:09:44.676614+0000","last_fullsized":"2023-11-28T20:09:44.676614+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:56.251918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.675231+0000","last_change":"2023-11-28T20:09:43.672470+0000","last_active":"2023-11-28T20:09:44.675231+0000","last_peered":"2023-11-28T20:09:44.675231+0000","last_clean":"2023-11-28T20:09:44.675231+0000","last_became_active":"2023-11-28T20:09:43.672144+0000","last_became_peered":"2023-11-28T20:09:43.672144+0000","last_unstale":"2023-11-28T20:09:44.675231+0000","last_undegraded":"2023-11-28T20:09:44.675231+0000","last_fullsized":"2023-11-28T20:09:44.675231+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:49.604599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.193541+0000","last_change":"2023-11-28T20:09:43.668647+0000","last_active":"2023-11-28T20:09:45.193541+0000","last_peered":"2023-11-28T20:09:45.193541+0000","last_clean":"2023-11-28T20:09:45.193541+0000","last_became_active":"2023-11-28T20:09:43.668359+0000","last_became_peered":"2023-11-28T20:09:43.668359+0000","last_unstale":"2023-11-28T20:09:45.193541+0000","last_undegraded":"2023-11-28T20:09:45.193541+0000","last_fullsized":"2023-11-28T20:09:45.193541+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:38.813926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.194330+0000","last_change":"2023-11-28T20:09:43.669730+0000","last_active":"2023-11-28T20:09:45.194330+0000","last_peered":"2023-11-28T20:09:45.194330+0000","last_clean":"2023-11-28T20:09:45.194330+0000","last_became_active":"2023-11-28T20:09:43.669414+0000","last_became_peered":"2023-11-28T20:09:43.669414+0000","last_unstale":"2023-11-28T20:09:45.194330+0000","last_undegraded":"2023-11-28T20:09:45.194330+0000","last_fullsized":"2023-11-28T20:09:45.194330+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:18:43.769705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.677884+0000","last_change":"2023-11-28T20:09:43.669978+0000","last_active":"2023-11-28T20:09:44.677884+0000","last_peered":"2023-11-28T20:09:44.677884+0000","last_clean":"2023-11-28T20:09:44.677884+0000","last_became_active":"2023-11-28T20:09:43.669514+0000","last_became_peered":"2023-11-28T20:09:43.669514+0000","last_unstale":"2023-11-28T20:09:44.677884+0000","last_undegraded":"2023-11-28T20:09:44.677884+0000","last_fullsized":"2023-11-28T20:09:44.677884+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:32.979269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.676332+0000","last_change":"2023-11-28T20:09:43.686540+0000","last_active":"2023-11-28T20:09:44.676332+0000","last_peered":"2023-11-28T20:09:44.676332+0000","last_clean":"2023-11-28T20:09:44.676332+0000","last_became_active":"2023-11-28T20:09:43.685907+0000","last_became_peered":"2023-11-28T20:09:43.685907+0000","last_unstale":"2023-11-28T20:09:44.676332+0000","last_undegraded":"2023-11-28T20:09:44.676332+0000","last_fullsized":"2023-11-28T20:09:44.676332+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:12.515161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.749581+0000","last_change":"2023-11-28T20:09:43.675712+0000","last_active":"2023-11-28T20:09:45.749581+0000","last_peered":"2023-11-28T20:09:45.749581+0000","last_clean":"2023-11-28T20:09:45.749581+0000","last_became_active":"2023-11-28T20:09:43.674971+0000","last_became_peered":"2023-11-28T20:09:43.674971+0000","last_unstale":"2023-11-28T20:09:45.749581+0000","last_undegraded":"2023-11-28T20:09:45.749581+0000","last_fullsized":"2023-11-28T20:09:45.749581+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:50.642477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.193775+0000","last_change":"2023-11-28T20:09:43.675354+0000","last_active":"2023-11-28T20:09:45.193775+0000","last_peered":"2023-11-28T20:09:45.193775+0000","last_clean":"2023-11-28T20:09:45.193775+0000","last_became_active":"2023-11-28T20:09:43.675097+0000","last_became_peered":"2023-11-28T20:09:43.675097+0000","last_unstale":"2023-11-28T20:09:45.193775+0000","last_undegraded":"2023-11-28T20:09:45.193775+0000","last_fullsized":"2023-11-28T20:09:45.193775+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:49:02.119490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.904887+0000","last_change":"2023-11-28T20:09:43.676713+0000","last_active":"2023-11-28T20:09:44.904887+0000","last_peered":"2023-11-28T20:09:44.904887+0000","last_clean":"2023-11-28T20:09:44.904887+0000","last_became_active":"2023-11-28T20:09:43.676345+0000","last_became_peered":"2023-11-28T20:09:43.676345+0000","last_unstale":"2023-11-28T20:09:44.904887+0000","last_undegraded":"2023-11-28T20:09:44.904887+0000","last_fullsized":"2023-11-28T20:09:44.904887+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:52:08.788154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.193667+0000","last_change":"2023-11-28T20:09:43.680016+0000","last_active":"2023-11-28T20:09:45.193667+0000","last_peered":"2023-11-28T20:09:45.193667+0000","last_clean":"2023-11-28T20:09:45.193667+0000","last_became_active":"2023-11-28T20:09:43.679746+0000","last_became_peered":"2023-11-28T20:09:43.679746+0000","last_unstale":"2023-11-28T20:09:45.193667+0000","last_undegraded":"2023-11-28T20:09:45.193667+0000","last_fullsized":"2023-11-28T20:09:45.193667+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:54.429388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.876902+0000","last_change":"2023-11-28T20:09:43.667836+0000","last_active":"2023-11-28T20:09:45.876902+0000","last_peered":"2023-11-28T20:09:45.876902+0000","last_clean":"2023-11-28T20:09:45.876902+0000","last_became_active":"2023-11-28T20:09:43.667566+0000","last_became_peered":"2023-11-28T20:09:43.667566+0000","last_unstale":"2023-11-28T20:09:45.876902+0000","last_undegraded":"2023-11-28T20:09:45.876902+0000","last_fullsized":"2023-11-28T20:09:45.876902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:51.371777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.904611+0000","last_change":"2023-11-28T20:09:43.682989+0000","last_active":"2023-11-28T20:09:44.904611+0000","last_peered":"2023-11-28T20:09:44.904611+0000","last_clean":"2023-11-28T20:09:44.904611+0000","last_became_active":"2023-11-28T20:09:43.682699+0000","last_became_peered":"2023-11-28T20:09:43.682699+0000","last_unstale":"2023-11-28T20:09:44.904611+0000","last_undegraded":"2023-11-28T20:09:44.904611+0000","last_fullsized":"2023-11-28T20:09:44.904611+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:05.048605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"48'4","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.692762+0000","last_change":"2023-11-28T20:09:42.666794+0000","last_active":"2023-11-28T20:09:43.692762+0000","last_peered":"2023-11-28T20:09:43.692762+0000","last_clean":"2023-11-28T20:09:43.692762+0000","last_became_active":"2023-11-28T20:09:42.666513+0000","last_became_peered":"2023-11-28T20:09:42.666513+0000","last_unstale":"2023-11-28T20:09:43.692762+0000","last_undegraded":"2023-11-28T20:09:43.692762+0000","last_fullsized":"2023-11-28T20:09:43.692762+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:13.499186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.876756+0000","last_change":"2023-11-28T20:09:43.671373+0000","last_active":"2023-11-28T20:09:45.876756+0000","last_peered":"2023-11-28T20:09:45.876756+0000","last_clean":"2023-11-28T20:09:45.876756+0000","last_became_active":"2023-11-28T20:09:43.671064+0000","last_became_peered":"2023-11-28T20:09:43.671064+0000","last_unstale":"2023-11-28T20:09:45.876756+0000","last_undegraded":"2023-11-28T20:09:45.876756+0000","last_fullsized":"2023-11-28T20:09:45.876756+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:13.831972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"48'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.699044+0000","last_change":"2023-11-28T20:09:42.674692+0000","last_active":"2023-11-28T20:09:43.699044+0000","last_peered":"2023-11-28T20:09:43.699044+0000","last_clean":"2023-11-28T20:09:43.699044+0000","last_became_active":"2023-11-28T20:09:42.674364+0000","last_became_peered":"2023-11-28T20:09:42.674364+0000","last_unstale":"2023-11-28T20:09:43.699044+0000","last_undegraded":"2023-11-28T20:09:43.699044+0000","last_fullsized":"2023-11-28T20:09:43.699044+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:46:44.388109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.749329+0000","last_change":"2023-11-28T20:09:43.674032+0000","last_active":"2023-11-28T20:09:45.749329+0000","last_peered":"2023-11-28T20:09:45.749329+0000","last_clean":"2023-11-28T20:09:45.749329+0000","last_became_active":"2023-11-28T20:09:43.672963+0000","last_became_peered":"2023-11-28T20:09:43.672963+0000","last_unstale":"2023-11-28T20:09:45.749329+0000","last_undegraded":"2023-11-28T20:09:45.749329+0000","last_fullsized":"2023-11-28T20:09:45.749329+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:21:39.461654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.691400+0000","last_change":"2023-11-28T20:09:42.670599+0000","last_active":"2023-11-28T20:09:43.691400+0000","last_peered":"2023-11-28T20:09:43.691400+0000","last_clean":"2023-11-28T20:09:43.691400+0000","last_became_active":"2023-11-28T20:09:42.670216+0000","last_became_peered":"2023-11-28T20:09:42.670216+0000","last_unstale":"2023-11-28T20:09:43.691400+0000","last_undegraded":"2023-11-28T20:09:43.691400+0000","last_fullsized":"2023-11-28T20:09:43.691400+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:06:19.110045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.676566+0000","last_change":"2023-11-28T20:09:43.664009+0000","last_active":"2023-11-28T20:09:44.676566+0000","last_peered":"2023-11-28T20:09:44.676566+0000","last_clean":"2023-11-28T20:09:44.676566+0000","last_became_active":"2023-11-28T20:09:43.663693+0000","last_became_peered":"2023-11-28T20:09:43.663693+0000","last_unstale":"2023-11-28T20:09:44.676566+0000","last_undegraded":"2023-11-28T20:09:44.676566+0000","last_fullsized":"2023-11-28T20:09:44.676566+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:40:11.147313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.697071+0000","last_change":"2023-11-28T20:09:42.674101+0000","last_active":"2023-11-28T20:09:43.697071+0000","last_peered":"2023-11-28T20:09:43.697071+0000","last_clean":"2023-11-28T20:09:43.697071+0000","last_became_active":"2023-11-28T20:09:42.673725+0000","last_became_peered":"2023-11-28T20:09:42.673725+0000","last_unstale":"2023-11-28T20:09:43.697071+0000","last_undegraded":"2023-11-28T20:09:43.697071+0000","last_fullsized":"2023-11-28T20:09:43.697071+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:25.757605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.917381+0000","last_change":"2023-11-28T20:09:43.688231+0000","last_active":"2023-11-28T20:09:45.917381+0000","last_peered":"2023-11-28T20:09:45.917381+0000","last_clean":"2023-11-28T20:09:45.917381+0000","last_became_active":"2023-11-28T20:09:43.687920+0000","last_became_peered":"2023-11-28T20:09:43.687920+0000","last_unstale":"2023-11-28T20:09:45.917381+0000","last_undegraded":"2023-11-28T20:09:45.917381+0000","last_fullsized":"2023-11-28T20:09:45.917381+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:34:40.174571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"48'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.695219+0000","last_change":"2023-11-28T20:09:42.664506+0000","last_active":"2023-11-28T20:09:43.695219+0000","last_peered":"2023-11-28T20:09:43.695219+0000","last_clean":"2023-11-28T20:09:43.695219+0000","last_became_active":"2023-11-28T20:09:42.664199+0000","last_became_peered":"2023-11-28T20:09:42.664199+0000","last_unstale":"2023-11-28T20:09:43.695219+0000","last_undegraded":"2023-11-28T20:09:43.695219+0000","last_fullsized":"2023-11-28T20:09:43.695219+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:12.823637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.905088+0000","last_change":"2023-11-28T20:09:43.675604+0000","last_active":"2023-11-28T20:09:44.905088+0000","last_peered":"2023-11-28T20:09:44.905088+0000","last_clean":"2023-11-28T20:09:44.905088+0000","last_became_active":"2023-11-28T20:09:43.675315+0000","last_became_peered":"2023-11-28T20:09:43.675315+0000","last_unstale":"2023-11-28T20:09:44.905088+0000","last_undegraded":"2023-11-28T20:09:44.905088+0000","last_fullsized":"2023-11-28T20:09:44.905088+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:46.233552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"48'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.687417+0000","last_change":"2023-11-28T20:09:42.670093+0000","last_active":"2023-11-28T20:09:43.687417+0000","last_peered":"2023-11-28T20:09:43.687417+0000","last_clean":"2023-11-28T20:09:43.687417+0000","last_became_active":"2023-11-28T20:09:42.669832+0000","last_became_peered":"2023-11-28T20:09:42.669832+0000","last_unstale":"2023-11-28T20:09:43.687417+0000","last_undegraded":"2023-11-28T20:09:43.687417+0000","last_fullsized":"2023-11-28T20:09:43.687417+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:17.507022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.678011+0000","last_change":"2023-11-28T20:09:43.669803+0000","last_active":"2023-11-28T20:09:44.678011+0000","last_peered":"2023-11-28T20:09:44.678011+0000","last_clean":"2023-11-28T20:09:44.678011+0000","last_became_active":"2023-11-28T20:09:43.669180+0000","last_became_peered":"2023-11-28T20:09:43.669180+0000","last_unstale":"2023-11-28T20:09:44.678011+0000","last_undegraded":"2023-11-28T20:09:44.678011+0000","last_fullsized":"2023-11-28T20:09:44.678011+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:43:55.076570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.661819+0000","last_change":"2023-11-28T20:09:42.666410+0000","last_active":"2023-11-28T20:09:43.661819+0000","last_peered":"2023-11-28T20:09:43.661819+0000","last_clean":"2023-11-28T20:09:43.661819+0000","last_became_active":"2023-11-28T20:09:42.666065+0000","last_became_peered":"2023-11-28T20:09:42.666065+0000","last_unstale":"2023-11-28T20:09:43.661819+0000","last_undegraded":"2023-11-28T20:09:43.661819+0000","last_fullsized":"2023-11-28T20:09:43.661819+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:54:40.313292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.905231+0000","last_change":"2023-11-28T20:09:43.685944+0000","last_active":"2023-11-28T20:09:44.905231+0000","last_peered":"2023-11-28T20:09:44.905231+0000","last_clean":"2023-11-28T20:09:44.905231+0000","last_became_active":"2023-11-28T20:09:43.685616+0000","last_became_peered":"2023-11-28T20:09:43.685616+0000","last_unstale":"2023-11-28T20:09:44.905231+0000","last_undegraded":"2023-11-28T20:09:44.905231+0000","last_fullsized":"2023-11-28T20:09:44.905231+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:09.875900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.667493+0000","last_change":"2023-11-28T20:09:42.671231+0000","last_active":"2023-11-28T20:09:43.667493+0000","last_peered":"2023-11-28T20:09:43.667493+0000","last_clean":"2023-11-28T20:09:43.667493+0000","last_became_active":"2023-11-28T20:09:42.670957+0000","last_became_peered":"2023-11-28T20:09:42.670957+0000","last_unstale":"2023-11-28T20:09:43.667493+0000","last_undegraded":"2023-11-28T20:09:43.667493+0000","last_fullsized":"2023-11-28T20:09:43.667493+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:34.195428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.916951+0000","last_change":"2023-11-28T20:09:43.669382+0000","last_active":"2023-11-28T20:09:45.916951+0000","last_peered":"2023-11-28T20:09:45.916951+0000","last_clean":"2023-11-28T20:09:45.916951+0000","last_became_active":"2023-11-28T20:09:43.669094+0000","last_became_peered":"2023-11-28T20:09:43.669094+0000","last_unstale":"2023-11-28T20:09:45.916951+0000","last_undegraded":"2023-11-28T20:09:45.916951+0000","last_fullsized":"2023-11-28T20:09:45.916951+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:40.380220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.659325+0000","last_change":"2023-11-28T20:09:42.666932+0000","last_active":"2023-11-28T20:09:43.659325+0000","last_peered":"2023-11-28T20:09:43.659325+0000","last_clean":"2023-11-28T20:09:43.659325+0000","last_became_active":"2023-11-28T20:09:42.666671+0000","last_became_peered":"2023-11-28T20:09:42.666671+0000","last_unstale":"2023-11-28T20:09:43.659325+0000","last_undegraded":"2023-11-28T20:09:43.659325+0000","last_fullsized":"2023-11-28T20:09:43.659325+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:50.363442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.876661+0000","last_change":"2023-11-28T20:09:43.668160+0000","last_active":"2023-11-28T20:09:45.876661+0000","last_peered":"2023-11-28T20:09:45.876661+0000","last_clean":"2023-11-28T20:09:45.876661+0000","last_became_active":"2023-11-28T20:09:43.667874+0000","last_became_peered":"2023-11-28T20:09:43.667874+0000","last_unstale":"2023-11-28T20:09:45.876661+0000","last_undegraded":"2023-11-28T20:09:45.876661+0000","last_fullsized":"2023-11-28T20:09:45.876661+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:35.203763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.660492+0000","last_change":"2023-11-28T20:09:42.680303+0000","last_active":"2023-11-28T20:09:43.660492+0000","last_peered":"2023-11-28T20:09:43.660492+0000","last_clean":"2023-11-28T20:09:43.660492+0000","last_became_active":"2023-11-28T20:09:42.680028+0000","last_became_peered":"2023-11-28T20:09:42.680028+0000","last_unstale":"2023-11-28T20:09:43.660492+0000","last_undegraded":"2023-11-28T20:09:43.660492+0000","last_fullsized":"2023-11-28T20:09:43.660492+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:21:38.453319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.193770+0000","last_change":"2023-11-28T20:09:43.678756+0000","last_active":"2023-11-28T20:09:45.193770+0000","last_peered":"2023-11-28T20:09:45.193770+0000","last_clean":"2023-11-28T20:09:45.193770+0000","last_became_active":"2023-11-28T20:09:43.678485+0000","last_became_peered":"2023-11-28T20:09:43.678485+0000","last_unstale":"2023-11-28T20:09:45.193770+0000","last_undegraded":"2023-11-28T20:09:45.193770+0000","last_fullsized":"2023-11-28T20:09:45.193770+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:19:10.186131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"48'3","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.693501+0000","last_change":"2023-11-28T20:09:42.674301+0000","last_active":"2023-11-28T20:09:43.693501+0000","last_peered":"2023-11-28T20:09:43.693501+0000","last_clean":"2023-11-28T20:09:43.693501+0000","last_became_active":"2023-11-28T20:09:42.673651+0000","last_became_peered":"2023-11-28T20:09:42.673651+0000","last_unstale":"2023-11-28T20:09:43.693501+0000","last_undegraded":"2023-11-28T20:09:43.693501+0000","last_fullsized":"2023-11-28T20:09:43.693501+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:33.894590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.917576+0000","last_change":"2023-11-28T20:09:43.670298+0000","last_active":"2023-11-28T20:09:45.917576+0000","last_peered":"2023-11-28T20:09:45.917576+0000","last_clean":"2023-11-28T20:09:45.917576+0000","last_became_active":"2023-11-28T20:09:43.669913+0000","last_became_peered":"2023-11-28T20:09:43.669913+0000","last_unstale":"2023-11-28T20:09:45.917576+0000","last_undegraded":"2023-11-28T20:09:45.917576+0000","last_fullsized":"2023-11-28T20:09:45.917576+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:43.015574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"48'6","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.700791+0000","last_change":"2023-11-28T20:09:42.669553+0000","last_active":"2023-11-28T20:09:43.700791+0000","last_peered":"2023-11-28T20:09:43.700791+0000","last_clean":"2023-11-28T20:09:43.700791+0000","last_became_active":"2023-11-28T20:09:42.667456+0000","last_became_peered":"2023-11-28T20:09:42.667456+0000","last_unstale":"2023-11-28T20:09:43.700791+0000","last_undegraded":"2023-11-28T20:09:43.700791+0000","last_fullsized":"2023-11-28T20:09:43.700791+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:02:19.522340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.876949+0000","last_change":"2023-11-28T20:09:43.678217+0000","last_active":"2023-11-28T20:09:45.876949+0000","last_peered":"2023-11-28T20:09:45.876949+0000","last_clean":"2023-11-28T20:09:45.876949+0000","last_became_active":"2023-11-28T20:09:43.677946+0000","last_became_peered":"2023-11-28T20:09:43.677946+0000","last_unstale":"2023-11-28T20:09:45.876949+0000","last_undegraded":"2023-11-28T20:09:45.876949+0000","last_fullsized":"2023-11-28T20:09:45.876949+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:08:59.252802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.695675+0000","last_change":"2023-11-28T20:09:42.675080+0000","last_active":"2023-11-28T20:09:43.695675+0000","last_peered":"2023-11-28T20:09:43.695675+0000","last_clean":"2023-11-28T20:09:43.695675+0000","last_became_active":"2023-11-28T20:09:42.674739+0000","last_became_peered":"2023-11-28T20:09:42.674739+0000","last_unstale":"2023-11-28T20:09:43.695675+0000","last_undegraded":"2023-11-28T20:09:43.695675+0000","last_fullsized":"2023-11-28T20:09:43.695675+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:50.363442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.194192+0000","last_change":"2023-11-28T20:09:43.681080+0000","last_active":"2023-11-28T20:09:45.194192+0000","last_peered":"2023-11-28T20:09:45.194192+0000","last_clean":"2023-11-28T20:09:45.194192+0000","last_became_active":"2023-11-28T20:09:43.680773+0000","last_became_peered":"2023-11-28T20:09:43.680773+0000","last_unstale":"2023-11-28T20:09:45.194192+0000","last_undegraded":"2023-11-28T20:09:45.194192+0000","last_fullsized":"2023-11-28T20:09:45.194192+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:09.875900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.663347+0000","last_change":"2023-11-28T20:09:42.675061+0000","last_active":"2023-11-28T20:09:43.663347+0000","last_peered":"2023-11-28T20:09:43.663347+0000","last_clean":"2023-11-28T20:09:43.663347+0000","last_became_active":"2023-11-28T20:09:42.674720+0000","last_became_peered":"2023-11-28T20:09:42.674720+0000","last_unstale":"2023-11-28T20:09:43.663347+0000","last_undegraded":"2023-11-28T20:09:43.663347+0000","last_fullsized":"2023-11-28T20:09:43.663347+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:17.280206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.677890+0000","last_change":"2023-11-28T20:09:43.672439+0000","last_active":"2023-11-28T20:09:44.677890+0000","last_peered":"2023-11-28T20:09:44.677890+0000","last_clean":"2023-11-28T20:09:44.677890+0000","last_became_active":"2023-11-28T20:09:43.672153+0000","last_became_peered":"2023-11-28T20:09:43.672153+0000","last_unstale":"2023-11-28T20:09:44.677890+0000","last_undegraded":"2023-11-28T20:09:44.677890+0000","last_fullsized":"2023-11-28T20:09:44.677890+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:46.343191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.659741+0000","last_change":"2023-11-28T20:09:42.668166+0000","last_active":"2023-11-28T20:09:43.659741+0000","last_peered":"2023-11-28T20:09:43.659741+0000","last_clean":"2023-11-28T20:09:43.659741+0000","last_became_active":"2023-11-28T20:09:42.666450+0000","last_became_peered":"2023-11-28T20:09:42.666450+0000","last_unstale":"2023-11-28T20:09:43.659741+0000","last_undegraded":"2023-11-28T20:09:43.659741+0000","last_fullsized":"2023-11-28T20:09:43.659741+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:11.506826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.194341+0000","last_change":"2023-11-28T20:09:43.681324+0000","last_active":"2023-11-28T20:09:45.194341+0000","last_peered":"2023-11-28T20:09:45.194341+0000","last_clean":"2023-11-28T20:09:45.194341+0000","last_became_active":"2023-11-28T20:09:43.680677+0000","last_became_peered":"2023-11-28T20:09:43.680677+0000","last_unstale":"2023-11-28T20:09:45.194341+0000","last_undegraded":"2023-11-28T20:09:45.194341+0000","last_fullsized":"2023-11-28T20:09:45.194341+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:02:20.530675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"48'8","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.698987+0000","last_change":"2023-11-28T20:09:42.667815+0000","last_active":"2023-11-28T20:09:43.698987+0000","last_peered":"2023-11-28T20:09:43.698987+0000","last_clean":"2023-11-28T20:09:43.698987+0000","last_became_active":"2023-11-28T20:09:42.667502+0000","last_became_peered":"2023-11-28T20:09:42.667502+0000","last_unstale":"2023-11-28T20:09:43.698987+0000","last_undegraded":"2023-11-28T20:09:43.698987+0000","last_fullsized":"2023-11-28T20:09:43.698987+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:18:42.761370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.676233+0000","last_change":"2023-11-28T20:09:43.673886+0000","last_active":"2023-11-28T20:09:44.676233+0000","last_peered":"2023-11-28T20:09:44.676233+0000","last_clean":"2023-11-28T20:09:44.676233+0000","last_became_active":"2023-11-28T20:09:43.673613+0000","last_became_peered":"2023-11-28T20:09:43.673613+0000","last_unstale":"2023-11-28T20:09:44.676233+0000","last_undegraded":"2023-11-28T20:09:44.676233+0000","last_fullsized":"2023-11-28T20:09:44.676233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:58.010617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"48'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.696211+0000","last_change":"2023-11-28T20:09:42.673577+0000","last_active":"2023-11-28T20:09:43.696211+0000","last_peered":"2023-11-28T20:09:43.696211+0000","last_clean":"2023-11-28T20:09:43.696211+0000","last_became_active":"2023-11-28T20:09:42.673263+0000","last_became_peered":"2023-11-28T20:09:42.673263+0000","last_unstale":"2023-11-28T20:09:43.696211+0000","last_undegraded":"2023-11-28T20:09:43.696211+0000","last_fullsized":"2023-11-28T20:09:43.696211+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:59.639535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.675850+0000","last_change":"2023-11-28T20:09:43.684018+0000","last_active":"2023-11-28T20:09:44.675850+0000","last_peered":"2023-11-28T20:09:44.675850+0000","last_clean":"2023-11-28T20:09:44.675850+0000","last_became_active":"2023-11-28T20:09:43.683728+0000","last_became_peered":"2023-11-28T20:09:43.683728+0000","last_unstale":"2023-11-28T20:09:44.675850+0000","last_undegraded":"2023-11-28T20:09:44.675850+0000","last_fullsized":"2023-11-28T20:09:44.675850+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:19.365769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.690386+0000","last_change":"2023-11-28T20:09:42.666698+0000","last_active":"2023-11-28T20:09:43.690386+0000","last_peered":"2023-11-28T20:09:43.690386+0000","last_clean":"2023-11-28T20:09:43.690386+0000","last_became_active":"2023-11-28T20:09:42.666428+0000","last_became_peered":"2023-11-28T20:09:42.666428+0000","last_unstale":"2023-11-28T20:09:43.690386+0000","last_undegraded":"2023-11-28T20:09:43.690386+0000","last_fullsized":"2023-11-28T20:09:43.690386+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:46.851956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.917031+0000","last_change":"2023-11-28T20:09:43.685218+0000","last_active":"2023-11-28T20:09:45.917031+0000","last_peered":"2023-11-28T20:09:45.917031+0000","last_clean":"2023-11-28T20:09:45.917031+0000","last_became_active":"2023-11-28T20:09:43.684921+0000","last_became_peered":"2023-11-28T20:09:43.684921+0000","last_unstale":"2023-11-28T20:09:45.917031+0000","last_undegraded":"2023-11-28T20:09:45.917031+0000","last_fullsized":"2023-11-28T20:09:45.917031+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:50.642477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"48'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.693302+0000","last_change":"2023-11-28T20:09:42.672595+0000","last_active":"2023-11-28T20:09:43.693302+0000","last_peered":"2023-11-28T20:09:43.693302+0000","last_clean":"2023-11-28T20:09:43.693302+0000","last_became_active":"2023-11-28T20:09:42.672270+0000","last_became_peered":"2023-11-28T20:09:42.672270+0000","last_unstale":"2023-11-28T20:09:43.693302+0000","last_undegraded":"2023-11-28T20:09:43.693302+0000","last_fullsized":"2023-11-28T20:09:43.693302+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:24:57.386846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.676123+0000","last_change":"2023-11-28T20:09:43.670828+0000","last_active":"2023-11-28T20:09:44.676123+0000","last_peered":"2023-11-28T20:09:44.676123+0000","last_clean":"2023-11-28T20:09:44.676123+0000","last_became_active":"2023-11-28T20:09:43.670563+0000","last_became_peered":"2023-11-28T20:09:43.670563+0000","last_unstale":"2023-11-28T20:09:44.676123+0000","last_undegraded":"2023-11-28T20:09:44.676123+0000","last_fullsized":"2023-11-28T20:09:44.676123+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:51.371777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.664780+0000","last_change":"2023-11-28T20:09:42.675538+0000","last_active":"2023-11-28T20:09:43.664780+0000","last_peered":"2023-11-28T20:09:43.664780+0000","last_clean":"2023-11-28T20:09:43.664780+0000","last_became_active":"2023-11-28T20:09:42.675139+0000","last_became_peered":"2023-11-28T20:09:42.675139+0000","last_unstale":"2023-11-28T20:09:43.664780+0000","last_undegraded":"2023-11-28T20:09:43.664780+0000","last_fullsized":"2023-11-28T20:09:43.664780+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:15.217653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.877001+0000","last_change":"2023-11-28T20:09:43.669834+0000","last_active":"2023-11-28T20:09:45.877001+0000","last_peered":"2023-11-28T20:09:45.877001+0000","last_clean":"2023-11-28T20:09:45.877001+0000","last_became_active":"2023-11-28T20:09:43.669514+0000","last_became_peered":"2023-11-28T20:09:43.669514+0000","last_unstale":"2023-11-28T20:09:45.877001+0000","last_undegraded":"2023-11-28T20:09:45.877001+0000","last_fullsized":"2023-11-28T20:09:45.877001+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:12.515161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.693261+0000","last_change":"2023-11-28T20:09:42.668264+0000","last_active":"2023-11-28T20:09:43.693261+0000","last_peered":"2023-11-28T20:09:43.693261+0000","last_clean":"2023-11-28T20:09:43.693261+0000","last_became_active":"2023-11-28T20:09:42.667948+0000","last_became_peered":"2023-11-28T20:09:42.667948+0000","last_unstale":"2023-11-28T20:09:43.693261+0000","last_undegraded":"2023-11-28T20:09:43.693261+0000","last_fullsized":"2023-11-28T20:09:43.693261+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:08:55.630802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.749528+0000","last_change":"2023-11-28T20:09:43.680917+0000","last_active":"2023-11-28T20:09:45.749528+0000","last_peered":"2023-11-28T20:09:45.749528+0000","last_clean":"2023-11-28T20:09:45.749528+0000","last_became_active":"2023-11-28T20:09:43.680481+0000","last_became_peered":"2023-11-28T20:09:43.680481+0000","last_unstale":"2023-11-28T20:09:45.749528+0000","last_undegraded":"2023-11-28T20:09:45.749528+0000","last_fullsized":"2023-11-28T20:09:45.749528+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:40.380220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.654481+0000","last_change":"2023-11-28T20:09:42.660838+0000","last_active":"2023-11-28T20:09:43.654481+0000","last_peered":"2023-11-28T20:09:43.654481+0000","last_clean":"2023-11-28T20:09:43.654481+0000","last_became_active":"2023-11-28T20:09:42.660549+0000","last_became_peered":"2023-11-28T20:09:42.660549+0000","last_unstale":"2023-11-28T20:09:43.654481+0000","last_undegraded":"2023-11-28T20:09:43.654481+0000","last_fullsized":"2023-11-28T20:09:43.654481+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:19:09.177796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.194120+0000","last_change":"2023-11-28T20:09:43.681102+0000","last_active":"2023-11-28T20:09:45.194120+0000","last_peered":"2023-11-28T20:09:45.194120+0000","last_clean":"2023-11-28T20:09:45.194120+0000","last_became_active":"2023-11-28T20:09:43.680667+0000","last_became_peered":"2023-11-28T20:09:43.680667+0000","last_unstale":"2023-11-28T20:09:45.194120+0000","last_undegraded":"2023-11-28T20:09:45.194120+0000","last_fullsized":"2023-11-28T20:09:45.194120+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:46.233552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.667729+0000","last_change":"2023-11-28T20:09:42.678274+0000","last_active":"2023-11-28T20:09:43.667729+0000","last_peered":"2023-11-28T20:09:43.667729+0000","last_clean":"2023-11-28T20:09:43.667729+0000","last_became_active":"2023-11-28T20:09:42.677974+0000","last_became_peered":"2023-11-28T20:09:42.677974+0000","last_unstale":"2023-11-28T20:09:43.667729+0000","last_undegraded":"2023-11-28T20:09:43.667729+0000","last_fullsized":"2023-11-28T20:09:43.667729+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:57.626688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.675898+0000","last_change":"2023-11-28T20:09:43.669391+0000","last_active":"2023-11-28T20:09:44.675898+0000","last_peered":"2023-11-28T20:09:44.675898+0000","last_clean":"2023-11-28T20:09:44.675898+0000","last_became_active":"2023-11-28T20:09:43.669120+0000","last_became_peered":"2023-11-28T20:09:43.669120+0000","last_unstale":"2023-11-28T20:09:44.675898+0000","last_undegraded":"2023-11-28T20:09:44.675898+0000","last_fullsized":"2023-11-28T20:09:44.675898+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:35.203763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.652218+0000","last_change":"2023-11-28T20:09:42.664555+0000","last_active":"2023-11-28T20:09:43.652218+0000","last_peered":"2023-11-28T20:09:43.652218+0000","last_clean":"2023-11-28T20:09:43.652218+0000","last_became_active":"2023-11-28T20:09:42.663496+0000","last_became_peered":"2023-11-28T20:09:42.663496+0000","last_unstale":"2023-11-28T20:09:43.652218+0000","last_undegraded":"2023-11-28T20:09:43.652218+0000","last_fullsized":"2023-11-28T20:09:43.652218+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:42:34.003160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.877085+0000","last_change":"2023-11-28T20:09:43.679428+0000","last_active":"2023-11-28T20:09:45.877085+0000","last_peered":"2023-11-28T20:09:45.877085+0000","last_clean":"2023-11-28T20:09:45.877085+0000","last_became_active":"2023-11-28T20:09:43.676964+0000","last_became_peered":"2023-11-28T20:09:43.676964+0000","last_unstale":"2023-11-28T20:09:45.877085+0000","last_undegraded":"2023-11-28T20:09:45.877085+0000","last_fullsized":"2023-11-28T20:09:45.877085+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:29:00.647870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.698314+0000","last_change":"2023-11-28T20:09:42.676899+0000","last_active":"2023-11-28T20:09:43.698314+0000","last_peered":"2023-11-28T20:09:43.698314+0000","last_clean":"2023-11-28T20:09:43.698314+0000","last_became_active":"2023-11-28T20:09:42.676592+0000","last_became_peered":"2023-11-28T20:09:42.676592+0000","last_unstale":"2023-11-28T20:09:43.698314+0000","last_undegraded":"2023-11-28T20:09:43.698314+0000","last_fullsized":"2023-11-28T20:09:43.698314+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:36.096265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.676245+0000","last_change":"2023-11-28T20:09:43.664903+0000","last_active":"2023-11-28T20:09:44.676245+0000","last_peered":"2023-11-28T20:09:44.676245+0000","last_clean":"2023-11-28T20:09:44.676245+0000","last_became_active":"2023-11-28T20:09:43.664614+0000","last_became_peered":"2023-11-28T20:09:43.664614+0000","last_unstale":"2023-11-28T20:09:44.676245+0000","last_undegraded":"2023-11-28T20:09:44.676245+0000","last_fullsized":"2023-11-28T20:09:44.676245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:08:59.252802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.660340+0000","last_change":"2023-11-28T20:09:42.675569+0000","last_active":"2023-11-28T20:09:43.660340+0000","last_peered":"2023-11-28T20:09:43.660340+0000","last_clean":"2023-11-28T20:09:43.660340+0000","last_became_active":"2023-11-28T20:09:42.675111+0000","last_became_peered":"2023-11-28T20:09:42.675111+0000","last_unstale":"2023-11-28T20:09:43.660340+0000","last_undegraded":"2023-11-28T20:09:43.660340+0000","last_fullsized":"2023-11-28T20:09:43.660340+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:37.805591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.676690+0000","last_change":"2023-11-28T20:09:43.668534+0000","last_active":"2023-11-28T20:09:44.676690+0000","last_peered":"2023-11-28T20:09:44.676690+0000","last_clean":"2023-11-28T20:09:44.676690+0000","last_became_active":"2023-11-28T20:09:43.668279+0000","last_became_peered":"2023-11-28T20:09:43.668279+0000","last_unstale":"2023-11-28T20:09:44.676690+0000","last_undegraded":"2023-11-28T20:09:44.676690+0000","last_fullsized":"2023-11-28T20:09:44.676690+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:37:53.777866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.669363+0000","last_change":"2023-11-28T20:09:42.678609+0000","last_active":"2023-11-28T20:09:43.669363+0000","last_peered":"2023-11-28T20:09:43.669363+0000","last_clean":"2023-11-28T20:09:43.669363+0000","last_became_active":"2023-11-28T20:09:42.677536+0000","last_became_peered":"2023-11-28T20:09:42.677536+0000","last_unstale":"2023-11-28T20:09:43.669363+0000","last_undegraded":"2023-11-28T20:09:43.669363+0000","last_fullsized":"2023-11-28T20:09:43.669363+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:08:58.244467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.193944+0000","last_change":"2023-11-28T20:09:43.682822+0000","last_active":"2023-11-28T20:09:45.193944+0000","last_peered":"2023-11-28T20:09:45.193944+0000","last_clean":"2023-11-28T20:09:45.193944+0000","last_became_active":"2023-11-28T20:09:43.679969+0000","last_became_peered":"2023-11-28T20:09:43.679969+0000","last_unstale":"2023-11-28T20:09:45.193944+0000","last_undegraded":"2023-11-28T20:09:45.193944+0000","last_fullsized":"2023-11-28T20:09:45.193944+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:05.048605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.655132+0000","last_change":"2023-11-28T20:09:42.669065+0000","last_active":"2023-11-28T20:09:43.655132+0000","last_peered":"2023-11-28T20:09:43.655132+0000","last_clean":"2023-11-28T20:09:43.655132+0000","last_became_active":"2023-11-28T20:09:42.668745+0000","last_became_peered":"2023-11-28T20:09:42.668745+0000","last_unstale":"2023-11-28T20:09:43.655132+0000","last_undegraded":"2023-11-28T20:09:43.655132+0000","last_fullsized":"2023-11-28T20:09:43.655132+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:00.863506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.876729+0000","last_change":"2023-11-28T20:09:43.671394+0000","last_active":"2023-11-28T20:09:45.876729+0000","last_peered":"2023-11-28T20:09:45.876729+0000","last_clean":"2023-11-28T20:09:45.876729+0000","last_became_active":"2023-11-28T20:09:43.671060+0000","last_became_peered":"2023-11-28T20:09:43.671060+0000","last_unstale":"2023-11-28T20:09:45.876729+0000","last_undegraded":"2023-11-28T20:09:45.876729+0000","last_fullsized":"2023-11-28T20:09:45.876729+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:58.635023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.654618+0000","last_change":"2023-11-28T20:09:42.671311+0000","last_active":"2023-11-28T20:09:43.654618+0000","last_peered":"2023-11-28T20:09:43.654618+0000","last_clean":"2023-11-28T20:09:43.654618+0000","last_became_active":"2023-11-28T20:09:42.671023+0000","last_became_peered":"2023-11-28T20:09:42.671023+0000","last_unstale":"2023-11-28T20:09:43.654618+0000","last_undegraded":"2023-11-28T20:09:43.654618+0000","last_fullsized":"2023-11-28T20:09:43.654618+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:49:01.111155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.194100+0000","last_change":"2023-11-28T20:09:43.682150+0000","last_active":"2023-11-28T20:09:45.194100+0000","last_peered":"2023-11-28T20:09:45.194100+0000","last_clean":"2023-11-28T20:09:45.194100+0000","last_became_active":"2023-11-28T20:09:43.681845+0000","last_became_peered":"2023-11-28T20:09:43.681845+0000","last_unstale":"2023-11-28T20:09:45.194100+0000","last_undegraded":"2023-11-28T20:09:45.194100+0000","last_fullsized":"2023-11-28T20:09:45.194100+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:01.871841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.657145+0000","last_change":"2023-11-28T20:09:42.673420+0000","last_active":"2023-11-28T20:09:43.657145+0000","last_peered":"2023-11-28T20:09:43.657145+0000","last_clean":"2023-11-28T20:09:43.657145+0000","last_became_active":"2023-11-28T20:09:42.673075+0000","last_became_peered":"2023-11-28T20:09:42.673075+0000","last_unstale":"2023-11-28T20:09:43.657145+0000","last_undegraded":"2023-11-28T20:09:43.657145+0000","last_fullsized":"2023-11-28T20:09:43.657145+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:15.217653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:44.677946+0000","last_change":"2023-11-28T20:09:43.664346+0000","last_active":"2023-11-28T20:09:44.677946+0000","last_peered":"2023-11-28T20:09:44.677946+0000","last_clean":"2023-11-28T20:09:44.677946+0000","last_became_active":"2023-11-28T20:09:43.664050+0000","last_became_peered":"2023-11-28T20:09:43.664050+0000","last_unstale":"2023-11-28T20:09:44.677946+0000","last_undegraded":"2023-11-28T20:09:44.677946+0000","last_fullsized":"2023-11-28T20:09:44.677946+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:50:04.172823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.661749+0000","last_change":"2023-11-28T20:09:42.667295+0000","last_active":"2023-11-28T20:09:43.661749+0000","last_peered":"2023-11-28T20:09:43.661749+0000","last_clean":"2023-11-28T20:09:43.661749+0000","last_became_active":"2023-11-28T20:09:42.666932+0000","last_became_peered":"2023-11-28T20:09:42.666932+0000","last_unstale":"2023-11-28T20:09:43.661749+0000","last_undegraded":"2023-11-28T20:09:43.661749+0000","last_fullsized":"2023-11-28T20:09:43.661749+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:48:37.397331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.749310+0000","last_change":"2023-11-28T20:09:43.678654+0000","last_active":"2023-11-28T20:09:45.749310+0000","last_peered":"2023-11-28T20:09:45.749310+0000","last_clean":"2023-11-28T20:09:45.749310+0000","last_became_active":"2023-11-28T20:09:43.678319+0000","last_became_peered":"2023-11-28T20:09:43.678319+0000","last_unstale":"2023-11-28T20:09:45.749310+0000","last_undegraded":"2023-11-28T20:09:45.749310+0000","last_fullsized":"2023-11-28T20:09:45.749310+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:42.638418+0000","last_clean_scrub_stamp":"2023-11-28T20:09:42.638418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:18.515357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T20:09:45.194250+0000","last_change":"2023-11-28T20:09:42.674280+0000","last_active":"2023-11-28T20:09:45.194250+0000","last_peered":"2023-11-28T20:09:45.194250+0000","last_clean":"2023-11-28T20:09:45.194250+0000","last_became_active":"2023-11-28T20:09:42.673979+0000","last_became_peered":"2023-11-28T20:09:42.673979+0000","last_unstale":"2023-11-28T20:09:45.194250+0000","last_undegraded":"2023-11-28T20:09:45.194250+0000","last_fullsized":"2023-11-28T20:09:45.194250+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:09:41.630083+0000","last_clean_scrub_stamp":"2023-11-28T20:09:41.630083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:11.506826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":191,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.657706+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:09:43.657706+0000","last_peered":"2023-11-28T20:09:43.657706+0000","last_clean":"2023-11-28T20:09:43.657706+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:09:43.657706+0000","last_undegraded":"2023-11-28T20:09:43.657706+0000","last_fullsized":"2023-11-28T20:09:43.657706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1183744,"data_stored":832569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.438,"5min":0.313,"15min":0.313},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.749},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.56200000000000006,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.032,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.72799999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.65400000000000003},"min":{"1min":0.49199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94399999999999995,"5min":1.161,"15min":1.161},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0009999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.77800000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97899999999999998,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.60299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.79900000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0209999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.84099999999999997}]},{"osd":4,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.44500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.505,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.53300000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.48799999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.44},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.495,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.51400000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.58899999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.054,"5min":1.272,"15min":1.272},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.48699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":242729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.44500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.996}]},{"osd":1,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.69999999999999996,"15min":0.68500000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.748,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.77100000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.65400000000000003},"min":{"1min":0.501,"5min":0.498,"15min":0.498},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.60999999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5819999999999999,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.88600000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.125,"5min":1.357,"15min":1.357},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.006,"5min":0.80600000000000005,"15min":0.77200000000000002},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":6.2249999999999996,"5min":6.2249999999999996,"15min":6.2249999999999996},"last":0.86399999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.0789999999999997,"5min":4.0789999999999997,"15min":4.0789999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"last":0.91700000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":0.81899999999999995,"15min":0.77700000000000002},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":8.6159999999999997,"5min":8.6159999999999997,"15min":8.6159999999999997},"last":0.753},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.83299999999999996,"15min":0.82099999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":1.0609999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.84399999999999997,"15min":0.84199999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":1.042},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.86199999999999999,"15min":0.85799999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.97499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":581632,"data_stored":242077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.78900000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.58799999999999997}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65900000000000003,"15min":0.66000000000000003},"min":{"1min":0.47199999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.879,"5min":1.083,"15min":1.083},"last":0.69199999999999995}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.052,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.71399999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69799999999999995,"15min":0.70099999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84399999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.80300000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65300000000000002,"15min":0.66200000000000003},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.878},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81299999999999994,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.83499999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.98599999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82999999999999996,"5min":0.997,"15min":0.997},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92400000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.89600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":242659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67900000000000005,"15min":0.68600000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.78100000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71399999999999997,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85599999999999998,"5min":1.361,"15min":1.361},"last":0.78900000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68799999999999994},"min":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.88},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.81799999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.40100000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86899999999999999,"5min":1.04,"15min":1.04},"last":0.63}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.56699999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.83999999999999997,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88100000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.65800000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.45400000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85699999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":1.038,"15min":1.038},"last":0.85699999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.84299999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.91400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93100000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.405},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.86099999999999999,"15min":0.877},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98899999999999999,"5min":1.353,"15min":1.353},"last":1.109}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":598016,"data_stored":243711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.02,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.68100000000000005,"15min":0.72199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76000000000000001,"5min":6.016,"15min":6.016},"last":0.40400000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.437},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2170000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.45400000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94799999999999995,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0549999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0009999999999999,"5min":5.8810000000000002,"15min":5.8810000000000002},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.038,"5min":1.405,"15min":1.405},"last":0.874}]},{"osd":5,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79800000000000004,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.119,"5min":1.585,"15min":1.585},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.97299999999999998,"15min":1.0129999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.042,"5min":5.9349999999999996,"15min":5.9349999999999996},"last":0.84399999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95699999999999996,"5min":1.361,"15min":1.361},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.55500000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0900000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.752}]},{"osd":7,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.94999999999999996,"15min":0.98799999999999999},"min":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.262,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0620000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.78600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":593920,"data_stored":243689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.80800000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.442},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.54300000000000004,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.626}]},{"osd":1,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.3140000000000001,"5min":5.3140000000000001,"15min":5.3140000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":3.7650000000000001,"5min":3.7650000000000001,"15min":3.7650000000000001},"last":0.502}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":5.3460000000000001,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.54500000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3580000000000001,"5min":1.415,"15min":1.415},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.81699999999999995,"15min":0.80700000000000005},"min":{"1min":0.54500000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.8090000000000002,"5min":3.8090000000000002,"15min":3.8090000000000002},"last":0.79100000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.2809999999999997,"5min":5.2809999999999997,"15min":5.2809999999999997},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88800000000000001,"15min":0.88400000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.5369999999999999,"5min":4.5369999999999999,"15min":4.5369999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.88700000000000001,"15min":0.86599999999999999},"min":{"1min":0.56799999999999995,"5min":0.496,"15min":0.496},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.84499999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.88,"15min":0.874},"min":{"1min":0.56999999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":3.863,"5min":3.863,"15min":3.863},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.90300000000000002,"15min":0.88600000000000001},"min":{"1min":0.627,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":5.2460000000000004,"5min":5.2460000000000004,"15min":5.2460000000000004},"last":0.81499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":589824,"data_stored":242237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.60499999999999998,"15min":0.63900000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.627,"15min":0.66100000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.48499999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.64800000000000002,"15min":0.68300000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79900000000000004,"5min":4.9909999999999997,"15min":4.9909999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.68100000000000005,"15min":0.71899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56699999999999995,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.61399999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":1.389,"15min":1.389},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.67000000000000004,"15min":0.70399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.443}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.503,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":1.145,"15min":1.145},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.93500000000000005,"15min":0.96599999999999997},"min":{"1min":0.59899999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90600000000000003,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.749}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.91400000000000003,"15min":0.95499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90600000000000003,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.89100000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.629}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.94799999999999995,"15min":0.99099999999999999},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.89800000000000002,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.80900000000000005,"15min":0.81799999999999995},"min":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.92400000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0009999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.94699999999999995,"15min":0.98499999999999999},"min":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.93100000000000005,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":0.57399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1183744,"data_stored":832501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.34000000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.753,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38100000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59299999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52700000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.998,"5min":1.052,"15min":1.052},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92100000000000004,"5min":1.006,"15min":1.006},"last":0.751}]},{"osd":5,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88900000000000001,"5min":1.524,"15min":1.524},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.97999999999999998,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.71699999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.624,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.84199999999999997,"5min":1.214,"15min":1.214},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97399999999999998,"5min":1.415,"15min":1.415},"last":0.68799999999999994}]},{"osd":7,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95599999999999996,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93899999999999995,"5min":1.099,"15min":1.099},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:09:52.601 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T20:09:52.602 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-28T20:09:52.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.776+0000 7ff2d3074640 1 Processor -- start 2023-11-28T20:09:52.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.776+0000 7ff2d3074640 1 -- start start 2023-11-28T20:09:52.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d3074640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2cc13cd30 0x7ff2cc06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:52.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d3074640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff2cc06da10 0x7ff2cc15a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:52.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d3074640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff2cc15aa40 0x7ff2cc071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:52.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d3074640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc06de70 con 0x7ff2cc06da10 2023-11-28T20:09:52.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d3074640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc15b270 con 0x7ff2cc15aa40 2023-11-28T20:09:52.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d3074640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc15d9a0 con 0x7ff2cc13cd30 2023-11-28T20:09:52.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d1871640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff2cc06da10 0x7ff2cc15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:52.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d1871640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff2cc06da10 0x7ff2cc15a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51500/0 (socket says 172.21.15.177:51500) 2023-11-28T20:09:52.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d1871640 1 -- 172.21.15.177:0/2913633483 learned_addr learned my addr 172.21.15.177:0/2913633483 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:52.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d2072640 1 --2- 172.21.15.177:0/2913633483 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2cc13cd30 0x7ff2cc06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:52.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d2873640 1 --2- 172.21.15.177:0/2913633483 >> v2:172.21.15.195:3300/0 conn(0x7ff2cc15aa40 0x7ff2cc071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:52.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d1871640 1 -- 172.21.15.177:0/2913633483 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2cc13cd30 msgr2=0x7ff2cc06d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:52.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d1871640 1 --2- 172.21.15.177:0/2913633483 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2cc13cd30 0x7ff2cc06d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:52.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d1871640 1 -- 172.21.15.177:0/2913633483 >> v2:172.21.15.195:3300/0 conn(0x7ff2cc15aa40 msgr2=0x7ff2cc071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:52.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d1871640 1 --2- 172.21.15.177:0/2913633483 >> v2:172.21.15.195:3300/0 conn(0x7ff2cc15aa40 0x7ff2cc071380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:52.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d1871640 1 -- 172.21.15.177:0/2913633483 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc15dc80 con 0x7ff2cc06da10 2023-11-28T20:09:52.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.780+0000 7ff2d1871640 1 --2- 172.21.15.177:0/2913633483 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc06da10 0x7ff2cc15a500 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc140590 tx=0x7ff2bc01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e4f8246b2abe1c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:52.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d1070640 1 -- 172.21.15.177:0/2913633483 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0ab600 con 0x7ff2cc06da10 2023-11-28T20:09:52.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d1070640 1 -- 172.21.15.177:0/2913633483 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc0a7050 con 0x7ff2cc06da10 2023-11-28T20:09:52.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d1070640 1 -- 172.21.15.177:0/2913633483 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0ab980 con 0x7ff2cc06da10 2023-11-28T20:09:52.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 -- 172.21.15.177:0/2913633483 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc06da10 msgr2=0x7ff2cc15a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:52.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 --2- 172.21.15.177:0/2913633483 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc06da10 0x7ff2cc15a500 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc140590 tx=0x7ff2bc01c210 comp rx=0 tx=0).stop 2023-11-28T20:09:52.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 -- 172.21.15.177:0/2913633483 shutdown_connections 2023-11-28T20:09:52.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 --2- 172.21.15.177:0/2913633483 >> v2:172.21.15.195:3300/0 conn(0x7ff2cc15aa40 0x7ff2cc071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:52.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 --2- 172.21.15.177:0/2913633483 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc06da10 0x7ff2cc15a500 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:52.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 --2- 172.21.15.177:0/2913633483 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2cc13cd30 0x7ff2cc06d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:52.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 -- 172.21.15.177:0/2913633483 >> 172.21.15.177:0/2913633483 conn(0x7ff2cc0b0b50 msgr2=0x7ff2cc0b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:52.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 -- 172.21.15.177:0/2913633483 shutdown_connections 2023-11-28T20:09:52.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 -- 172.21.15.177:0/2913633483 wait complete. 2023-11-28T20:09:52.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 Processor -- start 2023-11-28T20:09:52.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 -- start start 2023-11-28T20:09:52.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2cc06da10 0x7ff2cc1574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:52.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc13cd30 0x7ff2cc070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:52.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2cc15aa40 0x7ff2cc154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:52.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc070bc0 con 0x7ff2cc13cd30 2023-11-28T20:09:52.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc157060 con 0x7ff2cc06da10 2023-11-28T20:09:52.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.784+0000 7ff2d3074640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc156a80 con 0x7ff2cc15aa40 2023-11-28T20:09:52.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2d1871640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc13cd30 0x7ff2cc070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:52.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2d1871640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc13cd30 0x7ff2cc070680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51514/0 (socket says 172.21.15.177:51514) 2023-11-28T20:09:52.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2d1871640 1 -- 172.21.15.177:0/2516926050 learned_addr learned my addr 172.21.15.177:0/2516926050 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:52.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2d2072640 1 --2- 172.21.15.177:0/2516926050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2cc06da10 0x7ff2cc1574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:52.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2d2873640 1 --2- 172.21.15.177:0/2516926050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2cc15aa40 0x7ff2cc154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:52.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2d1871640 1 -- 172.21.15.177:0/2516926050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2cc15aa40 msgr2=0x7ff2cc154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:52.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2d1871640 1 --2- 172.21.15.177:0/2516926050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2cc15aa40 0x7ff2cc154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:52.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2d1871640 1 -- 172.21.15.177:0/2516926050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2cc06da10 msgr2=0x7ff2cc1574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:52.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2d1871640 1 --2- 172.21.15.177:0/2516926050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2cc06da10 0x7ff2cc1574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:52.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2d1871640 1 -- 172.21.15.177:0/2516926050 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc0094d0 con 0x7ff2cc13cd30 2023-11-28T20:09:52.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2d2873640 1 --2- 172.21.15.177:0/2516926050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2cc15aa40 0x7ff2cc154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:52.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2d1871640 1 --2- 172.21.15.177:0/2516926050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc13cd30 0x7ff2cc070680 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc01a8c0 tx=0x7ff2bc018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:52.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2c2ffd640 1 -- 172.21.15.177:0/2516926050 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0b4620 con 0x7ff2cc13cd30 2023-11-28T20:09:52.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2c2ffd640 1 -- 172.21.15.177:0/2516926050 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc0b4780 con 0x7ff2cc13cd30 2023-11-28T20:09:52.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2c2ffd640 1 -- 172.21.15.177:0/2516926050 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0b4b30 con 0x7ff2cc13cd30 2023-11-28T20:09:52.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2d3074640 1 -- 172.21.15.177:0/2516926050 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2cc15e8e0 con 0x7ff2cc13cd30 2023-11-28T20:09:52.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2d3074640 1 -- 172.21.15.177:0/2516926050 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2cc156cf0 con 0x7ff2cc13cd30 2023-11-28T20:09:52.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2d3074640 1 -- 172.21.15.177:0/2516926050 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2cc1568e0 con 0x7ff2cc13cd30 2023-11-28T20:09:52.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2c2ffd640 1 -- 172.21.15.177:0/2516926050 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2bc0b2070 con 0x7ff2cc13cd30 2023-11-28T20:09:52.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2c2ffd640 1 --2- 172.21.15.177:0/2516926050 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff2b0066470 0x7ff2b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:52.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.788+0000 7ff2c2ffd640 1 -- 172.21.15.177:0/2516926050 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2bc11ce10 con 0x7ff2cc13cd30 2023-11-28T20:09:52.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.792+0000 7ff2d2072640 1 --2- 172.21.15.177:0/2516926050 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff2b0066470 0x7ff2b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:52.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.792+0000 7ff2d2072640 1 --2- 172.21.15.177:0/2516926050 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff2b0066470 0x7ff2b0068930 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80045f0 tx=0x7ff2c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:52.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.792+0000 7ff2c2ffd640 1 -- 172.21.15.177:0/2516926050 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff2cc1568e0 con 0x7ff2cc13cd30 2023-11-28T20:09:53.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:52.996+0000 7ff2d3074640 1 -- 172.21.15.177:0/2516926050 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff2cc1568e0 con 0x7ff2cc13cd30 2023-11-28T20:09:53.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.000+0000 7ff2c2ffd640 1 -- 172.21.15.177:0/2516926050 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff2bc0b00b0 con 0x7ff2cc13cd30 2023-11-28T20:09:53.003 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-11-28T20:09:53.003 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZl+2t5KxAAc/J7x+fjSQR4IkIQJ/X8sw== 2023-11-28T20:09:53.004 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-11-28T20:09:53.004 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-11-28T20:09:53.004 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T20:09:53.004 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-11-28T20:09:53.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.000+0000 7ff2d3074640 1 -- 172.21.15.177:0/2516926050 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff2b0066470 msgr2=0x7ff2b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.000+0000 7ff2d3074640 1 --2- 172.21.15.177:0/2516926050 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff2b0066470 0x7ff2b0068930 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80045f0 tx=0x7ff2c8008040 comp rx=0 tx=0).stop 2023-11-28T20:09:53.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.000+0000 7ff2d3074640 1 -- 172.21.15.177:0/2516926050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc13cd30 msgr2=0x7ff2cc070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.000+0000 7ff2d3074640 1 --2- 172.21.15.177:0/2516926050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc13cd30 0x7ff2cc070680 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc01a8c0 tx=0x7ff2bc018fb0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.000+0000 7ff2d3074640 1 -- 172.21.15.177:0/2516926050 shutdown_connections 2023-11-28T20:09:53.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.000+0000 7ff2d3074640 1 --2- 172.21.15.177:0/2516926050 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff2b0066470 0x7ff2b0068930 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.000+0000 7ff2d3074640 1 --2- 172.21.15.177:0/2516926050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2cc15aa40 0x7ff2cc154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.000+0000 7ff2d3074640 1 --2- 172.21.15.177:0/2516926050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc13cd30 0x7ff2cc070680 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.000+0000 7ff2d3074640 1 --2- 172.21.15.177:0/2516926050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2cc06da10 0x7ff2cc1574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.000+0000 7ff2d3074640 1 -- 172.21.15.177:0/2516926050 >> 172.21.15.177:0/2516926050 conn(0x7ff2cc0b0b50 msgr2=0x7ff2cc06c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:53.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.000+0000 7ff2d3074640 1 -- 172.21.15.177:0/2516926050 shutdown_connections 2023-11-28T20:09:53.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.000+0000 7ff2d3074640 1 -- 172.21.15.177:0/2516926050 wait complete. 2023-11-28T20:09:53.024 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:09:53.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.156+0000 7f17818ea640 1 Processor -- start 2023-11-28T20:09:53.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.160+0000 7f17818ea640 1 -- start start 2023-11-28T20:09:53.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.160+0000 7f17818ea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c13cf30 0x7f177c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.160+0000 7f17818ea640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f177c15ad40 0x7f177c0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.160+0000 7f17818ea640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177c15b3a0 con 0x7f177c06c800 2023-11-28T20:09:53.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.160+0000 7f17818ea640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177c13d310 con 0x7f177c15ad40 2023-11-28T20:09:53.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.160+0000 7f17818ea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c15b1b0 con 0x7f177c13cf30 2023-11-28T20:09:53.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.160+0000 7f177b7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f177c15ad40 0x7f177c0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.160+0000 7f1773fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f177c06c800 0x7f177c15a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:42696/0 (socket says 172.21.15.177:42696) 2023-11-28T20:09:53.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.160+0000 7f1773fff640 1 -- 172.21.15.177:0/180084141 learned_addr learned my addr 172.21.15.177:0/180084141 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:53.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.160+0000 7f177affd640 1 --2- 172.21.15.177:0/180084141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c13cf30 0x7f177c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.160+0000 7f177b7fe640 1 -- 172.21.15.177:0/180084141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c13cf30 msgr2=0x7f177c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:53.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.160+0000 7f177b7fe640 1 --2- 172.21.15.177:0/180084141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c13cf30 0x7f177c06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.160+0000 7f177b7fe640 1 -- 172.21.15.177:0/180084141 >> v1:172.21.15.177:6789/0 conn(0x7f177c06c800 legacy=0x7f177c15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.160+0000 7f177b7fe640 1 -- 172.21.15.177:0/180084141 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c06cc40 con 0x7f177c15ad40 2023-11-28T20:09:53.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.164+0000 7f177b7fe640 1 --2- 172.21.15.177:0/180084141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f177c15ad40 0x7f177c0cd880 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1774009d90 tx=0x7f177401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c49cf2b5293eb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:53.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.164+0000 7f177a7fc640 1 -- 172.21.15.177:0/180084141 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17740a5870 con 0x7f177c15ad40 2023-11-28T20:09:53.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.164+0000 7f177a7fc640 1 -- 172.21.15.177:0/180084141 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17740a59d0 con 0x7f177c15ad40 2023-11-28T20:09:53.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.164+0000 7f177a7fc640 1 -- 172.21.15.177:0/180084141 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17740a5d60 con 0x7f177c15ad40 2023-11-28T20:09:53.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.164+0000 7f17818ea640 1 -- 172.21.15.177:0/180084141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f177c15ad40 msgr2=0x7f177c0cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.164+0000 7f17818ea640 1 --2- 172.21.15.177:0/180084141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f177c15ad40 0x7f177c0cd880 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1774009d90 tx=0x7f177401c8c0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.164+0000 7f17818ea640 1 -- 172.21.15.177:0/180084141 shutdown_connections 2023-11-28T20:09:53.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.164+0000 7f17818ea640 1 --2- 172.21.15.177:0/180084141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f177c15ad40 0x7f177c0cd880 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.164+0000 7f17818ea640 1 --2- 172.21.15.177:0/180084141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c13cf30 0x7f177c06c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.164+0000 7f17818ea640 1 -- 172.21.15.177:0/180084141 >> 172.21.15.177:0/180084141 conn(0x7f177c06a530 msgr2=0x7f177c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:53.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.164+0000 7f17818ea640 1 -- 172.21.15.177:0/180084141 shutdown_connections 2023-11-28T20:09:53.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.164+0000 7f17818ea640 1 -- 172.21.15.177:0/180084141 wait complete. 2023-11-28T20:09:53.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.164+0000 7f17818ea640 1 Processor -- start 2023-11-28T20:09:53.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.164+0000 7f17818ea640 1 -- start start 2023-11-28T20:09:53.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f17818ea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c06c800 0x7f177c1f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f17818ea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f177c13cf30 0x7f177c135870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f17818ea640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c15ad40 0x7f177c1360a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f17818ea640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0a8630 con 0x7f177c13cf30 2023-11-28T20:09:53.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f17818ea640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c138db0 con 0x7f177c15ad40 2023-11-28T20:09:53.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f17818ea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c136d20 con 0x7f177c06c800 2023-11-28T20:09:53.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f1773fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f177c13cf30 0x7f177c135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f1773fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f177c13cf30 0x7f177c135870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51532/0 (socket says 172.21.15.177:51532) 2023-11-28T20:09:53.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f1773fff640 1 -- 172.21.15.177:0/3970458604 learned_addr learned my addr 172.21.15.177:0/3970458604 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:53.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f177affd640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c06c800 0x7f177c1f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f1773fff640 1 -- 172.21.15.177:0/3970458604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c06c800 msgr2=0x7f177c1f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f1773fff640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c06c800 0x7f177c1f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f177b7fe640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c15ad40 0x7f177c1360a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f1773fff640 1 -- 172.21.15.177:0/3970458604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c15ad40 msgr2=0x7f177c1360a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f1773fff640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c15ad40 0x7f177c1360a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f1773fff640 1 -- 172.21.15.177:0/3970458604 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1774009a70 con 0x7f177c13cf30 2023-11-28T20:09:53.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f177affd640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c06c800 0x7f177c1f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:53.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f177b7fe640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c15ad40 0x7f177c1360a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:53.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f1773fff640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f177c13cf30 0x7f177c135870 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f176400c500 tx=0x7f176400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:53.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f1778ff9640 1 -- 172.21.15.177:0/3970458604 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764005cf0 con 0x7f177c13cf30 2023-11-28T20:09:53.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f1778ff9640 1 -- 172.21.15.177:0/3970458604 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1764005e50 con 0x7f177c13cf30 2023-11-28T20:09:53.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f17818ea640 1 -- 172.21.15.177:0/3970458604 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177c1381a0 con 0x7f177c13cf30 2023-11-28T20:09:53.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f1778ff9640 1 -- 172.21.15.177:0/3970458604 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640072f0 con 0x7f177c13cf30 2023-11-28T20:09:53.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f17818ea640 1 -- 172.21.15.177:0/3970458604 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177c138760 con 0x7f177c13cf30 2023-11-28T20:09:53.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.168+0000 7f17818ea640 1 -- 172.21.15.177:0/3970458604 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177c138f40 con 0x7f177c13cf30 2023-11-28T20:09:53.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.172+0000 7f1778ff9640 1 -- 172.21.15.177:0/3970458604 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1764007450 con 0x7f177c13cf30 2023-11-28T20:09:53.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.172+0000 7f1778ff9640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f175c066470 0x7f175c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.172+0000 7f1778ff9640 1 -- 172.21.15.177:0/3970458604 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1764083390 con 0x7f177c13cf30 2023-11-28T20:09:53.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.172+0000 7f177affd640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f175c066470 0x7f175c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.172+0000 7f177affd640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f175c066470 0x7f175c068930 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f177c067780 tx=0x7f176c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:53.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.176+0000 7f1778ff9640 1 -- 172.21.15.177:0/3970458604 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17640508b0 con 0x7f177c13cf30 2023-11-28T20:09:53.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.356+0000 7f17818ea640 1 -- 172.21.15.177:0/3970458604 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f177c069440 con 0x7f177c13cf30 2023-11-28T20:09:53.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.356+0000 7f1778ff9640 1 -- 172.21.15.177:0/3970458604 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f1764053ed0 con 0x7f177c13cf30 2023-11-28T20:09:53.361 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:53.362 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1822043740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1822043740},{"type":"v1","addr":"172.21.15.195:6835","nonce":1822043740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5713,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3889128653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3889128653},{"type":"v1","addr":"172.21.15.195:6834","nonce":3889128653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5898,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2574151536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2574151536},{"type":"v1","addr":"172.21.15.177:6835","nonce":2574151536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:09:43.046143+0000","modified":"2023-11-28T20:09:46.049118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/198543116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":198543116},{"type":"v1","addr":"172.21.15.177:6837","nonce":198543116}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T20:09:53.362 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 26 2023-11-28T20:09:53.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.360+0000 7f17818ea640 1 -- 172.21.15.177:0/3970458604 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f175c066470 msgr2=0x7f175c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.360+0000 7f17818ea640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f175c066470 0x7f175c068930 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f177c067780 tx=0x7f176c008040 comp rx=0 tx=0).stop 2023-11-28T20:09:53.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.360+0000 7f17818ea640 1 -- 172.21.15.177:0/3970458604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f177c13cf30 msgr2=0x7f177c135870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.360+0000 7f17818ea640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f177c13cf30 0x7f177c135870 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f176400c500 tx=0x7f176400c9c0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.360+0000 7f17818ea640 1 -- 172.21.15.177:0/3970458604 shutdown_connections 2023-11-28T20:09:53.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.360+0000 7f17818ea640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f175c066470 0x7f175c068930 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.360+0000 7f17818ea640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c15ad40 0x7f177c1360a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.360+0000 7f17818ea640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f177c13cf30 0x7f177c135870 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.360+0000 7f17818ea640 1 --2- 172.21.15.177:0/3970458604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c06c800 0x7f177c1f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.360+0000 7f17818ea640 1 -- 172.21.15.177:0/3970458604 >> 172.21.15.177:0/3970458604 conn(0x7f177c06a530 msgr2=0x7f177c06a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:53.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.360+0000 7f17818ea640 1 -- 172.21.15.177:0/3970458604 shutdown_connections 2023-11-28T20:09:53.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.360+0000 7f17818ea640 1 -- 172.21.15.177:0/3970458604 wait complete. 2023-11-28T20:09:53.786 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T20:09:43.046143+0000', 'modified': '2023-11-28T20:09:46.049118+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5907}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5907': {'gid': 5907, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.177:6837/198543116', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6836', 'nonce': 198543116}, {'type': 'v1', 'addr': '172.21.15.177:6837', 'nonce': 198543116}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T20:09:53.786 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T20:09:53.787 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T20:09:53.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b196c8640 1 Processor -- start 2023-11-28T20:09:53.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b196c8640 1 -- start start 2023-11-28T20:09:53.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b196c8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1b140d0400 0x7f1b14161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b196c8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b14161750 0x7f1b14161ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b196c8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b140c6fc0 con 0x7f1b140cf910 2023-11-28T20:09:53.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b196c8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b140cf060 con 0x7f1b140d0400 2023-11-28T20:09:53.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b196c8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b141620e0 con 0x7f1b14161750 2023-11-28T20:09:53.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b137fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1b140d0400 0x7f1b14161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b137fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1b140d0400 0x7f1b14161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51546/0 (socket says 172.21.15.177:51546) 2023-11-28T20:09:53.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b13fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f1b140cf910 0x7f1b140cfcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:42710/0 (socket says 172.21.15.177:42710) 2023-11-28T20:09:53.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b137fe640 1 -- 172.21.15.177:0/804352039 learned_addr learned my addr 172.21.15.177:0/804352039 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:53.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b18ec7640 1 --2- 172.21.15.177:0/804352039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b14161750 0x7f1b14161ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b137fe640 1 -- 172.21.15.177:0/804352039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b14161750 msgr2=0x7f1b14161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:53.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b137fe640 1 --2- 172.21.15.177:0/804352039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b14161750 0x7f1b14161ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b137fe640 1 -- 172.21.15.177:0/804352039 >> v1:172.21.15.177:6789/0 conn(0x7f1b140cf910 legacy=0x7f1b140cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b137fe640 1 -- 172.21.15.177:0/804352039 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b140d0890 con 0x7f1b140d0400 2023-11-28T20:09:53.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.924+0000 7f1b18ec7640 1 --2- 172.21.15.177:0/804352039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b14161750 0x7f1b14161ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:53.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.928+0000 7f1b137fe640 1 --2- 172.21.15.177:0/804352039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b140d0400 0x7f1b14161210 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1b080098a0 tx=0x7f1b0801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5cbd1b1395e4af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:53.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.928+0000 7f1b12ffd640 1 -- 172.21.15.177:0/804352039 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b080ab660 con 0x7f1b140d0400 2023-11-28T20:09:53.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.928+0000 7f1b12ffd640 1 -- 172.21.15.177:0/804352039 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b080ab7c0 con 0x7f1b140d0400 2023-11-28T20:09:53.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.928+0000 7f1b12ffd640 1 -- 172.21.15.177:0/804352039 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b080abb50 con 0x7f1b140d0400 2023-11-28T20:09:53.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.928+0000 7f1b196c8640 1 -- 172.21.15.177:0/804352039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b140d0400 msgr2=0x7f1b14161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.928+0000 7f1b196c8640 1 --2- 172.21.15.177:0/804352039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b140d0400 0x7f1b14161210 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1b080098a0 tx=0x7f1b0801c460 comp rx=0 tx=0).stop 2023-11-28T20:09:53.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.928+0000 7f1b196c8640 1 -- 172.21.15.177:0/804352039 shutdown_connections 2023-11-28T20:09:53.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.928+0000 7f1b196c8640 1 --2- 172.21.15.177:0/804352039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b140d0400 0x7f1b14161210 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.928+0000 7f1b196c8640 1 --2- 172.21.15.177:0/804352039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b14161750 0x7f1b14161ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.928+0000 7f1b196c8640 1 -- 172.21.15.177:0/804352039 >> 172.21.15.177:0/804352039 conn(0x7f1b140d2f60 msgr2=0x7f1b140d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:53.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.928+0000 7f1b196c8640 1 -- 172.21.15.177:0/804352039 shutdown_connections 2023-11-28T20:09:53.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.928+0000 7f1b196c8640 1 -- 172.21.15.177:0/804352039 wait complete. 2023-11-28T20:09:53.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b196c8640 1 Processor -- start 2023-11-28T20:09:53.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b196c8640 1 -- start start 2023-11-28T20:09:53.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b196c8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b140cf910 0x7f1b14159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b196c8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b140d0400 0x7f1b140cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b196c8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b14161750 0x7f1b1415fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b196c8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b14159f50 con 0x7f1b14161750 2023-11-28T20:09:53.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b196c8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b140ca410 con 0x7f1b140cf910 2023-11-28T20:09:53.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b196c8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b140ca6f0 con 0x7f1b140d0400 2023-11-28T20:09:53.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b18ec7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b14161750 0x7f1b1415fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b18ec7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b14161750 0x7f1b1415fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51548/0 (socket says 172.21.15.177:51548) 2023-11-28T20:09:53.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b18ec7640 1 -- 172.21.15.177:0/1688736126 learned_addr learned my addr 172.21.15.177:0/1688736126 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:53.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b137fe640 1 --2- 172.21.15.177:0/1688736126 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b140d0400 0x7f1b140cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b13fff640 1 --2- 172.21.15.177:0/1688736126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b140cf910 0x7f1b14159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b18ec7640 1 -- 172.21.15.177:0/1688736126 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b140d0400 msgr2=0x7f1b140cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b18ec7640 1 --2- 172.21.15.177:0/1688736126 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b140d0400 0x7f1b140cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b18ec7640 1 -- 172.21.15.177:0/1688736126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b140cf910 msgr2=0x7f1b14159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b18ec7640 1 --2- 172.21.15.177:0/1688736126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b140cf910 0x7f1b14159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b18ec7640 1 -- 172.21.15.177:0/1688736126 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b080094d0 con 0x7f1b14161750 2023-11-28T20:09:53.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b18ec7640 1 --2- 172.21.15.177:0/1688736126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b14161750 0x7f1b1415fdd0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c007df0 tx=0x7f1b0c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:53.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b10ff9640 1 -- 172.21.15.177:0/1688736126 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c0039a0 con 0x7f1b14161750 2023-11-28T20:09:53.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b10ff9640 1 -- 172.21.15.177:0/1688736126 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c00f040 con 0x7f1b14161750 2023-11-28T20:09:53.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b196c8640 1 -- 172.21.15.177:0/1688736126 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b140ca9d0 con 0x7f1b14161750 2023-11-28T20:09:53.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b10ff9640 1 -- 172.21.15.177:0/1688736126 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c003d40 con 0x7f1b14161750 2023-11-28T20:09:53.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.932+0000 7f1b196c8640 1 -- 172.21.15.177:0/1688736126 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b140caf90 con 0x7f1b14161750 2023-11-28T20:09:53.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b10ff9640 1 -- 172.21.15.177:0/1688736126 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1b0c004030 con 0x7f1b14161750 2023-11-28T20:09:53.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b10ff9640 1 --2- 172.21.15.177:0/1688736126 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1b00066470 0x7f1b00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b10ff9640 1 -- 172.21.15.177:0/1688736126 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b0c0840c0 con 0x7f1b14161750 2023-11-28T20:09:53.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b13fff640 1 --2- 172.21.15.177:0/1688736126 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1b00066470 0x7f1b00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b1dca5000 1 Processor -- start 2023-11-28T20:09:53.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b1dca5000 1 -- start start 2023-11-28T20:09:53.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b13fff640 1 --2- 172.21.15.177:0/1688736126 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1b00066470 0x7f1b00068930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1b04000f70 tx=0x7f1b04007cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:53.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b1dca5000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe0fc90 0x55e0bbe10070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b1dca5000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbe105b0 0x55e0bbdc5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b1dca5000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbdc6320 0x55e0bbdc6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b1dca5000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bbc30130 con 0x55e0bbdc6320 2023-11-28T20:09:53.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b1dca5000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bbc1d9a0 con 0x55e0bbe105b0 2023-11-28T20:09:53.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b1dca5000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0bbc1aed0 con 0x55e0bbe0fc90 2023-11-28T20:09:53.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b18ec7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbdc6320 0x55e0bbdc6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b18ec7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbdc6320 0x55e0bbdc6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51556/0 (socket says 172.21.15.177:51556) 2023-11-28T20:09:53.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b18ec7640 1 -- 172.21.15.177:0/224556446 learned_addr learned my addr 172.21.15.177:0/224556446 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:53.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b13fff640 1 --2- 172.21.15.177:0/224556446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe0fc90 0x55e0bbe10070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.936+0000 7f1b137fe640 1 --2- 172.21.15.177:0/224556446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbe105b0 0x55e0bbdc5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b18ec7640 1 -- 172.21.15.177:0/224556446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe0fc90 msgr2=0x55e0bbe10070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:53.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b18ec7640 1 --2- 172.21.15.177:0/224556446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe0fc90 0x55e0bbe10070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b18ec7640 1 -- 172.21.15.177:0/224556446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbe105b0 msgr2=0x55e0bbdc5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:53.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b18ec7640 1 --2- 172.21.15.177:0/224556446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbe105b0 0x55e0bbdc5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b18ec7640 1 -- 172.21.15.177:0/224556446 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0bb90e890 con 0x55e0bbdc6320 2023-11-28T20:09:53.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b18ec7640 1 --2- 172.21.15.177:0/224556446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbdc6320 0x55e0bbdc6700 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c05cfc0 tx=0x7f1b0c055360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a509fd5d518c8a5c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:53.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1af9ffb640 1 -- 172.21.15.177:0/224556446 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c059170 con 0x55e0bbdc6320 2023-11-28T20:09:53.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1af9ffb640 1 -- 172.21.15.177:0/224556446 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c053640 con 0x55e0bbdc6320 2023-11-28T20:09:53.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1af9ffb640 1 -- 172.21.15.177:0/224556446 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c055500 con 0x55e0bbdc6320 2023-11-28T20:09:53.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 -- 172.21.15.177:0/224556446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbdc6320 msgr2=0x55e0bbdc6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/224556446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbdc6320 0x55e0bbdc6700 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c05cfc0 tx=0x7f1b0c055360 comp rx=0 tx=0).stop 2023-11-28T20:09:53.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 -- 172.21.15.177:0/224556446 shutdown_connections 2023-11-28T20:09:53.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/224556446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbdc6320 0x55e0bbdc6700 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/224556446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbe105b0 0x55e0bbdc5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/224556446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe0fc90 0x55e0bbe10070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 -- 172.21.15.177:0/224556446 >> 172.21.15.177:0/224556446 conn(0x55e0bbdc22d0 msgr2=0x55e0bbdc46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:53.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 -- 172.21.15.177:0/224556446 shutdown_connections 2023-11-28T20:09:53.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 -- 172.21.15.177:0/224556446 wait complete. 2023-11-28T20:09:53.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 -- start start 2023-11-28T20:09:53.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 Processor -- start 2023-11-28T20:09:53.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbdc6320 0x55e0bbdcad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbe0fc90 0x55e0bbdcb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe105b0 0x55e0bbdde910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bbc167c0 con 0x55e0bbe0fc90 2023-11-28T20:09:53.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bbbcebf0 con 0x55e0bbdc6320 2023-11-28T20:09:53.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0bbbd4a90 con 0x55e0bbe105b0 2023-11-28T20:09:53.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b1dca5000 10 client.0 _ll_register_callbacks cb 0x55e0bbdb13c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:09:53.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b137fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbe0fc90 0x55e0bbdcb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b137fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbe0fc90 0x55e0bbdcb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51564/0 (socket says 172.21.15.177:51564) 2023-11-28T20:09:53.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b137fe640 1 -- 172.21.15.177:0/2819604122 learned_addr learned my addr 172.21.15.177:0/2819604122 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:53.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b13fff640 1 --2- 172.21.15.177:0/2819604122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbdc6320 0x55e0bbdcad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.940+0000 7f1b18ec7640 1 --2- 172.21.15.177:0/2819604122 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe105b0 0x55e0bbdde910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b137fe640 1 -- 172.21.15.177:0/2819604122 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe105b0 msgr2=0x55e0bbdde910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:53.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b137fe640 1 --2- 172.21.15.177:0/2819604122 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe105b0 0x55e0bbdde910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b137fe640 1 -- 172.21.15.177:0/2819604122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbdc6320 msgr2=0x55e0bbdcad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:53.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b137fe640 1 --2- 172.21.15.177:0/2819604122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbdc6320 0x55e0bbdcad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b137fe640 1 -- 172.21.15.177:0/2819604122 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b140caf90 con 0x55e0bbe0fc90 2023-11-28T20:09:53.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b137fe640 1 --2- 172.21.15.177:0/2819604122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbe0fc90 0x55e0bbdcb280 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1b0801a090 tx=0x7f1b080046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac26776372909e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:53.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1af2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-11-28T20:09:53.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1af2ffd640 1 -- 172.21.15.177:0/2819604122 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b080c3070 con 0x55e0bbe0fc90 2023-11-28T20:09:53.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 1 -- 172.21.15.177:0/2819604122 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0bbbd8470 con 0x55e0bbe0fc90 2023-11-28T20:09:53.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1af2ffd640 1 -- 172.21.15.177:0/2819604122 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b080b9040 con 0x55e0bbe0fc90 2023-11-28T20:09:53.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1af2ffd640 1 -- 172.21.15.177:0/2819604122 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b080ab650 con 0x55e0bbe0fc90 2023-11-28T20:09:53.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 10 client.6069 fetch_fsmap learned FSMap version 26 2023-11-28T20:09:53.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 1 -- 172.21.15.177:0/2819604122 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55e0bbbd7190 con 0x55e0bbe0fc90 2023-11-28T20:09:53.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1af2ffd640 1 -- 172.21.15.177:0/2819604122 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0bbbd8470 con 0x55e0bbe0fc90 2023-11-28T20:09:53.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1af2ffd640 1 -- 172.21.15.177:0/2819604122 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1b080bd050 con 0x55e0bbe0fc90 2023-11-28T20:09:53.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 10 client.6069 fetch_fsmap finished waiting for FSMap version 26 2023-11-28T20:09:53.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 10 client.6069 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T20:09:53.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 20 client.6069 populate_metadata read hostname 'smithi177' 2023-11-28T20:09:53.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/2819604122 >> [v2:172.21.15.177:6836/198543116,v1:172.21.15.177:6837/198543116] conn(0x55e0bbddf320 0x55e0bbe21f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 4 client.6069 mds_command: new command op to 5907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T20:09:53.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 1 -- 172.21.15.177:0/2819604122 --> [v2:172.21.15.177:6836/198543116,v1:172.21.15.177:6837/198543116] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0bbbdbb50 con 0x55e0bbddf320 2023-11-28T20:09:53.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b13fff640 1 --2- 172.21.15.177:0/2819604122 >> [v2:172.21.15.177:6836/198543116,v1:172.21.15.177:6837/198543116] conn(0x55e0bbddf320 0x55e0bbe21f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b13fff640 1 --2- 172.21.15.177:0/2819604122 >> [v2:172.21.15.177:6836/198543116,v1:172.21.15.177:6837/198543116] conn(0x55e0bbddf320 0x55e0bbe21f50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51a019f1858f6ea2 server_cookie=9f45f510d6a2f8d5 in_seq=0 out_seq=0 2023-11-28T20:09:53.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1af2ffd640 10 client.6069 ms_handle_connect on v2:172.21.15.177:6836/198543116 2023-11-28T20:09:53.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1af2ffd640 1 -- 172.21.15.177:0/2819604122 <== mds.0 v2:172.21.15.177:6836/198543116 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e0bbbdbb50 con 0x55e0bbddf320 2023-11-28T20:09:53.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1af2ffd640 10 client.6069 handle_command_reply: tid=0 2023-11-28T20:09:53.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 1 client.6069 shutdown 2023-11-28T20:09:53.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 1 -- 172.21.15.177:0/2819604122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbe0fc90 msgr2=0x55e0bbdcb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/2819604122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbe0fc90 0x55e0bbdcb280 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1b0801a090 tx=0x7f1b080046d0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 1 -- 172.21.15.177:0/2819604122 shutdown_connections 2023-11-28T20:09:53.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/2819604122 >> [v2:172.21.15.177:6836/198543116,v1:172.21.15.177:6837/198543116] conn(0x55e0bbddf320 0x55e0bbe21f50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/2819604122 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe105b0 0x55e0bbdde910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/2819604122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbe0fc90 0x55e0bbdcb280 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/2819604122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbdc6320 0x55e0bbdcad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1af2ffd640 0 client.6069 ms_handle_reset on v2:172.21.15.177:6836/198543116 2023-11-28T20:09:53.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 1 -- 172.21.15.177:0/2819604122 >> 172.21.15.177:0/2819604122 conn(0x55e0bbdc22d0 msgr2=0x55e0bbdc46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:53.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 1 -- 172.21.15.177:0/2819604122 shutdown_connections 2023-11-28T20:09:53.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 1 -- 172.21.15.177:0/2819604122 wait complete. 2023-11-28T20:09:53.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.944+0000 7f1b1dca5000 20 client.6069 trim_cache size 0 max 16384 2023-11-28T20:09:53.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.960+0000 7f1b1dca5000 1 Processor -- start 2023-11-28T20:09:53.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.960+0000 7f1b1dca5000 1 -- start start 2023-11-28T20:09:53.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.960+0000 7f1b1dca5000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbdc6320 0x55e0bbe0ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.960+0000 7f1b1dca5000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbe0fc90 0x55e0bbe0db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.960+0000 7f1b1dca5000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe105b0 0x55e0bbe0e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.960+0000 7f1b1dca5000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bb8cf940 con 0x55e0bbdc6320 2023-11-28T20:09:53.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.960+0000 7f1b1dca5000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bbc15470 con 0x55e0bbe0fc90 2023-11-28T20:09:53.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.960+0000 7f1b1dca5000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0bbbd26f0 con 0x55e0bbe105b0 2023-11-28T20:09:53.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.960+0000 7f1b13fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbdc6320 0x55e0bbe0ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.960+0000 7f1b13fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbdc6320 0x55e0bbe0ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51580/0 (socket says 172.21.15.177:51580) 2023-11-28T20:09:53.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b13fff640 1 -- 172.21.15.177:0/3816113929 learned_addr learned my addr 172.21.15.177:0/3816113929 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:53.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b13fff640 1 -- 172.21.15.177:0/3816113929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe105b0 msgr2=0x55e0bbe0e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:53.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b13fff640 1 --2- 172.21.15.177:0/3816113929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe105b0 0x55e0bbe0e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b13fff640 1 -- 172.21.15.177:0/3816113929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbe0fc90 msgr2=0x55e0bbe0db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:53.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b13fff640 1 --2- 172.21.15.177:0/3816113929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbe0fc90 0x55e0bbe0db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b13fff640 1 -- 172.21.15.177:0/3816113929 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0bbbbd490 con 0x55e0bbdc6320 2023-11-28T20:09:53.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b13fff640 1 --2- 172.21.15.177:0/3816113929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbdc6320 0x55e0bbe0ea80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x55e0bbdcb930 tx=0x7f1b04012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fe6f4fec858c32 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:53.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1afa7fc640 1 -- 172.21.15.177:0/3816113929 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04007590 con 0x55e0bbdc6320 2023-11-28T20:09:53.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1afa7fc640 1 -- 172.21.15.177:0/3816113929 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0402a070 con 0x55e0bbdc6320 2023-11-28T20:09:53.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1afa7fc640 1 -- 172.21.15.177:0/3816113929 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04023470 con 0x55e0bbdc6320 2023-11-28T20:09:53.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 -- 172.21.15.177:0/3816113929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbdc6320 msgr2=0x55e0bbe0ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/3816113929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbdc6320 0x55e0bbe0ea80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x55e0bbdcb930 tx=0x7f1b04012000 comp rx=0 tx=0).stop 2023-11-28T20:09:53.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 -- 172.21.15.177:0/3816113929 shutdown_connections 2023-11-28T20:09:53.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/3816113929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe105b0 0x55e0bbe0e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/3816113929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbe0fc90 0x55e0bbe0db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/3816113929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbdc6320 0x55e0bbe0ea80 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 -- 172.21.15.177:0/3816113929 >> 172.21.15.177:0/3816113929 conn(0x55e0bbdc22d0 msgr2=0x55e0bbdc46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:53.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 -- 172.21.15.177:0/3816113929 shutdown_connections 2023-11-28T20:09:53.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 -- 172.21.15.177:0/3816113929 wait complete. 2023-11-28T20:09:53.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 -- start start 2023-11-28T20:09:53.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 Processor -- start 2023-11-28T20:09:53.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbdc6320 0x55e0bbe242e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe0fc90 0x55e0bbe22fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbe105b0 0x55e0bbe234e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bbc1cf30 con 0x55e0bbe105b0 2023-11-28T20:09:53.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bbbd39b0 con 0x55e0bbdc6320 2023-11-28T20:09:53.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0bbc125c0 con 0x55e0bbe0fc90 2023-11-28T20:09:53.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b1dca5000 10 client.0 _ll_register_callbacks cb 0x55e0bbc64c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:09:53.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b18ec7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbe105b0 0x55e0bbe234e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b18ec7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbe105b0 0x55e0bbe234e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51592/0 (socket says 172.21.15.177:51592) 2023-11-28T20:09:53.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b18ec7640 1 -- 172.21.15.177:0/1691648647 learned_addr learned my addr 172.21.15.177:0/1691648647 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:53.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.964+0000 7f1b137fe640 1 --2- 172.21.15.177:0/1691648647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe0fc90 0x55e0bbe22fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b13fff640 1 --2- 172.21.15.177:0/1691648647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbdc6320 0x55e0bbe242e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b18ec7640 1 -- 172.21.15.177:0/1691648647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe0fc90 msgr2=0x55e0bbe22fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:53.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b18ec7640 1 --2- 172.21.15.177:0/1691648647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe0fc90 0x55e0bbe22fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b18ec7640 1 -- 172.21.15.177:0/1691648647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbdc6320 msgr2=0x55e0bbe242e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:53.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b18ec7640 1 --2- 172.21.15.177:0/1691648647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbdc6320 0x55e0bbe242e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b18ec7640 1 -- 172.21.15.177:0/1691648647 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0401d040 con 0x55e0bbe105b0 2023-11-28T20:09:53.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b13fff640 1 --2- 172.21.15.177:0/1691648647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbdc6320 0x55e0bbe242e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:53.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b18ec7640 1 --2- 172.21.15.177:0/1691648647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbe105b0 0x55e0bbe234e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c059500 tx=0x7f1b0c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105163875d756e0f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:53.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1af2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-11-28T20:09:53.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1af2ffd640 1 -- 172.21.15.177:0/1691648647 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c054990 con 0x55e0bbe105b0 2023-11-28T20:09:53.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1af2ffd640 1 -- 172.21.15.177:0/1691648647 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b0c055500 con 0x55e0bbe105b0 2023-11-28T20:09:53.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 1 -- 172.21.15.177:0/1691648647 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0bbc15110 con 0x55e0bbe105b0 2023-11-28T20:09:53.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1af2ffd640 1 -- 172.21.15.177:0/1691648647 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b0c059170 con 0x55e0bbe105b0 2023-11-28T20:09:53.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 10 client.6075 fetch_fsmap learned FSMap version 26 2023-11-28T20:09:53.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 1 -- 172.21.15.177:0/1691648647 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55e0bb90ecc0 con 0x55e0bbe105b0 2023-11-28T20:09:53.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1af2ffd640 1 -- 172.21.15.177:0/1691648647 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0bbc15110 con 0x55e0bbe105b0 2023-11-28T20:09:53.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1af2ffd640 1 -- 172.21.15.177:0/1691648647 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1b0c012070 con 0x55e0bbe105b0 2023-11-28T20:09:53.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 10 client.6075 fetch_fsmap finished waiting for FSMap version 26 2023-11-28T20:09:53.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 10 client.6075 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T20:09:53.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 20 client.6075 populate_metadata read hostname 'smithi177' 2023-11-28T20:09:53.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/1691648647 >> [v2:172.21.15.177:6836/198543116,v1:172.21.15.177:6837/198543116] conn(0x55e0bbe76e40 0x55e0bbe79230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:53.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 4 client.6075 mds_command: new command op to 5907 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T20:09:53.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 1 -- 172.21.15.177:0/1691648647 --> [v2:172.21.15.177:6836/198543116,v1:172.21.15.177:6837/198543116] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e0bbc449a0 con 0x55e0bbe76e40 2023-11-28T20:09:53.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b13fff640 1 --2- 172.21.15.177:0/1691648647 >> [v2:172.21.15.177:6836/198543116,v1:172.21.15.177:6837/198543116] conn(0x55e0bbe76e40 0x55e0bbe79230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:53.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1af2ffd640 10 client.6075 ms_handle_connect on v2:172.21.15.177:6836/198543116 2023-11-28T20:09:53.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b13fff640 1 --2- 172.21.15.177:0/1691648647 >> [v2:172.21.15.177:6836/198543116,v1:172.21.15.177:6837/198543116] conn(0x55e0bbe76e40 0x55e0bbe79230 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc32af4f5660304f server_cookie=1cf70948492927d2 in_seq=0 out_seq=0 2023-11-28T20:09:53.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1af2ffd640 1 -- 172.21.15.177:0/1691648647 <== mds.0 v2:172.21.15.177:6836/198543116 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e0bbc449a0 con 0x55e0bbe76e40 2023-11-28T20:09:53.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1af2ffd640 10 client.6075 handle_command_reply: tid=0 2023-11-28T20:09:53.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 1 client.6075 shutdown 2023-11-28T20:09:53.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 1 -- 172.21.15.177:0/1691648647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbe105b0 msgr2=0x55e0bbe234e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/1691648647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbe105b0 0x55e0bbe234e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c059500 tx=0x7f1b0c004a50 comp rx=0 tx=0).stop 2023-11-28T20:09:53.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 1 -- 172.21.15.177:0/1691648647 shutdown_connections 2023-11-28T20:09:53.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/1691648647 >> [v2:172.21.15.177:6836/198543116,v1:172.21.15.177:6837/198543116] conn(0x55e0bbe76e40 0x55e0bbe79230 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/1691648647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0bbe105b0 0x55e0bbe234e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/1691648647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0bbe0fc90 0x55e0bbe22fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 1 --2- 172.21.15.177:0/1691648647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0bbdc6320 0x55e0bbe242e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 1 -- 172.21.15.177:0/1691648647 >> 172.21.15.177:0/1691648647 conn(0x55e0bbdc22d0 msgr2=0x55e0bbe1d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:53.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1af2ffd640 0 client.6075 ms_handle_reset on v2:172.21.15.177:6836/198543116 2023-11-28T20:09:53.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 1 -- 172.21.15.177:0/1691648647 shutdown_connections 2023-11-28T20:09:53.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 1 -- 172.21.15.177:0/1691648647 wait complete. 2023-11-28T20:09:53.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b1dca5000 20 client.6075 trim_cache size 0 max 16384 2023-11-28T20:09:53.982 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:09:53.982 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "281097bd-2f79-488c-a8b5-264c5bd230f4", 2023-11-28T20:09:53.982 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-11-28T20:09:53.982 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 5907, 2023-11-28T20:09:53.982 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-11-28T20:09:53.983 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-11-28T20:09:53.983 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-11-28T20:09:53.983 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 10.307351238000001, 2023-11-28T20:09:53.983 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 26, 2023-11-28T20:09:53.983 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 49, 2023-11-28T20:09:53.983 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 49, 2023-11-28T20:09:53.983 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 16.165881734999999 2023-11-28T20:09:53.983 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:09:53.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b196c8640 1 -- 172.21.15.177:0/1688736126 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1b00066470 msgr2=0x7f1b00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b196c8640 1 --2- 172.21.15.177:0/1688736126 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1b00066470 0x7f1b00068930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1b04000f70 tx=0x7f1b04007cb0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b196c8640 1 -- 172.21.15.177:0/1688736126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b14161750 msgr2=0x7f1b1415fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:53.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b196c8640 1 --2- 172.21.15.177:0/1688736126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b14161750 0x7f1b1415fdd0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c007df0 tx=0x7f1b0c00d4a0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b196c8640 1 -- 172.21.15.177:0/1688736126 shutdown_connections 2023-11-28T20:09:53.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b196c8640 1 --2- 172.21.15.177:0/1688736126 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1b00066470 0x7f1b00068930 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b196c8640 1 --2- 172.21.15.177:0/1688736126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b14161750 0x7f1b1415fdd0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b196c8640 1 --2- 172.21.15.177:0/1688736126 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b140d0400 0x7f1b140cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b196c8640 1 --2- 172.21.15.177:0/1688736126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b140cf910 0x7f1b14159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:53.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b196c8640 1 -- 172.21.15.177:0/1688736126 >> 172.21.15.177:0/1688736126 conn(0x7f1b140d2f60 msgr2=0x7f1b1406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:53.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b196c8640 1 -- 172.21.15.177:0/1688736126 shutdown_connections 2023-11-28T20:09:53.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:53.968+0000 7f1b196c8640 1 -- 172.21.15.177:0/1688736126 wait complete. 2023-11-28T20:09:53.992 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:09:54.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f182b617640 1 Processor -- start 2023-11-28T20:09:54.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f182b617640 1 -- start start 2023-11-28T20:09:54.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f182b617640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f182406c9d0 0x7f1824145250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:54.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f182b617640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f182415c070 0x7f1824145790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:54.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f182b617640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1824145fc0 con 0x7f182415bc90 2023-11-28T20:09:54.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f182b617640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18241462a0 con 0x7f182406c9d0 2023-11-28T20:09:54.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f182b617640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1824146580 con 0x7f182415c070 2023-11-28T20:09:54.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f1828bb2640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f182406c9d0 0x7f1824145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:54.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f18293b3640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f182415bc90 0x7f182406c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:42712/0 (socket says 172.21.15.177:42712) 2023-11-28T20:09:54.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f18293b3640 1 -- 172.21.15.177:0/1816424185 learned_addr learned my addr 172.21.15.177:0/1816424185 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:54.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f1829bb4640 1 --2- 172.21.15.177:0/1816424185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f182415c070 0x7f1824145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:54.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f1828bb2640 1 -- 172.21.15.177:0/1816424185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f182415c070 msgr2=0x7f1824145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:54.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f1828bb2640 1 --2- 172.21.15.177:0/1816424185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f182415c070 0x7f1824145790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:54.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f1828bb2640 1 -- 172.21.15.177:0/1816424185 >> v1:172.21.15.177:6789/0 conn(0x7f182415bc90 legacy=0x7f182406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:54.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f1828bb2640 1 -- 172.21.15.177:0/1816424185 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824146860 con 0x7f182406c9d0 2023-11-28T20:09:54.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.128+0000 7f181bfff640 1 -- 172.21.15.177:0/1816424185 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552586043 0 0) 0x7f1824145fc0 con 0x7f182415bc90 2023-11-28T20:09:54.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.132+0000 7f1828bb2640 1 --2- 172.21.15.177:0/1816424185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f182406c9d0 0x7f1824145250 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f18140097f0 tx=0x7f181401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca98040fda08bced server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:54.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.132+0000 7f181bfff640 1 -- 172.21.15.177:0/1816424185 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140ac600 con 0x7f182406c9d0 2023-11-28T20:09:54.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.132+0000 7f181bfff640 1 -- 172.21.15.177:0/1816424185 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18140a8050 con 0x7f182406c9d0 2023-11-28T20:09:54.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.132+0000 7f181bfff640 1 -- 172.21.15.177:0/1816424185 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140ac980 con 0x7f182406c9d0 2023-11-28T20:09:54.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.132+0000 7f182b617640 1 -- 172.21.15.177:0/1816424185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f182406c9d0 msgr2=0x7f1824145250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:54.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.132+0000 7f182b617640 1 --2- 172.21.15.177:0/1816424185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f182406c9d0 0x7f1824145250 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f18140097f0 tx=0x7f181401c3c0 comp rx=0 tx=0).stop 2023-11-28T20:09:54.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.132+0000 7f182b617640 1 -- 172.21.15.177:0/1816424185 shutdown_connections 2023-11-28T20:09:54.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.132+0000 7f182b617640 1 --2- 172.21.15.177:0/1816424185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f182406c9d0 0x7f1824145250 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:54.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.132+0000 7f182b617640 1 --2- 172.21.15.177:0/1816424185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f182415c070 0x7f1824145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:54.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.132+0000 7f182b617640 1 -- 172.21.15.177:0/1816424185 >> 172.21.15.177:0/1816424185 conn(0x7f182406a530 msgr2=0x7f182406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:54.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.132+0000 7f182b617640 1 -- 172.21.15.177:0/1816424185 shutdown_connections 2023-11-28T20:09:54.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.132+0000 7f182b617640 1 -- 172.21.15.177:0/1816424185 wait complete. 2023-11-28T20:09:54.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f182b617640 1 Processor -- start 2023-11-28T20:09:54.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f182b617640 1 -- start start 2023-11-28T20:09:54.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f182b617640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f182406c9d0 0x7f1824141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:54.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f182b617640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f182415bc90 0x7f1824143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:54.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f182b617640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f182415c070 0x7f1824155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:54.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f182b617640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18240ce6e0 con 0x7f182415c070 2023-11-28T20:09:54.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f182b617640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18240ce060 con 0x7f182406c9d0 2023-11-28T20:09:54.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f182b617640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18240ceb00 con 0x7f182415bc90 2023-11-28T20:09:54.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f1829bb4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f182415c070 0x7f1824155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:54.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f1829bb4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f182415c070 0x7f1824155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51616/0 (socket says 172.21.15.177:51616) 2023-11-28T20:09:54.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f1829bb4640 1 -- 172.21.15.177:0/2085853307 learned_addr learned my addr 172.21.15.177:0/2085853307 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:54.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f1828bb2640 1 --2- 172.21.15.177:0/2085853307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f182415bc90 0x7f1824143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:54.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f18293b3640 1 --2- 172.21.15.177:0/2085853307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f182406c9d0 0x7f1824141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:54.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f1829bb4640 1 -- 172.21.15.177:0/2085853307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f182415bc90 msgr2=0x7f1824143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:54.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f1829bb4640 1 --2- 172.21.15.177:0/2085853307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f182415bc90 0x7f1824143460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:54.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f1829bb4640 1 -- 172.21.15.177:0/2085853307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f182406c9d0 msgr2=0x7f1824141c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:54.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f1829bb4640 1 --2- 172.21.15.177:0/2085853307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f182406c9d0 0x7f1824141c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:54.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f1829bb4640 1 -- 172.21.15.177:0/2085853307 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1814009420 con 0x7f182415c070 2023-11-28T20:09:54.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f18293b3640 1 --2- 172.21.15.177:0/2085853307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f182406c9d0 0x7f1824141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:54.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f1829bb4640 1 --2- 172.21.15.177:0/2085853307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f182415c070 0x7f1824155f80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f181c009fd0 tx=0x7f181c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:54.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f1819ffb640 1 -- 172.21.15.177:0/2085853307 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c014420 con 0x7f182415c070 2023-11-28T20:09:54.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f1819ffb640 1 -- 172.21.15.177:0/2085853307 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c014580 con 0x7f182415c070 2023-11-28T20:09:54.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f1819ffb640 1 -- 172.21.15.177:0/2085853307 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c014930 con 0x7f182415c070 2023-11-28T20:09:54.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.136+0000 7f182b617640 1 -- 172.21.15.177:0/2085853307 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1824143d70 con 0x7f182415c070 2023-11-28T20:09:54.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.140+0000 7f182b617640 1 -- 172.21.15.177:0/2085853307 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1824144050 con 0x7f182415c070 2023-11-28T20:09:54.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.140+0000 7f182b617640 1 -- 172.21.15.177:0/2085853307 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18240ce820 con 0x7f182415c070 2023-11-28T20:09:54.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.140+0000 7f1819ffb640 1 -- 172.21.15.177:0/2085853307 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f181c014a90 con 0x7f182415c070 2023-11-28T20:09:54.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.140+0000 7f1819ffb640 1 --2- 172.21.15.177:0/2085853307 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1808066470 0x7f1808068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:54.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.140+0000 7f1819ffb640 1 -- 172.21.15.177:0/2085853307 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f181c0846c0 con 0x7f182415c070 2023-11-28T20:09:54.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.140+0000 7f18293b3640 1 --2- 172.21.15.177:0/2085853307 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1808066470 0x7f1808068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:54.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.144+0000 7f18293b3640 1 --2- 172.21.15.177:0/2085853307 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1808066470 0x7f1808068930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1820007fd0 tx=0x7f1820007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:54.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.144+0000 7f1819ffb640 1 -- 172.21.15.177:0/2085853307 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f181c051b30 con 0x7f182415c070 2023-11-28T20:09:54.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.332+0000 7f182b617640 1 -- 172.21.15.177:0/2085853307 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1824069440 con 0x7f182415c070 2023-11-28T20:09:54.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.332+0000 7f1819ffb640 1 -- 172.21.15.177:0/2085853307 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f181c055150 con 0x7f182415c070 2023-11-28T20:09:54.336 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:09:54.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.332+0000 7f182b617640 1 -- 172.21.15.177:0/2085853307 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1808066470 msgr2=0x7f1808068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:54.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.332+0000 7f182b617640 1 --2- 172.21.15.177:0/2085853307 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1808066470 0x7f1808068930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1820007fd0 tx=0x7f1820007c20 comp rx=0 tx=0).stop 2023-11-28T20:09:54.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.332+0000 7f182b617640 1 -- 172.21.15.177:0/2085853307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f182415c070 msgr2=0x7f1824155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:54.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.332+0000 7f182b617640 1 --2- 172.21.15.177:0/2085853307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f182415c070 0x7f1824155f80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f181c009fd0 tx=0x7f181c00e4b0 comp rx=0 tx=0).stop 2023-11-28T20:09:54.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.332+0000 7f182b617640 1 -- 172.21.15.177:0/2085853307 shutdown_connections 2023-11-28T20:09:54.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.332+0000 7f182b617640 1 --2- 172.21.15.177:0/2085853307 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1808066470 0x7f1808068930 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:54.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.332+0000 7f182b617640 1 --2- 172.21.15.177:0/2085853307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f182415c070 0x7f1824155f80 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:54.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.332+0000 7f182b617640 1 --2- 172.21.15.177:0/2085853307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f182415bc90 0x7f1824143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:54.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.332+0000 7f182b617640 1 --2- 172.21.15.177:0/2085853307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f182406c9d0 0x7f1824141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:54.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.332+0000 7f182b617640 1 -- 172.21.15.177:0/2085853307 >> 172.21.15.177:0/2085853307 conn(0x7f182406a530 msgr2=0x7f182406c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:54.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.332+0000 7f182b617640 1 -- 172.21.15.177:0/2085853307 shutdown_connections 2023-11-28T20:09:54.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:54.332+0000 7f182b617640 1 -- 172.21.15.177:0/2085853307 wait complete. 2023-11-28T20:09:54.357 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T20:09:54.357 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:09:54.357 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-11-28T20:09:54.357 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T20:09:54.357 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:54.358 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T20:09:54.358 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T20:09:54.358 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:09:54.358 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:09:54.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:54.358 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-11-28T20:09:54.369 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:09:54.369 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:09:54.369 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:09:54.369 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:54.369 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-11-28T20:09:54.370 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:54.370 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:09:54.370 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:54.370 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-11-28T20:09:54.370 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:09:54.370 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:54.370 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-11-28T20:09:54.370 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:09:54.371 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:54.371 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:09:54.371 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:54.371 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:09:54.371 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42279sec preferred_lft 42279sec 2023-11-28T20:09:54.371 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-11-28T20:09:54.371 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:54.371 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:09:54.371 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:91:19:71:65 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:54.371 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:09:54.371 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:54.371 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:09:54.372 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:54.372 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:09:54.372 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:54.372 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:09:54.372 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:54.372 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:09:54.372 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:54.372 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:09:54.372 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:54.372 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:09:54.373 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:54.373 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-28T20:09:54.373 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:54.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:54.373 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:09:54.433 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-11-28T20:09:54.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:54.435 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-11-28T20:09:54.489 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-11-28T20:09:54.490 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:09:54.490 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:09:54.490 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:09:54.490 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:09:54.490 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:09:54.490 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:09:54.490 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:09:54.490 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:09:54.490 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:09:54.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:54.491 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-28T20:09:54.491 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-28T20:09:54.491 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:09:54.491 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:09:54.491 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:09:54.491 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-28T20:09:54.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:54.580 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-11-28T20:09:54.590 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T20:09:54.590 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T20:09:54.590 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:09:54.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:54.590 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-11-28T20:09:54.654 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T20:09:54.654 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:09:54.655 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:54.706 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:09:54.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:09:54.707 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:54.758 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:09:54.823 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:09:54.876 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:09:54.876 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:09:54.876 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:09:54.876 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:09:54.876 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:09:54.876 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:09:54.876 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:09:54.876 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:09:54.877 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:09:54.877 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:09:54.877 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:09:54.877 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:09:54.877 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:09:54.877 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:09:54.877 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:09:54.877 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:09:54.877 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:09:54.877 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:09:54.877 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:09:54.877 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:09:54.878 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:09:54.878 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:09:54.878 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:09:54.878 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:09:54.878 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:09:54.878 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:09:54.878 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:09:54.878 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:09:54.878 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:09:54.878 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:54.878 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:54.879 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:54.879 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:54.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:54.880 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:09:54.934 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T20:09:54.934 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T20:09:54.981 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:09:55.002 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:09:55.057 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:09:55.058 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:09:55.058 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:09:55.058 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:09:55.058 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:09:55.058 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:09:55.058 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:09:55.058 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:09:55.058 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:09:55.058 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:09:55.059 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:09:55.059 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:09:55.059 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:09:55.059 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:09:55.059 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:09:55.059 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:09:55.059 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:09:55.059 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:09:55.059 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:09:55.059 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:09:55.060 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:09:55.060 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:09:55.060 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:09:55.060 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:09:55.060 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:09:55.060 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:09:55.060 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:09:55.060 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:09:55.060 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:09:55.060 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:55.061 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:55.061 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:55.061 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:55.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:55.062 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:09:55.078 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-11-28T20:09:55.072+0000 7f704ccb8580 -1 init, newargv = 0x55af8cf8ee90 newargc=15 2023-11-28T20:09:55.079 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[51829]: starting ceph client 2023-11-28T20:09:55.085 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[51829]: starting fuse 2023-11-28T20:09:55.090 INFO:teuthology.orchestra.run.smithi177.stdout:43 2023-11-28T20:09:55.090 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T20:09:55.090 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-11-28T20:09:55.090 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-11-28T20:09:55.090 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-11-28T20:09:55.090 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-11-28T20:09:55.091 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-11-28T20:09:55.091 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:09:55.091 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-11-28T20:09:55.091 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T20:09:55.091 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-11-28T20:09:55.091 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T20:09:55.091 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:09:55.091 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-11-28T20:09:55.091 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-11-28T20:09:55.091 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-11-28T20:09:55.091 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-11-28T20:09:55.091 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:09:55.092 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-11-28T20:09:55.092 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T20:09:55.092 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T20:09:55.092 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T20:09:55.092 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-11-28T20:09:55.092 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-11-28T20:09:55.092 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-11-28T20:09:55.092 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T20:09:55.092 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:09:55.092 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-11-28T20:09:55.092 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-11-28T20:09:55.214 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.51829.asok 2023-11-28T20:09:55.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T20:09:55.225 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51829.asok 2023-11-28T20:09:55.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:55.226 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51829.asok status 2023-11-28T20:09:55.395 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:09:55.395 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-11-28T20:09:55.395 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T20:09:55.395 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T20:09:55.395 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-11-28T20:09:55.395 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-11-28T20:09:55.396 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T20:09:55.396 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "51829", 2023-11-28T20:09:55.396 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-11-28T20:09:55.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:55.396 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-11-28T20:09:55.397 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-11-28T20:09:55.397 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 6093, 2023-11-28T20:09:55.397 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-11-28T20:09:55.397 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-11-28T20:09:55.397 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-11-28T20:09:55.397 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 6093 2023-11-28T20:09:55.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:55.398 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:09:55.398 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:09:55.398 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:09:55.398 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1731175249 2023-11-28T20:09:55.398 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:09:55.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:55.398 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:09:55.398 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:09:55.399 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:09:55.399 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1731175249 2023-11-28T20:09:55.399 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:09:55.399 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.6093 192.168.0.1:0/1731175249", 2023-11-28T20:09:55.399 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/1731175249", 2023-11-28T20:09:55.399 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-11-28T20:09:55.399 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 26, 2023-11-28T20:09:55.399 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 49, 2023-11-28T20:09:55.399 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-11-28T20:09:55.399 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-11-28T20:09:55.399 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-11-28T20:09:55.399 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:09:55.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:55.411 DEBUG:teuthology.orchestra.run.smithi177:> stat --file-system '--printf=%T 2023-11-28T20:09:55.411 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:55.421 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-11-28T20:09:55.421 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:55.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:55.421 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:55.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:55.484 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2023-11-28T20:09:55.542 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=cephfs_data' 2023-11-28T20:09:55.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.720+0000 7f394bbf8640 1 Processor -- start 2023-11-28T20:09:55.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.720+0000 7f394bbf8640 1 -- start start 2023-11-28T20:09:55.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f394bbf8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3944072530 0x7f39440cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:55.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f394bbf8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39440ced10 con 0x7f39440ce200 2023-11-28T20:09:55.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f394bbf8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39440cea30 con 0x7f394413d0a0 2023-11-28T20:09:55.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f394bbf8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394413d480 con 0x7f3944072530 2023-11-28T20:09:55.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f394a195640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f39440ce200 0x7f394413e2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:42726/0 (socket says 172.21.15.177:42726) 2023-11-28T20:09:55.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f394a195640 1 -- 172.21.15.177:0/68730632 learned_addr learned my addr 172.21.15.177:0/68730632 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:55.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3949193640 1 --2- 172.21.15.177:0/68730632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3944072530 0x7f39440cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:55.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3948992640 1 -- 172.21.15.177:0/68730632 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3614159208 0 0) 0x7f39440ced10 con 0x7f39440ce200 2023-11-28T20:09:55.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3948992640 1 -- 172.21.15.177:0/68730632 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3930003530 con 0x7f39440ce200 2023-11-28T20:09:55.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3948992640 1 -- 172.21.15.177:0/68730632 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1046023278 0 0) 0x7f3930003530 con 0x7f39440ce200 2023-11-28T20:09:55.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3948992640 1 -- 172.21.15.177:0/68730632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3944072530 msgr2=0x7f39440cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:55.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3948992640 1 --2- 172.21.15.177:0/68730632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3944072530 0x7f39440cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:55.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3948992640 1 -- 172.21.15.177:0/68730632 >> v1:172.21.15.195:6789/0 conn(0x7f394413d0a0 legacy=0x7f3944071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:55.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3948992640 1 -- 172.21.15.177:0/68730632 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394413d800 con 0x7f39440ce200 2023-11-28T20:09:55.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3948992640 1 -- 172.21.15.177:0/68730632 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f393c001a00 con 0x7f39440ce200 2023-11-28T20:09:55.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3948992640 1 -- 172.21.15.177:0/68730632 >> v1:172.21.15.177:6789/0 conn(0x7f39440ce200 legacy=0x7f394413e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:55.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3948992640 1 --2- 172.21.15.177:0/68730632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3944072530 0x7f39300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:55.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3948992640 1 --2- 172.21.15.177:0/68730632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3930003ef0 0x7f39300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:55.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3948992640 1 --2- 172.21.15.177:0/68730632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3930004d10 0x7f3930005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:55.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3948992640 1 -- 172.21.15.177:0/68730632 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393000ba70 con 0x7f3930004d10 2023-11-28T20:09:55.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3948992640 1 -- 172.21.15.177:0/68730632 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393000bbe0 con 0x7f3930003ef0 2023-11-28T20:09:55.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3948992640 1 -- 172.21.15.177:0/68730632 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393000dfb0 con 0x7f3944072530 2023-11-28T20:09:55.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3949994640 1 --2- 172.21.15.177:0/68730632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3944072530 0x7f39300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:55.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f394a195640 1 --2- 172.21.15.177:0/68730632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3930004d10 0x7f3930005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:55.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3949193640 1 --2- 172.21.15.177:0/68730632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3930003ef0 0x7f39300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:55.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3949994640 1 -- 172.21.15.177:0/68730632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3930003ef0 msgr2=0x7f39300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:55.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3949994640 1 --2- 172.21.15.177:0/68730632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3930003ef0 0x7f39300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:55.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3949994640 1 -- 172.21.15.177:0/68730632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3930004d10 msgr2=0x7f3930005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:55.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3949994640 1 --2- 172.21.15.177:0/68730632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3930004d10 0x7f3930005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:55.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f3949994640 1 -- 172.21.15.177:0/68730632 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3930003530 con 0x7f3944072530 2023-11-28T20:09:55.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.724+0000 7f394a195640 1 --2- 172.21.15.177:0/68730632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3930004d10 0x7f3930005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:09:55.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.728+0000 7f3949994640 1 --2- 172.21.15.177:0/68730632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3944072530 0x7f39300039b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3940001860 tx=0x7f394001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b81bf2bb856dfb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:55.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.728+0000 7f3948992640 1 -- 172.21.15.177:0/68730632 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39400ab600 con 0x7f3944072530 2023-11-28T20:09:55.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.728+0000 7f3948992640 1 -- 172.21.15.177:0/68730632 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39400a7050 con 0x7f3944072530 2023-11-28T20:09:55.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.728+0000 7f3948992640 1 -- 172.21.15.177:0/68730632 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39400aba20 con 0x7f3944072530 2023-11-28T20:09:55.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.728+0000 7f394bbf8640 1 -- 172.21.15.177:0/68730632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3944072530 msgr2=0x7f39300039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:55.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.728+0000 7f394bbf8640 1 --2- 172.21.15.177:0/68730632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3944072530 0x7f39300039b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3940001860 tx=0x7f394001c4d0 comp rx=0 tx=0).stop 2023-11-28T20:09:55.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.728+0000 7f394a195640 1 -- 172.21.15.177:0/68730632 reap_dead start 2023-11-28T20:09:55.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.728+0000 7f394bbf8640 1 -- 172.21.15.177:0/68730632 shutdown_connections 2023-11-28T20:09:55.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.728+0000 7f394bbf8640 1 -- 172.21.15.177:0/68730632 >> 172.21.15.177:0/68730632 conn(0x7f39440b0cc0 msgr2=0x7f39440b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:55.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.728+0000 7f394bbf8640 1 -- 172.21.15.177:0/68730632 shutdown_connections 2023-11-28T20:09:55.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.728+0000 7f394bbf8640 1 -- 172.21.15.177:0/68730632 wait complete. 2023-11-28T20:09:55.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f394bbf8640 1 Processor -- start 2023-11-28T20:09:55.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f394bbf8640 1 -- start start 2023-11-28T20:09:55.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f394bbf8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3944072530 0x7f39441f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:55.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f394bbf8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3944142210 0x7f39441f6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:55.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f394bbf8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39441f5140 0x7f394415faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:55.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f394bbf8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39441f6ef0 con 0x7f3944142210 2023-11-28T20:09:55.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f394bbf8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39441f67b0 con 0x7f3944072530 2023-11-28T20:09:55.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f394bbf8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394415dc60 con 0x7f39441f5140 2023-11-28T20:09:55.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f3949193640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3944142210 0x7f39441f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:55.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f3949193640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3944142210 0x7f39441f6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51644/0 (socket says 172.21.15.177:51644) 2023-11-28T20:09:55.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f3949193640 1 -- 172.21.15.177:0/3872764127 learned_addr learned my addr 172.21.15.177:0/3872764127 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:55.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f3949994640 1 --2- 172.21.15.177:0/3872764127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3944072530 0x7f39441f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:55.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f394a195640 1 --2- 172.21.15.177:0/3872764127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39441f5140 0x7f394415faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:55.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f3949193640 1 -- 172.21.15.177:0/3872764127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39441f5140 msgr2=0x7f394415faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:55.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f3949193640 1 --2- 172.21.15.177:0/3872764127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39441f5140 0x7f394415faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:55.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f3949193640 1 -- 172.21.15.177:0/3872764127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3944072530 msgr2=0x7f39441f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:55.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f3949193640 1 --2- 172.21.15.177:0/3872764127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3944072530 0x7f39441f69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:55.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f3949193640 1 -- 172.21.15.177:0/3872764127 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394413f500 con 0x7f3944142210 2023-11-28T20:09:55.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f3949193640 1 --2- 172.21.15.177:0/3872764127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3944142210 0x7f39441f6270 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3934011990 tx=0x7f3934011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:55.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f393a7fc640 1 -- 172.21.15.177:0/3872764127 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934004240 con 0x7f3944142210 2023-11-28T20:09:55.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f393a7fc640 1 -- 172.21.15.177:0/3872764127 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39340043a0 con 0x7f3944142210 2023-11-28T20:09:55.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f393a7fc640 1 -- 172.21.15.177:0/3872764127 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400fa80 con 0x7f3944142210 2023-11-28T20:09:55.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f394bbf8640 1 -- 172.21.15.177:0/3872764127 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394415df20 con 0x7f3944142210 2023-11-28T20:09:55.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f394bbf8640 1 -- 172.21.15.177:0/3872764127 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394415e4e0 con 0x7f3944142210 2023-11-28T20:09:55.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.732+0000 7f394bbf8640 1 -- 172.21.15.177:0/3872764127 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3944069440 con 0x7f3944142210 2023-11-28T20:09:55.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.736+0000 7f393a7fc640 1 -- 172.21.15.177:0/3872764127 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f393400fbe0 con 0x7f3944142210 2023-11-28T20:09:55.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.736+0000 7f393a7fc640 1 --2- 172.21.15.177:0/3872764127 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3928066470 0x7f3928068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:55.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.736+0000 7f393a7fc640 1 -- 172.21.15.177:0/3872764127 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39340844f0 con 0x7f3944142210 2023-11-28T20:09:55.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.736+0000 7f3949994640 1 --2- 172.21.15.177:0/3872764127 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3928066470 0x7f3928068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:55.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.736+0000 7f3949994640 1 --2- 172.21.15.177:0/3872764127 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3928066470 0x7f3928068930 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f39400ad000 tx=0x7f39400a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:55.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.740+0000 7f393a7fc640 1 -- 172.21.15.177:0/3872764127 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3934051990 con 0x7f3944142210 2023-11-28T20:09:55.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.940+0000 7f394bbf8640 1 -- 172.21.15.177:0/3872764127 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]} v 0) v1 -- 0x7f394415a040 con 0x7f3944142210 2023-11-28T20:09:55.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.944+0000 7f393a7fc640 1 -- 172.21.15.177:0/3872764127 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]}]=0 updated caps for client.0 v20) v1 ==== 183+0+140 (secure 0 0 0) 0x7f39340190a0 con 0x7f3944142210 2023-11-28T20:09:55.949 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-11-28T20:09:55.949 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZl+2t5KxAAc/J7x+fjSQR4IkIQJ/X8sw== 2023-11-28T20:09:55.950 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-11-28T20:09:55.950 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-11-28T20:09:55.950 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow r pool=cephfs_data" 2023-11-28T20:09:55.950 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-11-28T20:09:55.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.948+0000 7f394bbf8640 1 -- 172.21.15.177:0/3872764127 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3928066470 msgr2=0x7f3928068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:55.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.948+0000 7f394bbf8640 1 --2- 172.21.15.177:0/3872764127 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3928066470 0x7f3928068930 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f39400ad000 tx=0x7f39400a4f90 comp rx=0 tx=0).stop 2023-11-28T20:09:55.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.948+0000 7f394bbf8640 1 -- 172.21.15.177:0/3872764127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3944142210 msgr2=0x7f39441f6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:55.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.948+0000 7f394bbf8640 1 --2- 172.21.15.177:0/3872764127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3944142210 0x7f39441f6270 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3934011990 tx=0x7f3934011e50 comp rx=0 tx=0).stop 2023-11-28T20:09:55.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.948+0000 7f394bbf8640 1 -- 172.21.15.177:0/3872764127 shutdown_connections 2023-11-28T20:09:55.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.948+0000 7f394bbf8640 1 --2- 172.21.15.177:0/3872764127 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3928066470 0x7f3928068930 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:55.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.948+0000 7f394bbf8640 1 --2- 172.21.15.177:0/3872764127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39441f5140 0x7f394415faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:55.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.948+0000 7f394bbf8640 1 --2- 172.21.15.177:0/3872764127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3944142210 0x7f39441f6270 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:55.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.948+0000 7f394bbf8640 1 --2- 172.21.15.177:0/3872764127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3944072530 0x7f39441f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:55.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.948+0000 7f394bbf8640 1 -- 172.21.15.177:0/3872764127 >> 172.21.15.177:0/3872764127 conn(0x7f39440b0cc0 msgr2=0x7f39440adb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:55.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.948+0000 7f394bbf8640 1 -- 172.21.15.177:0/3872764127 shutdown_connections 2023-11-28T20:09:55.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:55.948+0000 7f394bbf8640 1 -- 172.21.15.177:0/3872764127 wait complete. 2023-11-28T20:09:55.970 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:09:55.970 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:09:55.980 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:09:56.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f245cf01640 1 Processor -- start 2023-11-28T20:09:56.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f245cf01640 1 -- start start 2023-11-28T20:09:56.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f245cf01640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f245806c9d0 0x7f245815a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f245cf01640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f245815ab70 0x7f24580cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f245cf01640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245815b3a0 con 0x7f245813cf30 2023-11-28T20:09:56.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f245cf01640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245813d310 con 0x7f245806c9d0 2023-11-28T20:09:56.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f245cf01640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24581404e0 con 0x7f245815ab70 2023-11-28T20:09:56.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f245659c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f245813cf30 0x7f245806c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:42738/0 (socket says 172.21.15.177:42738) 2023-11-28T20:09:56.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f245659c640 1 -- 172.21.15.177:0/2732676623 learned_addr learned my addr 172.21.15.177:0/2732676623 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:56.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2456d9d640 1 --2- 172.21.15.177:0/2732676623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f245815ab70 0x7f24580cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f244dd9b640 1 --2- 172.21.15.177:0/2732676623 >> v2:172.21.15.195:3300/0 conn(0x7f245806c9d0 0x7f245815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 -- 172.21.15.177:0/2732676623 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721818489 0 0) 0x7f245815b3a0 con 0x7f245813cf30 2023-11-28T20:09:56.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 -- 172.21.15.177:0/2732676623 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2444003530 con 0x7f245813cf30 2023-11-28T20:09:56.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 -- 172.21.15.177:0/2732676623 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2764639454 0 0) 0x7f2444003530 con 0x7f245813cf30 2023-11-28T20:09:56.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 -- 172.21.15.177:0/2732676623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f245815ab70 msgr2=0x7f24580cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:56.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 --2- 172.21.15.177:0/2732676623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f245815ab70 0x7f24580cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 -- 172.21.15.177:0/2732676623 >> v2:172.21.15.195:3300/0 conn(0x7f245806c9d0 msgr2=0x7f245815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:56.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 --2- 172.21.15.177:0/2732676623 >> v2:172.21.15.195:3300/0 conn(0x7f245806c9d0 0x7f245815a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 -- 172.21.15.177:0/2732676623 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245813f720 con 0x7f245813cf30 2023-11-28T20:09:56.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 -- 172.21.15.177:0/2732676623 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f2448001a00 con 0x7f245813cf30 2023-11-28T20:09:56.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 -- 172.21.15.177:0/2732676623 >> v1:172.21.15.177:6789/0 conn(0x7f245813cf30 legacy=0x7f245806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 --2- 172.21.15.177:0/2732676623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24440039b0 0x7f2444003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 --2- 172.21.15.177:0/2732676623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f245815ab70 0x7f24440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 --2- 172.21.15.177:0/2732676623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2444004d10 0x7f2444005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 -- 172.21.15.177:0/2732676623 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24581404e0 con 0x7f2444004d10 2023-11-28T20:09:56.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 -- 172.21.15.177:0/2732676623 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244400b990 con 0x7f24440039b0 2023-11-28T20:09:56.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2455d9b640 1 -- 172.21.15.177:0/2732676623 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244400bb50 con 0x7f245815ab70 2023-11-28T20:09:56.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f2456d9d640 1 --2- 172.21.15.177:0/2732676623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2444004d10 0x7f2444005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f245659c640 1 --2- 172.21.15.177:0/2732676623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24440039b0 0x7f2444003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.160+0000 7f244dd9b640 1 --2- 172.21.15.177:0/2732676623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f245815ab70 0x7f24440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f2456d9d640 1 -- 172.21.15.177:0/2732676623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f245815ab70 msgr2=0x7f24440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:56.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f2456d9d640 1 --2- 172.21.15.177:0/2732676623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f245815ab70 0x7f24440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f2456d9d640 1 -- 172.21.15.177:0/2732676623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24440039b0 msgr2=0x7f2444003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:56.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f2456d9d640 1 --2- 172.21.15.177:0/2732676623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24440039b0 0x7f2444003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f2456d9d640 1 -- 172.21.15.177:0/2732676623 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2444003530 con 0x7f2444004d10 2023-11-28T20:09:56.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f2456d9d640 1 --2- 172.21.15.177:0/2732676623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2444004d10 0x7f2444005190 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2450009670 tx=0x7f245001ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ce7b7df8e484bc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:56.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f2455d9b640 1 -- 172.21.15.177:0/2732676623 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24500a7770 con 0x7f2444004d10 2023-11-28T20:09:56.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f2455d9b640 1 -- 172.21.15.177:0/2732676623 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24500a78d0 con 0x7f2444004d10 2023-11-28T20:09:56.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f2455d9b640 1 -- 172.21.15.177:0/2732676623 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24500a7c80 con 0x7f2444004d10 2023-11-28T20:09:56.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f245cf01640 1 -- 172.21.15.177:0/2732676623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2444004d10 msgr2=0x7f2444005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f245cf01640 1 --2- 172.21.15.177:0/2732676623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2444004d10 0x7f2444005190 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2450009670 tx=0x7f245001ec80 comp rx=0 tx=0).stop 2023-11-28T20:09:56.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f2456d9d640 1 -- 172.21.15.177:0/2732676623 reap_dead start 2023-11-28T20:09:56.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f245cf01640 1 -- 172.21.15.177:0/2732676623 shutdown_connections 2023-11-28T20:09:56.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f245cf01640 1 -- 172.21.15.177:0/2732676623 >> 172.21.15.177:0/2732676623 conn(0x7f245806a530 msgr2=0x7f245806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:56.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f245cf01640 1 -- 172.21.15.177:0/2732676623 shutdown_connections 2023-11-28T20:09:56.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.164+0000 7f245cf01640 1 -- 172.21.15.177:0/2732676623 wait complete. 2023-11-28T20:09:56.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f245cf01640 1 Processor -- start 2023-11-28T20:09:56.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f245cf01640 1 -- start start 2023-11-28T20:09:56.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f245cf01640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2444004d10 0x7f24581f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f245cf01640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24581548c0 0x7f2458158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f245cf01640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f245813d310 0x7f245813d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f245cf01640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245813dce0 con 0x7f24581548c0 2023-11-28T20:09:56.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f245cf01640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2458158950 con 0x7f245813d310 2023-11-28T20:09:56.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f245cf01640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2458158c30 con 0x7f2444004d10 2023-11-28T20:09:56.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f244dd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24581548c0 0x7f2458158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f244dd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24581548c0 0x7f2458158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51652/0 (socket says 172.21.15.177:51652) 2023-11-28T20:09:56.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f244dd9b640 1 -- 172.21.15.177:0/2334454725 learned_addr learned my addr 172.21.15.177:0/2334454725 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:56.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f245659c640 1 --2- 172.21.15.177:0/2334454725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2444004d10 0x7f24581f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f2456d9d640 1 --2- 172.21.15.177:0/2334454725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f245813d310 0x7f245813d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f244dd9b640 1 -- 172.21.15.177:0/2334454725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2444004d10 msgr2=0x7f24581f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f244dd9b640 1 --2- 172.21.15.177:0/2334454725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2444004d10 0x7f24581f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f244dd9b640 1 -- 172.21.15.177:0/2334454725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f245813d310 msgr2=0x7f245813d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f244dd9b640 1 --2- 172.21.15.177:0/2334454725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f245813d310 0x7f245813d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.168+0000 7f244dd9b640 1 -- 172.21.15.177:0/2334454725 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2458158f10 con 0x7f24581548c0 2023-11-28T20:09:56.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.172+0000 7f244dd9b640 1 --2- 172.21.15.177:0/2334454725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24581548c0 0x7f2458158000 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2440011980 tx=0x7f2440011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:56.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.172+0000 7f244f7fe640 1 -- 172.21.15.177:0/2334454725 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244000faf0 con 0x7f24581548c0 2023-11-28T20:09:56.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.172+0000 7f244f7fe640 1 -- 172.21.15.177:0/2334454725 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244000fc50 con 0x7f24581548c0 2023-11-28T20:09:56.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.172+0000 7f244f7fe640 1 -- 172.21.15.177:0/2334454725 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440014440 con 0x7f24581548c0 2023-11-28T20:09:56.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.172+0000 7f245cf01640 1 -- 172.21.15.177:0/2334454725 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24581591f0 con 0x7f24581548c0 2023-11-28T20:09:56.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.172+0000 7f245cf01640 1 -- 172.21.15.177:0/2334454725 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24581f5eb0 con 0x7f24581548c0 2023-11-28T20:09:56.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.172+0000 7f245cf01640 1 -- 172.21.15.177:0/2334454725 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2458069440 con 0x7f24581548c0 2023-11-28T20:09:56.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.172+0000 7f244f7fe640 1 -- 172.21.15.177:0/2334454725 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f24400145a0 con 0x7f24581548c0 2023-11-28T20:09:56.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.172+0000 7f244f7fe640 1 --2- 172.21.15.177:0/2334454725 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2438066470 0x7f2438068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.172+0000 7f244f7fe640 1 -- 172.21.15.177:0/2334454725 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2440084620 con 0x7f24581548c0 2023-11-28T20:09:56.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.172+0000 7f245659c640 1 --2- 172.21.15.177:0/2334454725 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2438066470 0x7f2438068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.172+0000 7f245659c640 1 --2- 172.21.15.177:0/2334454725 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2438066470 0x7f2438068930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f24480013e0 tx=0x7f2448001f10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:56.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.176+0000 7f244f7fe640 1 -- 172.21.15.177:0/2334454725 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2440051b40 con 0x7f24581548c0 2023-11-28T20:09:56.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.328+0000 7f245cf01640 1 -- 172.21.15.177:0/2334454725 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2458139170 con 0x7f24581548c0 2023-11-28T20:09:56.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.328+0000 7f244f7fe640 1 -- 172.21.15.177:0/2334454725 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f2440055160 con 0x7f24581548c0 2023-11-28T20:09:56.334 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:56.334 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":49,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:09:44.664848+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:09:40.777720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T20:09:42.029277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:09:56.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.332+0000 7f245cf01640 1 -- 172.21.15.177:0/2334454725 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2438066470 msgr2=0x7f2438068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.332+0000 7f245cf01640 1 --2- 172.21.15.177:0/2334454725 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2438066470 0x7f2438068930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f24480013e0 tx=0x7f2448001f10 comp rx=0 tx=0).stop 2023-11-28T20:09:56.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.332+0000 7f245cf01640 1 -- 172.21.15.177:0/2334454725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24581548c0 msgr2=0x7f2458158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.332+0000 7f245cf01640 1 --2- 172.21.15.177:0/2334454725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24581548c0 0x7f2458158000 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2440011980 tx=0x7f2440011e40 comp rx=0 tx=0).stop 2023-11-28T20:09:56.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.332+0000 7f245cf01640 1 -- 172.21.15.177:0/2334454725 shutdown_connections 2023-11-28T20:09:56.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.332+0000 7f245cf01640 1 --2- 172.21.15.177:0/2334454725 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2438066470 0x7f2438068930 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.332+0000 7f245cf01640 1 --2- 172.21.15.177:0/2334454725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f245813d310 0x7f245813d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.332+0000 7f245cf01640 1 --2- 172.21.15.177:0/2334454725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24581548c0 0x7f2458158000 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.332+0000 7f245cf01640 1 --2- 172.21.15.177:0/2334454725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2444004d10 0x7f24581f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.332+0000 7f245cf01640 1 -- 172.21.15.177:0/2334454725 >> 172.21.15.177:0/2334454725 conn(0x7f245806a530 msgr2=0x7f2458071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:56.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.332+0000 7f245cf01640 1 -- 172.21.15.177:0/2334454725 shutdown_connections 2023-11-28T20:09:56.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.332+0000 7f245cf01640 1 -- 172.21.15.177:0/2334454725 wait complete. 2023-11-28T20:09:56.355 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:09:40.777720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:09:42.029277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:09:56.355 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:09:56.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.492+0000 7f9ac9c17640 1 Processor -- start 2023-11-28T20:09:56.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.492+0000 7f9ac9c17640 1 -- start start 2023-11-28T20:09:56.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.492+0000 7f9ac9c17640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9ac40b42d0 0x7f9ac40b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.492+0000 7f9ac9c17640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac40b4c60 con 0x7f9ac40cba10 2023-11-28T20:09:56.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.492+0000 7f9ac9c17640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac415b670 con 0x7f9ac4158ca0 2023-11-28T20:09:56.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.492+0000 7f9ac9c17640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac415c510 con 0x7f9ac40b42d0 2023-11-28T20:09:56.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.492+0000 7f9ac3fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9ac40b42d0 0x7f9ac40b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.492+0000 7f9abbfff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f9ac40cba10 0x7f9ac415be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:42750/0 (socket says 172.21.15.177:42750) 2023-11-28T20:09:56.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.492+0000 7f9abbfff640 1 -- 172.21.15.177:0/4020239257 learned_addr learned my addr 172.21.15.177:0/4020239257 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:56.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.492+0000 7f9ac3fff640 1 -- 172.21.15.177:0/4020239257 >> v1:172.21.15.195:6789/0 conn(0x7f9ac4158ca0 legacy=0x7f9ac415eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:56.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.492+0000 7f9ac3fff640 1 -- 172.21.15.177:0/4020239257 >> v1:172.21.15.177:6789/0 conn(0x7f9ac40cba10 legacy=0x7f9ac415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.492+0000 7f9ac3fff640 1 -- 172.21.15.177:0/4020239257 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac415f410 con 0x7f9ac40b42d0 2023-11-28T20:09:56.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.492+0000 7f9ac2ffd640 1 -- 172.21.15.177:0/4020239257 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330190244 0 0) 0x7f9aac001120 con 0x7f9ac40cba10 2023-11-28T20:09:56.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.496+0000 7f9ac3fff640 1 --2- 172.21.15.177:0/4020239257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ac40b42d0 0x7f9ac40b4720 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009d90 tx=0x7f9abc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b12a88d3fa6335c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:56.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.496+0000 7f9ac2ffd640 1 -- 172.21.15.177:0/4020239257 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0a58c0 con 0x7f9ac40b42d0 2023-11-28T20:09:56.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.496+0000 7f9ac2ffd640 1 -- 172.21.15.177:0/4020239257 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc0a5a20 con 0x7f9ac40b42d0 2023-11-28T20:09:56.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.496+0000 7f9ac2ffd640 1 -- 172.21.15.177:0/4020239257 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0a5db0 con 0x7f9ac40b42d0 2023-11-28T20:09:56.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.496+0000 7f9ac9c17640 1 -- 172.21.15.177:0/4020239257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ac40b42d0 msgr2=0x7f9ac40b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.496+0000 7f9ac9c17640 1 --2- 172.21.15.177:0/4020239257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ac40b42d0 0x7f9ac40b4720 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009d90 tx=0x7f9abc01c910 comp rx=0 tx=0).stop 2023-11-28T20:09:56.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.496+0000 7f9ac9c17640 1 -- 172.21.15.177:0/4020239257 shutdown_connections 2023-11-28T20:09:56.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.496+0000 7f9ac9c17640 1 --2- 172.21.15.177:0/4020239257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ac40b42d0 0x7f9ac40b4720 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.496+0000 7f9ac9c17640 1 -- 172.21.15.177:0/4020239257 >> 172.21.15.177:0/4020239257 conn(0x7f9ac40b0cc0 msgr2=0x7f9ac40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:56.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.496+0000 7f9ac9c17640 1 -- 172.21.15.177:0/4020239257 shutdown_connections 2023-11-28T20:09:56.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.496+0000 7f9ac9c17640 1 -- 172.21.15.177:0/4020239257 wait complete. 2023-11-28T20:09:56.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac9c17640 1 Processor -- start 2023-11-28T20:09:56.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac9c17640 1 -- start start 2023-11-28T20:09:56.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac9c17640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ac40b42d0 0x7f9ac40c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac9c17640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ac40cba10 0x7f9ac4153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac9c17640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ac4158ca0 0x7f9ac4165070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac9c17640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40c4940 con 0x7f9ac4158ca0 2023-11-28T20:09:56.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac9c17640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40c4c20 con 0x7f9ac40b42d0 2023-11-28T20:09:56.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac9c17640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40c4f00 con 0x7f9ac40cba10 2023-11-28T20:09:56.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ac4158ca0 0x7f9ac4165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ac4158ca0 0x7f9ac4165070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51666/0 (socket says 172.21.15.177:51666) 2023-11-28T20:09:56.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac3fff640 1 -- 172.21.15.177:0/351255301 learned_addr learned my addr 172.21.15.177:0/351255301 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:56.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9abbfff640 1 --2- 172.21.15.177:0/351255301 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ac40cba10 0x7f9ac4153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac37fe640 1 --2- 172.21.15.177:0/351255301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ac40b42d0 0x7f9ac40c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac3fff640 1 -- 172.21.15.177:0/351255301 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ac40cba10 msgr2=0x7f9ac4153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac3fff640 1 --2- 172.21.15.177:0/351255301 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ac40cba10 0x7f9ac4153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac3fff640 1 -- 172.21.15.177:0/351255301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ac40b42d0 msgr2=0x7f9ac40c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac3fff640 1 --2- 172.21.15.177:0/351255301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ac40b42d0 0x7f9ac40c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac3fff640 1 -- 172.21.15.177:0/351255301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc009a70 con 0x7f9ac4158ca0 2023-11-28T20:09:56.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac3fff640 1 --2- 172.21.15.177:0/351255301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ac4158ca0 0x7f9ac4165070 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0b0040 tx=0x7f9abc0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:56.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac0ff9640 1 -- 172.21.15.177:0/351255301 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0ad850 con 0x7f9ac4158ca0 2023-11-28T20:09:56.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac0ff9640 1 -- 172.21.15.177:0/351255301 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc0ad9b0 con 0x7f9ac4158ca0 2023-11-28T20:09:56.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac0ff9640 1 -- 172.21.15.177:0/351255301 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0adda0 con 0x7f9ac4158ca0 2023-11-28T20:09:56.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac9c17640 1 -- 172.21.15.177:0/351255301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac40c51e0 con 0x7f9ac4158ca0 2023-11-28T20:09:56.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.500+0000 7f9ac9c17640 1 -- 172.21.15.177:0/351255301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac41544c0 con 0x7f9ac4158ca0 2023-11-28T20:09:56.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.504+0000 7f9ac9c17640 1 -- 172.21.15.177:0/351255301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac40693d0 con 0x7f9ac4158ca0 2023-11-28T20:09:56.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.504+0000 7f9ac0ff9640 1 -- 172.21.15.177:0/351255301 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9abc0b4050 con 0x7f9ac4158ca0 2023-11-28T20:09:56.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.504+0000 7f9ac0ff9640 1 --2- 172.21.15.177:0/351255301 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9aa4066470 0x7f9aa4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.504+0000 7f9ac0ff9640 1 -- 172.21.15.177:0/351255301 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9abc11ecc0 con 0x7f9ac4158ca0 2023-11-28T20:09:56.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.504+0000 7f9ac37fe640 1 --2- 172.21.15.177:0/351255301 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9aa4066470 0x7f9aa4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.504+0000 7f9ac37fe640 1 --2- 172.21.15.177:0/351255301 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9aa4066470 0x7f9aa4068930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40b0b00 tx=0x7f9ab4009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:56.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.508+0000 7f9ac0ff9640 1 -- 172.21.15.177:0/351255301 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9abc125080 con 0x7f9ac4158ca0 2023-11-28T20:09:56.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.660+0000 7f9ac9c17640 1 -- 172.21.15.177:0/351255301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9ac40693d0 con 0x7f9ac4158ca0 2023-11-28T20:09:56.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.660+0000 7f9ac0ff9640 1 -- 172.21.15.177:0/351255301 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9abc0b20a0 con 0x7f9ac4158ca0 2023-11-28T20:09:56.665 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:09:56.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.664+0000 7f9ac9c17640 1 -- 172.21.15.177:0/351255301 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9aa4066470 msgr2=0x7f9aa4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.664+0000 7f9ac9c17640 1 --2- 172.21.15.177:0/351255301 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9aa4066470 0x7f9aa4068930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40b0b00 tx=0x7f9ab4009060 comp rx=0 tx=0).stop 2023-11-28T20:09:56.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.664+0000 7f9ac9c17640 1 -- 172.21.15.177:0/351255301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ac4158ca0 msgr2=0x7f9ac4165070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.664+0000 7f9ac9c17640 1 --2- 172.21.15.177:0/351255301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ac4158ca0 0x7f9ac4165070 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0b0040 tx=0x7f9abc0196b0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.664+0000 7f9ac9c17640 1 -- 172.21.15.177:0/351255301 shutdown_connections 2023-11-28T20:09:56.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.664+0000 7f9ac9c17640 1 --2- 172.21.15.177:0/351255301 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9aa4066470 0x7f9aa4068930 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.664+0000 7f9ac9c17640 1 --2- 172.21.15.177:0/351255301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ac4158ca0 0x7f9ac4165070 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.664+0000 7f9ac9c17640 1 --2- 172.21.15.177:0/351255301 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ac40cba10 0x7f9ac4153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.664+0000 7f9ac9c17640 1 --2- 172.21.15.177:0/351255301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ac40b42d0 0x7f9ac40c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.664+0000 7f9ac9c17640 1 -- 172.21.15.177:0/351255301 >> 172.21.15.177:0/351255301 conn(0x7f9ac40b0cc0 msgr2=0x7f9ac415ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:56.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.664+0000 7f9ac9c17640 1 -- 172.21.15.177:0/351255301 shutdown_connections 2023-11-28T20:09:56.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.664+0000 7f9ac9c17640 1 -- 172.21.15.177:0/351255301 wait complete. 2023-11-28T20:09:56.686 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:09:56.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce9748640 1 Processor -- start 2023-11-28T20:09:56.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce9748640 1 -- start start 2023-11-28T20:09:56.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce9748640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ce40abee0 0x7f4ce406c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce9748640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce406d200 con 0x7f4ce4159650 2023-11-28T20:09:56.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce9748640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce4159a30 con 0x7f4ce406cdb0 2023-11-28T20:09:56.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce9748640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce4070260 con 0x7f4ce40abee0 2023-11-28T20:09:56.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce3fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f4ce4159650 0x7f4ce406d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:42756/0 (socket says 172.21.15.177:42756) 2023-11-28T20:09:56.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce3fff640 1 -- 172.21.15.177:0/1895000118 learned_addr learned my addr 172.21.15.177:0/1895000118 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:56.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce2ffd640 1 -- 172.21.15.177:0/1895000118 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616464595 0 0) 0x7f4cd4001120 con 0x7f4ce4159650 2023-11-28T20:09:56.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce2ffd640 1 -- 172.21.15.177:0/1895000118 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ccc003530 con 0x7f4ce4159650 2023-11-28T20:09:56.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce37fe640 1 --2- 172.21.15.177:0/1895000118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ce40abee0 0x7f4ce406c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce2ffd640 1 -- 172.21.15.177:0/1895000118 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 473329265 0 0) 0x7f4ccc003530 con 0x7f4ce4159650 2023-11-28T20:09:56.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce2ffd640 1 -- 172.21.15.177:0/1895000118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ce40abee0 msgr2=0x7f4ce406c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:56.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce2ffd640 1 --2- 172.21.15.177:0/1895000118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ce40abee0 0x7f4ce406c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce2ffd640 1 -- 172.21.15.177:0/1895000118 >> v1:172.21.15.195:6789/0 conn(0x7f4ce406cdb0 legacy=0x7f4ce40715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce2ffd640 1 -- 172.21.15.177:0/1895000118 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce4070500 con 0x7f4ce4159650 2023-11-28T20:09:56.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce2ffd640 1 -- 172.21.15.177:0/1895000118 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f4cd4001810 con 0x7f4ce4159650 2023-11-28T20:09:56.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce2ffd640 1 -- 172.21.15.177:0/1895000118 >> v1:172.21.15.177:6789/0 conn(0x7f4ce4159650 legacy=0x7f4ce406d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce2ffd640 1 --2- 172.21.15.177:0/1895000118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ccc0039b0 0x7f4ccc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce2ffd640 1 --2- 172.21.15.177:0/1895000118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ccc0047d0 0x7f4ccc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce2ffd640 1 --2- 172.21.15.177:0/1895000118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ce40abee0 0x7f4ccc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce2ffd640 1 -- 172.21.15.177:0/1895000118 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce4070260 con 0x7f4ccc0047d0 2023-11-28T20:09:56.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce2ffd640 1 -- 172.21.15.177:0/1895000118 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc00ba70 con 0x7f4ccc0039b0 2023-11-28T20:09:56.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce2ffd640 1 -- 172.21.15.177:0/1895000118 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc00bc30 con 0x7f4ce40abee0 2023-11-28T20:09:56.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce37fe640 1 --2- 172.21.15.177:0/1895000118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ccc0047d0 0x7f4ccc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.824+0000 7f4ce3fff640 1 --2- 172.21.15.177:0/1895000118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ccc0039b0 0x7f4ccc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce8f47640 1 --2- 172.21.15.177:0/1895000118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ce40abee0 0x7f4ccc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce37fe640 1 -- 172.21.15.177:0/1895000118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ce40abee0 msgr2=0x7f4ccc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:56.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce37fe640 1 --2- 172.21.15.177:0/1895000118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ce40abee0 0x7f4ccc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce37fe640 1 -- 172.21.15.177:0/1895000118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ccc0039b0 msgr2=0x7f4ccc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:56.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce37fe640 1 --2- 172.21.15.177:0/1895000118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ccc0039b0 0x7f4ccc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce37fe640 1 -- 172.21.15.177:0/1895000118 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc003530 con 0x7f4ccc0047d0 2023-11-28T20:09:56.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce37fe640 1 --2- 172.21.15.177:0/1895000118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ccc0047d0 0x7f4ccc004c50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40ac2e0 tx=0x7f4cd801ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fcf02a94059234 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:56.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce2ffd640 1 -- 172.21.15.177:0/1895000118 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd80a76a0 con 0x7f4ccc0047d0 2023-11-28T20:09:56.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce2ffd640 1 -- 172.21.15.177:0/1895000118 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd80a7800 con 0x7f4ccc0047d0 2023-11-28T20:09:56.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce2ffd640 1 -- 172.21.15.177:0/1895000118 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd80a7bb0 con 0x7f4ccc0047d0 2023-11-28T20:09:56.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce9748640 1 -- 172.21.15.177:0/1895000118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ccc0047d0 msgr2=0x7f4ccc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce9748640 1 --2- 172.21.15.177:0/1895000118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ccc0047d0 0x7f4ccc004c50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40ac2e0 tx=0x7f4cd801ebb0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce8f47640 1 -- 172.21.15.177:0/1895000118 reap_dead start 2023-11-28T20:09:56.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce9748640 1 -- 172.21.15.177:0/1895000118 shutdown_connections 2023-11-28T20:09:56.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce9748640 1 -- 172.21.15.177:0/1895000118 >> 172.21.15.177:0/1895000118 conn(0x7f4ce40b0920 msgr2=0x7f4ce40b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:56.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce9748640 1 -- 172.21.15.177:0/1895000118 shutdown_connections 2023-11-28T20:09:56.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.828+0000 7f4ce9748640 1 -- 172.21.15.177:0/1895000118 wait complete. 2023-11-28T20:09:56.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce9748640 1 Processor -- start 2023-11-28T20:09:56.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce9748640 1 -- start start 2023-11-28T20:09:56.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce9748640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ccc0047d0 0x7f4ce414d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce9748640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ce41f3c00 0x7f4ce40cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce9748640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ce4157b70 0x7f4ce4157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce9748640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce4157750 con 0x7f4ccc0047d0 2023-11-28T20:09:56.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce9748640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce41f41a0 con 0x7f4ce41f3c00 2023-11-28T20:09:56.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce9748640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce414dc80 con 0x7f4ce4157b70 2023-11-28T20:09:56.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ccc0047d0 0x7f4ce414d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ccc0047d0 0x7f4ce414d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51690/0 (socket says 172.21.15.177:51690) 2023-11-28T20:09:56.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce3fff640 1 -- 172.21.15.177:0/2453589133 learned_addr learned my addr 172.21.15.177:0/2453589133 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:56.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce8f47640 1 --2- 172.21.15.177:0/2453589133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ce4157b70 0x7f4ce4157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce37fe640 1 --2- 172.21.15.177:0/2453589133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ce41f3c00 0x7f4ce40cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce3fff640 1 -- 172.21.15.177:0/2453589133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ce4157b70 msgr2=0x7f4ce4157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce3fff640 1 --2- 172.21.15.177:0/2453589133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ce4157b70 0x7f4ce4157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce3fff640 1 -- 172.21.15.177:0/2453589133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ce41f3c00 msgr2=0x7f4ce40cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce3fff640 1 --2- 172.21.15.177:0/2453589133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ce41f3c00 0x7f4ce40cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce3fff640 1 -- 172.21.15.177:0/2453589133 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce4156df0 con 0x7f4ccc0047d0 2023-11-28T20:09:56.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce3fff640 1 --2- 172.21.15.177:0/2453589133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ccc0047d0 0x7f4ce414d740 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4012490 tx=0x7f4cd4012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:56.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.832+0000 7f4ce0ff9640 1 -- 172.21.15.177:0/2453589133 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4014750 con 0x7f4ccc0047d0 2023-11-28T20:09:56.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.836+0000 7f4ce0ff9640 1 -- 172.21.15.177:0/2453589133 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd40148b0 con 0x7f4ccc0047d0 2023-11-28T20:09:56.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.836+0000 7f4ce9748640 1 -- 172.21.15.177:0/2453589133 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce4157090 con 0x7f4ccc0047d0 2023-11-28T20:09:56.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.836+0000 7f4ce0ff9640 1 -- 172.21.15.177:0/2453589133 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4014c40 con 0x7f4ccc0047d0 2023-11-28T20:09:56.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.836+0000 7f4ce9748640 1 -- 172.21.15.177:0/2453589133 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce4158530 con 0x7f4ccc0047d0 2023-11-28T20:09:56.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.836+0000 7f4ce9748640 1 -- 172.21.15.177:0/2453589133 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce4157890 con 0x7f4ccc0047d0 2023-11-28T20:09:56.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.836+0000 7f4ce0ff9640 1 -- 172.21.15.177:0/2453589133 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4cd40153e0 con 0x7f4ccc0047d0 2023-11-28T20:09:56.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.836+0000 7f4ce0ff9640 1 --2- 172.21.15.177:0/2453589133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4cd00664a0 0x7f4cd0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:56.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.836+0000 7f4ce0ff9640 1 -- 172.21.15.177:0/2453589133 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cd4086510 con 0x7f4ccc0047d0 2023-11-28T20:09:56.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.836+0000 7f4ce37fe640 1 --2- 172.21.15.177:0/2453589133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4cd00664a0 0x7f4cd0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:56.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.836+0000 7f4ce37fe640 1 --2- 172.21.15.177:0/2453589133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4cd00664a0 0x7f4cd0068960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80b1000 tx=0x7f4cd8010040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:56.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.840+0000 7f4ce0ff9640 1 -- 172.21.15.177:0/2453589133 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4ce4157890 con 0x7f4ccc0047d0 2023-11-28T20:09:56.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.992+0000 7f4ce9748640 1 -- 172.21.15.177:0/2453589133 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ce406d200 con 0x7f4ccc0047d0 2023-11-28T20:09:56.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.992+0000 7f4ce0ff9640 1 -- 172.21.15.177:0/2453589133 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ce406d200 con 0x7f4ccc0047d0 2023-11-28T20:09:56.996 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:09:56.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.992+0000 7f4ce9748640 1 -- 172.21.15.177:0/2453589133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4cd00664a0 msgr2=0x7f4cd0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.992+0000 7f4ce9748640 1 --2- 172.21.15.177:0/2453589133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4cd00664a0 0x7f4cd0068960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80b1000 tx=0x7f4cd8010040 comp rx=0 tx=0).stop 2023-11-28T20:09:56.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.992+0000 7f4ce9748640 1 -- 172.21.15.177:0/2453589133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ccc0047d0 msgr2=0x7f4ce414d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:56.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.992+0000 7f4ce9748640 1 --2- 172.21.15.177:0/2453589133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ccc0047d0 0x7f4ce414d740 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4012490 tx=0x7f4cd4012950 comp rx=0 tx=0).stop 2023-11-28T20:09:56.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.992+0000 7f4ce9748640 1 -- 172.21.15.177:0/2453589133 shutdown_connections 2023-11-28T20:09:56.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.992+0000 7f4ce9748640 1 --2- 172.21.15.177:0/2453589133 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4cd00664a0 0x7f4cd0068960 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.992+0000 7f4ce9748640 1 --2- 172.21.15.177:0/2453589133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ce4157b70 0x7f4ce4157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.992+0000 7f4ce9748640 1 --2- 172.21.15.177:0/2453589133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ce41f3c00 0x7f4ce40cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.992+0000 7f4ce9748640 1 --2- 172.21.15.177:0/2453589133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ccc0047d0 0x7f4ce414d740 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:56.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.992+0000 7f4ce9748640 1 -- 172.21.15.177:0/2453589133 >> 172.21.15.177:0/2453589133 conn(0x7f4ce40b0920 msgr2=0x7f4ce414f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:56.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.992+0000 7f4ce9748640 1 -- 172.21.15.177:0/2453589133 shutdown_connections 2023-11-28T20:09:56.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:56.992+0000 7f4ce9748640 1 -- 172.21.15.177:0/2453589133 wait complete. 2023-11-28T20:09:57.017 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:09:57.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.156+0000 7fec8390f640 1 Processor -- start 2023-11-28T20:09:57.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.156+0000 7fec8390f640 1 -- start start 2023-11-28T20:09:57.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.156+0000 7fec8390f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fec7c071d90 0x7fec7c072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.156+0000 7fec8390f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec7c13f5f0 0x7fec7c0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.156+0000 7fec8390f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7c13d2b0 con 0x7fec7c15adb0 2023-11-28T20:09:57.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.156+0000 7fec8390f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7c140520 con 0x7fec7c071d90 2023-11-28T20:09:57.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.156+0000 7fec8390f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c0cd7f0 con 0x7fec7c13f5f0 2023-11-28T20:09:57.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.156+0000 7fec81eac640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec7c13f5f0 0x7fec7c0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.156+0000 7fec816ab640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fec7c071d90 0x7fec7c072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.156+0000 7fec81eac640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec7c13f5f0 0x7fec7c0ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:51970/0 (socket says 172.21.15.177:51970) 2023-11-28T20:09:57.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.156+0000 7fec81eac640 1 -- 172.21.15.177:0/3602386442 learned_addr learned my addr 172.21.15.177:0/3602386442 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:57.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.156+0000 7fec80eaa640 1 --1- 172.21.15.177:0/3602386442 >> v1:172.21.15.195:6789/0 conn(0x7fec7c15adb0 0x7fec7c13d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:58390/0 (socket says 172.21.15.177:58390) 2023-11-28T20:09:57.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.160+0000 7fec73fff640 1 -- 172.21.15.177:0/3602386442 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898891975 0 0) 0x7fec7c13d2b0 con 0x7fec7c15adb0 2023-11-28T20:09:57.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.160+0000 7fec816ab640 1 -- 172.21.15.177:0/3602386442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec7c13f5f0 msgr2=0x7fec7c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:57.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.160+0000 7fec816ab640 1 --2- 172.21.15.177:0/3602386442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec7c13f5f0 0x7fec7c0ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.160+0000 7fec816ab640 1 -- 172.21.15.177:0/3602386442 >> v1:172.21.15.195:6789/0 conn(0x7fec7c15adb0 legacy=0x7fec7c13d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.160+0000 7fec816ab640 1 -- 172.21.15.177:0/3602386442 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c0cdd70 con 0x7fec7c071d90 2023-11-28T20:09:57.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.160+0000 7fec816ab640 1 --2- 172.21.15.177:0/3602386442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec7c071d90 0x7fec7c072170 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fec7800ba60 tx=0x7fec7801eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce18d0f0c61adae9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:57.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.160+0000 7fec73fff640 1 -- 172.21.15.177:0/3602386442 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec780a7b20 con 0x7fec7c071d90 2023-11-28T20:09:57.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.160+0000 7fec73fff640 1 -- 172.21.15.177:0/3602386442 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec780a7c80 con 0x7fec7c071d90 2023-11-28T20:09:57.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.160+0000 7fec73fff640 1 -- 172.21.15.177:0/3602386442 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec780af440 con 0x7fec7c071d90 2023-11-28T20:09:57.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 -- 172.21.15.177:0/3602386442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec7c071d90 msgr2=0x7fec7c072170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 --2- 172.21.15.177:0/3602386442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec7c071d90 0x7fec7c072170 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fec7800ba60 tx=0x7fec7801eb50 comp rx=0 tx=0).stop 2023-11-28T20:09:57.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 -- 172.21.15.177:0/3602386442 shutdown_connections 2023-11-28T20:09:57.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 --2- 172.21.15.177:0/3602386442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec7c13f5f0 0x7fec7c0ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 --2- 172.21.15.177:0/3602386442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec7c071d90 0x7fec7c072170 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 -- 172.21.15.177:0/3602386442 >> 172.21.15.177:0/3602386442 conn(0x7fec7c0b0cc0 msgr2=0x7fec7c0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:57.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 -- 172.21.15.177:0/3602386442 shutdown_connections 2023-11-28T20:09:57.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 -- 172.21.15.177:0/3602386442 wait complete. 2023-11-28T20:09:57.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 Processor -- start 2023-11-28T20:09:57.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 -- start start 2023-11-28T20:09:57.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec7c071d90 0x7fec7c12e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec7c13f5f0 0x7fec7c1fa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec7c15adb0 0x7fec7c0b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c0b4d30 con 0x7fec7c071d90 2023-11-28T20:09:57.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c12ed70 con 0x7fec7c13f5f0 2023-11-28T20:09:57.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec8390f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c12f670 con 0x7fec7c15adb0 2023-11-28T20:09:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec816ab640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec7c071d90 0x7fec7c12e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec816ab640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec7c071d90 0x7fec7c12e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51696/0 (socket says 172.21.15.177:51696) 2023-11-28T20:09:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec816ab640 1 -- 172.21.15.177:0/1813226845 learned_addr learned my addr 172.21.15.177:0/1813226845 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec80eaa640 1 --2- 172.21.15.177:0/1813226845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec7c13f5f0 0x7fec7c1fa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec81eac640 1 --2- 172.21.15.177:0/1813226845 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec7c15adb0 0x7fec7c0b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec816ab640 1 -- 172.21.15.177:0/1813226845 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec7c15adb0 msgr2=0x7fec7c0b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec816ab640 1 --2- 172.21.15.177:0/1813226845 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec7c15adb0 0x7fec7c0b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec816ab640 1 -- 172.21.15.177:0/1813226845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec7c13f5f0 msgr2=0x7fec7c1fa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec816ab640 1 --2- 172.21.15.177:0/1813226845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec7c13f5f0 0x7fec7c1fa080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.164+0000 7fec816ab640 1 -- 172.21.15.177:0/1813226845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7800b6c0 con 0x7fec7c071d90 2023-11-28T20:09:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.168+0000 7fec816ab640 1 --2- 172.21.15.177:0/1813226845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec7c071d90 0x7fec7c12e830 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fec780b2040 tx=0x7fec7801b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.168+0000 7fec71ffb640 1 -- 172.21.15.177:0/1813226845 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec780afd90 con 0x7fec7c071d90 2023-11-28T20:09:57.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.168+0000 7fec71ffb640 1 -- 172.21.15.177:0/1813226845 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec780ba470 con 0x7fec7c071d90 2023-11-28T20:09:57.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.168+0000 7fec71ffb640 1 -- 172.21.15.177:0/1813226845 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec780ba820 con 0x7fec7c071d90 2023-11-28T20:09:57.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.168+0000 7fec8390f640 1 -- 172.21.15.177:0/1813226845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7c12f950 con 0x7fec7c071d90 2023-11-28T20:09:57.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.168+0000 7fec8390f640 1 -- 172.21.15.177:0/1813226845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7c12ff10 con 0x7fec7c071d90 2023-11-28T20:09:57.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.168+0000 7fec8390f640 1 -- 172.21.15.177:0/1813226845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7c0693d0 con 0x7fec7c071d90 2023-11-28T20:09:57.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.168+0000 7fec71ffb640 1 -- 172.21.15.177:0/1813226845 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fec780b6070 con 0x7fec7c071d90 2023-11-28T20:09:57.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.168+0000 7fec71ffb640 1 --2- 172.21.15.177:0/1813226845 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fec60066470 0x7fec60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.168+0000 7fec71ffb640 1 -- 172.21.15.177:0/1813226845 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec7811f140 con 0x7fec7c071d90 2023-11-28T20:09:57.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.168+0000 7fec80eaa640 1 --2- 172.21.15.177:0/1813226845 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fec60066470 0x7fec60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.172+0000 7fec80eaa640 1 --2- 172.21.15.177:0/1813226845 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fec60066470 0x7fec60068930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fec7c1fdd70 tx=0x7fec6c007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:57.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.172+0000 7fec71ffb640 1 -- 172.21.15.177:0/1813226845 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fec780ec5d0 con 0x7fec7c071d90 2023-11-28T20:09:57.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.324+0000 7fec8390f640 1 -- 172.21.15.177:0/1813226845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fec7c06e710 con 0x7fec7c071d90 2023-11-28T20:09:57.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.324+0000 7fec71ffb640 1 -- 172.21.15.177:0/1813226845 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7fec780b40a0 con 0x7fec7c071d90 2023-11-28T20:09:57.329 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:09:57.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.328+0000 7fec8390f640 1 -- 172.21.15.177:0/1813226845 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fec60066470 msgr2=0x7fec60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.328+0000 7fec8390f640 1 --2- 172.21.15.177:0/1813226845 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fec60066470 0x7fec60068930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fec7c1fdd70 tx=0x7fec6c007df0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.328+0000 7fec8390f640 1 -- 172.21.15.177:0/1813226845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec7c071d90 msgr2=0x7fec7c12e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.328+0000 7fec8390f640 1 --2- 172.21.15.177:0/1813226845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec7c071d90 0x7fec7c12e830 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fec780b2040 tx=0x7fec7801b8f0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.328+0000 7fec8390f640 1 -- 172.21.15.177:0/1813226845 shutdown_connections 2023-11-28T20:09:57.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.328+0000 7fec8390f640 1 --2- 172.21.15.177:0/1813226845 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fec60066470 0x7fec60068930 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.328+0000 7fec8390f640 1 --2- 172.21.15.177:0/1813226845 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec7c15adb0 0x7fec7c0b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.328+0000 7fec8390f640 1 --2- 172.21.15.177:0/1813226845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec7c13f5f0 0x7fec7c1fa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.328+0000 7fec8390f640 1 --2- 172.21.15.177:0/1813226845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec7c071d90 0x7fec7c12e830 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.328+0000 7fec8390f640 1 -- 172.21.15.177:0/1813226845 >> 172.21.15.177:0/1813226845 conn(0x7fec7c0b0cc0 msgr2=0x7fec7c0af600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:57.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.328+0000 7fec8390f640 1 -- 172.21.15.177:0/1813226845 shutdown_connections 2023-11-28T20:09:57.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.328+0000 7fec8390f640 1 -- 172.21.15.177:0/1813226845 wait complete. 2023-11-28T20:09:57.350 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:09:57.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.484+0000 7f88ba45a640 1 Processor -- start 2023-11-28T20:09:57.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.484+0000 7f88ba45a640 1 -- start start 2023-11-28T20:09:57.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.488+0000 7f88ba45a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f88b4144840 0x7f88b406c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.488+0000 7f88ba45a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f88b4070b70 0x7f88b406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.488+0000 7f88ba45a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b40710e0 con 0x7f88b4072180 2023-11-28T20:09:57.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.488+0000 7f88ba45a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b415f010 con 0x7f88b4144840 2023-11-28T20:09:57.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.488+0000 7f88ba45a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b40713c0 con 0x7f88b4070b70 2023-11-28T20:09:57.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.488+0000 7f88b3fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f88b4144840 0x7f88b406c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.488+0000 7f88b3fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f88b4144840 0x7f88b406c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51700/0 (socket says 172.21.15.177:51700) 2023-11-28T20:09:57.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.488+0000 7f88b3fff640 1 -- 172.21.15.177:0/2768000412 learned_addr learned my addr 172.21.15.177:0/2768000412 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:57.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.488+0000 7f88b89f7640 1 --2- 172.21.15.177:0/2768000412 >> v2:172.21.15.195:3300/0 conn(0x7f88b4070b70 0x7f88b406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.488+0000 7f88b3fff640 1 -- 172.21.15.177:0/2768000412 >> v2:172.21.15.195:3300/0 conn(0x7f88b4070b70 msgr2=0x7f88b406c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:57.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.488+0000 7f88b3fff640 1 --2- 172.21.15.177:0/2768000412 >> v2:172.21.15.195:3300/0 conn(0x7f88b4070b70 0x7f88b406c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.488+0000 7f88b3fff640 1 -- 172.21.15.177:0/2768000412 >> v1:172.21.15.177:6789/0 conn(0x7f88b4072180 legacy=0x7f88b4070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.488+0000 7f88b3fff640 1 -- 172.21.15.177:0/2768000412 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b40716a0 con 0x7f88b4144840 2023-11-28T20:09:57.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.488+0000 7f88b2ffd640 1 -- 172.21.15.177:0/2768000412 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956619927 0 0) 0x7f88b40710e0 con 0x7f88b4072180 2023-11-28T20:09:57.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.492+0000 7f88b3fff640 1 --2- 172.21.15.177:0/2768000412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b4144840 0x7f88b406c2c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f88b40b2070 tx=0x7f88a401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec729972fda9b75 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:57.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.492+0000 7f88b2ffd640 1 -- 172.21.15.177:0/2768000412 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a40aa430 con 0x7f88b4144840 2023-11-28T20:09:57.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.492+0000 7f88b2ffd640 1 -- 172.21.15.177:0/2768000412 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a40aa590 con 0x7f88b4144840 2023-11-28T20:09:57.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.492+0000 7f88b2ffd640 1 -- 172.21.15.177:0/2768000412 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a40aa920 con 0x7f88b4144840 2023-11-28T20:09:57.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.492+0000 7f88ba45a640 1 -- 172.21.15.177:0/2768000412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b4144840 msgr2=0x7f88b406c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.492+0000 7f88ba45a640 1 --2- 172.21.15.177:0/2768000412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b4144840 0x7f88b406c2c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f88b40b2070 tx=0x7f88a401c4d0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.492+0000 7f88ba45a640 1 -- 172.21.15.177:0/2768000412 shutdown_connections 2023-11-28T20:09:57.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.492+0000 7f88ba45a640 1 --2- 172.21.15.177:0/2768000412 >> v2:172.21.15.195:3300/0 conn(0x7f88b4070b70 0x7f88b406c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.492+0000 7f88ba45a640 1 --2- 172.21.15.177:0/2768000412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b4144840 0x7f88b406c2c0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.492+0000 7f88ba45a640 1 -- 172.21.15.177:0/2768000412 >> 172.21.15.177:0/2768000412 conn(0x7f88b406a530 msgr2=0x7f88b406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:57.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.492+0000 7f88ba45a640 1 -- 172.21.15.177:0/2768000412 shutdown_connections 2023-11-28T20:09:57.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.492+0000 7f88ba45a640 1 -- 172.21.15.177:0/2768000412 wait complete. 2023-11-28T20:09:57.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.492+0000 7f88ba45a640 1 Processor -- start 2023-11-28T20:09:57.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.492+0000 7f88ba45a640 1 -- start start 2023-11-28T20:09:57.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88ba45a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b4070b70 0x7f88b4138520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88ba45a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88b4072180 0x7f88b41585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88ba45a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88b4144840 0x7f88b4141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88ba45a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b415abf0 con 0x7f88b4070b70 2023-11-28T20:09:57.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88ba45a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b413c050 con 0x7f88b4072180 2023-11-28T20:09:57.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88ba45a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b41413f0 con 0x7f88b4144840 2023-11-28T20:09:57.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88b3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b4070b70 0x7f88b4138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88b3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b4070b70 0x7f88b4138520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51708/0 (socket says 172.21.15.177:51708) 2023-11-28T20:09:57.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88b3fff640 1 -- 172.21.15.177:0/1790112685 learned_addr learned my addr 172.21.15.177:0/1790112685 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:57.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88b37fe640 1 --2- 172.21.15.177:0/1790112685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88b4072180 0x7f88b41585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88b89f7640 1 --2- 172.21.15.177:0/1790112685 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88b4144840 0x7f88b4141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88b3fff640 1 -- 172.21.15.177:0/1790112685 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88b4144840 msgr2=0x7f88b4141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88b3fff640 1 --2- 172.21.15.177:0/1790112685 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88b4144840 0x7f88b4141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88b3fff640 1 -- 172.21.15.177:0/1790112685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88b4072180 msgr2=0x7f88b41585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88b3fff640 1 --2- 172.21.15.177:0/1790112685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88b4072180 0x7f88b41585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88b3fff640 1 -- 172.21.15.177:0/1790112685 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a40094d0 con 0x7f88b4070b70 2023-11-28T20:09:57.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88b37fe640 1 --2- 172.21.15.177:0/1790112685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88b4072180 0x7f88b41585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:57.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88b3fff640 1 --2- 172.21.15.177:0/1790112685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b4070b70 0x7f88b4138520 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f88a401ab80 tx=0x7f88a401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:57.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88b0ff9640 1 -- 172.21.15.177:0/1790112685 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a40aac50 con 0x7f88b4070b70 2023-11-28T20:09:57.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88b0ff9640 1 -- 172.21.15.177:0/1790112685 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a40b7070 con 0x7f88b4070b70 2023-11-28T20:09:57.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88b0ff9640 1 -- 172.21.15.177:0/1790112685 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a4004030 con 0x7f88b4070b70 2023-11-28T20:09:57.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88ba45a640 1 -- 172.21.15.177:0/1790112685 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b41416d0 con 0x7f88b4070b70 2023-11-28T20:09:57.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88ba45a640 1 -- 172.21.15.177:0/1790112685 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b41649b0 con 0x7f88b4070b70 2023-11-28T20:09:57.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.496+0000 7f88ba45a640 1 -- 172.21.15.177:0/1790112685 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b4164530 con 0x7f88b4070b70 2023-11-28T20:09:57.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.500+0000 7f88b0ff9640 1 -- 172.21.15.177:0/1790112685 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f88a4004190 con 0x7f88b4070b70 2023-11-28T20:09:57.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.500+0000 7f88b0ff9640 1 --2- 172.21.15.177:0/1790112685 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f88a0066470 0x7f88a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.500+0000 7f88b0ff9640 1 -- 172.21.15.177:0/1790112685 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88a411dd00 con 0x7f88b4070b70 2023-11-28T20:09:57.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.500+0000 7f88b37fe640 1 --2- 172.21.15.177:0/1790112685 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f88a0066470 0x7f88a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.500+0000 7f88b37fe640 1 --2- 172.21.15.177:0/1790112685 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f88a0066470 0x7f88a0068930 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f88b41384b0 tx=0x7f88a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:57.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.504+0000 7f88b0ff9640 1 -- 172.21.15.177:0/1790112685 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88b4164530 con 0x7f88b4070b70 2023-11-28T20:09:57.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.664+0000 7f88ba45a640 1 -- 172.21.15.177:0/1790112685 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f88b4164530 con 0x7f88b4070b70 2023-11-28T20:09:57.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.664+0000 7f88b0ff9640 1 -- 172.21.15.177:0/1790112685 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7f88b4164530 con 0x7f88b4070b70 2023-11-28T20:09:57.668 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:09:57.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.664+0000 7f88ba45a640 1 -- 172.21.15.177:0/1790112685 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f88a0066470 msgr2=0x7f88a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.664+0000 7f88ba45a640 1 --2- 172.21.15.177:0/1790112685 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f88a0066470 0x7f88a0068930 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f88b41384b0 tx=0x7f88a8009040 comp rx=0 tx=0).stop 2023-11-28T20:09:57.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.664+0000 7f88ba45a640 1 -- 172.21.15.177:0/1790112685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b4070b70 msgr2=0x7f88b4138520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.664+0000 7f88ba45a640 1 --2- 172.21.15.177:0/1790112685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b4070b70 0x7f88b4138520 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f88a401ab80 tx=0x7f88a401ad10 comp rx=0 tx=0).stop 2023-11-28T20:09:57.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.664+0000 7f88ba45a640 1 -- 172.21.15.177:0/1790112685 shutdown_connections 2023-11-28T20:09:57.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.664+0000 7f88ba45a640 1 --2- 172.21.15.177:0/1790112685 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f88a0066470 0x7f88a0068930 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.664+0000 7f88ba45a640 1 --2- 172.21.15.177:0/1790112685 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88b4144840 0x7f88b4141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.664+0000 7f88ba45a640 1 --2- 172.21.15.177:0/1790112685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88b4072180 0x7f88b41585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.664+0000 7f88ba45a640 1 --2- 172.21.15.177:0/1790112685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b4070b70 0x7f88b4138520 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.664+0000 7f88ba45a640 1 -- 172.21.15.177:0/1790112685 >> 172.21.15.177:0/1790112685 conn(0x7f88b406a530 msgr2=0x7f88b415f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:57.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.668+0000 7f88ba45a640 1 -- 172.21.15.177:0/1790112685 shutdown_connections 2023-11-28T20:09:57.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.668+0000 7f88ba45a640 1 -- 172.21.15.177:0/1790112685 wait complete. 2023-11-28T20:09:57.689 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:09:57.689 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:09:57.698 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:09:57.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62f3479640 1 Processor -- start 2023-11-28T20:09:57.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62f3479640 1 -- start start 2023-11-28T20:09:57.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62f3479640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62ec13cf30 0x7f62ec06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62f3479640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f62ec15ad40 0x7f62ec0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62f3479640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ec15b3a0 con 0x7f62ec06c800 2023-11-28T20:09:57.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62f3479640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ec13d310 con 0x7f62ec15ad40 2023-11-28T20:09:57.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62f3479640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec15b1b0 con 0x7f62ec13cf30 2023-11-28T20:09:57.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62f0a14640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f62ec06c800 0x7f62ec15a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:42768/0 (socket says 172.21.15.177:42768) 2023-11-28T20:09:57.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62f0a14640 1 -- 172.21.15.177:0/934667000 learned_addr learned my addr 172.21.15.177:0/934667000 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:57.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62f1a16640 1 --2- 172.21.15.177:0/934667000 >> v2:172.21.15.195:3300/0 conn(0x7f62ec15ad40 0x7f62ec0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62f1215640 1 --2- 172.21.15.177:0/934667000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62ec13cf30 0x7f62ec06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62e3fff640 1 -- 172.21.15.177:0/934667000 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209743783 0 0) 0x7f62ec15b3a0 con 0x7f62ec06c800 2023-11-28T20:09:57.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62e3fff640 1 -- 172.21.15.177:0/934667000 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62d8003530 con 0x7f62ec06c800 2023-11-28T20:09:57.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62e3fff640 1 -- 172.21.15.177:0/934667000 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 626752838 0 0) 0x7f62d8003530 con 0x7f62ec06c800 2023-11-28T20:09:57.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62f1a16640 1 -- 172.21.15.177:0/934667000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62ec13cf30 msgr2=0x7f62ec06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:57.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62f1a16640 1 --2- 172.21.15.177:0/934667000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62ec13cf30 0x7f62ec06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62f1a16640 1 -- 172.21.15.177:0/934667000 >> v1:172.21.15.177:6789/0 conn(0x7f62ec06c800 legacy=0x7f62ec15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.880+0000 7f62f1a16640 1 -- 172.21.15.177:0/934667000 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec06cc40 con 0x7f62ec15ad40 2023-11-28T20:09:57.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.884+0000 7f62f1a16640 1 --2- 172.21.15.177:0/934667000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62ec15ad40 0x7f62ec0cd880 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009d90 tx=0x7f62e401c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c895d6eaa853e6c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:57.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.884+0000 7f62e3fff640 1 -- 172.21.15.177:0/934667000 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc001680 con 0x7f62ec15ad40 2023-11-28T20:09:57.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.884+0000 7f62e3fff640 1 -- 172.21.15.177:0/934667000 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e40a64e0 con 0x7f62ec15ad40 2023-11-28T20:09:57.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.884+0000 7f62e3fff640 1 -- 172.21.15.177:0/934667000 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e40a6850 con 0x7f62ec15ad40 2023-11-28T20:09:57.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.884+0000 7f62f3479640 1 -- 172.21.15.177:0/934667000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62ec15ad40 msgr2=0x7f62ec0cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.884+0000 7f62f3479640 1 --2- 172.21.15.177:0/934667000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62ec15ad40 0x7f62ec0cd880 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009d90 tx=0x7f62e401c7e0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.884+0000 7f62f3479640 1 -- 172.21.15.177:0/934667000 shutdown_connections 2023-11-28T20:09:57.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.884+0000 7f62f3479640 1 --2- 172.21.15.177:0/934667000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62ec15ad40 0x7f62ec0cd880 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.884+0000 7f62f3479640 1 --2- 172.21.15.177:0/934667000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62ec13cf30 0x7f62ec06c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.884+0000 7f62f3479640 1 -- 172.21.15.177:0/934667000 >> 172.21.15.177:0/934667000 conn(0x7f62ec06a530 msgr2=0x7f62ec06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:57.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.884+0000 7f62f3479640 1 -- 172.21.15.177:0/934667000 shutdown_connections 2023-11-28T20:09:57.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.884+0000 7f62f3479640 1 -- 172.21.15.177:0/934667000 wait complete. 2023-11-28T20:09:57.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f3479640 1 Processor -- start 2023-11-28T20:09:57.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f3479640 1 -- start start 2023-11-28T20:09:57.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f3479640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62ec06c800 0x7f62ec133400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f3479640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62ec13cf30 0x7f62ec150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f3479640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62ec15ad40 0x7f62ec154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f3479640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec1396d0 con 0x7f62ec13cf30 2023-11-28T20:09:57.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f3479640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec138a50 con 0x7f62ec15ad40 2023-11-28T20:09:57.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f3479640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec138d30 con 0x7f62ec06c800 2023-11-28T20:09:57.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f0a14640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62ec13cf30 0x7f62ec150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f0a14640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62ec13cf30 0x7f62ec150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51720/0 (socket says 172.21.15.177:51720) 2023-11-28T20:09:57.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f0a14640 1 -- 172.21.15.177:0/2778235125 learned_addr learned my addr 172.21.15.177:0/2778235125 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:57.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f1a16640 1 --2- 172.21.15.177:0/2778235125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62ec15ad40 0x7f62ec154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f1215640 1 --2- 172.21.15.177:0/2778235125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62ec06c800 0x7f62ec133400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f0a14640 1 -- 172.21.15.177:0/2778235125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62ec06c800 msgr2=0x7f62ec133400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f0a14640 1 --2- 172.21.15.177:0/2778235125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62ec06c800 0x7f62ec133400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f0a14640 1 -- 172.21.15.177:0/2778235125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62ec15ad40 msgr2=0x7f62ec154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:57.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f0a14640 1 --2- 172.21.15.177:0/2778235125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62ec15ad40 0x7f62ec154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:57.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f0a14640 1 -- 172.21.15.177:0/2778235125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e4009a70 con 0x7f62ec13cf30 2023-11-28T20:09:57.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f0a14640 1 --2- 172.21.15.177:0/2778235125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62ec13cf30 0x7f62ec150a00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00c750 tx=0x7f62dc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:57.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62e1ffb640 1 -- 172.21.15.177:0/2778235125 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc005ae0 con 0x7f62ec13cf30 2023-11-28T20:09:57.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62e1ffb640 1 -- 172.21.15.177:0/2778235125 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc005c40 con 0x7f62ec13cf30 2023-11-28T20:09:57.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62e1ffb640 1 -- 172.21.15.177:0/2778235125 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc007070 con 0x7f62ec13cf30 2023-11-28T20:09:57.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.888+0000 7f62f3479640 1 -- 172.21.15.177:0/2778235125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ec139010 con 0x7f62ec13cf30 2023-11-28T20:09:57.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.892+0000 7f62f3479640 1 -- 172.21.15.177:0/2778235125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ec150f40 con 0x7f62ec13cf30 2023-11-28T20:09:57.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.892+0000 7f62f3479640 1 -- 172.21.15.177:0/2778235125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ec139810 con 0x7f62ec13cf30 2023-11-28T20:09:57.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.892+0000 7f62e1ffb640 1 -- 172.21.15.177:0/2778235125 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f62dc0071d0 con 0x7f62ec13cf30 2023-11-28T20:09:57.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.892+0000 7f62e1ffb640 1 --2- 172.21.15.177:0/2778235125 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f62d0066470 0x7f62d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:57.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.892+0000 7f62e1ffb640 1 -- 172.21.15.177:0/2778235125 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62dc083c30 con 0x7f62ec13cf30 2023-11-28T20:09:57.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.892+0000 7f62f1215640 1 --2- 172.21.15.177:0/2778235125 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f62d0066470 0x7f62d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:57.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.892+0000 7f62f1215640 1 --2- 172.21.15.177:0/2778235125 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f62d0066470 0x7f62d0068930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009b60 tx=0x7f62e8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:57.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:57.896+0000 7f62e1ffb640 1 -- 172.21.15.177:0/2778235125 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f62ec139810 con 0x7f62ec13cf30 2023-11-28T20:09:58.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.048+0000 7f62f3479640 1 -- 172.21.15.177:0/2778235125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62ec139810 con 0x7f62ec13cf30 2023-11-28T20:09:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.048+0000 7f62e1ffb640 1 -- 172.21.15.177:0/2778235125 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f62ec139810 con 0x7f62ec13cf30 2023-11-28T20:09:58.052 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:09:58.053 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":49,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:09:44.664848+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:09:40.777720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T20:09:42.029277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:09:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.052+0000 7f62f3479640 1 -- 172.21.15.177:0/2778235125 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f62d0066470 msgr2=0x7f62d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.052+0000 7f62f3479640 1 --2- 172.21.15.177:0/2778235125 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f62d0066470 0x7f62d0068930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009b60 tx=0x7f62e8009190 comp rx=0 tx=0).stop 2023-11-28T20:09:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.052+0000 7f62f3479640 1 -- 172.21.15.177:0/2778235125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62ec13cf30 msgr2=0x7f62ec150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.052+0000 7f62f3479640 1 --2- 172.21.15.177:0/2778235125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62ec13cf30 0x7f62ec150a00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00c750 tx=0x7f62dc00cc10 comp rx=0 tx=0).stop 2023-11-28T20:09:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.052+0000 7f62f3479640 1 -- 172.21.15.177:0/2778235125 shutdown_connections 2023-11-28T20:09:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.052+0000 7f62f3479640 1 --2- 172.21.15.177:0/2778235125 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f62d0066470 0x7f62d0068930 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.052+0000 7f62f3479640 1 --2- 172.21.15.177:0/2778235125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62ec15ad40 0x7f62ec154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.052+0000 7f62f3479640 1 --2- 172.21.15.177:0/2778235125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62ec13cf30 0x7f62ec150a00 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.052+0000 7f62f3479640 1 --2- 172.21.15.177:0/2778235125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62ec06c800 0x7f62ec133400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.052+0000 7f62f3479640 1 -- 172.21.15.177:0/2778235125 >> 172.21.15.177:0/2778235125 conn(0x7f62ec06a530 msgr2=0x7f62ec13de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:58.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.052+0000 7f62f3479640 1 -- 172.21.15.177:0/2778235125 shutdown_connections 2023-11-28T20:09:58.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.052+0000 7f62f3479640 1 -- 172.21.15.177:0/2778235125 wait complete. 2023-11-28T20:09:58.073 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:09:40.777720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:09:42.029277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:09:58.074 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:09:58.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.208+0000 7fcf544fd640 1 Processor -- start 2023-11-28T20:09:58.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.208+0000 7fcf544fd640 1 -- start start 2023-11-28T20:09:58.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf544fd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcf4c1571d0 0x7fcf4c070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf544fd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcf4c0ae830 0x7fcf4c15d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf544fd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf4c15d710 0x7fcf4c159be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf544fd640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c15db80 con 0x7fcf4c0ae830 2023-11-28T20:09:58.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf544fd640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c1575b0 con 0x7fcf4c1571d0 2023-11-28T20:09:58.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf544fd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c071600 con 0x7fcf4c15d710 2023-11-28T20:09:58.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf51a98640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcf4c0ae830 0x7fcf4c15d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf51a98640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcf4c0ae830 0x7fcf4c15d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51724/0 (socket says 172.21.15.177:51724) 2023-11-28T20:09:58.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf51a98640 1 -- 172.21.15.177:0/1051934872 learned_addr learned my addr 172.21.15.177:0/1051934872 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:58.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf52299640 1 --2- 172.21.15.177:0/1051934872 >> v2:172.21.15.195:3300/0 conn(0x7fcf4c1571d0 0x7fcf4c070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf52a9a640 1 --2- 172.21.15.177:0/1051934872 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf4c15d710 0x7fcf4c159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf51a98640 1 -- 172.21.15.177:0/1051934872 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf4c15d710 msgr2=0x7fcf4c159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:58.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf51a98640 1 --2- 172.21.15.177:0/1051934872 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf4c15d710 0x7fcf4c159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf51a98640 1 -- 172.21.15.177:0/1051934872 >> v2:172.21.15.195:3300/0 conn(0x7fcf4c1571d0 msgr2=0x7fcf4c070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:58.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf51a98640 1 --2- 172.21.15.177:0/1051934872 >> v2:172.21.15.195:3300/0 conn(0x7fcf4c1571d0 0x7fcf4c070c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf51a98640 1 -- 172.21.15.177:0/1051934872 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c0718e0 con 0x7fcf4c0ae830 2023-11-28T20:09:58.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.212+0000 7fcf52299640 1 --2- 172.21.15.177:0/1051934872 >> v2:172.21.15.195:3300/0 conn(0x7fcf4c1571d0 0x7fcf4c070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:58.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.216+0000 7fcf51a98640 1 --2- 172.21.15.177:0/1051934872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf4c0ae830 0x7fcf4c15d1d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c06bf90 tx=0x7fcf3c01ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df375a56593dd5f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:58.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.216+0000 7fcf51297640 1 -- 172.21.15.177:0/1051934872 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0a7be0 con 0x7fcf4c0ae830 2023-11-28T20:09:58.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.216+0000 7fcf51297640 1 -- 172.21.15.177:0/1051934872 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c0a7d40 con 0x7fcf4c0ae830 2023-11-28T20:09:58.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.216+0000 7fcf51297640 1 -- 172.21.15.177:0/1051934872 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0af660 con 0x7fcf4c0ae830 2023-11-28T20:09:58.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.216+0000 7fcf544fd640 1 -- 172.21.15.177:0/1051934872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf4c0ae830 msgr2=0x7fcf4c15d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.216+0000 7fcf544fd640 1 --2- 172.21.15.177:0/1051934872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf4c0ae830 0x7fcf4c15d1d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c06bf90 tx=0x7fcf3c01ebd0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.216+0000 7fcf544fd640 1 -- 172.21.15.177:0/1051934872 shutdown_connections 2023-11-28T20:09:58.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.216+0000 7fcf544fd640 1 --2- 172.21.15.177:0/1051934872 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf4c15d710 0x7fcf4c159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.216+0000 7fcf544fd640 1 --2- 172.21.15.177:0/1051934872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf4c0ae830 0x7fcf4c15d1d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.216+0000 7fcf544fd640 1 --2- 172.21.15.177:0/1051934872 >> v2:172.21.15.195:3300/0 conn(0x7fcf4c1571d0 0x7fcf4c070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.216+0000 7fcf544fd640 1 -- 172.21.15.177:0/1051934872 >> 172.21.15.177:0/1051934872 conn(0x7fcf4c0b0cc0 msgr2=0x7fcf4c0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:58.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.216+0000 7fcf544fd640 1 -- 172.21.15.177:0/1051934872 shutdown_connections 2023-11-28T20:09:58.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.216+0000 7fcf544fd640 1 -- 172.21.15.177:0/1051934872 wait complete. 2023-11-28T20:09:58.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.216+0000 7fcf544fd640 1 Processor -- start 2023-11-28T20:09:58.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.216+0000 7fcf544fd640 1 -- start start 2023-11-28T20:09:58.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf544fd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf4c0ae830 0x7fcf4c0b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf544fd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf4c1571d0 0x7fcf4c1533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf544fd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf4c15d710 0x7fcf4c14e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf544fd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0b3d70 con 0x7fcf4c1571d0 2023-11-28T20:09:58.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf544fd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0b31f0 con 0x7fcf4c15d710 2023-11-28T20:09:58.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf544fd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0b34d0 con 0x7fcf4c0ae830 2023-11-28T20:09:58.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf51a98640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf4c1571d0 0x7fcf4c1533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf51a98640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf4c1571d0 0x7fcf4c1533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51726/0 (socket says 172.21.15.177:51726) 2023-11-28T20:09:58.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf51a98640 1 -- 172.21.15.177:0/1184704896 learned_addr learned my addr 172.21.15.177:0/1184704896 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:58.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf52299640 1 --2- 172.21.15.177:0/1184704896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf4c0ae830 0x7fcf4c0b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf52a9a640 1 --2- 172.21.15.177:0/1184704896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf4c15d710 0x7fcf4c14e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf51a98640 1 -- 172.21.15.177:0/1184704896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf4c0ae830 msgr2=0x7fcf4c0b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf51a98640 1 --2- 172.21.15.177:0/1184704896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf4c0ae830 0x7fcf4c0b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf51a98640 1 -- 172.21.15.177:0/1184704896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf4c15d710 msgr2=0x7fcf4c14e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf51a98640 1 --2- 172.21.15.177:0/1184704896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf4c15d710 0x7fcf4c14e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf51a98640 1 -- 172.21.15.177:0/1184704896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c00b770 con 0x7fcf4c1571d0 2023-11-28T20:09:58.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf51a98640 1 --2- 172.21.15.177:0/1184704896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf4c1571d0 0x7fcf4c1533a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00b2c0 tx=0x7fcf3c01b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:58.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf42ffd640 1 -- 172.21.15.177:0/1184704896 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c006ee0 con 0x7fcf4c1571d0 2023-11-28T20:09:58.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf42ffd640 1 -- 172.21.15.177:0/1184704896 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c0ba640 con 0x7fcf4c1571d0 2023-11-28T20:09:58.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf544fd640 1 -- 172.21.15.177:0/1184704896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c0b37b0 con 0x7fcf4c1571d0 2023-11-28T20:09:58.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf42ffd640 1 -- 172.21.15.177:0/1184704896 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0ba9f0 con 0x7fcf4c1571d0 2023-11-28T20:09:58.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf544fd640 1 -- 172.21.15.177:0/1184704896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c1538e0 con 0x7fcf4c1571d0 2023-11-28T20:09:58.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf544fd640 1 -- 172.21.15.177:0/1184704896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4c0693d0 con 0x7fcf4c1571d0 2023-11-28T20:09:58.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.220+0000 7fcf42ffd640 1 -- 172.21.15.177:0/1184704896 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf3c0b6040 con 0x7fcf4c1571d0 2023-11-28T20:09:58.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.224+0000 7fcf42ffd640 1 --2- 172.21.15.177:0/1184704896 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcf300664a0 0x7fcf30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.224+0000 7fcf42ffd640 1 -- 172.21.15.177:0/1184704896 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf3c1211c0 con 0x7fcf4c1571d0 2023-11-28T20:09:58.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.224+0000 7fcf52299640 1 --2- 172.21.15.177:0/1184704896 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcf300664a0 0x7fcf30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.224+0000 7fcf52299640 1 --2- 172.21.15.177:0/1184704896 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcf300664a0 0x7fcf30068960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcf480098d0 tx=0x7fcf48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:58.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.224+0000 7fcf42ffd640 1 -- 172.21.15.177:0/1184704896 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf3c0ee6e0 con 0x7fcf4c1571d0 2023-11-28T20:09:58.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.380+0000 7fcf544fd640 1 -- 172.21.15.177:0/1184704896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf4c1517a0 con 0x7fcf4c1571d0 2023-11-28T20:09:58.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.384+0000 7fcf42ffd640 1 -- 172.21.15.177:0/1184704896 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf3c0f1d00 con 0x7fcf4c1571d0 2023-11-28T20:09:58.387 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:09:58.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.384+0000 7fcf544fd640 1 -- 172.21.15.177:0/1184704896 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcf300664a0 msgr2=0x7fcf30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.384+0000 7fcf544fd640 1 --2- 172.21.15.177:0/1184704896 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcf300664a0 0x7fcf30068960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcf480098d0 tx=0x7fcf48008040 comp rx=0 tx=0).stop 2023-11-28T20:09:58.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.384+0000 7fcf544fd640 1 -- 172.21.15.177:0/1184704896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf4c1571d0 msgr2=0x7fcf4c1533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.384+0000 7fcf544fd640 1 --2- 172.21.15.177:0/1184704896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf4c1571d0 0x7fcf4c1533a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00b2c0 tx=0x7fcf3c01b970 comp rx=0 tx=0).stop 2023-11-28T20:09:58.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.384+0000 7fcf544fd640 1 -- 172.21.15.177:0/1184704896 shutdown_connections 2023-11-28T20:09:58.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.384+0000 7fcf544fd640 1 --2- 172.21.15.177:0/1184704896 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcf300664a0 0x7fcf30068960 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.384+0000 7fcf544fd640 1 --2- 172.21.15.177:0/1184704896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf4c15d710 0x7fcf4c14e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.384+0000 7fcf544fd640 1 --2- 172.21.15.177:0/1184704896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf4c1571d0 0x7fcf4c1533a0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.384+0000 7fcf544fd640 1 --2- 172.21.15.177:0/1184704896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf4c0ae830 0x7fcf4c0b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.384+0000 7fcf544fd640 1 -- 172.21.15.177:0/1184704896 >> 172.21.15.177:0/1184704896 conn(0x7fcf4c0b0cc0 msgr2=0x7fcf4c158380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:58.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.384+0000 7fcf544fd640 1 -- 172.21.15.177:0/1184704896 shutdown_connections 2023-11-28T20:09:58.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.384+0000 7fcf544fd640 1 -- 172.21.15.177:0/1184704896 wait complete. 2023-11-28T20:09:58.407 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:09:58.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.544+0000 7f5bdc3f8640 1 Processor -- start 2023-11-28T20:09:58.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.544+0000 7f5bdc3f8640 1 -- start start 2023-11-28T20:09:58.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.544+0000 7f5bdc3f8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5bd40cba10 0x7f5bd415be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.544+0000 7f5bdc3f8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd415b670 con 0x7f5bd40b42d0 2023-11-28T20:09:58.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.544+0000 7f5bdc3f8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd415f410 con 0x7f5bd4158ca0 2023-11-28T20:09:58.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.544+0000 7f5bdc3f8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd415f6f0 con 0x7f5bd40cba10 2023-11-28T20:09:58.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bda995640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5bd40b42d0 0x7f5bd40703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:42778/0 (socket says 172.21.15.177:42778) 2023-11-28T20:09:58.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bda995640 1 -- 172.21.15.177:0/3442585431 learned_addr learned my addr 172.21.15.177:0/3442585431 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:58.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9993640 1 --2- 172.21.15.177:0/3442585431 >> v2:172.21.15.195:3300/0 conn(0x7f5bd40cba10 0x7f5bd415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9192640 1 -- 172.21.15.177:0/3442585431 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507111683 0 0) 0x7f5bd415b670 con 0x7f5bd40b42d0 2023-11-28T20:09:58.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9192640 1 -- 172.21.15.177:0/3442585431 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bc0003530 con 0x7f5bd40b42d0 2023-11-28T20:09:58.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9192640 1 -- 172.21.15.177:0/3442585431 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 251572314 0 0) 0x7f5bc0003530 con 0x7f5bd40b42d0 2023-11-28T20:09:58.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9192640 1 -- 172.21.15.177:0/3442585431 >> v2:172.21.15.195:3300/0 conn(0x7f5bd40cba10 msgr2=0x7f5bd415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:58.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9192640 1 --2- 172.21.15.177:0/3442585431 >> v2:172.21.15.195:3300/0 conn(0x7f5bd40cba10 0x7f5bd415be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9192640 1 -- 172.21.15.177:0/3442585431 >> v1:172.21.15.195:6789/0 conn(0x7f5bd4158ca0 legacy=0x7f5bd415eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9192640 1 -- 172.21.15.177:0/3442585431 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd415b8e0 con 0x7f5bd40b42d0 2023-11-28T20:09:58.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9192640 1 -- 172.21.15.177:0/3442585431 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f5bcc001a00 con 0x7f5bd40b42d0 2023-11-28T20:09:58.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9192640 1 -- 172.21.15.177:0/3442585431 >> v1:172.21.15.177:6789/0 conn(0x7f5bd40b42d0 legacy=0x7f5bd40703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9192640 1 --2- 172.21.15.177:0/3442585431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bc0003980 0x7f5bc0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9192640 1 --2- 172.21.15.177:0/3442585431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bc00047d0 0x7f5bc0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9192640 1 --2- 172.21.15.177:0/3442585431 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bc0005190 0x7f5bc000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9192640 1 -- 172.21.15.177:0/3442585431 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd415f6f0 con 0x7f5bc00047d0 2023-11-28T20:09:58.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9192640 1 -- 172.21.15.177:0/3442585431 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc000c030 con 0x7f5bc0003980 2023-11-28T20:09:58.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9192640 1 -- 172.21.15.177:0/3442585431 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc000c1f0 con 0x7f5bc0005190 2023-11-28T20:09:58.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9993640 1 --2- 172.21.15.177:0/3442585431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bc00047d0 0x7f5bc0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bda194640 1 --2- 172.21.15.177:0/3442585431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bc0003980 0x7f5bc0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bda995640 1 --2- 172.21.15.177:0/3442585431 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bc0005190 0x7f5bc000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9993640 1 -- 172.21.15.177:0/3442585431 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bc0005190 msgr2=0x7f5bc000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:58.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9993640 1 --2- 172.21.15.177:0/3442585431 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bc0005190 0x7f5bc000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9993640 1 -- 172.21.15.177:0/3442585431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bc0003980 msgr2=0x7f5bc0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:58.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9993640 1 --2- 172.21.15.177:0/3442585431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bc0003980 0x7f5bc0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bd9993640 1 -- 172.21.15.177:0/3442585431 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc0003530 con 0x7f5bc00047d0 2023-11-28T20:09:58.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.548+0000 7f5bda995640 1 -- 172.21.15.177:0/3442585431 reap_dead start 2023-11-28T20:09:58.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.552+0000 7f5bd9993640 1 --2- 172.21.15.177:0/3442585431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bc00047d0 0x7f5bc0004c50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4009ab0 tx=0x7f5bc401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321dc660b91fb1bf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:58.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.552+0000 7f5bd9192640 1 -- 172.21.15.177:0/3442585431 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc40a5510 con 0x7f5bc00047d0 2023-11-28T20:09:58.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.552+0000 7f5bd9192640 1 -- 172.21.15.177:0/3442585431 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc40a5670 con 0x7f5bc00047d0 2023-11-28T20:09:58.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.552+0000 7f5bd9192640 1 -- 172.21.15.177:0/3442585431 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc40a5a20 con 0x7f5bc00047d0 2023-11-28T20:09:58.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.552+0000 7f5bdc3f8640 1 -- 172.21.15.177:0/3442585431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bc00047d0 msgr2=0x7f5bc0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.552+0000 7f5bdc3f8640 1 --2- 172.21.15.177:0/3442585431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bc00047d0 0x7f5bc0004c50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4009ab0 tx=0x7f5bc401ca30 comp rx=0 tx=0).stop 2023-11-28T20:09:58.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.552+0000 7f5bdc3f8640 1 -- 172.21.15.177:0/3442585431 shutdown_connections 2023-11-28T20:09:58.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.552+0000 7f5bdc3f8640 1 --2- 172.21.15.177:0/3442585431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bc00047d0 0x7f5bc0004c50 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.552+0000 7f5bdc3f8640 1 -- 172.21.15.177:0/3442585431 >> 172.21.15.177:0/3442585431 conn(0x7f5bd40b0cc0 msgr2=0x7f5bd40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:58.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.552+0000 7f5bdc3f8640 1 -- 172.21.15.177:0/3442585431 shutdown_connections 2023-11-28T20:09:58.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.552+0000 7f5bdc3f8640 1 -- 172.21.15.177:0/3442585431 wait complete. 2023-11-28T20:09:58.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.552+0000 7f5bdc3f8640 1 Processor -- start 2023-11-28T20:09:58.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.552+0000 7f5bdc3f8640 1 -- start start 2023-11-28T20:09:58.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bdc3f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bc00047d0 0x7f5bd40b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bdc3f8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bd41f2f90 0x7f5bd40b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bdc3f8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bd4157240 0x7f5bd415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bdc3f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd415dcb0 con 0x7f5bc00047d0 2023-11-28T20:09:58.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bdc3f8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd41e4e60 con 0x7f5bd4157240 2023-11-28T20:09:58.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bdc3f8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd41e9120 con 0x7f5bd41f2f90 2023-11-28T20:09:58.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bda194640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bc00047d0 0x7f5bd40b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bda194640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bc00047d0 0x7f5bd40b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51738/0 (socket says 172.21.15.177:51738) 2023-11-28T20:09:58.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bda194640 1 -- 172.21.15.177:0/1932480256 learned_addr learned my addr 172.21.15.177:0/1932480256 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:58.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bd9993640 1 --2- 172.21.15.177:0/1932480256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bd41f2f90 0x7f5bd40b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bda995640 1 --2- 172.21.15.177:0/1932480256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bd4157240 0x7f5bd415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bda194640 1 -- 172.21.15.177:0/1932480256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bd41f2f90 msgr2=0x7f5bd40b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bda194640 1 --2- 172.21.15.177:0/1932480256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bd41f2f90 0x7f5bd40b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bda194640 1 -- 172.21.15.177:0/1932480256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bd4157240 msgr2=0x7f5bd415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bda194640 1 --2- 172.21.15.177:0/1932480256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bd4157240 0x7f5bd415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bda194640 1 -- 172.21.15.177:0/1932480256 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd41e9400 con 0x7f5bc00047d0 2023-11-28T20:09:58.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bda995640 1 --2- 172.21.15.177:0/1932480256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bd4157240 0x7f5bd415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:58.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bda194640 1 --2- 172.21.15.177:0/1932480256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bc00047d0 0x7f5bd40b3110 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000f7f0 tx=0x7f5bd000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:58.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bcaffd640 1 -- 172.21.15.177:0/1932480256 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00050d0 con 0x7f5bc00047d0 2023-11-28T20:09:58.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bcaffd640 1 -- 172.21.15.177:0/1932480256 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd0005230 con 0x7f5bc00047d0 2023-11-28T20:09:58.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bdc3f8640 1 -- 172.21.15.177:0/1932480256 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd41e96e0 con 0x7f5bc00047d0 2023-11-28T20:09:58.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bcaffd640 1 -- 172.21.15.177:0/1932480256 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000d730 con 0x7f5bc00047d0 2023-11-28T20:09:58.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bdc3f8640 1 -- 172.21.15.177:0/1932480256 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd41e8dd0 con 0x7f5bc00047d0 2023-11-28T20:09:58.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bdc3f8640 1 -- 172.21.15.177:0/1932480256 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd40b0670 con 0x7f5bc00047d0 2023-11-28T20:09:58.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.556+0000 7f5bcaffd640 1 -- 172.21.15.177:0/1932480256 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5bd000d890 con 0x7f5bc00047d0 2023-11-28T20:09:58.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.560+0000 7f5bcaffd640 1 --2- 172.21.15.177:0/1932480256 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5bb8066470 0x7f5bb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.560+0000 7f5bcaffd640 1 -- 172.21.15.177:0/1932480256 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bd0083df0 con 0x7f5bc00047d0 2023-11-28T20:09:58.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.560+0000 7f5bd9993640 1 --2- 172.21.15.177:0/1932480256 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5bb8066470 0x7f5bb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.560+0000 7f5bd9993640 1 --2- 172.21.15.177:0/1932480256 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5bb8066470 0x7f5bb8068930 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40af000 tx=0x7f5bc40046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:58.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.564+0000 7f5bcaffd640 1 -- 172.21.15.177:0/1932480256 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5bd00511e0 con 0x7f5bc00047d0 2023-11-28T20:09:58.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.716+0000 7f5bdc3f8640 1 -- 172.21.15.177:0/1932480256 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5bd40693d0 con 0x7f5bc00047d0 2023-11-28T20:09:58.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.716+0000 7f5bcaffd640 1 -- 172.21.15.177:0/1932480256 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5bd0054800 con 0x7f5bc00047d0 2023-11-28T20:09:58.720 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:09:58.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.716+0000 7f5bdc3f8640 1 -- 172.21.15.177:0/1932480256 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5bb8066470 msgr2=0x7f5bb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.716+0000 7f5bdc3f8640 1 --2- 172.21.15.177:0/1932480256 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5bb8066470 0x7f5bb8068930 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40af000 tx=0x7f5bc40046d0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.716+0000 7f5bdc3f8640 1 -- 172.21.15.177:0/1932480256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bc00047d0 msgr2=0x7f5bd40b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.716+0000 7f5bdc3f8640 1 --2- 172.21.15.177:0/1932480256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bc00047d0 0x7f5bd40b3110 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000f7f0 tx=0x7f5bd000fcb0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.716+0000 7f5bdc3f8640 1 -- 172.21.15.177:0/1932480256 shutdown_connections 2023-11-28T20:09:58.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.716+0000 7f5bdc3f8640 1 --2- 172.21.15.177:0/1932480256 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f5bb8066470 0x7f5bb8068930 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.716+0000 7f5bdc3f8640 1 --2- 172.21.15.177:0/1932480256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bd4157240 0x7f5bd415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.716+0000 7f5bdc3f8640 1 --2- 172.21.15.177:0/1932480256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bd41f2f90 0x7f5bd40b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.716+0000 7f5bdc3f8640 1 --2- 172.21.15.177:0/1932480256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bc00047d0 0x7f5bd40b3110 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.716+0000 7f5bdc3f8640 1 -- 172.21.15.177:0/1932480256 >> 172.21.15.177:0/1932480256 conn(0x7f5bd40b0cc0 msgr2=0x7f5bd4159320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:58.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.716+0000 7f5bdc3f8640 1 -- 172.21.15.177:0/1932480256 shutdown_connections 2023-11-28T20:09:58.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.716+0000 7f5bdc3f8640 1 -- 172.21.15.177:0/1932480256 wait complete. 2023-11-28T20:09:58.740 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:09:58.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f96276dd640 1 Processor -- start 2023-11-28T20:09:58.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f96276dd640 1 -- start start 2023-11-28T20:09:58.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f96276dd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f962014abe0 0x7f9620165a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f96276dd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f962014b1e0 0x7f96200b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f96276dd640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96200b1fc0 con 0x7f96200b4350 2023-11-28T20:09:58.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f96276dd640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96200b47e0 con 0x7f962014b1e0 2023-11-28T20:09:58.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f96276dd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96200b2260 con 0x7f962014abe0 2023-11-28T20:09:58.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f9625c7a640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f96200b4350 0x7f9620161b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45190/0 (socket says 172.21.15.177:45190) 2023-11-28T20:09:58.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f9625c7a640 1 -- 172.21.15.177:0/3642397030 learned_addr learned my addr 172.21.15.177:0/3642397030 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:58.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f9625479640 1 --2- 172.21.15.177:0/3642397030 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f962014abe0 0x7f9620165a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f9624c78640 1 --2- 172.21.15.177:0/3642397030 >> v2:172.21.15.195:3300/0 conn(0x7f962014b1e0 0x7f96200b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f9617fff640 1 -- 172.21.15.177:0/3642397030 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015246856 0 0) 0x7f96200b1fc0 con 0x7f96200b4350 2023-11-28T20:09:58.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f9617fff640 1 -- 172.21.15.177:0/3642397030 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f960c003530 con 0x7f96200b4350 2023-11-28T20:09:58.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f9625479640 1 -- 172.21.15.177:0/3642397030 >> v2:172.21.15.195:3300/0 conn(0x7f962014b1e0 msgr2=0x7f96200b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:58.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f9625479640 1 --2- 172.21.15.177:0/3642397030 >> v2:172.21.15.195:3300/0 conn(0x7f962014b1e0 0x7f96200b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f9625479640 1 -- 172.21.15.177:0/3642397030 >> v1:172.21.15.177:6789/0 conn(0x7f96200b4350 legacy=0x7f9620161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.876+0000 7f9625479640 1 -- 172.21.15.177:0/3642397030 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96200b2540 con 0x7f962014abe0 2023-11-28T20:09:58.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.880+0000 7f9625479640 1 --2- 172.21.15.177:0/3642397030 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f962014abe0 0x7f9620165a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f961c0097c0 tx=0x7f961c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=767a42f8cf9e88c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:58.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.880+0000 7f9617fff640 1 -- 172.21.15.177:0/3642397030 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c0ab650 con 0x7f962014abe0 2023-11-28T20:09:58.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.880+0000 7f9617fff640 1 -- 172.21.15.177:0/3642397030 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961c0ab7b0 con 0x7f962014abe0 2023-11-28T20:09:58.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.880+0000 7f9617fff640 1 -- 172.21.15.177:0/3642397030 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c0abb40 con 0x7f962014abe0 2023-11-28T20:09:58.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.880+0000 7f96276dd640 1 -- 172.21.15.177:0/3642397030 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f962014abe0 msgr2=0x7f9620165a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.880+0000 7f96276dd640 1 --2- 172.21.15.177:0/3642397030 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f962014abe0 0x7f9620165a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f961c0097c0 tx=0x7f961c01c450 comp rx=0 tx=0).stop 2023-11-28T20:09:58.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.880+0000 7f96276dd640 1 -- 172.21.15.177:0/3642397030 shutdown_connections 2023-11-28T20:09:58.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.880+0000 7f96276dd640 1 --2- 172.21.15.177:0/3642397030 >> v2:172.21.15.195:3300/0 conn(0x7f962014b1e0 0x7f96200b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.880+0000 7f96276dd640 1 --2- 172.21.15.177:0/3642397030 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f962014abe0 0x7f9620165a20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.880+0000 7f96276dd640 1 -- 172.21.15.177:0/3642397030 >> 172.21.15.177:0/3642397030 conn(0x7f96200b0cc0 msgr2=0x7f96200b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:58.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.880+0000 7f96276dd640 1 -- 172.21.15.177:0/3642397030 shutdown_connections 2023-11-28T20:09:58.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.880+0000 7f96276dd640 1 -- 172.21.15.177:0/3642397030 wait complete. 2023-11-28T20:09:58.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f96276dd640 1 Processor -- start 2023-11-28T20:09:58.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f96276dd640 1 -- start start 2023-11-28T20:09:58.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f96276dd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96200b4350 0x7f962014a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f96276dd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f962014abe0 0x7f9620160b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f96276dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9620166c80 0x7f9620168780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f96276dd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9620167430 con 0x7f9620166c80 2023-11-28T20:09:58.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f96276dd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9620167710 con 0x7f96200b4350 2023-11-28T20:09:58.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f96276dd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962016a930 con 0x7f962014abe0 2023-11-28T20:09:58.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f9625c7a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9620166c80 0x7f9620168780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f9625c7a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9620166c80 0x7f9620168780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46794/0 (socket says 172.21.15.177:46794) 2023-11-28T20:09:58.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f9625c7a640 1 -- 172.21.15.177:0/270894012 learned_addr learned my addr 172.21.15.177:0/270894012 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:58.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f9625479640 1 --2- 172.21.15.177:0/270894012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96200b4350 0x7f962014a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f9624c78640 1 --2- 172.21.15.177:0/270894012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f962014abe0 0x7f9620160b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f9625c7a640 1 -- 172.21.15.177:0/270894012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f962014abe0 msgr2=0x7f9620160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f9625c7a640 1 --2- 172.21.15.177:0/270894012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f962014abe0 0x7f9620160b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f9625c7a640 1 -- 172.21.15.177:0/270894012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96200b4350 msgr2=0x7f962014a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:58.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f9625c7a640 1 --2- 172.21.15.177:0/270894012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96200b4350 0x7f962014a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:58.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f9625c7a640 1 -- 172.21.15.177:0/270894012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c009420 con 0x7f9620166c80 2023-11-28T20:09:58.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f9624c78640 1 --2- 172.21.15.177:0/270894012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f962014abe0 0x7f9620160b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:09:58.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f9625c7a640 1 --2- 172.21.15.177:0/270894012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9620166c80 0x7f9620168780 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f961800caa0 tx=0x7f961800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:58.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f9615ffb640 1 -- 172.21.15.177:0/270894012 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961800ac00 con 0x7f9620166c80 2023-11-28T20:09:58.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f9615ffb640 1 -- 172.21.15.177:0/270894012 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961800ad60 con 0x7f9620166c80 2023-11-28T20:09:58.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f9615ffb640 1 -- 172.21.15.177:0/270894012 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618012620 con 0x7f9620166c80 2023-11-28T20:09:58.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f96276dd640 1 -- 172.21.15.177:0/270894012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962016ac10 con 0x7f9620166c80 2023-11-28T20:09:58.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.884+0000 7f96276dd640 1 -- 172.21.15.177:0/270894012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96201679f0 con 0x7f9620166c80 2023-11-28T20:09:58.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.888+0000 7f96276dd640 1 -- 172.21.15.177:0/270894012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962016a790 con 0x7f9620166c80 2023-11-28T20:09:58.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.888+0000 7f9615ffb640 1 -- 172.21.15.177:0/270894012 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9618007070 con 0x7f9620166c80 2023-11-28T20:09:58.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.888+0000 7f9615ffb640 1 --2- 172.21.15.177:0/270894012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9604066470 0x7f9604068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:58.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.888+0000 7f9615ffb640 1 -- 172.21.15.177:0/270894012 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9618083dd0 con 0x7f9620166c80 2023-11-28T20:09:58.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.888+0000 7f9625479640 1 --2- 172.21.15.177:0/270894012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9604066470 0x7f9604068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:58.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.888+0000 7f9625479640 1 --2- 172.21.15.177:0/270894012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9604066470 0x7f9604068930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f961c0af000 tx=0x7f961c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:58.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:58.892+0000 7f9615ffb640 1 -- 172.21.15.177:0/270894012 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f962016a790 con 0x7f9620166c80 2023-11-28T20:09:59.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.040+0000 7f96276dd640 1 -- 172.21.15.177:0/270894012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f962016a790 con 0x7f9620166c80 2023-11-28T20:09:59.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.040+0000 7f9615ffb640 1 -- 172.21.15.177:0/270894012 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f962016a790 con 0x7f9620166c80 2023-11-28T20:09:59.046 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:09:59.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.044+0000 7f96276dd640 1 -- 172.21.15.177:0/270894012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9604066470 msgr2=0x7f9604068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:59.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.044+0000 7f96276dd640 1 --2- 172.21.15.177:0/270894012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9604066470 0x7f9604068930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f961c0af000 tx=0x7f961c0a7000 comp rx=0 tx=0).stop 2023-11-28T20:09:59.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.044+0000 7f96276dd640 1 -- 172.21.15.177:0/270894012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9620166c80 msgr2=0x7f9620168780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:59.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.044+0000 7f96276dd640 1 --2- 172.21.15.177:0/270894012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9620166c80 0x7f9620168780 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f961800caa0 tx=0x7f961800cf60 comp rx=0 tx=0).stop 2023-11-28T20:09:59.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.044+0000 7f96276dd640 1 -- 172.21.15.177:0/270894012 shutdown_connections 2023-11-28T20:09:59.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.044+0000 7f96276dd640 1 --2- 172.21.15.177:0/270894012 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9604066470 0x7f9604068930 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.044+0000 7f96276dd640 1 --2- 172.21.15.177:0/270894012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9620166c80 0x7f9620168780 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.044+0000 7f96276dd640 1 --2- 172.21.15.177:0/270894012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f962014abe0 0x7f9620160b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.044+0000 7f96276dd640 1 --2- 172.21.15.177:0/270894012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96200b4350 0x7f962014a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.044+0000 7f96276dd640 1 -- 172.21.15.177:0/270894012 >> 172.21.15.177:0/270894012 conn(0x7f96200b0cc0 msgr2=0x7f9620164360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:59.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.044+0000 7f96276dd640 1 -- 172.21.15.177:0/270894012 shutdown_connections 2023-11-28T20:09:59.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.044+0000 7f96276dd640 1 -- 172.21.15.177:0/270894012 wait complete. 2023-11-28T20:09:59.067 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:09:59.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.200+0000 7f521705f640 1 Processor -- start 2023-11-28T20:09:59.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.200+0000 7f521705f640 1 -- start start 2023-11-28T20:09:59.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.204+0000 7f521705f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f521013cf30 0x7f521006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:59.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.204+0000 7f521705f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f521006c800 0x7f521015a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:59.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.204+0000 7f521705f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521015b3a0 con 0x7f521015ab70 2023-11-28T20:09:59.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.204+0000 7f521705f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521013d310 con 0x7f521013cf30 2023-11-28T20:09:59.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.204+0000 7f521705f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52101404e0 con 0x7f521006c800 2023-11-28T20:09:59.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.204+0000 7f5214dfb640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f521013cf30 0x7f521006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:59.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.204+0000 7f52155fc640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f521015ab70 0x7f5210071570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45194/0 (socket says 172.21.15.177:45194) 2023-11-28T20:09:59.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.204+0000 7f5214dfb640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f521013cf30 0x7f521006c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46808/0 (socket says 172.21.15.177:46808) 2023-11-28T20:09:59.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.204+0000 7f52155fc640 1 -- 172.21.15.177:0/2523217488 learned_addr learned my addr 172.21.15.177:0/2523217488 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:09:59.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.204+0000 7f5207fff640 1 --2- 172.21.15.177:0/2523217488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f521006c800 0x7f521015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:59.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.204+0000 7f5214dfb640 1 -- 172.21.15.177:0/2523217488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f521006c800 msgr2=0x7f521015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:59.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.204+0000 7f5214dfb640 1 --2- 172.21.15.177:0/2523217488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f521006c800 0x7f521015a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.204+0000 7f5214dfb640 1 -- 172.21.15.177:0/2523217488 >> v1:172.21.15.177:6789/0 conn(0x7f521015ab70 legacy=0x7f5210071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:59.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.204+0000 7f5214dfb640 1 -- 172.21.15.177:0/2523217488 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521006cc40 con 0x7f521013cf30 2023-11-28T20:09:59.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.208+0000 7f5214dfb640 1 --2- 172.21.15.177:0/2523217488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521013cf30 0x7f521006c2c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f520c0097f0 tx=0x7f520c01c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708b761e65c37c01 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:59.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.208+0000 7f52077fe640 1 -- 172.21.15.177:0/2523217488 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c0ab600 con 0x7f521013cf30 2023-11-28T20:09:59.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.208+0000 7f52077fe640 1 -- 172.21.15.177:0/2523217488 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c0a7050 con 0x7f521013cf30 2023-11-28T20:09:59.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.208+0000 7f52077fe640 1 -- 172.21.15.177:0/2523217488 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c0ab980 con 0x7f521013cf30 2023-11-28T20:09:59.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.208+0000 7f521705f640 1 -- 172.21.15.177:0/2523217488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521013cf30 msgr2=0x7f521006c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:59.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.208+0000 7f521705f640 1 --2- 172.21.15.177:0/2523217488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521013cf30 0x7f521006c2c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f520c0097f0 tx=0x7f520c01c280 comp rx=0 tx=0).stop 2023-11-28T20:09:59.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.208+0000 7f521705f640 1 -- 172.21.15.177:0/2523217488 shutdown_connections 2023-11-28T20:09:59.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.208+0000 7f521705f640 1 --2- 172.21.15.177:0/2523217488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f521006c800 0x7f521015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.208+0000 7f521705f640 1 --2- 172.21.15.177:0/2523217488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521013cf30 0x7f521006c2c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.208+0000 7f521705f640 1 -- 172.21.15.177:0/2523217488 >> 172.21.15.177:0/2523217488 conn(0x7f521006a530 msgr2=0x7f521006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:59.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.208+0000 7f521705f640 1 -- 172.21.15.177:0/2523217488 shutdown_connections 2023-11-28T20:09:59.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.208+0000 7f521705f640 1 -- 172.21.15.177:0/2523217488 wait complete. 2023-11-28T20:09:59.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.208+0000 7f521705f640 1 Processor -- start 2023-11-28T20:09:59.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.208+0000 7f521705f640 1 -- start start 2023-11-28T20:09:59.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f521705f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f521006c800 0x7f5210157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:59.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f521705f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521013cf30 0x7f52101554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:59.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f521705f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f521015ab70 0x7f52101559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:59.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f521705f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5210159540 con 0x7f521013cf30 2023-11-28T20:09:59.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f521705f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5210158950 con 0x7f521015ab70 2023-11-28T20:09:59.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f521705f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5210158c10 con 0x7f521006c800 2023-11-28T20:09:59.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f5207fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521013cf30 0x7f52101554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:59.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f5207fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521013cf30 0x7f52101554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46812/0 (socket says 172.21.15.177:46812) 2023-11-28T20:09:59.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f5207fff640 1 -- 172.21.15.177:0/1453253384 learned_addr learned my addr 172.21.15.177:0/1453253384 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:59.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f5214dfb640 1 --2- 172.21.15.177:0/1453253384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f521006c800 0x7f5210157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:59.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f52155fc640 1 --2- 172.21.15.177:0/1453253384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f521015ab70 0x7f52101559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:59.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f5207fff640 1 -- 172.21.15.177:0/1453253384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f521006c800 msgr2=0x7f5210157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:59.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f5207fff640 1 --2- 172.21.15.177:0/1453253384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f521006c800 0x7f5210157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f5207fff640 1 -- 172.21.15.177:0/1453253384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f521015ab70 msgr2=0x7f52101559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:59.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f5207fff640 1 --2- 172.21.15.177:0/1453253384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f521015ab70 0x7f52101559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f5207fff640 1 -- 172.21.15.177:0/1453253384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c009420 con 0x7f521013cf30 2023-11-28T20:09:59.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f5207fff640 1 --2- 172.21.15.177:0/1453253384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521013cf30 0x7f52101554b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f520000e870 tx=0x7f520000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:59.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f52057fa640 1 -- 172.21.15.177:0/1453253384 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200009510 con 0x7f521013cf30 2023-11-28T20:09:59.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f52057fa640 1 -- 172.21.15.177:0/1453253384 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520000eec0 con 0x7f521013cf30 2023-11-28T20:09:59.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f52057fa640 1 -- 172.21.15.177:0/1453253384 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520000cb40 con 0x7f521013cf30 2023-11-28T20:09:59.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f521705f640 1 -- 172.21.15.177:0/1453253384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5210158ef0 con 0x7f521013cf30 2023-11-28T20:09:59.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f521705f640 1 -- 172.21.15.177:0/1453253384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52101599d0 con 0x7f521013cf30 2023-11-28T20:09:59.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.212+0000 7f521705f640 1 -- 172.21.15.177:0/1453253384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5210069440 con 0x7f521013cf30 2023-11-28T20:09:59.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.216+0000 7f52057fa640 1 -- 172.21.15.177:0/1453253384 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f520000ccc0 con 0x7f521013cf30 2023-11-28T20:09:59.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.216+0000 7f52057fa640 1 --2- 172.21.15.177:0/1453253384 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f51fc066470 0x7f51fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:59.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.216+0000 7f52057fa640 1 -- 172.21.15.177:0/1453253384 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5200083f50 con 0x7f521013cf30 2023-11-28T20:09:59.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.216+0000 7f5214dfb640 1 --2- 172.21.15.177:0/1453253384 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f51fc066470 0x7f51fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:59.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.216+0000 7f5214dfb640 1 --2- 172.21.15.177:0/1453253384 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f51fc066470 0x7f51fc068930 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f520c0ad000 tx=0x7f520c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:59.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.220+0000 7f52057fa640 1 -- 172.21.15.177:0/1453253384 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52000513e0 con 0x7f521013cf30 2023-11-28T20:09:59.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.384+0000 7f521705f640 1 -- 172.21.15.177:0/1453253384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f52100cec70 con 0x7f521013cf30 2023-11-28T20:09:59.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.384+0000 7f52057fa640 1 -- 172.21.15.177:0/1453253384 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5200054a00 con 0x7f521013cf30 2023-11-28T20:09:59.387 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:09:59.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.384+0000 7f521705f640 1 -- 172.21.15.177:0/1453253384 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f51fc066470 msgr2=0x7f51fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:59.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.384+0000 7f521705f640 1 --2- 172.21.15.177:0/1453253384 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f51fc066470 0x7f51fc068930 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f520c0ad000 tx=0x7f520c008040 comp rx=0 tx=0).stop 2023-11-28T20:09:59.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.384+0000 7f521705f640 1 -- 172.21.15.177:0/1453253384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521013cf30 msgr2=0x7f52101554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:59.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.384+0000 7f521705f640 1 --2- 172.21.15.177:0/1453253384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521013cf30 0x7f52101554b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f520000e870 tx=0x7f520000ec70 comp rx=0 tx=0).stop 2023-11-28T20:09:59.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.384+0000 7f521705f640 1 -- 172.21.15.177:0/1453253384 shutdown_connections 2023-11-28T20:09:59.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.384+0000 7f521705f640 1 --2- 172.21.15.177:0/1453253384 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f51fc066470 0x7f51fc068930 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.384+0000 7f521705f640 1 --2- 172.21.15.177:0/1453253384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f521015ab70 0x7f52101559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.384+0000 7f521705f640 1 --2- 172.21.15.177:0/1453253384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521013cf30 0x7f52101554b0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.384+0000 7f521705f640 1 --2- 172.21.15.177:0/1453253384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f521006c800 0x7f5210157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.384+0000 7f521705f640 1 -- 172.21.15.177:0/1453253384 >> 172.21.15.177:0/1453253384 conn(0x7f521006a530 msgr2=0x7f52100cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:59.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.384+0000 7f521705f640 1 -- 172.21.15.177:0/1453253384 shutdown_connections 2023-11-28T20:09:59.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.384+0000 7f521705f640 1 -- 172.21.15.177:0/1453253384 wait complete. 2023-11-28T20:09:59.408 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-11-28T20:09:59.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:59.408 DEBUG:teuthology.orchestra.run.smithi177:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:59.428 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[51829]: fuse finished with error 0 and tester_r 0 2023-11-28T20:09:59.431 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:09:59.463 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:09:59.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:59.463 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T20:09:59.518 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:09:59.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.696+0000 7f9667879640 1 Processor -- start 2023-11-28T20:09:59.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9667879640 1 -- start start 2023-11-28T20:09:59.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9667879640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96600b51e0 0x7f96600b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:59.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9667879640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f966015d490 0x7f96600b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:59.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9667879640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f96600d14c0 0x7f96600d1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:59.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9667879640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96600d30e0 con 0x7f96600d14c0 2023-11-28T20:09:59.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9667879640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96600b5b00 con 0x7f966015d490 2023-11-28T20:09:59.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9667879640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96600d21f0 con 0x7f96600b51e0 2023-11-28T20:09:59.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9665e16640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f96600d14c0 0x7f96600d1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:59.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9665e16640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f96600d14c0 0x7f96600d1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46814/0 (socket says 172.21.15.177:46814) 2023-11-28T20:09:59.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9665e16640 1 -- 172.21.15.177:0/269025169 learned_addr learned my addr 172.21.15.177:0/269025169 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:59.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9665615640 1 --2- 172.21.15.177:0/269025169 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96600b51e0 0x7f96600b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:59.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9665e16640 1 -- 172.21.15.177:0/269025169 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96600b51e0 msgr2=0x7f96600b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:59.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9664e14640 1 --2- 172.21.15.177:0/269025169 >> v2:172.21.15.195:3300/0 conn(0x7f966015d490 0x7f96600b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:59.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9665e16640 1 --2- 172.21.15.177:0/269025169 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96600b51e0 0x7f96600b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9665e16640 1 -- 172.21.15.177:0/269025169 >> v2:172.21.15.195:3300/0 conn(0x7f966015d490 msgr2=0x7f96600b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:09:59.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9665e16640 1 --2- 172.21.15.177:0/269025169 >> v2:172.21.15.195:3300/0 conn(0x7f966015d490 0x7f96600b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9665e16640 1 -- 172.21.15.177:0/269025169 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96600d2740 con 0x7f96600d14c0 2023-11-28T20:09:59.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.700+0000 7f9665615640 1 --2- 172.21.15.177:0/269025169 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96600b51e0 0x7f96600b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:59.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.704+0000 7f9665e16640 1 --2- 172.21.15.177:0/269025169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96600d14c0 0x7f96600d1950 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f966006c5d0 tx=0x7f965801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d518a6713650616 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:59.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.704+0000 7f9657fff640 1 -- 172.21.15.177:0/269025169 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96580a5820 con 0x7f96600d14c0 2023-11-28T20:09:59.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.704+0000 7f9657fff640 1 -- 172.21.15.177:0/269025169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96580a5980 con 0x7f96600d14c0 2023-11-28T20:09:59.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.704+0000 7f9657fff640 1 -- 172.21.15.177:0/269025169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96580a5d10 con 0x7f96600d14c0 2023-11-28T20:09:59.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.704+0000 7f9667879640 1 -- 172.21.15.177:0/269025169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96600d14c0 msgr2=0x7f96600d1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:59.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.704+0000 7f9667879640 1 --2- 172.21.15.177:0/269025169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96600d14c0 0x7f96600d1950 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f966006c5d0 tx=0x7f965801c9a0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.704+0000 7f9667879640 1 -- 172.21.15.177:0/269025169 shutdown_connections 2023-11-28T20:09:59.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.704+0000 7f9667879640 1 --2- 172.21.15.177:0/269025169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96600d14c0 0x7f96600d1950 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.704+0000 7f9667879640 1 --2- 172.21.15.177:0/269025169 >> v2:172.21.15.195:3300/0 conn(0x7f966015d490 0x7f96600b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.704+0000 7f9667879640 1 --2- 172.21.15.177:0/269025169 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96600b51e0 0x7f96600b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.704+0000 7f9667879640 1 -- 172.21.15.177:0/269025169 >> 172.21.15.177:0/269025169 conn(0x7f9660072060 msgr2=0x7f9660072470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:59.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.704+0000 7f9667879640 1 -- 172.21.15.177:0/269025169 shutdown_connections 2023-11-28T20:09:59.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.704+0000 7f9667879640 1 -- 172.21.15.177:0/269025169 wait complete. 2023-11-28T20:09:59.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.704+0000 7f9667879640 1 Processor -- start 2023-11-28T20:09:59.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9667879640 1 -- start start 2023-11-28T20:09:59.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9667879640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96600b51e0 0x7f9660157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:59.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9667879640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96600d14c0 0x7f96600c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:59.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9667879640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f966015d490 0x7f96600c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:59.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9667879640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966015b7e0 con 0x7f96600b51e0 2023-11-28T20:09:59.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9667879640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9660159800 con 0x7f966015d490 2023-11-28T20:09:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9667879640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966015b500 con 0x7f96600d14c0 2023-11-28T20:09:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9665615640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96600b51e0 0x7f9660157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9665615640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96600b51e0 0x7f9660157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46828/0 (socket says 172.21.15.177:46828) 2023-11-28T20:09:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9665615640 1 -- 172.21.15.177:0/1980718143 learned_addr learned my addr 172.21.15.177:0/1980718143 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:09:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9665615640 1 -- 172.21.15.177:0/1980718143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96600d14c0 msgr2=0x7f96600c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9665e16640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f966015d490 0x7f96600c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9664e14640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96600d14c0 0x7f96600c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9665615640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96600d14c0 0x7f96600c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9665615640 1 -- 172.21.15.177:0/1980718143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f966015d490 msgr2=0x7f96600c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9665615640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f966015d490 0x7f96600c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9665615640 1 -- 172.21.15.177:0/1980718143 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9658009b30 con 0x7f96600b51e0 2023-11-28T20:09:59.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9665e16640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f966015d490 0x7f96600c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:59.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9664e14640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96600d14c0 0x7f96600c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:09:59.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9665615640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96600b51e0 0x7f9660157980 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f965c00c7c0 tx=0x7f965c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:59.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9655ffb640 1 -- 172.21.15.177:0/1980718143 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c007a30 con 0x7f96600b51e0 2023-11-28T20:09:59.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9655ffb640 1 -- 172.21.15.177:0/1980718143 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c007b90 con 0x7f96600b51e0 2023-11-28T20:09:59.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9655ffb640 1 -- 172.21.15.177:0/1980718143 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c00ce70 con 0x7f96600b51e0 2023-11-28T20:09:59.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9667879640 1 -- 172.21.15.177:0/1980718143 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96600cae80 con 0x7f96600b51e0 2023-11-28T20:09:59.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9667879640 1 -- 172.21.15.177:0/1980718143 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96600b3490 con 0x7f96600b51e0 2023-11-28T20:09:59.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.708+0000 7f9667879640 1 -- 172.21.15.177:0/1980718143 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96600cace0 con 0x7f96600b51e0 2023-11-28T20:09:59.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.712+0000 7f9655ffb640 1 -- 172.21.15.177:0/1980718143 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f965c0113f0 con 0x7f96600b51e0 2023-11-28T20:09:59.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.712+0000 7f9655ffb640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9644066470 0x7f9644068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:09:59.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.712+0000 7f9655ffb640 1 -- 172.21.15.177:0/1980718143 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f965c083fd0 con 0x7f96600b51e0 2023-11-28T20:09:59.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.712+0000 7f9664e14640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9644066470 0x7f9644068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:09:59.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.712+0000 7f9664e14640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9644066470 0x7f9644068930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9650006fd0 tx=0x7f9650008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:09:59.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.716+0000 7f9655ffb640 1 -- 172.21.15.177:0/1980718143 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f96600cace0 con 0x7f96600b51e0 2023-11-28T20:09:59.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.900+0000 7f9667879640 1 -- 172.21.15.177:0/1980718143 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f96600cace0 con 0x7f96600b51e0 2023-11-28T20:09:59.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.900+0000 7f9655ffb640 1 -- 172.21.15.177:0/1980718143 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f96600cace0 con 0x7f96600b51e0 2023-11-28T20:09:59.903 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:09:59.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.900+0000 7f9667879640 1 -- 172.21.15.177:0/1980718143 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9644066470 msgr2=0x7f9644068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:59.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.900+0000 7f9667879640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9644066470 0x7f9644068930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9650006fd0 tx=0x7f9650008040 comp rx=0 tx=0).stop 2023-11-28T20:09:59.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.900+0000 7f9667879640 1 -- 172.21.15.177:0/1980718143 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96600b51e0 msgr2=0x7f9660157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:09:59.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.900+0000 7f9667879640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96600b51e0 0x7f9660157980 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f965c00c7c0 tx=0x7f965c00cc80 comp rx=0 tx=0).stop 2023-11-28T20:09:59.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.900+0000 7f9667879640 1 -- 172.21.15.177:0/1980718143 shutdown_connections 2023-11-28T20:09:59.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.900+0000 7f9667879640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9644066470 0x7f9644068930 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.900+0000 7f9667879640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f966015d490 0x7f96600c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.900+0000 7f9667879640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96600d14c0 0x7f96600c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.900+0000 7f9667879640 1 --2- 172.21.15.177:0/1980718143 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96600b51e0 0x7f9660157980 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:09:59.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.900+0000 7f9667879640 1 -- 172.21.15.177:0/1980718143 >> 172.21.15.177:0/1980718143 conn(0x7f9660072060 msgr2=0x7f96600b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:09:59.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.900+0000 7f9667879640 1 -- 172.21.15.177:0/1980718143 shutdown_connections 2023-11-28T20:09:59.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:09:59.900+0000 7f9667879640 1 -- 172.21.15.177:0/1980718143 wait complete. 2023-11-28T20:09:59.924 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T20:09:59.924 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:09:59.924 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-11-28T20:09:59.924 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T20:09:59.925 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:09:59.925 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T20:09:59.925 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T20:09:59.925 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:09:59.925 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:09:59.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:59.925 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-11-28T20:09:59.935 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:09:59.936 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:09:59.936 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:09:59.936 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:59.936 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-11-28T20:09:59.936 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:59.936 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:09:59.936 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:59.936 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-11-28T20:09:59.936 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:09:59.937 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:59.937 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-11-28T20:09:59.937 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:09:59.937 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:59.937 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:09:59.937 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:59.937 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:09:59.937 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42274sec preferred_lft 42274sec 2023-11-28T20:09:59.937 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-11-28T20:09:59.937 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:59.937 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:09:59.937 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:91:19:71:65 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:59.938 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:09:59.938 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:59.938 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:09:59.938 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:09:59.938 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:09:59.938 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:59.938 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:09:59.938 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:59.938 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:09:59.938 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:09:59.939 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:09:59.939 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:59.939 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:09:59.939 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:09:59.939 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-28T20:09:59.939 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:09:59.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:59.939 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:09:59.996 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-11-28T20:09:59.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:09:59.998 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-11-28T20:10:00.052 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-11-28T20:10:00.053 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:10:00.053 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:10:00.053 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:10:00.053 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:10:00.053 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:10:00.053 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:10:00.053 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:10:00.053 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:10:00.053 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:10:00.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:00.054 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-28T20:10:00.054 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-28T20:10:00.054 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:10:00.054 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:10:00.054 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:10:00.054 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-28T20:10:00.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:00.148 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-11-28T20:10:00.158 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T20:10:00.158 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T20:10:00.158 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:10:00.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:00.159 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-11-28T20:10:00.222 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T20:10:00.222 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:10:00.222 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T20:10:00.274 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:10:00.275 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:10:00.275 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:10:00.326 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:10:00.390 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:10:00.444 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:10:00.444 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:10:00.444 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:10:00.444 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:10:00.444 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:10:00.444 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:10:00.444 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:10:00.444 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:10:00.444 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:10:00.445 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:10:00.445 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:10:00.445 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:10:00.445 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:10:00.445 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:10:00.445 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:10:00.445 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:10:00.445 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:10:00.445 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:10:00.445 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:10:00.445 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:10:00.445 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:10:00.446 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:10:00.446 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:10:00.446 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:10:00.446 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:10:00.446 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:10:00.446 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:10:00.446 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:10:00.446 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:10:00.446 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:10:00.446 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:10:00.446 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:10:00.447 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:10:00.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:00.448 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:10:00.498 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T20:10:00.499 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T20:10:00.545 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:10:00.567 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:10:00.621 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:10:00.621 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:10:00.621 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:10:00.621 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:10:00.621 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:10:00.621 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:10:00.622 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:10:00.622 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:10:00.622 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:10:00.622 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:10:00.622 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:10:00.622 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:10:00.622 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:10:00.622 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:10:00.622 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:10:00.622 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:10:00.622 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:10:00.622 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:10:00.623 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:10:00.623 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:10:00.623 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:10:00.623 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:10:00.623 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:10:00.623 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:10:00.623 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:10:00.623 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:10:00.623 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:10:00.623 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:10:00.623 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:10:00.623 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:10:00.624 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:10:00.624 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:10:00.624 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:10:00.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:00.625 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:10:00.641 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-11-28T20:10:00.636+0000 7fbfe5448580 -1 init, newargv = 0x5597584a2420 newargc=15 2023-11-28T20:10:00.642 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[52227]: starting ceph client 2023-11-28T20:10:00.648 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[52227]: starting fuse 2023-11-28T20:10:00.652 INFO:teuthology.orchestra.run.smithi177.stdout:43 2023-11-28T20:10:00.652 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T20:10:00.652 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-11-28T20:10:00.652 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-11-28T20:10:00.652 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-11-28T20:10:00.652 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-11-28T20:10:00.652 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-11-28T20:10:00.653 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:10:00.653 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-11-28T20:10:00.653 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T20:10:00.653 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-11-28T20:10:00.653 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T20:10:00.653 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:10:00.653 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-11-28T20:10:00.653 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-11-28T20:10:00.653 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-11-28T20:10:00.653 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-11-28T20:10:00.653 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:10:00.653 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-11-28T20:10:00.654 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T20:10:00.654 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T20:10:00.654 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T20:10:00.654 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-11-28T20:10:00.654 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-11-28T20:10:00.654 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-11-28T20:10:00.655 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T20:10:00.655 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:10:00.655 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-11-28T20:10:00.655 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-11-28T20:10:00.778 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.52227.asok 2023-11-28T20:10:00.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T20:10:00.790 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52227.asok 2023-11-28T20:10:00.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:00.790 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52227.asok status 2023-11-28T20:10:00.961 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:10:00.961 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-11-28T20:10:00.961 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T20:10:00.961 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T20:10:00.962 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-11-28T20:10:00.962 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-11-28T20:10:00.962 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T20:10:00.962 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "52227", 2023-11-28T20:10:00.962 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-11-28T20:10:00.962 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:10:00.962 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-11-28T20:10:00.962 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-11-28T20:10:00.962 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 6177, 2023-11-28T20:10:00.962 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-11-28T20:10:00.962 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-11-28T20:10:00.962 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-11-28T20:10:00.963 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 6177 2023-11-28T20:10:00.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:10:00.963 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:10:00.963 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:10:00.963 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:10:00.963 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 2683074185 2023-11-28T20:10:00.963 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:10:00.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:10:00.963 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:10:00.963 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:10:00.963 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:10:00.963 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 2683074185 2023-11-28T20:10:00.964 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:10:00.964 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.6177 192.168.0.1:0/2683074185", 2023-11-28T20:10:00.964 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/2683074185", 2023-11-28T20:10:00.964 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-11-28T20:10:00.964 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 26, 2023-11-28T20:10:00.964 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 49, 2023-11-28T20:10:00.964 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-11-28T20:10:00.964 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-11-28T20:10:00.964 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-11-28T20:10:00.964 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:10:00.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:00.978 DEBUG:teuthology.orchestra.run.smithi177:> stat --file-system '--printf=%T 2023-11-28T20:10:00.978 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T20:10:00.987 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-11-28T20:10:00.988 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T20:10:00.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:00.988 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:10:01.050 DEBUG:teuthology.orchestra.run.smithi177:> stdin-killer -- python3 -c ' 2023-11-28T20:10:01.050 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-11-28T20:10:01.050 DEBUG:teuthology.orchestra.run.smithi177:> import errno 2023-11-28T20:10:01.050 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:10:01.050 DEBUG:teuthology.orchestra.run.smithi177:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-11-28T20:10:01.050 DEBUG:teuthology.orchestra.run.smithi177:> try: 2023-11-28T20:10:01.050 DEBUG:teuthology.orchestra.run.smithi177:> if False: 2023-11-28T20:10:01.050 DEBUG:teuthology.orchestra.run.smithi177:> ret = os.read(fd, 1024) 2023-11-28T20:10:01.051 DEBUG:teuthology.orchestra.run.smithi177:> else: 2023-11-28T20:10:01.051 DEBUG:teuthology.orchestra.run.smithi177:> os.write(fd, b'"'"'content'"'"') 2023-11-28T20:10:01.051 DEBUG:teuthology.orchestra.run.smithi177:> except OSError as e: 2023-11-28T20:10:01.051 DEBUG:teuthology.orchestra.run.smithi177:> if e.errno != errno.EPERM: 2023-11-28T20:10:01.051 DEBUG:teuthology.orchestra.run.smithi177:> raise 2023-11-28T20:10:01.051 DEBUG:teuthology.orchestra.run.smithi177:> else: 2023-11-28T20:10:01.051 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("client does not check permission of data pool") 2023-11-28T20:10:01.051 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-11-28T20:10:01.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T20:10:01.176 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=cephfs_data' 2023-11-28T20:10:01.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f077b3aa640 1 Processor -- start 2023-11-28T20:10:01.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f077b3aa640 1 -- start start 2023-11-28T20:10:01.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f077b3aa640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f077414b250 0x7f07740b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:01.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f077b3aa640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f07740b4140 0x7f0774070e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:01.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f077b3aa640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0774071820 con 0x7f07740713d0 2023-11-28T20:10:01.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f077b3aa640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07740ccfd0 con 0x7f07740b4140 2023-11-28T20:10:01.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f077b3aa640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07740b45f0 con 0x7f077414b250 2023-11-28T20:10:01.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f0778945640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f07740b4140 0x7f0774070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:01.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f0779947640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f07740713d0 0x7f07740b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45202/0 (socket says 172.21.15.177:45202) 2023-11-28T20:10:01.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f0778945640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f07740b4140 0x7f0774070e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46834/0 (socket says 172.21.15.177:46834) 2023-11-28T20:10:01.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f0779947640 1 -- 172.21.15.177:0/3117663082 learned_addr learned my addr 172.21.15.177:0/3117663082 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:01.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f0779146640 1 --2- 172.21.15.177:0/3117663082 >> v2:172.21.15.195:3300/0 conn(0x7f077414b250 0x7f07740b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:01.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f0778945640 1 -- 172.21.15.177:0/3117663082 >> v2:172.21.15.195:3300/0 conn(0x7f077414b250 msgr2=0x7f07740b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:01.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f0778945640 1 --2- 172.21.15.177:0/3117663082 >> v2:172.21.15.195:3300/0 conn(0x7f077414b250 0x7f07740b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f0778945640 1 -- 172.21.15.177:0/3117663082 >> v1:172.21.15.177:6789/0 conn(0x7f07740713d0 legacy=0x7f07740b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:01.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f0778945640 1 -- 172.21.15.177:0/3117663082 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07740b4a60 con 0x7f07740b4140 2023-11-28T20:10:01.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.360+0000 7f076bfff640 1 -- 172.21.15.177:0/3117663082 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719575764 0 0) 0x7f0774071820 con 0x7f07740713d0 2023-11-28T20:10:01.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.364+0000 7f0778945640 1 --2- 172.21.15.177:0/3117663082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07740b4140 0x7f0774070e90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f07740b5280 tx=0x7f076401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d16ed346404373b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:01.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.364+0000 7f076bfff640 1 -- 172.21.15.177:0/3117663082 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640ac600 con 0x7f07740b4140 2023-11-28T20:10:01.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.364+0000 7f076bfff640 1 -- 172.21.15.177:0/3117663082 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07640a8050 con 0x7f07740b4140 2023-11-28T20:10:01.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.364+0000 7f076bfff640 1 -- 172.21.15.177:0/3117663082 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640ac980 con 0x7f07740b4140 2023-11-28T20:10:01.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.364+0000 7f077b3aa640 1 -- 172.21.15.177:0/3117663082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07740b4140 msgr2=0x7f0774070e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:01.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.364+0000 7f077b3aa640 1 --2- 172.21.15.177:0/3117663082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07740b4140 0x7f0774070e90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f07740b5280 tx=0x7f076401c3a0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.364+0000 7f077b3aa640 1 -- 172.21.15.177:0/3117663082 shutdown_connections 2023-11-28T20:10:01.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.364+0000 7f077b3aa640 1 --2- 172.21.15.177:0/3117663082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07740b4140 0x7f0774070e90 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.364+0000 7f077b3aa640 1 --2- 172.21.15.177:0/3117663082 >> v2:172.21.15.195:3300/0 conn(0x7f077414b250 0x7f07740b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.364+0000 7f077b3aa640 1 -- 172.21.15.177:0/3117663082 >> 172.21.15.177:0/3117663082 conn(0x7f07740b0cc0 msgr2=0x7f07740b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:01.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.364+0000 7f077b3aa640 1 -- 172.21.15.177:0/3117663082 shutdown_connections 2023-11-28T20:10:01.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.364+0000 7f077b3aa640 1 -- 172.21.15.177:0/3117663082 wait complete. 2023-11-28T20:10:01.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f077b3aa640 1 Processor -- start 2023-11-28T20:10:01.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f077b3aa640 1 -- start start 2023-11-28T20:10:01.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f077b3aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07740713d0 0x7f0774131990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:01.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f077b3aa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07740b4140 0x7f0774131ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:01.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f077b3aa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f077414b250 0x7f0774160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:01.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f077b3aa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07740a98c0 con 0x7f077414b250 2023-11-28T20:10:01.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f077b3aa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07740a9300 con 0x7f07740b4140 2023-11-28T20:10:01.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f077b3aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07740a95e0 con 0x7f07740713d0 2023-11-28T20:10:01.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0779947640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f077414b250 0x7f0774160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:01.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0779947640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f077414b250 0x7f0774160910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46850/0 (socket says 172.21.15.177:46850) 2023-11-28T20:10:01.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0779947640 1 -- 172.21.15.177:0/3971662941 learned_addr learned my addr 172.21.15.177:0/3971662941 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:01.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0778945640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07740b4140 0x7f0774131ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:01.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0779146640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07740713d0 0x7f0774131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:01.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0779947640 1 -- 172.21.15.177:0/3971662941 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07740713d0 msgr2=0x7f0774131990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:01.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0779947640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07740713d0 0x7f0774131990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0779947640 1 -- 172.21.15.177:0/3971662941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07740b4140 msgr2=0x7f0774131ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:01.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0779947640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07740b4140 0x7f0774131ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0779947640 1 -- 172.21.15.177:0/3971662941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764009420 con 0x7f077414b250 2023-11-28T20:10:01.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0778945640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07740b4140 0x7f0774131ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:01.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0779146640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07740713d0 0x7f0774131990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:01.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0779947640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f077414b250 0x7f0774160910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f076c001570 tx=0x7f076c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:01.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0769ffb640 1 -- 172.21.15.177:0/3971662941 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c00a640 con 0x7f077414b250 2023-11-28T20:10:01.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0769ffb640 1 -- 172.21.15.177:0/3971662941 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c00a7c0 con 0x7f077414b250 2023-11-28T20:10:01.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f0769ffb640 1 -- 172.21.15.177:0/3971662941 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c00ab70 con 0x7f077414b250 2023-11-28T20:10:01.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f077b3aa640 1 -- 172.21.15.177:0/3971662941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077412f840 con 0x7f077414b250 2023-11-28T20:10:01.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.368+0000 7f077b3aa640 1 -- 172.21.15.177:0/3971662941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0774144f80 con 0x7f077414b250 2023-11-28T20:10:01.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.372+0000 7f077b3aa640 1 -- 172.21.15.177:0/3971662941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077412f6a0 con 0x7f077414b250 2023-11-28T20:10:01.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.372+0000 7f0769ffb640 1 -- 172.21.15.177:0/3971662941 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f076c00acd0 con 0x7f077414b250 2023-11-28T20:10:01.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.372+0000 7f0769ffb640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0758066470 0x7f0758068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:01.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.372+0000 7f0769ffb640 1 -- 172.21.15.177:0/3971662941 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f076c0834f0 con 0x7f077414b250 2023-11-28T20:10:01.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.372+0000 7f0779146640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0758066470 0x7f0758068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:01.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.372+0000 7f0779146640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0758066470 0x7f0758068930 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f07740b1450 tx=0x7f0770008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:01.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.376+0000 7f0769ffb640 1 -- 172.21.15.177:0/3971662941 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f077412f6a0 con 0x7f077414b250 2023-11-28T20:10:01.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.580+0000 7f077b3aa640 1 -- 172.21.15.177:0/3971662941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]} v 0) v1 -- 0x7f077412f6a0 con 0x7f077414b250 2023-11-28T20:10:01.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.584+0000 7f0769ffb640 1 -- 172.21.15.177:0/3971662941 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]}]=0 updated caps for client.0 v21) v1 ==== 183+0+140 (secure 0 0 0) 0x7f077412f6a0 con 0x7f077414b250 2023-11-28T20:10:01.588 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-11-28T20:10:01.588 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZl+2t5KxAAc/J7x+fjSQR4IkIQJ/X8sw== 2023-11-28T20:10:01.588 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-11-28T20:10:01.588 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-11-28T20:10:01.588 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow w pool=cephfs_data" 2023-11-28T20:10:01.589 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-11-28T20:10:01.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.584+0000 7f077b3aa640 1 -- 172.21.15.177:0/3971662941 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0758066470 msgr2=0x7f0758068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:01.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.584+0000 7f077b3aa640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0758066470 0x7f0758068930 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f07740b1450 tx=0x7f0770008040 comp rx=0 tx=0).stop 2023-11-28T20:10:01.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.584+0000 7f077b3aa640 1 -- 172.21.15.177:0/3971662941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f077414b250 msgr2=0x7f0774160910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:01.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.584+0000 7f077b3aa640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f077414b250 0x7f0774160910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f076c001570 tx=0x7f076c00cca0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.584+0000 7f077b3aa640 1 -- 172.21.15.177:0/3971662941 shutdown_connections 2023-11-28T20:10:01.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.584+0000 7f077b3aa640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0758066470 0x7f0758068930 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.584+0000 7f077b3aa640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f077414b250 0x7f0774160910 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.584+0000 7f077b3aa640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07740b4140 0x7f0774131ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.584+0000 7f077b3aa640 1 --2- 172.21.15.177:0/3971662941 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07740713d0 0x7f0774131990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.584+0000 7f077b3aa640 1 -- 172.21.15.177:0/3971662941 >> 172.21.15.177:0/3971662941 conn(0x7f07740b0cc0 msgr2=0x7f07741462a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:01.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.588+0000 7f077b3aa640 1 -- 172.21.15.177:0/3971662941 shutdown_connections 2023-11-28T20:10:01.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.588+0000 7f077b3aa640 1 -- 172.21.15.177:0/3971662941 wait complete. 2023-11-28T20:10:01.609 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:10:01.609 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:10:01.619 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:10:01.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.792+0000 7f7459032640 1 Processor -- start 2023-11-28T20:10:01.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.792+0000 7f7459032640 1 -- start start 2023-11-28T20:10:01.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f7459032640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f745406c9d0 0x7f7454070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:01.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f7459032640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74540710e0 con 0x7f7454072180 2023-11-28T20:10:01.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f7459032640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74540713c0 con 0x7f7454144840 2023-11-28T20:10:01.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f7459032640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745415f010 con 0x7f745406c9d0 2023-11-28T20:10:01.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745359e640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f7454072180 0x7f745415b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45208/0 (socket says 172.21.15.177:45208) 2023-11-28T20:10:01.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745359e640 1 -- 172.21.15.177:0/423981565 learned_addr learned my addr 172.21.15.177:0/423981565 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:01.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f744bfff640 1 --2- 172.21.15.177:0/423981565 >> v2:172.21.15.195:3300/0 conn(0x7f745406c9d0 0x7f7454070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:01.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067146753 0 0) 0x7f74540710e0 con 0x7f7454072180 2023-11-28T20:10:01.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7440003530 con 0x7f7454072180 2023-11-28T20:10:01.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049109664 0 0) 0x7f74540713c0 con 0x7f7454144840 2023-11-28T20:10:01.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74540710e0 con 0x7f7454144840 2023-11-28T20:10:01.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2572112274 0 0) 0x7f7440003530 con 0x7f7454072180 2023-11-28T20:10:01.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 >> v2:172.21.15.195:3300/0 conn(0x7f745406c9d0 msgr2=0x7f7454070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:01.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 --2- 172.21.15.177:0/423981565 >> v2:172.21.15.195:3300/0 conn(0x7f745406c9d0 0x7f7454070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 >> v1:172.21.15.195:6789/0 conn(0x7f7454144840 legacy=0x7f745406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:01.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74540716a0 con 0x7f7454072180 2023-11-28T20:10:01.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f744c001a00 con 0x7f7454072180 2023-11-28T20:10:01.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f744bfff640 1 --2- 172.21.15.177:0/423981565 >> v2:172.21.15.195:3300/0 conn(0x7f745406c9d0 0x7f7454070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:10:01.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 >> v1:172.21.15.177:6789/0 conn(0x7f7454072180 legacy=0x7f745415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:01.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 --2- 172.21.15.177:0/423981565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7440003b60 0x7f7440003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:01.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 --2- 172.21.15.177:0/423981565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74400047d0 0x7f7440004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:01.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 --2- 172.21.15.177:0/423981565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7440005190 0x7f744000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:01.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744000c060 con 0x7f7440003b60 2023-11-28T20:10:01.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744000c1a0 con 0x7f74400047d0 2023-11-28T20:10:01.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744000c360 con 0x7f7440005190 2023-11-28T20:10:01.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f7452d9d640 1 --2- 172.21.15.177:0/423981565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7440003b60 0x7f7440003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:01.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745359e640 1 --2- 172.21.15.177:0/423981565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7440005190 0x7f744000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:01.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f744bfff640 1 --2- 172.21.15.177:0/423981565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74400047d0 0x7f7440004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:01.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f7452d9d640 1 -- 172.21.15.177:0/423981565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7440005190 msgr2=0x7f744000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:01.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f7452d9d640 1 --2- 172.21.15.177:0/423981565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7440005190 0x7f744000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f7452d9d640 1 -- 172.21.15.177:0/423981565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74400047d0 msgr2=0x7f7440004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:01.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f7452d9d640 1 --2- 172.21.15.177:0/423981565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74400047d0 0x7f7440004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f7452d9d640 1 -- 172.21.15.177:0/423981565 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7440003530 con 0x7f7440003b60 2023-11-28T20:10:01.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.796+0000 7f745359e640 1 -- 172.21.15.177:0/423981565 reap_dead start 2023-11-28T20:10:01.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.800+0000 7f7452d9d640 1 --2- 172.21.15.177:0/423981565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7440003b60 0x7f7440003f60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f74440018d0 tx=0x7f744401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1790af71d9d49d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:01.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.800+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74440050d0 con 0x7f7440003b60 2023-11-28T20:10:01.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.800+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7444005250 con 0x7f7440003b60 2023-11-28T20:10:01.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.800+0000 7f745259c640 1 -- 172.21.15.177:0/423981565 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444003600 con 0x7f7440003b60 2023-11-28T20:10:01.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.800+0000 7f7459032640 1 -- 172.21.15.177:0/423981565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7440003b60 msgr2=0x7f7440003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:01.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.800+0000 7f7459032640 1 --2- 172.21.15.177:0/423981565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7440003b60 0x7f7440003f60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f74440018d0 tx=0x7f744401c4d0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.800+0000 7f7459032640 1 -- 172.21.15.177:0/423981565 shutdown_connections 2023-11-28T20:10:01.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.800+0000 7f7459032640 1 --2- 172.21.15.177:0/423981565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7440003b60 0x7f7440003f60 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.800+0000 7f7459032640 1 -- 172.21.15.177:0/423981565 >> 172.21.15.177:0/423981565 conn(0x7f745406a530 msgr2=0x7f745406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:01.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.800+0000 7f7459032640 1 -- 172.21.15.177:0/423981565 shutdown_connections 2023-11-28T20:10:01.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.800+0000 7f7459032640 1 -- 172.21.15.177:0/423981565 wait complete. 2023-11-28T20:10:01.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f7459032640 1 Processor -- start 2023-11-28T20:10:01.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f7459032640 1 -- start start 2023-11-28T20:10:01.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f7459032640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7440003b60 0x7f7454141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:01.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f7459032640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74540c5be0 0x7f74541f92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:01.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f7459032640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74541f64d0 0x7f74540ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:01.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f7459032640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74541f5cf0 con 0x7f74541f64d0 2023-11-28T20:10:01.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f7459032640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74541f9820 con 0x7f74540c5be0 2023-11-28T20:10:01.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f7459032640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74541f9af0 con 0x7f7440003b60 2023-11-28T20:10:01.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f745359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74541f64d0 0x7f74540ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:01.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f745359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74541f64d0 0x7f74540ad890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46874/0 (socket says 172.21.15.177:46874) 2023-11-28T20:10:01.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f745359e640 1 -- 172.21.15.177:0/2799959877 learned_addr learned my addr 172.21.15.177:0/2799959877 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:01.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f7452d9d640 1 --2- 172.21.15.177:0/2799959877 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7440003b60 0x7f7454141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:01.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f744bfff640 1 --2- 172.21.15.177:0/2799959877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74540c5be0 0x7f74541f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:01.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f745359e640 1 -- 172.21.15.177:0/2799959877 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7440003b60 msgr2=0x7f7454141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:01.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f745359e640 1 --2- 172.21.15.177:0/2799959877 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7440003b60 0x7f7454141840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f745359e640 1 -- 172.21.15.177:0/2799959877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74540c5be0 msgr2=0x7f74541f92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:01.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f745359e640 1 --2- 172.21.15.177:0/2799959877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74540c5be0 0x7f74541f92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f745359e640 1 -- 172.21.15.177:0/2799959877 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74541f9dd0 con 0x7f74541f64d0 2023-11-28T20:10:01.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f745359e640 1 --2- 172.21.15.177:0/2799959877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74541f64d0 0x7f74540ad890 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f74540b2070 tx=0x7f744c007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:01.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f744b7fe640 1 -- 172.21.15.177:0/2799959877 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c00aaf0 con 0x7f74541f64d0 2023-11-28T20:10:01.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f744b7fe640 1 -- 172.21.15.177:0/2799959877 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c00ac50 con 0x7f74541f64d0 2023-11-28T20:10:01.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f744b7fe640 1 -- 172.21.15.177:0/2799959877 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0133f0 con 0x7f74541f64d0 2023-11-28T20:10:01.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f7459032640 1 -- 172.21.15.177:0/2799959877 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74541fa0b0 con 0x7f74541f64d0 2023-11-28T20:10:01.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f7459032640 1 -- 172.21.15.177:0/2799959877 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74540c6060 con 0x7f74541f64d0 2023-11-28T20:10:01.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.804+0000 7f7459032640 1 -- 172.21.15.177:0/2799959877 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74541f61f0 con 0x7f74541f64d0 2023-11-28T20:10:01.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.808+0000 7f744b7fe640 1 -- 172.21.15.177:0/2799959877 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f744c013550 con 0x7f74541f64d0 2023-11-28T20:10:01.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.808+0000 7f744b7fe640 1 --2- 172.21.15.177:0/2799959877 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f74340664a0 0x7f7434068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:01.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.808+0000 7f744b7fe640 1 -- 172.21.15.177:0/2799959877 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f744c084390 con 0x7f74541f64d0 2023-11-28T20:10:01.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.808+0000 7f7452d9d640 1 --2- 172.21.15.177:0/2799959877 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f74340664a0 0x7f7434068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:01.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.808+0000 7f7452d9d640 1 --2- 172.21.15.177:0/2799959877 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f74340664a0 0x7f7434068960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f74440ac000 tx=0x7f74440a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:01.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.812+0000 7f744b7fe640 1 -- 172.21.15.177:0/2799959877 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74541f61f0 con 0x7f74541f64d0 2023-11-28T20:10:01.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.960+0000 7f7459032640 1 -- 172.21.15.177:0/2799959877 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74541f61f0 con 0x7f74541f64d0 2023-11-28T20:10:01.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.964+0000 7f744b7fe640 1 -- 172.21.15.177:0/2799959877 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f74541f61f0 con 0x7f74541f64d0 2023-11-28T20:10:01.967 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:01.968 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":49,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:09:44.664848+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:09:40.777720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T20:09:42.029277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:10:01.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.964+0000 7f7459032640 1 -- 172.21.15.177:0/2799959877 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f74340664a0 msgr2=0x7f7434068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:01.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.964+0000 7f7459032640 1 --2- 172.21.15.177:0/2799959877 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f74340664a0 0x7f7434068960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f74440ac000 tx=0x7f74440a6070 comp rx=0 tx=0).stop 2023-11-28T20:10:01.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.964+0000 7f7459032640 1 -- 172.21.15.177:0/2799959877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74541f64d0 msgr2=0x7f74540ad890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:01.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.964+0000 7f7459032640 1 --2- 172.21.15.177:0/2799959877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74541f64d0 0x7f74540ad890 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f74540b2070 tx=0x7f744c007bd0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.964+0000 7f7459032640 1 -- 172.21.15.177:0/2799959877 shutdown_connections 2023-11-28T20:10:01.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.964+0000 7f7459032640 1 --2- 172.21.15.177:0/2799959877 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f74340664a0 0x7f7434068960 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.964+0000 7f7459032640 1 --2- 172.21.15.177:0/2799959877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74541f64d0 0x7f74540ad890 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.964+0000 7f7459032640 1 --2- 172.21.15.177:0/2799959877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74540c5be0 0x7f74541f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.964+0000 7f7459032640 1 --2- 172.21.15.177:0/2799959877 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7440003b60 0x7f7454141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:01.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.964+0000 7f7459032640 1 -- 172.21.15.177:0/2799959877 >> 172.21.15.177:0/2799959877 conn(0x7f745406a530 msgr2=0x7f74540cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:01.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.964+0000 7f7459032640 1 -- 172.21.15.177:0/2799959877 shutdown_connections 2023-11-28T20:10:01.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:01.964+0000 7f7459032640 1 -- 172.21.15.177:0/2799959877 wait complete. 2023-11-28T20:10:01.989 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:09:40.777720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:09:42.029277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:10:01.989 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:10:02.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.124+0000 7f3401180640 1 Processor -- start 2023-11-28T20:10:02.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.128+0000 7f3401180640 1 -- start start 2023-11-28T20:10:02.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.128+0000 7f3401180640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33fc071d90 0x7f33fc072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.128+0000 7f3401180640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f33fc13f5f0 0x7f33fc0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.128+0000 7f3401180640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33fc13d2b0 con 0x7f33fc15adb0 2023-11-28T20:10:02.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.128+0000 7f3401180640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33fc140520 con 0x7f33fc13f5f0 2023-11-28T20:10:02.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.128+0000 7f3401180640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc0cd7f0 con 0x7f33fc071d90 2023-11-28T20:10:02.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.128+0000 7f33fb59e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f33fc13f5f0 0x7f33fc0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.128+0000 7f33fa59c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f33fc15adb0 0x7f33fc13d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45214/0 (socket says 172.21.15.177:45214) 2023-11-28T20:10:02.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.128+0000 7f33fa59c640 1 -- 172.21.15.177:0/1361087299 learned_addr learned my addr 172.21.15.177:0/1361087299 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:02.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.128+0000 7f33fad9d640 1 --2- 172.21.15.177:0/1361087299 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33fc071d90 0x7f33fc072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.128+0000 7f33fb59e640 1 -- 172.21.15.177:0/1361087299 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33fc071d90 msgr2=0x7f33fc072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:02.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.128+0000 7f33fb59e640 1 --2- 172.21.15.177:0/1361087299 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33fc071d90 0x7f33fc072170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.128+0000 7f33fb59e640 1 -- 172.21.15.177:0/1361087299 >> v1:172.21.15.177:6789/0 conn(0x7f33fc15adb0 legacy=0x7f33fc13d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.128+0000 7f33fb59e640 1 -- 172.21.15.177:0/1361087299 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc0cdd70 con 0x7f33fc13f5f0 2023-11-28T20:10:02.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.128+0000 7f33f9d9b640 1 -- 172.21.15.177:0/1361087299 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021770077 0 0) 0x7f33fc13d2b0 con 0x7f33fc15adb0 2023-11-28T20:10:02.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.132+0000 7f33fb59e640 1 --2- 172.21.15.177:0/1361087299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33fc13f5f0 0x7f33fc0ce200 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009d90 tx=0x7f33f401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ca3f8796fb0665 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:02.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.132+0000 7f33f9d9b640 1 -- 172.21.15.177:0/1361087299 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f40a5a10 con 0x7f33fc13f5f0 2023-11-28T20:10:02.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.132+0000 7f33f9d9b640 1 -- 172.21.15.177:0/1361087299 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f40a5b70 con 0x7f33fc13f5f0 2023-11-28T20:10:02.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.132+0000 7f33f9d9b640 1 -- 172.21.15.177:0/1361087299 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f40ad440 con 0x7f33fc13f5f0 2023-11-28T20:10:02.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.132+0000 7f3401180640 1 -- 172.21.15.177:0/1361087299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33fc13f5f0 msgr2=0x7f33fc0ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.132+0000 7f3401180640 1 --2- 172.21.15.177:0/1361087299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33fc13f5f0 0x7f33fc0ce200 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009d90 tx=0x7f33f401c950 comp rx=0 tx=0).stop 2023-11-28T20:10:02.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.132+0000 7f3401180640 1 -- 172.21.15.177:0/1361087299 shutdown_connections 2023-11-28T20:10:02.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.132+0000 7f3401180640 1 --2- 172.21.15.177:0/1361087299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33fc13f5f0 0x7f33fc0ce200 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.132+0000 7f3401180640 1 --2- 172.21.15.177:0/1361087299 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33fc071d90 0x7f33fc072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.132+0000 7f3401180640 1 -- 172.21.15.177:0/1361087299 >> 172.21.15.177:0/1361087299 conn(0x7f33fc0b0cc0 msgr2=0x7f33fc0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:02.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.132+0000 7f3401180640 1 -- 172.21.15.177:0/1361087299 shutdown_connections 2023-11-28T20:10:02.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.132+0000 7f3401180640 1 -- 172.21.15.177:0/1361087299 wait complete. 2023-11-28T20:10:02.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.132+0000 7f3401180640 1 Processor -- start 2023-11-28T20:10:02.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.132+0000 7f3401180640 1 -- start start 2023-11-28T20:10:02.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f3401180640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33fc071d90 0x7f33fc142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f3401180640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33fc13f5f0 0x7f33fc15e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f3401180640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33fc15adb0 0x7f33fc1f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f3401180640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc142640 con 0x7f33fc13f5f0 2023-11-28T20:10:02.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f3401180640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc15ebe0 con 0x7f33fc071d90 2023-11-28T20:10:02.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f3401180640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc1f9500 con 0x7f33fc15adb0 2023-11-28T20:10:02.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33fa59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33fc13f5f0 0x7f33fc15e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33fa59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33fc13f5f0 0x7f33fc15e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46894/0 (socket says 172.21.15.177:46894) 2023-11-28T20:10:02.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33fa59c640 1 -- 172.21.15.177:0/683835927 learned_addr learned my addr 172.21.15.177:0/683835927 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:02.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33fb59e640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33fc15adb0 0x7f33fc1f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33fad9d640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33fc071d90 0x7f33fc142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33fa59c640 1 -- 172.21.15.177:0/683835927 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33fc15adb0 msgr2=0x7f33fc1f8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33fa59c640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33fc15adb0 0x7f33fc1f8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33fa59c640 1 -- 172.21.15.177:0/683835927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33fc071d90 msgr2=0x7f33fc142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33fa59c640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33fc071d90 0x7f33fc142100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33fa59c640 1 -- 172.21.15.177:0/683835927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f4009a70 con 0x7f33fc13f5f0 2023-11-28T20:10:02.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33fb59e640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33fc15adb0 0x7f33fc1f8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:02.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33fad9d640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33fc071d90 0x7f33fc142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:02.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33fa59c640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33fc13f5f0 0x7f33fc15e6a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f33f000c480 tx=0x7f33f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:02.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33e37fe640 1 -- 172.21.15.177:0/683835927 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f00074e0 con 0x7f33fc13f5f0 2023-11-28T20:10:02.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33e37fe640 1 -- 172.21.15.177:0/683835927 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f0007660 con 0x7f33fc13f5f0 2023-11-28T20:10:02.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f33e37fe640 1 -- 172.21.15.177:0/683835927 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0004a30 con 0x7f33fc13f5f0 2023-11-28T20:10:02.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f3401180640 1 -- 172.21.15.177:0/683835927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33fc142850 con 0x7f33fc13f5f0 2023-11-28T20:10:02.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f3401180640 1 -- 172.21.15.177:0/683835927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33fc142e10 con 0x7f33fc13f5f0 2023-11-28T20:10:02.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.136+0000 7f3401180640 1 -- 172.21.15.177:0/683835927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33fc0693d0 con 0x7f33fc13f5f0 2023-11-28T20:10:02.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.140+0000 7f33e37fe640 1 -- 172.21.15.177:0/683835927 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f33f0004b90 con 0x7f33fc13f5f0 2023-11-28T20:10:02.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.140+0000 7f33e37fe640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f33e8066470 0x7f33e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.140+0000 7f33e37fe640 1 -- 172.21.15.177:0/683835927 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33f0082fa0 con 0x7f33fc13f5f0 2023-11-28T20:10:02.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.140+0000 7f33fad9d640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f33e8066470 0x7f33e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.140+0000 7f33fad9d640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f33e8066470 0x7f33e8068930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f33ec007a70 tx=0x7f33ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:02.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.144+0000 7f33e37fe640 1 -- 172.21.15.177:0/683835927 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f33f00b4280 con 0x7f33fc13f5f0 2023-11-28T20:10:02.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.292+0000 7f3401180640 1 -- 172.21.15.177:0/683835927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33fc06e710 con 0x7f33fc13f5f0 2023-11-28T20:10:02.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.292+0000 7f33e37fe640 1 -- 172.21.15.177:0/683835927 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33f0018020 con 0x7f33fc13f5f0 2023-11-28T20:10:02.297 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:10:02.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.296+0000 7f3401180640 1 -- 172.21.15.177:0/683835927 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f33e8066470 msgr2=0x7f33e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.296+0000 7f3401180640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f33e8066470 0x7f33e8068930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f33ec007a70 tx=0x7f33ec008040 comp rx=0 tx=0).stop 2023-11-28T20:10:02.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.296+0000 7f3401180640 1 -- 172.21.15.177:0/683835927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33fc13f5f0 msgr2=0x7f33fc15e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.296+0000 7f3401180640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33fc13f5f0 0x7f33fc15e6a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f33f000c480 tx=0x7f33f000c940 comp rx=0 tx=0).stop 2023-11-28T20:10:02.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.296+0000 7f3401180640 1 -- 172.21.15.177:0/683835927 shutdown_connections 2023-11-28T20:10:02.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.296+0000 7f3401180640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f33e8066470 0x7f33e8068930 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.296+0000 7f3401180640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33fc15adb0 0x7f33fc1f8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.296+0000 7f3401180640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33fc13f5f0 0x7f33fc15e6a0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.296+0000 7f3401180640 1 --2- 172.21.15.177:0/683835927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33fc071d90 0x7f33fc142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.296+0000 7f3401180640 1 -- 172.21.15.177:0/683835927 >> 172.21.15.177:0/683835927 conn(0x7f33fc0b0cc0 msgr2=0x7f33fc15cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:02.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.296+0000 7f3401180640 1 -- 172.21.15.177:0/683835927 shutdown_connections 2023-11-28T20:10:02.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.296+0000 7f3401180640 1 -- 172.21.15.177:0/683835927 wait complete. 2023-11-28T20:10:02.319 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:10:02.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c4b6c9640 1 Processor -- start 2023-11-28T20:10:02.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c4b6c9640 1 -- start start 2023-11-28T20:10:02.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c4b6c9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4c4414abe0 0x7f4c44165a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c4b6c9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4c4414b1e0 0x7f4c440b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c4b6c9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c440b4770 con 0x7f4c440b4350 2023-11-28T20:10:02.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c4b6c9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c440b1fc0 con 0x7f4c4414abe0 2023-11-28T20:10:02.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c4b6c9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c440b2260 con 0x7f4c4414b1e0 2023-11-28T20:10:02.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c49465640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4c4414abe0 0x7f4c44165a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c49c66640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f4c440b4350 0x7f4c44161b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45216/0 (socket says 172.21.15.177:45216) 2023-11-28T20:10:02.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c49c66640 1 -- 172.21.15.177:0/2535815330 learned_addr learned my addr 172.21.15.177:0/2535815330 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:02.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c48c64640 1 --2- 172.21.15.177:0/2535815330 >> v2:172.21.15.195:3300/0 conn(0x7f4c4414b1e0 0x7f4c440b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c49465640 1 -- 172.21.15.177:0/2535815330 >> v2:172.21.15.195:3300/0 conn(0x7f4c4414b1e0 msgr2=0x7f4c440b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:02.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c49465640 1 --2- 172.21.15.177:0/2535815330 >> v2:172.21.15.195:3300/0 conn(0x7f4c4414b1e0 0x7f4c440b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c49465640 1 -- 172.21.15.177:0/2535815330 >> v1:172.21.15.177:6789/0 conn(0x7f4c440b4350 legacy=0x7f4c44161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c49465640 1 -- 172.21.15.177:0/2535815330 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c440b2540 con 0x7f4c4414abe0 2023-11-28T20:10:02.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c3bfff640 1 -- 172.21.15.177:0/2535815330 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076473 0 0) 0x7f4c440b4770 con 0x7f4c440b4350 2023-11-28T20:10:02.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.456+0000 7f4c48c64640 1 --2- 172.21.15.177:0/2535815330 >> v2:172.21.15.195:3300/0 conn(0x7f4c4414b1e0 0x7f4c440b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:02.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.460+0000 7f4c49465640 1 --2- 172.21.15.177:0/2535815330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c4414abe0 0x7f4c44165a20 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4c44074050 tx=0x7f4c4001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d610ecb28a2d64d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:02.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.460+0000 7f4c3bfff640 1 -- 172.21.15.177:0/2535815330 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c400a7070 con 0x7f4c4414abe0 2023-11-28T20:10:02.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.460+0000 7f4c3bfff640 1 -- 172.21.15.177:0/2535815330 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c400ab430 con 0x7f4c4414abe0 2023-11-28T20:10:02.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.460+0000 7f4c3bfff640 1 -- 172.21.15.177:0/2535815330 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c400ab7c0 con 0x7f4c4414abe0 2023-11-28T20:10:02.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.460+0000 7f4c4b6c9640 1 -- 172.21.15.177:0/2535815330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c4414abe0 msgr2=0x7f4c44165a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.460+0000 7f4c4b6c9640 1 --2- 172.21.15.177:0/2535815330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c4414abe0 0x7f4c44165a20 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4c44074050 tx=0x7f4c4001c430 comp rx=0 tx=0).stop 2023-11-28T20:10:02.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.460+0000 7f4c4b6c9640 1 -- 172.21.15.177:0/2535815330 shutdown_connections 2023-11-28T20:10:02.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.460+0000 7f4c4b6c9640 1 --2- 172.21.15.177:0/2535815330 >> v2:172.21.15.195:3300/0 conn(0x7f4c4414b1e0 0x7f4c440b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.460+0000 7f4c4b6c9640 1 --2- 172.21.15.177:0/2535815330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c4414abe0 0x7f4c44165a20 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.460+0000 7f4c4b6c9640 1 -- 172.21.15.177:0/2535815330 >> 172.21.15.177:0/2535815330 conn(0x7f4c440b0cc0 msgr2=0x7f4c440b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:02.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.460+0000 7f4c4b6c9640 1 -- 172.21.15.177:0/2535815330 shutdown_connections 2023-11-28T20:10:02.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.460+0000 7f4c4b6c9640 1 -- 172.21.15.177:0/2535815330 wait complete. 2023-11-28T20:10:02.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c4b6c9640 1 Processor -- start 2023-11-28T20:10:02.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c4b6c9640 1 -- start start 2023-11-28T20:10:02.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c4b6c9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c440b4350 0x7f4c44168a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c4b6c9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c4414abe0 0x7f4c44166260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c4b6c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c44161070 0x7f4c441635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c4b6c9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c441675c0 con 0x7f4c440b4350 2023-11-28T20:10:02.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c4b6c9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c441667a0 con 0x7f4c4414abe0 2023-11-28T20:10:02.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c4b6c9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44166a40 con 0x7f4c44161070 2023-11-28T20:10:02.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c49465640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c440b4350 0x7f4c44168a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c49465640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c440b4350 0x7f4c44168a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46906/0 (socket says 172.21.15.177:46906) 2023-11-28T20:10:02.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c49465640 1 -- 172.21.15.177:0/195611341 learned_addr learned my addr 172.21.15.177:0/195611341 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:02.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c48c64640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c4414abe0 0x7f4c44166260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c49c66640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c44161070 0x7f4c441635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c49465640 1 -- 172.21.15.177:0/195611341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c44161070 msgr2=0x7f4c441635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c49465640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c44161070 0x7f4c441635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c49465640 1 -- 172.21.15.177:0/195611341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c4414abe0 msgr2=0x7f4c44166260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c49465640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c4414abe0 0x7f4c44166260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c49465640 1 -- 172.21.15.177:0/195611341 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c40009420 con 0x7f4c440b4350 2023-11-28T20:10:02.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c48c64640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c4414abe0 0x7f4c44166260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:02.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c49c66640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c44161070 0x7f4c441635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:02.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c49465640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c440b4350 0x7f4c44168a90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4c40019040 tx=0x7f4c4001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:02.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c39ffb640 1 -- 172.21.15.177:0/195611341 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c400b5810 con 0x7f4c440b4350 2023-11-28T20:10:02.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c39ffb640 1 -- 172.21.15.177:0/195611341 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c400b5990 con 0x7f4c440b4350 2023-11-28T20:10:02.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c4b6c9640 1 -- 172.21.15.177:0/195611341 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c44166d20 con 0x7f4c440b4350 2023-11-28T20:10:02.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c39ffb640 1 -- 172.21.15.177:0/195611341 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c400b5d40 con 0x7f4c440b4350 2023-11-28T20:10:02.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.464+0000 7f4c4b6c9640 1 -- 172.21.15.177:0/195611341 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c441672e0 con 0x7f4c440b4350 2023-11-28T20:10:02.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.468+0000 7f4c4b6c9640 1 -- 172.21.15.177:0/195611341 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c440693d0 con 0x7f4c440b4350 2023-11-28T20:10:02.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.468+0000 7f4c39ffb640 1 -- 172.21.15.177:0/195611341 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4c400c7390 con 0x7f4c440b4350 2023-11-28T20:10:02.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.468+0000 7f4c39ffb640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4c28066470 0x7f4c28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.468+0000 7f4c39ffb640 1 -- 172.21.15.177:0/195611341 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c44162a70 con 0x7f4c440b4350 2023-11-28T20:10:02.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.468+0000 7f4c48c64640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4c28066470 0x7f4c28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.468+0000 7f4c48c64640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4c28066470 0x7f4c28068930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4c440ce3e0 tx=0x7f4c34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:02.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.472+0000 7f4c39ffb640 1 -- 172.21.15.177:0/195611341 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c400ebfa0 con 0x7f4c440b4350 2023-11-28T20:10:02.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.620+0000 7f4c4b6c9640 1 -- 172.21.15.177:0/195611341 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c440b1420 con 0x7f4c440b4350 2023-11-28T20:10:02.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.620+0000 7f4c39ffb640 1 -- 172.21.15.177:0/195611341 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c400ef5c0 con 0x7f4c440b4350 2023-11-28T20:10:02.626 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:10:02.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.624+0000 7f4c4b6c9640 1 -- 172.21.15.177:0/195611341 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4c28066470 msgr2=0x7f4c28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.624+0000 7f4c4b6c9640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4c28066470 0x7f4c28068930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4c440ce3e0 tx=0x7f4c34008040 comp rx=0 tx=0).stop 2023-11-28T20:10:02.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.624+0000 7f4c4b6c9640 1 -- 172.21.15.177:0/195611341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c440b4350 msgr2=0x7f4c44168a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.624+0000 7f4c4b6c9640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c440b4350 0x7f4c44168a90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4c40019040 tx=0x7f4c4001ac70 comp rx=0 tx=0).stop 2023-11-28T20:10:02.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.624+0000 7f4c4b6c9640 1 -- 172.21.15.177:0/195611341 shutdown_connections 2023-11-28T20:10:02.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.624+0000 7f4c4b6c9640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f4c28066470 0x7f4c28068930 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.624+0000 7f4c4b6c9640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c44161070 0x7f4c441635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.624+0000 7f4c4b6c9640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c4414abe0 0x7f4c44166260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.624+0000 7f4c4b6c9640 1 --2- 172.21.15.177:0/195611341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c440b4350 0x7f4c44168a90 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.624+0000 7f4c4b6c9640 1 -- 172.21.15.177:0/195611341 >> 172.21.15.177:0/195611341 conn(0x7f4c440b0cc0 msgr2=0x7f4c440cb230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:02.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.624+0000 7f4c4b6c9640 1 -- 172.21.15.177:0/195611341 shutdown_connections 2023-11-28T20:10:02.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.624+0000 7f4c4b6c9640 1 -- 172.21.15.177:0/195611341 wait complete. 2023-11-28T20:10:02.647 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:10:02.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa76e617640 1 Processor -- start 2023-11-28T20:10:02.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa76e617640 1 -- start start 2023-11-28T20:10:02.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa76e617640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa7681571d0 0x7fa768070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa76e617640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa76815d8e0 0x7fa7680ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa76e617640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7681575b0 con 0x7fa7680ae830 2023-11-28T20:10:02.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa76e617640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa768071600 con 0x7fa7681571d0 2023-11-28T20:10:02.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa76e617640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7680718e0 con 0x7fa76815d8e0 2023-11-28T20:10:02.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa767fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa7681571d0 0x7fa768070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa767fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa7681571d0 0x7fa768070c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46912/0 (socket says 172.21.15.177:46912) 2023-11-28T20:10:02.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa7677fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fa7680ae830 0x7fa76815d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45218/0 (socket says 172.21.15.177:45218) 2023-11-28T20:10:02.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa767fff640 1 -- 172.21.15.177:0/1864061971 learned_addr learned my addr 172.21.15.177:0/1864061971 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:02.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa76cbb4640 1 --2- 172.21.15.177:0/1864061971 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa76815d8e0 0x7fa7680ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa767fff640 1 -- 172.21.15.177:0/1864061971 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa76815d8e0 msgr2=0x7fa7680ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:02.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa767fff640 1 --2- 172.21.15.177:0/1864061971 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa76815d8e0 0x7fa7680ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa767fff640 1 -- 172.21.15.177:0/1864061971 >> v1:172.21.15.177:6789/0 conn(0x7fa7680ae830 legacy=0x7fa76815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa767fff640 1 -- 172.21.15.177:0/1864061971 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768071bc0 con 0x7fa7681571d0 2023-11-28T20:10:02.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.784+0000 7fa76cbb4640 1 --2- 172.21.15.177:0/1864061971 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa76815d8e0 0x7fa7680ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:02.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.788+0000 7fa767fff640 1 --2- 172.21.15.177:0/1864061971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7681571d0 0x7fa768070c80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa758009870 tx=0x7fa75801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae25e59dbb76b7d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:02.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.788+0000 7fa766ffd640 1 -- 172.21.15.177:0/1864061971 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7580ac410 con 0x7fa7681571d0 2023-11-28T20:10:02.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.788+0000 7fa766ffd640 1 -- 172.21.15.177:0/1864061971 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7580ac570 con 0x7fa7681571d0 2023-11-28T20:10:02.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.788+0000 7fa766ffd640 1 -- 172.21.15.177:0/1864061971 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7580ac900 con 0x7fa7681571d0 2023-11-28T20:10:02.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.788+0000 7fa76e617640 1 -- 172.21.15.177:0/1864061971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7681571d0 msgr2=0x7fa768070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.788+0000 7fa76e617640 1 --2- 172.21.15.177:0/1864061971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7681571d0 0x7fa768070c80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa758009870 tx=0x7fa75801c540 comp rx=0 tx=0).stop 2023-11-28T20:10:02.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.788+0000 7fa76e617640 1 -- 172.21.15.177:0/1864061971 shutdown_connections 2023-11-28T20:10:02.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.788+0000 7fa76e617640 1 --2- 172.21.15.177:0/1864061971 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa76815d8e0 0x7fa7680ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.788+0000 7fa76e617640 1 --2- 172.21.15.177:0/1864061971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7681571d0 0x7fa768070c80 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.788+0000 7fa76e617640 1 -- 172.21.15.177:0/1864061971 >> 172.21.15.177:0/1864061971 conn(0x7fa7680b0cc0 msgr2=0x7fa7680b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:02.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.788+0000 7fa76e617640 1 -- 172.21.15.177:0/1864061971 shutdown_connections 2023-11-28T20:10:02.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.788+0000 7fa76e617640 1 -- 172.21.15.177:0/1864061971 wait complete. 2023-11-28T20:10:02.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76e617640 1 Processor -- start 2023-11-28T20:10:02.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76e617640 1 -- start start 2023-11-28T20:10:02.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76e617640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7680ae830 0x7fa76813a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76e617640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7681571d0 0x7fa7681523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76e617640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa76815d8e0 0x7fa768150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76e617640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7681510b0 con 0x7fa76815d8e0 2023-11-28T20:10:02.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76e617640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa768151300 con 0x7fa7681571d0 2023-11-28T20:10:02.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76e617640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7681515e0 con 0x7fa7680ae830 2023-11-28T20:10:02.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76cbb4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa76815d8e0 0x7fa768150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76cbb4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa76815d8e0 0x7fa768150350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46916/0 (socket says 172.21.15.177:46916) 2023-11-28T20:10:02.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76cbb4640 1 -- 172.21.15.177:0/2268712078 learned_addr learned my addr 172.21.15.177:0/2268712078 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:02.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa767fff640 1 --2- 172.21.15.177:0/2268712078 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7680ae830 0x7fa76813a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa7677fe640 1 --2- 172.21.15.177:0/2268712078 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7681571d0 0x7fa7681523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76cbb4640 1 -- 172.21.15.177:0/2268712078 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7680ae830 msgr2=0x7fa76813a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76cbb4640 1 --2- 172.21.15.177:0/2268712078 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7680ae830 0x7fa76813a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76cbb4640 1 -- 172.21.15.177:0/2268712078 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7681571d0 msgr2=0x7fa7681523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76cbb4640 1 --2- 172.21.15.177:0/2268712078 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7681571d0 0x7fa7681523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76cbb4640 1 -- 172.21.15.177:0/2268712078 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7580094d0 con 0x7fa76815d8e0 2023-11-28T20:10:02.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76cbb4640 1 --2- 172.21.15.177:0/2268712078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa76815d8e0 0x7fa768150350 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa76000cd10 tx=0x7fa76000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:02.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa764ff9640 1 -- 172.21.15.177:0/2268712078 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760003ba0 con 0x7fa76815d8e0 2023-11-28T20:10:02.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa764ff9640 1 -- 172.21.15.177:0/2268712078 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa760003d20 con 0x7fa76815d8e0 2023-11-28T20:10:02.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76e617640 1 -- 172.21.15.177:0/2268712078 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7681518c0 con 0x7fa76815d8e0 2023-11-28T20:10:02.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa764ff9640 1 -- 172.21.15.177:0/2268712078 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760004260 con 0x7fa76815d8e0 2023-11-28T20:10:02.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.792+0000 7fa76e617640 1 -- 172.21.15.177:0/2268712078 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa768151e80 con 0x7fa76815d8e0 2023-11-28T20:10:02.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.796+0000 7fa76e617640 1 -- 172.21.15.177:0/2268712078 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7680693d0 con 0x7fa76815d8e0 2023-11-28T20:10:02.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.796+0000 7fa764ff9640 1 -- 172.21.15.177:0/2268712078 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa76000b040 con 0x7fa76815d8e0 2023-11-28T20:10:02.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.796+0000 7fa764ff9640 1 --2- 172.21.15.177:0/2268712078 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa754066470 0x7fa754068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:02.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.796+0000 7fa764ff9640 1 -- 172.21.15.177:0/2268712078 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7600844c0 con 0x7fa76815d8e0 2023-11-28T20:10:02.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.796+0000 7fa767fff640 1 --2- 172.21.15.177:0/2268712078 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa754066470 0x7fa754068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:02.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.796+0000 7fa767fff640 1 --2- 172.21.15.177:0/2268712078 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa754066470 0x7fa754068930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa7580ae000 tx=0x7fa758009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:02.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.800+0000 7fa764ff9640 1 -- 172.21.15.177:0/2268712078 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa760051950 con 0x7fa76815d8e0 2023-11-28T20:10:02.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.952+0000 7fa76e617640 1 -- 172.21.15.177:0/2268712078 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa7680ce970 con 0x7fa76815d8e0 2023-11-28T20:10:02.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.952+0000 7fa764ff9640 1 -- 172.21.15.177:0/2268712078 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa76001d020 con 0x7fa76815d8e0 2023-11-28T20:10:02.955 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:10:02.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.952+0000 7fa76e617640 1 -- 172.21.15.177:0/2268712078 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa754066470 msgr2=0x7fa754068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.952+0000 7fa76e617640 1 --2- 172.21.15.177:0/2268712078 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa754066470 0x7fa754068930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa7580ae000 tx=0x7fa758009040 comp rx=0 tx=0).stop 2023-11-28T20:10:02.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.952+0000 7fa76e617640 1 -- 172.21.15.177:0/2268712078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa76815d8e0 msgr2=0x7fa768150350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:02.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.952+0000 7fa76e617640 1 --2- 172.21.15.177:0/2268712078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa76815d8e0 0x7fa768150350 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa76000cd10 tx=0x7fa76000a650 comp rx=0 tx=0).stop 2023-11-28T20:10:02.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.952+0000 7fa76e617640 1 -- 172.21.15.177:0/2268712078 shutdown_connections 2023-11-28T20:10:02.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.952+0000 7fa76e617640 1 --2- 172.21.15.177:0/2268712078 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa754066470 0x7fa754068930 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.952+0000 7fa76e617640 1 --2- 172.21.15.177:0/2268712078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa76815d8e0 0x7fa768150350 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.952+0000 7fa76e617640 1 --2- 172.21.15.177:0/2268712078 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7681571d0 0x7fa7681523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.952+0000 7fa76e617640 1 --2- 172.21.15.177:0/2268712078 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7680ae830 0x7fa76813a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:02.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.952+0000 7fa76e617640 1 -- 172.21.15.177:0/2268712078 >> 172.21.15.177:0/2268712078 conn(0x7fa7680b0cc0 msgr2=0x7fa768157770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:02.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.952+0000 7fa76e617640 1 -- 172.21.15.177:0/2268712078 shutdown_connections 2023-11-28T20:10:02.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:02.952+0000 7fa76e617640 1 -- 172.21.15.177:0/2268712078 wait complete. 2023-11-28T20:10:02.977 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:10:03.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50eaac9640 1 Processor -- start 2023-11-28T20:10:03.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50eaac9640 1 -- start start 2023-11-28T20:10:03.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50eaac9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e4144840 0x7f50e406c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50eaac9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f50e4072180 0x7f50e406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50eaac9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e40710e0 con 0x7f50e4070460 2023-11-28T20:10:03.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50eaac9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e415f010 con 0x7f50e4072180 2023-11-28T20:10:03.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50eaac9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40713c0 con 0x7f50e4144840 2023-11-28T20:10:03.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50e8865640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e4144840 0x7f50e406c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50dbfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f50e4072180 0x7f50e406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50e8865640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e4144840 0x7f50e406c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.177:34884/0 (socket says 172.21.15.177:34884) 2023-11-28T20:10:03.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50e8865640 1 -- 172.21.15.177:0/453546279 learned_addr learned my addr 172.21.15.177:0/453546279 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:03.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50dbfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f50e4072180 0x7f50e406c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.177:50380/0 (socket says 172.21.15.177:50380) 2023-11-28T20:10:03.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50e9066640 1 --1- 172.21.15.177:0/453546279 >> v1:172.21.15.195:6789/0 conn(0x7f50e4070460 0x7f50e40708e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.177:35802/0 (socket says 172.21.15.177:35802) 2023-11-28T20:10:03.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50e8865640 1 -- 172.21.15.177:0/453546279 >> v2:172.21.15.195:3300/0 conn(0x7f50e4072180 msgr2=0x7f50e406c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:03.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50e8865640 1 --2- 172.21.15.177:0/453546279 >> v2:172.21.15.195:3300/0 conn(0x7f50e4072180 0x7f50e406c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50e8865640 1 -- 172.21.15.177:0/453546279 >> v1:172.21.15.195:6789/0 conn(0x7f50e4070460 legacy=0x7f50e40708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.112+0000 7f50e8865640 1 -- 172.21.15.177:0/453546279 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e40716a0 con 0x7f50e4144840 2023-11-28T20:10:03.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.116+0000 7f50e8865640 1 --2- 172.21.15.177:0/453546279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e4144840 0x7f50e406c2c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009870 tx=0x7f50e001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b95f0147332a3d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:03.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.116+0000 7f50db7fe640 1 -- 172.21.15.177:0/453546279 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e00aa670 con 0x7f50e4144840 2023-11-28T20:10:03.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.116+0000 7f50db7fe640 1 -- 172.21.15.177:0/453546279 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e00aa7d0 con 0x7f50e4144840 2023-11-28T20:10:03.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.116+0000 7f50db7fe640 1 -- 172.21.15.177:0/453546279 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e00aab60 con 0x7f50e4144840 2023-11-28T20:10:03.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.116+0000 7f50eaac9640 1 -- 172.21.15.177:0/453546279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e4144840 msgr2=0x7f50e406c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.116+0000 7f50eaac9640 1 --2- 172.21.15.177:0/453546279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e4144840 0x7f50e406c2c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009870 tx=0x7f50e001c510 comp rx=0 tx=0).stop 2023-11-28T20:10:03.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.116+0000 7f50eaac9640 1 -- 172.21.15.177:0/453546279 shutdown_connections 2023-11-28T20:10:03.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.116+0000 7f50eaac9640 1 --2- 172.21.15.177:0/453546279 >> v2:172.21.15.195:3300/0 conn(0x7f50e4072180 0x7f50e406c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.116+0000 7f50eaac9640 1 --2- 172.21.15.177:0/453546279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e4144840 0x7f50e406c2c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.116+0000 7f50eaac9640 1 -- 172.21.15.177:0/453546279 >> 172.21.15.177:0/453546279 conn(0x7f50e406a530 msgr2=0x7f50e406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:03.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.116+0000 7f50eaac9640 1 -- 172.21.15.177:0/453546279 shutdown_connections 2023-11-28T20:10:03.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.116+0000 7f50eaac9640 1 -- 172.21.15.177:0/453546279 wait complete. 2023-11-28T20:10:03.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50eaac9640 1 Processor -- start 2023-11-28T20:10:03.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50eaac9640 1 -- start start 2023-11-28T20:10:03.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50eaac9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e4070460 0x7f50e415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50eaac9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e4072180 0x7f50e40cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50eaac9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e4144840 0x7f50e40ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50eaac9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4165ce0 con 0x7f50e4144840 2023-11-28T20:10:03.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50eaac9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4141960 con 0x7f50e4070460 2023-11-28T20:10:03.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50eaac9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e415af00 con 0x7f50e4072180 2023-11-28T20:10:03.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50e9066640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e4144840 0x7f50e40ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50e9066640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e4144840 0x7f50e40ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46918/0 (socket says 172.21.15.177:46918) 2023-11-28T20:10:03.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50e8865640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e4070460 0x7f50e415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50e9066640 1 -- 172.21.15.177:0/3116609185 learned_addr learned my addr 172.21.15.177:0/3116609185 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:03.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50dbfff640 1 --2- 172.21.15.177:0/3116609185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e4072180 0x7f50e40cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50e8865640 1 -- 172.21.15.177:0/3116609185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e4072180 msgr2=0x7f50e40cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50e8865640 1 --2- 172.21.15.177:0/3116609185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e4072180 0x7f50e40cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50e8865640 1 -- 172.21.15.177:0/3116609185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e4144840 msgr2=0x7f50e40ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50e8865640 1 --2- 172.21.15.177:0/3116609185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e4144840 0x7f50e40ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50e8865640 1 -- 172.21.15.177:0/3116609185 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e00094d0 con 0x7f50e4070460 2023-11-28T20:10:03.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50e9066640 1 --2- 172.21.15.177:0/3116609185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e4144840 0x7f50e40ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:10:03.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50e8865640 1 --2- 172.21.15.177:0/3116609185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e4070460 0x7f50e415a9c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f50e00ab000 tx=0x7f50e001ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:03.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50d97fa640 1 -- 172.21.15.177:0/3116609185 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e00bd5f0 con 0x7f50e4070460 2023-11-28T20:10:03.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50d97fa640 1 -- 172.21.15.177:0/3116609185 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e00bd770 con 0x7f50e4070460 2023-11-28T20:10:03.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50eaac9640 1 -- 172.21.15.177:0/3116609185 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e4164cb0 con 0x7f50e4070460 2023-11-28T20:10:03.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.120+0000 7f50d97fa640 1 -- 172.21.15.177:0/3116609185 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e00bdb20 con 0x7f50e4070460 2023-11-28T20:10:03.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.124+0000 7f50eaac9640 1 -- 172.21.15.177:0/3116609185 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e4165270 con 0x7f50e4070460 2023-11-28T20:10:03.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.124+0000 7f50eaac9640 1 -- 172.21.15.177:0/3116609185 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e40b0a80 con 0x7f50e4070460 2023-11-28T20:10:03.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.124+0000 7f50d97fa640 1 -- 172.21.15.177:0/3116609185 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f50e00059a0 con 0x7f50e4070460 2023-11-28T20:10:03.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.124+0000 7f50d97fa640 1 --2- 172.21.15.177:0/3116609185 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f50d0066470 0x7f50d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.124+0000 7f50d97fa640 1 -- 172.21.15.177:0/3116609185 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50e011f190 con 0x7f50e4070460 2023-11-28T20:10:03.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.124+0000 7f50dbfff640 1 --2- 172.21.15.177:0/3116609185 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f50d0066470 0x7f50d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.124+0000 7f50dbfff640 1 --2- 172.21.15.177:0/3116609185 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f50d0066470 0x7f50d0068930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f50e4163fd0 tx=0x7f50d4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:03.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.128+0000 7f50d97fa640 1 -- 172.21.15.177:0/3116609185 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50e00ec6a0 con 0x7f50e4070460 2023-11-28T20:10:03.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.288+0000 7f50eaac9640 1 -- 172.21.15.177:0/3116609185 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f50e4069440 con 0x7f50e4070460 2023-11-28T20:10:03.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.288+0000 7f50d97fa640 1 -- 172.21.15.177:0/3116609185 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7f50e00c3080 con 0x7f50e4070460 2023-11-28T20:10:03.293 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:10:03.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.292+0000 7f50eaac9640 1 -- 172.21.15.177:0/3116609185 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f50d0066470 msgr2=0x7f50d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.292+0000 7f50eaac9640 1 --2- 172.21.15.177:0/3116609185 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f50d0066470 0x7f50d0068930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f50e4163fd0 tx=0x7f50d4009190 comp rx=0 tx=0).stop 2023-11-28T20:10:03.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.292+0000 7f50eaac9640 1 -- 172.21.15.177:0/3116609185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e4070460 msgr2=0x7f50e415a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.292+0000 7f50eaac9640 1 --2- 172.21.15.177:0/3116609185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e4070460 0x7f50e415a9c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f50e00ab000 tx=0x7f50e001ad50 comp rx=0 tx=0).stop 2023-11-28T20:10:03.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.292+0000 7f50eaac9640 1 -- 172.21.15.177:0/3116609185 shutdown_connections 2023-11-28T20:10:03.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.292+0000 7f50eaac9640 1 --2- 172.21.15.177:0/3116609185 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f50d0066470 0x7f50d0068930 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.292+0000 7f50eaac9640 1 --2- 172.21.15.177:0/3116609185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e4144840 0x7f50e40ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.292+0000 7f50eaac9640 1 --2- 172.21.15.177:0/3116609185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e4072180 0x7f50e40cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.292+0000 7f50eaac9640 1 --2- 172.21.15.177:0/3116609185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e4070460 0x7f50e415a9c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.292+0000 7f50eaac9640 1 -- 172.21.15.177:0/3116609185 >> 172.21.15.177:0/3116609185 conn(0x7f50e406a530 msgr2=0x7f50e40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:03.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.292+0000 7f50eaac9640 1 -- 172.21.15.177:0/3116609185 shutdown_connections 2023-11-28T20:10:03.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.292+0000 7f50eaac9640 1 -- 172.21.15.177:0/3116609185 wait complete. 2023-11-28T20:10:03.315 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:10:03.315 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:10:03.324 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:10:03.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.504+0000 7f258af1d640 1 Processor -- start 2023-11-28T20:10:03.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.504+0000 7f258af1d640 1 -- start start 2023-11-28T20:10:03.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.504+0000 7f258af1d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f258406c9d0 0x7f258415a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.504+0000 7f258af1d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258415b3a0 con 0x7f258413cf30 2023-11-28T20:10:03.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.504+0000 7f258af1d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258413f720 con 0x7f258415ab70 2023-11-28T20:10:03.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.504+0000 7f258af1d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258413d310 con 0x7f258406c9d0 2023-11-28T20:10:03.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.504+0000 7f2588cb9640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f258413cf30 0x7f258406c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45232/0 (socket says 172.21.15.177:45232) 2023-11-28T20:10:03.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.504+0000 7f2588cb9640 1 -- 172.21.15.177:0/4209712816 learned_addr learned my addr 172.21.15.177:0/4209712816 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:03.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.504+0000 7f2583fff640 1 --2- 172.21.15.177:0/4209712816 >> v2:172.21.15.177:3300/0 conn(0x7f258406c9d0 0x7f258415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.508+0000 7f25837fe640 1 -- 172.21.15.177:0/4209712816 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768825250 0 0) 0x7f258415b3a0 con 0x7f258413cf30 2023-11-28T20:10:03.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.508+0000 7f25837fe640 1 -- 172.21.15.177:0/4209712816 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2574003530 con 0x7f258413cf30 2023-11-28T20:10:03.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.508+0000 7f2583fff640 1 -- 172.21.15.177:0/4209712816 >> v1:172.21.15.195:6789/0 conn(0x7f258415ab70 legacy=0x7f25840cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.508+0000 7f2583fff640 1 -- 172.21.15.177:0/4209712816 >> v1:172.21.15.177:6789/0 conn(0x7f258413cf30 legacy=0x7f258406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.508+0000 7f2583fff640 1 -- 172.21.15.177:0/4209712816 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258413fa00 con 0x7f258406c9d0 2023-11-28T20:10:03.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.508+0000 7f2583fff640 1 --2- 172.21.15.177:0/4209712816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f258406c9d0 0x7f258415a630 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f25700097c0 tx=0x7f257001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5acfe3b4a38cbc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:03.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.508+0000 7f25837fe640 1 -- 172.21.15.177:0/4209712816 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25700ab600 con 0x7f258406c9d0 2023-11-28T20:10:03.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.508+0000 7f25837fe640 1 -- 172.21.15.177:0/4209712816 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25700a7050 con 0x7f258406c9d0 2023-11-28T20:10:03.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.508+0000 7f25837fe640 1 -- 172.21.15.177:0/4209712816 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25700ab980 con 0x7f258406c9d0 2023-11-28T20:10:03.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.508+0000 7f258af1d640 1 -- 172.21.15.177:0/4209712816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f258406c9d0 msgr2=0x7f258415a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.508+0000 7f258af1d640 1 --2- 172.21.15.177:0/4209712816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f258406c9d0 0x7f258415a630 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f25700097c0 tx=0x7f257001c3f0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f258af1d640 1 -- 172.21.15.177:0/4209712816 shutdown_connections 2023-11-28T20:10:03.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f258af1d640 1 --2- 172.21.15.177:0/4209712816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f258406c9d0 0x7f258415a630 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f258af1d640 1 -- 172.21.15.177:0/4209712816 >> 172.21.15.177:0/4209712816 conn(0x7f258406a530 msgr2=0x7f258406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:03.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f258af1d640 1 -- 172.21.15.177:0/4209712816 shutdown_connections 2023-11-28T20:10:03.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f258af1d640 1 -- 172.21.15.177:0/4209712816 wait complete. 2023-11-28T20:10:03.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f258af1d640 1 Processor -- start 2023-11-28T20:10:03.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f258af1d640 1 -- start start 2023-11-28T20:10:03.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f258af1d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f258406c9d0 0x7f2584158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f258af1d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f258413cf30 0x7f2584155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f258af1d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f258415ab70 0x7f258413a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f258af1d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25841596e0 con 0x7f258406c9d0 2023-11-28T20:10:03.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f258af1d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2584158a60 con 0x7f258415ab70 2023-11-28T20:10:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f258af1d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2584158d40 con 0x7f258413cf30 2023-11-28T20:10:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f2588cb9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f258406c9d0 0x7f2584158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f2588cb9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f258406c9d0 0x7f2584158210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46932/0 (socket says 172.21.15.177:46932) 2023-11-28T20:10:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f2588cb9640 1 -- 172.21.15.177:0/2991451970 learned_addr learned my addr 172.21.15.177:0/2991451970 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f2583fff640 1 --2- 172.21.15.177:0/2991451970 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f258413cf30 0x7f2584155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f25894ba640 1 --2- 172.21.15.177:0/2991451970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f258415ab70 0x7f258413a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f2588cb9640 1 -- 172.21.15.177:0/2991451970 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f258413cf30 msgr2=0x7f2584155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f2588cb9640 1 --2- 172.21.15.177:0/2991451970 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f258413cf30 0x7f2584155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f2588cb9640 1 -- 172.21.15.177:0/2991451970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f258415ab70 msgr2=0x7f258413a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f2588cb9640 1 --2- 172.21.15.177:0/2991451970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f258415ab70 0x7f258413a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f2588cb9640 1 -- 172.21.15.177:0/2991451970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2570009420 con 0x7f258406c9d0 2023-11-28T20:10:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.512+0000 7f2583fff640 1 --2- 172.21.15.177:0/2991451970 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f258413cf30 0x7f2584155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:03.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.516+0000 7f2588cb9640 1 --2- 172.21.15.177:0/2991451970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f258406c9d0 0x7f2584158210 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f257800c4d0 tx=0x7f257800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:03.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.516+0000 7f25817fa640 1 -- 172.21.15.177:0/2991451970 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2578005cf0 con 0x7f258406c9d0 2023-11-28T20:10:03.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.516+0000 7f25817fa640 1 -- 172.21.15.177:0/2991451970 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2578005e50 con 0x7f258406c9d0 2023-11-28T20:10:03.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.516+0000 7f25817fa640 1 -- 172.21.15.177:0/2991451970 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2578007270 con 0x7f258406c9d0 2023-11-28T20:10:03.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.516+0000 7f258af1d640 1 -- 172.21.15.177:0/2991451970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2584159020 con 0x7f258406c9d0 2023-11-28T20:10:03.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.516+0000 7f258af1d640 1 -- 172.21.15.177:0/2991451970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2584158750 con 0x7f258406c9d0 2023-11-28T20:10:03.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.516+0000 7f258af1d640 1 -- 172.21.15.177:0/2991451970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2584070440 con 0x7f258406c9d0 2023-11-28T20:10:03.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.516+0000 7f25817fa640 1 -- 172.21.15.177:0/2991451970 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25780073d0 con 0x7f258406c9d0 2023-11-28T20:10:03.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.516+0000 7f25817fa640 1 --2- 172.21.15.177:0/2991451970 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2568066470 0x7f2568068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.516+0000 7f25817fa640 1 -- 172.21.15.177:0/2991451970 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25780833e0 con 0x7f258406c9d0 2023-11-28T20:10:03.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.516+0000 7f2583fff640 1 --2- 172.21.15.177:0/2991451970 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2568066470 0x7f2568068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.520+0000 7f2583fff640 1 --2- 172.21.15.177:0/2991451970 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2568066470 0x7f2568068930 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f25700ad000 tx=0x7f2570008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:03.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.520+0000 7f25817fa640 1 -- 172.21.15.177:0/2991451970 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2584070440 con 0x7f258406c9d0 2023-11-28T20:10:03.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.672+0000 7f258af1d640 1 -- 172.21.15.177:0/2991451970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2584070440 con 0x7f258406c9d0 2023-11-28T20:10:03.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.676+0000 7f25817fa640 1 -- 172.21.15.177:0/2991451970 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f2584070440 con 0x7f258406c9d0 2023-11-28T20:10:03.679 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:03.679 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":49,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:09:44.664848+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:09:40.777720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T20:09:42.029277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:10:03.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.676+0000 7f258af1d640 1 -- 172.21.15.177:0/2991451970 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2568066470 msgr2=0x7f2568068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.676+0000 7f258af1d640 1 --2- 172.21.15.177:0/2991451970 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2568066470 0x7f2568068930 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f25700ad000 tx=0x7f2570008040 comp rx=0 tx=0).stop 2023-11-28T20:10:03.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.676+0000 7f258af1d640 1 -- 172.21.15.177:0/2991451970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f258406c9d0 msgr2=0x7f2584158210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.676+0000 7f258af1d640 1 --2- 172.21.15.177:0/2991451970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f258406c9d0 0x7f2584158210 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f257800c4d0 tx=0x7f257800c990 comp rx=0 tx=0).stop 2023-11-28T20:10:03.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.676+0000 7f258af1d640 1 -- 172.21.15.177:0/2991451970 shutdown_connections 2023-11-28T20:10:03.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.676+0000 7f258af1d640 1 --2- 172.21.15.177:0/2991451970 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2568066470 0x7f2568068930 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.676+0000 7f258af1d640 1 --2- 172.21.15.177:0/2991451970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f258415ab70 0x7f258413a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.676+0000 7f258af1d640 1 --2- 172.21.15.177:0/2991451970 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f258413cf30 0x7f2584155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.676+0000 7f258af1d640 1 --2- 172.21.15.177:0/2991451970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f258406c9d0 0x7f2584158210 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.676+0000 7f258af1d640 1 -- 172.21.15.177:0/2991451970 >> 172.21.15.177:0/2991451970 conn(0x7f258406a530 msgr2=0x7f258415c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:03.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.676+0000 7f258af1d640 1 -- 172.21.15.177:0/2991451970 shutdown_connections 2023-11-28T20:10:03.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.676+0000 7f258af1d640 1 -- 172.21.15.177:0/2991451970 wait complete. 2023-11-28T20:10:03.700 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:09:40.777720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:09:42.029277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:10:03.701 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:10:03.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.836+0000 7f6c14956640 1 Processor -- start 2023-11-28T20:10:03.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.836+0000 7f6c14956640 1 -- start start 2023-11-28T20:10:03.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c14956640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6c1015d050 0x7f6c100cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c14956640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c1015d430 0x7f6c100cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c14956640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c100ce370 con 0x7f6c1006c6e0 2023-11-28T20:10:03.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c14956640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1006b640 con 0x7f6c1015d050 2023-11-28T20:10:03.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c14956640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1006b920 con 0x7f6c1015d430 2023-11-28T20:10:03.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c0ed9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6c1015d050 0x7f6c100cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c0f59e640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f6c1006c6e0 0x7f6c10160d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45236/0 (socket says 172.21.15.177:45236) 2023-11-28T20:10:03.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c0f59e640 1 -- 172.21.15.177:0/23857745 learned_addr learned my addr 172.21.15.177:0/23857745 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:03.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c0ed9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6c1015d050 0x7f6c100cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46936/0 (socket says 172.21.15.177:46936) 2023-11-28T20:10:03.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c07fff640 1 --2- 172.21.15.177:0/23857745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c1015d430 0x7f6c100cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c0ed9d640 1 -- 172.21.15.177:0/23857745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c1015d430 msgr2=0x7f6c100cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:03.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c0ed9d640 1 --2- 172.21.15.177:0/23857745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c1015d430 0x7f6c100cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c0ed9d640 1 -- 172.21.15.177:0/23857745 >> v1:172.21.15.177:6789/0 conn(0x7f6c1006c6e0 legacy=0x7f6c10160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c0ed9d640 1 -- 172.21.15.177:0/23857745 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1006bc00 con 0x7f6c1015d050 2023-11-28T20:10:03.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c0e59c640 1 -- 172.21.15.177:0/23857745 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104682720 0 0) 0x7f6c100ce370 con 0x7f6c1006c6e0 2023-11-28T20:10:03.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c07fff640 1 --2- 172.21.15.177:0/23857745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c1015d430 0x7f6c100cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:03.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.840+0000 7f6c0ed9d640 1 --2- 172.21.15.177:0/23857745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1015d050 0x7f6c100cfa80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6c000097c0 tx=0x7f6c0001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2369af815322cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:03.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c0e59c640 1 -- 172.21.15.177:0/23857745 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000a8970 con 0x7f6c1015d050 2023-11-28T20:10:03.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c0e59c640 1 -- 172.21.15.177:0/23857745 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c000a8ad0 con 0x7f6c1015d050 2023-11-28T20:10:03.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c0e59c640 1 -- 172.21.15.177:0/23857745 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000a8e60 con 0x7f6c1015d050 2023-11-28T20:10:03.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 -- 172.21.15.177:0/23857745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1015d050 msgr2=0x7f6c100cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 --2- 172.21.15.177:0/23857745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1015d050 0x7f6c100cfa80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6c000097c0 tx=0x7f6c0001ec70 comp rx=0 tx=0).stop 2023-11-28T20:10:03.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 -- 172.21.15.177:0/23857745 shutdown_connections 2023-11-28T20:10:03.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 --2- 172.21.15.177:0/23857745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c1015d430 0x7f6c100cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 --2- 172.21.15.177:0/23857745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1015d050 0x7f6c100cfa80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 -- 172.21.15.177:0/23857745 >> 172.21.15.177:0/23857745 conn(0x7f6c100b2860 msgr2=0x7f6c100b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:03.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 -- 172.21.15.177:0/23857745 shutdown_connections 2023-11-28T20:10:03.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 -- 172.21.15.177:0/23857745 wait complete. 2023-11-28T20:10:03.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 Processor -- start 2023-11-28T20:10:03.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 -- start start 2023-11-28T20:10:03.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c1006c6e0 0x7f6c100c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c1015d050 0x7f6c1015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1015d430 0x7f6c100ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c101f6920 con 0x7f6c1015d430 2023-11-28T20:10:03.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100c9210 con 0x7f6c1015d050 2023-11-28T20:10:03.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c14956640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c101f6b70 con 0x7f6c1006c6e0 2023-11-28T20:10:03.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c0f59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1015d430 0x7f6c100ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c0f59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1015d430 0x7f6c100ca680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46944/0 (socket says 172.21.15.177:46944) 2023-11-28T20:10:03.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.844+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3358535606 learned_addr learned my addr 172.21.15.177:0/3358535606 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:03.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3358535606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c1006c6e0 msgr2=0x7f6c100c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c0f59e640 1 --2- 172.21.15.177:0/3358535606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c1006c6e0 0x7f6c100c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c07fff640 1 --2- 172.21.15.177:0/3358535606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c1015d050 0x7f6c1015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3358535606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c1015d050 msgr2=0x7f6c1015b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c0f59e640 1 --2- 172.21.15.177:0/3358535606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c1015d050 0x7f6c1015b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c0f59e640 1 -- 172.21.15.177:0/3358535606 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c00009420 con 0x7f6c1015d430 2023-11-28T20:10:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c0f59e640 1 --2- 172.21.15.177:0/3358535606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1015d430 0x7f6c100ca680 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6c08001570 tx=0x7f6c0800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c077fe640 1 -- 172.21.15.177:0/3358535606 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800a640 con 0x7f6c1015d430 2023-11-28T20:10:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c077fe640 1 -- 172.21.15.177:0/3358535606 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0800a7c0 con 0x7f6c1015d430 2023-11-28T20:10:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c077fe640 1 -- 172.21.15.177:0/3358535606 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800ab70 con 0x7f6c1015d430 2023-11-28T20:10:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c14956640 1 -- 172.21.15.177:0/3358535606 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c101f6e50 con 0x7f6c1015d430 2023-11-28T20:10:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c14956640 1 -- 172.21.15.177:0/3358535606 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c101f7410 con 0x7f6c1015d430 2023-11-28T20:10:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c14956640 1 -- 172.21.15.177:0/3358535606 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1006d2b0 con 0x7f6c1015d430 2023-11-28T20:10:03.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c077fe640 1 -- 172.21.15.177:0/3358535606 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c0800acd0 con 0x7f6c1015d430 2023-11-28T20:10:03.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c077fe640 1 --2- 172.21.15.177:0/3358535606 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bf0066470 0x7f6bf0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:03.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c077fe640 1 -- 172.21.15.177:0/3358535606 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c08083480 con 0x7f6c1015d430 2023-11-28T20:10:03.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.848+0000 7f6c0ed9d640 1 --2- 172.21.15.177:0/3358535606 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bf0066470 0x7f6bf0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:03.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.852+0000 7f6c0ed9d640 1 --2- 172.21.15.177:0/3358535606 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bf0066470 0x7f6bf0068930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6c000b2000 tx=0x7f6c00004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:03.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:03.852+0000 7f6c077fe640 1 -- 172.21.15.177:0/3358535606 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c080508f0 con 0x7f6c1015d430 2023-11-28T20:10:04.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.004+0000 7f6c14956640 1 -- 172.21.15.177:0/3358535606 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c100d0870 con 0x7f6c1015d430 2023-11-28T20:10:04.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.004+0000 7f6c077fe640 1 -- 172.21.15.177:0/3358535606 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c080180a0 con 0x7f6c1015d430 2023-11-28T20:10:04.009 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:10:04.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.008+0000 7f6c14956640 1 -- 172.21.15.177:0/3358535606 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bf0066470 msgr2=0x7f6bf0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.008+0000 7f6c14956640 1 --2- 172.21.15.177:0/3358535606 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bf0066470 0x7f6bf0068930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6c000b2000 tx=0x7f6c00004740 comp rx=0 tx=0).stop 2023-11-28T20:10:04.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.008+0000 7f6c14956640 1 -- 172.21.15.177:0/3358535606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1015d430 msgr2=0x7f6c100ca680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.008+0000 7f6c14956640 1 --2- 172.21.15.177:0/3358535606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1015d430 0x7f6c100ca680 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6c08001570 tx=0x7f6c0800cca0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.008+0000 7f6c14956640 1 -- 172.21.15.177:0/3358535606 shutdown_connections 2023-11-28T20:10:04.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.008+0000 7f6c14956640 1 --2- 172.21.15.177:0/3358535606 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6bf0066470 0x7f6bf0068930 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.008+0000 7f6c14956640 1 --2- 172.21.15.177:0/3358535606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1015d430 0x7f6c100ca680 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.008+0000 7f6c14956640 1 --2- 172.21.15.177:0/3358535606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c1015d050 0x7f6c1015b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.008+0000 7f6c14956640 1 --2- 172.21.15.177:0/3358535606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c1006c6e0 0x7f6c100c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.008+0000 7f6c14956640 1 -- 172.21.15.177:0/3358535606 >> 172.21.15.177:0/3358535606 conn(0x7f6c100b2860 msgr2=0x7f6c1006fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:04.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.008+0000 7f6c14956640 1 -- 172.21.15.177:0/3358535606 shutdown_connections 2023-11-28T20:10:04.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.008+0000 7f6c14956640 1 -- 172.21.15.177:0/3358535606 wait complete. 2023-11-28T20:10:04.030 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:10:04.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f7939f0f640 1 Processor -- start 2023-11-28T20:10:04.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f7939f0f640 1 -- start start 2023-11-28T20:10:04.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f7939f0f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7934158ca0 0x7f793415eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f7939f0f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f79340cba10 0x7f793415be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f7939f0f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793415b670 con 0x7f79340b42d0 2023-11-28T20:10:04.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f7939f0f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f793415f410 con 0x7f79340cba10 2023-11-28T20:10:04.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f7939f0f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793415f6f0 con 0x7f7934158ca0 2023-11-28T20:10:04.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f7933fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f79340b42d0 0x7f79340703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45244/0 (socket says 172.21.15.177:45244) 2023-11-28T20:10:04.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f7933fff640 1 -- 172.21.15.177:0/28322296 learned_addr learned my addr 172.21.15.177:0/28322296 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:04.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f79337fe640 1 --2- 172.21.15.177:0/28322296 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7934158ca0 0x7f793415eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f792bfff640 1 --2- 172.21.15.177:0/28322296 >> v2:172.21.15.195:3300/0 conn(0x7f79340cba10 0x7f793415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f7932ffd640 1 -- 172.21.15.177:0/28322296 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375456032 0 0) 0x7f793415b670 con 0x7f79340b42d0 2023-11-28T20:10:04.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f7932ffd640 1 -- 172.21.15.177:0/28322296 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7920003530 con 0x7f79340b42d0 2023-11-28T20:10:04.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f79337fe640 1 -- 172.21.15.177:0/28322296 >> v2:172.21.15.195:3300/0 conn(0x7f79340cba10 msgr2=0x7f793415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:04.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f79337fe640 1 --2- 172.21.15.177:0/28322296 >> v2:172.21.15.195:3300/0 conn(0x7f79340cba10 0x7f793415be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f79337fe640 1 -- 172.21.15.177:0/28322296 >> v1:172.21.15.177:6789/0 conn(0x7f79340b42d0 legacy=0x7f79340703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f79337fe640 1 -- 172.21.15.177:0/28322296 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793415b8e0 con 0x7f7934158ca0 2023-11-28T20:10:04.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.168+0000 7f792bfff640 1 --2- 172.21.15.177:0/28322296 >> v2:172.21.15.195:3300/0 conn(0x7f79340cba10 0x7f793415be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:10:04.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.172+0000 7f79337fe640 1 --2- 172.21.15.177:0/28322296 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7934158ca0 0x7f793415eb50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f79240097c0 tx=0x7f792401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86c5e14cb77f9b66 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:04.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.172+0000 7f7932ffd640 1 -- 172.21.15.177:0/28322296 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79240a6040 con 0x7f7934158ca0 2023-11-28T20:10:04.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.172+0000 7f7932ffd640 1 -- 172.21.15.177:0/28322296 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79240aa600 con 0x7f7934158ca0 2023-11-28T20:10:04.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.172+0000 7f7932ffd640 1 -- 172.21.15.177:0/28322296 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79240aa990 con 0x7f7934158ca0 2023-11-28T20:10:04.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.172+0000 7f7939f0f640 1 -- 172.21.15.177:0/28322296 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7934158ca0 msgr2=0x7f793415eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.172+0000 7f7939f0f640 1 --2- 172.21.15.177:0/28322296 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7934158ca0 0x7f793415eb50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f79240097c0 tx=0x7f792401c480 comp rx=0 tx=0).stop 2023-11-28T20:10:04.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.172+0000 7f7939f0f640 1 -- 172.21.15.177:0/28322296 shutdown_connections 2023-11-28T20:10:04.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.172+0000 7f7939f0f640 1 --2- 172.21.15.177:0/28322296 >> v2:172.21.15.195:3300/0 conn(0x7f79340cba10 0x7f793415be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.172+0000 7f7939f0f640 1 --2- 172.21.15.177:0/28322296 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7934158ca0 0x7f793415eb50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.172+0000 7f7939f0f640 1 -- 172.21.15.177:0/28322296 >> 172.21.15.177:0/28322296 conn(0x7f79340b0cc0 msgr2=0x7f79340b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:04.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.172+0000 7f7939f0f640 1 -- 172.21.15.177:0/28322296 shutdown_connections 2023-11-28T20:10:04.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.172+0000 7f7939f0f640 1 -- 172.21.15.177:0/28322296 wait complete. 2023-11-28T20:10:04.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f7939f0f640 1 Processor -- start 2023-11-28T20:10:04.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f7939f0f640 1 -- start start 2023-11-28T20:10:04.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f7939f0f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79340b42d0 0x7f79341f6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f7939f0f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79340cba10 0x7f7934153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f7939f0f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7934158ca0 0x7f7934154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f7939f0f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7934154000 con 0x7f79340cba10 2023-11-28T20:10:04.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f7939f0f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79341561b0 con 0x7f79340b42d0 2023-11-28T20:10:04.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f7939f0f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7934156490 con 0x7f7934158ca0 2023-11-28T20:10:04.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f792bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79340cba10 0x7f7934153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f792bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79340cba10 0x7f7934153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46954/0 (socket says 172.21.15.177:46954) 2023-11-28T20:10:04.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f792bfff640 1 -- 172.21.15.177:0/1704962863 learned_addr learned my addr 172.21.15.177:0/1704962863 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:04.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f79337fe640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79340b42d0 0x7f79341f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f7933fff640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7934158ca0 0x7f7934154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f792bfff640 1 -- 172.21.15.177:0/1704962863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7934158ca0 msgr2=0x7f7934154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f792bfff640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7934158ca0 0x7f7934154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f792bfff640 1 -- 172.21.15.177:0/1704962863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79340b42d0 msgr2=0x7f79341f6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f792bfff640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79340b42d0 0x7f79341f6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f792bfff640 1 -- 172.21.15.177:0/1704962863 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c009420 con 0x7f79340cba10 2023-11-28T20:10:04.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f79337fe640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79340b42d0 0x7f79341f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:04.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f7933fff640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7934158ca0 0x7f7934154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:04.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f792bfff640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79340cba10 0x7f7934153ac0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f791c00e9d0 tx=0x7f791c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:04.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f7930ff9640 1 -- 172.21.15.177:0/1704962863 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00ca60 con 0x7f79340cba10 2023-11-28T20:10:04.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f7930ff9640 1 -- 172.21.15.177:0/1704962863 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c00cbc0 con 0x7f79340cba10 2023-11-28T20:10:04.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f7930ff9640 1 -- 172.21.15.177:0/1704962863 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c013470 con 0x7f79340cba10 2023-11-28T20:10:04.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f7939f0f640 1 -- 172.21.15.177:0/1704962863 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7924009420 con 0x7f79340cba10 2023-11-28T20:10:04.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.176+0000 7f7939f0f640 1 -- 172.21.15.177:0/1704962863 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7934156a50 con 0x7f79340cba10 2023-11-28T20:10:04.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.180+0000 7f7939f0f640 1 -- 172.21.15.177:0/1704962863 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79340693d0 con 0x7f79340cba10 2023-11-28T20:10:04.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.180+0000 7f7930ff9640 1 -- 172.21.15.177:0/1704962863 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f791c0135d0 con 0x7f79340cba10 2023-11-28T20:10:04.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.180+0000 7f7930ff9640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f79140664a0 0x7f7914068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.180+0000 7f7930ff9640 1 -- 172.21.15.177:0/1704962863 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f791c083da0 con 0x7f79340cba10 2023-11-28T20:10:04.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.180+0000 7f79337fe640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f79140664a0 0x7f7914068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.180+0000 7f79337fe640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f79140664a0 0x7f7914068960 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f79240ae000 tx=0x7f79240a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:04.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.184+0000 7f7930ff9640 1 -- 172.21.15.177:0/1704962863 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f791c051210 con 0x7f79340cba10 2023-11-28T20:10:04.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.336+0000 7f7939f0f640 1 -- 172.21.15.177:0/1704962863 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79340716b0 con 0x7f79340cba10 2023-11-28T20:10:04.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.336+0000 7f7930ff9640 1 -- 172.21.15.177:0/1704962863 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f791c054830 con 0x7f79340cba10 2023-11-28T20:10:04.340 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:10:04.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.336+0000 7f7939f0f640 1 -- 172.21.15.177:0/1704962863 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f79140664a0 msgr2=0x7f7914068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.336+0000 7f7939f0f640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f79140664a0 0x7f7914068960 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f79240ae000 tx=0x7f79240a7000 comp rx=0 tx=0).stop 2023-11-28T20:10:04.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.336+0000 7f7939f0f640 1 -- 172.21.15.177:0/1704962863 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79340cba10 msgr2=0x7f7934153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.336+0000 7f7939f0f640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79340cba10 0x7f7934153ac0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f791c00e9d0 tx=0x7f791c00ee90 comp rx=0 tx=0).stop 2023-11-28T20:10:04.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.336+0000 7f7939f0f640 1 -- 172.21.15.177:0/1704962863 shutdown_connections 2023-11-28T20:10:04.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.336+0000 7f7939f0f640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f79140664a0 0x7f7914068960 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.336+0000 7f7939f0f640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7934158ca0 0x7f7934154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.336+0000 7f7939f0f640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79340cba10 0x7f7934153ac0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.336+0000 7f7939f0f640 1 --2- 172.21.15.177:0/1704962863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79340b42d0 0x7f79341f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.336+0000 7f7939f0f640 1 -- 172.21.15.177:0/1704962863 >> 172.21.15.177:0/1704962863 conn(0x7f79340b0cc0 msgr2=0x7f79341653b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:04.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.336+0000 7f7939f0f640 1 -- 172.21.15.177:0/1704962863 shutdown_connections 2023-11-28T20:10:04.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.336+0000 7f7939f0f640 1 -- 172.21.15.177:0/1704962863 wait complete. 2023-11-28T20:10:04.362 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:10:04.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.500+0000 7f901ea6b640 1 Processor -- start 2023-11-28T20:10:04.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.500+0000 7f901ea6b640 1 -- start start 2023-11-28T20:10:04.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.500+0000 7f901ea6b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f901815adb0 0x7f901813d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.500+0000 7f901ea6b640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901813d2b0 con 0x7f9018071d90 2023-11-28T20:10:04.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.500+0000 7f901ea6b640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90180cdd70 con 0x7f901813f5f0 2023-11-28T20:10:04.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.500+0000 7f901ea6b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9018140520 con 0x7f901815adb0 2023-11-28T20:10:04.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.500+0000 7f900ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f901815adb0 0x7f901813d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.500+0000 7f900ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f901815adb0 0x7f901813d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46968/0 (socket says 172.21.15.177:46968) 2023-11-28T20:10:04.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.500+0000 7f900ffff640 1 -- 172.21.15.177:0/3858320170 learned_addr learned my addr 172.21.15.177:0/3858320170 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:04.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.500+0000 7f901c807640 1 --1- 172.21.15.177:0/3858320170 >> v1:172.21.15.177:6789/0 conn(0x7f9018071d90 0x7f9018072170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45250/0 (socket says 172.21.15.177:45250) 2023-11-28T20:10:04.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.500+0000 7f900ffff640 1 -- 172.21.15.177:0/3858320170 >> v1:172.21.15.195:6789/0 conn(0x7f901813f5f0 legacy=0x7f90180ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.500+0000 7f900ffff640 1 -- 172.21.15.177:0/3858320170 >> v1:172.21.15.177:6789/0 conn(0x7f9018071d90 legacy=0x7f9018072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.500+0000 7f900ffff640 1 -- 172.21.15.177:0/3858320170 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901813ff60 con 0x7f901815adb0 2023-11-28T20:10:04.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.500+0000 7f900f7fe640 1 -- 172.21.15.177:0/3858320170 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304955586 0 0) 0x7f901813d2b0 con 0x7f9018071d90 2023-11-28T20:10:04.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.504+0000 7f900ffff640 1 --2- 172.21.15.177:0/3858320170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901815adb0 0x7f901813d560 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9008009870 tx=0x7f900801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0aaee51a95fee2d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:04.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.504+0000 7f900f7fe640 1 -- 172.21.15.177:0/3858320170 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080a7070 con 0x7f901815adb0 2023-11-28T20:10:04.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.504+0000 7f900f7fe640 1 -- 172.21.15.177:0/3858320170 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90080ab430 con 0x7f901815adb0 2023-11-28T20:10:04.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.504+0000 7f900f7fe640 1 -- 172.21.15.177:0/3858320170 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080ab7c0 con 0x7f901815adb0 2023-11-28T20:10:04.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.504+0000 7f901ea6b640 1 -- 172.21.15.177:0/3858320170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901815adb0 msgr2=0x7f901813d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.504+0000 7f901ea6b640 1 --2- 172.21.15.177:0/3858320170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901815adb0 0x7f901813d560 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9008009870 tx=0x7f900801c540 comp rx=0 tx=0).stop 2023-11-28T20:10:04.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.504+0000 7f901ea6b640 1 -- 172.21.15.177:0/3858320170 shutdown_connections 2023-11-28T20:10:04.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.504+0000 7f901ea6b640 1 --2- 172.21.15.177:0/3858320170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901815adb0 0x7f901813d560 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.504+0000 7f901ea6b640 1 -- 172.21.15.177:0/3858320170 >> 172.21.15.177:0/3858320170 conn(0x7f90180b0cc0 msgr2=0x7f90180b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:04.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.504+0000 7f901ea6b640 1 -- 172.21.15.177:0/3858320170 shutdown_connections 2023-11-28T20:10:04.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.504+0000 7f901ea6b640 1 -- 172.21.15.177:0/3858320170 wait complete. 2023-11-28T20:10:04.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f901ea6b640 1 Processor -- start 2023-11-28T20:10:04.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f901ea6b640 1 -- start start 2023-11-28T20:10:04.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f901ea6b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9018071d90 0x7f9018139b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f901ea6b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901813f5f0 0x7f9018143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f901ea6b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901815adb0 0x7f901814e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f901ea6b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901814f550 con 0x7f901813f5f0 2023-11-28T20:10:04.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f901ea6b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90181425f0 con 0x7f9018071d90 2023-11-28T20:10:04.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f901ea6b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901814ef90 con 0x7f901815adb0 2023-11-28T20:10:04.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f900ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901813f5f0 0x7f9018143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f900ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901813f5f0 0x7f9018143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46980/0 (socket says 172.21.15.177:46980) 2023-11-28T20:10:04.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f900ffff640 1 -- 172.21.15.177:0/299794729 learned_addr learned my addr 172.21.15.177:0/299794729 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:04.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f901c807640 1 --2- 172.21.15.177:0/299794729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9018071d90 0x7f9018139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f901d008640 1 --2- 172.21.15.177:0/299794729 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901815adb0 0x7f901814e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f900ffff640 1 -- 172.21.15.177:0/299794729 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901815adb0 msgr2=0x7f901814e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f900ffff640 1 --2- 172.21.15.177:0/299794729 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901815adb0 0x7f901814e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f900ffff640 1 -- 172.21.15.177:0/299794729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9018071d90 msgr2=0x7f9018139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f900ffff640 1 --2- 172.21.15.177:0/299794729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9018071d90 0x7f9018139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f900ffff640 1 -- 172.21.15.177:0/299794729 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90080094d0 con 0x7f901813f5f0 2023-11-28T20:10:04.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f901c807640 1 --2- 172.21.15.177:0/299794729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9018071d90 0x7f9018139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:04.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f900ffff640 1 --2- 172.21.15.177:0/299794729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901813f5f0 0x7f9018143090 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f90080ad040 tx=0x7f900801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:04.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f900d7fa640 1 -- 172.21.15.177:0/299794729 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080b4800 con 0x7f901813f5f0 2023-11-28T20:10:04.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f900d7fa640 1 -- 172.21.15.177:0/299794729 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90080b4980 con 0x7f901813f5f0 2023-11-28T20:10:04.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f901ea6b640 1 -- 172.21.15.177:0/299794729 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901814f270 con 0x7f901813f5f0 2023-11-28T20:10:04.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f900d7fa640 1 -- 172.21.15.177:0/299794729 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080b4d30 con 0x7f901813f5f0 2023-11-28T20:10:04.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.508+0000 7f901ea6b640 1 -- 172.21.15.177:0/299794729 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9018142b70 con 0x7f901813f5f0 2023-11-28T20:10:04.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.512+0000 7f901ea6b640 1 -- 172.21.15.177:0/299794729 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9018142d60 con 0x7f901813f5f0 2023-11-28T20:10:04.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.512+0000 7f900d7fa640 1 -- 172.21.15.177:0/299794729 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f90080b3380 con 0x7f901813f5f0 2023-11-28T20:10:04.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.512+0000 7f900d7fa640 1 --2- 172.21.15.177:0/299794729 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9004066470 0x7f9004068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.512+0000 7f900d7fa640 1 -- 172.21.15.177:0/299794729 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f900811dc30 con 0x7f901813f5f0 2023-11-28T20:10:04.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.512+0000 7f901c807640 1 --2- 172.21.15.177:0/299794729 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9004066470 0x7f9004068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.512+0000 7f901c807640 1 --2- 172.21.15.177:0/299794729 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9004066470 0x7f9004068930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9014000f70 tx=0x7f9014007c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:04.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.516+0000 7f900d7fa640 1 -- 172.21.15.177:0/299794729 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90080eb010 con 0x7f901813f5f0 2023-11-28T20:10:04.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.668+0000 7f901ea6b640 1 -- 172.21.15.177:0/299794729 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90180693d0 con 0x7f901813f5f0 2023-11-28T20:10:04.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.668+0000 7f900d7fa640 1 -- 172.21.15.177:0/299794729 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f90080ee630 con 0x7f901813f5f0 2023-11-28T20:10:04.673 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:10:04.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.672+0000 7f901ea6b640 1 -- 172.21.15.177:0/299794729 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9004066470 msgr2=0x7f9004068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.672+0000 7f901ea6b640 1 --2- 172.21.15.177:0/299794729 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9004066470 0x7f9004068930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9014000f70 tx=0x7f9014007c60 comp rx=0 tx=0).stop 2023-11-28T20:10:04.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.672+0000 7f901ea6b640 1 -- 172.21.15.177:0/299794729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901813f5f0 msgr2=0x7f9018143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.672+0000 7f901ea6b640 1 --2- 172.21.15.177:0/299794729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901813f5f0 0x7f9018143090 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f90080ad040 tx=0x7f900801ad80 comp rx=0 tx=0).stop 2023-11-28T20:10:04.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.672+0000 7f901ea6b640 1 -- 172.21.15.177:0/299794729 shutdown_connections 2023-11-28T20:10:04.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.672+0000 7f901ea6b640 1 --2- 172.21.15.177:0/299794729 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f9004066470 0x7f9004068930 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.672+0000 7f901ea6b640 1 --2- 172.21.15.177:0/299794729 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901815adb0 0x7f901814e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.672+0000 7f901ea6b640 1 --2- 172.21.15.177:0/299794729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f901813f5f0 0x7f9018143090 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.672+0000 7f901ea6b640 1 --2- 172.21.15.177:0/299794729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9018071d90 0x7f9018139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.672+0000 7f901ea6b640 1 -- 172.21.15.177:0/299794729 >> 172.21.15.177:0/299794729 conn(0x7f90180b0cc0 msgr2=0x7f901813e070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:04.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.672+0000 7f901ea6b640 1 -- 172.21.15.177:0/299794729 shutdown_connections 2023-11-28T20:10:04.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.672+0000 7f901ea6b640 1 -- 172.21.15.177:0/299794729 wait complete. 2023-11-28T20:10:04.695 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:10:04.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.828+0000 7fe020f96640 1 Processor -- start 2023-11-28T20:10:04.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.828+0000 7fe020f96640 1 -- start start 2023-11-28T20:10:04.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.832+0000 7fe020f96640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe01c144840 0x7fe01c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.832+0000 7fe020f96640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01c0710e0 con 0x7fe01c070b70 2023-11-28T20:10:04.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.832+0000 7fe020f96640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01c0713c0 con 0x7fe01c072180 2023-11-28T20:10:04.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.832+0000 7fe020f96640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01c15f010 con 0x7fe01c144840 2023-11-28T20:10:04.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.832+0000 7fe01ad9d640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe01c070b70 0x7fe01c15b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45258/0 (socket says 172.21.15.177:45258) 2023-11-28T20:10:04.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.832+0000 7fe01ad9d640 1 -- 172.21.15.177:0/317383074 learned_addr learned my addr 172.21.15.177:0/317383074 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:04.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.832+0000 7fe01a59c640 1 --2- 172.21.15.177:0/317383074 >> v2:172.21.15.195:3300/0 conn(0x7fe01c144840 0x7fe01c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.832+0000 7fe019d9b640 1 -- 172.21.15.177:0/317383074 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393706618 0 0) 0x7fe01c0710e0 con 0x7fe01c070b70 2023-11-28T20:10:04.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.832+0000 7fe019d9b640 1 -- 172.21.15.177:0/317383074 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe008003530 con 0x7fe01c070b70 2023-11-28T20:10:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.832+0000 7fe01a59c640 1 -- 172.21.15.177:0/317383074 >> v1:172.21.15.195:6789/0 conn(0x7fe01c072180 legacy=0x7fe01c070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.832+0000 7fe01a59c640 1 -- 172.21.15.177:0/317383074 >> v1:172.21.15.177:6789/0 conn(0x7fe01c070b70 legacy=0x7fe01c15b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.832+0000 7fe01a59c640 1 -- 172.21.15.177:0/317383074 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c0716a0 con 0x7fe01c144840 2023-11-28T20:10:04.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.836+0000 7fe01a59c640 1 --2- 172.21.15.177:0/317383074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe01c144840 0x7fe01c06c2c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0097c0 tx=0x7fe00c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10921e1d0fa5de08 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:04.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.836+0000 7fe019d9b640 1 -- 172.21.15.177:0/317383074 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0ad660 con 0x7fe01c144840 2023-11-28T20:10:04.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.836+0000 7fe019d9b640 1 -- 172.21.15.177:0/317383074 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c0ad7c0 con 0x7fe01c144840 2023-11-28T20:10:04.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.836+0000 7fe019d9b640 1 -- 172.21.15.177:0/317383074 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0adb50 con 0x7fe01c144840 2023-11-28T20:10:04.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.836+0000 7fe020f96640 1 -- 172.21.15.177:0/317383074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe01c144840 msgr2=0x7fe01c06c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.836+0000 7fe020f96640 1 --2- 172.21.15.177:0/317383074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe01c144840 0x7fe01c06c2c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0097c0 tx=0x7fe00c01c450 comp rx=0 tx=0).stop 2023-11-28T20:10:04.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.836+0000 7fe020f96640 1 -- 172.21.15.177:0/317383074 shutdown_connections 2023-11-28T20:10:04.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.836+0000 7fe020f96640 1 --2- 172.21.15.177:0/317383074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe01c144840 0x7fe01c06c2c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.836+0000 7fe020f96640 1 -- 172.21.15.177:0/317383074 >> 172.21.15.177:0/317383074 conn(0x7fe01c06a530 msgr2=0x7fe01c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:04.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.836+0000 7fe020f96640 1 -- 172.21.15.177:0/317383074 shutdown_connections 2023-11-28T20:10:04.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.836+0000 7fe020f96640 1 -- 172.21.15.177:0/317383074 wait complete. 2023-11-28T20:10:04.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.836+0000 7fe020f96640 1 Processor -- start 2023-11-28T20:10:04.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.836+0000 7fe020f96640 1 -- start start 2023-11-28T20:10:04.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe020f96640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe01c070b70 0x7fe01c0ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe020f96640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe01c072180 0x7fe01c158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe020f96640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe01c144840 0x7fe01c13b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe020f96640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c0aea90 con 0x7fe01c070b70 2023-11-28T20:10:04.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe020f96640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c158570 con 0x7fe01c144840 2023-11-28T20:10:04.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe020f96640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c0a89f0 con 0x7fe01c072180 2023-11-28T20:10:04.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe01a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe01c070b70 0x7fe01c0ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe01a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe01c070b70 0x7fe01c0ae550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46988/0 (socket says 172.21.15.177:46988) 2023-11-28T20:10:04.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe01a59c640 1 -- 172.21.15.177:0/2289541601 learned_addr learned my addr 172.21.15.177:0/2289541601 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:04.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe013fff640 1 --2- 172.21.15.177:0/2289541601 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe01c072180 0x7fe01c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe01ad9d640 1 --2- 172.21.15.177:0/2289541601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe01c144840 0x7fe01c13b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe01a59c640 1 -- 172.21.15.177:0/2289541601 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe01c072180 msgr2=0x7fe01c158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe01a59c640 1 --2- 172.21.15.177:0/2289541601 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe01c072180 0x7fe01c158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe01a59c640 1 -- 172.21.15.177:0/2289541601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe01c144840 msgr2=0x7fe01c13b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:04.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe01a59c640 1 --2- 172.21.15.177:0/2289541601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe01c144840 0x7fe01c13b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:04.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe01a59c640 1 -- 172.21.15.177:0/2289541601 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c009420 con 0x7fe01c070b70 2023-11-28T20:10:04.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe01a59c640 1 --2- 172.21.15.177:0/2289541601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe01c070b70 0x7fe01c0ae550 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fe00c01a080 tx=0x7fe00c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:04.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe012ffd640 1 -- 172.21.15.177:0/2289541601 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0b9650 con 0x7fe01c070b70 2023-11-28T20:10:04.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe012ffd640 1 -- 172.21.15.177:0/2289541601 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c0b97b0 con 0x7fe01c070b70 2023-11-28T20:10:04.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe020f96640 1 -- 172.21.15.177:0/2289541601 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01c0a8cd0 con 0x7fe01c070b70 2023-11-28T20:10:04.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe012ffd640 1 -- 172.21.15.177:0/2289541601 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0b9b60 con 0x7fe01c070b70 2023-11-28T20:10:04.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe020f96640 1 -- 172.21.15.177:0/2289541601 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c0a9290 con 0x7fe01c070b70 2023-11-28T20:10:04.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.840+0000 7fe020f96640 1 -- 172.21.15.177:0/2289541601 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c069440 con 0x7fe01c070b70 2023-11-28T20:10:04.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.844+0000 7fe012ffd640 1 -- 172.21.15.177:0/2289541601 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe00c0b9cc0 con 0x7fe01c070b70 2023-11-28T20:10:04.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.844+0000 7fe012ffd640 1 --2- 172.21.15.177:0/2289541601 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdffc066470 0x7fdffc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:04.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.844+0000 7fe012ffd640 1 -- 172.21.15.177:0/2289541601 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe00c11e750 con 0x7fe01c070b70 2023-11-28T20:10:04.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.844+0000 7fe013fff640 1 --2- 172.21.15.177:0/2289541601 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdffc066470 0x7fdffc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:04.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.844+0000 7fe013fff640 1 --2- 172.21.15.177:0/2289541601 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdffc066470 0x7fdffc068930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe01c140230 tx=0x7fe004009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:04.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:04.848+0000 7fe012ffd640 1 -- 172.21.15.177:0/2289541601 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe00c0ebbe0 con 0x7fe01c070b70 2023-11-28T20:10:05.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:05.008+0000 7fe020f96640 1 -- 172.21.15.177:0/2289541601 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe01c15c530 con 0x7fe01c070b70 2023-11-28T20:10:05.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:05.008+0000 7fe012ffd640 1 -- 172.21.15.177:0/2289541601 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe01c15c530 con 0x7fe01c070b70 2023-11-28T20:10:05.013 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:10:05.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:05.012+0000 7fe020f96640 1 -- 172.21.15.177:0/2289541601 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdffc066470 msgr2=0x7fdffc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:05.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:05.012+0000 7fe020f96640 1 --2- 172.21.15.177:0/2289541601 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdffc066470 0x7fdffc068930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe01c140230 tx=0x7fe004009040 comp rx=0 tx=0).stop 2023-11-28T20:10:05.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:05.012+0000 7fe020f96640 1 -- 172.21.15.177:0/2289541601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe01c070b70 msgr2=0x7fe01c0ae550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:05.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:05.012+0000 7fe020f96640 1 --2- 172.21.15.177:0/2289541601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe01c070b70 0x7fe01c0ae550 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fe00c01a080 tx=0x7fe00c01ac90 comp rx=0 tx=0).stop 2023-11-28T20:10:05.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:05.012+0000 7fe020f96640 1 -- 172.21.15.177:0/2289541601 shutdown_connections 2023-11-28T20:10:05.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:05.012+0000 7fe020f96640 1 --2- 172.21.15.177:0/2289541601 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdffc066470 0x7fdffc068930 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:05.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:05.012+0000 7fe020f96640 1 --2- 172.21.15.177:0/2289541601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe01c144840 0x7fe01c13b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:05.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:05.012+0000 7fe020f96640 1 --2- 172.21.15.177:0/2289541601 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe01c072180 0x7fe01c158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:05.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:05.012+0000 7fe020f96640 1 --2- 172.21.15.177:0/2289541601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe01c070b70 0x7fe01c0ae550 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:05.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:05.012+0000 7fe020f96640 1 -- 172.21.15.177:0/2289541601 >> 172.21.15.177:0/2289541601 conn(0x7fe01c06a530 msgr2=0x7fe01c0aecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:05.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:05.012+0000 7fe020f96640 1 -- 172.21.15.177:0/2289541601 shutdown_connections 2023-11-28T20:10:05.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:05.012+0000 7fe020f96640 1 -- 172.21.15.177:0/2289541601 wait complete. 2023-11-28T20:10:05.034 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-11-28T20:10:05.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:05.034 DEBUG:teuthology.orchestra.run.smithi177:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T20:10:05.053 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[52227]: fuse finished with error 0 and tester_r 0 2023-11-28T20:10:05.055 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:10:10.171 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:10:10.175 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:10:11.157 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:10:11.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:11.158 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T20:10:11.168 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:10:11.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.352+0000 7fee47cd6640 1 Processor -- start 2023-11-28T20:10:11.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.352+0000 7fee47cd6640 1 -- start start 2023-11-28T20:10:11.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.356+0000 7fee47cd6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fee40144840 0x7fee4006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:11.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.356+0000 7fee47cd6640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fee40072180 0x7fee4006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:11.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.356+0000 7fee47cd6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee400710e0 con 0x7fee40070460 2023-11-28T20:10:11.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.356+0000 7fee47cd6640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4015f010 con 0x7fee40144840 2023-11-28T20:10:11.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.356+0000 7fee47cd6640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee400713c0 con 0x7fee40072180 2023-11-28T20:10:11.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.356+0000 7fee45a72640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fee40144840 0x7fee4006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:11.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.356+0000 7fee45a72640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fee40144840 0x7fee4006c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48554/0 (socket says 172.21.15.177:48554) 2023-11-28T20:10:11.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.356+0000 7fee45a72640 1 -- 172.21.15.177:0/2763167007 learned_addr learned my addr 172.21.15.177:0/2763167007 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:11.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.356+0000 7fee45a72640 1 -- 172.21.15.177:0/2763167007 >> v2:172.21.15.195:3300/0 conn(0x7fee40072180 msgr2=0x7fee4006c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:11.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.356+0000 7fee45a72640 1 --2- 172.21.15.177:0/2763167007 >> v2:172.21.15.195:3300/0 conn(0x7fee40072180 0x7fee4006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:11.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.356+0000 7fee45a72640 1 -- 172.21.15.177:0/2763167007 >> v1:172.21.15.195:6789/0 conn(0x7fee40070460 legacy=0x7fee40070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:11.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.356+0000 7fee45a72640 1 -- 172.21.15.177:0/2763167007 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee400716a0 con 0x7fee40144840 2023-11-28T20:10:11.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.360+0000 7fee45a72640 1 --2- 172.21.15.177:0/2763167007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee40144840 0x7fee4006c2c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fee4006d140 tx=0x7fee3c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8a1238bd3de462 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.360+0000 7fee44a70640 1 -- 172.21.15.177:0/2763167007 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0aa5f0 con 0x7fee40144840 2023-11-28T20:10:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.360+0000 7fee44a70640 1 -- 172.21.15.177:0/2763167007 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c0aa750 con 0x7fee40144840 2023-11-28T20:10:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.360+0000 7fee44a70640 1 -- 172.21.15.177:0/2763167007 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0aaae0 con 0x7fee40144840 2023-11-28T20:10:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.360+0000 7fee47cd6640 1 -- 172.21.15.177:0/2763167007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee40144840 msgr2=0x7fee4006c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.360+0000 7fee47cd6640 1 --2- 172.21.15.177:0/2763167007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee40144840 0x7fee4006c2c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fee4006d140 tx=0x7fee3c01c490 comp rx=0 tx=0).stop 2023-11-28T20:10:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.360+0000 7fee47cd6640 1 -- 172.21.15.177:0/2763167007 shutdown_connections 2023-11-28T20:10:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.360+0000 7fee47cd6640 1 --2- 172.21.15.177:0/2763167007 >> v2:172.21.15.195:3300/0 conn(0x7fee40072180 0x7fee4006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.360+0000 7fee47cd6640 1 --2- 172.21.15.177:0/2763167007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee40144840 0x7fee4006c2c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.360+0000 7fee47cd6640 1 -- 172.21.15.177:0/2763167007 >> 172.21.15.177:0/2763167007 conn(0x7fee4006a530 msgr2=0x7fee4006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.360+0000 7fee47cd6640 1 -- 172.21.15.177:0/2763167007 shutdown_connections 2023-11-28T20:10:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.360+0000 7fee47cd6640 1 -- 172.21.15.177:0/2763167007 wait complete. 2023-11-28T20:10:11.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.360+0000 7fee47cd6640 1 Processor -- start 2023-11-28T20:10:11.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.360+0000 7fee47cd6640 1 -- start start 2023-11-28T20:10:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee47cd6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee40070460 0x7fee4013f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee47cd6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee40072180 0x7fee400b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee47cd6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee40144840 0x7fee40165520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee47cd6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee400b2cd0 con 0x7fee40072180 2023-11-28T20:10:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee47cd6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee400b2fa0 con 0x7fee40070460 2023-11-28T20:10:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee47cd6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee400b3280 con 0x7fee40144840 2023-11-28T20:10:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee45271640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee40072180 0x7fee400b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee45271640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee40072180 0x7fee400b2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48568/0 (socket says 172.21.15.177:48568) 2023-11-28T20:10:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee45271640 1 -- 172.21.15.177:0/2248130651 learned_addr learned my addr 172.21.15.177:0/2248130651 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee46273640 1 --2- 172.21.15.177:0/2248130651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee40144840 0x7fee40165520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee45a72640 1 --2- 172.21.15.177:0/2248130651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee40070460 0x7fee4013f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee45271640 1 -- 172.21.15.177:0/2248130651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee40144840 msgr2=0x7fee40165520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee45271640 1 --2- 172.21.15.177:0/2248130651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee40144840 0x7fee40165520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee45271640 1 -- 172.21.15.177:0/2248130651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee40070460 msgr2=0x7fee4013f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee45271640 1 --2- 172.21.15.177:0/2248130651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee40070460 0x7fee4013f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee45271640 1 -- 172.21.15.177:0/2248130651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c0094d0 con 0x7fee40072180 2023-11-28T20:10:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee46273640 1 --2- 172.21.15.177:0/2248130651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee40144840 0x7fee40165520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee45271640 1 --2- 172.21.15.177:0/2248130651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee40072180 0x7fee400b2790 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fee3000b480 tx=0x7fee3000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee367fc640 1 -- 172.21.15.177:0/2248130651 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30010870 con 0x7fee40072180 2023-11-28T20:10:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee367fc640 1 -- 172.21.15.177:0/2248130651 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee300109f0 con 0x7fee40072180 2023-11-28T20:10:11.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee367fc640 1 -- 172.21.15.177:0/2248130651 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30010da0 con 0x7fee40072180 2023-11-28T20:10:11.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee47cd6640 1 -- 172.21.15.177:0/2248130651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee400b3560 con 0x7fee40072180 2023-11-28T20:10:11.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee47cd6640 1 -- 172.21.15.177:0/2248130651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee400b3b20 con 0x7fee40072180 2023-11-28T20:10:11.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee47cd6640 1 -- 172.21.15.177:0/2248130651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee400b3d10 con 0x7fee40072180 2023-11-28T20:10:11.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.364+0000 7fee367fc640 1 -- 172.21.15.177:0/2248130651 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fee3000f3c0 con 0x7fee40072180 2023-11-28T20:10:11.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.368+0000 7fee367fc640 1 --2- 172.21.15.177:0/2248130651 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee24066470 0x7fee24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:11.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.368+0000 7fee367fc640 1 -- 172.21.15.177:0/2248130651 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee30083e70 con 0x7fee40072180 2023-11-28T20:10:11.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.368+0000 7fee45a72640 1 --2- 172.21.15.177:0/2248130651 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee24066470 0x7fee24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:11.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.368+0000 7fee45a72640 1 --2- 172.21.15.177:0/2248130651 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee24066470 0x7fee24068930 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0ae000 tx=0x7fee3c0b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:11.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.372+0000 7fee367fc640 1 -- 172.21.15.177:0/2248130651 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fee30051390 con 0x7fee40072180 2023-11-28T20:10:11.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.552+0000 7fee47cd6640 1 -- 172.21.15.177:0/2248130651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fee40069440 con 0x7fee40072180 2023-11-28T20:10:11.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.556+0000 7fee367fc640 1 -- 172.21.15.177:0/2248130651 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7fee30014060 con 0x7fee40072180 2023-11-28T20:10:11.559 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:10:11.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.556+0000 7fee47cd6640 1 -- 172.21.15.177:0/2248130651 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee24066470 msgr2=0x7fee24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:11.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.556+0000 7fee47cd6640 1 --2- 172.21.15.177:0/2248130651 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee24066470 0x7fee24068930 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0ae000 tx=0x7fee3c0b5040 comp rx=0 tx=0).stop 2023-11-28T20:10:11.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.556+0000 7fee47cd6640 1 -- 172.21.15.177:0/2248130651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee40072180 msgr2=0x7fee400b2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.556+0000 7fee47cd6640 1 --2- 172.21.15.177:0/2248130651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee40072180 0x7fee400b2790 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fee3000b480 tx=0x7fee3000b940 comp rx=0 tx=0).stop 2023-11-28T20:10:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.556+0000 7fee47cd6640 1 -- 172.21.15.177:0/2248130651 shutdown_connections 2023-11-28T20:10:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.556+0000 7fee47cd6640 1 --2- 172.21.15.177:0/2248130651 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fee24066470 0x7fee24068930 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.556+0000 7fee47cd6640 1 --2- 172.21.15.177:0/2248130651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee40144840 0x7fee40165520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.556+0000 7fee47cd6640 1 --2- 172.21.15.177:0/2248130651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee40072180 0x7fee400b2790 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:11.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.556+0000 7fee47cd6640 1 --2- 172.21.15.177:0/2248130651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee40070460 0x7fee4013f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:11.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.556+0000 7fee47cd6640 1 -- 172.21.15.177:0/2248130651 >> 172.21.15.177:0/2248130651 conn(0x7fee4006a530 msgr2=0x7fee4015fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:11.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.556+0000 7fee47cd6640 1 -- 172.21.15.177:0/2248130651 shutdown_connections 2023-11-28T20:10:11.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:11.556+0000 7fee47cd6640 1 -- 172.21.15.177:0/2248130651 wait complete. 2023-11-28T20:10:11.579 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T20:10:11.579 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:10:11.580 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-11-28T20:10:11.580 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T20:10:11.580 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:10:11.580 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T20:10:11.580 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T20:10:11.580 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:10:11.580 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:10:11.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:11.581 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-11-28T20:10:11.591 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:10:11.591 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:10:11.591 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:10:11.592 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:10:11.592 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-11-28T20:10:11.592 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:10:11.592 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:10:11.592 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:10:11.592 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-11-28T20:10:11.592 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:10:11.593 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:10:11.593 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-11-28T20:10:11.593 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:10:11.593 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-11-28T20:10:11.593 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:10:11.593 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-11-28T20:10:11.594 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:10:11.594 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42262sec preferred_lft 42262sec 2023-11-28T20:10:11.594 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-11-28T20:10:11.594 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:10:11.594 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:10:11.594 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:91:19:71:65 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:10:11.594 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:10:11.595 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:10:11.595 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:10:11.595 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:10:11.595 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:10:11.595 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:10:11.595 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:10:11.595 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:10:11.596 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:10:11.596 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:10:11.596 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:10:11.596 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:10:11.596 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:10:11.596 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:10:11.596 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-28T20:10:11.596 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:10:11.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:11.597 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:10:11.656 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-11-28T20:10:11.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:11.658 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-11-28T20:10:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-11-28T20:10:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:10:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:10:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:10:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:10:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:10:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:10:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:10:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:10:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:10:11.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:11.720 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-28T20:10:11.720 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-28T20:10:11.720 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:10:11.720 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:10:11.721 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:10:11.721 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-28T20:10:11.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:11.810 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-11-28T20:10:11.867 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T20:10:11.867 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T20:10:11.867 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:10:11.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:11.868 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-11-28T20:10:11.930 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T20:10:11.930 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:10:11.930 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T20:10:11.982 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:10:11.982 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:10:11.982 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:10:12.034 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:10:12.098 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:10:12.151 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:10:12.152 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:10:12.152 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:10:12.152 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:10:12.152 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:10:12.152 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:10:12.152 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:10:12.152 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:10:12.152 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:10:12.152 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:10:12.152 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:10:12.153 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:10:12.153 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:10:12.153 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:10:12.153 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:10:12.153 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:10:12.153 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:10:12.153 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:10:12.153 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:10:12.153 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:10:12.153 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:10:12.153 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:10:12.153 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:10:12.154 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:10:12.154 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:10:12.154 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:10:12.154 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:10:12.154 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:10:12.154 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:10:12.154 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:10:12.154 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:10:12.154 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:10:12.154 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:10:12.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:12.155 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:10:12.205 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T20:10:12.206 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T20:10:12.253 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-11-28T20:10:12.274 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:10:12.328 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-11-28T20:10:12.328 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-11-28T20:10:12.328 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-11-28T20:10:12.328 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-11-28T20:10:12.328 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-11-28T20:10:12.328 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-11-28T20:10:12.328 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-11-28T20:10:12.328 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-11-28T20:10:12.328 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-11-28T20:10:12.328 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-11-28T20:10:12.329 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-11-28T20:10:12.329 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-11-28T20:10:12.329 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:10:12.329 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-11-28T20:10:12.329 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-11-28T20:10:12.329 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-11-28T20:10:12.329 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-11-28T20:10:12.329 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-11-28T20:10:12.329 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-11-28T20:10:12.329 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-11-28T20:10:12.329 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:10:12.329 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-11-28T20:10:12.329 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-11-28T20:10:12.330 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-11-28T20:10:12.330 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:10:12.330 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:10:12.330 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:10:12.330 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:10:12.330 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-11-28T20:10:12.330 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:10:12.330 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:10:12.330 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:10:12.330 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:10:12.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:12.331 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-11-28T20:10:12.350 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-11-28T20:10:12.344+0000 7f2648148580 -1 init, newargv = 0x5604bae30020 newargc=15 2023-11-28T20:10:12.350 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[52626]: starting ceph client 2023-11-28T20:10:12.357 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[52626]: starting fuse 2023-11-28T20:10:12.360 INFO:teuthology.orchestra.run.smithi177.stdout:43 2023-11-28T20:10:12.360 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T20:10:12.361 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-11-28T20:10:12.361 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-11-28T20:10:12.361 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-11-28T20:10:12.361 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-11-28T20:10:12.361 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-11-28T20:10:12.362 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:10:12.362 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-11-28T20:10:12.362 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T20:10:12.362 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-11-28T20:10:12.362 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T20:10:12.363 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:10:12.363 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-11-28T20:10:12.363 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-11-28T20:10:12.363 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-11-28T20:10:12.364 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-11-28T20:10:12.364 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:10:12.364 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-11-28T20:10:12.364 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T20:10:12.364 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T20:10:12.365 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T20:10:12.365 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-11-28T20:10:12.365 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-11-28T20:10:12.365 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-11-28T20:10:12.365 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T20:10:12.366 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:10:12.366 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-11-28T20:10:12.366 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-11-28T20:10:12.483 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.52626.asok 2023-11-28T20:10:12.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T20:10:12.495 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52626.asok 2023-11-28T20:10:12.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:12.495 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52626.asok status 2023-11-28T20:10:12.667 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:10:12.667 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-11-28T20:10:12.667 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T20:10:12.667 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T20:10:12.667 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-11-28T20:10:12.667 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-11-28T20:10:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T20:10:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "52626", 2023-11-28T20:10:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-11-28T20:10:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:10:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-11-28T20:10:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-11-28T20:10:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 6273, 2023-11-28T20:10:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-11-28T20:10:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-11-28T20:10:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-11-28T20:10:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 6273 2023-11-28T20:10:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:10:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:10:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:10:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:10:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1720181505 2023-11-28T20:10:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-28T20:10:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:10:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-11-28T20:10:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-11-28T20:10:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:10:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1720181505 2023-11-28T20:10:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-28T20:10:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.6273 192.168.0.1:0/1720181505", 2023-11-28T20:10:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/1720181505", 2023-11-28T20:10:12.670 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-11-28T20:10:12.670 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 26, 2023-11-28T20:10:12.670 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 49, 2023-11-28T20:10:12.670 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-11-28T20:10:12.670 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-11-28T20:10:12.670 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-11-28T20:10:12.670 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:10:12.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:12.682 DEBUG:teuthology.orchestra.run.smithi177:> stat --file-system '--printf=%T 2023-11-28T20:10:12.682 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T20:10:12.693 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-11-28T20:10:12.693 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T20:10:12.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:12.694 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:10:12.753 DEBUG:teuthology.orchestra.run.smithi177:> stdin-killer -- python3 -c ' 2023-11-28T20:10:12.754 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-11-28T20:10:12.754 DEBUG:teuthology.orchestra.run.smithi177:> import errno 2023-11-28T20:10:12.754 DEBUG:teuthology.orchestra.run.smithi177:> 2023-11-28T20:10:12.754 DEBUG:teuthology.orchestra.run.smithi177:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-11-28T20:10:12.754 DEBUG:teuthology.orchestra.run.smithi177:> try: 2023-11-28T20:10:12.754 DEBUG:teuthology.orchestra.run.smithi177:> if True: 2023-11-28T20:10:12.754 DEBUG:teuthology.orchestra.run.smithi177:> ret = os.read(fd, 1024) 2023-11-28T20:10:12.754 DEBUG:teuthology.orchestra.run.smithi177:> else: 2023-11-28T20:10:12.754 DEBUG:teuthology.orchestra.run.smithi177:> os.write(fd, b'"'"'content'"'"') 2023-11-28T20:10:12.754 DEBUG:teuthology.orchestra.run.smithi177:> except OSError as e: 2023-11-28T20:10:12.754 DEBUG:teuthology.orchestra.run.smithi177:> if e.errno != errno.EPERM: 2023-11-28T20:10:12.754 DEBUG:teuthology.orchestra.run.smithi177:> raise 2023-11-28T20:10:12.754 DEBUG:teuthology.orchestra.run.smithi177:> else: 2023-11-28T20:10:12.755 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("client does not check permission of data pool") 2023-11-28T20:10:12.755 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-11-28T20:10:12.863 INFO:teuthology.orchestra.run.smithi177.stderr:Traceback (most recent call last): 2023-11-28T20:10:12.864 INFO:teuthology.orchestra.run.smithi177.stderr: File "", line 15, in 2023-11-28T20:10:12.864 INFO:teuthology.orchestra.run.smithi177.stderr:RuntimeError: client does not check permission of data pool 2023-11-28T20:10:12.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:12 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2023-11-28T20:10:12.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:10:12.873 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2023-11-28T20:10:13.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa205efe640 1 Processor -- start 2023-11-28T20:10:13.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa205efe640 1 -- start start 2023-11-28T20:10:13.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa205efe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2000ce3d0 0x7fa200164b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:13.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa205efe640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2000ced10 con 0x7fa200072530 2023-11-28T20:10:13.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa205efe640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2000cea30 con 0x7fa20013d0a0 2023-11-28T20:10:13.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa205efe640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20013d480 con 0x7fa2000ce3d0 2023-11-28T20:10:13.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa1feffd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fa200072530 0x7fa2000cdcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:55470/0 (socket says 172.21.15.177:55470) 2023-11-28T20:10:13.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa1feffd640 1 -- 172.21.15.177:0/1990677683 learned_addr learned my addr 172.21.15.177:0/1990677683 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:13.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa1fffff640 1 --2- 172.21.15.177:0/1990677683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2000ce3d0 0x7fa200164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:13.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa1fe7fc640 1 -- 172.21.15.177:0/1990677683 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402367867 0 0) 0x7fa2000ced10 con 0x7fa200072530 2023-11-28T20:10:13.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa1fe7fc640 1 -- 172.21.15.177:0/1990677683 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1e8005740 con 0x7fa200072530 2023-11-28T20:10:13.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa1fe7fc640 1 -- 172.21.15.177:0/1990677683 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443474672 0 0) 0x7fa2000cea30 con 0x7fa20013d0a0 2023-11-28T20:10:13.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa1fe7fc640 1 -- 172.21.15.177:0/1990677683 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2000ced10 con 0x7fa20013d0a0 2023-11-28T20:10:13.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa1fffff640 1 -- 172.21.15.177:0/1990677683 >> v1:172.21.15.195:6789/0 conn(0x7fa20013d0a0 legacy=0x7fa200071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:13.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa1fffff640 1 -- 172.21.15.177:0/1990677683 >> v1:172.21.15.177:6789/0 conn(0x7fa200072530 legacy=0x7fa2000cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:13.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.056+0000 7fa1fffff640 1 -- 172.21.15.177:0/1990677683 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20013d800 con 0x7fa2000ce3d0 2023-11-28T20:10:13.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.060+0000 7fa1fffff640 1 --2- 172.21.15.177:0/1990677683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2000ce3d0 0x7fa200164b90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009dc0 tx=0x7fa1f801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60d9fe858c438eae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:13.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.060+0000 7fa1fe7fc640 1 -- 172.21.15.177:0/1990677683 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80a5790 con 0x7fa2000ce3d0 2023-11-28T20:10:13.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.060+0000 7fa1fe7fc640 1 -- 172.21.15.177:0/1990677683 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f80a58f0 con 0x7fa2000ce3d0 2023-11-28T20:10:13.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.060+0000 7fa1fe7fc640 1 -- 172.21.15.177:0/1990677683 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80a5c80 con 0x7fa2000ce3d0 2023-11-28T20:10:13.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.060+0000 7fa205efe640 1 -- 172.21.15.177:0/1990677683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2000ce3d0 msgr2=0x7fa200164b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:13.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.060+0000 7fa205efe640 1 --2- 172.21.15.177:0/1990677683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2000ce3d0 0x7fa200164b90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009dc0 tx=0x7fa1f801c8e0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.060+0000 7fa205efe640 1 -- 172.21.15.177:0/1990677683 shutdown_connections 2023-11-28T20:10:13.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.060+0000 7fa205efe640 1 --2- 172.21.15.177:0/1990677683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2000ce3d0 0x7fa200164b90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.060+0000 7fa205efe640 1 -- 172.21.15.177:0/1990677683 >> 172.21.15.177:0/1990677683 conn(0x7fa2000b0cc0 msgr2=0x7fa2000b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:13.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.060+0000 7fa205efe640 1 -- 172.21.15.177:0/1990677683 shutdown_connections 2023-11-28T20:10:13.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.060+0000 7fa205efe640 1 -- 172.21.15.177:0/1990677683 wait complete. 2023-11-28T20:10:13.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa205efe640 1 Processor -- start 2023-11-28T20:10:13.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa205efe640 1 -- start start 2023-11-28T20:10:13.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa205efe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa200072530 0x7fa200134380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:13.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa205efe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2000ce3d0 0x7fa20013f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:13.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa205efe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa20013d0a0 0x7fa20013fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:13.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa205efe640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa200158840 con 0x7fa2000ce3d0 2023-11-28T20:10:13.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa205efe640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa200158c60 con 0x7fa20013d0a0 2023-11-28T20:10:13.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa205efe640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa200155080 con 0x7fa200072530 2023-11-28T20:10:13.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa1feffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2000ce3d0 0x7fa20013f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:13.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa1feffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2000ce3d0 0x7fa20013f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48572/0 (socket says 172.21.15.177:48572) 2023-11-28T20:10:13.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa1feffd640 1 -- 172.21.15.177:0/1681181748 learned_addr learned my addr 172.21.15.177:0/1681181748 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:13.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa1ff7fe640 1 --2- 172.21.15.177:0/1681181748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa200072530 0x7fa200134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:13.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa1fffff640 1 --2- 172.21.15.177:0/1681181748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa20013d0a0 0x7fa20013fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:13.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa1feffd640 1 -- 172.21.15.177:0/1681181748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa200072530 msgr2=0x7fa200134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:13.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa1feffd640 1 --2- 172.21.15.177:0/1681181748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa200072530 0x7fa200134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa1feffd640 1 -- 172.21.15.177:0/1681181748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa20013d0a0 msgr2=0x7fa20013fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:13.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa1feffd640 1 --2- 172.21.15.177:0/1681181748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa20013d0a0 0x7fa20013fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa1feffd640 1 -- 172.21.15.177:0/1681181748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8009a70 con 0x7fa2000ce3d0 2023-11-28T20:10:13.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa1feffd640 1 --2- 172.21.15.177:0/1681181748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2000ce3d0 0x7fa20013f690 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4005890 tx=0x7fa1f400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:13.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa1e7fff640 1 -- 172.21.15.177:0/1681181748 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4005cf0 con 0x7fa2000ce3d0 2023-11-28T20:10:13.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa1e7fff640 1 -- 172.21.15.177:0/1681181748 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f4005e50 con 0x7fa2000ce3d0 2023-11-28T20:10:13.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa1e7fff640 1 -- 172.21.15.177:0/1681181748 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4007270 con 0x7fa2000ce3d0 2023-11-28T20:10:13.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa205efe640 1 -- 172.21.15.177:0/1681181748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20013f500 con 0x7fa2000ce3d0 2023-11-28T20:10:13.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa205efe640 1 -- 172.21.15.177:0/1681181748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa200157ec0 con 0x7fa2000ce3d0 2023-11-28T20:10:13.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.064+0000 7fa205efe640 1 -- 172.21.15.177:0/1681181748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa200158980 con 0x7fa2000ce3d0 2023-11-28T20:10:13.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.068+0000 7fa1e7fff640 1 -- 172.21.15.177:0/1681181748 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa1f40073d0 con 0x7fa2000ce3d0 2023-11-28T20:10:13.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.068+0000 7fa1e7fff640 1 --2- 172.21.15.177:0/1681181748 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa1ec066470 0x7fa1ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:13.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.068+0000 7fa1e7fff640 1 -- 172.21.15.177:0/1681181748 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1f40832e0 con 0x7fa2000ce3d0 2023-11-28T20:10:13.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.068+0000 7fa1ff7fe640 1 --2- 172.21.15.177:0/1681181748 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa1ec066470 0x7fa1ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:13.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.068+0000 7fa1ff7fe640 1 --2- 172.21.15.177:0/1681181748 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa1ec066470 0x7fa1ec068930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00011f0 tx=0x7fa1f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:13.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.072+0000 7fa1e7fff640 1 -- 172.21.15.177:0/1681181748 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa200158980 con 0x7fa2000ce3d0 2023-11-28T20:10:13.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.272+0000 7fa205efe640 1 -- 172.21.15.177:0/1681181748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa200158980 con 0x7fa2000ce3d0 2023-11-28T20:10:13.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.276+0000 7fa1e7fff640 1 -- 172.21.15.177:0/1681181748 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v22) v1 ==== 184+0+141 (secure 0 0 0) 0x7fa1f40170a0 con 0x7fa2000ce3d0 2023-11-28T20:10:13.279 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-11-28T20:10:13.279 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSSGZl+2t5KxAAc/J7x+fjSQR4IkIQJ/X8sw== 2023-11-28T20:10:13.279 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-11-28T20:10:13.279 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-11-28T20:10:13.279 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw pool=cephfs_data" 2023-11-28T20:10:13.280 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-11-28T20:10:13.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.276+0000 7fa205efe640 1 -- 172.21.15.177:0/1681181748 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa1ec066470 msgr2=0x7fa1ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:13.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.276+0000 7fa205efe640 1 --2- 172.21.15.177:0/1681181748 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa1ec066470 0x7fa1ec068930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00011f0 tx=0x7fa1f0009040 comp rx=0 tx=0).stop 2023-11-28T20:10:13.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.276+0000 7fa205efe640 1 -- 172.21.15.177:0/1681181748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2000ce3d0 msgr2=0x7fa20013f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:13.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.276+0000 7fa205efe640 1 --2- 172.21.15.177:0/1681181748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2000ce3d0 0x7fa20013f690 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4005890 tx=0x7fa1f400c960 comp rx=0 tx=0).stop 2023-11-28T20:10:13.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.276+0000 7fa205efe640 1 -- 172.21.15.177:0/1681181748 shutdown_connections 2023-11-28T20:10:13.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.276+0000 7fa205efe640 1 --2- 172.21.15.177:0/1681181748 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa1ec066470 0x7fa1ec068930 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.276+0000 7fa205efe640 1 --2- 172.21.15.177:0/1681181748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa20013d0a0 0x7fa20013fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.276+0000 7fa205efe640 1 --2- 172.21.15.177:0/1681181748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2000ce3d0 0x7fa20013f690 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.276+0000 7fa205efe640 1 --2- 172.21.15.177:0/1681181748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa200072530 0x7fa200134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.276+0000 7fa205efe640 1 -- 172.21.15.177:0/1681181748 >> 172.21.15.177:0/1681181748 conn(0x7fa2000b0cc0 msgr2=0x7fa200071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:13.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.276+0000 7fa205efe640 1 -- 172.21.15.177:0/1681181748 shutdown_connections 2023-11-28T20:10:13.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.276+0000 7fa205efe640 1 -- 172.21.15.177:0/1681181748 wait complete. 2023-11-28T20:10:13.301 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T20:10:13.301 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:10:13.412 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:10:13.500 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T20:10:13.500 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:10:13.500 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:10:13.510 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:10:13.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d3249c640 1 Processor -- start 2023-11-28T20:10:13.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d3249c640 1 -- start start 2023-11-28T20:10:13.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d3249c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d2c06c9d0 0x7f0d2c070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:13.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d3249c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0d2c072180 0x7f0d2c0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:13.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d3249c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2c0710e0 con 0x7f0d2c144840 2023-11-28T20:10:13.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d3249c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2c15f010 con 0x7f0d2c072180 2023-11-28T20:10:13.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d3249c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c070ee0 con 0x7f0d2c06c9d0 2023-11-28T20:10:13.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d30a39640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0d2c072180 0x7f0d2c0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:13.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d30a39640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0d2c072180 0x7f0d2c0709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48576/0 (socket says 172.21.15.177:48576) 2023-11-28T20:10:13.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d30a39640 1 -- 172.21.15.177:0/3511689926 learned_addr learned my addr 172.21.15.177:0/3511689926 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:13.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d2b7fe640 1 --2- 172.21.15.177:0/3511689926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d2c06c9d0 0x7f0d2c070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:13.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d30a39640 1 -- 172.21.15.177:0/3511689926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d2c06c9d0 msgr2=0x7f0d2c070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:13.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d30a39640 1 --2- 172.21.15.177:0/3511689926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d2c06c9d0 0x7f0d2c070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d30a39640 1 -- 172.21.15.177:0/3511689926 >> v1:172.21.15.195:6789/0 conn(0x7f0d2c144840 legacy=0x7f0d2c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:13.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d30a39640 1 -- 172.21.15.177:0/3511689926 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c0713c0 con 0x7f0d2c072180 2023-11-28T20:10:13.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.688+0000 7f0d2b7fe640 1 --2- 172.21.15.177:0/3511689926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d2c06c9d0 0x7f0d2c070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:13.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.692+0000 7f0d30a39640 1 --2- 172.21.15.177:0/3511689926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d2c072180 0x7f0d2c0709a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009e50 tx=0x7f0d2401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662d446eb31c047e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:13.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.692+0000 7f0d2affd640 1 -- 172.21.15.177:0/3511689926 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d240a58a0 con 0x7f0d2c072180 2023-11-28T20:10:13.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.692+0000 7f0d2affd640 1 -- 172.21.15.177:0/3511689926 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d240a5a00 con 0x7f0d2c072180 2023-11-28T20:10:13.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.692+0000 7f0d2affd640 1 -- 172.21.15.177:0/3511689926 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d240a5d90 con 0x7f0d2c072180 2023-11-28T20:10:13.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.692+0000 7f0d3249c640 1 -- 172.21.15.177:0/3511689926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d2c072180 msgr2=0x7f0d2c0709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:13.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.692+0000 7f0d3249c640 1 --2- 172.21.15.177:0/3511689926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d2c072180 0x7f0d2c0709a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009e50 tx=0x7f0d2401c9e0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.692+0000 7f0d3249c640 1 -- 172.21.15.177:0/3511689926 shutdown_connections 2023-11-28T20:10:13.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.692+0000 7f0d3249c640 1 --2- 172.21.15.177:0/3511689926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d2c072180 0x7f0d2c0709a0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.692+0000 7f0d3249c640 1 --2- 172.21.15.177:0/3511689926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d2c06c9d0 0x7f0d2c070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.692+0000 7f0d3249c640 1 -- 172.21.15.177:0/3511689926 >> 172.21.15.177:0/3511689926 conn(0x7f0d2c06a530 msgr2=0x7f0d2c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:13.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.692+0000 7f0d3249c640 1 -- 172.21.15.177:0/3511689926 shutdown_connections 2023-11-28T20:10:13.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.692+0000 7f0d3249c640 1 -- 172.21.15.177:0/3511689926 wait complete. 2023-11-28T20:10:13.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d3249c640 1 Processor -- start 2023-11-28T20:10:13.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d3249c640 1 -- start start 2023-11-28T20:10:13.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d3249c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d2c06c9d0 0x7f0d2c13d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:13.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d3249c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d2c072180 0x7f0d2c1649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:13.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d3249c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d2c144840 0x7f0d2c157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:13.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d3249c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c165a10 con 0x7f0d2c144840 2023-11-28T20:10:13.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d3249c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0b2710 con 0x7f0d2c072180 2023-11-28T20:10:13.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d3249c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c1f5a30 con 0x7f0d2c06c9d0 2023-11-28T20:10:13.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d30a39640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d2c144840 0x7f0d2c157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:13.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d30a39640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d2c144840 0x7f0d2c157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48588/0 (socket says 172.21.15.177:48588) 2023-11-28T20:10:13.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d30a39640 1 -- 172.21.15.177:0/3115248147 learned_addr learned my addr 172.21.15.177:0/3115248147 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:13.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d2bfff640 1 --2- 172.21.15.177:0/3115248147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d2c06c9d0 0x7f0d2c13d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:13.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d2b7fe640 1 --2- 172.21.15.177:0/3115248147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d2c072180 0x7f0d2c1649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:13.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d30a39640 1 -- 172.21.15.177:0/3115248147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d2c06c9d0 msgr2=0x7f0d2c13d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:13.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d30a39640 1 --2- 172.21.15.177:0/3115248147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d2c06c9d0 0x7f0d2c13d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d30a39640 1 -- 172.21.15.177:0/3115248147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d2c072180 msgr2=0x7f0d2c1649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:13.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d30a39640 1 --2- 172.21.15.177:0/3115248147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d2c072180 0x7f0d2c1649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d30a39640 1 -- 172.21.15.177:0/3115248147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24009b30 con 0x7f0d2c144840 2023-11-28T20:10:13.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d30a39640 1 --2- 172.21.15.177:0/3115248147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d2c144840 0x7f0d2c157120 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0d2401a610 tx=0x7f0d24019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:13.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d28ff9640 1 -- 172.21.15.177:0/3115248147 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d240b8670 con 0x7f0d2c144840 2023-11-28T20:10:13.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d28ff9640 1 -- 172.21.15.177:0/3115248147 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d240b87f0 con 0x7f0d2c144840 2023-11-28T20:10:13.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d3249c640 1 -- 172.21.15.177:0/3115248147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2c164f20 con 0x7f0d2c144840 2023-11-28T20:10:13.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d28ff9640 1 -- 172.21.15.177:0/3115248147 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d240b8ba0 con 0x7f0d2c144840 2023-11-28T20:10:13.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.696+0000 7f0d3249c640 1 -- 172.21.15.177:0/3115248147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2c165450 con 0x7f0d2c144840 2023-11-28T20:10:13.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.700+0000 7f0d3249c640 1 -- 172.21.15.177:0/3115248147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2c0b2850 con 0x7f0d2c144840 2023-11-28T20:10:13.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.700+0000 7f0d28ff9640 1 -- 172.21.15.177:0/3115248147 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0d240b8d00 con 0x7f0d2c144840 2023-11-28T20:10:13.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.700+0000 7f0d28ff9640 1 --2- 172.21.15.177:0/3115248147 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d18066470 0x7f0d18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:13.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.700+0000 7f0d28ff9640 1 -- 172.21.15.177:0/3115248147 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d2411f590 con 0x7f0d2c144840 2023-11-28T20:10:13.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.700+0000 7f0d2bfff640 1 --2- 172.21.15.177:0/3115248147 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d18066470 0x7f0d18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:13.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.700+0000 7f0d2bfff640 1 --2- 172.21.15.177:0/3115248147 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d18066470 0x7f0d18068930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c007fd0 tx=0x7f0d1c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:13.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.704+0000 7f0d28ff9640 1 -- 172.21.15.177:0/3115248147 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0d2c0b2850 con 0x7f0d2c144840 2023-11-28T20:10:13.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.856+0000 7f0d3249c640 1 -- 172.21.15.177:0/3115248147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d2c0b2850 con 0x7f0d2c144840 2023-11-28T20:10:13.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.856+0000 7f0d28ff9640 1 -- 172.21.15.177:0/3115248147 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f0d2c0b2850 con 0x7f0d2c144840 2023-11-28T20:10:13.861 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:13.861 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":49,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:09:44.664848+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:09:40.777720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T20:09:42.029277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:10:13.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.860+0000 7f0d3249c640 1 -- 172.21.15.177:0/3115248147 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d18066470 msgr2=0x7f0d18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:13.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.860+0000 7f0d3249c640 1 --2- 172.21.15.177:0/3115248147 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d18066470 0x7f0d18068930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c007fd0 tx=0x7f0d1c009040 comp rx=0 tx=0).stop 2023-11-28T20:10:13.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.860+0000 7f0d3249c640 1 -- 172.21.15.177:0/3115248147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d2c144840 msgr2=0x7f0d2c157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:13.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.860+0000 7f0d3249c640 1 --2- 172.21.15.177:0/3115248147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d2c144840 0x7f0d2c157120 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0d2401a610 tx=0x7f0d24019780 comp rx=0 tx=0).stop 2023-11-28T20:10:13.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.860+0000 7f0d3249c640 1 -- 172.21.15.177:0/3115248147 shutdown_connections 2023-11-28T20:10:13.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.860+0000 7f0d3249c640 1 --2- 172.21.15.177:0/3115248147 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0d18066470 0x7f0d18068930 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.860+0000 7f0d3249c640 1 --2- 172.21.15.177:0/3115248147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d2c144840 0x7f0d2c157120 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.860+0000 7f0d3249c640 1 --2- 172.21.15.177:0/3115248147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d2c072180 0x7f0d2c1649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.860+0000 7f0d3249c640 1 --2- 172.21.15.177:0/3115248147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d2c06c9d0 0x7f0d2c13d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:13.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.860+0000 7f0d3249c640 1 -- 172.21.15.177:0/3115248147 >> 172.21.15.177:0/3115248147 conn(0x7f0d2c06a530 msgr2=0x7f0d2c15e070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:13.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.860+0000 7f0d3249c640 1 -- 172.21.15.177:0/3115248147 shutdown_connections 2023-11-28T20:10:13.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:13.860+0000 7f0d3249c640 1 -- 172.21.15.177:0/3115248147 wait complete. 2023-11-28T20:10:13.885 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:09:40.777720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:09:42.029277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:10:13.885 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:10:14.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.020+0000 7f90d56c9640 1 Processor -- start 2023-11-28T20:10:14.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.020+0000 7f90d56c9640 1 -- start start 2023-11-28T20:10:14.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.024+0000 7f90d56c9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90d015d2b0 0x7f90d00d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.024+0000 7f90d56c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d00d1cf0 0x7f90d00cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.024+0000 7f90d56c9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d00aff30 con 0x7f90d015d690 2023-11-28T20:10:14.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.024+0000 7f90d56c9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d00b01d0 con 0x7f90d015d2b0 2023-11-28T20:10:14.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.024+0000 7f90d56c9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d00b04b0 con 0x7f90d00d1cf0 2023-11-28T20:10:14.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.024+0000 7f90ceffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90d015d2b0 0x7f90d00d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.024+0000 7f90ceffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90d015d2b0 0x7f90d00d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48604/0 (socket says 172.21.15.177:48604) 2023-11-28T20:10:14.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.024+0000 7f90ceffd640 1 -- 172.21.15.177:0/1301126642 learned_addr learned my addr 172.21.15.177:0/1301126642 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:14.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.024+0000 7f90ce7fc640 1 --2- 172.21.15.177:0/1301126642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d00d1cf0 0x7f90d00cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.024+0000 7f90ceffd640 1 -- 172.21.15.177:0/1301126642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d00d1cf0 msgr2=0x7f90d00cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:14.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.024+0000 7f90ceffd640 1 --2- 172.21.15.177:0/1301126642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d00d1cf0 0x7f90d00cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.024+0000 7f90ceffd640 1 -- 172.21.15.177:0/1301126642 >> v1:172.21.15.177:6789/0 conn(0x7f90d015d690 legacy=0x7f90d00cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.024+0000 7f90ceffd640 1 -- 172.21.15.177:0/1301126642 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d00b0790 con 0x7f90d015d2b0 2023-11-28T20:10:14.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.024+0000 7f90cdffb640 1 -- 172.21.15.177:0/1301126642 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459142445 0 0) 0x7f90d00aff30 con 0x7f90d015d690 2023-11-28T20:10:14.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.028+0000 7f90ceffd640 1 --2- 172.21.15.177:0/1301126642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d015d2b0 0x7f90d00d17b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f90c0009870 tx=0x7f90c001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34ea5a33381a2f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:14.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.028+0000 7f90cdffb640 1 -- 172.21.15.177:0/1301126642 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00aa640 con 0x7f90d015d2b0 2023-11-28T20:10:14.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.028+0000 7f90cdffb640 1 -- 172.21.15.177:0/1301126642 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c00aa7a0 con 0x7f90d015d2b0 2023-11-28T20:10:14.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.028+0000 7f90cdffb640 1 -- 172.21.15.177:0/1301126642 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00aab30 con 0x7f90d015d2b0 2023-11-28T20:10:14.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.028+0000 7f90d56c9640 1 -- 172.21.15.177:0/1301126642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d015d2b0 msgr2=0x7f90d00d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.028+0000 7f90d56c9640 1 --2- 172.21.15.177:0/1301126642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d015d2b0 0x7f90d00d17b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f90c0009870 tx=0x7f90c001c540 comp rx=0 tx=0).stop 2023-11-28T20:10:14.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.028+0000 7f90d56c9640 1 -- 172.21.15.177:0/1301126642 shutdown_connections 2023-11-28T20:10:14.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.028+0000 7f90d56c9640 1 --2- 172.21.15.177:0/1301126642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d00d1cf0 0x7f90d00cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.028+0000 7f90d56c9640 1 --2- 172.21.15.177:0/1301126642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d015d2b0 0x7f90d00d17b0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.028+0000 7f90d56c9640 1 -- 172.21.15.177:0/1301126642 >> 172.21.15.177:0/1301126642 conn(0x7f90d009c510 msgr2=0x7f90d00d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:14.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.028+0000 7f90d56c9640 1 -- 172.21.15.177:0/1301126642 shutdown_connections 2023-11-28T20:10:14.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.028+0000 7f90d56c9640 1 -- 172.21.15.177:0/1301126642 wait complete. 2023-11-28T20:10:14.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.028+0000 7f90d56c9640 1 Processor -- start 2023-11-28T20:10:14.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.028+0000 7f90d56c9640 1 -- start start 2023-11-28T20:10:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90d56c9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d00d1cf0 0x7f90d01535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90d56c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d015d2b0 0x7f90d00cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90d56c9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d015d690 0x7f90d00ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90d56c9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0153b10 con 0x7f90d015d690 2023-11-28T20:10:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90d56c9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d00cb900 con 0x7f90d00d1cf0 2023-11-28T20:10:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90d56c9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d00cacf0 con 0x7f90d015d2b0 2023-11-28T20:10:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90cf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d015d690 0x7f90d00ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90cf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d015d690 0x7f90d00ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48610/0 (socket says 172.21.15.177:48610) 2023-11-28T20:10:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90cf7fe640 1 -- 172.21.15.177:0/3956325 learned_addr learned my addr 172.21.15.177:0/3956325 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90ce7fc640 1 --2- 172.21.15.177:0/3956325 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d015d2b0 0x7f90d00cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90ceffd640 1 --2- 172.21.15.177:0/3956325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d00d1cf0 0x7f90d01535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90cf7fe640 1 -- 172.21.15.177:0/3956325 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d015d2b0 msgr2=0x7f90d00cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90cf7fe640 1 --2- 172.21.15.177:0/3956325 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d015d2b0 0x7f90d00cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90cf7fe640 1 -- 172.21.15.177:0/3956325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d00d1cf0 msgr2=0x7f90d01535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90cf7fe640 1 --2- 172.21.15.177:0/3956325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d00d1cf0 0x7f90d01535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90cf7fe640 1 -- 172.21.15.177:0/3956325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c00094d0 con 0x7f90d015d690 2023-11-28T20:10:14.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90cf7fe640 1 --2- 172.21.15.177:0/3956325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d015d690 0x7f90d00ca2a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f90c800c780 tx=0x7f90c800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:14.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90b77fe640 1 -- 172.21.15.177:0/3956325 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8003db0 con 0x7f90d015d690 2023-11-28T20:10:14.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90b77fe640 1 -- 172.21.15.177:0/3956325 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c800ce30 con 0x7f90d015d690 2023-11-28T20:10:14.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90b77fe640 1 -- 172.21.15.177:0/3956325 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c80052b0 con 0x7f90d015d690 2023-11-28T20:10:14.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90d56c9640 1 -- 172.21.15.177:0/3956325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d00cafd0 con 0x7f90d015d690 2023-11-28T20:10:14.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90d56c9640 1 -- 172.21.15.177:0/3956325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d00cb590 con 0x7f90d015d690 2023-11-28T20:10:14.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90d56c9640 1 -- 172.21.15.177:0/3956325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d00679f0 con 0x7f90d015d690 2023-11-28T20:10:14.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.032+0000 7f90b77fe640 1 -- 172.21.15.177:0/3956325 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f90c8005410 con 0x7f90d015d690 2023-11-28T20:10:14.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.036+0000 7f90b77fe640 1 --2- 172.21.15.177:0/3956325 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f90bc0664a0 0x7f90bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.036+0000 7f90b77fe640 1 -- 172.21.15.177:0/3956325 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90c8083c30 con 0x7f90d015d690 2023-11-28T20:10:14.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.036+0000 7f90ceffd640 1 --2- 172.21.15.177:0/3956325 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f90bc0664a0 0x7f90bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.036+0000 7f90ceffd640 1 --2- 172.21.15.177:0/3956325 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f90bc0664a0 0x7f90bc068960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f90c00ae000 tx=0x7f90c00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:14.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.040+0000 7f90b77fe640 1 -- 172.21.15.177:0/3956325 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90c80510a0 con 0x7f90d015d690 2023-11-28T20:10:14.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.192+0000 7f90d56c9640 1 -- 172.21.15.177:0/3956325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90d00693d0 con 0x7f90d015d690 2023-11-28T20:10:14.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.192+0000 7f90b77fe640 1 -- 172.21.15.177:0/3956325 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90c80546c0 con 0x7f90d015d690 2023-11-28T20:10:14.196 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:10:14.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.192+0000 7f90d56c9640 1 -- 172.21.15.177:0/3956325 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f90bc0664a0 msgr2=0x7f90bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.192+0000 7f90d56c9640 1 --2- 172.21.15.177:0/3956325 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f90bc0664a0 0x7f90bc068960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f90c00ae000 tx=0x7f90c00a7000 comp rx=0 tx=0).stop 2023-11-28T20:10:14.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.192+0000 7f90d56c9640 1 -- 172.21.15.177:0/3956325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d015d690 msgr2=0x7f90d00ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.192+0000 7f90d56c9640 1 --2- 172.21.15.177:0/3956325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d015d690 0x7f90d00ca2a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f90c800c780 tx=0x7f90c800cc40 comp rx=0 tx=0).stop 2023-11-28T20:10:14.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.192+0000 7f90d56c9640 1 -- 172.21.15.177:0/3956325 shutdown_connections 2023-11-28T20:10:14.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.192+0000 7f90d56c9640 1 --2- 172.21.15.177:0/3956325 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f90bc0664a0 0x7f90bc068960 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.192+0000 7f90d56c9640 1 --2- 172.21.15.177:0/3956325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d015d690 0x7f90d00ca2a0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.192+0000 7f90d56c9640 1 --2- 172.21.15.177:0/3956325 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90d015d2b0 0x7f90d00cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.192+0000 7f90d56c9640 1 --2- 172.21.15.177:0/3956325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d00d1cf0 0x7f90d01535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.192+0000 7f90d56c9640 1 -- 172.21.15.177:0/3956325 >> 172.21.15.177:0/3956325 conn(0x7f90d009c510 msgr2=0x7f90d00b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:14.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.196+0000 7f90d56c9640 1 -- 172.21.15.177:0/3956325 shutdown_connections 2023-11-28T20:10:14.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.196+0000 7f90d56c9640 1 -- 172.21.15.177:0/3956325 wait complete. 2023-11-28T20:10:14.217 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:10:14.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.356+0000 7f32c2632640 1 Processor -- start 2023-11-28T20:10:14.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.356+0000 7f32c2632640 1 -- start start 2023-11-28T20:10:14.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.356+0000 7f32c2632640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f32bc158ca0 0x7f32bc15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.356+0000 7f32c2632640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f32bc0b42d0 0x7f32bc0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.356+0000 7f32c2632640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32bc0b4c60 con 0x7f32bc0cba10 2023-11-28T20:10:14.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.356+0000 7f32c2632640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32bc15b670 con 0x7f32bc0b42d0 2023-11-28T20:10:14.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.356+0000 7f32c2632640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32bc15c510 con 0x7f32bc158ca0 2023-11-28T20:10:14.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.360+0000 7f32c0bcf640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f32bc0b42d0 0x7f32bc0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.360+0000 7f32c0bcf640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f32bc0b42d0 0x7f32bc0b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48626/0 (socket says 172.21.15.177:48626) 2023-11-28T20:10:14.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.360+0000 7f32c0bcf640 1 -- 172.21.15.177:0/1985954672 learned_addr learned my addr 172.21.15.177:0/1985954672 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:14.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.360+0000 7f32bbfff640 1 --2- 172.21.15.177:0/1985954672 >> v2:172.21.15.195:3300/0 conn(0x7f32bc158ca0 0x7f32bc15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.360+0000 7f32c0bcf640 1 -- 172.21.15.177:0/1985954672 >> v2:172.21.15.195:3300/0 conn(0x7f32bc158ca0 msgr2=0x7f32bc15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:14.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.360+0000 7f32c0bcf640 1 --2- 172.21.15.177:0/1985954672 >> v2:172.21.15.195:3300/0 conn(0x7f32bc158ca0 0x7f32bc15eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.360+0000 7f32c0bcf640 1 -- 172.21.15.177:0/1985954672 >> v1:172.21.15.195:6789/0 conn(0x7f32bc0cba10 legacy=0x7f32bc15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:14.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.360+0000 7f32c0bcf640 1 -- 172.21.15.177:0/1985954672 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc15f410 con 0x7f32bc0b42d0 2023-11-28T20:10:14.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.360+0000 7f32c0bcf640 1 --2- 172.21.15.177:0/1985954672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32bc0b42d0 0x7f32bc0b4720 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f32bc067f70 tx=0x7f32b401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3370ae4f8a5918 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:14.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.360+0000 7f32baffd640 1 -- 172.21.15.177:0/1985954672 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40a5820 con 0x7f32bc0b42d0 2023-11-28T20:10:14.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.360+0000 7f32baffd640 1 -- 172.21.15.177:0/1985954672 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b40a5980 con 0x7f32bc0b42d0 2023-11-28T20:10:14.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.360+0000 7f32baffd640 1 -- 172.21.15.177:0/1985954672 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40a5d10 con 0x7f32bc0b42d0 2023-11-28T20:10:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 -- 172.21.15.177:0/1985954672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32bc0b42d0 msgr2=0x7f32bc0b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 --2- 172.21.15.177:0/1985954672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32bc0b42d0 0x7f32bc0b4720 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f32bc067f70 tx=0x7f32b401c960 comp rx=0 tx=0).stop 2023-11-28T20:10:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 -- 172.21.15.177:0/1985954672 shutdown_connections 2023-11-28T20:10:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 --2- 172.21.15.177:0/1985954672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32bc0b42d0 0x7f32bc0b4720 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 --2- 172.21.15.177:0/1985954672 >> v2:172.21.15.195:3300/0 conn(0x7f32bc158ca0 0x7f32bc15eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 -- 172.21.15.177:0/1985954672 >> 172.21.15.177:0/1985954672 conn(0x7f32bc0b0cc0 msgr2=0x7f32bc0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 -- 172.21.15.177:0/1985954672 shutdown_connections 2023-11-28T20:10:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 -- 172.21.15.177:0/1985954672 wait complete. 2023-11-28T20:10:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 Processor -- start 2023-11-28T20:10:14.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 -- start start 2023-11-28T20:10:14.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32bc0b42d0 0x7f32bc14c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32bc0cba10 0x7f32bc0b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32bc158ca0 0x7f32bc165610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc165180 con 0x7f32bc0b42d0 2023-11-28T20:10:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc164570 con 0x7f32bc0cba10 2023-11-28T20:10:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c2632640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc164850 con 0x7f32bc158ca0 2023-11-28T20:10:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32bc0b42d0 0x7f32bc14c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32bc0b42d0 0x7f32bc14c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48636/0 (socket says 172.21.15.177:48636) 2023-11-28T20:10:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32bbfff640 1 -- 172.21.15.177:0/3150813134 learned_addr learned my addr 172.21.15.177:0/3150813134 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32c0bcf640 1 --2- 172.21.15.177:0/3150813134 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32bc158ca0 0x7f32bc165610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32bb7fe640 1 --2- 172.21.15.177:0/3150813134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32bc0cba10 0x7f32bc0b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32bbfff640 1 -- 172.21.15.177:0/3150813134 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32bc158ca0 msgr2=0x7f32bc165610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32bbfff640 1 --2- 172.21.15.177:0/3150813134 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32bc158ca0 0x7f32bc165610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32bbfff640 1 -- 172.21.15.177:0/3150813134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32bc0cba10 msgr2=0x7f32bc0b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32bbfff640 1 --2- 172.21.15.177:0/3150813134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32bc0cba10 0x7f32bc0b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.364+0000 7f32bbfff640 1 -- 172.21.15.177:0/3150813134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b4009b30 con 0x7f32bc0b42d0 2023-11-28T20:10:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.368+0000 7f32bbfff640 1 --2- 172.21.15.177:0/3150813134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32bc0b42d0 0x7f32bc14c350 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00d800 tx=0x7f32ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.368+0000 7f32b8ff9640 1 -- 172.21.15.177:0/3150813134 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00b6c0 con 0x7f32bc0b42d0 2023-11-28T20:10:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.368+0000 7f32b8ff9640 1 -- 172.21.15.177:0/3150813134 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac00b820 con 0x7f32bc0b42d0 2023-11-28T20:10:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.368+0000 7f32c2632640 1 -- 172.21.15.177:0/3150813134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32bc164b30 con 0x7f32bc0b42d0 2023-11-28T20:10:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.368+0000 7f32b8ff9640 1 -- 172.21.15.177:0/3150813134 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00bb90 con 0x7f32bc0b42d0 2023-11-28T20:10:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.368+0000 7f32c2632640 1 -- 172.21.15.177:0/3150813134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32bc14c890 con 0x7f32bc0b42d0 2023-11-28T20:10:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.368+0000 7f32c2632640 1 -- 172.21.15.177:0/3150813134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32bc15f010 con 0x7f32bc0b42d0 2023-11-28T20:10:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.368+0000 7f32b8ff9640 1 -- 172.21.15.177:0/3150813134 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f32ac00bcf0 con 0x7f32bc0b42d0 2023-11-28T20:10:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.368+0000 7f32b8ff9640 1 --2- 172.21.15.177:0/3150813134 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f32a8066470 0x7f32a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.368+0000 7f32b8ff9640 1 -- 172.21.15.177:0/3150813134 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32ac0842e0 con 0x7f32bc0b42d0 2023-11-28T20:10:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.368+0000 7f32bb7fe640 1 --2- 172.21.15.177:0/3150813134 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f32a8066470 0x7f32a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.368+0000 7f32bb7fe640 1 --2- 172.21.15.177:0/3150813134 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f32a8066470 0x7f32a8068930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f32bc1598a0 tx=0x7f32b0009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:14.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.372+0000 7f32b8ff9640 1 -- 172.21.15.177:0/3150813134 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f32ac051800 con 0x7f32bc0b42d0 2023-11-28T20:10:14.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.524+0000 7f32c2632640 1 -- 172.21.15.177:0/3150813134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32bc0693d0 con 0x7f32bc0b42d0 2023-11-28T20:10:14.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.524+0000 7f32b8ff9640 1 -- 172.21.15.177:0/3150813134 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32ac054e20 con 0x7f32bc0b42d0 2023-11-28T20:10:14.527 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:10:14.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.524+0000 7f32c2632640 1 -- 172.21.15.177:0/3150813134 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f32a8066470 msgr2=0x7f32a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.524+0000 7f32c2632640 1 --2- 172.21.15.177:0/3150813134 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f32a8066470 0x7f32a8068930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f32bc1598a0 tx=0x7f32b0009060 comp rx=0 tx=0).stop 2023-11-28T20:10:14.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.524+0000 7f32c2632640 1 -- 172.21.15.177:0/3150813134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32bc0b42d0 msgr2=0x7f32bc14c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.524+0000 7f32c2632640 1 --2- 172.21.15.177:0/3150813134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32bc0b42d0 0x7f32bc14c350 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00d800 tx=0x7f32ac00dcc0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.524+0000 7f32c2632640 1 -- 172.21.15.177:0/3150813134 shutdown_connections 2023-11-28T20:10:14.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.524+0000 7f32c2632640 1 --2- 172.21.15.177:0/3150813134 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f32a8066470 0x7f32a8068930 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.524+0000 7f32c2632640 1 --2- 172.21.15.177:0/3150813134 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32bc158ca0 0x7f32bc165610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.524+0000 7f32c2632640 1 --2- 172.21.15.177:0/3150813134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32bc0cba10 0x7f32bc0b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.524+0000 7f32c2632640 1 --2- 172.21.15.177:0/3150813134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32bc0b42d0 0x7f32bc14c350 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.524+0000 7f32c2632640 1 -- 172.21.15.177:0/3150813134 >> 172.21.15.177:0/3150813134 conn(0x7f32bc0b0cc0 msgr2=0x7f32bc151450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:14.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.524+0000 7f32c2632640 1 -- 172.21.15.177:0/3150813134 shutdown_connections 2023-11-28T20:10:14.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.524+0000 7f32c2632640 1 -- 172.21.15.177:0/3150813134 wait complete. 2023-11-28T20:10:14.548 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:10:14.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.688+0000 7fad7cf57640 1 Processor -- start 2023-11-28T20:10:14.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.688+0000 7fad7cf57640 1 -- start start 2023-11-28T20:10:14.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.688+0000 7fad7cf57640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fad780cba10 0x7fad7815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.688+0000 7fad7cf57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad780b42d0 0x7fad780b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.688+0000 7fad7cf57640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad780b4c60 con 0x7fad78158ca0 2023-11-28T20:10:14.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.688+0000 7fad7cf57640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7815b670 con 0x7fad780cba10 2023-11-28T20:10:14.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.688+0000 7fad7cf57640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7815f410 con 0x7fad780b42d0 2023-11-28T20:10:14.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.692+0000 7fad6ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fad780cba10 0x7fad7815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.692+0000 7fad6ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fad780cba10 0x7fad7815be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48646/0 (socket says 172.21.15.177:48646) 2023-11-28T20:10:14.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.692+0000 7fad6ffff640 1 -- 172.21.15.177:0/3763223415 learned_addr learned my addr 172.21.15.177:0/3763223415 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:14.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.692+0000 7fad76d9d640 1 --2- 172.21.15.177:0/3763223415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad780b42d0 0x7fad780b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.692+0000 7fad6ffff640 1 -- 172.21.15.177:0/3763223415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad780b42d0 msgr2=0x7fad780b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:14.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.692+0000 7fad6ffff640 1 --2- 172.21.15.177:0/3763223415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad780b42d0 0x7fad780b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.692+0000 7fad6ffff640 1 -- 172.21.15.177:0/3763223415 >> v1:172.21.15.195:6789/0 conn(0x7fad78158ca0 legacy=0x7fad7815eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.692+0000 7fad6ffff640 1 -- 172.21.15.177:0/3763223415 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7815f6f0 con 0x7fad780cba10 2023-11-28T20:10:14.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.692+0000 7fad6ffff640 1 --2- 172.21.15.177:0/3763223415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad780cba10 0x7fad7815be00 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fad60009870 tx=0x7fad6001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e2720f9bd6fb15 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:14.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.692+0000 7fad75d9b640 1 -- 172.21.15.177:0/3763223415 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600ab650 con 0x7fad780cba10 2023-11-28T20:10:14.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.692+0000 7fad75d9b640 1 -- 172.21.15.177:0/3763223415 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad600ab7b0 con 0x7fad780cba10 2023-11-28T20:10:14.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.692+0000 7fad75d9b640 1 -- 172.21.15.177:0/3763223415 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600abb40 con 0x7fad780cba10 2023-11-28T20:10:14.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 -- 172.21.15.177:0/3763223415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad780cba10 msgr2=0x7fad7815be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 --2- 172.21.15.177:0/3763223415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad780cba10 0x7fad7815be00 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fad60009870 tx=0x7fad6001c540 comp rx=0 tx=0).stop 2023-11-28T20:10:14.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 -- 172.21.15.177:0/3763223415 shutdown_connections 2023-11-28T20:10:14.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 --2- 172.21.15.177:0/3763223415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad780b42d0 0x7fad780b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 --2- 172.21.15.177:0/3763223415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad780cba10 0x7fad7815be00 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 -- 172.21.15.177:0/3763223415 >> 172.21.15.177:0/3763223415 conn(0x7fad780b0cc0 msgr2=0x7fad780b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:14.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 -- 172.21.15.177:0/3763223415 shutdown_connections 2023-11-28T20:10:14.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 -- 172.21.15.177:0/3763223415 wait complete. 2023-11-28T20:10:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 Processor -- start 2023-11-28T20:10:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 -- start start 2023-11-28T20:10:14.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad780b42d0 0x7fad780a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad780cba10 0x7fad78154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad78158ca0 0x7fad781474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad780b2830 con 0x7fad78158ca0 2023-11-28T20:10:14.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad780b2b10 con 0x7fad780b42d0 2023-11-28T20:10:14.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7cf57640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad780b2df0 con 0x7fad780cba10 2023-11-28T20:10:14.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad76d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad78158ca0 0x7fad781474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad76d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad78158ca0 0x7fad781474b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48662/0 (socket says 172.21.15.177:48662) 2023-11-28T20:10:14.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad7659c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad780b42d0 0x7fad780a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad76d9d640 1 -- 172.21.15.177:0/2014609515 learned_addr learned my addr 172.21.15.177:0/2014609515 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:14.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.696+0000 7fad6ffff640 1 --2- 172.21.15.177:0/2014609515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad780cba10 0x7fad78154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.700+0000 7fad76d9d640 1 -- 172.21.15.177:0/2014609515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad780cba10 msgr2=0x7fad78154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.700+0000 7fad76d9d640 1 --2- 172.21.15.177:0/2014609515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad780cba10 0x7fad78154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.700+0000 7fad76d9d640 1 -- 172.21.15.177:0/2014609515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad780b42d0 msgr2=0x7fad780a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.700+0000 7fad76d9d640 1 --2- 172.21.15.177:0/2014609515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad780b42d0 0x7fad780a8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.700+0000 7fad76d9d640 1 -- 172.21.15.177:0/2014609515 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad600094d0 con 0x7fad78158ca0 2023-11-28T20:10:14.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.700+0000 7fad76d9d640 1 --2- 172.21.15.177:0/2014609515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad78158ca0 0x7fad781474b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fad7000efc0 tx=0x7fad7000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:14.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.700+0000 7fad6effd640 1 -- 172.21.15.177:0/2014609515 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70009ba0 con 0x7fad78158ca0 2023-11-28T20:10:14.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.700+0000 7fad6effd640 1 -- 172.21.15.177:0/2014609515 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7000f040 con 0x7fad78158ca0 2023-11-28T20:10:14.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.700+0000 7fad6effd640 1 -- 172.21.15.177:0/2014609515 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad700146c0 con 0x7fad78158ca0 2023-11-28T20:10:14.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.700+0000 7fad7cf57640 1 -- 172.21.15.177:0/2014609515 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad780b30d0 con 0x7fad78158ca0 2023-11-28T20:10:14.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.700+0000 7fad7cf57640 1 -- 172.21.15.177:0/2014609515 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad78147dc0 con 0x7fad78158ca0 2023-11-28T20:10:14.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.700+0000 7fad7cf57640 1 -- 172.21.15.177:0/2014609515 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad781560f0 con 0x7fad78158ca0 2023-11-28T20:10:14.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.700+0000 7fad6effd640 1 -- 172.21.15.177:0/2014609515 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fad70014820 con 0x7fad78158ca0 2023-11-28T20:10:14.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.700+0000 7fad6effd640 1 --2- 172.21.15.177:0/2014609515 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad58066470 0x7fad58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:14.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.704+0000 7fad6effd640 1 -- 172.21.15.177:0/2014609515 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad70084880 con 0x7fad78158ca0 2023-11-28T20:10:14.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.704+0000 7fad7659c640 1 --2- 172.21.15.177:0/2014609515 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad58066470 0x7fad58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:14.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.704+0000 7fad7659c640 1 --2- 172.21.15.177:0/2014609515 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad58066470 0x7fad58068930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fad68007fd0 tx=0x7fad68009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:14.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.708+0000 7fad6effd640 1 -- 172.21.15.177:0/2014609515 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad70051d30 con 0x7fad78158ca0 2023-11-28T20:10:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.856+0000 7fad7cf57640 1 -- 172.21.15.177:0/2014609515 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad780693d0 con 0x7fad78158ca0 2023-11-28T20:10:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.856+0000 7fad6effd640 1 -- 172.21.15.177:0/2014609515 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad70018020 con 0x7fad78158ca0 2023-11-28T20:10:14.861 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:10:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.860+0000 7fad7cf57640 1 -- 172.21.15.177:0/2014609515 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad58066470 msgr2=0x7fad58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.860+0000 7fad7cf57640 1 --2- 172.21.15.177:0/2014609515 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad58066470 0x7fad58068930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fad68007fd0 tx=0x7fad68009040 comp rx=0 tx=0).stop 2023-11-28T20:10:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.860+0000 7fad7cf57640 1 -- 172.21.15.177:0/2014609515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad78158ca0 msgr2=0x7fad781474b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.860+0000 7fad7cf57640 1 --2- 172.21.15.177:0/2014609515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad78158ca0 0x7fad781474b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fad7000efc0 tx=0x7fad7000c490 comp rx=0 tx=0).stop 2023-11-28T20:10:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.860+0000 7fad7cf57640 1 -- 172.21.15.177:0/2014609515 shutdown_connections 2023-11-28T20:10:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.860+0000 7fad7cf57640 1 --2- 172.21.15.177:0/2014609515 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fad58066470 0x7fad58068930 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.860+0000 7fad7cf57640 1 --2- 172.21.15.177:0/2014609515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad78158ca0 0x7fad781474b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.860+0000 7fad7cf57640 1 --2- 172.21.15.177:0/2014609515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad780cba10 0x7fad78154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.860+0000 7fad7cf57640 1 --2- 172.21.15.177:0/2014609515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad780b42d0 0x7fad780a8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.860+0000 7fad7cf57640 1 -- 172.21.15.177:0/2014609515 >> 172.21.15.177:0/2014609515 conn(0x7fad780b0cc0 msgr2=0x7fad78164120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.860+0000 7fad7cf57640 1 -- 172.21.15.177:0/2014609515 shutdown_connections 2023-11-28T20:10:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:14.860+0000 7fad7cf57640 1 -- 172.21.15.177:0/2014609515 wait complete. 2023-11-28T20:10:14.883 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:10:15.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.016+0000 7f45b4372640 1 Processor -- start 2023-11-28T20:10:15.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.016+0000 7f45b4372640 1 -- start start 2023-11-28T20:10:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b4372640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f45ac13cf30 0x7f45ac06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b4372640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac15b170 con 0x7f45ac15ad40 2023-11-28T20:10:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b4372640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac15b3a0 con 0x7f45ac06c800 2023-11-28T20:10:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b4372640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ac13d310 con 0x7f45ac13cf30 2023-11-28T20:10:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b290f640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f45ac15ad40 0x7f45ac0cd880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:55492/0 (socket says 172.21.15.177:55492) 2023-11-28T20:10:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b290f640 1 -- 172.21.15.177:0/3778236357 learned_addr learned my addr 172.21.15.177:0/3778236357 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:15.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b210e640 1 --2- 172.21.15.177:0/3778236357 >> v2:172.21.15.195:3300/0 conn(0x7f45ac13cf30 0x7f45ac06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:15.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b110c640 1 -- 172.21.15.177:0/3778236357 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677194177 0 0) 0x7f45ac15b170 con 0x7f45ac15ad40 2023-11-28T20:10:15.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b110c640 1 -- 172.21.15.177:0/3778236357 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4598003530 con 0x7f45ac15ad40 2023-11-28T20:10:15.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b110c640 1 -- 172.21.15.177:0/3778236357 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3948118281 0 0) 0x7f4598003530 con 0x7f45ac15ad40 2023-11-28T20:10:15.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b110c640 1 -- 172.21.15.177:0/3778236357 >> v2:172.21.15.195:3300/0 conn(0x7f45ac13cf30 msgr2=0x7f45ac06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:15.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b110c640 1 --2- 172.21.15.177:0/3778236357 >> v2:172.21.15.195:3300/0 conn(0x7f45ac13cf30 0x7f45ac06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b110c640 1 -- 172.21.15.177:0/3778236357 >> v1:172.21.15.195:6789/0 conn(0x7f45ac06c800 legacy=0x7f45ac15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:15.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b110c640 1 -- 172.21.15.177:0/3778236357 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac13f720 con 0x7f45ac15ad40 2023-11-28T20:10:15.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b110c640 1 -- 172.21.15.177:0/3778236357 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f45a4001a00 con 0x7f45ac15ad40 2023-11-28T20:10:15.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b110c640 1 -- 172.21.15.177:0/3778236357 >> v1:172.21.15.177:6789/0 conn(0x7f45ac15ad40 legacy=0x7f45ac0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:15.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b110c640 1 --2- 172.21.15.177:0/3778236357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45980039d0 0x7f4598003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:15.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b110c640 1 --2- 172.21.15.177:0/3778236357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45980047d0 0x7f4598004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:15.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b110c640 1 --2- 172.21.15.177:0/3778236357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45980051e0 0x7f459800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:15.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b110c640 1 -- 172.21.15.177:0/3778236357 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459800c100 con 0x7f45980047d0 2023-11-28T20:10:15.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b110c640 1 -- 172.21.15.177:0/3778236357 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459800c270 con 0x7f45980039d0 2023-11-28T20:10:15.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b110c640 1 -- 172.21.15.177:0/3778236357 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459800e640 con 0x7f45980051e0 2023-11-28T20:10:15.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b190d640 1 --2- 172.21.15.177:0/3778236357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45980047d0 0x7f4598004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:15.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b210e640 1 --2- 172.21.15.177:0/3778236357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45980039d0 0x7f4598003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:15.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b290f640 1 --2- 172.21.15.177:0/3778236357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45980051e0 0x7f459800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:15.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b190d640 1 -- 172.21.15.177:0/3778236357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45980051e0 msgr2=0x7f459800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:15.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b190d640 1 --2- 172.21.15.177:0/3778236357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45980051e0 0x7f459800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b190d640 1 -- 172.21.15.177:0/3778236357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45980039d0 msgr2=0x7f4598003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:15.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b190d640 1 --2- 172.21.15.177:0/3778236357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45980039d0 0x7f4598003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b190d640 1 -- 172.21.15.177:0/3778236357 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4598003530 con 0x7f45980047d0 2023-11-28T20:10:15.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.020+0000 7f45b290f640 1 -- 172.21.15.177:0/3778236357 reap_dead start 2023-11-28T20:10:15.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.024+0000 7f45b190d640 1 --2- 172.21.15.177:0/3778236357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45980047d0 0x7f4598004c50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f459c001750 tx=0x7f459c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523f5412ae551fcf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:15.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.024+0000 7f45b110c640 1 -- 172.21.15.177:0/3778236357 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c0052d0 con 0x7f45980047d0 2023-11-28T20:10:15.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.024+0000 7f45b110c640 1 -- 172.21.15.177:0/3778236357 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c0a7050 con 0x7f45980047d0 2023-11-28T20:10:15.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.024+0000 7f45b110c640 1 -- 172.21.15.177:0/3778236357 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c003600 con 0x7f45980047d0 2023-11-28T20:10:15.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.024+0000 7f45b4372640 1 -- 172.21.15.177:0/3778236357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45980047d0 msgr2=0x7f4598004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:15.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.024+0000 7f45b4372640 1 --2- 172.21.15.177:0/3778236357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45980047d0 0x7f4598004c50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f459c001750 tx=0x7f459c01c3a0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.024+0000 7f45b4372640 1 -- 172.21.15.177:0/3778236357 shutdown_connections 2023-11-28T20:10:15.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.024+0000 7f45b4372640 1 --2- 172.21.15.177:0/3778236357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45980047d0 0x7f4598004c50 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.024+0000 7f45b4372640 1 -- 172.21.15.177:0/3778236357 >> 172.21.15.177:0/3778236357 conn(0x7f45ac06a530 msgr2=0x7f45ac06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:15.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.024+0000 7f45b4372640 1 -- 172.21.15.177:0/3778236357 shutdown_connections 2023-11-28T20:10:15.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.024+0000 7f45b4372640 1 -- 172.21.15.177:0/3778236357 wait complete. 2023-11-28T20:10:15.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b4372640 1 Processor -- start 2023-11-28T20:10:15.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b4372640 1 -- start start 2023-11-28T20:10:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b4372640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45980047d0 0x7f45ac156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b4372640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45ac1f7290 0x7f45ac1fa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b4372640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45ac13b3c0 0x7f45ac13b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b4372640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac13bd80 con 0x7f45ac1f7290 2023-11-28T20:10:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b4372640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac14e200 con 0x7f45980047d0 2023-11-28T20:10:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b4372640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac1f7710 con 0x7f45ac13b3c0 2023-11-28T20:10:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b190d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45ac1f7290 0x7f45ac1fa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b190d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45ac1f7290 0x7f45ac1fa750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48676/0 (socket says 172.21.15.177:48676) 2023-11-28T20:10:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b190d640 1 -- 172.21.15.177:0/3373130593 learned_addr learned my addr 172.21.15.177:0/3373130593 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b210e640 1 --2- 172.21.15.177:0/3373130593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45980047d0 0x7f45ac156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b290f640 1 --2- 172.21.15.177:0/3373130593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45ac13b3c0 0x7f45ac13b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b190d640 1 -- 172.21.15.177:0/3373130593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45ac13b3c0 msgr2=0x7f45ac13b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b190d640 1 --2- 172.21.15.177:0/3373130593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45ac13b3c0 0x7f45ac13b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b190d640 1 -- 172.21.15.177:0/3373130593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45980047d0 msgr2=0x7f45ac156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b190d640 1 --2- 172.21.15.177:0/3373130593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45980047d0 0x7f45ac156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b190d640 1 -- 172.21.15.177:0/3373130593 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac1fac90 con 0x7f45ac1f7290 2023-11-28T20:10:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b290f640 1 --2- 172.21.15.177:0/3373130593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45ac13b3c0 0x7f45ac13b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:15.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b190d640 1 --2- 172.21.15.177:0/3373130593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45ac1f7290 0x7f45ac1fa750 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f459c005040 tx=0x7f4598005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:15.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45a2ffd640 1 -- 172.21.15.177:0/3373130593 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c007440 con 0x7f45ac1f7290 2023-11-28T20:10:15.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45a2ffd640 1 -- 172.21.15.177:0/3373130593 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c0075a0 con 0x7f45ac1f7290 2023-11-28T20:10:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b4372640 1 -- 172.21.15.177:0/3373130593 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ac156700 con 0x7f45ac1f7290 2023-11-28T20:10:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45a2ffd640 1 -- 172.21.15.177:0/3373130593 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c006a00 con 0x7f45ac1f7290 2023-11-28T20:10:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b4372640 1 -- 172.21.15.177:0/3373130593 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac156cc0 con 0x7f45ac1f7290 2023-11-28T20:10:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.028+0000 7f45b4372640 1 -- 172.21.15.177:0/3373130593 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ac069440 con 0x7f45ac1f7290 2023-11-28T20:10:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.032+0000 7f45a2ffd640 1 -- 172.21.15.177:0/3373130593 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f459c006b60 con 0x7f45ac1f7290 2023-11-28T20:10:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.032+0000 7f45a2ffd640 1 --2- 172.21.15.177:0/3373130593 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45900664a0 0x7f4590068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:15.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.032+0000 7f45a2ffd640 1 -- 172.21.15.177:0/3373130593 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f459c11e0b0 con 0x7f45ac1f7290 2023-11-28T20:10:15.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.032+0000 7f45b210e640 1 --2- 172.21.15.177:0/3373130593 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45900664a0 0x7f4590068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:15.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.032+0000 7f45b210e640 1 --2- 172.21.15.177:0/3373130593 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45900664a0 0x7f4590068960 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009be0 tx=0x7f45a8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:15.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.036+0000 7f45a2ffd640 1 -- 172.21.15.177:0/3373130593 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f459c0eb520 con 0x7f45ac1f7290 2023-11-28T20:10:15.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.196+0000 7f45b4372640 1 -- 172.21.15.177:0/3373130593 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f45ac0ae930 con 0x7f45ac1f7290 2023-11-28T20:10:15.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.196+0000 7f45a2ffd640 1 -- 172.21.15.177:0/3373130593 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7f459c0eeb40 con 0x7f45ac1f7290 2023-11-28T20:10:15.200 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-28T20:10:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.196+0000 7f45b4372640 1 -- 172.21.15.177:0/3373130593 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45900664a0 msgr2=0x7f4590068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.196+0000 7f45b4372640 1 --2- 172.21.15.177:0/3373130593 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45900664a0 0x7f4590068960 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009be0 tx=0x7f45a8009190 comp rx=0 tx=0).stop 2023-11-28T20:10:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.196+0000 7f45b4372640 1 -- 172.21.15.177:0/3373130593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45ac1f7290 msgr2=0x7f45ac1fa750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.196+0000 7f45b4372640 1 --2- 172.21.15.177:0/3373130593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45ac1f7290 0x7f45ac1fa750 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f459c005040 tx=0x7f4598005800 comp rx=0 tx=0).stop 2023-11-28T20:10:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.196+0000 7f45b4372640 1 -- 172.21.15.177:0/3373130593 shutdown_connections 2023-11-28T20:10:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.196+0000 7f45b4372640 1 --2- 172.21.15.177:0/3373130593 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f45900664a0 0x7f4590068960 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.196+0000 7f45b4372640 1 --2- 172.21.15.177:0/3373130593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45ac13b3c0 0x7f45ac13b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.196+0000 7f45b4372640 1 --2- 172.21.15.177:0/3373130593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45ac1f7290 0x7f45ac1fa750 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.196+0000 7f45b4372640 1 --2- 172.21.15.177:0/3373130593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45980047d0 0x7f45ac156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.196+0000 7f45b4372640 1 -- 172.21.15.177:0/3373130593 >> 172.21.15.177:0/3373130593 conn(0x7f45ac06a530 msgr2=0x7f45ac158240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:15.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.196+0000 7f45b4372640 1 -- 172.21.15.177:0/3373130593 shutdown_connections 2023-11-28T20:10:15.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.196+0000 7f45b4372640 1 -- 172.21.15.177:0/3373130593 wait complete. 2023-11-28T20:10:15.223 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-11-28T20:10:15.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:15.223 DEBUG:teuthology.orchestra.run.smithi177:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T20:10:15.244 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[52626]: fuse finished with error 0 and tester_r 0 2023-11-28T20:10:15.246 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:10:15.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:15.246 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T20:10:15.335 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:10:15.335 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:10:15.346 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2702 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T20:10:15.346 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:10:15.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:15.346 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T20:10:15.397 INFO:teuthology.orchestra.run.smithi195.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T20:10:15.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:10:15.399 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:10:15.399 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:10:15.408 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354508k,nr_inodes=4088627,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=883 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T20:10:15.408 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:10:15.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:15.408 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T20:10:15.462 INFO:teuthology.orchestra.run.smithi177.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T20:10:15.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:10:15.464 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:10:15.464 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:10:15.473 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2702 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T20:10:15.474 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:10:15.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:15.474 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T20:10:15.530 INFO:teuthology.orchestra.run.smithi195.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T20:10:15.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:10:15.531 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:10:15.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.668+0000 7fdee072a640 1 Processor -- start 2023-11-28T20:10:15.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.668+0000 7fdee072a640 1 -- start start 2023-11-28T20:10:15.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.668+0000 7fdee072a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fded80b51e0 0x7fded80b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:15.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.668+0000 7fdee072a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fded80d14c0 0x7fded80d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.668+0000 7fdee072a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded80b69a0 con 0x7fded815d490 2023-11-28T20:10:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.668+0000 7fdee072a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded80d30e0 con 0x7fded80b51e0 2023-11-28T20:10:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.668+0000 7fdee072a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded80b5b00 con 0x7fded80d14c0 2023-11-28T20:10:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.668+0000 7fdede4c6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fded80b51e0 0x7fded80b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.672+0000 7fdeddcc5640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fded815d490 0x7fded80b6290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:55500/0 (socket says 172.21.15.177:55500) 2023-11-28T20:10:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.672+0000 7fdeddcc5640 1 -- 172.21.15.177:0/1554515747 learned_addr learned my addr 172.21.15.177:0/1554515747 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.672+0000 7fdedecc7640 1 --2- 172.21.15.177:0/1554515747 >> v2:172.21.15.195:3300/0 conn(0x7fded80d14c0 0x7fded80d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.672+0000 7fdede4c6640 1 -- 172.21.15.177:0/1554515747 >> v2:172.21.15.195:3300/0 conn(0x7fded80d14c0 msgr2=0x7fded80d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.672+0000 7fdede4c6640 1 --2- 172.21.15.177:0/1554515747 >> v2:172.21.15.195:3300/0 conn(0x7fded80d14c0 0x7fded80d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.672+0000 7fdede4c6640 1 -- 172.21.15.177:0/1554515747 >> v1:172.21.15.177:6789/0 conn(0x7fded815d490 legacy=0x7fded80b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.672+0000 7fdedd4c4640 1 -- 172.21.15.177:0/1554515747 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141764762 0 0) 0x7fded80b69a0 con 0x7fded815d490 2023-11-28T20:10:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.672+0000 7fdede4c6640 1 -- 172.21.15.177:0/1554515747 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded80d21f0 con 0x7fded80b51e0 2023-11-28T20:10:15.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.672+0000 7fdede4c6640 1 --2- 172.21.15.177:0/1554515747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fded80b51e0 0x7fded80b55c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fded80d24d0 tx=0x7fded401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3597fb5e4400d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:15.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.672+0000 7fdedd4c4640 1 -- 172.21.15.177:0/1554515747 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded40a7070 con 0x7fded80b51e0 2023-11-28T20:10:15.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.676+0000 7fdedd4c4640 1 -- 172.21.15.177:0/1554515747 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded40ab430 con 0x7fded80b51e0 2023-11-28T20:10:15.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.676+0000 7fdedd4c4640 1 -- 172.21.15.177:0/1554515747 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded40ab7c0 con 0x7fded80b51e0 2023-11-28T20:10:15.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.676+0000 7fdee072a640 1 -- 172.21.15.177:0/1554515747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fded80b51e0 msgr2=0x7fded80b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:15.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.676+0000 7fdee072a640 1 --2- 172.21.15.177:0/1554515747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fded80b51e0 0x7fded80b55c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fded80d24d0 tx=0x7fded401c430 comp rx=0 tx=0).stop 2023-11-28T20:10:15.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.676+0000 7fdee072a640 1 -- 172.21.15.177:0/1554515747 shutdown_connections 2023-11-28T20:10:15.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.676+0000 7fdee072a640 1 --2- 172.21.15.177:0/1554515747 >> v2:172.21.15.195:3300/0 conn(0x7fded80d14c0 0x7fded80d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.676+0000 7fdee072a640 1 --2- 172.21.15.177:0/1554515747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fded80b51e0 0x7fded80b55c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.676+0000 7fdee072a640 1 -- 172.21.15.177:0/1554515747 >> 172.21.15.177:0/1554515747 conn(0x7fded8072060 msgr2=0x7fded8072470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:15.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.676+0000 7fdee072a640 1 -- 172.21.15.177:0/1554515747 shutdown_connections 2023-11-28T20:10:15.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.676+0000 7fdee072a640 1 -- 172.21.15.177:0/1554515747 wait complete. 2023-11-28T20:10:15.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.676+0000 7fdee072a640 1 Processor -- start 2023-11-28T20:10:15.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.676+0000 7fdee072a640 1 -- start start 2023-11-28T20:10:15.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdee072a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fded80b51e0 0x7fded80cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:15.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdee072a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fded80d14c0 0x7fded80c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:15.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdee072a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fded815d490 0x7fded81673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:15.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdee072a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded81f5540 con 0x7fded815d490 2023-11-28T20:10:15.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdee072a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded80c8a50 con 0x7fded80b51e0 2023-11-28T20:10:15.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdee072a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded80c8c80 con 0x7fded80d14c0 2023-11-28T20:10:15.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdedecc7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fded815d490 0x7fded81673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:15.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdedecc7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fded815d490 0x7fded81673e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48700/0 (socket says 172.21.15.177:48700) 2023-11-28T20:10:15.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdedecc7640 1 -- 172.21.15.177:0/3441067227 learned_addr learned my addr 172.21.15.177:0/3441067227 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:15.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdede4c6640 1 --2- 172.21.15.177:0/3441067227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fded80b51e0 0x7fded80cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:15.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdeddcc5640 1 --2- 172.21.15.177:0/3441067227 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fded80d14c0 0x7fded80c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:15.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdedecc7640 1 -- 172.21.15.177:0/3441067227 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fded80d14c0 msgr2=0x7fded80c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdedecc7640 1 --2- 172.21.15.177:0/3441067227 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fded80d14c0 0x7fded80c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdedecc7640 1 -- 172.21.15.177:0/3441067227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fded80b51e0 msgr2=0x7fded80cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdedecc7640 1 --2- 172.21.15.177:0/3441067227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fded80b51e0 0x7fded80cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdedecc7640 1 -- 172.21.15.177:0/3441067227 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded4009420 con 0x7fded815d490 2023-11-28T20:10:15.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdedecc7640 1 --2- 172.21.15.177:0/3441067227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fded815d490 0x7fded81673e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fded000efc0 tx=0x7fded000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:15.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdeceffd640 1 -- 172.21.15.177:0/3441067227 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded0014480 con 0x7fded815d490 2023-11-28T20:10:15.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdeceffd640 1 -- 172.21.15.177:0/3441067227 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded000f040 con 0x7fded815d490 2023-11-28T20:10:15.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdee072a640 1 -- 172.21.15.177:0/3441067227 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded80c8f60 con 0x7fded815d490 2023-11-28T20:10:15.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdeceffd640 1 -- 172.21.15.177:0/3441067227 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded0014820 con 0x7fded815d490 2023-11-28T20:10:15.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdee072a640 1 -- 172.21.15.177:0/3441067227 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded80c9520 con 0x7fded815d490 2023-11-28T20:10:15.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdee072a640 1 -- 172.21.15.177:0/3441067227 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded81f5680 con 0x7fded815d490 2023-11-28T20:10:15.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.680+0000 7fdeceffd640 1 -- 172.21.15.177:0/3441067227 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fded0014980 con 0x7fded815d490 2023-11-28T20:10:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.684+0000 7fdeceffd640 1 --2- 172.21.15.177:0/3441067227 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdebc066470 0x7fdebc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.684+0000 7fdeceffd640 1 -- 172.21.15.177:0/3441067227 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fded0084890 con 0x7fded815d490 2023-11-28T20:10:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.684+0000 7fdede4c6640 1 --2- 172.21.15.177:0/3441067227 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdebc066470 0x7fdebc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.684+0000 7fdede4c6640 1 --2- 172.21.15.177:0/3441067227 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdebc066470 0x7fdebc068930 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fded40af000 tx=0x7fded40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:15.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.688+0000 7fdeceffd640 1 -- 172.21.15.177:0/3441067227 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fded0051db0 con 0x7fded815d490 2023-11-28T20:10:15.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.868+0000 7fdee072a640 1 -- 172.21.15.177:0/3441067227 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fded8069420 con 0x7fded815d490 2023-11-28T20:10:15.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.868+0000 7fdeceffd640 1 -- 172.21.15.177:0/3441067227 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fded0018090 con 0x7fded815d490 2023-11-28T20:10:15.874 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:15.874 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1822043740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1822043740},{"type":"v1","addr":"172.21.15.195:6835","nonce":1822043740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5713,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3889128653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3889128653},{"type":"v1","addr":"172.21.15.195:6834","nonce":3889128653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5898,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2574151536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2574151536},{"type":"v1","addr":"172.21.15.177:6835","nonce":2574151536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:09:43.046143+0000","modified":"2023-11-28T20:09:46.049118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/198543116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":198543116},{"type":"v1","addr":"172.21.15.177:6837","nonce":198543116}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T20:10:15.874 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 26 2023-11-28T20:10:15.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.872+0000 7fdee072a640 1 -- 172.21.15.177:0/3441067227 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdebc066470 msgr2=0x7fdebc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:15.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.872+0000 7fdee072a640 1 --2- 172.21.15.177:0/3441067227 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdebc066470 0x7fdebc068930 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fded40af000 tx=0x7fded40a7000 comp rx=0 tx=0).stop 2023-11-28T20:10:15.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.872+0000 7fdee072a640 1 -- 172.21.15.177:0/3441067227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fded815d490 msgr2=0x7fded81673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:15.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.872+0000 7fdee072a640 1 --2- 172.21.15.177:0/3441067227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fded815d490 0x7fded81673e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fded000efc0 tx=0x7fded000c490 comp rx=0 tx=0).stop 2023-11-28T20:10:15.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.872+0000 7fdee072a640 1 -- 172.21.15.177:0/3441067227 shutdown_connections 2023-11-28T20:10:15.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.872+0000 7fdee072a640 1 --2- 172.21.15.177:0/3441067227 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fdebc066470 0x7fdebc068930 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.872+0000 7fdee072a640 1 --2- 172.21.15.177:0/3441067227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fded815d490 0x7fded81673e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.872+0000 7fdee072a640 1 --2- 172.21.15.177:0/3441067227 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fded80d14c0 0x7fded80c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.872+0000 7fdee072a640 1 --2- 172.21.15.177:0/3441067227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fded80b51e0 0x7fded80cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:15.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.872+0000 7fdee072a640 1 -- 172.21.15.177:0/3441067227 >> 172.21.15.177:0/3441067227 conn(0x7fded8072060 msgr2=0x7fded80b6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:15.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.872+0000 7fdee072a640 1 -- 172.21.15.177:0/3441067227 shutdown_connections 2023-11-28T20:10:15.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:15.872+0000 7fdee072a640 1 -- 172.21.15.177:0/3441067227 wait complete. 2023-11-28T20:10:15.896 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:10:16.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796edd0640 1 Processor -- start 2023-11-28T20:10:16.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796edd0640 1 -- start start 2023-11-28T20:10:16.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796edd0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796806dd40 0x7f796806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796edd0640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79680cdf70 con 0x7f79680cc7a0 2023-11-28T20:10:16.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796edd0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79680ce250 con 0x7f796815b000 2023-11-28T20:10:16.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796edd0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79680cf720 con 0x7f796806dd40 2023-11-28T20:10:16.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796e5cf640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f79680cc7a0 0x7f7968070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:55510/0 (socket says 172.21.15.177:55510) 2023-11-28T20:10:16.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796e5cf640 1 -- 172.21.15.177:0/3359213563 learned_addr learned my addr 172.21.15.177:0/3359213563 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796d5cd640 1 --2- 172.21.15.177:0/3359213563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796806dd40 0x7f796806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3550721635 0 0) 0x7f79680cdf70 con 0x7f79680cc7a0 2023-11-28T20:10:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7954003530 con 0x7f79680cc7a0 2023-11-28T20:10:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977194326 0 0) 0x7f79680ce250 con 0x7f796815b000 2023-11-28T20:10:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79680cdf70 con 0x7f796815b000 2023-11-28T20:10:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3680672985 0 0) 0x7f7954003530 con 0x7f79680cc7a0 2023-11-28T20:10:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796806dd40 msgr2=0x7f796806e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 --2- 172.21.15.177:0/3359213563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796806dd40 0x7f796806e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 >> v1:172.21.15.195:6789/0 conn(0x7f796815b000 legacy=0x7f79680cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680ce530 con 0x7f79680cc7a0 2023-11-28T20:10:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f7960001a00 con 0x7f79680cc7a0 2023-11-28T20:10:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 >> v1:172.21.15.177:6789/0 conn(0x7f79680cc7a0 legacy=0x7f7968070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 --2- 172.21.15.177:0/3359213563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7954003b40 0x7f7954003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 --2- 172.21.15.177:0/3359213563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796806dd40 0x7f79540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 --2- 172.21.15.177:0/3359213563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7954004d10 0x7f7954005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680cf720 con 0x7f7954003b40 2023-11-28T20:10:16.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795400ba40 con 0x7f7954004d10 2023-11-28T20:10:16.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795400bc00 con 0x7f796806dd40 2023-11-28T20:10:16.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796ddce640 1 --2- 172.21.15.177:0/3359213563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7954003b40 0x7f7954003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796d5cd640 1 --2- 172.21.15.177:0/3359213563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796806dd40 0x7f79540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796e5cf640 1 --2- 172.21.15.177:0/3359213563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7954004d10 0x7f7954005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796ddce640 1 -- 172.21.15.177:0/3359213563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796806dd40 msgr2=0x7f79540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:16.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796ddce640 1 --2- 172.21.15.177:0/3359213563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796806dd40 0x7f79540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796ddce640 1 -- 172.21.15.177:0/3359213563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7954004d10 msgr2=0x7f7954005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:16.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796ddce640 1 --2- 172.21.15.177:0/3359213563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7954004d10 0x7f7954005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.032+0000 7f796ddce640 1 -- 172.21.15.177:0/3359213563 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7954003530 con 0x7f7954003b40 2023-11-28T20:10:16.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.036+0000 7f796ddce640 1 --2- 172.21.15.177:0/3359213563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7954003b40 0x7f7954003f40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f79640018d0 tx=0x7f796401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b4eb7d52d0c2c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.036+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79640052d0 con 0x7f7954003b40 2023-11-28T20:10:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.036+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7964005450 con 0x7f7954003b40 2023-11-28T20:10:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.036+0000 7f796cdcc640 1 -- 172.21.15.177:0/3359213563 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964003840 con 0x7f7954003b40 2023-11-28T20:10:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.036+0000 7f796edd0640 1 -- 172.21.15.177:0/3359213563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7954003b40 msgr2=0x7f7954003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.036+0000 7f796edd0640 1 --2- 172.21.15.177:0/3359213563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7954003b40 0x7f7954003f40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f79640018d0 tx=0x7f796401c530 comp rx=0 tx=0).stop 2023-11-28T20:10:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.036+0000 7f796e5cf640 1 -- 172.21.15.177:0/3359213563 reap_dead start 2023-11-28T20:10:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.036+0000 7f796edd0640 1 -- 172.21.15.177:0/3359213563 shutdown_connections 2023-11-28T20:10:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.036+0000 7f796edd0640 1 -- 172.21.15.177:0/3359213563 >> 172.21.15.177:0/3359213563 conn(0x7f79680b0920 msgr2=0x7f79680b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.036+0000 7f796edd0640 1 -- 172.21.15.177:0/3359213563 shutdown_connections 2023-11-28T20:10:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.036+0000 7f796edd0640 1 -- 172.21.15.177:0/3359213563 wait complete. 2023-11-28T20:10:16.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796edd0640 1 Processor -- start 2023-11-28T20:10:16.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796edd0640 1 -- start start 2023-11-28T20:10:16.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796edd0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7954003b40 0x7f796814d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796edd0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f79681537c0 0x7f796814cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796edd0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79680ad060 0x7f79680ad510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796edd0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796814ed80 con 0x7f79680ad060 2023-11-28T20:10:16.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796edd0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680ada50 con 0x7f7954003b40 2023-11-28T20:10:16.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796edd0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796814d260 con 0x7f79681537c0 2023-11-28T20:10:16.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796e5cf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79680ad060 0x7f79680ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796e5cf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79680ad060 0x7f79680ad510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48720/0 (socket says 172.21.15.177:48720) 2023-11-28T20:10:16.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796e5cf640 1 -- 172.21.15.177:0/2798822518 learned_addr learned my addr 172.21.15.177:0/2798822518 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:16.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796d5cd640 1 --2- 172.21.15.177:0/2798822518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f79681537c0 0x7f796814cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796ddce640 1 --2- 172.21.15.177:0/2798822518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7954003b40 0x7f796814d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796d5cd640 1 -- 172.21.15.177:0/2798822518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7954003b40 msgr2=0x7f796814d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796d5cd640 1 --2- 172.21.15.177:0/2798822518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7954003b40 0x7f796814d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796d5cd640 1 -- 172.21.15.177:0/2798822518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79680ad060 msgr2=0x7f79680ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796d5cd640 1 --2- 172.21.15.177:0/2798822518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79680ad060 0x7f79680ad510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796d5cd640 1 -- 172.21.15.177:0/2798822518 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796814d710 con 0x7f79681537c0 2023-11-28T20:10:16.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796e5cf640 1 --2- 172.21.15.177:0/2798822518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79680ad060 0x7f79680ad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:10:16.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796d5cd640 1 --2- 172.21.15.177:0/2798822518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f79681537c0 0x7f796814cd20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7958011990 tx=0x7f7958011e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:16.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f795e7fc640 1 -- 172.21.15.177:0/2798822518 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958004300 con 0x7f79681537c0 2023-11-28T20:10:16.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f795e7fc640 1 -- 172.21.15.177:0/2798822518 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7958004460 con 0x7f79681537c0 2023-11-28T20:10:16.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796edd0640 1 -- 172.21.15.177:0/2798822518 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796814e3e0 con 0x7f79681537c0 2023-11-28T20:10:16.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f795e7fc640 1 -- 172.21.15.177:0/2798822518 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795800fa80 con 0x7f79681537c0 2023-11-28T20:10:16.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.040+0000 7f796edd0640 1 -- 172.21.15.177:0/2798822518 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796814e9a0 con 0x7f79681537c0 2023-11-28T20:10:16.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.044+0000 7f796edd0640 1 -- 172.21.15.177:0/2798822518 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796809d080 con 0x7f79681537c0 2023-11-28T20:10:16.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.044+0000 7f795e7fc640 1 -- 172.21.15.177:0/2798822518 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f795800fbe0 con 0x7f79681537c0 2023-11-28T20:10:16.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.044+0000 7f795e7fc640 1 --2- 172.21.15.177:0/2798822518 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f794c0664a0 0x7f794c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.044+0000 7f795e7fc640 1 -- 172.21.15.177:0/2798822518 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7958084850 con 0x7f79681537c0 2023-11-28T20:10:16.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.044+0000 7f796ddce640 1 --2- 172.21.15.177:0/2798822518 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f794c0664a0 0x7f794c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.044+0000 7f796ddce640 1 --2- 172.21.15.177:0/2798822518 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f794c0664a0 0x7f794c068960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f79640ad000 tx=0x7f79640a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:16.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.048+0000 7f795e7fc640 1 -- 172.21.15.177:0/2798822518 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7958051df0 con 0x7f79681537c0 2023-11-28T20:10:16.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.200+0000 7f796edd0640 1 -- 172.21.15.177:0/2798822518 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f796804e930 con 0x7f79681537c0 2023-11-28T20:10:16.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.200+0000 7f795e7fc640 1 -- 172.21.15.177:0/2798822518 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f7958019090 con 0x7f79681537c0 2023-11-28T20:10:16.204 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:16.204 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":49,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:09:44.664848+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:09:40.777720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T20:09:42.029277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:10:16.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.200+0000 7f796edd0640 1 -- 172.21.15.177:0/2798822518 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f794c0664a0 msgr2=0x7f794c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.200+0000 7f796edd0640 1 --2- 172.21.15.177:0/2798822518 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f794c0664a0 0x7f794c068960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f79640ad000 tx=0x7f79640a7000 comp rx=0 tx=0).stop 2023-11-28T20:10:16.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.200+0000 7f796edd0640 1 -- 172.21.15.177:0/2798822518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f79681537c0 msgr2=0x7f796814cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.204+0000 7f796edd0640 1 --2- 172.21.15.177:0/2798822518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f79681537c0 0x7f796814cd20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7958011990 tx=0x7f7958011e50 comp rx=0 tx=0).stop 2023-11-28T20:10:16.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.204+0000 7f796edd0640 1 -- 172.21.15.177:0/2798822518 shutdown_connections 2023-11-28T20:10:16.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.204+0000 7f796edd0640 1 --2- 172.21.15.177:0/2798822518 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f794c0664a0 0x7f794c068960 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.204+0000 7f796edd0640 1 --2- 172.21.15.177:0/2798822518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79680ad060 0x7f79680ad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.204+0000 7f796edd0640 1 --2- 172.21.15.177:0/2798822518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f79681537c0 0x7f796814cd20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.204+0000 7f796edd0640 1 --2- 172.21.15.177:0/2798822518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7954003b40 0x7f796814d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.204+0000 7f796edd0640 1 -- 172.21.15.177:0/2798822518 >> 172.21.15.177:0/2798822518 conn(0x7f79680b0920 msgr2=0x7f79681665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:16.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.204+0000 7f796edd0640 1 -- 172.21.15.177:0/2798822518 shutdown_connections 2023-11-28T20:10:16.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.204+0000 7f796edd0640 1 -- 172.21.15.177:0/2798822518 wait complete. 2023-11-28T20:10:16.225 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:07:29.480556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:09:40.777720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:09:42.029277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:10:16.226 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:10:16.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.364+0000 7f88eeff5640 1 Processor -- start 2023-11-28T20:10:16.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.364+0000 7f88eeff5640 1 -- start start 2023-11-28T20:10:16.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.368+0000 7f88eeff5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f88e815d2b0 0x7f88e80d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.368+0000 7f88eeff5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f88e80d02f0 0x7f88e80b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.368+0000 7f88eeff5640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e80aff30 con 0x7f88e80d1cf0 2023-11-28T20:10:16.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.368+0000 7f88eeff5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e80b01d0 con 0x7f88e80d02f0 2023-11-28T20:10:16.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.368+0000 7f88eeff5640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e80b04b0 con 0x7f88e815d2b0 2023-11-28T20:10:16.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.368+0000 7f88ed592640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f88e80d02f0 0x7f88e80b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.368+0000 7f88ed592640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f88e80d02f0 0x7f88e80b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48728/0 (socket says 172.21.15.177:48728) 2023-11-28T20:10:16.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.368+0000 7f88ed592640 1 -- 172.21.15.177:0/3729654733 learned_addr learned my addr 172.21.15.177:0/3729654733 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:16.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.368+0000 7f88ecd91640 1 --2- 172.21.15.177:0/3729654733 >> v2:172.21.15.195:3300/0 conn(0x7f88e815d2b0 0x7f88e80d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.368+0000 7f88ed592640 1 -- 172.21.15.177:0/3729654733 >> v2:172.21.15.195:3300/0 conn(0x7f88e815d2b0 msgr2=0x7f88e80d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:16.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.368+0000 7f88ed592640 1 --2- 172.21.15.177:0/3729654733 >> v2:172.21.15.195:3300/0 conn(0x7f88e815d2b0 0x7f88e80d17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.368+0000 7f88ed592640 1 -- 172.21.15.177:0/3729654733 >> v1:172.21.15.195:6789/0 conn(0x7f88e80d1cf0 legacy=0x7f88e80cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.368+0000 7f88ed592640 1 -- 172.21.15.177:0/3729654733 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e80b0790 con 0x7f88e80d02f0 2023-11-28T20:10:16.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.368+0000 7f88ecd91640 1 --2- 172.21.15.177:0/3729654733 >> v2:172.21.15.195:3300/0 conn(0x7f88e815d2b0 0x7f88e80d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:16.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.372+0000 7f88ed592640 1 --2- 172.21.15.177:0/3729654733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88e80d02f0 0x7f88e80b0cb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f88e808bcb0 tx=0x7f88e001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e87db5d5888afaf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:16.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.372+0000 7f88df7fe640 1 -- 172.21.15.177:0/3729654733 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e00a5830 con 0x7f88e80d02f0 2023-11-28T20:10:16.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.372+0000 7f88df7fe640 1 -- 172.21.15.177:0/3729654733 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e00a5990 con 0x7f88e80d02f0 2023-11-28T20:10:16.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.372+0000 7f88df7fe640 1 -- 172.21.15.177:0/3729654733 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e00a5d20 con 0x7f88e80d02f0 2023-11-28T20:10:16.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.372+0000 7f88eeff5640 1 -- 172.21.15.177:0/3729654733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88e80d02f0 msgr2=0x7f88e80b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.372+0000 7f88eeff5640 1 --2- 172.21.15.177:0/3729654733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88e80d02f0 0x7f88e80b0cb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f88e808bcb0 tx=0x7f88e001c9d0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.372+0000 7f88eeff5640 1 -- 172.21.15.177:0/3729654733 shutdown_connections 2023-11-28T20:10:16.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.372+0000 7f88eeff5640 1 --2- 172.21.15.177:0/3729654733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88e80d02f0 0x7f88e80b0cb0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.372+0000 7f88eeff5640 1 --2- 172.21.15.177:0/3729654733 >> v2:172.21.15.195:3300/0 conn(0x7f88e815d2b0 0x7f88e80d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.372+0000 7f88eeff5640 1 -- 172.21.15.177:0/3729654733 >> 172.21.15.177:0/3729654733 conn(0x7f88e809c510 msgr2=0x7f88e80d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:16.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.372+0000 7f88eeff5640 1 -- 172.21.15.177:0/3729654733 shutdown_connections 2023-11-28T20:10:16.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.372+0000 7f88eeff5640 1 -- 172.21.15.177:0/3729654733 wait complete. 2023-11-28T20:10:16.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.372+0000 7f88eeff5640 1 Processor -- start 2023-11-28T20:10:16.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.372+0000 7f88eeff5640 1 -- start start 2023-11-28T20:10:16.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88eeff5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88e80d02f0 0x7f88e81536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88eeff5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88e80d1cf0 0x7f88e80ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88eeff5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88e815d2b0 0x7f88e8154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88eeff5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e80b8bb0 con 0x7f88e80d1cf0 2023-11-28T20:10:16.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88eeff5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e80b8e90 con 0x7f88e815d2b0 2023-11-28T20:10:16.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88eeff5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e8153f90 con 0x7f88e80d02f0 2023-11-28T20:10:16.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88dffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88e80d1cf0 0x7f88e80ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88dffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88e80d1cf0 0x7f88e80ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48736/0 (socket says 172.21.15.177:48736) 2023-11-28T20:10:16.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88dffff640 1 -- 172.21.15.177:0/1010525615 learned_addr learned my addr 172.21.15.177:0/1010525615 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:16.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88ed592640 1 --2- 172.21.15.177:0/1010525615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88e815d2b0 0x7f88e8154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88ecd91640 1 --2- 172.21.15.177:0/1010525615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88e80d02f0 0x7f88e81536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88dffff640 1 -- 172.21.15.177:0/1010525615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88e80d02f0 msgr2=0x7f88e81536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88dffff640 1 --2- 172.21.15.177:0/1010525615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88e80d02f0 0x7f88e81536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88dffff640 1 -- 172.21.15.177:0/1010525615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88e815d2b0 msgr2=0x7f88e8154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88dffff640 1 --2- 172.21.15.177:0/1010525615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88e815d2b0 0x7f88e8154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88dffff640 1 -- 172.21.15.177:0/1010525615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e0009b30 con 0x7f88e80d1cf0 2023-11-28T20:10:16.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88ecd91640 1 --2- 172.21.15.177:0/1010525615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88e80d02f0 0x7f88e81536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:16.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88dffff640 1 --2- 172.21.15.177:0/1010525615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88e80d1cf0 0x7f88e80ca790 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f88d800c500 tx=0x7f88d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:16.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88dd7fa640 1 -- 172.21.15.177:0/1010525615 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8005220 con 0x7f88e80d1cf0 2023-11-28T20:10:16.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88dd7fa640 1 -- 172.21.15.177:0/1010525615 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d8005380 con 0x7f88e80d1cf0 2023-11-28T20:10:16.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88eeff5640 1 -- 172.21.15.177:0/1010525615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e8154270 con 0x7f88e80d1cf0 2023-11-28T20:10:16.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88dd7fa640 1 -- 172.21.15.177:0/1010525615 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8007270 con 0x7f88e80d1cf0 2023-11-28T20:10:16.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88eeff5640 1 -- 172.21.15.177:0/1010525615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e8153c00 con 0x7f88e80d1cf0 2023-11-28T20:10:16.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88eeff5640 1 -- 172.21.15.177:0/1010525615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e80679f0 con 0x7f88e80d1cf0 2023-11-28T20:10:16.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.376+0000 7f88dd7fa640 1 -- 172.21.15.177:0/1010525615 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f88d80073d0 con 0x7f88e80d1cf0 2023-11-28T20:10:16.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.380+0000 7f88dd7fa640 1 --2- 172.21.15.177:0/1010525615 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f88d4066470 0x7f88d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.380+0000 7f88dd7fa640 1 -- 172.21.15.177:0/1010525615 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88d8083120 con 0x7f88e80d1cf0 2023-11-28T20:10:16.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.380+0000 7f88ecd91640 1 --2- 172.21.15.177:0/1010525615 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f88d4066470 0x7f88d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.380+0000 7f88ecd91640 1 --2- 172.21.15.177:0/1010525615 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f88d4066470 0x7f88d4068930 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f88e80b7a50 tx=0x7f88e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:16.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.384+0000 7f88dd7fa640 1 -- 172.21.15.177:0/1010525615 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88d8050660 con 0x7f88e80d1cf0 2023-11-28T20:10:16.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.536+0000 7f88eeff5640 1 -- 172.21.15.177:0/1010525615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88e80693d0 con 0x7f88e80d1cf0 2023-11-28T20:10:16.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.536+0000 7f88dd7fa640 1 -- 172.21.15.177:0/1010525615 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f88d8053c80 con 0x7f88e80d1cf0 2023-11-28T20:10:16.540 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-28T20:10:16.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.536+0000 7f88eeff5640 1 -- 172.21.15.177:0/1010525615 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f88d4066470 msgr2=0x7f88d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.536+0000 7f88eeff5640 1 --2- 172.21.15.177:0/1010525615 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f88d4066470 0x7f88d4068930 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f88e80b7a50 tx=0x7f88e4008040 comp rx=0 tx=0).stop 2023-11-28T20:10:16.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.536+0000 7f88eeff5640 1 -- 172.21.15.177:0/1010525615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88e80d1cf0 msgr2=0x7f88e80ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.536+0000 7f88eeff5640 1 --2- 172.21.15.177:0/1010525615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88e80d1cf0 0x7f88e80ca790 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f88d800c500 tx=0x7f88d800c9c0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.536+0000 7f88eeff5640 1 -- 172.21.15.177:0/1010525615 shutdown_connections 2023-11-28T20:10:16.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.536+0000 7f88eeff5640 1 --2- 172.21.15.177:0/1010525615 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f88d4066470 0x7f88d4068930 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.536+0000 7f88eeff5640 1 --2- 172.21.15.177:0/1010525615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88e815d2b0 0x7f88e8154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.536+0000 7f88eeff5640 1 --2- 172.21.15.177:0/1010525615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88e80d1cf0 0x7f88e80ca790 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.536+0000 7f88eeff5640 1 --2- 172.21.15.177:0/1010525615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88e80d02f0 0x7f88e81536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.536+0000 7f88eeff5640 1 -- 172.21.15.177:0/1010525615 >> 172.21.15.177:0/1010525615 conn(0x7f88e809c510 msgr2=0x7f88e8159e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:16.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.536+0000 7f88eeff5640 1 -- 172.21.15.177:0/1010525615 shutdown_connections 2023-11-28T20:10:16.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.536+0000 7f88eeff5640 1 -- 172.21.15.177:0/1010525615 wait complete. 2023-11-28T20:10:16.560 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:10:16.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.696+0000 7f3979d80640 1 Processor -- start 2023-11-28T20:10:16.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f3979d80640 1 -- start start 2023-11-28T20:10:16.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f3979d80640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f397415adb0 0x7f397413d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f3979d80640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f397413f5f0 0x7f39740ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f3979d80640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397413d2b0 con 0x7f3974071d90 2023-11-28T20:10:16.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f3979d80640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3974140520 con 0x7f397415adb0 2023-11-28T20:10:16.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f3979d80640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39740cd7f0 con 0x7f397413f5f0 2023-11-28T20:10:16.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39737fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f3974071d90 0x7f3974072170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:55522/0 (socket says 172.21.15.177:55522) 2023-11-28T20:10:16.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39737fe640 1 -- 172.21.15.177:0/310129891 learned_addr learned my addr 172.21.15.177:0/310129891 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:16.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f3973fff640 1 --2- 172.21.15.177:0/310129891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f397413f5f0 0x7f39740ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f3972ffd640 1 --2- 172.21.15.177:0/310129891 >> v2:172.21.15.195:3300/0 conn(0x7f397415adb0 0x7f397413d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 -- 172.21.15.177:0/310129891 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692244499 0 0) 0x7f397413d2b0 con 0x7f3974071d90 2023-11-28T20:10:16.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 -- 172.21.15.177:0/310129891 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f395c003530 con 0x7f3974071d90 2023-11-28T20:10:16.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 -- 172.21.15.177:0/310129891 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 603341531 0 0) 0x7f395c003530 con 0x7f3974071d90 2023-11-28T20:10:16.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 -- 172.21.15.177:0/310129891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f397413f5f0 msgr2=0x7f39740ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:16.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 --2- 172.21.15.177:0/310129891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f397413f5f0 0x7f39740ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 -- 172.21.15.177:0/310129891 >> v2:172.21.15.195:3300/0 conn(0x7f397415adb0 msgr2=0x7f397413d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:16.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 --2- 172.21.15.177:0/310129891 >> v2:172.21.15.195:3300/0 conn(0x7f397415adb0 0x7f397413d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 -- 172.21.15.177:0/310129891 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39740cdd70 con 0x7f3974071d90 2023-11-28T20:10:16.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 -- 172.21.15.177:0/310129891 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f3964001680 con 0x7f3974071d90 2023-11-28T20:10:16.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 -- 172.21.15.177:0/310129891 >> v1:172.21.15.177:6789/0 conn(0x7f3974071d90 legacy=0x7f3974072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 --2- 172.21.15.177:0/310129891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f395c003980 0x7f395c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 --2- 172.21.15.177:0/310129891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f395c0047d0 0x7f395c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 --2- 172.21.15.177:0/310129891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f397413f5f0 0x7f395c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 -- 172.21.15.177:0/310129891 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3974140520 con 0x7f395c0047d0 2023-11-28T20:10:16.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 -- 172.21.15.177:0/310129891 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39740cd7f0 con 0x7f395c003980 2023-11-28T20:10:16.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39727fc640 1 -- 172.21.15.177:0/310129891 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395c00b990 con 0x7f397413f5f0 2023-11-28T20:10:16.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f3972ffd640 1 --2- 172.21.15.177:0/310129891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f395c0047d0 0x7f395c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f39737fe640 1 --2- 172.21.15.177:0/310129891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f395c003980 0x7f395c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f3973fff640 1 --2- 172.21.15.177:0/310129891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f397413f5f0 0x7f395c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f3972ffd640 1 -- 172.21.15.177:0/310129891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f397413f5f0 msgr2=0x7f395c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:16.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f3972ffd640 1 --2- 172.21.15.177:0/310129891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f397413f5f0 0x7f395c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f3972ffd640 1 -- 172.21.15.177:0/310129891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f395c003980 msgr2=0x7f395c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:16.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f3972ffd640 1 --2- 172.21.15.177:0/310129891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f395c003980 0x7f395c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.700+0000 7f3972ffd640 1 -- 172.21.15.177:0/310129891 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c003530 con 0x7f395c0047d0 2023-11-28T20:10:16.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.704+0000 7f3972ffd640 1 --2- 172.21.15.177:0/310129891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f395c0047d0 0x7f395c004c50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f3968009670 tx=0x7f396801ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba02445ceda5a2a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:16.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.704+0000 7f39727fc640 1 -- 172.21.15.177:0/310129891 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39680a77e0 con 0x7f395c0047d0 2023-11-28T20:10:16.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.704+0000 7f39727fc640 1 -- 172.21.15.177:0/310129891 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39680a7940 con 0x7f395c0047d0 2023-11-28T20:10:16.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.704+0000 7f39727fc640 1 -- 172.21.15.177:0/310129891 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39680a7cf0 con 0x7f395c0047d0 2023-11-28T20:10:16.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.704+0000 7f3979d80640 1 -- 172.21.15.177:0/310129891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f395c0047d0 msgr2=0x7f395c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.704+0000 7f3979d80640 1 --2- 172.21.15.177:0/310129891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f395c0047d0 0x7f395c004c50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f3968009670 tx=0x7f396801ecc0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.704+0000 7f3973fff640 1 -- 172.21.15.177:0/310129891 reap_dead start 2023-11-28T20:10:16.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.704+0000 7f3979d80640 1 -- 172.21.15.177:0/310129891 shutdown_connections 2023-11-28T20:10:16.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.704+0000 7f3979d80640 1 -- 172.21.15.177:0/310129891 >> 172.21.15.177:0/310129891 conn(0x7f39740b0cc0 msgr2=0x7f39740b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:16.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.704+0000 7f3979d80640 1 -- 172.21.15.177:0/310129891 shutdown_connections 2023-11-28T20:10:16.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.704+0000 7f3979d80640 1 -- 172.21.15.177:0/310129891 wait complete. 2023-11-28T20:10:16.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f3979d80640 1 Processor -- start 2023-11-28T20:10:16.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f3979d80640 1 -- start start 2023-11-28T20:10:16.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f3979d80640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f395c0047d0 0x7f39741540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f3979d80640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39741f28d0 0x7f3974142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f3979d80640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3974142580 0x7f3974142a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f3979d80640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3974142f40 con 0x7f395c0047d0 2023-11-28T20:10:16.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f3979d80640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397413f000 con 0x7f3974142580 2023-11-28T20:10:16.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f3979d80640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397413f2e0 con 0x7f39741f28d0 2023-11-28T20:10:16.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f39737fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f395c0047d0 0x7f39741540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f39737fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f395c0047d0 0x7f39741540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48758/0 (socket says 172.21.15.177:48758) 2023-11-28T20:10:16.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f39737fe640 1 -- 172.21.15.177:0/978737615 learned_addr learned my addr 172.21.15.177:0/978737615 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:16.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f3972ffd640 1 --2- 172.21.15.177:0/978737615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39741f28d0 0x7f3974142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f3973fff640 1 --2- 172.21.15.177:0/978737615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3974142580 0x7f3974142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f39737fe640 1 -- 172.21.15.177:0/978737615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39741f28d0 msgr2=0x7f3974142040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f39737fe640 1 --2- 172.21.15.177:0/978737615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39741f28d0 0x7f3974142040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f39737fe640 1 -- 172.21.15.177:0/978737615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3974142580 msgr2=0x7f3974142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f39737fe640 1 --2- 172.21.15.177:0/978737615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3974142580 0x7f3974142a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f39737fe640 1 -- 172.21.15.177:0/978737615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3974151630 con 0x7f395c0047d0 2023-11-28T20:10:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f3973fff640 1 --2- 172.21.15.177:0/978737615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3974142580 0x7f3974142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f39737fe640 1 --2- 172.21.15.177:0/978737615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f395c0047d0 0x7f39741540e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3964012310 tx=0x7f3964005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:16.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f395bfff640 1 -- 172.21.15.177:0/978737615 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3964014750 con 0x7f395c0047d0 2023-11-28T20:10:16.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f395bfff640 1 -- 172.21.15.177:0/978737615 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39640148b0 con 0x7f395c0047d0 2023-11-28T20:10:16.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f3979d80640 1 -- 172.21.15.177:0/978737615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3974151910 con 0x7f395c0047d0 2023-11-28T20:10:16.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f395bfff640 1 -- 172.21.15.177:0/978737615 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3964014c60 con 0x7f395c0047d0 2023-11-28T20:10:16.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.708+0000 7f3979d80640 1 -- 172.21.15.177:0/978737615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39741f2d50 con 0x7f395c0047d0 2023-11-28T20:10:16.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.712+0000 7f3979d80640 1 -- 172.21.15.177:0/978737615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39740693d0 con 0x7f395c0047d0 2023-11-28T20:10:16.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.712+0000 7f395bfff640 1 -- 172.21.15.177:0/978737615 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f39640153e0 con 0x7f395c0047d0 2023-11-28T20:10:16.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.712+0000 7f395bfff640 1 --2- 172.21.15.177:0/978737615 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39600664a0 0x7f3960068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:16.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.712+0000 7f395bfff640 1 -- 172.21.15.177:0/978737615 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3964086a40 con 0x7f395c0047d0 2023-11-28T20:10:16.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.712+0000 7f3972ffd640 1 --2- 172.21.15.177:0/978737615 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39600664a0 0x7f3960068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:16.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.712+0000 7f3972ffd640 1 --2- 172.21.15.177:0/978737615 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39600664a0 0x7f3960068960 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f39680b1000 tx=0x7f3968010040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:16.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.716+0000 7f395bfff640 1 -- 172.21.15.177:0/978737615 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3964053ed0 con 0x7f395c0047d0 2023-11-28T20:10:16.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.868+0000 7f3979d80640 1 -- 172.21.15.177:0/978737615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f397406e710 con 0x7f395c0047d0 2023-11-28T20:10:16.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.868+0000 7f395bfff640 1 -- 172.21.15.177:0/978737615 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f396401c0a0 con 0x7f395c0047d0 2023-11-28T20:10:16.872 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-28T20:10:16.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.868+0000 7f3979d80640 1 -- 172.21.15.177:0/978737615 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39600664a0 msgr2=0x7f3960068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.868+0000 7f3979d80640 1 --2- 172.21.15.177:0/978737615 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39600664a0 0x7f3960068960 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f39680b1000 tx=0x7f3968010040 comp rx=0 tx=0).stop 2023-11-28T20:10:16.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.868+0000 7f3979d80640 1 -- 172.21.15.177:0/978737615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f395c0047d0 msgr2=0x7f39741540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:16.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.868+0000 7f3979d80640 1 --2- 172.21.15.177:0/978737615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f395c0047d0 0x7f39741540e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3964012310 tx=0x7f3964005870 comp rx=0 tx=0).stop 2023-11-28T20:10:16.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.868+0000 7f3979d80640 1 -- 172.21.15.177:0/978737615 shutdown_connections 2023-11-28T20:10:16.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.868+0000 7f3979d80640 1 --2- 172.21.15.177:0/978737615 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f39600664a0 0x7f3960068960 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.868+0000 7f3979d80640 1 --2- 172.21.15.177:0/978737615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3974142580 0x7f3974142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.868+0000 7f3979d80640 1 --2- 172.21.15.177:0/978737615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39741f28d0 0x7f3974142040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.868+0000 7f3979d80640 1 --2- 172.21.15.177:0/978737615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f395c0047d0 0x7f39741540e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:16.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.868+0000 7f3979d80640 1 -- 172.21.15.177:0/978737615 >> 172.21.15.177:0/978737615 conn(0x7f39740b0cc0 msgr2=0x7f397415b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:16.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.868+0000 7f3979d80640 1 -- 172.21.15.177:0/978737615 shutdown_connections 2023-11-28T20:10:16.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:16.868+0000 7f3979d80640 1 -- 172.21.15.177:0/978737615 wait complete. 2023-11-28T20:10:16.893 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:10:17.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.028+0000 7f618689c640 1 Processor -- start 2023-11-28T20:10:17.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.028+0000 7f618689c640 1 -- start start 2023-11-28T20:10:17.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.028+0000 7f618689c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f61801571d0 0x7f6180070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.028+0000 7f618689c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f618015d8e0 0x7f61800ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.028+0000 7f618689c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61801575b0 con 0x7f61800ae830 2023-11-28T20:10:17.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.028+0000 7f618689c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6180071600 con 0x7f618015d8e0 2023-11-28T20:10:17.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.028+0000 7f618689c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61800718e0 con 0x7f61801571d0 2023-11-28T20:10:17.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.032+0000 7f6184e39640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f618015d8e0 0x7f61800ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.032+0000 7f6184e39640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f618015d8e0 0x7f61800ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48770/0 (socket says 172.21.15.177:48770) 2023-11-28T20:10:17.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.032+0000 7f6184e39640 1 -- 172.21.15.177:0/2097108748 learned_addr learned my addr 172.21.15.177:0/2097108748 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:17.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.032+0000 7f617ffff640 1 --2- 172.21.15.177:0/2097108748 >> v2:172.21.15.195:3300/0 conn(0x7f61801571d0 0x7f6180070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.032+0000 7f6184e39640 1 -- 172.21.15.177:0/2097108748 >> v2:172.21.15.195:3300/0 conn(0x7f61801571d0 msgr2=0x7f6180070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:17.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.032+0000 7f6184e39640 1 --2- 172.21.15.177:0/2097108748 >> v2:172.21.15.195:3300/0 conn(0x7f61801571d0 0x7f6180070c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.032+0000 7f6184e39640 1 -- 172.21.15.177:0/2097108748 >> v1:172.21.15.195:6789/0 conn(0x7f61800ae830 legacy=0x7f618015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:17.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.032+0000 7f6184e39640 1 -- 172.21.15.177:0/2097108748 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6180071bc0 con 0x7f618015d8e0 2023-11-28T20:10:17.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.032+0000 7f6184e39640 1 --2- 172.21.15.177:0/2097108748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f618015d8e0 0x7f61800ccff0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f61800ccdc0 tx=0x7f617801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d91753b3b0b1ebf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:17.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.032+0000 7f617effd640 1 -- 172.21.15.177:0/2097108748 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61780a57a0 con 0x7f618015d8e0 2023-11-28T20:10:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.032+0000 7f617effd640 1 -- 172.21.15.177:0/2097108748 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61780a5900 con 0x7f618015d8e0 2023-11-28T20:10:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.032+0000 7f617effd640 1 -- 172.21.15.177:0/2097108748 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61780a5c90 con 0x7f618015d8e0 2023-11-28T20:10:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 -- 172.21.15.177:0/2097108748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f618015d8e0 msgr2=0x7f61800ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 --2- 172.21.15.177:0/2097108748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f618015d8e0 0x7f61800ccff0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f61800ccdc0 tx=0x7f617801c8e0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 -- 172.21.15.177:0/2097108748 shutdown_connections 2023-11-28T20:10:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 --2- 172.21.15.177:0/2097108748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f618015d8e0 0x7f61800ccff0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 --2- 172.21.15.177:0/2097108748 >> v2:172.21.15.195:3300/0 conn(0x7f61801571d0 0x7f6180070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 -- 172.21.15.177:0/2097108748 >> 172.21.15.177:0/2097108748 conn(0x7f61800b0cc0 msgr2=0x7f61800b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 -- 172.21.15.177:0/2097108748 shutdown_connections 2023-11-28T20:10:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 -- 172.21.15.177:0/2097108748 wait complete. 2023-11-28T20:10:17.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 Processor -- start 2023-11-28T20:10:17.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 -- start start 2023-11-28T20:10:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61800ae830 0x7f6180155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61801571d0 0x7f618015f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f618015d8e0 0x7f61801587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618015b1f0 con 0x7f618015d8e0 2023-11-28T20:10:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618015b4d0 con 0x7f61801571d0 2023-11-28T20:10:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f618689c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618015b7b0 con 0x7f61800ae830 2023-11-28T20:10:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f6184e39640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f618015d8e0 0x7f61801587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f6184e39640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f618015d8e0 0x7f61801587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48780/0 (socket says 172.21.15.177:48780) 2023-11-28T20:10:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f6184e39640 1 -- 172.21.15.177:0/3649330844 learned_addr learned my addr 172.21.15.177:0/3649330844 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f617ffff640 1 --2- 172.21.15.177:0/3649330844 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61800ae830 0x7f6180155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.036+0000 7f617f7fe640 1 --2- 172.21.15.177:0/3649330844 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61801571d0 0x7f618015f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f6184e39640 1 -- 172.21.15.177:0/3649330844 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61800ae830 msgr2=0x7f6180155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f6184e39640 1 --2- 172.21.15.177:0/3649330844 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61800ae830 0x7f6180155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f6184e39640 1 -- 172.21.15.177:0/3649330844 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61801571d0 msgr2=0x7f618015f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f6184e39640 1 --2- 172.21.15.177:0/3649330844 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61801571d0 0x7f618015f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f6184e39640 1 -- 172.21.15.177:0/3649330844 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6178009b30 con 0x7f618015d8e0 2023-11-28T20:10:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f6184e39640 1 --2- 172.21.15.177:0/3649330844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f618015d8e0 0x7f61801587c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f617801a510 tx=0x7f6178019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f617cff9640 1 -- 172.21.15.177:0/3649330844 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61780b8670 con 0x7f618015d8e0 2023-11-28T20:10:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f617cff9640 1 -- 172.21.15.177:0/3649330844 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61780b87f0 con 0x7f618015d8e0 2023-11-28T20:10:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f617cff9640 1 -- 172.21.15.177:0/3649330844 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61780b8ba0 con 0x7f618015d8e0 2023-11-28T20:10:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f618689c640 1 -- 172.21.15.177:0/3649330844 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618015ba90 con 0x7f618015d8e0 2023-11-28T20:10:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f618689c640 1 -- 172.21.15.177:0/3649330844 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6180156120 con 0x7f618015d8e0 2023-11-28T20:10:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f618689c640 1 -- 172.21.15.177:0/3649330844 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618015bfb0 con 0x7f618015d8e0 2023-11-28T20:10:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f617cff9640 1 -- 172.21.15.177:0/3649330844 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f61780b8d00 con 0x7f618015d8e0 2023-11-28T20:10:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f617cff9640 1 --2- 172.21.15.177:0/3649330844 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f616c066470 0x7f616c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f617cff9640 1 -- 172.21.15.177:0/3649330844 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f617811f260 con 0x7f618015d8e0 2023-11-28T20:10:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.040+0000 7f617ffff640 1 --2- 172.21.15.177:0/3649330844 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f616c066470 0x7f616c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.044+0000 7f617ffff640 1 --2- 172.21.15.177:0/3649330844 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f616c066470 0x7f616c068930 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f61800cb6e0 tx=0x7f6170008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:17.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.044+0000 7f617cff9640 1 -- 172.21.15.177:0/3649330844 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f618015bfb0 con 0x7f618015d8e0 2023-11-28T20:10:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.196+0000 7f618689c640 1 -- 172.21.15.177:0/3649330844 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f618015bfb0 con 0x7f618015d8e0 2023-11-28T20:10:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.196+0000 7f617cff9640 1 -- 172.21.15.177:0/3649330844 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f618015bfb0 con 0x7f618015d8e0 2023-11-28T20:10:17.199 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-28T20:10:17.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.196+0000 7f618689c640 1 -- 172.21.15.177:0/3649330844 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f616c066470 msgr2=0x7f616c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.196+0000 7f618689c640 1 --2- 172.21.15.177:0/3649330844 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f616c066470 0x7f616c068930 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f61800cb6e0 tx=0x7f6170008040 comp rx=0 tx=0).stop 2023-11-28T20:10:17.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.196+0000 7f618689c640 1 -- 172.21.15.177:0/3649330844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f618015d8e0 msgr2=0x7f61801587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.196+0000 7f618689c640 1 --2- 172.21.15.177:0/3649330844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f618015d8e0 0x7f61801587c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f617801a510 tx=0x7f6178019680 comp rx=0 tx=0).stop 2023-11-28T20:10:17.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.196+0000 7f618689c640 1 -- 172.21.15.177:0/3649330844 shutdown_connections 2023-11-28T20:10:17.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.196+0000 7f618689c640 1 --2- 172.21.15.177:0/3649330844 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f616c066470 0x7f616c068930 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.196+0000 7f618689c640 1 --2- 172.21.15.177:0/3649330844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f618015d8e0 0x7f61801587c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.196+0000 7f618689c640 1 --2- 172.21.15.177:0/3649330844 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61801571d0 0x7f618015f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.196+0000 7f618689c640 1 --2- 172.21.15.177:0/3649330844 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61800ae830 0x7f6180155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.196+0000 7f618689c640 1 -- 172.21.15.177:0/3649330844 >> 172.21.15.177:0/3649330844 conn(0x7f61800b0cc0 msgr2=0x7f618013e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:17.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.196+0000 7f618689c640 1 -- 172.21.15.177:0/3649330844 shutdown_connections 2023-11-28T20:10:17.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.196+0000 7f618689c640 1 -- 172.21.15.177:0/3649330844 wait complete. 2023-11-28T20:10:17.220 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:10:17.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.352+0000 7fa0952e3640 1 Processor -- start 2023-11-28T20:10:17.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.352+0000 7fa0952e3640 1 -- start start 2023-11-28T20:10:17.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa0952e3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0900b35b0 0x7fa0900d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa0952e3640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa0900b3c70 0x7fa09015f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa0952e3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa0900cf780 0x7fa0900cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa0952e3640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0900d4090 con 0x7fa0900b3c70 2023-11-28T20:10:17.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa0952e3640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0900d0130 con 0x7fa0900cf780 2023-11-28T20:10:17.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa0952e3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900d3880 con 0x7fa0900b35b0 2023-11-28T20:10:17.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa08e7fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa0900b3c70 0x7fa09015f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa08effd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0900b35b0 0x7fa0900d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa08e7fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa0900b3c70 0x7fa09015f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48792/0 (socket says 172.21.15.177:48792) 2023-11-28T20:10:17.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa08e7fc640 1 -- 172.21.15.177:0/2610763926 learned_addr learned my addr 172.21.15.177:0/2610763926 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:17.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa08f7fe640 1 --2- 172.21.15.177:0/2610763926 >> v2:172.21.15.195:3300/0 conn(0x7fa0900cf780 0x7fa0900cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa08e7fc640 1 -- 172.21.15.177:0/2610763926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0900b35b0 msgr2=0x7fa0900d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:17.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa08e7fc640 1 --2- 172.21.15.177:0/2610763926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0900b35b0 0x7fa0900d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa08e7fc640 1 -- 172.21.15.177:0/2610763926 >> v2:172.21.15.195:3300/0 conn(0x7fa0900cf780 msgr2=0x7fa0900cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:17.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa08e7fc640 1 --2- 172.21.15.177:0/2610763926 >> v2:172.21.15.195:3300/0 conn(0x7fa0900cf780 0x7fa0900cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.356+0000 7fa08e7fc640 1 -- 172.21.15.177:0/2610763926 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0900cdc80 con 0x7fa0900b3c70 2023-11-28T20:10:17.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.360+0000 7fa08e7fc640 1 --2- 172.21.15.177:0/2610763926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0900b3c70 0x7fa09015f060 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa09008c5e0 tx=0x7fa08401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c41ce7597c4274 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:17.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.360+0000 7fa08dffb640 1 -- 172.21.15.177:0/2610763926 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0840aa620 con 0x7fa0900b3c70 2023-11-28T20:10:17.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.360+0000 7fa08dffb640 1 -- 172.21.15.177:0/2610763926 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0840aa780 con 0x7fa0900b3c70 2023-11-28T20:10:17.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.360+0000 7fa08dffb640 1 -- 172.21.15.177:0/2610763926 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0840aab10 con 0x7fa0900b3c70 2023-11-28T20:10:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.360+0000 7fa0952e3640 1 -- 172.21.15.177:0/2610763926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0900b3c70 msgr2=0x7fa09015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.360+0000 7fa0952e3640 1 --2- 172.21.15.177:0/2610763926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0900b3c70 0x7fa09015f060 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa09008c5e0 tx=0x7fa08401c500 comp rx=0 tx=0).stop 2023-11-28T20:10:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.360+0000 7fa0952e3640 1 -- 172.21.15.177:0/2610763926 shutdown_connections 2023-11-28T20:10:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.360+0000 7fa0952e3640 1 --2- 172.21.15.177:0/2610763926 >> v2:172.21.15.195:3300/0 conn(0x7fa0900cf780 0x7fa0900cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.360+0000 7fa0952e3640 1 --2- 172.21.15.177:0/2610763926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0900b3c70 0x7fa09015f060 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.360+0000 7fa0952e3640 1 --2- 172.21.15.177:0/2610763926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0900b35b0 0x7fa0900d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.360+0000 7fa0952e3640 1 -- 172.21.15.177:0/2610763926 >> 172.21.15.177:0/2610763926 conn(0x7fa09009c4b0 msgr2=0x7fa0900d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.360+0000 7fa0952e3640 1 -- 172.21.15.177:0/2610763926 shutdown_connections 2023-11-28T20:10:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.360+0000 7fa0952e3640 1 -- 172.21.15.177:0/2610763926 wait complete. 2023-11-28T20:10:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.360+0000 7fa0952e3640 1 Processor -- start 2023-11-28T20:10:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.360+0000 7fa0952e3640 1 -- start start 2023-11-28T20:10:17.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa0952e3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0900b35b0 0x7fa090151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa0952e3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0900b3c70 0x7fa09014dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa0952e3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0900cf780 0x7fa0900b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa0952e3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa090159c70 con 0x7fa0900b3c70 2023-11-28T20:10:17.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa0952e3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa090159f50 con 0x7fa0900b35b0 2023-11-28T20:10:17.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa0952e3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900cb5c0 con 0x7fa0900cf780 2023-11-28T20:10:17.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa08e7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0900b3c70 0x7fa09014dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa08e7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0900b3c70 0x7fa09014dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48804/0 (socket says 172.21.15.177:48804) 2023-11-28T20:10:17.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa08e7fc640 1 -- 172.21.15.177:0/4132502999 learned_addr learned my addr 172.21.15.177:0/4132502999 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:17.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa08effd640 1 --2- 172.21.15.177:0/4132502999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0900b35b0 0x7fa090151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa08f7fe640 1 --2- 172.21.15.177:0/4132502999 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0900cf780 0x7fa0900b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa08e7fc640 1 -- 172.21.15.177:0/4132502999 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0900cf780 msgr2=0x7fa0900b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa08e7fc640 1 --2- 172.21.15.177:0/4132502999 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0900cf780 0x7fa0900b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa08e7fc640 1 -- 172.21.15.177:0/4132502999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0900b35b0 msgr2=0x7fa090151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa08e7fc640 1 --2- 172.21.15.177:0/4132502999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0900b35b0 0x7fa090151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa08e7fc640 1 -- 172.21.15.177:0/4132502999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0840094d0 con 0x7fa0900b3c70 2023-11-28T20:10:17.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa08effd640 1 --2- 172.21.15.177:0/4132502999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0900b35b0 0x7fa090151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:17.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa08e7fc640 1 --2- 172.21.15.177:0/4132502999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0900b3c70 0x7fa09014dcd0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa08401abb0 tx=0x7fa08401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:17.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa0777fe640 1 -- 172.21.15.177:0/4132502999 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0840aae00 con 0x7fa0900b3c70 2023-11-28T20:10:17.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa0777fe640 1 -- 172.21.15.177:0/4132502999 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0840bd3f0 con 0x7fa0900b3c70 2023-11-28T20:10:17.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa0777fe640 1 -- 172.21.15.177:0/4132502999 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0840bd7a0 con 0x7fa0900b3c70 2023-11-28T20:10:17.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa0952e3640 1 -- 172.21.15.177:0/4132502999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0900cb8a0 con 0x7fa0900b3c70 2023-11-28T20:10:17.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa0952e3640 1 -- 172.21.15.177:0/4132502999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09014e770 con 0x7fa0900b3c70 2023-11-28T20:10:17.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa0952e3640 1 -- 172.21.15.177:0/4132502999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0900cbae0 con 0x7fa0900b3c70 2023-11-28T20:10:17.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.364+0000 7fa0777fe640 1 -- 172.21.15.177:0/4132502999 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa0840b33f0 con 0x7fa0900b3c70 2023-11-28T20:10:17.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.368+0000 7fa0777fe640 1 --2- 172.21.15.177:0/4132502999 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa07c066470 0x7fa07c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.368+0000 7fa0777fe640 1 -- 172.21.15.177:0/4132502999 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa08411dff0 con 0x7fa0900b3c70 2023-11-28T20:10:17.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.368+0000 7fa08effd640 1 --2- 172.21.15.177:0/4132502999 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa07c066470 0x7fa07c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.368+0000 7fa08effd640 1 --2- 172.21.15.177:0/4132502999 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa07c066470 0x7fa07c068930 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa09015c2c0 tx=0x7fa080008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:17.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.372+0000 7fa0777fe640 1 -- 172.21.15.177:0/4132502999 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0900cbae0 con 0x7fa0900b3c70 2023-11-28T20:10:17.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.552+0000 7fa0952e3640 1 -- 172.21.15.177:0/4132502999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0900cbae0 con 0x7fa0900b3c70 2023-11-28T20:10:17.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.552+0000 7fa0777fe640 1 -- 172.21.15.177:0/4132502999 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fa0900cbae0 con 0x7fa0900b3c70 2023-11-28T20:10:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:17.557 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1822043740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1822043740},{"type":"v1","addr":"172.21.15.195:6835","nonce":1822043740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5713,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3889128653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3889128653},{"type":"v1","addr":"172.21.15.195:6834","nonce":3889128653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5898,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2574151536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2574151536},{"type":"v1","addr":"172.21.15.177:6835","nonce":2574151536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:09:43.046143+0000","modified":"2023-11-28T20:09:46.049118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/198543116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":198543116},{"type":"v1","addr":"172.21.15.177:6837","nonce":198543116}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T20:10:17.557 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 26 2023-11-28T20:10:17.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.556+0000 7fa0952e3640 1 -- 172.21.15.177:0/4132502999 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa07c066470 msgr2=0x7fa07c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.556+0000 7fa0952e3640 1 --2- 172.21.15.177:0/4132502999 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa07c066470 0x7fa07c068930 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa09015c2c0 tx=0x7fa080008040 comp rx=0 tx=0).stop 2023-11-28T20:10:17.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.556+0000 7fa0952e3640 1 -- 172.21.15.177:0/4132502999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0900b3c70 msgr2=0x7fa09014dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.556+0000 7fa0952e3640 1 --2- 172.21.15.177:0/4132502999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0900b3c70 0x7fa09014dcd0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa08401abb0 tx=0x7fa08401ad40 comp rx=0 tx=0).stop 2023-11-28T20:10:17.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.556+0000 7fa0952e3640 1 -- 172.21.15.177:0/4132502999 shutdown_connections 2023-11-28T20:10:17.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.556+0000 7fa0952e3640 1 --2- 172.21.15.177:0/4132502999 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa07c066470 0x7fa07c068930 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.556+0000 7fa0952e3640 1 --2- 172.21.15.177:0/4132502999 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0900cf780 0x7fa0900b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.556+0000 7fa0952e3640 1 --2- 172.21.15.177:0/4132502999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0900b3c70 0x7fa09014dcd0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.556+0000 7fa0952e3640 1 --2- 172.21.15.177:0/4132502999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0900b35b0 0x7fa090151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.556+0000 7fa0952e3640 1 -- 172.21.15.177:0/4132502999 >> 172.21.15.177:0/4132502999 conn(0x7fa09009c4b0 msgr2=0x7fa0900afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:17.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.556+0000 7fa0952e3640 1 -- 172.21.15.177:0/4132502999 shutdown_connections 2023-11-28T20:10:17.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.556+0000 7fa0952e3640 1 -- 172.21.15.177:0/4132502999 wait complete. 2023-11-28T20:10:17.578 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:10:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.712+0000 7fc0cd879640 1 Processor -- start 2023-11-28T20:10:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.712+0000 7fc0cd879640 1 -- start start 2023-11-28T20:10:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.716+0000 7fc0cd879640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc0c815ad40 0x7fc0c8164df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.716+0000 7fc0cd879640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c815b170 con 0x7fc0c813cf30 2023-11-28T20:10:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.716+0000 7fc0cd879640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c815b3a0 con 0x7fc0c806c9d0 2023-11-28T20:10:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.716+0000 7fc0cd879640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c813d310 con 0x7fc0c815ad40 2023-11-28T20:10:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.716+0000 7fc0c6ffd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc0c813cf30 0x7fc0c806c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:55536/0 (socket says 172.21.15.177:55536) 2023-11-28T20:10:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.716+0000 7fc0c6ffd640 1 -- 172.21.15.177:0/3341794254 learned_addr learned my addr 172.21.15.177:0/3341794254 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.716+0000 7fc0c77fe640 1 --2- 172.21.15.177:0/3341794254 >> v2:172.21.15.177:3300/0 conn(0x7fc0c815ad40 0x7fc0c8164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.716+0000 7fc0c5ffb640 1 -- 172.21.15.177:0/3341794254 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639483633 0 0) 0x7fc0c815b170 con 0x7fc0c813cf30 2023-11-28T20:10:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.716+0000 7fc0c5ffb640 1 -- 172.21.15.177:0/3341794254 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0b0003530 con 0x7fc0c813cf30 2023-11-28T20:10:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.716+0000 7fc0c77fe640 1 -- 172.21.15.177:0/3341794254 >> v1:172.21.15.195:6789/0 conn(0x7fc0c806c9d0 legacy=0x7fc0c815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.716+0000 7fc0c77fe640 1 -- 172.21.15.177:0/3341794254 >> v1:172.21.15.177:6789/0 conn(0x7fc0c813cf30 legacy=0x7fc0c806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.716+0000 7fc0c77fe640 1 -- 172.21.15.177:0/3341794254 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c813f720 con 0x7fc0c815ad40 2023-11-28T20:10:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.720+0000 7fc0c77fe640 1 --2- 172.21.15.177:0/3341794254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c815ad40 0x7fc0c8164df0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009d90 tx=0x7fc0c001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa2679e2dfb2e03 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.720+0000 7fc0c5ffb640 1 -- 172.21.15.177:0/3341794254 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c00a5870 con 0x7fc0c815ad40 2023-11-28T20:10:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.720+0000 7fc0c5ffb640 1 -- 172.21.15.177:0/3341794254 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c00a59d0 con 0x7fc0c815ad40 2023-11-28T20:10:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.720+0000 7fc0c5ffb640 1 -- 172.21.15.177:0/3341794254 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c00a5d60 con 0x7fc0c815ad40 2023-11-28T20:10:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.720+0000 7fc0cd879640 1 -- 172.21.15.177:0/3341794254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c815ad40 msgr2=0x7fc0c8164df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.720+0000 7fc0cd879640 1 --2- 172.21.15.177:0/3341794254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c815ad40 0x7fc0c8164df0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009d90 tx=0x7fc0c001c8c0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.720+0000 7fc0cd879640 1 -- 172.21.15.177:0/3341794254 shutdown_connections 2023-11-28T20:10:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.720+0000 7fc0cd879640 1 --2- 172.21.15.177:0/3341794254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c815ad40 0x7fc0c8164df0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.720+0000 7fc0cd879640 1 -- 172.21.15.177:0/3341794254 >> 172.21.15.177:0/3341794254 conn(0x7fc0c806a530 msgr2=0x7fc0c806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.720+0000 7fc0cd879640 1 -- 172.21.15.177:0/3341794254 shutdown_connections 2023-11-28T20:10:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.720+0000 7fc0cd879640 1 -- 172.21.15.177:0/3341794254 wait complete. 2023-11-28T20:10:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.720+0000 7fc0cd879640 1 Processor -- start 2023-11-28T20:10:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.720+0000 7fc0cd879640 1 -- start start 2023-11-28T20:10:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0cd879640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c806c9d0 0x7fc0c81369b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0cd879640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0c813cf30 0x7fc0c815bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0cd879640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0c815ad40 0x7fc0c8159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0cd879640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c8159650 con 0x7fc0c806c9d0 2023-11-28T20:10:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0cd879640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c8158a40 con 0x7fc0c815ad40 2023-11-28T20:10:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0cd879640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c8158d20 con 0x7fc0c813cf30 2023-11-28T20:10:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0c6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c806c9d0 0x7fc0c81369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0c6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c806c9d0 0x7fc0c81369b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48816/0 (socket says 172.21.15.177:48816) 2023-11-28T20:10:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0c6ffd640 1 -- 172.21.15.177:0/1961716759 learned_addr learned my addr 172.21.15.177:0/1961716759 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0c77fe640 1 --2- 172.21.15.177:0/1961716759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0c815ad40 0x7fc0c8159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0c67fc640 1 --2- 172.21.15.177:0/1961716759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0c813cf30 0x7fc0c815bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0c6ffd640 1 -- 172.21.15.177:0/1961716759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0c813cf30 msgr2=0x7fc0c815bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0c6ffd640 1 --2- 172.21.15.177:0/1961716759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0c813cf30 0x7fc0c815bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0c6ffd640 1 -- 172.21.15.177:0/1961716759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0c815ad40 msgr2=0x7fc0c8159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0c6ffd640 1 --2- 172.21.15.177:0/1961716759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0c815ad40 0x7fc0c8159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0c6ffd640 1 -- 172.21.15.177:0/1961716759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c0009a70 con 0x7fc0c806c9d0 2023-11-28T20:10:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0c67fc640 1 --2- 172.21.15.177:0/1961716759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0c813cf30 0x7fc0c815bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0c6ffd640 1 --2- 172.21.15.177:0/1961716759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c806c9d0 0x7fc0c81369b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800c4d0 tx=0x7fc0b800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0affff640 1 -- 172.21.15.177:0/1961716759 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8005cf0 con 0x7fc0c806c9d0 2023-11-28T20:10:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0affff640 1 -- 172.21.15.177:0/1961716759 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b8005e50 con 0x7fc0c806c9d0 2023-11-28T20:10:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0cd879640 1 -- 172.21.15.177:0/1961716759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c8159000 con 0x7fc0c806c9d0 2023-11-28T20:10:17.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0affff640 1 -- 172.21.15.177:0/1961716759 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8007270 con 0x7fc0c806c9d0 2023-11-28T20:10:17.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0cd879640 1 -- 172.21.15.177:0/1961716759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c81365f0 con 0x7fc0c806c9d0 2023-11-28T20:10:17.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0cd879640 1 -- 172.21.15.177:0/1961716759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c8070440 con 0x7fc0c806c9d0 2023-11-28T20:10:17.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.724+0000 7fc0affff640 1 -- 172.21.15.177:0/1961716759 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc0b80073d0 con 0x7fc0c806c9d0 2023-11-28T20:10:17.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.728+0000 7fc0affff640 1 --2- 172.21.15.177:0/1961716759 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc0b4066470 0x7fc0b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:17.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.728+0000 7fc0affff640 1 -- 172.21.15.177:0/1961716759 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0b8083340 con 0x7fc0c806c9d0 2023-11-28T20:10:17.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.728+0000 7fc0c67fc640 1 --2- 172.21.15.177:0/1961716759 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc0b4066470 0x7fc0b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:17.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.728+0000 7fc0c67fc640 1 --2- 172.21.15.177:0/1961716759 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc0b4066470 0x7fc0b4068930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8136410 tx=0x7fc0bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.732+0000 7fc0affff640 1 -- 172.21.15.177:0/1961716759 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc0c8070440 con 0x7fc0c806c9d0 2023-11-28T20:10:17.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.880+0000 7fc0cd879640 1 -- 172.21.15.177:0/1961716759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0c8070440 con 0x7fc0c806c9d0 2023-11-28T20:10:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.884+0000 7fc0affff640 1 -- 172.21.15.177:0/1961716759 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fc0c8070440 con 0x7fc0c806c9d0 2023-11-28T20:10:17.886 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:17.886 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":49,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:09:44.664848+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:09:40.777720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T20:09:42.029277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:10:17.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.884+0000 7fc0cd879640 1 -- 172.21.15.177:0/1961716759 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc0b4066470 msgr2=0x7fc0b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.884+0000 7fc0cd879640 1 --2- 172.21.15.177:0/1961716759 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc0b4066470 0x7fc0b4068930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8136410 tx=0x7fc0bc009040 comp rx=0 tx=0).stop 2023-11-28T20:10:17.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.884+0000 7fc0cd879640 1 -- 172.21.15.177:0/1961716759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c806c9d0 msgr2=0x7fc0c81369b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:17.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.884+0000 7fc0cd879640 1 --2- 172.21.15.177:0/1961716759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c806c9d0 0x7fc0c81369b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800c4d0 tx=0x7fc0b800c990 comp rx=0 tx=0).stop 2023-11-28T20:10:17.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.884+0000 7fc0cd879640 1 -- 172.21.15.177:0/1961716759 shutdown_connections 2023-11-28T20:10:17.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.884+0000 7fc0cd879640 1 --2- 172.21.15.177:0/1961716759 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc0b4066470 0x7fc0b4068930 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.884+0000 7fc0cd879640 1 --2- 172.21.15.177:0/1961716759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0c815ad40 0x7fc0c8159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.884+0000 7fc0cd879640 1 --2- 172.21.15.177:0/1961716759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0c813cf30 0x7fc0c815bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.884+0000 7fc0cd879640 1 --2- 172.21.15.177:0/1961716759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0c806c9d0 0x7fc0c81369b0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:17.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.884+0000 7fc0cd879640 1 -- 172.21.15.177:0/1961716759 >> 172.21.15.177:0/1961716759 conn(0x7fc0c806a530 msgr2=0x7fc0c8139920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:17.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.884+0000 7fc0cd879640 1 -- 172.21.15.177:0/1961716759 shutdown_connections 2023-11-28T20:10:17.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:17.884+0000 7fc0cd879640 1 -- 172.21.15.177:0/1961716759 wait complete. 2023-11-28T20:10:17.907 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T20:10:17.908 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:10:18.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.040+0000 7fd7aa654640 1 Processor -- start 2023-11-28T20:10:18.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.040+0000 7fd7aa654640 1 -- start start 2023-11-28T20:10:18.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.044+0000 7fd7aa654640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd7a406d190 0x7fd7a415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.044+0000 7fd7aa654640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a4070460 con 0x7fd7a406cdb0 2023-11-28T20:10:18.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.044+0000 7fd7aa654640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a415ab20 con 0x7fd7a4150960 2023-11-28T20:10:18.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.044+0000 7fd7aa654640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a4070690 con 0x7fd7a406d190 2023-11-28T20:10:18.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.044+0000 7fd7a3fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fd7a406cdb0 0x7fd7a4150250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:55538/0 (socket says 172.21.15.177:55538) 2023-11-28T20:10:18.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.044+0000 7fd7a3fff640 1 -- 172.21.15.177:0/597971968 learned_addr learned my addr 172.21.15.177:0/597971968 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:18.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.044+0000 7fd7a8bf1640 1 --2- 172.21.15.177:0/597971968 >> v2:172.21.15.177:3300/0 conn(0x7fd7a406d190 0x7fd7a415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.044+0000 7fd7a8bf1640 1 -- 172.21.15.177:0/597971968 >> v1:172.21.15.195:6789/0 conn(0x7fd7a4150960 legacy=0x7fd7a4159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:18.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.044+0000 7fd7a8bf1640 1 -- 172.21.15.177:0/597971968 >> v1:172.21.15.177:6789/0 conn(0x7fd7a406cdb0 legacy=0x7fd7a4150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.044+0000 7fd7a8bf1640 1 -- 172.21.15.177:0/597971968 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a4070970 con 0x7fd7a406d190 2023-11-28T20:10:18.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.048+0000 7fd7a8bf1640 1 --2- 172.21.15.177:0/597971968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a406d190 0x7fd7a415a4b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009d90 tx=0x7fd79c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50766336d6ff2c08 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:18.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.048+0000 7fd7a2ffd640 1 -- 172.21.15.177:0/597971968 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c0a5750 con 0x7fd7a406d190 2023-11-28T20:10:18.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.048+0000 7fd7a2ffd640 1 -- 172.21.15.177:0/597971968 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c0a58b0 con 0x7fd7a406d190 2023-11-28T20:10:18.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.048+0000 7fd7a2ffd640 1 -- 172.21.15.177:0/597971968 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c0a5c40 con 0x7fd7a406d190 2023-11-28T20:10:18.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.048+0000 7fd7aa654640 1 -- 172.21.15.177:0/597971968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a406d190 msgr2=0x7fd7a415a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.048+0000 7fd7aa654640 1 --2- 172.21.15.177:0/597971968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a406d190 0x7fd7a415a4b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009d90 tx=0x7fd79c01c910 comp rx=0 tx=0).stop 2023-11-28T20:10:18.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.048+0000 7fd7aa654640 1 -- 172.21.15.177:0/597971968 shutdown_connections 2023-11-28T20:10:18.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.048+0000 7fd7aa654640 1 --2- 172.21.15.177:0/597971968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a406d190 0x7fd7a415a4b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.048+0000 7fd7aa654640 1 -- 172.21.15.177:0/597971968 >> 172.21.15.177:0/597971968 conn(0x7fd7a406a530 msgr2=0x7fd7a406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:18.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.048+0000 7fd7aa654640 1 -- 172.21.15.177:0/597971968 shutdown_connections 2023-11-28T20:10:18.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.048+0000 7fd7aa654640 1 -- 172.21.15.177:0/597971968 wait complete. 2023-11-28T20:10:18.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.048+0000 7fd7aa654640 1 Processor -- start 2023-11-28T20:10:18.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.048+0000 7fd7aa654640 1 -- start start 2023-11-28T20:10:18.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7aa654640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7a406cdb0 0x7fd7a4133b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7aa654640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a406d190 0x7fd7a41448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7aa654640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a4150960 0x7fd7a414bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7aa654640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a41535b0 con 0x7fd7a4150960 2023-11-28T20:10:18.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7aa654640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a4145170 con 0x7fd7a406d190 2023-11-28T20:10:18.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7aa654640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a4145730 con 0x7fd7a406cdb0 2023-11-28T20:10:18.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a8bf1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a4150960 0x7fd7a414bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a8bf1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a4150960 0x7fd7a414bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48838/0 (socket says 172.21.15.177:48838) 2023-11-28T20:10:18.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a8bf1640 1 -- 172.21.15.177:0/4221445170 learned_addr learned my addr 172.21.15.177:0/4221445170 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:18.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a3fff640 1 --2- 172.21.15.177:0/4221445170 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7a406cdb0 0x7fd7a4133b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a37fe640 1 --2- 172.21.15.177:0/4221445170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a406d190 0x7fd7a41448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a8bf1640 1 -- 172.21.15.177:0/4221445170 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7a406cdb0 msgr2=0x7fd7a4133b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a8bf1640 1 --2- 172.21.15.177:0/4221445170 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7a406cdb0 0x7fd7a4133b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a8bf1640 1 -- 172.21.15.177:0/4221445170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a406d190 msgr2=0x7fd7a41448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a8bf1640 1 --2- 172.21.15.177:0/4221445170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a406d190 0x7fd7a41448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a8bf1640 1 -- 172.21.15.177:0/4221445170 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c009a70 con 0x7fd7a4150960 2023-11-28T20:10:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a37fe640 1 --2- 172.21.15.177:0/4221445170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a406d190 0x7fd7a41448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a8bf1640 1 --2- 172.21.15.177:0/4221445170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a4150960 0x7fd7a414bd80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd79c01a540 tx=0x7fd79c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a0ff9640 1 -- 172.21.15.177:0/4221445170 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c0b9860 con 0x7fd7a4150960 2023-11-28T20:10:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a0ff9640 1 -- 172.21.15.177:0/4221445170 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c0b99c0 con 0x7fd7a4150960 2023-11-28T20:10:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a0ff9640 1 -- 172.21.15.177:0/4221445170 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c0b9d50 con 0x7fd7a4150960 2023-11-28T20:10:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7aa654640 1 -- 172.21.15.177:0/4221445170 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a4134040 con 0x7fd7a4150960 2023-11-28T20:10:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7aa654640 1 -- 172.21.15.177:0/4221445170 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a4153aa0 con 0x7fd7a4150960 2023-11-28T20:10:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7aa654640 1 -- 172.21.15.177:0/4221445170 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a4069440 con 0x7fd7a4150960 2023-11-28T20:10:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.052+0000 7fd7a0ff9640 1 -- 172.21.15.177:0/4221445170 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd79c0ad440 con 0x7fd7a4150960 2023-11-28T20:10:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.056+0000 7fd7a0ff9640 1 --2- 172.21.15.177:0/4221445170 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd7900664a0 0x7fd790068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.056+0000 7fd7a0ff9640 1 -- 172.21.15.177:0/4221445170 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd79c11ead0 con 0x7fd7a4150960 2023-11-28T20:10:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.056+0000 7fd7a3fff640 1 --2- 172.21.15.177:0/4221445170 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd7900664a0 0x7fd790068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.056+0000 7fd7a3fff640 1 --2- 172.21.15.177:0/4221445170 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd7900664a0 0x7fd790068960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd794000f70 tx=0x7fd794009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:18.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.060+0000 7fd7a0ff9640 1 -- 172.21.15.177:0/4221445170 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd79c0ec090 con 0x7fd7a4150960 2023-11-28T20:10:18.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.240+0000 7fd7aa654640 1 -- 172.21.15.177:0/4221445170 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7a4071380 con 0x7fd7a4150960 2023-11-28T20:10:18.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.240+0000 7fd7a0ff9640 1 -- 172.21.15.177:0/4221445170 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fd7a4071380 con 0x7fd7a4150960 2023-11-28T20:10:18.244 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:18.244 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1822043740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1822043740},{"type":"v1","addr":"172.21.15.195:6835","nonce":1822043740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5713,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3889128653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3889128653},{"type":"v1","addr":"172.21.15.195:6834","nonce":3889128653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5898,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2574151536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2574151536},{"type":"v1","addr":"172.21.15.177:6835","nonce":2574151536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:09:43.046143+0000","modified":"2023-11-28T20:09:46.049118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/198543116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":198543116},{"type":"v1","addr":"172.21.15.177:6837","nonce":198543116}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T20:10:18.244 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 26 2023-11-28T20:10:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.240+0000 7fd7aa654640 1 -- 172.21.15.177:0/4221445170 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd7900664a0 msgr2=0x7fd790068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.240+0000 7fd7aa654640 1 --2- 172.21.15.177:0/4221445170 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd7900664a0 0x7fd790068960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd794000f70 tx=0x7fd794009040 comp rx=0 tx=0).stop 2023-11-28T20:10:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.240+0000 7fd7aa654640 1 -- 172.21.15.177:0/4221445170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a4150960 msgr2=0x7fd7a414bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.240+0000 7fd7aa654640 1 --2- 172.21.15.177:0/4221445170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a4150960 0x7fd7a414bd80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd79c01a540 tx=0x7fd79c0196b0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.240+0000 7fd7aa654640 1 -- 172.21.15.177:0/4221445170 shutdown_connections 2023-11-28T20:10:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.240+0000 7fd7aa654640 1 --2- 172.21.15.177:0/4221445170 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd7900664a0 0x7fd790068960 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.240+0000 7fd7aa654640 1 --2- 172.21.15.177:0/4221445170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a4150960 0x7fd7a414bd80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.240+0000 7fd7aa654640 1 --2- 172.21.15.177:0/4221445170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a406d190 0x7fd7a41448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.240+0000 7fd7aa654640 1 --2- 172.21.15.177:0/4221445170 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7a406cdb0 0x7fd7a4133b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.240+0000 7fd7aa654640 1 -- 172.21.15.177:0/4221445170 >> 172.21.15.177:0/4221445170 conn(0x7fd7a406a530 msgr2=0x7fd7a4150240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.240+0000 7fd7aa654640 1 -- 172.21.15.177:0/4221445170 shutdown_connections 2023-11-28T20:10:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.240+0000 7fd7aa654640 1 -- 172.21.15.177:0/4221445170 wait complete. 2023-11-28T20:10:18.264 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:10:18.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce7af0f640 1 Processor -- start 2023-11-28T20:10:18.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce7af0f640 1 -- start start 2023-11-28T20:10:18.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce7af0f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fce74144840 0x7fce7406c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce7af0f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fce74072180 0x7fce7406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce7af0f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce740710e0 con 0x7fce74070460 2023-11-28T20:10:18.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce7af0f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7415f010 con 0x7fce74072180 2023-11-28T20:10:18.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce7af0f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce740713c0 con 0x7fce74144840 2023-11-28T20:10:18.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce6bfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fce74072180 0x7fce7406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce794ac640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fce74070460 0x7fce74070910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:55544/0 (socket says 172.21.15.177:55544) 2023-11-28T20:10:18.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce794ac640 1 -- 172.21.15.177:0/13125213 learned_addr learned my addr 172.21.15.177:0/13125213 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:18.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce6bfff640 1 -- 172.21.15.177:0/13125213 >> v2:172.21.15.195:3300/0 conn(0x7fce74144840 msgr2=0x7fce7406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:18.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce78cab640 1 --2- 172.21.15.177:0/13125213 >> v2:172.21.15.195:3300/0 conn(0x7fce74144840 0x7fce7406c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce6bfff640 1 --2- 172.21.15.177:0/13125213 >> v2:172.21.15.195:3300/0 conn(0x7fce74144840 0x7fce7406c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce6b7fe640 1 -- 172.21.15.177:0/13125213 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909737450 0 0) 0x7fce740710e0 con 0x7fce74070460 2023-11-28T20:10:18.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce6bfff640 1 -- 172.21.15.177:0/13125213 >> v1:172.21.15.177:6789/0 conn(0x7fce74070460 legacy=0x7fce74070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce6bfff640 1 -- 172.21.15.177:0/13125213 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce740716a0 con 0x7fce74072180 2023-11-28T20:10:18.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.400+0000 7fce78cab640 1 --2- 172.21.15.177:0/13125213 >> v2:172.21.15.195:3300/0 conn(0x7fce74144840 0x7fce7406c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:18.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.404+0000 7fce6bfff640 1 --2- 172.21.15.177:0/13125213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce74072180 0x7fce7406c800 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fce74068020 tx=0x7fce6401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e456ba36e25f739b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:18.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.404+0000 7fce6b7fe640 1 -- 172.21.15.177:0/13125213 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640a7070 con 0x7fce74072180 2023-11-28T20:10:18.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.404+0000 7fce6b7fe640 1 -- 172.21.15.177:0/13125213 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce640ab430 con 0x7fce74072180 2023-11-28T20:10:18.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.404+0000 7fce6b7fe640 1 -- 172.21.15.177:0/13125213 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640ab7c0 con 0x7fce74072180 2023-11-28T20:10:18.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.404+0000 7fce7af0f640 1 -- 172.21.15.177:0/13125213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce74072180 msgr2=0x7fce7406c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.404+0000 7fce7af0f640 1 --2- 172.21.15.177:0/13125213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce74072180 0x7fce7406c800 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fce74068020 tx=0x7fce6401c430 comp rx=0 tx=0).stop 2023-11-28T20:10:18.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.404+0000 7fce7af0f640 1 -- 172.21.15.177:0/13125213 shutdown_connections 2023-11-28T20:10:18.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.404+0000 7fce7af0f640 1 --2- 172.21.15.177:0/13125213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce74072180 0x7fce7406c800 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.404+0000 7fce7af0f640 1 --2- 172.21.15.177:0/13125213 >> v2:172.21.15.195:3300/0 conn(0x7fce74144840 0x7fce7406c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.404+0000 7fce7af0f640 1 -- 172.21.15.177:0/13125213 >> 172.21.15.177:0/13125213 conn(0x7fce7406a530 msgr2=0x7fce7406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:18.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.404+0000 7fce7af0f640 1 -- 172.21.15.177:0/13125213 shutdown_connections 2023-11-28T20:10:18.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.404+0000 7fce7af0f640 1 -- 172.21.15.177:0/13125213 wait complete. 2023-11-28T20:10:18.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce7af0f640 1 Processor -- start 2023-11-28T20:10:18.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce7af0f640 1 -- start start 2023-11-28T20:10:18.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce7af0f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce74070460 0x7fce74164010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce7af0f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce74072180 0x7fce741f9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce7af0f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce74144840 0x7fce740b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce7af0f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce741653c0 con 0x7fce74144840 2023-11-28T20:10:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce7af0f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce74164550 con 0x7fce74070460 2023-11-28T20:10:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce7af0f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce741fa050 con 0x7fce74072180 2023-11-28T20:10:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce794ac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce74144840 0x7fce740b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce794ac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce74144840 0x7fce740b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48860/0 (socket says 172.21.15.177:48860) 2023-11-28T20:10:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce794ac640 1 -- 172.21.15.177:0/567175142 learned_addr learned my addr 172.21.15.177:0/567175142 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce78cab640 1 --2- 172.21.15.177:0/567175142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce74070460 0x7fce74164010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce6bfff640 1 --2- 172.21.15.177:0/567175142 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce74072180 0x7fce741f9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce794ac640 1 -- 172.21.15.177:0/567175142 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce74072180 msgr2=0x7fce741f9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce794ac640 1 --2- 172.21.15.177:0/567175142 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce74072180 0x7fce741f9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce794ac640 1 -- 172.21.15.177:0/567175142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce74070460 msgr2=0x7fce74164010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce794ac640 1 --2- 172.21.15.177:0/567175142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce74070460 0x7fce74164010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce794ac640 1 -- 172.21.15.177:0/567175142 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce64009420 con 0x7fce74144840 2023-11-28T20:10:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce78cab640 1 --2- 172.21.15.177:0/567175142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce74070460 0x7fce74164010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce794ac640 1 --2- 172.21.15.177:0/567175142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce74144840 0x7fce740b3880 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fce6c001570 tx=0x7fce6c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce697fa640 1 -- 172.21.15.177:0/567175142 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00a640 con 0x7fce74144840 2023-11-28T20:10:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce697fa640 1 -- 172.21.15.177:0/567175142 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c00a7c0 con 0x7fce74144840 2023-11-28T20:10:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce697fa640 1 -- 172.21.15.177:0/567175142 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00ab70 con 0x7fce74144840 2023-11-28T20:10:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce7af0f640 1 -- 172.21.15.177:0/567175142 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce74164a20 con 0x7fce74144840 2023-11-28T20:10:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.408+0000 7fce7af0f640 1 -- 172.21.15.177:0/567175142 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce74164fe0 con 0x7fce74144840 2023-11-28T20:10:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.412+0000 7fce7af0f640 1 -- 172.21.15.177:0/567175142 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce74069440 con 0x7fce74144840 2023-11-28T20:10:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.412+0000 7fce697fa640 1 -- 172.21.15.177:0/567175142 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fce6c00acd0 con 0x7fce74144840 2023-11-28T20:10:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.412+0000 7fce697fa640 1 --2- 172.21.15.177:0/567175142 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fce60066470 0x7fce60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.412+0000 7fce697fa640 1 -- 172.21.15.177:0/567175142 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce6c083440 con 0x7fce74144840 2023-11-28T20:10:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.412+0000 7fce78cab640 1 --2- 172.21.15.177:0/567175142 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fce60066470 0x7fce60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.412+0000 7fce78cab640 1 --2- 172.21.15.177:0/567175142 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fce60066470 0x7fce60068930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fce7000a9b0 tx=0x7fce70008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:18.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.416+0000 7fce697fa640 1 -- 172.21.15.177:0/567175142 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce6c0508d0 con 0x7fce74144840 2023-11-28T20:10:18.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.596+0000 7fce7af0f640 1 -- 172.21.15.177:0/567175142 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce7406d170 con 0x7fce74144840 2023-11-28T20:10:18.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.600+0000 7fce697fa640 1 -- 172.21.15.177:0/567175142 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fce6c018090 con 0x7fce74144840 2023-11-28T20:10:18.602 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:18.603 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1822043740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1822043740},{"type":"v1","addr":"172.21.15.195:6835","nonce":1822043740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5713,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3889128653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3889128653},{"type":"v1","addr":"172.21.15.195:6834","nonce":3889128653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5898,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2574151536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2574151536},{"type":"v1","addr":"172.21.15.177:6835","nonce":2574151536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:09:43.046143+0000","modified":"2023-11-28T20:09:46.049118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/198543116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":198543116},{"type":"v1","addr":"172.21.15.177:6837","nonce":198543116}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T20:10:18.603 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 26 2023-11-28T20:10:18.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.600+0000 7fce7af0f640 1 -- 172.21.15.177:0/567175142 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fce60066470 msgr2=0x7fce60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.600+0000 7fce7af0f640 1 --2- 172.21.15.177:0/567175142 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fce60066470 0x7fce60068930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fce7000a9b0 tx=0x7fce70008040 comp rx=0 tx=0).stop 2023-11-28T20:10:18.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.600+0000 7fce7af0f640 1 -- 172.21.15.177:0/567175142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce74144840 msgr2=0x7fce740b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.600+0000 7fce7af0f640 1 --2- 172.21.15.177:0/567175142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce74144840 0x7fce740b3880 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fce6c001570 tx=0x7fce6c00cca0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.600+0000 7fce7af0f640 1 -- 172.21.15.177:0/567175142 shutdown_connections 2023-11-28T20:10:18.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.600+0000 7fce7af0f640 1 --2- 172.21.15.177:0/567175142 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fce60066470 0x7fce60068930 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.600+0000 7fce7af0f640 1 --2- 172.21.15.177:0/567175142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce74144840 0x7fce740b3880 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.600+0000 7fce7af0f640 1 --2- 172.21.15.177:0/567175142 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce74072180 0x7fce741f9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.600+0000 7fce7af0f640 1 --2- 172.21.15.177:0/567175142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce74070460 0x7fce74164010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.600+0000 7fce7af0f640 1 -- 172.21.15.177:0/567175142 >> 172.21.15.177:0/567175142 conn(0x7fce7406a530 msgr2=0x7fce7415dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:18.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.600+0000 7fce7af0f640 1 -- 172.21.15.177:0/567175142 shutdown_connections 2023-11-28T20:10:18.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.600+0000 7fce7af0f640 1 -- 172.21.15.177:0/567175142 wait complete. 2023-11-28T20:10:18.623 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:10:18.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.760+0000 7f85eaa5a640 1 Processor -- start 2023-11-28T20:10:18.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.760+0000 7f85eaa5a640 1 -- start start 2023-11-28T20:10:18.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.760+0000 7f85eaa5a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f85e415ad40 0x7f85e4164df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.760+0000 7f85eaa5a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e415b170 con 0x7f85e413cf30 2023-11-28T20:10:18.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.760+0000 7f85eaa5a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e415b3a0 con 0x7f85e406c9d0 2023-11-28T20:10:18.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.760+0000 7f85eaa5a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e413d310 con 0x7f85e415ad40 2023-11-28T20:10:18.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.760+0000 7f85e3fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f85e413cf30 0x7f85e406c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46992/0 (socket says 172.21.15.177:46992) 2023-11-28T20:10:18.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.760+0000 7f85e3fff640 1 -- 172.21.15.177:0/1014759484 learned_addr learned my addr 172.21.15.177:0/1014759484 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:18.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.760+0000 7f85e8ff7640 1 --2- 172.21.15.177:0/1014759484 >> v2:172.21.15.177:3300/0 conn(0x7f85e415ad40 0x7f85e4164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.760+0000 7f85e2ffd640 1 -- 172.21.15.177:0/1014759484 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500284348 0 0) 0x7f85e415b170 con 0x7f85e413cf30 2023-11-28T20:10:18.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.760+0000 7f85e2ffd640 1 -- 172.21.15.177:0/1014759484 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85cc003530 con 0x7f85e413cf30 2023-11-28T20:10:18.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.760+0000 7f85e8ff7640 1 -- 172.21.15.177:0/1014759484 >> v1:172.21.15.195:6789/0 conn(0x7f85e406c9d0 legacy=0x7f85e415a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.760+0000 7f85e8ff7640 1 -- 172.21.15.177:0/1014759484 >> v1:172.21.15.177:6789/0 conn(0x7f85e413cf30 legacy=0x7f85e406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.760+0000 7f85e8ff7640 1 -- 172.21.15.177:0/1014759484 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e413f720 con 0x7f85e415ad40 2023-11-28T20:10:18.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.764+0000 7f85e8ff7640 1 --2- 172.21.15.177:0/1014759484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e415ad40 0x7f85e4164df0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009d90 tx=0x7f85dc01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f2e90c9d7c7d04 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:18.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.764+0000 7f85e2ffd640 1 -- 172.21.15.177:0/1014759484 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0a5870 con 0x7f85e415ad40 2023-11-28T20:10:18.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.764+0000 7f85e2ffd640 1 -- 172.21.15.177:0/1014759484 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc0a59d0 con 0x7f85e415ad40 2023-11-28T20:10:18.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.764+0000 7f85e2ffd640 1 -- 172.21.15.177:0/1014759484 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0a5d60 con 0x7f85e415ad40 2023-11-28T20:10:18.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.764+0000 7f85eaa5a640 1 -- 172.21.15.177:0/1014759484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e415ad40 msgr2=0x7f85e4164df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.764+0000 7f85eaa5a640 1 --2- 172.21.15.177:0/1014759484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e415ad40 0x7f85e4164df0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009d90 tx=0x7f85dc01c8c0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.764+0000 7f85eaa5a640 1 -- 172.21.15.177:0/1014759484 shutdown_connections 2023-11-28T20:10:18.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.764+0000 7f85eaa5a640 1 --2- 172.21.15.177:0/1014759484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e415ad40 0x7f85e4164df0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.764+0000 7f85eaa5a640 1 -- 172.21.15.177:0/1014759484 >> 172.21.15.177:0/1014759484 conn(0x7f85e406a530 msgr2=0x7f85e406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:18.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.764+0000 7f85eaa5a640 1 -- 172.21.15.177:0/1014759484 shutdown_connections 2023-11-28T20:10:18.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.764+0000 7f85eaa5a640 1 -- 172.21.15.177:0/1014759484 wait complete. 2023-11-28T20:10:18.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85eaa5a640 1 Processor -- start 2023-11-28T20:10:18.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85eaa5a640 1 -- start start 2023-11-28T20:10:18.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85eaa5a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e406c9d0 0x7f85e413eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85eaa5a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85e413cf30 0x7f85e41348d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85eaa5a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85e415ad40 0x7f85e413bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85eaa5a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40cc650 con 0x7f85e406c9d0 2023-11-28T20:10:18.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85eaa5a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e413d7b0 con 0x7f85e413cf30 2023-11-28T20:10:18.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85eaa5a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e413afe0 con 0x7f85e415ad40 2023-11-28T20:10:18.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85e3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e406c9d0 0x7f85e413eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85e3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e406c9d0 0x7f85e413eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59658/0 (socket says 172.21.15.177:59658) 2023-11-28T20:10:18.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85e3fff640 1 -- 172.21.15.177:0/3321356453 learned_addr learned my addr 172.21.15.177:0/3321356453 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:18.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85e37fe640 1 --2- 172.21.15.177:0/3321356453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85e413cf30 0x7f85e41348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85e8ff7640 1 --2- 172.21.15.177:0/3321356453 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85e415ad40 0x7f85e413bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85e3fff640 1 -- 172.21.15.177:0/3321356453 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85e415ad40 msgr2=0x7f85e413bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85e3fff640 1 --2- 172.21.15.177:0/3321356453 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85e415ad40 0x7f85e413bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85e3fff640 1 -- 172.21.15.177:0/3321356453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85e413cf30 msgr2=0x7f85e41348d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85e3fff640 1 --2- 172.21.15.177:0/3321356453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85e413cf30 0x7f85e41348d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85e3fff640 1 -- 172.21.15.177:0/3321356453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc009a70 con 0x7f85e406c9d0 2023-11-28T20:10:18.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85e3fff640 1 --2- 172.21.15.177:0/3321356453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e406c9d0 0x7f85e413eff0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f85d400c4d0 tx=0x7f85d400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:18.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85e0ff9640 1 -- 172.21.15.177:0/3321356453 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4005cf0 con 0x7f85e406c9d0 2023-11-28T20:10:18.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85e0ff9640 1 -- 172.21.15.177:0/3321356453 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d4005e50 con 0x7f85e406c9d0 2023-11-28T20:10:18.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85e0ff9640 1 -- 172.21.15.177:0/3321356453 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4007270 con 0x7f85e406c9d0 2023-11-28T20:10:18.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85eaa5a640 1 -- 172.21.15.177:0/3321356453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e413b2c0 con 0x7f85e406c9d0 2023-11-28T20:10:18.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.768+0000 7f85eaa5a640 1 -- 172.21.15.177:0/3321356453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e4134e10 con 0x7f85e406c9d0 2023-11-28T20:10:18.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.772+0000 7f85eaa5a640 1 -- 172.21.15.177:0/3321356453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e4070440 con 0x7f85e406c9d0 2023-11-28T20:10:18.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.772+0000 7f85e0ff9640 1 -- 172.21.15.177:0/3321356453 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f85d40073d0 con 0x7f85e406c9d0 2023-11-28T20:10:18.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.772+0000 7f85e0ff9640 1 --2- 172.21.15.177:0/3321356453 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f85d0066470 0x7f85d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:18.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.772+0000 7f85e0ff9640 1 -- 172.21.15.177:0/3321356453 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85d4083380 con 0x7f85e406c9d0 2023-11-28T20:10:18.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.772+0000 7f85e37fe640 1 --2- 172.21.15.177:0/3321356453 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f85d0066470 0x7f85d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:18.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.772+0000 7f85e37fe640 1 --2- 172.21.15.177:0/3321356453 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f85d0066470 0x7f85d0068930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f85e415ce90 tx=0x7f85d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:18.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.776+0000 7f85e0ff9640 1 -- 172.21.15.177:0/3321356453 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f85e4070440 con 0x7f85e406c9d0 2023-11-28T20:10:18.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.928+0000 7f85eaa5a640 1 -- 172.21.15.177:0/3321356453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85e413b7e0 con 0x7f85e406c9d0 2023-11-28T20:10:18.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.928+0000 7f85e0ff9640 1 -- 172.21.15.177:0/3321356453 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f85e413b7e0 con 0x7f85e406c9d0 2023-11-28T20:10:18.933 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:18.934 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":49,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:09:44.664848+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:09:40.777720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T20:09:42.029277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:10:18.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.932+0000 7f85eaa5a640 1 -- 172.21.15.177:0/3321356453 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f85d0066470 msgr2=0x7f85d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.932+0000 7f85eaa5a640 1 --2- 172.21.15.177:0/3321356453 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f85d0066470 0x7f85d0068930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f85e415ce90 tx=0x7f85d8009040 comp rx=0 tx=0).stop 2023-11-28T20:10:18.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.932+0000 7f85eaa5a640 1 -- 172.21.15.177:0/3321356453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e406c9d0 msgr2=0x7f85e413eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:18.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.932+0000 7f85eaa5a640 1 --2- 172.21.15.177:0/3321356453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e406c9d0 0x7f85e413eff0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f85d400c4d0 tx=0x7f85d400c990 comp rx=0 tx=0).stop 2023-11-28T20:10:18.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.932+0000 7f85eaa5a640 1 -- 172.21.15.177:0/3321356453 shutdown_connections 2023-11-28T20:10:18.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.932+0000 7f85eaa5a640 1 --2- 172.21.15.177:0/3321356453 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f85d0066470 0x7f85d0068930 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.932+0000 7f85eaa5a640 1 --2- 172.21.15.177:0/3321356453 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85e415ad40 0x7f85e413bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.932+0000 7f85eaa5a640 1 --2- 172.21.15.177:0/3321356453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85e413cf30 0x7f85e41348d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.932+0000 7f85eaa5a640 1 --2- 172.21.15.177:0/3321356453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e406c9d0 0x7f85e413eff0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:18.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.932+0000 7f85eaa5a640 1 -- 172.21.15.177:0/3321356453 >> 172.21.15.177:0/3321356453 conn(0x7f85e406a530 msgr2=0x7f85e41361a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:18.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.932+0000 7f85eaa5a640 1 -- 172.21.15.177:0/3321356453 shutdown_connections 2023-11-28T20:10:18.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:18.932+0000 7f85eaa5a640 1 -- 172.21.15.177:0/3321356453 wait complete. 2023-11-28T20:10:18.956 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T20:10:19.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8b05db8640 1 Processor -- start 2023-11-28T20:10:19.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8b05db8640 1 -- start start 2023-11-28T20:10:19.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8b05db8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8b00150960 0x7f8b00159da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:19.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8b05db8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0006d190 0x7f8b0015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:19.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8b05db8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b00070460 con 0x7f8b0006cdb0 2023-11-28T20:10:19.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8b05db8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0015ab20 con 0x7f8b00150960 2023-11-28T20:10:19.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8b05db8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b00070690 con 0x7f8b0006d190 2023-11-28T20:10:19.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8aff7fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f8b0006cdb0 0x7f8b00150250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47006/0 (socket says 172.21.15.177:47006) 2023-11-28T20:10:19.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8aff7fe640 1 -- 172.21.15.177:0/4213662942 learned_addr learned my addr 172.21.15.177:0/4213662942 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:19.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 -- 172.21.15.177:0/4213662942 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123763488 0 0) 0x7f8b00070460 con 0x7f8b0006cdb0 2023-11-28T20:10:19.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 -- 172.21.15.177:0/4213662942 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aec003530 con 0x7f8b0006cdb0 2023-11-28T20:10:19.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8af7fff640 1 --2- 172.21.15.177:0/4213662942 >> v2:172.21.15.195:3300/0 conn(0x7f8b00150960 0x7f8b00159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:19.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afffff640 1 --2- 172.21.15.177:0/4213662942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0006d190 0x7f8b0015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:19.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 -- 172.21.15.177:0/4213662942 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3101480970 0 0) 0x7f8aec003530 con 0x7f8b0006cdb0 2023-11-28T20:10:19.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 -- 172.21.15.177:0/4213662942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0006d190 msgr2=0x7f8b0015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:19.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 --2- 172.21.15.177:0/4213662942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0006d190 0x7f8b0015a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:19.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 -- 172.21.15.177:0/4213662942 >> v2:172.21.15.195:3300/0 conn(0x7f8b00150960 msgr2=0x7f8b00159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:19.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 --2- 172.21.15.177:0/4213662942 >> v2:172.21.15.195:3300/0 conn(0x7f8b00150960 0x7f8b00159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:19.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 -- 172.21.15.177:0/4213662942 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b00070970 con 0x7f8b0006cdb0 2023-11-28T20:10:19.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 -- 172.21.15.177:0/4213662942 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f8af0001680 con 0x7f8b0006cdb0 2023-11-28T20:10:19.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 -- 172.21.15.177:0/4213662942 >> v1:172.21.15.177:6789/0 conn(0x7f8b0006cdb0 legacy=0x7f8b00150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:19.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 --2- 172.21.15.177:0/4213662942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8aec003980 0x7f8aec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:19.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 --2- 172.21.15.177:0/4213662942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0006d190 0x7f8aec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:19.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 --2- 172.21.15.177:0/4213662942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8aec004d10 0x7f8aec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:19.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 -- 172.21.15.177:0/4213662942 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0015ab20 con 0x7f8aec004d10 2023-11-28T20:10:19.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 -- 172.21.15.177:0/4213662942 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b00070690 con 0x7f8aec003980 2023-11-28T20:10:19.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afeffd640 1 -- 172.21.15.177:0/4213662942 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec00ba40 con 0x7f8b0006d190 2023-11-28T20:10:19.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afffff640 1 --2- 172.21.15.177:0/4213662942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8aec004d10 0x7f8aec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:19.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8aff7fe640 1 --2- 172.21.15.177:0/4213662942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8aec003980 0x7f8aec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:19.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8af7fff640 1 --2- 172.21.15.177:0/4213662942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0006d190 0x7f8aec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:19.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afffff640 1 -- 172.21.15.177:0/4213662942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0006d190 msgr2=0x7f8aec0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:19.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afffff640 1 --2- 172.21.15.177:0/4213662942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0006d190 0x7f8aec0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:19.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afffff640 1 -- 172.21.15.177:0/4213662942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8aec003980 msgr2=0x7f8aec003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:19.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afffff640 1 --2- 172.21.15.177:0/4213662942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8aec003980 0x7f8aec003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:19.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8afffff640 1 -- 172.21.15.177:0/4213662942 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec003530 con 0x7f8aec004d10 2023-11-28T20:10:19.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.092+0000 7f8af7fff640 1 --2- 172.21.15.177:0/4213662942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0006d190 0x7f8aec0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:19.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.096+0000 7f8afffff640 1 --2- 172.21.15.177:0/4213662942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8aec004d10 0x7f8aec005190 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8af80090b0 tx=0x7f8af801cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a328d90910f9272 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:19.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.096+0000 7f8afeffd640 1 -- 172.21.15.177:0/4213662942 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8007220 con 0x7f8aec004d10 2023-11-28T20:10:19.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.096+0000 7f8afeffd640 1 -- 172.21.15.177:0/4213662942 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af80a9070 con 0x7f8aec004d10 2023-11-28T20:10:19.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.096+0000 7f8afeffd640 1 -- 172.21.15.177:0/4213662942 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af80a5980 con 0x7f8aec004d10 2023-11-28T20:10:19.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.096+0000 7f8b05db8640 1 -- 172.21.15.177:0/4213662942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8aec004d10 msgr2=0x7f8aec005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:19.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.096+0000 7f8b05db8640 1 --2- 172.21.15.177:0/4213662942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8aec004d10 0x7f8aec005190 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8af80090b0 tx=0x7f8af801cc70 comp rx=0 tx=0).stop 2023-11-28T20:10:19.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.096+0000 7f8afffff640 1 -- 172.21.15.177:0/4213662942 reap_dead start 2023-11-28T20:10:19.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.096+0000 7f8b05db8640 1 -- 172.21.15.177:0/4213662942 shutdown_connections 2023-11-28T20:10:19.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.096+0000 7f8b05db8640 1 -- 172.21.15.177:0/4213662942 >> 172.21.15.177:0/4213662942 conn(0x7f8b0006a530 msgr2=0x7f8b0006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:19.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.096+0000 7f8b05db8640 1 -- 172.21.15.177:0/4213662942 shutdown_connections 2023-11-28T20:10:19.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.096+0000 7f8b05db8640 1 -- 172.21.15.177:0/4213662942 wait complete. 2023-11-28T20:10:19.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8b05db8640 1 Processor -- start 2023-11-28T20:10:19.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8b05db8640 1 -- start start 2023-11-28T20:10:19.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8b05db8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b001e6f30 0x7f8b0013f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:19.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8b05db8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b001e7310 0x7f8b0013f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:19.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8b05db8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b0015bd70 0x7f8b0015c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:19.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8b05db8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b001e4c00 con 0x7f8b001e7310 2023-11-28T20:10:19.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8b05db8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b001e4330 con 0x7f8b0015bd70 2023-11-28T20:10:19.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8b05db8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0015cb30 con 0x7f8b001e6f30 2023-11-28T20:10:19.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8af7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b001e7310 0x7f8b0013f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:19.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8af7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b001e7310 0x7f8b0013f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59688/0 (socket says 172.21.15.177:59688) 2023-11-28T20:10:19.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8af7fff640 1 -- 172.21.15.177:0/1812299548 learned_addr learned my addr 172.21.15.177:0/1812299548 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:19.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8aff7fe640 1 --2- 172.21.15.177:0/1812299548 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b001e6f30 0x7f8b0013f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:19.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8afffff640 1 --2- 172.21.15.177:0/1812299548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b0015bd70 0x7f8b0015c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:19.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8af7fff640 1 -- 172.21.15.177:0/1812299548 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b001e6f30 msgr2=0x7f8b0013f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:19.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8af7fff640 1 --2- 172.21.15.177:0/1812299548 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b001e6f30 0x7f8b0013f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:19.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8af7fff640 1 -- 172.21.15.177:0/1812299548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b0015bd70 msgr2=0x7f8b0015c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:19.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8af7fff640 1 --2- 172.21.15.177:0/1812299548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b0015bd70 0x7f8b0015c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:19.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8af7fff640 1 -- 172.21.15.177:0/1812299548 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b001e4540 con 0x7f8b001e7310 2023-11-28T20:10:19.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8afffff640 1 --2- 172.21.15.177:0/1812299548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b0015bd70 0x7f8b0015c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:19.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8af7fff640 1 --2- 172.21.15.177:0/1812299548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b001e7310 0x7f8b0013f930 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800fa10 tx=0x7f8ae800fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:19.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8afcff9640 1 -- 172.21.15.177:0/1812299548 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800dd60 con 0x7f8b001e7310 2023-11-28T20:10:19.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8afcff9640 1 -- 172.21.15.177:0/1812299548 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae801a460 con 0x7f8b001e7310 2023-11-28T20:10:19.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8b05db8640 1 -- 172.21.15.177:0/1812299548 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b001e4820 con 0x7f8b001e7310 2023-11-28T20:10:19.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8afcff9640 1 -- 172.21.15.177:0/1812299548 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae801a810 con 0x7f8b001e7310 2023-11-28T20:10:19.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.100+0000 7f8b05db8640 1 -- 172.21.15.177:0/1812299548 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0015c730 con 0x7f8b001e7310 2023-11-28T20:10:19.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.104+0000 7f8b05db8640 1 -- 172.21.15.177:0/1812299548 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b000b42d0 con 0x7f8b001e7310 2023-11-28T20:10:19.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.104+0000 7f8afcff9640 1 -- 172.21.15.177:0/1812299548 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ae801a970 con 0x7f8b001e7310 2023-11-28T20:10:19.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.104+0000 7f8afcff9640 1 --2- 172.21.15.177:0/1812299548 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8ae00664a0 0x7f8ae0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:19.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.104+0000 7f8afcff9640 1 -- 172.21.15.177:0/1812299548 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ae80846b0 con 0x7f8b001e7310 2023-11-28T20:10:19.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.104+0000 7f8aff7fe640 1 --2- 172.21.15.177:0/1812299548 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8ae00664a0 0x7f8ae0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:19.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.104+0000 7f8aff7fe640 1 --2- 172.21.15.177:0/1812299548 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8ae00664a0 0x7f8ae0068960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8af0000c10 tx=0x7f8af0007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:19.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.108+0000 7f8afcff9640 1 -- 172.21.15.177:0/1812299548 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ae8051bc0 con 0x7f8b001e7310 2023-11-28T20:10:19.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.292+0000 7f8b05db8640 1 -- 172.21.15.177:0/1812299548 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8b00069440 con 0x7f8b001e7310 2023-11-28T20:10:19.296 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-11-28T20:10:19.292+0000 7f79a8741640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T20:10:19.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.296+0000 7f8afcff9640 1 -- 172.21.15.177:0/1812299548 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8ae80551e0 con 0x7f8b001e7310 2023-11-28T20:10:19.299 INFO:teuthology.orchestra.run.smithi177.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T20:10:19.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.296+0000 7f8b05db8640 1 -- 172.21.15.177:0/1812299548 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8ae00664a0 msgr2=0x7f8ae0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.296+0000 7f8b05db8640 1 --2- 172.21.15.177:0/1812299548 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8ae00664a0 0x7f8ae0068960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8af0000c10 tx=0x7f8af0007900 comp rx=0 tx=0).stop 2023-11-28T20:10:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.296+0000 7f8b05db8640 1 -- 172.21.15.177:0/1812299548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b001e7310 msgr2=0x7f8b0013f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.296+0000 7f8b05db8640 1 --2- 172.21.15.177:0/1812299548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b001e7310 0x7f8b0013f930 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800fa10 tx=0x7f8ae800fed0 comp rx=0 tx=0).stop 2023-11-28T20:10:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.300+0000 7f8b05db8640 1 -- 172.21.15.177:0/1812299548 shutdown_connections 2023-11-28T20:10:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.300+0000 7f8b05db8640 1 --2- 172.21.15.177:0/1812299548 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8ae00664a0 0x7f8ae0068960 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.300+0000 7f8b05db8640 1 --2- 172.21.15.177:0/1812299548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b0015bd70 0x7f8b0015c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.300+0000 7f8b05db8640 1 --2- 172.21.15.177:0/1812299548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b001e7310 0x7f8b0013f930 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.300+0000 7f8b05db8640 1 --2- 172.21.15.177:0/1812299548 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b001e6f30 0x7f8b0013f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.300+0000 7f8b05db8640 1 -- 172.21.15.177:0/1812299548 >> 172.21.15.177:0/1812299548 conn(0x7f8b0006a530 msgr2=0x7f8b000b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.300+0000 7f8b05db8640 1 -- 172.21.15.177:0/1812299548 shutdown_connections 2023-11-28T20:10:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.300+0000 7f8b05db8640 1 -- 172.21.15.177:0/1812299548 wait complete. 2023-11-28T20:10:19.312 INFO:tasks.ceph.mds.a.smithi177.stderr: -2687> 2023-11-28T20:09:48.628+0000 7fac6dd78640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:10:19.330 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T20:10:19.365 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-11-28T20:10:19.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.468+0000 7fd12b92a640 1 Processor -- start 2023-11-28T20:10:19.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.468+0000 7fd12b92a640 1 -- start start 2023-11-28T20:10:19.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.468+0000 7fd12b92a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd12414b1e0 0x7fd1240b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:19.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.468+0000 7fd12b92a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1240b4770 con 0x7fd1240b4350 2023-11-28T20:10:19.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.468+0000 7fd12b92a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1240b1fc0 con 0x7fd12414abe0 2023-11-28T20:10:19.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.468+0000 7fd12b92a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd124166130 con 0x7fd12414b1e0 2023-11-28T20:10:19.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.468+0000 7fd129ec7640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fd1240b4350 0x7fd1240703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47024/0 (socket says 172.21.15.177:47024) 2023-11-28T20:10:19.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.468+0000 7fd129ec7640 1 -- 172.21.15.177:0/102573598 learned_addr learned my addr 172.21.15.177:0/102573598 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:19.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.468+0000 7fd128ec5640 1 --2- 172.21.15.177:0/102573598 >> v2:172.21.15.195:3300/0 conn(0x7fd12414b1e0 0x7fd1240b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:19.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.472+0000 7fd11bfff640 1 -- 172.21.15.177:0/102573598 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501305401 0 0) 0x7fd1240b4770 con 0x7fd1240b4350 2023-11-28T20:10:19.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.472+0000 7fd11bfff640 1 -- 172.21.15.177:0/102573598 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd110003530 con 0x7fd1240b4350 2023-11-28T20:10:19.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.472+0000 7fd11bfff640 1 -- 172.21.15.177:0/102573598 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328532855 0 0) 0x7fd1240b1fc0 con 0x7fd12414abe0 2023-11-28T20:10:19.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.472+0000 7fd11bfff640 1 -- 172.21.15.177:0/102573598 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1240b4770 con 0x7fd12414abe0 2023-11-28T20:10:19.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.472+0000 7fd128ec5640 1 -- 172.21.15.177:0/102573598 >> v1:172.21.15.195:6789/0 conn(0x7fd12414abe0 legacy=0x7fd124165a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:19.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.472+0000 7fd128ec5640 1 -- 172.21.15.177:0/102573598 >> v1:172.21.15.177:6789/0 conn(0x7fd1240b4350 legacy=0x7fd1240703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:19.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.472+0000 7fd128ec5640 1 -- 172.21.15.177:0/102573598 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1240b2260 con 0x7fd12414b1e0 2023-11-28T20:10:19.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.472+0000 7fd128ec5640 1 --2- 172.21.15.177:0/102573598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd12414b1e0 0x7fd1240b3e10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd1140097c0 tx=0x7fd11401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb4e838f523eea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:19.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.472+0000 7fd11bfff640 1 -- 172.21.15.177:0/102573598 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140ab650 con 0x7fd12414b1e0 2023-11-28T20:10:19.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.472+0000 7fd11bfff640 1 -- 172.21.15.177:0/102573598 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1140ab7b0 con 0x7fd12414b1e0 2023-11-28T20:10:19.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.472+0000 7fd11bfff640 1 -- 172.21.15.177:0/102573598 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140abb20 con 0x7fd12414b1e0 2023-11-28T20:10:19.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd12b92a640 1 -- 172.21.15.177:0/102573598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd12414b1e0 msgr2=0x7fd1240b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:19.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd12b92a640 1 --2- 172.21.15.177:0/102573598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd12414b1e0 0x7fd1240b3e10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd1140097c0 tx=0x7fd11401c450 comp rx=0 tx=0).stop 2023-11-28T20:10:19.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd12b92a640 1 -- 172.21.15.177:0/102573598 shutdown_connections 2023-11-28T20:10:19.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd12b92a640 1 --2- 172.21.15.177:0/102573598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd12414b1e0 0x7fd1240b3e10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:19.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd12b92a640 1 -- 172.21.15.177:0/102573598 >> 172.21.15.177:0/102573598 conn(0x7fd1240b0cc0 msgr2=0x7fd1240b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:19.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd12b92a640 1 -- 172.21.15.177:0/102573598 shutdown_connections 2023-11-28T20:10:19.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd12b92a640 1 -- 172.21.15.177:0/102573598 wait complete. 2023-11-28T20:10:19.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd12b92a640 1 Processor -- start 2023-11-28T20:10:19.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd12b92a640 1 -- start start 2023-11-28T20:10:19.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd12b92a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1240b4350 0x7fd12413ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:19.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd12b92a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd12414abe0 0x7fd12413d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:19.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd12b92a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd12413efb0 0x7fd12413f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:19.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd12b92a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12415eb50 con 0x7fd1240b4350 2023-11-28T20:10:19.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd12b92a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12415f6c0 con 0x7fd12413efb0 2023-11-28T20:10:19.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd12b92a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12415ed90 con 0x7fd12414abe0 2023-11-28T20:10:19.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd1296c6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1240b4350 0x7fd12413ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:19.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd1296c6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1240b4350 0x7fd12413ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59704/0 (socket says 172.21.15.177:59704) 2023-11-28T20:10:19.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd1296c6640 1 -- 172.21.15.177:0/1739222307 learned_addr learned my addr 172.21.15.177:0/1739222307 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:19.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd128ec5640 1 --2- 172.21.15.177:0/1739222307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd12414abe0 0x7fd12413d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:19.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd129ec7640 1 --2- 172.21.15.177:0/1739222307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd12413efb0 0x7fd12413f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:19.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd1296c6640 1 -- 172.21.15.177:0/1739222307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd12414abe0 msgr2=0x7fd12413d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:19.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd1296c6640 1 --2- 172.21.15.177:0/1739222307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd12414abe0 0x7fd12413d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:19.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd1296c6640 1 -- 172.21.15.177:0/1739222307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd12413efb0 msgr2=0x7fd12413f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:19.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd1296c6640 1 --2- 172.21.15.177:0/1739222307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd12413efb0 0x7fd12413f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:19.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.476+0000 7fd1296c6640 1 -- 172.21.15.177:0/1739222307 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd114009420 con 0x7fd1240b4350 2023-11-28T20:10:19.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.480+0000 7fd1296c6640 1 --2- 172.21.15.177:0/1739222307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1240b4350 0x7fd12413ce70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fd12000c490 tx=0x7fd12000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:19.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.480+0000 7fd119ffb640 1 -- 172.21.15.177:0/1739222307 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200052d0 con 0x7fd1240b4350 2023-11-28T20:10:19.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.480+0000 7fd119ffb640 1 -- 172.21.15.177:0/1739222307 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd120005430 con 0x7fd1240b4350 2023-11-28T20:10:19.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.480+0000 7fd119ffb640 1 -- 172.21.15.177:0/1739222307 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd120012870 con 0x7fd1240b4350 2023-11-28T20:10:19.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.480+0000 7fd12b92a640 1 -- 172.21.15.177:0/1739222307 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12415f070 con 0x7fd1240b4350 2023-11-28T20:10:19.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.480+0000 7fd12b92a640 1 -- 172.21.15.177:0/1739222307 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12413fd70 con 0x7fd1240b4350 2023-11-28T20:10:19.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.480+0000 7fd12b92a640 1 -- 172.21.15.177:0/1739222307 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1240693d0 con 0x7fd1240b4350 2023-11-28T20:10:19.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.480+0000 7fd119ffb640 1 -- 172.21.15.177:0/1739222307 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd1200129d0 con 0x7fd1240b4350 2023-11-28T20:10:19.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.480+0000 7fd119ffb640 1 --2- 172.21.15.177:0/1739222307 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd1080664a0 0x7fd108068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:19.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.480+0000 7fd119ffb640 1 -- 172.21.15.177:0/1739222307 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd120083a10 con 0x7fd1240b4350 2023-11-28T20:10:19.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.480+0000 7fd128ec5640 1 --2- 172.21.15.177:0/1739222307 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd1080664a0 0x7fd108068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:19.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.484+0000 7fd128ec5640 1 --2- 172.21.15.177:0/1739222307 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd1080664a0 0x7fd108068960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd1140af000 tx=0x7fd1140a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:19.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.484+0000 7fd119ffb640 1 -- 172.21.15.177:0/1739222307 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd120050e20 con 0x7fd1240b4350 2023-11-28T20:10:19.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:19.668+0000 7fd12b92a640 1 -- 172.21.15.177:0/1739222307 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd124165b20 con 0x7fd1240b4350 2023-11-28T20:10:20.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.360+0000 7fd119ffb640 1 -- 172.21.15.177:0/1739222307 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd120054440 con 0x7fd1240b4350 2023-11-28T20:10:20.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.360+0000 7fd12b92a640 1 -- 172.21.15.177:0/1739222307 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd1080664a0 msgr2=0x7fd108068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:20.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.360+0000 7fd12b92a640 1 --2- 172.21.15.177:0/1739222307 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd1080664a0 0x7fd108068960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd1140af000 tx=0x7fd1140a7000 comp rx=0 tx=0).stop 2023-11-28T20:10:20.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.360+0000 7fd12b92a640 1 -- 172.21.15.177:0/1739222307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1240b4350 msgr2=0x7fd12413ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:20.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.360+0000 7fd12b92a640 1 --2- 172.21.15.177:0/1739222307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1240b4350 0x7fd12413ce70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fd12000c490 tx=0x7fd12000c950 comp rx=0 tx=0).stop 2023-11-28T20:10:20.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.364+0000 7fd12b92a640 1 -- 172.21.15.177:0/1739222307 shutdown_connections 2023-11-28T20:10:20.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.364+0000 7fd12b92a640 1 --2- 172.21.15.177:0/1739222307 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd1080664a0 0x7fd108068960 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:20.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.364+0000 7fd12b92a640 1 --2- 172.21.15.177:0/1739222307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd12413efb0 0x7fd12413f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:20.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.364+0000 7fd12b92a640 1 --2- 172.21.15.177:0/1739222307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd12414abe0 0x7fd12413d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:20.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.364+0000 7fd12b92a640 1 --2- 172.21.15.177:0/1739222307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1240b4350 0x7fd12413ce70 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:20.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.364+0000 7fd12b92a640 1 -- 172.21.15.177:0/1739222307 >> 172.21.15.177:0/1739222307 conn(0x7fd1240b0cc0 msgr2=0x7fd1240b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:20.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.364+0000 7fd12b92a640 1 -- 172.21.15.177:0/1739222307 shutdown_connections 2023-11-28T20:10:20.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.364+0000 7fd12b92a640 1 -- 172.21.15.177:0/1739222307 wait complete. 2023-11-28T20:10:20.389 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T20:10:20.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc85c9c640 1 Processor -- start 2023-11-28T20:10:20.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc85c9c640 1 -- start start 2023-11-28T20:10:20.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc85c9c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc8015d190 0x7fcc800b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:20.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc85c9c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcc800b4fe0 0x7fcc8006a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:20.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc85c9c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcc8006aa70 0x7fcc80160d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:20.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc85c9c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8006af20 con 0x7fcc8006aa70 2023-11-28T20:10:20.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc85c9c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800725b0 con 0x7fcc800b4fe0 2023-11-28T20:10:20.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc85c9c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80071510 con 0x7fcc8015d190 2023-11-28T20:10:20.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc8549b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcc8006aa70 0x7fcc80160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:20.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc8549b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcc8006aa70 0x7fcc80160d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59708/0 (socket says 172.21.15.177:59708) 2023-11-28T20:10:20.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc8549b640 1 -- 172.21.15.177:0/3804515808 learned_addr learned my addr 172.21.15.177:0/3804515808 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:20.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc7ffff640 1 --2- 172.21.15.177:0/3804515808 >> v2:172.21.15.195:3300/0 conn(0x7fcc800b4fe0 0x7fcc8006a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:20.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc84c9a640 1 --2- 172.21.15.177:0/3804515808 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc8015d190 0x7fcc800b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:20.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc8549b640 1 -- 172.21.15.177:0/3804515808 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc8015d190 msgr2=0x7fcc800b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:20.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc8549b640 1 --2- 172.21.15.177:0/3804515808 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc8015d190 0x7fcc800b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:20.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc8549b640 1 -- 172.21.15.177:0/3804515808 >> v2:172.21.15.195:3300/0 conn(0x7fcc800b4fe0 msgr2=0x7fcc8006a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:20.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc8549b640 1 --2- 172.21.15.177:0/3804515808 >> v2:172.21.15.195:3300/0 conn(0x7fcc800b4fe0 0x7fcc8006a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:20.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.576+0000 7fcc8549b640 1 -- 172.21.15.177:0/3804515808 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc800717f0 con 0x7fcc8006aa70 2023-11-28T20:10:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.580+0000 7fcc8549b640 1 --2- 172.21.15.177:0/3804515808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc8006aa70 0x7fcc80160d10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fcc800b2af0 tx=0x7fcc7801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9c4a4fd536c5e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.580+0000 7fcc7f7fe640 1 -- 172.21.15.177:0/3804515808 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc780a5560 con 0x7fcc8006aa70 2023-11-28T20:10:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.580+0000 7fcc7f7fe640 1 -- 172.21.15.177:0/3804515808 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc780a56c0 con 0x7fcc8006aa70 2023-11-28T20:10:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.580+0000 7fcc7f7fe640 1 -- 172.21.15.177:0/3804515808 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc780a5a50 con 0x7fcc8006aa70 2023-11-28T20:10:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.580+0000 7fcc85c9c640 1 -- 172.21.15.177:0/3804515808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc8006aa70 msgr2=0x7fcc80160d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.580+0000 7fcc85c9c640 1 --2- 172.21.15.177:0/3804515808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc8006aa70 0x7fcc80160d10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fcc800b2af0 tx=0x7fcc7801c6e0 comp rx=0 tx=0).stop 2023-11-28T20:10:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.580+0000 7fcc85c9c640 1 -- 172.21.15.177:0/3804515808 shutdown_connections 2023-11-28T20:10:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.580+0000 7fcc85c9c640 1 --2- 172.21.15.177:0/3804515808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc8006aa70 0x7fcc80160d10 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.580+0000 7fcc85c9c640 1 --2- 172.21.15.177:0/3804515808 >> v2:172.21.15.195:3300/0 conn(0x7fcc800b4fe0 0x7fcc8006a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.580+0000 7fcc85c9c640 1 --2- 172.21.15.177:0/3804515808 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc8015d190 0x7fcc800b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.580+0000 7fcc85c9c640 1 -- 172.21.15.177:0/3804515808 >> 172.21.15.177:0/3804515808 conn(0x7fcc800b1a30 msgr2=0x7fcc800b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:20.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.580+0000 7fcc85c9c640 1 -- 172.21.15.177:0/3804515808 shutdown_connections 2023-11-28T20:10:20.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.580+0000 7fcc85c9c640 1 -- 172.21.15.177:0/3804515808 wait complete. 2023-11-28T20:10:20.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.580+0000 7fcc85c9c640 1 Processor -- start 2023-11-28T20:10:20.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.580+0000 7fcc85c9c640 1 -- start start 2023-11-28T20:10:20.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc85c9c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc8006aa70 0x7fcc80144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:20.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc85c9c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc800b4fe0 0x7fcc80153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:20.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc85c9c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc8015d190 0x7fcc800b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:20.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc85c9c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8015c340 con 0x7fcc800b4fe0 2023-11-28T20:10:20.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc85c9c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8015baa0 con 0x7fcc8015d190 2023-11-28T20:10:20.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc85c9c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8015bd80 con 0x7fcc8006aa70 2023-11-28T20:10:20.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc7ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc800b4fe0 0x7fcc80153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:20.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc7ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc800b4fe0 0x7fcc80153000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59712/0 (socket says 172.21.15.177:59712) 2023-11-28T20:10:20.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc7ffff640 1 -- 172.21.15.177:0/2982267516 learned_addr learned my addr 172.21.15.177:0/2982267516 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:20.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc84c9a640 1 --2- 172.21.15.177:0/2982267516 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc8006aa70 0x7fcc80144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:20.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc8549b640 1 --2- 172.21.15.177:0/2982267516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc8015d190 0x7fcc800b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:20.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc7ffff640 1 -- 172.21.15.177:0/2982267516 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc8006aa70 msgr2=0x7fcc80144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:20.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc7ffff640 1 --2- 172.21.15.177:0/2982267516 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc8006aa70 0x7fcc80144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:20.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc7ffff640 1 -- 172.21.15.177:0/2982267516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc8015d190 msgr2=0x7fcc800b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:20.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc7ffff640 1 --2- 172.21.15.177:0/2982267516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc8015d190 0x7fcc800b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:20.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc7ffff640 1 -- 172.21.15.177:0/2982267516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc78009b30 con 0x7fcc800b4fe0 2023-11-28T20:10:20.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc7ffff640 1 --2- 172.21.15.177:0/2982267516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc800b4fe0 0x7fcc80153000 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00d7d0 tx=0x7fcc6c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:20.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc7d7fa640 1 -- 172.21.15.177:0/2982267516 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c004020 con 0x7fcc800b4fe0 2023-11-28T20:10:20.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc7d7fa640 1 -- 172.21.15.177:0/2982267516 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c004180 con 0x7fcc800b4fe0 2023-11-28T20:10:20.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc7d7fa640 1 -- 172.21.15.177:0/2982267516 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c004330 con 0x7fcc800b4fe0 2023-11-28T20:10:20.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc85c9c640 1 -- 172.21.15.177:0/2982267516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8015c060 con 0x7fcc800b4fe0 2023-11-28T20:10:20.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc85c9c640 1 -- 172.21.15.177:0/2982267516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8015b730 con 0x7fcc800b4fe0 2023-11-28T20:10:20.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.584+0000 7fcc85c9c640 1 -- 172.21.15.177:0/2982267516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc80074950 con 0x7fcc800b4fe0 2023-11-28T20:10:20.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.588+0000 7fcc7d7fa640 1 -- 172.21.15.177:0/2982267516 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc6c0096a0 con 0x7fcc800b4fe0 2023-11-28T20:10:20.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.588+0000 7fcc7d7fa640 1 --2- 172.21.15.177:0/2982267516 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcc64066470 0x7fcc64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:20.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.588+0000 7fcc7d7fa640 1 -- 172.21.15.177:0/2982267516 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fcc6c0840e0 con 0x7fcc800b4fe0 2023-11-28T20:10:20.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.588+0000 7fcc84c9a640 1 --2- 172.21.15.177:0/2982267516 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcc64066470 0x7fcc64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:20.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.588+0000 7fcc84c9a640 1 --2- 172.21.15.177:0/2982267516 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcc64066470 0x7fcc64068930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcc74007a60 tx=0x7fcc74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:20.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.592+0000 7fcc7d7fa640 1 -- 172.21.15.177:0/2982267516 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc6c0515a0 con 0x7fcc800b4fe0 2023-11-28T20:10:20.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:20.740+0000 7fcc85c9c640 1 -- 172.21.15.177:0/2982267516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcc8015e150 con 0x7fcc800b4fe0 2023-11-28T20:10:21.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.360+0000 7fcc7d7fa640 1 -- 172.21.15.177:0/2982267516 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcc8015e150 con 0x7fcc800b4fe0 2023-11-28T20:10:21.366 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' removed 2023-11-28T20:10:21.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.364+0000 7fcc85c9c640 1 -- 172.21.15.177:0/2982267516 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcc64066470 msgr2=0x7fcc64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:21.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.364+0000 7fcc85c9c640 1 --2- 172.21.15.177:0/2982267516 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcc64066470 0x7fcc64068930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcc74007a60 tx=0x7fcc74008040 comp rx=0 tx=0).stop 2023-11-28T20:10:21.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.364+0000 7fcc85c9c640 1 -- 172.21.15.177:0/2982267516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc800b4fe0 msgr2=0x7fcc80153000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:21.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.364+0000 7fcc85c9c640 1 --2- 172.21.15.177:0/2982267516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc800b4fe0 0x7fcc80153000 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00d7d0 tx=0x7fcc6c00dc90 comp rx=0 tx=0).stop 2023-11-28T20:10:21.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.364+0000 7fcc85c9c640 1 -- 172.21.15.177:0/2982267516 shutdown_connections 2023-11-28T20:10:21.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.368+0000 7fcc85c9c640 1 --2- 172.21.15.177:0/2982267516 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fcc64066470 0x7fcc64068930 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:21.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.368+0000 7fcc85c9c640 1 --2- 172.21.15.177:0/2982267516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc8015d190 0x7fcc800b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:21.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.368+0000 7fcc85c9c640 1 --2- 172.21.15.177:0/2982267516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc800b4fe0 0x7fcc80153000 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:21.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.368+0000 7fcc85c9c640 1 --2- 172.21.15.177:0/2982267516 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc8006aa70 0x7fcc80144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:21.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.368+0000 7fcc85c9c640 1 -- 172.21.15.177:0/2982267516 >> 172.21.15.177:0/2982267516 conn(0x7fcc800b1a30 msgr2=0x7fcc800af960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:21.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.368+0000 7fcc85c9c640 1 -- 172.21.15.177:0/2982267516 shutdown_connections 2023-11-28T20:10:21.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.368+0000 7fcc85c9c640 1 -- 172.21.15.177:0/2982267516 wait complete. 2023-11-28T20:10:21.398 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T20:10:21.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.540+0000 7f8cd69f8640 1 Processor -- start 2023-11-28T20:10:21.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.544+0000 7f8cd69f8640 1 -- start start 2023-11-28T20:10:21.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.544+0000 7f8cd69f8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8cd00ccc70 0x7f8cd006c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:21.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.544+0000 7f8cd69f8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd006cf80 con 0x7f8cd006c1d0 2023-11-28T20:10:21.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.544+0000 7f8cd69f8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd00cb380 con 0x7f8cd006b640 2023-11-28T20:10:21.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.544+0000 7f8cd69f8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd006ebd0 con 0x7f8cd00ccc70 2023-11-28T20:10:21.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.544+0000 7f8cd61f7640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f8cd006c1d0 0x7f8cd00cf100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47034/0 (socket says 172.21.15.177:47034) 2023-11-28T20:10:21.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.544+0000 7f8cd61f7640 1 -- 172.21.15.177:0/261315929 learned_addr learned my addr 172.21.15.177:0/261315929 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:21.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.544+0000 7f8cd59f6640 1 --2- 172.21.15.177:0/261315929 >> v2:172.21.15.195:3300/0 conn(0x7f8cd00ccc70 0x7f8cd006c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:21.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.544+0000 7f8cd49f4640 1 -- 172.21.15.177:0/261315929 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263116830 0 0) 0x7f8cd006cf80 con 0x7f8cd006c1d0 2023-11-28T20:10:21.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.544+0000 7f8cd49f4640 1 -- 172.21.15.177:0/261315929 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cbc003530 con 0x7f8cd006c1d0 2023-11-28T20:10:21.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.544+0000 7f8cd49f4640 1 -- 172.21.15.177:0/261315929 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418664112 0 0) 0x7f8cd00cb380 con 0x7f8cd006b640 2023-11-28T20:10:21.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.544+0000 7f8cd49f4640 1 -- 172.21.15.177:0/261315929 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cd006cf80 con 0x7f8cd006b640 2023-11-28T20:10:21.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.544+0000 7f8cd59f6640 1 -- 172.21.15.177:0/261315929 >> v1:172.21.15.195:6789/0 conn(0x7f8cd006b640 legacy=0x7f8cd006bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:21.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.544+0000 7f8cd59f6640 1 -- 172.21.15.177:0/261315929 >> v1:172.21.15.177:6789/0 conn(0x7f8cd006c1d0 legacy=0x7f8cd00cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:21.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.544+0000 7f8cd59f6640 1 -- 172.21.15.177:0/261315929 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd006d600 con 0x7f8cd00ccc70 2023-11-28T20:10:21.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.548+0000 7f8cd59f6640 1 --2- 172.21.15.177:0/261315929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd00ccc70 0x7f8cd006c6c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0097c0 tx=0x7f8ccc01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba12f870fea06fb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:21.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.548+0000 7f8cd49f4640 1 -- 172.21.15.177:0/261315929 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0ac620 con 0x7f8cd00ccc70 2023-11-28T20:10:21.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.548+0000 7f8cd49f4640 1 -- 172.21.15.177:0/261315929 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc0ac780 con 0x7f8cd00ccc70 2023-11-28T20:10:21.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.548+0000 7f8cd49f4640 1 -- 172.21.15.177:0/261315929 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0acb10 con 0x7f8cd00ccc70 2023-11-28T20:10:21.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.548+0000 7f8cd69f8640 1 -- 172.21.15.177:0/261315929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd00ccc70 msgr2=0x7f8cd006c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:21.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.548+0000 7f8cd69f8640 1 --2- 172.21.15.177:0/261315929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd00ccc70 0x7f8cd006c6c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0097c0 tx=0x7f8ccc01c3c0 comp rx=0 tx=0).stop 2023-11-28T20:10:21.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.548+0000 7f8cd69f8640 1 -- 172.21.15.177:0/261315929 shutdown_connections 2023-11-28T20:10:21.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.548+0000 7f8cd69f8640 1 --2- 172.21.15.177:0/261315929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd00ccc70 0x7f8cd006c6c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:21.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.548+0000 7f8cd69f8640 1 -- 172.21.15.177:0/261315929 >> 172.21.15.177:0/261315929 conn(0x7f8cd00b2860 msgr2=0x7f8cd00b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:21.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.548+0000 7f8cd69f8640 1 -- 172.21.15.177:0/261315929 shutdown_connections 2023-11-28T20:10:21.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.548+0000 7f8cd69f8640 1 -- 172.21.15.177:0/261315929 wait complete. 2023-11-28T20:10:21.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd69f8640 1 Processor -- start 2023-11-28T20:10:21.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd69f8640 1 -- start start 2023-11-28T20:10:21.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd69f8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd006b640 0x7f8cd01405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:21.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd69f8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd006c1d0 0x7f8cd0154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:21.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd69f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd00ccc70 0x7f8cd013eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:21.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd69f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd0140150 con 0x7f8cd00ccc70 2023-11-28T20:10:21.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd69f8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd013f540 con 0x7f8cd006c1d0 2023-11-28T20:10:21.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd69f8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd013f820 con 0x7f8cd006b640 2023-11-28T20:10:21.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd61f7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd00ccc70 0x7f8cd013eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:21.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd61f7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd00ccc70 0x7f8cd013eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59716/0 (socket says 172.21.15.177:59716) 2023-11-28T20:10:21.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd61f7640 1 -- 172.21.15.177:0/2418889585 learned_addr learned my addr 172.21.15.177:0/2418889585 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:21.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd59f6640 1 --2- 172.21.15.177:0/2418889585 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd006b640 0x7f8cd01405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:21.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd51f5640 1 --2- 172.21.15.177:0/2418889585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd006c1d0 0x7f8cd0154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:21.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd61f7640 1 -- 172.21.15.177:0/2418889585 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd006b640 msgr2=0x7f8cd01405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:21.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd61f7640 1 --2- 172.21.15.177:0/2418889585 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd006b640 0x7f8cd01405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:21.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd61f7640 1 -- 172.21.15.177:0/2418889585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd006c1d0 msgr2=0x7f8cd0154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:21.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd61f7640 1 --2- 172.21.15.177:0/2418889585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd006c1d0 0x7f8cd0154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:21.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd61f7640 1 -- 172.21.15.177:0/2418889585 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc009420 con 0x7f8cd00ccc70 2023-11-28T20:10:21.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd51f5640 1 --2- 172.21.15.177:0/2418889585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd006c1d0 0x7f8cd0154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:21.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd61f7640 1 --2- 172.21.15.177:0/2418889585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd00ccc70 0x7f8cd013eb80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800cae0 tx=0x7f8cc800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:21.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cc67fc640 1 -- 172.21.15.177:0/2418889585 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800ac40 con 0x7f8cd00ccc70 2023-11-28T20:10:21.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cc67fc640 1 -- 172.21.15.177:0/2418889585 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc800ada0 con 0x7f8cd00ccc70 2023-11-28T20:10:21.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd69f8640 1 -- 172.21.15.177:0/2418889585 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd013fb00 con 0x7f8cd00ccc70 2023-11-28T20:10:21.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cc67fc640 1 -- 172.21.15.177:0/2418889585 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8012600 con 0x7f8cd00ccc70 2023-11-28T20:10:21.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd69f8640 1 -- 172.21.15.177:0/2418889585 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd0154f90 con 0x7f8cd00ccc70 2023-11-28T20:10:21.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.552+0000 7f8cd69f8640 1 -- 172.21.15.177:0/2418889585 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd00679b0 con 0x7f8cd00ccc70 2023-11-28T20:10:21.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.556+0000 7f8cc67fc640 1 -- 172.21.15.177:0/2418889585 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8cc8007070 con 0x7f8cd00ccc70 2023-11-28T20:10:21.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.556+0000 7f8cc67fc640 1 --2- 172.21.15.177:0/2418889585 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8cb4066470 0x7f8cb4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:21.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.556+0000 7f8cc67fc640 1 -- 172.21.15.177:0/2418889585 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f8cc8083b60 con 0x7f8cd00ccc70 2023-11-28T20:10:21.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.556+0000 7f8cd59f6640 1 --2- 172.21.15.177:0/2418889585 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8cb4066470 0x7f8cb4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:21.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.556+0000 7f8cd59f6640 1 --2- 172.21.15.177:0/2418889585 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8cb4066470 0x7f8cb4068930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0ae000 tx=0x7f8ccc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:21.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.560+0000 7f8cc67fc640 1 -- 172.21.15.177:0/2418889585 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8cc80511e0 con 0x7f8cd00ccc70 2023-11-28T20:10:21.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:21.712+0000 7f8cd69f8640 1 -- 172.21.15.177:0/2418889585 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8cd009eec0 con 0x7f8cd00ccc70 2023-11-28T20:10:22.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.376+0000 7f8cc67fc640 1 -- 172.21.15.177:0/2418889585 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8cc8054800 con 0x7f8cd00ccc70 2023-11-28T20:10:22.379 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' removed 2023-11-28T20:10:22.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.380+0000 7f8cd69f8640 1 -- 172.21.15.177:0/2418889585 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8cb4066470 msgr2=0x7f8cb4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:22.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.380+0000 7f8cd69f8640 1 --2- 172.21.15.177:0/2418889585 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8cb4066470 0x7f8cb4068930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0ae000 tx=0x7f8ccc0a7000 comp rx=0 tx=0).stop 2023-11-28T20:10:22.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.380+0000 7f8cd69f8640 1 -- 172.21.15.177:0/2418889585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd00ccc70 msgr2=0x7f8cd013eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:22.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.380+0000 7f8cd69f8640 1 --2- 172.21.15.177:0/2418889585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd00ccc70 0x7f8cd013eb80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800cae0 tx=0x7f8cc800a060 comp rx=0 tx=0).stop 2023-11-28T20:10:22.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.380+0000 7f8cd69f8640 1 -- 172.21.15.177:0/2418889585 shutdown_connections 2023-11-28T20:10:22.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.380+0000 7f8cd69f8640 1 --2- 172.21.15.177:0/2418889585 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8cb4066470 0x7f8cb4068930 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.380+0000 7f8cd69f8640 1 --2- 172.21.15.177:0/2418889585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd00ccc70 0x7f8cd013eb80 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.380+0000 7f8cd69f8640 1 --2- 172.21.15.177:0/2418889585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd006c1d0 0x7f8cd0154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.380+0000 7f8cd69f8640 1 --2- 172.21.15.177:0/2418889585 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd006b640 0x7f8cd01405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.380+0000 7f8cd69f8640 1 -- 172.21.15.177:0/2418889585 >> 172.21.15.177:0/2418889585 conn(0x7f8cd00b2860 msgr2=0x7f8cd00b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:22.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.384+0000 7f8cd69f8640 1 -- 172.21.15.177:0/2418889585 shutdown_connections 2023-11-28T20:10:22.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.384+0000 7f8cd69f8640 1 -- 172.21.15.177:0/2418889585 wait complete. 2023-11-28T20:10:22.414 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T20:10:22.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.548+0000 7f1bf2846640 1 Processor -- start 2023-11-28T20:10:22.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.548+0000 7f1bf2846640 1 -- start start 2023-11-28T20:10:22.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bf2846640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bec158ca0 0x7f1bec15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:22.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bf2846640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1bec0cba10 0x7f1bec15be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:22.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bf2846640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bec15b670 con 0x7f1bec0b42d0 2023-11-28T20:10:22.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bf2846640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bec15f410 con 0x7f1bec0cba10 2023-11-28T20:10:22.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bf2846640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec15f6f0 con 0x7f1bec158ca0 2023-11-28T20:10:22.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bf0de3640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f1bec0b42d0 0x7f1bec0703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47044/0 (socket says 172.21.15.177:47044) 2023-11-28T20:10:22.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bf0de3640 1 -- 172.21.15.177:0/1289315375 learned_addr learned my addr 172.21.15.177:0/1289315375 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:22.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beb7fe640 1 --2- 172.21.15.177:0/1289315375 >> v2:172.21.15.195:3300/0 conn(0x7f1bec0cba10 0x7f1bec15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:22.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bebfff640 1 --2- 172.21.15.177:0/1289315375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bec158ca0 0x7f1bec15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:22.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 -- 172.21.15.177:0/1289315375 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036693548 0 0) 0x7f1bec15b670 con 0x7f1bec0b42d0 2023-11-28T20:10:22.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 -- 172.21.15.177:0/1289315375 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bd4003530 con 0x7f1bec0b42d0 2023-11-28T20:10:22.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 -- 172.21.15.177:0/1289315375 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 137382962 0 0) 0x7f1bd4003530 con 0x7f1bec0b42d0 2023-11-28T20:10:22.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 -- 172.21.15.177:0/1289315375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bec158ca0 msgr2=0x7f1bec15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:22.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 --2- 172.21.15.177:0/1289315375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bec158ca0 0x7f1bec15eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 -- 172.21.15.177:0/1289315375 >> v2:172.21.15.195:3300/0 conn(0x7f1bec0cba10 msgr2=0x7f1bec15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:22.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 --2- 172.21.15.177:0/1289315375 >> v2:172.21.15.195:3300/0 conn(0x7f1bec0cba10 0x7f1bec15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 -- 172.21.15.177:0/1289315375 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec15b8e0 con 0x7f1bec0b42d0 2023-11-28T20:10:22.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 -- 172.21.15.177:0/1289315375 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f1be4001a00 con 0x7f1bec0b42d0 2023-11-28T20:10:22.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 -- 172.21.15.177:0/1289315375 >> v1:172.21.15.177:6789/0 conn(0x7f1bec0b42d0 legacy=0x7f1bec0703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:22.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 --2- 172.21.15.177:0/1289315375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bd4003980 0x7f1bd4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:22.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 --2- 172.21.15.177:0/1289315375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd40047d0 0x7f1bd4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:22.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 --2- 172.21.15.177:0/1289315375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bec158ca0 0x7f1bd4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:22.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 -- 172.21.15.177:0/1289315375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec15f410 con 0x7f1bd4003980 2023-11-28T20:10:22.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 -- 172.21.15.177:0/1289315375 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec15f6f0 con 0x7f1bd40047d0 2023-11-28T20:10:22.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beaffd640 1 -- 172.21.15.177:0/1289315375 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd400b990 con 0x7f1bec158ca0 2023-11-28T20:10:22.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bebfff640 1 --2- 172.21.15.177:0/1289315375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bd4003980 0x7f1bd4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:22.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1beb7fe640 1 --2- 172.21.15.177:0/1289315375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd40047d0 0x7f1bd4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:22.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bf0de3640 1 --2- 172.21.15.177:0/1289315375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bec158ca0 0x7f1bd4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:22.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bebfff640 1 -- 172.21.15.177:0/1289315375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bec158ca0 msgr2=0x7f1bd4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:22.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bebfff640 1 --2- 172.21.15.177:0/1289315375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bec158ca0 0x7f1bd4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bebfff640 1 -- 172.21.15.177:0/1289315375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd40047d0 msgr2=0x7f1bd4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:22.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bebfff640 1 --2- 172.21.15.177:0/1289315375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd40047d0 0x7f1bd4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bebfff640 1 -- 172.21.15.177:0/1289315375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd4003530 con 0x7f1bd4003980 2023-11-28T20:10:22.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.552+0000 7f1bf0de3640 1 --2- 172.21.15.177:0/1289315375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bec158ca0 0x7f1bd4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:22.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.556+0000 7f1bebfff640 1 --2- 172.21.15.177:0/1289315375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bd4003980 0x7f1bd4003da0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009ae0 tx=0x7f1bdc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3901b0bcd7ee8b68 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:22.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.556+0000 7f1beaffd640 1 -- 172.21.15.177:0/1289315375 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc0a5560 con 0x7f1bd4003980 2023-11-28T20:10:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.556+0000 7f1beaffd640 1 -- 172.21.15.177:0/1289315375 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc0a56c0 con 0x7f1bd4003980 2023-11-28T20:10:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.556+0000 7f1beaffd640 1 -- 172.21.15.177:0/1289315375 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc0a5a70 con 0x7f1bd4003980 2023-11-28T20:10:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.556+0000 7f1bf2846640 1 -- 172.21.15.177:0/1289315375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bd4003980 msgr2=0x7f1bd4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.556+0000 7f1bf2846640 1 --2- 172.21.15.177:0/1289315375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bd4003980 0x7f1bd4003da0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009ae0 tx=0x7f1bdc01ca50 comp rx=0 tx=0).stop 2023-11-28T20:10:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.556+0000 7f1bf0de3640 1 -- 172.21.15.177:0/1289315375 reap_dead start 2023-11-28T20:10:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.556+0000 7f1bf2846640 1 -- 172.21.15.177:0/1289315375 shutdown_connections 2023-11-28T20:10:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.556+0000 7f1bf2846640 1 -- 172.21.15.177:0/1289315375 >> 172.21.15.177:0/1289315375 conn(0x7f1bec0b0cc0 msgr2=0x7f1bec0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.556+0000 7f1bf2846640 1 -- 172.21.15.177:0/1289315375 shutdown_connections 2023-11-28T20:10:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.556+0000 7f1bf2846640 1 -- 172.21.15.177:0/1289315375 wait complete. 2023-11-28T20:10:22.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1bf2846640 1 Processor -- start 2023-11-28T20:10:22.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1bf2846640 1 -- start start 2023-11-28T20:10:22.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1bf2846640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd4003980 0x7f1bec13d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:22.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1bf2846640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bec13e000 0x7f1bec151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:22.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1bf2846640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bec151c70 0x7f1bec1538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:22.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1bf2846640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec1520f0 con 0x7f1bec13e000 2023-11-28T20:10:22.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1bf2846640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec1550d0 con 0x7f1bec151c70 2023-11-28T20:10:22.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1bf2846640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec1545f0 con 0x7f1bd4003980 2023-11-28T20:10:22.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1beb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bec13e000 0x7f1bec151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:22.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1beb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bec13e000 0x7f1bec151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59736/0 (socket says 172.21.15.177:59736) 2023-11-28T20:10:22.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1beb7fe640 1 -- 172.21.15.177:0/3253471884 learned_addr learned my addr 172.21.15.177:0/3253471884 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:22.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1beb7fe640 1 -- 172.21.15.177:0/3253471884 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd4003980 msgr2=0x7f1bec13d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:22.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1beb7fe640 1 --2- 172.21.15.177:0/3253471884 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd4003980 0x7f1bec13d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1beb7fe640 1 -- 172.21.15.177:0/3253471884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bec151c70 msgr2=0x7f1bec1538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:22.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1beb7fe640 1 --2- 172.21.15.177:0/3253471884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bec151c70 0x7f1bec1538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1beb7fe640 1 -- 172.21.15.177:0/3253471884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec1548d0 con 0x7f1bec13e000 2023-11-28T20:10:22.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1beb7fe640 1 --2- 172.21.15.177:0/3253471884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bec13e000 0x7f1bec151730 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1be00038d0 tx=0x7f1be0003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1be8ff9640 1 -- 172.21.15.177:0/3253471884 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0009c70 con 0x7f1bec13e000 2023-11-28T20:10:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1be8ff9640 1 -- 172.21.15.177:0/3253471884 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be0015040 con 0x7f1bec13e000 2023-11-28T20:10:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1be8ff9640 1 -- 172.21.15.177:0/3253471884 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be001b480 con 0x7f1bec13e000 2023-11-28T20:10:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1bf2846640 1 -- 172.21.15.177:0/3253471884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bec155320 con 0x7f1bec13e000 2023-11-28T20:10:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1bf2846640 1 -- 172.21.15.177:0/3253471884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bec13dca0 con 0x7f1bec13e000 2023-11-28T20:10:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.560+0000 7f1bf2846640 1 -- 172.21.15.177:0/3253471884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bec0693d0 con 0x7f1bec13e000 2023-11-28T20:10:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.564+0000 7f1be8ff9640 1 -- 172.21.15.177:0/3253471884 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1be001b600 con 0x7f1bec13e000 2023-11-28T20:10:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.564+0000 7f1be8ff9640 1 --2- 172.21.15.177:0/3253471884 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1bd80664a0 0x7f1bd8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.564+0000 7f1be8ff9640 1 -- 172.21.15.177:0/3253471884 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1be0088490 con 0x7f1bec13e000 2023-11-28T20:10:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.564+0000 7f1bebfff640 1 --2- 172.21.15.177:0/3253471884 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1bd80664a0 0x7f1bd8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.564+0000 7f1bebfff640 1 --2- 172.21.15.177:0/3253471884 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1bd80664a0 0x7f1bd8068960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0af000 tx=0x7f1bdc004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:22.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.568+0000 7f1be8ff9640 1 -- 172.21.15.177:0/3253471884 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1be0055c00 con 0x7f1bec13e000 2023-11-28T20:10:22.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.724+0000 7f1bf2846640 1 -- 172.21.15.177:0/3253471884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1bec0b1990 con 0x7f1bec13e000 2023-11-28T20:10:22.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.732+0000 7f1be8ff9640 1 -- 172.21.15.177:0/3253471884 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1be0059220 con 0x7f1bec13e000 2023-11-28T20:10:22.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.736+0000 7f1bf2846640 1 -- 172.21.15.177:0/3253471884 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1bd80664a0 msgr2=0x7f1bd8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:22.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.736+0000 7f1bf2846640 1 --2- 172.21.15.177:0/3253471884 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1bd80664a0 0x7f1bd8068960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0af000 tx=0x7f1bdc004740 comp rx=0 tx=0).stop 2023-11-28T20:10:22.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.736+0000 7f1bf2846640 1 -- 172.21.15.177:0/3253471884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bec13e000 msgr2=0x7f1bec151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:22.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.736+0000 7f1bf2846640 1 --2- 172.21.15.177:0/3253471884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bec13e000 0x7f1bec151730 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1be00038d0 tx=0x7f1be0003d90 comp rx=0 tx=0).stop 2023-11-28T20:10:22.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.736+0000 7f1bf2846640 1 -- 172.21.15.177:0/3253471884 shutdown_connections 2023-11-28T20:10:22.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.736+0000 7f1bf2846640 1 --2- 172.21.15.177:0/3253471884 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f1bd80664a0 0x7f1bd8068960 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.736+0000 7f1bf2846640 1 --2- 172.21.15.177:0/3253471884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bec151c70 0x7f1bec1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.736+0000 7f1bf2846640 1 --2- 172.21.15.177:0/3253471884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bec13e000 0x7f1bec151730 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.736+0000 7f1bf2846640 1 --2- 172.21.15.177:0/3253471884 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd4003980 0x7f1bec13d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.736+0000 7f1bf2846640 1 -- 172.21.15.177:0/3253471884 >> 172.21.15.177:0/3253471884 conn(0x7f1bec0b0cc0 msgr2=0x7f1bec0718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:22.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.736+0000 7f1bf2846640 1 -- 172.21.15.177:0/3253471884 shutdown_connections 2023-11-28T20:10:22.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.736+0000 7f1bf2846640 1 -- 172.21.15.177:0/3253471884 wait complete. 2023-11-28T20:10:22.759 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-11-28T20:10:22.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.892+0000 7fd1a9d56640 1 Processor -- start 2023-11-28T20:10:22.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.892+0000 7fd1a9d56640 1 -- start start 2023-11-28T20:10:22.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.892+0000 7fd1a9d56640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd1a4071b20 0x7fd1a4070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:22.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.892+0000 7fd1a9d56640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd1a40cf460 0x7fd1a4159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:22.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.892+0000 7fd1a9d56640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a409ceb0 con 0x7fd1a40cc7a0 2023-11-28T20:10:22.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.892+0000 7fd1a9d56640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a40ccc30 con 0x7fd1a4071b20 2023-11-28T20:10:22.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.892+0000 7fd1a9d56640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a4159c70 con 0x7fd1a40cf460 2023-11-28T20:10:22.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.892+0000 7fd1a8d54640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd1a4071b20 0x7fd1a4070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:22.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.892+0000 7fd1a8d54640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd1a4071b20 0x7fd1a4070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59744/0 (socket says 172.21.15.177:59744) 2023-11-28T20:10:22.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.892+0000 7fd1a8d54640 1 -- 172.21.15.177:0/4056984084 learned_addr learned my addr 172.21.15.177:0/4056984084 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:22.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.896+0000 7fd1a8d54640 1 -- 172.21.15.177:0/4056984084 >> v2:172.21.15.195:3300/0 conn(0x7fd1a40cf460 msgr2=0x7fd1a4159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:22.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.896+0000 7fd1a8d54640 1 --2- 172.21.15.177:0/4056984084 >> v2:172.21.15.195:3300/0 conn(0x7fd1a40cf460 0x7fd1a4159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.896+0000 7fd1a8d54640 1 -- 172.21.15.177:0/4056984084 >> v1:172.21.15.195:6789/0 conn(0x7fd1a40cc7a0 legacy=0x7fd1a4071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:22.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.896+0000 7fd1a8d54640 1 -- 172.21.15.177:0/4056984084 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4159f50 con 0x7fd1a4071b20 2023-11-28T20:10:22.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.896+0000 7fd1a8d54640 1 --2- 172.21.15.177:0/4056984084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a4071b20 0x7fd1a4070260 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd1a406e770 tx=0x7fd19801e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f26c2fcd719b35 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:22.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.896+0000 7fd1a37fe640 1 -- 172.21.15.177:0/4056984084 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198004230 con 0x7fd1a4071b20 2023-11-28T20:10:22.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.896+0000 7fd1a37fe640 1 -- 172.21.15.177:0/4056984084 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1980ab070 con 0x7fd1a4071b20 2023-11-28T20:10:22.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.896+0000 7fd1a37fe640 1 -- 172.21.15.177:0/4056984084 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1980a7790 con 0x7fd1a4071b20 2023-11-28T20:10:22.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.896+0000 7fd1a9d56640 1 -- 172.21.15.177:0/4056984084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a4071b20 msgr2=0x7fd1a4070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:22.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.896+0000 7fd1a9d56640 1 --2- 172.21.15.177:0/4056984084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a4071b20 0x7fd1a4070260 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd1a406e770 tx=0x7fd19801e940 comp rx=0 tx=0).stop 2023-11-28T20:10:22.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.896+0000 7fd1a9d56640 1 -- 172.21.15.177:0/4056984084 shutdown_connections 2023-11-28T20:10:22.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.896+0000 7fd1a9d56640 1 --2- 172.21.15.177:0/4056984084 >> v2:172.21.15.195:3300/0 conn(0x7fd1a40cf460 0x7fd1a4159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.896+0000 7fd1a9d56640 1 --2- 172.21.15.177:0/4056984084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a4071b20 0x7fd1a4070260 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.896+0000 7fd1a9d56640 1 -- 172.21.15.177:0/4056984084 >> 172.21.15.177:0/4056984084 conn(0x7fd1a40b0920 msgr2=0x7fd1a40b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:22.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a9d56640 1 -- 172.21.15.177:0/4056984084 shutdown_connections 2023-11-28T20:10:22.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a9d56640 1 -- 172.21.15.177:0/4056984084 wait complete. 2023-11-28T20:10:22.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a9d56640 1 Processor -- start 2023-11-28T20:10:22.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a9d56640 1 -- start start 2023-11-28T20:10:22.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a9d56640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a4071b20 0x7fd1a415c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:22.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a9d56640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1a40cc7a0 0x7fd1a41511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:22.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a9d56640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1a40cf460 0x7fd1a414da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:22.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a9d56640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4150840 con 0x7fd1a4071b20 2023-11-28T20:10:22.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a9d56640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a41452e0 con 0x7fd1a40cf460 2023-11-28T20:10:22.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a9d56640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4150280 con 0x7fd1a40cc7a0 2023-11-28T20:10:22.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a8d54640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a4071b20 0x7fd1a415c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:22.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a8d54640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a4071b20 0x7fd1a415c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59750/0 (socket says 172.21.15.177:59750) 2023-11-28T20:10:22.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a8d54640 1 -- 172.21.15.177:0/1951032841 learned_addr learned my addr 172.21.15.177:0/1951032841 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:22.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a9555640 1 --2- 172.21.15.177:0/1951032841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1a40cf460 0x7fd1a414da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:22.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a3fff640 1 --2- 172.21.15.177:0/1951032841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1a40cc7a0 0x7fd1a41511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:22.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a8d54640 1 -- 172.21.15.177:0/1951032841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1a40cc7a0 msgr2=0x7fd1a41511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:22.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a8d54640 1 --2- 172.21.15.177:0/1951032841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1a40cc7a0 0x7fd1a41511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a8d54640 1 -- 172.21.15.177:0/1951032841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1a40cf460 msgr2=0x7fd1a414da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:22.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a8d54640 1 --2- 172.21.15.177:0/1951032841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1a40cf460 0x7fd1a414da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:22.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a8d54640 1 -- 172.21.15.177:0/1951032841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19800b780 con 0x7fd1a4071b20 2023-11-28T20:10:22.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a3fff640 1 --2- 172.21.15.177:0/1951032841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1a40cc7a0 0x7fd1a41511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:22.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a8d54640 1 --2- 172.21.15.177:0/1951032841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a4071b20 0x7fd1a415c000 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd198000c10 tx=0x7fd19801b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:22.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.900+0000 7fd1a17fa640 1 -- 172.21.15.177:0/1951032841 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1980a7b20 con 0x7fd1a4071b20 2023-11-28T20:10:22.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.904+0000 7fd1a17fa640 1 -- 172.21.15.177:0/1951032841 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1980a7c80 con 0x7fd1a4071b20 2023-11-28T20:10:22.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.904+0000 7fd1a17fa640 1 -- 172.21.15.177:0/1951032841 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1980a7e10 con 0x7fd1a4071b20 2023-11-28T20:10:22.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.904+0000 7fd1a9d56640 1 -- 172.21.15.177:0/1951032841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a4150560 con 0x7fd1a4071b20 2023-11-28T20:10:22.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.904+0000 7fd1a9d56640 1 -- 172.21.15.177:0/1951032841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a4151d70 con 0x7fd1a4071b20 2023-11-28T20:10:22.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.904+0000 7fd1a9d56640 1 -- 172.21.15.177:0/1951032841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a4144dd0 con 0x7fd1a4071b20 2023-11-28T20:10:22.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.904+0000 7fd1a17fa640 1 -- 172.21.15.177:0/1951032841 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd198003620 con 0x7fd1a4071b20 2023-11-28T20:10:22.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.904+0000 7fd1a17fa640 1 --2- 172.21.15.177:0/1951032841 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd188066470 0x7fd188068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:22.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.904+0000 7fd1a17fa640 1 -- 172.21.15.177:0/1951032841 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd19811dac0 con 0x7fd1a4071b20 2023-11-28T20:10:22.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.904+0000 7fd1a3fff640 1 --2- 172.21.15.177:0/1951032841 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd188066470 0x7fd188068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:22.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.904+0000 7fd1a3fff640 1 --2- 172.21.15.177:0/1951032841 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd188066470 0x7fd188068930 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd1a415c800 tx=0x7fd190008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:22.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:22.908+0000 7fd1a17fa640 1 -- 172.21.15.177:0/1951032841 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1a4144dd0 con 0x7fd1a4071b20 2023-11-28T20:10:23.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:23.108+0000 7fd1a9d56640 1 -- 172.21.15.177:0/1951032841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7fd1a4144dd0 con 0x7fd1a4071b20 2023-11-28T20:10:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:23.376+0000 7fd1a17fa640 1 -- 172.21.15.177:0/1951032841 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v174) v1 ==== 134+0+0 (secure 0 0 0) 0x7fd1a4144dd0 con 0x7fd1a4071b20 2023-11-28T20:10:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:23.380+0000 7fd1a9d56640 1 -- 172.21.15.177:0/1951032841 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd188066470 msgr2=0x7fd188068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:23.380+0000 7fd1a9d56640 1 --2- 172.21.15.177:0/1951032841 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd188066470 0x7fd188068930 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd1a415c800 tx=0x7fd190008040 comp rx=0 tx=0).stop 2023-11-28T20:10:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:23.380+0000 7fd1a9d56640 1 -- 172.21.15.177:0/1951032841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a4071b20 msgr2=0x7fd1a415c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:23.380+0000 7fd1a9d56640 1 --2- 172.21.15.177:0/1951032841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a4071b20 0x7fd1a415c000 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd198000c10 tx=0x7fd19801b6e0 comp rx=0 tx=0).stop 2023-11-28T20:10:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:23.380+0000 7fd1a9d56640 1 -- 172.21.15.177:0/1951032841 shutdown_connections 2023-11-28T20:10:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:23.380+0000 7fd1a9d56640 1 --2- 172.21.15.177:0/1951032841 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd188066470 0x7fd188068930 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:23.380+0000 7fd1a9d56640 1 --2- 172.21.15.177:0/1951032841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1a40cf460 0x7fd1a414da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:23.380+0000 7fd1a9d56640 1 --2- 172.21.15.177:0/1951032841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1a40cc7a0 0x7fd1a41511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:23.380+0000 7fd1a9d56640 1 --2- 172.21.15.177:0/1951032841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1a4071b20 0x7fd1a415c000 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:23.380+0000 7fd1a9d56640 1 -- 172.21.15.177:0/1951032841 >> 172.21.15.177:0/1951032841 conn(0x7fd1a40b0920 msgr2=0x7fd1a40aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:23.380+0000 7fd1a9d56640 1 -- 172.21.15.177:0/1951032841 shutdown_connections 2023-11-28T20:10:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:23.380+0000 7fd1a9d56640 1 -- 172.21.15.177:0/1951032841 wait complete. 2023-11-28T20:10:23.405 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ERROR 2023-11-28T20:10:23.405 INFO:tasks.cephfs_test_runner: 2023-11-28T20:10:23.405 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T20:10:23.405 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-11-28T20:10:23.406 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T20:10:23.406 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T20:10:23.406 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2023-11-28T20:10:23.406 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2023-11-28T20:10:23.406 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/mount.py", line 775, in run_python 2023-11-28T20:10:23.406 INFO:tasks.cephfs_test_runner: p.wait() 2023-11-28T20:10:23.406 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait 2023-11-28T20:10:23.407 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-28T20:10:23.407 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-28T20:10:23.407 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-28T20:10:23.407 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi177 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2023-11-28T20:10:23.407 INFO:tasks.cephfs_test_runner: 2023-11-28T20:10:23.407 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T20:10:23.407 INFO:tasks.cephfs_test_runner:Ran 2 tests in 133.789s 2023-11-28T20:10:23.407 INFO:tasks.cephfs_test_runner: 2023-11-28T20:10:23.407 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-28T20:10:23.407 INFO:tasks.cephfs_test_runner: 2023-11-28T20:10:23.407 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T20:10:23.407 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-11-28T20:10:23.407 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T20:10:23.408 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T20:10:23.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2023-11-28T20:10:23.408 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2023-11-28T20:10:23.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/mount.py", line 775, in run_python 2023-11-28T20:10:23.408 INFO:tasks.cephfs_test_runner: p.wait() 2023-11-28T20:10:23.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait 2023-11-28T20:10:23.408 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-28T20:10:23.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-28T20:10:23.408 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-28T20:10:23.408 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi177 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2023-11-28T20:10:23.408 INFO:tasks.cephfs_test_runner: 2023-11-28T20:10:23.409 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-11-28T20:10:23.480 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9d0099c47a8c4a4887ba02075bee0843 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-11-28T20:10:23.482 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-28T20:10:23.495 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-28T20:10:23.530 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-28T20:10:23.531 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:10:23.531 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:10:23.547 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354508k,nr_inodes=4088627,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=883 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T20:10:23.547 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-28T20:10:23.547 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:10:23.598 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354508k,nr_inodes=4088627,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=883 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T20:10:23.598 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:10:23.598 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:10:23.608 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2702 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T20:10:23.608 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-11-28T20:10:23.608 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:10:23.658 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2702 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T20:10:23.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:23.659 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2023-11-28T20:10:23.710 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T20:10:23.711 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-28T20:10:23.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:23.712 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:10:23.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:23.776 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T20:10:23.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:23.887 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2023-11-28T20:10:24.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:24.054 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-11-28T20:10:24.065 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T20:10:24.065 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T20:10:24.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:24.066 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:10:24.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:24.128 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T20:10:24.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:10:24.198 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2023-11-28T20:10:24.372 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-28T20:10:24.388 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T20:10:24.388 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:10:24.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.524+0000 7f6ef7e79640 1 Processor -- start 2023-11-28T20:10:24.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.524+0000 7f6ef7e79640 1 -- start start 2023-11-28T20:10:24.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.524+0000 7f6ef7e79640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6ef0144840 0x7f6ef006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:24.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.524+0000 7f6ef7e79640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6ef0070b70 0x7f6ef006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:24.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.524+0000 7f6ef7e79640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef00710e0 con 0x7f6ef0072180 2023-11-28T20:10:24.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.524+0000 7f6ef7e79640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef015f010 con 0x7f6ef0144840 2023-11-28T20:10:24.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.524+0000 7f6ef7e79640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef00713c0 con 0x7f6ef0070b70 2023-11-28T20:10:24.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.524+0000 7f6ef5c15640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6ef0144840 0x7f6ef006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:24.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.524+0000 7f6ef5414640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f6ef0072180 0x7f6ef0070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47060/0 (socket says 172.21.15.177:47060) 2023-11-28T20:10:24.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.524+0000 7f6ef5414640 1 -- 172.21.15.177:0/3399055725 learned_addr learned my addr 172.21.15.177:0/3399055725 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:24.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.524+0000 7f6ef6416640 1 --2- 172.21.15.177:0/3399055725 >> v2:172.21.15.195:3300/0 conn(0x7f6ef0070b70 0x7f6ef006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:24.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.524+0000 7f6ef5c15640 1 -- 172.21.15.177:0/3399055725 >> v2:172.21.15.195:3300/0 conn(0x7f6ef0070b70 msgr2=0x7f6ef006c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:24.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.524+0000 7f6ef5c15640 1 --2- 172.21.15.177:0/3399055725 >> v2:172.21.15.195:3300/0 conn(0x7f6ef0070b70 0x7f6ef006c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:24.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.524+0000 7f6ef5c15640 1 -- 172.21.15.177:0/3399055725 >> v1:172.21.15.177:6789/0 conn(0x7f6ef0072180 legacy=0x7f6ef0070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:24.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.524+0000 7f6ef5c15640 1 -- 172.21.15.177:0/3399055725 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef00716a0 con 0x7f6ef0144840 2023-11-28T20:10:24.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.528+0000 7f6ef5c15640 1 --2- 172.21.15.177:0/3399055725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ef0144840 0x7f6ef006c2c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00b2070 tx=0x7f6eec01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740b55f35844322a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:24.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.528+0000 7f6ef4c13640 1 -- 172.21.15.177:0/3399055725 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0a7070 con 0x7f6ef0144840 2023-11-28T20:10:24.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.528+0000 7f6ef4c13640 1 -- 172.21.15.177:0/3399055725 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec0ab430 con 0x7f6ef0144840 2023-11-28T20:10:24.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.528+0000 7f6ef4c13640 1 -- 172.21.15.177:0/3399055725 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0ab7c0 con 0x7f6ef0144840 2023-11-28T20:10:24.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.528+0000 7f6ef7e79640 1 -- 172.21.15.177:0/3399055725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ef0144840 msgr2=0x7f6ef006c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:24.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.528+0000 7f6ef7e79640 1 --2- 172.21.15.177:0/3399055725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ef0144840 0x7f6ef006c2c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00b2070 tx=0x7f6eec01c430 comp rx=0 tx=0).stop 2023-11-28T20:10:24.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.528+0000 7f6ef7e79640 1 -- 172.21.15.177:0/3399055725 shutdown_connections 2023-11-28T20:10:24.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.528+0000 7f6ef7e79640 1 --2- 172.21.15.177:0/3399055725 >> v2:172.21.15.195:3300/0 conn(0x7f6ef0070b70 0x7f6ef006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:24.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.528+0000 7f6ef7e79640 1 --2- 172.21.15.177:0/3399055725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ef0144840 0x7f6ef006c2c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:24.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.528+0000 7f6ef7e79640 1 -- 172.21.15.177:0/3399055725 >> 172.21.15.177:0/3399055725 conn(0x7f6ef006a530 msgr2=0x7f6ef006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:24.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.528+0000 7f6ef7e79640 1 -- 172.21.15.177:0/3399055725 shutdown_connections 2023-11-28T20:10:24.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.528+0000 7f6ef7e79640 1 -- 172.21.15.177:0/3399055725 wait complete. 2023-11-28T20:10:24.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef7e79640 1 Processor -- start 2023-11-28T20:10:24.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef7e79640 1 -- start start 2023-11-28T20:10:24.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef7e79640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ef0070b70 0x7f6ef013d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:24.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef7e79640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ef0072180 0x7f6ef015a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:24.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef7e79640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ef0144840 0x7f6ef0164d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:24.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef7e79640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef0139790 con 0x7f6ef0072180 2023-11-28T20:10:24.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef7e79640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef015ae50 con 0x7f6ef0144840 2023-11-28T20:10:24.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef7e79640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef01652d0 con 0x7f6ef0070b70 2023-11-28T20:10:24.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef5414640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ef0072180 0x7f6ef015a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:24.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef5414640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ef0072180 0x7f6ef015a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59774/0 (socket says 172.21.15.177:59774) 2023-11-28T20:10:24.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef5414640 1 -- 172.21.15.177:0/4109032641 learned_addr learned my addr 172.21.15.177:0/4109032641 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:24.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef5c15640 1 --2- 172.21.15.177:0/4109032641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ef0070b70 0x7f6ef013d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:24.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef6416640 1 --2- 172.21.15.177:0/4109032641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ef0144840 0x7f6ef0164d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:24.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef5414640 1 -- 172.21.15.177:0/4109032641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ef0070b70 msgr2=0x7f6ef013d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:24.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef5414640 1 --2- 172.21.15.177:0/4109032641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ef0070b70 0x7f6ef013d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:24.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef5414640 1 -- 172.21.15.177:0/4109032641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ef0144840 msgr2=0x7f6ef0164d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:24.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef5414640 1 --2- 172.21.15.177:0/4109032641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ef0144840 0x7f6ef0164d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:24.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef5414640 1 -- 172.21.15.177:0/4109032641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec009420 con 0x7f6ef0072180 2023-11-28T20:10:24.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef5414640 1 --2- 172.21.15.177:0/4109032641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ef0072180 0x7f6ef015a910 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000c4d0 tx=0x7f6ee000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:24.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ee67fc640 1 -- 172.21.15.177:0/4109032641 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0005cf0 con 0x7f6ef0072180 2023-11-28T20:10:24.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ee67fc640 1 -- 172.21.15.177:0/4109032641 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee0005e50 con 0x7f6ef0072180 2023-11-28T20:10:24.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ee67fc640 1 -- 172.21.15.177:0/4109032641 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0007270 con 0x7f6ef0072180 2023-11-28T20:10:24.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef7e79640 1 -- 172.21.15.177:0/4109032641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef0165550 con 0x7f6ef0072180 2023-11-28T20:10:24.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.532+0000 7f6ef7e79640 1 -- 172.21.15.177:0/4109032641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef01390d0 con 0x7f6ef0072180 2023-11-28T20:10:24.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.536+0000 7f6ef7e79640 1 -- 172.21.15.177:0/4109032641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef01398d0 con 0x7f6ef0072180 2023-11-28T20:10:24.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.536+0000 7f6ee67fc640 1 -- 172.21.15.177:0/4109032641 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ee00073d0 con 0x7f6ef0072180 2023-11-28T20:10:24.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.536+0000 7f6ee67fc640 1 --2- 172.21.15.177:0/4109032641 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6ed4066470 0x7f6ed4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:24.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.536+0000 7f6ee67fc640 1 -- 172.21.15.177:0/4109032641 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6ee0082ff0 con 0x7f6ef0072180 2023-11-28T20:10:24.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.536+0000 7f6ef5c15640 1 --2- 172.21.15.177:0/4109032641 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6ed4066470 0x7f6ed4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:24.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.536+0000 7f6ef5c15640 1 --2- 172.21.15.177:0/4109032641 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6ed4066470 0x7f6ed4068930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0af000 tx=0x7f6eec0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:24.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.540+0000 7f6ee67fc640 1 -- 172.21.15.177:0/4109032641 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6ef01398d0 con 0x7f6ef0072180 2023-11-28T20:10:24.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.688+0000 7f6ef7e79640 1 -- 172.21.15.177:0/4109032641 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ef01398d0 con 0x7f6ed4066470 2023-11-28T20:10:24.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.688+0000 7f6ee67fc640 1 -- 172.21.15.177:0/4109032641 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50629 (secure 0 0 0) 0x7f6ef01398d0 con 0x7f6ed4066470 2023-11-28T20:10:24.695 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:24.695 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:10:24.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.692+0000 7f6ef7e79640 1 -- 172.21.15.177:0/4109032641 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6ed4066470 msgr2=0x7f6ed4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:24.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.692+0000 7f6ef7e79640 1 --2- 172.21.15.177:0/4109032641 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6ed4066470 0x7f6ed4068930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0af000 tx=0x7f6eec0a7000 comp rx=0 tx=0).stop 2023-11-28T20:10:24.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.692+0000 7f6ef7e79640 1 -- 172.21.15.177:0/4109032641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ef0072180 msgr2=0x7f6ef015a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:24.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.692+0000 7f6ef7e79640 1 --2- 172.21.15.177:0/4109032641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ef0072180 0x7f6ef015a910 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000c4d0 tx=0x7f6ee000c990 comp rx=0 tx=0).stop 2023-11-28T20:10:24.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.692+0000 7f6ef7e79640 1 -- 172.21.15.177:0/4109032641 shutdown_connections 2023-11-28T20:10:24.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.692+0000 7f6ef7e79640 1 --2- 172.21.15.177:0/4109032641 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6ed4066470 0x7f6ed4068930 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:24.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.692+0000 7f6ef7e79640 1 --2- 172.21.15.177:0/4109032641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ef0144840 0x7f6ef0164d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:24.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.692+0000 7f6ef7e79640 1 --2- 172.21.15.177:0/4109032641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ef0072180 0x7f6ef015a910 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:24.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.692+0000 7f6ef7e79640 1 --2- 172.21.15.177:0/4109032641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ef0070b70 0x7f6ef013d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:24.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.692+0000 7f6ef7e79640 1 -- 172.21.15.177:0/4109032641 >> 172.21.15.177:0/4109032641 conn(0x7f6ef006a530 msgr2=0x7f6ef00b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:24.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.692+0000 7f6ef7e79640 1 -- 172.21.15.177:0/4109032641 shutdown_connections 2023-11-28T20:10:24.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.692+0000 7f6ef7e79640 1 -- 172.21.15.177:0/4109032641 wait complete. 2023-11-28T20:10:24.715 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2023-11-28T20:10:23.450969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242744,"kb_used_data":5792,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731976,"statfs":{"total":773094113280,"available":772845543424,"internally_reserved":0,"allocated":5931008,"data_stored":3147212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14789,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001142"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":191,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.657706+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:09:43.657706+0000","last_peered":"2023-11-28T20:09:43.657706+0000","last_clean":"2023-11-28T20:09:43.657706+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:09:43.657706+0000","last_undegraded":"2023-11-28T20:09:43.657706+0000","last_fullsized":"2023-11-28T20:09:43.657706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1183744,"data_stored":832569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.438,"5min":0.313,"15min":0.313},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.56200000000000006,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.032,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.55500000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.65400000000000003},"min":{"1min":0.49199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94399999999999995,"5min":1.161,"15min":1.161},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0009999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97899999999999998,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.60299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.77400000000000002}]},{"osd":3,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0209999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.58099999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.44500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.505,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.48799999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.495,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.51200000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.58899999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.054,"5min":1.272,"15min":1.272},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.63200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":242729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.437},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.44500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.63}]},{"osd":1,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.69999999999999996,"15min":0.68500000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.748,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.498}]},{"osd":2,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.65400000000000003},"min":{"1min":0.501,"5min":0.498,"15min":0.498},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.60999999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5819999999999999,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.125,"5min":1.357,"15min":1.357},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.006,"5min":0.80600000000000005,"15min":0.77200000000000002},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":6.2249999999999996,"5min":6.2249999999999996,"15min":6.2249999999999996},"last":0.755}]},{"osd":4,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.0789999999999997,"5min":4.0789999999999997,"15min":4.0789999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":0.81899999999999995,"15min":0.77700000000000002},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":8.6159999999999997,"5min":8.6159999999999997,"15min":8.6159999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.83299999999999996,"15min":0.82099999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.77300000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.84399999999999997,"15min":0.84199999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.86199999999999999,"15min":0.85799999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.60199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":581632,"data_stored":242077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.78900000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.70199999999999996}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.626},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65900000000000003,"15min":0.66000000000000003},"min":{"1min":0.47199999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.879,"5min":1.083,"15min":1.083},"last":0.61199999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.052,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69799999999999995,"15min":0.70099999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84399999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65300000000000002,"15min":0.66200000000000003},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81299999999999994,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.745}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82999999999999996,"5min":0.997,"15min":0.997},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92400000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":242659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67900000000000005,"15min":0.68600000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.78100000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71399999999999997,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85599999999999998,"5min":1.361,"15min":1.361},"last":0.58099999999999996}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68799999999999994},"min":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.81799999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.63},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86899999999999999,"5min":1.04,"15min":1.04},"last":0.60899999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.56699999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.83999999999999997,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.504},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88100000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.45400000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85699999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":1.038,"15min":1.038},"last":0.40799999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.84299999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.91400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93100000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.86099999999999999,"15min":0.877},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98899999999999999,"5min":1.353,"15min":1.353},"last":0.72499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":610304,"data_stored":256231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.02,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.68100000000000005,"15min":0.72199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76000000000000001,"5min":6.016,"15min":6.016},"last":0.37}]},{"osd":1,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2170000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.44}]},{"osd":2,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94799999999999995,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0549999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.499}]},{"osd":4,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0009999999999999,"5min":5.8810000000000002,"15min":5.8810000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.038,"5min":1.405,"15min":1.405},"last":0.76500000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79800000000000004,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.119,"5min":1.585,"15min":1.585},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.97299999999999998,"15min":1.0129999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.042,"5min":5.9349999999999996,"15min":5.9349999999999996},"last":0.78300000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95699999999999996,"5min":1.361,"15min":1.361},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.55500000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0900000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.94999999999999996,"15min":0.98799999999999999},"min":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.262,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.751},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0620000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.621}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":606208,"data_stored":256209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.80800000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.54300000000000004,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.54000000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.3140000000000001,"5min":5.3140000000000001,"15min":5.3140000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":3.7650000000000001,"5min":3.7650000000000001,"15min":3.7650000000000001},"last":0.438}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":5.3460000000000001,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.497},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.41899999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3580000000000001,"5min":1.415,"15min":1.415},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.81699999999999995,"15min":0.80700000000000005},"min":{"1min":0.54500000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.8090000000000002,"5min":3.8090000000000002,"15min":3.8090000000000002},"last":0.66900000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.2809999999999997,"5min":5.2809999999999997,"15min":5.2809999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.55300000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88800000000000001,"15min":0.88400000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.5369999999999999,"5min":4.5369999999999999,"15min":4.5369999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.88700000000000001,"15min":0.86599999999999999},"min":{"1min":0.56799999999999995,"5min":0.496,"15min":0.496},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.68300000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.88,"15min":0.874},"min":{"1min":0.56999999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":3.863,"5min":3.863,"15min":3.863},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.90300000000000002,"15min":0.88600000000000001},"min":{"1min":0.627,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":5.2460000000000004,"5min":5.2460000000000004,"15min":5.2460000000000004},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":589824,"data_stored":242237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.60499999999999998,"15min":0.63900000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.627,"15min":0.66100000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.47199999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.64800000000000002,"15min":0.68300000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79900000000000004,"5min":4.9909999999999997,"15min":4.9909999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.68100000000000005,"15min":0.71899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56699999999999995,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":1.389,"15min":1.389},"last":0.503},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.67000000000000004,"15min":0.70399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.52200000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.503,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":1.145,"15min":1.145},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.93500000000000005,"15min":0.96599999999999997},"min":{"1min":0.59899999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90600000000000003,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.80700000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.91400000000000003,"15min":0.95499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90600000000000003,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.89100000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.94799999999999995,"15min":0.99099999999999999},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.89800000000000002,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.80900000000000005,"15min":0.81799999999999995},"min":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.92400000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0009999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.94699999999999995,"15min":0.98499999999999999},"min":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.93100000000000005,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":0.66800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1183744,"data_stored":832501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.753,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38600000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59299999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.435},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53500000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.998,"5min":1.052,"15min":1.052},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92100000000000004,"5min":1.006,"15min":1.006},"last":0.65000000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88900000000000001,"5min":1.524,"15min":1.524},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.97999999999999998,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.624,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.84199999999999997,"5min":1.214,"15min":1.214},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97399999999999998,"5min":1.415,"15min":1.415},"last":0.57799999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95599999999999996,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93899999999999995,"5min":1.099,"15min":1.099},"last":0.67800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:10:24.717 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:10:24.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.848+0000 7fd393bf5640 1 Processor -- start 2023-11-28T20:10:24.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.852+0000 7fd393bf5640 1 -- start start 2023-11-28T20:10:24.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.852+0000 7fd393bf5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd38c13cf30 0x7fd38c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:24.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.852+0000 7fd393bf5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd38c15ad40 0x7fd38c0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:24.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.852+0000 7fd393bf5640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38c15b3a0 con 0x7fd38c06c800 2023-11-28T20:10:24.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.852+0000 7fd393bf5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38c13d310 con 0x7fd38c13cf30 2023-11-28T20:10:24.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.852+0000 7fd393bf5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c15b1b0 con 0x7fd38c15ad40 2023-11-28T20:10:24.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.852+0000 7fd391991640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd38c13cf30 0x7fd38c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:24.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.852+0000 7fd391190640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fd38c06c800 0x7fd38c15a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47076/0 (socket says 172.21.15.177:47076) 2023-11-28T20:10:24.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.852+0000 7fd391190640 1 -- 172.21.15.177:0/3342021847 learned_addr learned my addr 172.21.15.177:0/3342021847 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:24.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.852+0000 7fd392192640 1 --2- 172.21.15.177:0/3342021847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd38c15ad40 0x7fd38c0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:24.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.852+0000 7fd391991640 1 -- 172.21.15.177:0/3342021847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd38c15ad40 msgr2=0x7fd38c0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:24.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.852+0000 7fd391991640 1 --2- 172.21.15.177:0/3342021847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd38c15ad40 0x7fd38c0cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:24.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.852+0000 7fd391991640 1 -- 172.21.15.177:0/3342021847 >> v1:172.21.15.177:6789/0 conn(0x7fd38c06c800 legacy=0x7fd38c15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:24.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.852+0000 7fd391991640 1 -- 172.21.15.177:0/3342021847 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38c13f720 con 0x7fd38c13cf30 2023-11-28T20:10:24.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.852+0000 7fd392192640 1 --2- 172.21.15.177:0/3342021847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd38c15ad40 0x7fd38c0cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:24.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.856+0000 7fd391991640 1 --2- 172.21.15.177:0/3342021847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38c13cf30 0x7fd38c06c2c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd3880097c0 tx=0x7fd38801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed060f429d995d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:24.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.856+0000 7fd39098f640 1 -- 172.21.15.177:0/3342021847 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3880ab600 con 0x7fd38c13cf30 2023-11-28T20:10:24.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.856+0000 7fd39098f640 1 -- 172.21.15.177:0/3342021847 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3880a7050 con 0x7fd38c13cf30 2023-11-28T20:10:24.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.856+0000 7fd39098f640 1 -- 172.21.15.177:0/3342021847 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3880ab980 con 0x7fd38c13cf30 2023-11-28T20:10:24.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.856+0000 7fd393bf5640 1 -- 172.21.15.177:0/3342021847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38c13cf30 msgr2=0x7fd38c06c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:24.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.856+0000 7fd393bf5640 1 --2- 172.21.15.177:0/3342021847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38c13cf30 0x7fd38c06c2c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd3880097c0 tx=0x7fd38801c3f0 comp rx=0 tx=0).stop 2023-11-28T20:10:24.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.856+0000 7fd393bf5640 1 -- 172.21.15.177:0/3342021847 shutdown_connections 2023-11-28T20:10:24.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.856+0000 7fd393bf5640 1 --2- 172.21.15.177:0/3342021847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd38c15ad40 0x7fd38c0cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:24.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.856+0000 7fd393bf5640 1 --2- 172.21.15.177:0/3342021847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38c13cf30 0x7fd38c06c2c0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:24.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.856+0000 7fd393bf5640 1 -- 172.21.15.177:0/3342021847 >> 172.21.15.177:0/3342021847 conn(0x7fd38c06a530 msgr2=0x7fd38c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:24.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.856+0000 7fd393bf5640 1 -- 172.21.15.177:0/3342021847 shutdown_connections 2023-11-28T20:10:24.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.856+0000 7fd393bf5640 1 -- 172.21.15.177:0/3342021847 wait complete. 2023-11-28T20:10:24.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.856+0000 7fd393bf5640 1 Processor -- start 2023-11-28T20:10:24.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.856+0000 7fd393bf5640 1 -- start start 2023-11-28T20:10:24.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd393bf5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38c06c800 0x7fd38c14c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:24.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd393bf5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd38c13cf30 0x7fd38c12b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:24.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd393bf5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd38c15ad40 0x7fd38c0b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:24.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd393bf5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c127e10 con 0x7fd38c06c800 2023-11-28T20:10:24.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd393bf5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c139330 con 0x7fd38c13cf30 2023-11-28T20:10:24.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd393bf5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c139610 con 0x7fd38c15ad40 2023-11-28T20:10:24.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd391991640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38c06c800 0x7fd38c14c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:24.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd391991640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38c06c800 0x7fd38c14c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59790/0 (socket says 172.21.15.177:59790) 2023-11-28T20:10:24.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd391991640 1 -- 172.21.15.177:0/3093305174 learned_addr learned my addr 172.21.15.177:0/3093305174 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:24.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd391190640 1 --2- 172.21.15.177:0/3093305174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd38c13cf30 0x7fd38c12b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:24.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd392192640 1 --2- 172.21.15.177:0/3093305174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd38c15ad40 0x7fd38c0b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:24.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd391991640 1 -- 172.21.15.177:0/3093305174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd38c15ad40 msgr2=0x7fd38c0b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:24.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd391991640 1 --2- 172.21.15.177:0/3093305174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd38c15ad40 0x7fd38c0b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:24.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd391991640 1 -- 172.21.15.177:0/3093305174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd38c13cf30 msgr2=0x7fd38c12b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:24.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd391991640 1 --2- 172.21.15.177:0/3093305174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd38c13cf30 0x7fd38c12b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:24.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd391991640 1 -- 172.21.15.177:0/3093305174 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388009420 con 0x7fd38c06c800 2023-11-28T20:10:24.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd391991640 1 --2- 172.21.15.177:0/3093305174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38c06c800 0x7fd38c14c2a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd38801a020 tx=0x7fd388019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:24.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd3827fc640 1 -- 172.21.15.177:0/3093305174 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3880b4610 con 0x7fd38c06c800 2023-11-28T20:10:24.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd3827fc640 1 -- 172.21.15.177:0/3093305174 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3880abe90 con 0x7fd38c06c800 2023-11-28T20:10:24.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd3827fc640 1 -- 172.21.15.177:0/3093305174 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3880b49d0 con 0x7fd38c06c800 2023-11-28T20:10:24.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd393bf5640 1 -- 172.21.15.177:0/3093305174 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38c1398f0 con 0x7fd38c06c800 2023-11-28T20:10:24.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd393bf5640 1 -- 172.21.15.177:0/3093305174 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38c12bfe0 con 0x7fd38c06c800 2023-11-28T20:10:24.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd393bf5640 1 -- 172.21.15.177:0/3093305174 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38c139ae0 con 0x7fd38c06c800 2023-11-28T20:10:24.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.860+0000 7fd3827fc640 1 -- 172.21.15.177:0/3093305174 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd3880b2040 con 0x7fd38c06c800 2023-11-28T20:10:24.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.864+0000 7fd3827fc640 1 --2- 172.21.15.177:0/3093305174 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd370066470 0x7fd370068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:24.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.864+0000 7fd3827fc640 1 -- 172.21.15.177:0/3093305174 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd38811dbe0 con 0x7fd38c06c800 2023-11-28T20:10:24.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.864+0000 7fd391190640 1 --2- 172.21.15.177:0/3093305174 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd370066470 0x7fd370068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:24.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.864+0000 7fd391190640 1 --2- 172.21.15.177:0/3093305174 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd370066470 0x7fd370068930 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0b46a0 tx=0x7fd37c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:24.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:24.868+0000 7fd3827fc640 1 -- 172.21.15.177:0/3093305174 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3880eb400 con 0x7fd38c06c800 2023-11-28T20:10:25.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.012+0000 7fd393bf5640 1 -- 172.21.15.177:0/3093305174 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd38c1394a0 con 0x7fd370066470 2023-11-28T20:10:25.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.016+0000 7fd3827fc640 1 -- 172.21.15.177:0/3093305174 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50629 (secure 0 0 0) 0x7fd38c1394a0 con 0x7fd370066470 2023-11-28T20:10:25.020 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:25.020 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:10:25.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.016+0000 7fd393bf5640 1 -- 172.21.15.177:0/3093305174 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd370066470 msgr2=0x7fd370068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:25.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.016+0000 7fd393bf5640 1 --2- 172.21.15.177:0/3093305174 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd370066470 0x7fd370068930 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0b46a0 tx=0x7fd37c009040 comp rx=0 tx=0).stop 2023-11-28T20:10:25.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.016+0000 7fd393bf5640 1 -- 172.21.15.177:0/3093305174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38c06c800 msgr2=0x7fd38c14c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:25.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.016+0000 7fd393bf5640 1 --2- 172.21.15.177:0/3093305174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38c06c800 0x7fd38c14c2a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd38801a020 tx=0x7fd388019190 comp rx=0 tx=0).stop 2023-11-28T20:10:25.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.016+0000 7fd393bf5640 1 -- 172.21.15.177:0/3093305174 shutdown_connections 2023-11-28T20:10:25.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.016+0000 7fd393bf5640 1 --2- 172.21.15.177:0/3093305174 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd370066470 0x7fd370068930 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.016+0000 7fd393bf5640 1 --2- 172.21.15.177:0/3093305174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd38c15ad40 0x7fd38c0b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.016+0000 7fd393bf5640 1 --2- 172.21.15.177:0/3093305174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd38c13cf30 0x7fd38c12b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.016+0000 7fd393bf5640 1 --2- 172.21.15.177:0/3093305174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38c06c800 0x7fd38c14c2a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.016+0000 7fd393bf5640 1 -- 172.21.15.177:0/3093305174 >> 172.21.15.177:0/3093305174 conn(0x7fd38c06a530 msgr2=0x7fd38c06a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:25.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.016+0000 7fd393bf5640 1 -- 172.21.15.177:0/3093305174 shutdown_connections 2023-11-28T20:10:25.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.016+0000 7fd393bf5640 1 -- 172.21.15.177:0/3093305174 wait complete. 2023-11-28T20:10:25.041 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2023-11-28T20:10:23.450969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242744,"kb_used_data":5792,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731976,"statfs":{"total":773094113280,"available":772845543424,"internally_reserved":0,"allocated":5931008,"data_stored":3147212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14789,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001142"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":191,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.657706+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:09:43.657706+0000","last_peered":"2023-11-28T20:09:43.657706+0000","last_clean":"2023-11-28T20:09:43.657706+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:09:43.657706+0000","last_undegraded":"2023-11-28T20:09:43.657706+0000","last_fullsized":"2023-11-28T20:09:43.657706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1183744,"data_stored":832569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.438,"5min":0.313,"15min":0.313},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.56200000000000006,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.032,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.55500000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.65400000000000003},"min":{"1min":0.49199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94399999999999995,"5min":1.161,"15min":1.161},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0009999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97899999999999998,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.60299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.77400000000000002}]},{"osd":3,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0209999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.58099999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.44500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.505,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.48799999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.495,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.51200000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.58899999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.054,"5min":1.272,"15min":1.272},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.63200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":242729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.437},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.44500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.63}]},{"osd":1,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.69999999999999996,"15min":0.68500000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.748,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.498}]},{"osd":2,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.65400000000000003},"min":{"1min":0.501,"5min":0.498,"15min":0.498},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.60999999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5819999999999999,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.125,"5min":1.357,"15min":1.357},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.006,"5min":0.80600000000000005,"15min":0.77200000000000002},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":6.2249999999999996,"5min":6.2249999999999996,"15min":6.2249999999999996},"last":0.755}]},{"osd":4,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.0789999999999997,"5min":4.0789999999999997,"15min":4.0789999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":0.81899999999999995,"15min":0.77700000000000002},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":8.6159999999999997,"5min":8.6159999999999997,"15min":8.6159999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.83299999999999996,"15min":0.82099999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.77300000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.84399999999999997,"15min":0.84199999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.86199999999999999,"15min":0.85799999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.60199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":581632,"data_stored":242077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.78900000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.70199999999999996}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.626},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65900000000000003,"15min":0.66000000000000003},"min":{"1min":0.47199999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.879,"5min":1.083,"15min":1.083},"last":0.61199999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.052,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69799999999999995,"15min":0.70099999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84399999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65300000000000002,"15min":0.66200000000000003},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81299999999999994,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.745}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82999999999999996,"5min":0.997,"15min":0.997},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92400000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":242659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67900000000000005,"15min":0.68600000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.78100000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71399999999999997,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85599999999999998,"5min":1.361,"15min":1.361},"last":0.58099999999999996}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68799999999999994},"min":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.81799999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.63},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86899999999999999,"5min":1.04,"15min":1.04},"last":0.60899999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.56699999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.83999999999999997,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.504},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88100000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.45400000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85699999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":1.038,"15min":1.038},"last":0.40799999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.84299999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.91400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93100000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.86099999999999999,"15min":0.877},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98899999999999999,"5min":1.353,"15min":1.353},"last":0.72499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":610304,"data_stored":256231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.02,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.68100000000000005,"15min":0.72199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76000000000000001,"5min":6.016,"15min":6.016},"last":0.37}]},{"osd":1,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2170000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.44}]},{"osd":2,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94799999999999995,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0549999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.499}]},{"osd":4,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0009999999999999,"5min":5.8810000000000002,"15min":5.8810000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.038,"5min":1.405,"15min":1.405},"last":0.76500000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79800000000000004,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.119,"5min":1.585,"15min":1.585},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.97299999999999998,"15min":1.0129999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.042,"5min":5.9349999999999996,"15min":5.9349999999999996},"last":0.78300000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95699999999999996,"5min":1.361,"15min":1.361},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.55500000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0900000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.94999999999999996,"15min":0.98799999999999999},"min":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.262,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.751},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0620000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.621}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":606208,"data_stored":256209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.80800000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.54300000000000004,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.54000000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.3140000000000001,"5min":5.3140000000000001,"15min":5.3140000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":3.7650000000000001,"5min":3.7650000000000001,"15min":3.7650000000000001},"last":0.438}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":5.3460000000000001,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.497},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.41899999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3580000000000001,"5min":1.415,"15min":1.415},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.81699999999999995,"15min":0.80700000000000005},"min":{"1min":0.54500000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.8090000000000002,"5min":3.8090000000000002,"15min":3.8090000000000002},"last":0.66900000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.2809999999999997,"5min":5.2809999999999997,"15min":5.2809999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.55300000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88800000000000001,"15min":0.88400000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.5369999999999999,"5min":4.5369999999999999,"15min":4.5369999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.88700000000000001,"15min":0.86599999999999999},"min":{"1min":0.56799999999999995,"5min":0.496,"15min":0.496},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.68300000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.88,"15min":0.874},"min":{"1min":0.56999999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":3.863,"5min":3.863,"15min":3.863},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.90300000000000002,"15min":0.88600000000000001},"min":{"1min":0.627,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":5.2460000000000004,"5min":5.2460000000000004,"15min":5.2460000000000004},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":589824,"data_stored":242237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.60499999999999998,"15min":0.63900000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.627,"15min":0.66100000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.47199999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.64800000000000002,"15min":0.68300000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79900000000000004,"5min":4.9909999999999997,"15min":4.9909999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.68100000000000005,"15min":0.71899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56699999999999995,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":1.389,"15min":1.389},"last":0.503},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.67000000000000004,"15min":0.70399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.52200000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.503,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":1.145,"15min":1.145},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.93500000000000005,"15min":0.96599999999999997},"min":{"1min":0.59899999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90600000000000003,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.80700000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.91400000000000003,"15min":0.95499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90600000000000003,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.89100000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.94799999999999995,"15min":0.99099999999999999},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.89800000000000002,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.80900000000000005,"15min":0.81799999999999995},"min":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.92400000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0009999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.94699999999999995,"15min":0.98499999999999999},"min":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.93100000000000005,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":0.66800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1183744,"data_stored":832501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.753,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38600000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59299999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.435},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53500000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.998,"5min":1.052,"15min":1.052},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92100000000000004,"5min":1.006,"15min":1.006},"last":0.65000000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88900000000000001,"5min":1.524,"15min":1.524},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.97999999999999998,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.624,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.84199999999999997,"5min":1.214,"15min":1.214},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97399999999999998,"5min":1.415,"15min":1.415},"last":0.57799999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95599999999999996,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93899999999999995,"5min":1.099,"15min":1.099},"last":0.67800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:10:25.043 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T20:10:25.043 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:10:25.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.176+0000 7fd1e19f8640 1 Processor -- start 2023-11-28T20:10:25.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.176+0000 7fd1e19f8640 1 -- start start 2023-11-28T20:10:25.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1e19f8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1dc071fd0 0x7fd1dc0af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:25.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1e19f8640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd1dc0af6e0 0x7fd1dc0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:25.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1e19f8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc0adfb0 con 0x7fd1dc15d3b0 2023-11-28T20:10:25.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1e19f8640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1dc0aeb30 con 0x7fd1dc0af6e0 2023-11-28T20:10:25.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1e19f8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0addb0 con 0x7fd1dc071fd0 2023-11-28T20:10:25.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1daffd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fd1dc15d3b0 0x7fd1dc0ad6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47082/0 (socket says 172.21.15.177:47082) 2023-11-28T20:10:25.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1daffd640 1 -- 172.21.15.177:0/1450101 learned_addr learned my addr 172.21.15.177:0/1450101 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:25.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1db7fe640 1 --2- 172.21.15.177:0/1450101 >> v2:172.21.15.177:3300/0 conn(0x7fd1dc0af6e0 0x7fd1dc0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:25.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1d27fc640 1 --2- 172.21.15.177:0/1450101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1dc071fd0 0x7fd1dc0af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:25.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1da7fc640 1 -- 172.21.15.177:0/1450101 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294791730 0 0) 0x7fd1dc0adfb0 con 0x7fd1dc15d3b0 2023-11-28T20:10:25.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1da7fc640 1 -- 172.21.15.177:0/1450101 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c8003530 con 0x7fd1dc15d3b0 2023-11-28T20:10:25.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1db7fe640 1 -- 172.21.15.177:0/1450101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1dc071fd0 msgr2=0x7fd1dc0af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:25.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1db7fe640 1 --2- 172.21.15.177:0/1450101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1dc071fd0 0x7fd1dc0af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1db7fe640 1 -- 172.21.15.177:0/1450101 >> v1:172.21.15.177:6789/0 conn(0x7fd1dc15d3b0 legacy=0x7fd1dc0ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:25.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1db7fe640 1 -- 172.21.15.177:0/1450101 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc0ae290 con 0x7fd1dc0af6e0 2023-11-28T20:10:25.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.180+0000 7fd1db7fe640 1 --2- 172.21.15.177:0/1450101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1dc0af6e0 0x7fd1dc0b34c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40097c0 tx=0x7fd1d401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf465787a95c179 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:25.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1da7fc640 1 -- 172.21.15.177:0/1450101 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d40a8970 con 0x7fd1dc0af6e0 2023-11-28T20:10:25.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1da7fc640 1 -- 172.21.15.177:0/1450101 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d40a8ad0 con 0x7fd1dc0af6e0 2023-11-28T20:10:25.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1da7fc640 1 -- 172.21.15.177:0/1450101 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d40a8e60 con 0x7fd1dc0af6e0 2023-11-28T20:10:25.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 -- 172.21.15.177:0/1450101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1dc0af6e0 msgr2=0x7fd1dc0b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:25.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 --2- 172.21.15.177:0/1450101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1dc0af6e0 0x7fd1dc0b34c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40097c0 tx=0x7fd1d401ec70 comp rx=0 tx=0).stop 2023-11-28T20:10:25.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 -- 172.21.15.177:0/1450101 shutdown_connections 2023-11-28T20:10:25.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 --2- 172.21.15.177:0/1450101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1dc0af6e0 0x7fd1dc0b34c0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 --2- 172.21.15.177:0/1450101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1dc071fd0 0x7fd1dc0af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 -- 172.21.15.177:0/1450101 >> 172.21.15.177:0/1450101 conn(0x7fd1dc06b640 msgr2=0x7fd1dc06ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:25.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 -- 172.21.15.177:0/1450101 shutdown_connections 2023-11-28T20:10:25.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 -- 172.21.15.177:0/1450101 wait complete. 2023-11-28T20:10:25.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 Processor -- start 2023-11-28T20:10:25.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 -- start start 2023-11-28T20:10:25.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1dc071fd0 0x7fd1dc0b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:25.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1dc0af6e0 0x7fd1dc153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:25.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1dc15d3b0 0x7fd1dc153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:25.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0b2470 con 0x7fd1dc071fd0 2023-11-28T20:10:25.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0b1860 con 0x7fd1dc15d3b0 2023-11-28T20:10:25.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1e19f8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0b1b40 con 0x7fd1dc0af6e0 2023-11-28T20:10:25.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.184+0000 7fd1daffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1dc071fd0 0x7fd1dc0b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:25.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1daffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1dc071fd0 0x7fd1dc0b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59808/0 (socket says 172.21.15.177:59808) 2023-11-28T20:10:25.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1daffd640 1 -- 172.21.15.177:0/3124257642 learned_addr learned my addr 172.21.15.177:0/3124257642 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:25.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1d27fc640 1 --2- 172.21.15.177:0/3124257642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1dc0af6e0 0x7fd1dc153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:25.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1db7fe640 1 --2- 172.21.15.177:0/3124257642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1dc15d3b0 0x7fd1dc153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:25.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1daffd640 1 -- 172.21.15.177:0/3124257642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1dc0af6e0 msgr2=0x7fd1dc153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:25.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1daffd640 1 --2- 172.21.15.177:0/3124257642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1dc0af6e0 0x7fd1dc153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1daffd640 1 -- 172.21.15.177:0/3124257642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1dc15d3b0 msgr2=0x7fd1dc153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:25.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1daffd640 1 --2- 172.21.15.177:0/3124257642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1dc15d3b0 0x7fd1dc153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1daffd640 1 -- 172.21.15.177:0/3124257642 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d4009420 con 0x7fd1dc071fd0 2023-11-28T20:10:25.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1daffd640 1 --2- 172.21.15.177:0/3124257642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1dc071fd0 0x7fd1dc0b0da0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00c420 tx=0x7fd1cc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:25.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1d8ff9640 1 -- 172.21.15.177:0/3124257642 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc005cf0 con 0x7fd1dc071fd0 2023-11-28T20:10:25.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1d8ff9640 1 -- 172.21.15.177:0/3124257642 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc005e50 con 0x7fd1dc071fd0 2023-11-28T20:10:25.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1d8ff9640 1 -- 172.21.15.177:0/3124257642 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0072d0 con 0x7fd1dc071fd0 2023-11-28T20:10:25.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1e19f8640 1 -- 172.21.15.177:0/3124257642 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc0b1e20 con 0x7fd1dc071fd0 2023-11-28T20:10:25.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1e19f8640 1 -- 172.21.15.177:0/3124257642 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc1413c0 con 0x7fd1dc071fd0 2023-11-28T20:10:25.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1e19f8640 1 -- 172.21.15.177:0/3124257642 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1dc069440 con 0x7fd1dc071fd0 2023-11-28T20:10:25.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1d8ff9640 1 -- 172.21.15.177:0/3124257642 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd1cc007430 con 0x7fd1dc071fd0 2023-11-28T20:10:25.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1d8ff9640 1 --2- 172.21.15.177:0/3124257642 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd1bc0664a0 0x7fd1bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:25.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.188+0000 7fd1d8ff9640 1 -- 172.21.15.177:0/3124257642 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd1cc083060 con 0x7fd1dc071fd0 2023-11-28T20:10:25.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.192+0000 7fd1d27fc640 1 --2- 172.21.15.177:0/3124257642 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd1bc0664a0 0x7fd1bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:25.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.192+0000 7fd1d27fc640 1 --2- 172.21.15.177:0/3124257642 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd1bc0664a0 0x7fd1bc068960 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc15dbc0 tx=0x7fd1c400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:25.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.192+0000 7fd1d8ff9640 1 -- 172.21.15.177:0/3124257642 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1cc0b4280 con 0x7fd1dc071fd0 2023-11-28T20:10:25.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.340+0000 7fd1e19f8640 1 -- 172.21.15.177:0/3124257642 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1dc15d790 con 0x7fd1bc0664a0 2023-11-28T20:10:25.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.344+0000 7fd1d8ff9640 1 -- 172.21.15.177:0/3124257642 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50629 (secure 0 0 0) 0x7fd1c400f040 con 0x7fd1bc0664a0 2023-11-28T20:10:25.347 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:25.348 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:10:25.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.344+0000 7fd1e19f8640 1 -- 172.21.15.177:0/3124257642 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd1bc0664a0 msgr2=0x7fd1bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:25.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.344+0000 7fd1e19f8640 1 --2- 172.21.15.177:0/3124257642 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd1bc0664a0 0x7fd1bc068960 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc15dbc0 tx=0x7fd1c400b040 comp rx=0 tx=0).stop 2023-11-28T20:10:25.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.344+0000 7fd1e19f8640 1 -- 172.21.15.177:0/3124257642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1dc071fd0 msgr2=0x7fd1dc0b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:25.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.344+0000 7fd1e19f8640 1 --2- 172.21.15.177:0/3124257642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1dc071fd0 0x7fd1dc0b0da0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00c420 tx=0x7fd1cc00c8e0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.344+0000 7fd1e19f8640 1 -- 172.21.15.177:0/3124257642 shutdown_connections 2023-11-28T20:10:25.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.344+0000 7fd1e19f8640 1 --2- 172.21.15.177:0/3124257642 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd1bc0664a0 0x7fd1bc068960 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.344+0000 7fd1e19f8640 1 --2- 172.21.15.177:0/3124257642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1dc15d3b0 0x7fd1dc153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.344+0000 7fd1e19f8640 1 --2- 172.21.15.177:0/3124257642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1dc0af6e0 0x7fd1dc153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.344+0000 7fd1e19f8640 1 --2- 172.21.15.177:0/3124257642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1dc071fd0 0x7fd1dc0b0da0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.344+0000 7fd1e19f8640 1 -- 172.21.15.177:0/3124257642 >> 172.21.15.177:0/3124257642 conn(0x7fd1dc06b640 msgr2=0x7fd1dc15acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:25.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.344+0000 7fd1e19f8640 1 -- 172.21.15.177:0/3124257642 shutdown_connections 2023-11-28T20:10:25.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.344+0000 7fd1e19f8640 1 -- 172.21.15.177:0/3124257642 wait complete. 2023-11-28T20:10:25.368 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2023-11-28T20:10:23.450969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242744,"kb_used_data":5792,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731976,"statfs":{"total":773094113280,"available":772845543424,"internally_reserved":0,"allocated":5931008,"data_stored":3147212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14789,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001142"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":191,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T20:09:43.657706+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:09:43.657706+0000","last_peered":"2023-11-28T20:09:43.657706+0000","last_clean":"2023-11-28T20:09:43.657706+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:09:43.657706+0000","last_undegraded":"2023-11-28T20:09:43.657706+0000","last_fullsized":"2023-11-28T20:09:43.657706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1183744,"data_stored":832569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.438,"5min":0.313,"15min":0.313},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.56200000000000006,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.032,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.55500000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.65400000000000003},"min":{"1min":0.49199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94399999999999995,"5min":1.161,"15min":1.161},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0009999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97899999999999998,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.60299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.77400000000000002}]},{"osd":3,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0209999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.58099999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.44500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.505,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.48799999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.495,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.51200000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.58899999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.054,"5min":1.272,"15min":1.272},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.63200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":242729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.437},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.44500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.63}]},{"osd":1,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.69999999999999996,"15min":0.68500000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.748,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.498}]},{"osd":2,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.65400000000000003},"min":{"1min":0.501,"5min":0.498,"15min":0.498},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.60999999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5819999999999999,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.125,"5min":1.357,"15min":1.357},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.006,"5min":0.80600000000000005,"15min":0.77200000000000002},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":6.2249999999999996,"5min":6.2249999999999996,"15min":6.2249999999999996},"last":0.755}]},{"osd":4,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.0789999999999997,"5min":4.0789999999999997,"15min":4.0789999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":0.81899999999999995,"15min":0.77700000000000002},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":8.6159999999999997,"5min":8.6159999999999997,"15min":8.6159999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.83299999999999996,"15min":0.82099999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.77300000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.84399999999999997,"15min":0.84199999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.86199999999999999,"15min":0.85799999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.60199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":581632,"data_stored":242077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.78900000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.70199999999999996}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.626},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65900000000000003,"15min":0.66000000000000003},"min":{"1min":0.47199999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.879,"5min":1.083,"15min":1.083},"last":0.61199999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.052,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69799999999999995,"15min":0.70099999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84399999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65300000000000002,"15min":0.66200000000000003},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81299999999999994,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.745}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82999999999999996,"5min":0.997,"15min":0.997},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92400000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":242659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67900000000000005,"15min":0.68600000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.78100000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71399999999999997,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85599999999999998,"5min":1.361,"15min":1.361},"last":0.58099999999999996}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68799999999999994},"min":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.81799999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.63},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86899999999999999,"5min":1.04,"15min":1.04},"last":0.60899999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.56699999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.83999999999999997,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.504},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88100000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.45400000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85699999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":1.038,"15min":1.038},"last":0.40799999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.84299999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.91400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93100000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.86099999999999999,"15min":0.877},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98899999999999999,"5min":1.353,"15min":1.353},"last":0.72499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":610304,"data_stored":256231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.02,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.68100000000000005,"15min":0.72199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76000000000000001,"5min":6.016,"15min":6.016},"last":0.37}]},{"osd":1,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2170000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.44}]},{"osd":2,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94799999999999995,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0549999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.499}]},{"osd":4,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0009999999999999,"5min":5.8810000000000002,"15min":5.8810000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.038,"5min":1.405,"15min":1.405},"last":0.76500000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79800000000000004,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.119,"5min":1.585,"15min":1.585},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.97299999999999998,"15min":1.0129999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.042,"5min":5.9349999999999996,"15min":5.9349999999999996},"last":0.78300000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95699999999999996,"5min":1.361,"15min":1.361},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.55500000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0900000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.94999999999999996,"15min":0.98799999999999999},"min":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.262,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.751},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0620000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.621}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":606208,"data_stored":256209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.80800000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.54300000000000004,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.54000000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.3140000000000001,"5min":5.3140000000000001,"15min":5.3140000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":3.7650000000000001,"5min":3.7650000000000001,"15min":3.7650000000000001},"last":0.438}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":5.3460000000000001,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.497},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.41899999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3580000000000001,"5min":1.415,"15min":1.415},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.81699999999999995,"15min":0.80700000000000005},"min":{"1min":0.54500000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.8090000000000002,"5min":3.8090000000000002,"15min":3.8090000000000002},"last":0.66900000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.2809999999999997,"5min":5.2809999999999997,"15min":5.2809999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.55300000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88800000000000001,"15min":0.88400000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.5369999999999999,"5min":4.5369999999999999,"15min":4.5369999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.88700000000000001,"15min":0.86599999999999999},"min":{"1min":0.56799999999999995,"5min":0.496,"15min":0.496},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.68300000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.88,"15min":0.874},"min":{"1min":0.56999999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":3.863,"5min":3.863,"15min":3.863},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.90300000000000002,"15min":0.88600000000000001},"min":{"1min":0.627,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":5.2460000000000004,"5min":5.2460000000000004,"15min":5.2460000000000004},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":589824,"data_stored":242237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.60499999999999998,"15min":0.63900000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.627,"15min":0.66100000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.47199999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.64800000000000002,"15min":0.68300000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79900000000000004,"5min":4.9909999999999997,"15min":4.9909999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.68100000000000005,"15min":0.71899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56699999999999995,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":1.389,"15min":1.389},"last":0.503},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.67000000000000004,"15min":0.70399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.52200000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.503,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":1.145,"15min":1.145},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.93500000000000005,"15min":0.96599999999999997},"min":{"1min":0.59899999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90600000000000003,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.80700000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.91400000000000003,"15min":0.95499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90600000000000003,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.89100000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.94799999999999995,"15min":0.99099999999999999},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.89800000000000002,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.80900000000000005,"15min":0.81799999999999995},"min":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.92400000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0009999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.94699999999999995,"15min":0.98499999999999999},"min":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.93100000000000005,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":0.66800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1183744,"data_stored":832501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.753,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38600000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59299999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.435},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53500000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.998,"5min":1.052,"15min":1.052},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92100000000000004,"5min":1.006,"15min":1.006},"last":0.65000000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88900000000000001,"5min":1.524,"15min":1.524},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.97999999999999998,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.624,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.84199999999999997,"5min":1.214,"15min":1.214},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97399999999999998,"5min":1.415,"15min":1.415},"last":0.57799999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95599999999999996,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93899999999999995,"5min":1.099,"15min":1.099},"last":0.67800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:10:25.370 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:10:25.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.504+0000 7f02d5e32640 1 Processor -- start 2023-11-28T20:10:25.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.504+0000 7f02d5e32640 1 -- start start 2023-11-28T20:10:25.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.504+0000 7f02d5e32640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f02d013cf30 0x7f02d006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:25.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.504+0000 7f02d5e32640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f02d006c800 0x7f02d015a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:25.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.504+0000 7f02d5e32640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02d015ab70 0x7f02d0071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:25.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.504+0000 7f02d5e32640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d013d310 con 0x7f02d006c800 2023-11-28T20:10:25.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.504+0000 7f02d5e32640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d01404e0 con 0x7f02d013cf30 2023-11-28T20:10:25.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.504+0000 7f02d5e32640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d006cc70 con 0x7f02d015ab70 2023-11-28T20:10:25.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.508+0000 7f02ceffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f02d006c800 0x7f02d015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:25.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.508+0000 7f02ceffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f02d006c800 0x7f02d015a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59824/0 (socket says 172.21.15.177:59824) 2023-11-28T20:10:25.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.508+0000 7f02ceffd640 1 -- 172.21.15.177:0/46793620 learned_addr learned my addr 172.21.15.177:0/46793620 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:25.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.508+0000 7f02cf7fe640 1 --2- 172.21.15.177:0/46793620 >> v2:172.21.15.195:3300/0 conn(0x7f02d013cf30 0x7f02d006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:25.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.508+0000 7f02cffff640 1 --2- 172.21.15.177:0/46793620 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02d015ab70 0x7f02d0071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:25.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.508+0000 7f02ceffd640 1 -- 172.21.15.177:0/46793620 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02d015ab70 msgr2=0x7f02d0071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:25.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.508+0000 7f02ceffd640 1 --2- 172.21.15.177:0/46793620 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02d015ab70 0x7f02d0071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.508+0000 7f02ceffd640 1 -- 172.21.15.177:0/46793620 >> v2:172.21.15.195:3300/0 conn(0x7f02d013cf30 msgr2=0x7f02d006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:25.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.508+0000 7f02ceffd640 1 --2- 172.21.15.177:0/46793620 >> v2:172.21.15.195:3300/0 conn(0x7f02d013cf30 0x7f02d006c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.508+0000 7f02ceffd640 1 -- 172.21.15.177:0/46793620 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d015b3a0 con 0x7f02d006c800 2023-11-28T20:10:25.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.508+0000 7f02ceffd640 1 --2- 172.21.15.177:0/46793620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02d006c800 0x7f02d015a630 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f02d006b510 tx=0x7f02c401eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c03c0fe850543f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:25.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.508+0000 7f02ce7fc640 1 -- 172.21.15.177:0/46793620 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40a7b80 con 0x7f02d006c800 2023-11-28T20:10:25.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.508+0000 7f02ce7fc640 1 -- 172.21.15.177:0/46793620 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c40a7ce0 con 0x7f02d006c800 2023-11-28T20:10:25.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.508+0000 7f02ce7fc640 1 -- 172.21.15.177:0/46793620 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40af660 con 0x7f02d006c800 2023-11-28T20:10:25.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 -- 172.21.15.177:0/46793620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02d006c800 msgr2=0x7f02d015a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:25.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 --2- 172.21.15.177:0/46793620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02d006c800 0x7f02d015a630 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f02d006b510 tx=0x7f02c401eaf0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 -- 172.21.15.177:0/46793620 shutdown_connections 2023-11-28T20:10:25.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 --2- 172.21.15.177:0/46793620 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02d015ab70 0x7f02d0071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 --2- 172.21.15.177:0/46793620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02d006c800 0x7f02d015a630 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 --2- 172.21.15.177:0/46793620 >> v2:172.21.15.195:3300/0 conn(0x7f02d013cf30 0x7f02d006c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 -- 172.21.15.177:0/46793620 >> 172.21.15.177:0/46793620 conn(0x7f02d006a530 msgr2=0x7f02d006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:25.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 -- 172.21.15.177:0/46793620 shutdown_connections 2023-11-28T20:10:25.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 -- 172.21.15.177:0/46793620 wait complete. 2023-11-28T20:10:25.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 Processor -- start 2023-11-28T20:10:25.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 -- start start 2023-11-28T20:10:25.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02d006c800 0x7f02d01fa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:25.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02d013cf30 0x7f02d013a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:25.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02d015ab70 0x7f02d013df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:25.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d014a560 con 0x7f02d006c800 2023-11-28T20:10:25.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d013aa70 con 0x7f02d015ab70 2023-11-28T20:10:25.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02d5e32640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d014a7b0 con 0x7f02d013cf30 2023-11-28T20:10:25.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02cf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02d006c800 0x7f02d01fa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:25.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02cf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02d006c800 0x7f02d01fa080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59832/0 (socket says 172.21.15.177:59832) 2023-11-28T20:10:25.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02cf7fe640 1 -- 172.21.15.177:0/3996487885 learned_addr learned my addr 172.21.15.177:0/3996487885 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:25.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02ceffd640 1 --2- 172.21.15.177:0/3996487885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02d013cf30 0x7f02d013a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:25.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.512+0000 7f02cffff640 1 --2- 172.21.15.177:0/3996487885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02d015ab70 0x7f02d013df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:25.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02cf7fe640 1 -- 172.21.15.177:0/3996487885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02d013cf30 msgr2=0x7f02d013a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:25.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02cf7fe640 1 --2- 172.21.15.177:0/3996487885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02d013cf30 0x7f02d013a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02cf7fe640 1 -- 172.21.15.177:0/3996487885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02d015ab70 msgr2=0x7f02d013df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:25.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02cf7fe640 1 --2- 172.21.15.177:0/3996487885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02d015ab70 0x7f02d013df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02cf7fe640 1 -- 172.21.15.177:0/3996487885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c400b770 con 0x7f02d006c800 2023-11-28T20:10:25.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02cffff640 1 --2- 172.21.15.177:0/3996487885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02d015ab70 0x7f02d013df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:25.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02cf7fe640 1 --2- 172.21.15.177:0/3996487885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02d006c800 0x7f02d01fa080 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f02c000e870 tx=0x7f02c000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:25.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02b7fff640 1 -- 172.21.15.177:0/3996487885 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c0009510 con 0x7f02d006c800 2023-11-28T20:10:25.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02b7fff640 1 -- 172.21.15.177:0/3996487885 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c000eec0 con 0x7f02d006c800 2023-11-28T20:10:25.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02b7fff640 1 -- 172.21.15.177:0/3996487885 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c000cb40 con 0x7f02d006c800 2023-11-28T20:10:25.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02d5e32640 1 -- 172.21.15.177:0/3996487885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d014aa90 con 0x7f02d006c800 2023-11-28T20:10:25.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02d5e32640 1 -- 172.21.15.177:0/3996487885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d014b050 con 0x7f02d006c800 2023-11-28T20:10:25.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02d5e32640 1 -- 172.21.15.177:0/3996487885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d0069440 con 0x7f02d006c800 2023-11-28T20:10:25.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02b7fff640 1 -- 172.21.15.177:0/3996487885 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f02c000cca0 con 0x7f02d006c800 2023-11-28T20:10:25.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02b7fff640 1 --2- 172.21.15.177:0/3996487885 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f02bc066470 0x7f02bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:25.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.516+0000 7f02b7fff640 1 -- 172.21.15.177:0/3996487885 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f02c0083d50 con 0x7f02d006c800 2023-11-28T20:10:25.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.520+0000 7f02ceffd640 1 --2- 172.21.15.177:0/3996487885 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f02bc066470 0x7f02bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:25.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.520+0000 7f02ceffd640 1 --2- 172.21.15.177:0/3996487885 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f02bc066470 0x7f02bc068930 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f02c40b1000 tx=0x7f02c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:25.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.520+0000 7f02b7fff640 1 -- 172.21.15.177:0/3996487885 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f02c0051430 con 0x7f02d006c800 2023-11-28T20:10:25.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.672+0000 7f02d5e32640 1 -- 172.21.15.177:0/3996487885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02d00cc300 con 0x7f02d006c800 2023-11-28T20:10:25.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.672+0000 7f02b7fff640 1 -- 172.21.15.177:0/3996487885 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+13046 (secure 0 0 0) 0x7f02c0054a50 con 0x7f02d006c800 2023-11-28T20:10:25.678 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:25.678 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":52,"fsid":"281097bd-2f79-488c-a8b5-264c5bd230f4","created":"2023-11-28T20:07:16.439004+0000","modified":"2023-11-28T20:10:22.372979+0000","last_up_change":"2023-11-28T20:07:28.183266+0000","last_in_change":"2023-11-28T20:07:19.006585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:07:29.480556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b7ec4c2-697e-4a04-a68a-db84cf62856a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6801","nonce":3095629541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6803","nonce":3095629541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6807","nonce":3095629541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3095629541},{"type":"v1","addr":"172.21.15.177:6805","nonce":3095629541}]},"public_addr":"172.21.15.177:6801/3095629541","cluster_addr":"172.21.15.177:6803/3095629541","heartbeat_back_addr":"172.21.15.177:6807/3095629541","heartbeat_front_addr":"172.21.15.177:6805/3095629541","state":["exists","up"]},{"osd":1,"uuid":"9e60dd25-b21a-4b85-bcd8-440427666cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6825","nonce":1722845469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6827","nonce":1722845469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6831","nonce":1722845469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1722845469},{"type":"v1","addr":"172.21.15.177:6829","nonce":1722845469}]},"public_addr":"172.21.15.177:6825/1722845469","cluster_addr":"172.21.15.177:6827/1722845469","heartbeat_back_addr":"172.21.15.177:6831/1722845469","heartbeat_front_addr":"172.21.15.177:6829/1722845469","state":["exists","up"]},{"osd":2,"uuid":"a059ae32-891e-4cf9-a1bf-eb1a5b11e9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6817","nonce":1088546159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6819","nonce":1088546159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6823","nonce":1088546159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1088546159},{"type":"v1","addr":"172.21.15.177:6821","nonce":1088546159}]},"public_addr":"172.21.15.177:6817/1088546159","cluster_addr":"172.21.15.177:6819/1088546159","heartbeat_back_addr":"172.21.15.177:6823/1088546159","heartbeat_front_addr":"172.21.15.177:6821/1088546159","state":["exists","up"]},{"osd":3,"uuid":"3bdda87a-725c-444f-b8cb-cfda18babf9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6809","nonce":3088892220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6811","nonce":3088892220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6815","nonce":3088892220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":3088892220},{"type":"v1","addr":"172.21.15.177:6813","nonce":3088892220}]},"public_addr":"172.21.15.177:6809/3088892220","cluster_addr":"172.21.15.177:6811/3088892220","heartbeat_back_addr":"172.21.15.177:6815/3088892220","heartbeat_front_addr":"172.21.15.177:6813/3088892220","state":["exists","up"]},{"osd":4,"uuid":"09b28205-53f0-4c2d-9964-721c79ea40f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6809","nonce":3998424383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6811","nonce":3998424383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6815","nonce":3998424383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3998424383},{"type":"v1","addr":"172.21.15.195:6813","nonce":3998424383}]},"public_addr":"172.21.15.195:6809/3998424383","cluster_addr":"172.21.15.195:6811/3998424383","heartbeat_back_addr":"172.21.15.195:6815/3998424383","heartbeat_front_addr":"172.21.15.195:6813/3998424383","state":["exists","up"]},{"osd":5,"uuid":"fa56bb04-67bf-460d-94d3-c466bcc4de0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6801","nonce":1295097681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6803","nonce":1295097681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6807","nonce":1295097681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1295097681},{"type":"v1","addr":"172.21.15.195:6805","nonce":1295097681}]},"public_addr":"172.21.15.195:6801/1295097681","cluster_addr":"172.21.15.195:6803/1295097681","heartbeat_back_addr":"172.21.15.195:6807/1295097681","heartbeat_front_addr":"172.21.15.195:6805/1295097681","state":["exists","up"]},{"osd":6,"uuid":"b88434bd-9fc8-40be-aa7e-1f88288d661c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6817","nonce":1289013754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6819","nonce":1289013754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6823","nonce":1289013754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1289013754},{"type":"v1","addr":"172.21.15.195:6821","nonce":1289013754}]},"public_addr":"172.21.15.195:6817/1289013754","cluster_addr":"172.21.15.195:6819/1289013754","heartbeat_back_addr":"172.21.15.195:6823/1289013754","heartbeat_front_addr":"172.21.15.195:6821/1289013754","state":["exists","up"]},{"osd":7,"uuid":"8e53b777-ef71-4d71-9d5c-f7f7067218b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6825","nonce":1875951680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6827","nonce":1875951680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6831","nonce":1875951680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1875951680},{"type":"v1","addr":"172.21.15.195:6829","nonce":1875951680}]},"public_addr":"172.21.15.195:6825/1875951680","cluster_addr":"172.21.15.195:6827/1875951680","heartbeat_back_addr":"172.21.15.195:6831/1875951680","heartbeat_front_addr":"172.21.15.195:6829/1875951680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.574641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.742614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.652961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.731930+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.672198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.839851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:07:24.783135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.177:6837/198543116":"2023-11-29T20:10:19.297115+0000","172.21.15.177:6836/198543116":"2023-11-29T20:10:19.297115+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:10:25.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.676+0000 7f02d5e32640 1 -- 172.21.15.177:0/3996487885 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f02bc066470 msgr2=0x7f02bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:25.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.676+0000 7f02d5e32640 1 --2- 172.21.15.177:0/3996487885 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f02bc066470 0x7f02bc068930 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f02c40b1000 tx=0x7f02c4008040 comp rx=0 tx=0).stop 2023-11-28T20:10:25.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.676+0000 7f02d5e32640 1 -- 172.21.15.177:0/3996487885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02d006c800 msgr2=0x7f02d01fa080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:25.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.676+0000 7f02d5e32640 1 --2- 172.21.15.177:0/3996487885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02d006c800 0x7f02d01fa080 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f02c000e870 tx=0x7f02c000ec70 comp rx=0 tx=0).stop 2023-11-28T20:10:25.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.676+0000 7f02d5e32640 1 -- 172.21.15.177:0/3996487885 shutdown_connections 2023-11-28T20:10:25.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.676+0000 7f02d5e32640 1 --2- 172.21.15.177:0/3996487885 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f02bc066470 0x7f02bc068930 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.676+0000 7f02d5e32640 1 --2- 172.21.15.177:0/3996487885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02d015ab70 0x7f02d013df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.676+0000 7f02d5e32640 1 --2- 172.21.15.177:0/3996487885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02d013cf30 0x7f02d013a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.676+0000 7f02d5e32640 1 --2- 172.21.15.177:0/3996487885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02d006c800 0x7f02d01fa080 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:25.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.676+0000 7f02d5e32640 1 -- 172.21.15.177:0/3996487885 >> 172.21.15.177:0/3996487885 conn(0x7f02d006a530 msgr2=0x7f02d015be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:25.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.676+0000 7f02d5e32640 1 -- 172.21.15.177:0/3996487885 shutdown_connections 2023-11-28T20:10:25.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:25.676+0000 7f02d5e32640 1 -- 172.21.15.177:0/3996487885 wait complete. 2023-11-28T20:10:26.700 INFO:tasks.ceph:Scrubbing osd.0 2023-11-28T20:10:26.701 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:10:26.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.848+0000 7fd0d5479640 1 Processor -- start 2023-11-28T20:10:26.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.848+0000 7fd0d5479640 1 -- start start 2023-11-28T20:10:26.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0d5479640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d00cd570 0x7fd0d00c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:26.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0d5479640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd0d00cb0c0 0x7fd0d0070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:26.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0d5479640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d0159f80 con 0x7fd0d0159ba0 2023-11-28T20:10:26.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0d5479640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d00cb550 con 0x7fd0d00cb0c0 2023-11-28T20:10:26.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0d5479640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00ce460 con 0x7fd0d00cd570 2023-11-28T20:10:26.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ceffd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fd0d0159ba0 0x7fd0d00cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47094/0 (socket says 172.21.15.177:47094) 2023-11-28T20:10:26.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ceffd640 1 -- 172.21.15.177:0/3618727466 learned_addr learned my addr 172.21.15.177:0/3618727466 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:26.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0c67fc640 1 --2- 172.21.15.177:0/3618727466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d00cd570 0x7fd0d00c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:26.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0cf7fe640 1 --2- 172.21.15.177:0/3618727466 >> v2:172.21.15.195:3300/0 conn(0x7fd0d00cb0c0 0x7fd0d0070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:26.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 -- 172.21.15.177:0/3618727466 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330718840 0 0) 0x7fd0d0159f80 con 0x7fd0d0159ba0 2023-11-28T20:10:26.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 -- 172.21.15.177:0/3618727466 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0bc003450 con 0x7fd0d0159ba0 2023-11-28T20:10:26.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 -- 172.21.15.177:0/3618727466 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1369883742 0 0) 0x7fd0bc003450 con 0x7fd0d0159ba0 2023-11-28T20:10:26.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 -- 172.21.15.177:0/3618727466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d00cd570 msgr2=0x7fd0d00c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:26.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 --2- 172.21.15.177:0/3618727466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d00cd570 0x7fd0d00c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:26.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 -- 172.21.15.177:0/3618727466 >> v2:172.21.15.195:3300/0 conn(0x7fd0d00cb0c0 msgr2=0x7fd0d0070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:26.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 --2- 172.21.15.177:0/3618727466 >> v2:172.21.15.195:3300/0 conn(0x7fd0d00cb0c0 0x7fd0d0070580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:26.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 -- 172.21.15.177:0/3618727466 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d00cda30 con 0x7fd0d0159ba0 2023-11-28T20:10:26.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 -- 172.21.15.177:0/3618727466 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7fd0c0001a00 con 0x7fd0d0159ba0 2023-11-28T20:10:26.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 -- 172.21.15.177:0/3618727466 >> v1:172.21.15.177:6789/0 conn(0x7fd0d0159ba0 legacy=0x7fd0d00cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:26.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 --2- 172.21.15.177:0/3618727466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0bc003a70 0x7fd0bc003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:26.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 --2- 172.21.15.177:0/3618727466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d00cd570 0x7fd0bc00a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:26.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 --2- 172.21.15.177:0/3618727466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0bc00ae00 0x7fd0bc00d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:26.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 -- 172.21.15.177:0/3618727466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00ce460 con 0x7fd0bc003a70 2023-11-28T20:10:26.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 -- 172.21.15.177:0/3618727466 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc00da70 con 0x7fd0bc00ae00 2023-11-28T20:10:26.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ce7fc640 1 -- 172.21.15.177:0/3618727466 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc00dc30 con 0x7fd0d00cd570 2023-11-28T20:10:26.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ceffd640 1 --2- 172.21.15.177:0/3618727466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0bc003a70 0x7fd0bc003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:26.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0c67fc640 1 --2- 172.21.15.177:0/3618727466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d00cd570 0x7fd0bc00a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:26.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0cf7fe640 1 --2- 172.21.15.177:0/3618727466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0bc00ae00 0x7fd0bc00d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:26.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ceffd640 1 -- 172.21.15.177:0/3618727466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d00cd570 msgr2=0x7fd0bc00a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:26.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ceffd640 1 --2- 172.21.15.177:0/3618727466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d00cd570 0x7fd0bc00a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:26.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ceffd640 1 -- 172.21.15.177:0/3618727466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0bc00ae00 msgr2=0x7fd0bc00d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:26.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ceffd640 1 --2- 172.21.15.177:0/3618727466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0bc00ae00 0x7fd0bc00d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:26.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.852+0000 7fd0ceffd640 1 -- 172.21.15.177:0/3618727466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc003450 con 0x7fd0bc003a70 2023-11-28T20:10:26.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.856+0000 7fd0ceffd640 1 --2- 172.21.15.177:0/3618727466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0bc003a70 0x7fd0bc003e90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0002240 tx=0x7fd0c001d2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d9142fe616cb20 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:26.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.856+0000 7fd0ce7fc640 1 -- 172.21.15.177:0/3618727466 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00ad630 con 0x7fd0bc003a70 2023-11-28T20:10:26.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.856+0000 7fd0ce7fc640 1 -- 172.21.15.177:0/3618727466 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c00a8070 con 0x7fd0bc003a70 2023-11-28T20:10:26.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.856+0000 7fd0ce7fc640 1 -- 172.21.15.177:0/3618727466 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00ad9f0 con 0x7fd0bc003a70 2023-11-28T20:10:26.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.856+0000 7fd0d5479640 1 -- 172.21.15.177:0/3618727466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0bc003a70 msgr2=0x7fd0bc003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:26.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.856+0000 7fd0d5479640 1 --2- 172.21.15.177:0/3618727466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0bc003a70 0x7fd0bc003e90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0002240 tx=0x7fd0c001d2d0 comp rx=0 tx=0).stop 2023-11-28T20:10:26.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.856+0000 7fd0cf7fe640 1 -- 172.21.15.177:0/3618727466 reap_dead start 2023-11-28T20:10:26.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.856+0000 7fd0d5479640 1 -- 172.21.15.177:0/3618727466 shutdown_connections 2023-11-28T20:10:26.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.856+0000 7fd0d5479640 1 -- 172.21.15.177:0/3618727466 >> 172.21.15.177:0/3618727466 conn(0x7fd0d00b0c50 msgr2=0x7fd0d00b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:26.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.856+0000 7fd0d5479640 1 -- 172.21.15.177:0/3618727466 shutdown_connections 2023-11-28T20:10:26.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.856+0000 7fd0d5479640 1 -- 172.21.15.177:0/3618727466 wait complete. 2023-11-28T20:10:26.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.856+0000 7fd0d5479640 1 Processor -- start 2023-11-28T20:10:26.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.856+0000 7fd0d5479640 1 -- start start 2023-11-28T20:10:26.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0d5479640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0bc003a70 0x7fd0d00b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:26.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0d5479640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0d015f7a0 0x7fd0d015e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:26.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0d5479640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d01f5980 0x7fd0d0070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:26.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0d5479640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d015e5d0 con 0x7fd0d01f5980 2023-11-28T20:10:26.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0d5479640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00b36f0 con 0x7fd0d015f7a0 2023-11-28T20:10:26.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0d5479640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d015e9e0 con 0x7fd0bc003a70 2023-11-28T20:10:26.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0cf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d01f5980 0x7fd0d0070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:26.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0cf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d01f5980 0x7fd0d0070fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59848/0 (socket says 172.21.15.177:59848) 2023-11-28T20:10:26.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0cf7fe640 1 -- 172.21.15.177:0/3850998671 learned_addr learned my addr 172.21.15.177:0/3850998671 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:26.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0ceffd640 1 --2- 172.21.15.177:0/3850998671 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0bc003a70 0x7fd0d00b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:26.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0c67fc640 1 --2- 172.21.15.177:0/3850998671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0d015f7a0 0x7fd0d015e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:26.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0cf7fe640 1 -- 172.21.15.177:0/3850998671 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0bc003a70 msgr2=0x7fd0d00b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:26.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0cf7fe640 1 --2- 172.21.15.177:0/3850998671 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0bc003a70 0x7fd0d00b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:26.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0cf7fe640 1 -- 172.21.15.177:0/3850998671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0d015f7a0 msgr2=0x7fd0d015e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:26.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0cf7fe640 1 --2- 172.21.15.177:0/3850998671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0d015f7a0 0x7fd0d015e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:26.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0cf7fe640 1 -- 172.21.15.177:0/3850998671 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d015ecc0 con 0x7fd0d01f5980 2023-11-28T20:10:26.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0cf7fe640 1 --2- 172.21.15.177:0/3850998671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d01f5980 0x7fd0d0070fb0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd0d006b510 tx=0x7fd0c8011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:26.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0c7fff640 1 -- 172.21.15.177:0/3850998671 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8004440 con 0x7fd0d01f5980 2023-11-28T20:10:26.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0c7fff640 1 -- 172.21.15.177:0/3850998671 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c8003620 con 0x7fd0d01f5980 2023-11-28T20:10:26.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0c7fff640 1 -- 172.21.15.177:0/3850998671 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8003a10 con 0x7fd0d01f5980 2023-11-28T20:10:26.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0d5479640 1 -- 172.21.15.177:0/3850998671 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d015efa0 con 0x7fd0d01f5980 2023-11-28T20:10:26.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0d5479640 1 -- 172.21.15.177:0/3850998671 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d01f5e00 con 0x7fd0d01f5980 2023-11-28T20:10:26.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0d5479640 1 -- 172.21.15.177:0/3850998671 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd0d015eb50 con 0x7fd0d01f5980 2023-11-28T20:10:26.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.860+0000 7fd0c7fff640 1 -- 172.21.15.177:0/3850998671 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd0c8003b70 con 0x7fd0d01f5980 2023-11-28T20:10:26.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.864+0000 7fd0c7fff640 1 --2- 172.21.15.177:0/3850998671 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd0b0066470 0x7fd0b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:26.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.864+0000 7fd0c7fff640 1 -- 172.21.15.177:0/3850998671 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd0c8083dd0 con 0x7fd0d01f5980 2023-11-28T20:10:26.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.864+0000 7fd0c7fff640 1 --2- 172.21.15.177:0/3850998671 >> [v2:172.21.15.177:6800/3095629541,v1:172.21.15.177:6801/3095629541] conn(0x7fd0b006c2d0 0x7fd0b006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:26.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.864+0000 7fd0c7fff640 1 -- 172.21.15.177:0/3850998671 --> [v2:172.21.15.177:6800/3095629541,v1:172.21.15.177:6801/3095629541] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd0b006eda0 con 0x7fd0b006c2d0 2023-11-28T20:10:26.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.864+0000 7fd0ceffd640 1 --2- 172.21.15.177:0/3850998671 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd0b0066470 0x7fd0b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:26.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.864+0000 7fd0c7fff640 1 -- 172.21.15.177:0/3850998671 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0c8087020 con 0x7fd0d01f5980 2023-11-28T20:10:26.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.864+0000 7fd0c67fc640 1 --2- 172.21.15.177:0/3850998671 >> [v2:172.21.15.177:6800/3095629541,v1:172.21.15.177:6801/3095629541] conn(0x7fd0b006c2d0 0x7fd0b006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:26.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.864+0000 7fd0ceffd640 1 --2- 172.21.15.177:0/3850998671 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd0b0066470 0x7fd0b0068930 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00ad000 tx=0x7fd0c0001d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:26.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.864+0000 7fd0c67fc640 1 --2- 172.21.15.177:0/3850998671 >> [v2:172.21.15.177:6800/3095629541,v1:172.21.15.177:6801/3095629541] conn(0x7fd0b006c2d0 0x7fd0b006e6f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:26.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.864+0000 7fd0c7fff640 1 -- 172.21.15.177:0/3850998671 <== osd.0 v2:172.21.15.177:6800/3095629541 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd0b006eda0 con 0x7fd0b006c2d0 2023-11-28T20:10:26.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.876+0000 7fd0d5479640 1 -- 172.21.15.177:0/3850998671 --> [v2:172.21.15.177:6800/3095629541,v1:172.21.15.177:6801/3095629541] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd0d00ae8f0 con 0x7fd0b006c2d0 2023-11-28T20:10:26.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.876+0000 7fd0c7fff640 1 -- 172.21.15.177:0/3850998671 <== osd.0 v2:172.21.15.177:6800/3095629541 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd0b8009c10 con 0x7fd0b006c2d0 2023-11-28T20:10:26.882 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:10:26.882 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:10:26.883 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:10:26.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.876+0000 7fd0d5479640 1 -- 172.21.15.177:0/3850998671 >> [v2:172.21.15.177:6800/3095629541,v1:172.21.15.177:6801/3095629541] conn(0x7fd0b006c2d0 msgr2=0x7fd0b006e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:26.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.876+0000 7fd0d5479640 1 --2- 172.21.15.177:0/3850998671 >> [v2:172.21.15.177:6800/3095629541,v1:172.21.15.177:6801/3095629541] conn(0x7fd0b006c2d0 0x7fd0b006e6f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:26.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.876+0000 7fd0d5479640 1 -- 172.21.15.177:0/3850998671 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd0b0066470 msgr2=0x7fd0b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:26.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.876+0000 7fd0d5479640 1 --2- 172.21.15.177:0/3850998671 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fd0b0066470 0x7fd0b0068930 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00ad000 tx=0x7fd0c0001d90 comp rx=0 tx=0).stop 2023-11-28T20:10:26.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.880+0000 7fd0d5479640 1 -- 172.21.15.177:0/3850998671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d01f5980 msgr2=0x7fd0d0070fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:26.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.880+0000 7fd0d5479640 1 --2- 172.21.15.177:0/3850998671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d01f5980 0x7fd0d0070fb0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd0d006b510 tx=0x7fd0c8011920 comp rx=0 tx=0).stop 2023-11-28T20:10:26.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.880+0000 7fd0cf7fe640 1 -- 172.21.15.177:0/3850998671 reap_dead start 2023-11-28T20:10:26.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.880+0000 7fd0d5479640 1 -- 172.21.15.177:0/3850998671 shutdown_connections 2023-11-28T20:10:26.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.880+0000 7fd0d5479640 1 -- 172.21.15.177:0/3850998671 >> 172.21.15.177:0/3850998671 conn(0x7fd0d00b0c50 msgr2=0x7fd0d0150980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:26.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.880+0000 7fd0d5479640 1 -- 172.21.15.177:0/3850998671 shutdown_connections 2023-11-28T20:10:26.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:26.880+0000 7fd0d5479640 1 -- 172.21.15.177:0/3850998671 wait complete. 2023-11-28T20:10:26.900 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-28T20:10:27.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.032+0000 7f0134b01640 1 Processor -- start 2023-11-28T20:10:27.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.032+0000 7f0134b01640 1 -- start start 2023-11-28T20:10:27.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.036+0000 7f0134b01640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f013006d190 0x7f013015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.036+0000 7f0134b01640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0130070460 con 0x7f0130150960 2023-11-28T20:10:27.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.036+0000 7f0134b01640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013015ab20 con 0x7f013006cdb0 2023-11-28T20:10:27.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.036+0000 7f0134b01640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0130070690 con 0x7f013006d190 2023-11-28T20:10:27.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.036+0000 7f0125d9b640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f0130150960 0x7f0130159da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47108/0 (socket says 172.21.15.177:47108) 2023-11-28T20:10:27.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.036+0000 7f0125d9b640 1 -- 172.21.15.177:0/667357501 learned_addr learned my addr 172.21.15.177:0/667357501 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:27.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.036+0000 7f012ed9d640 1 --2- 172.21.15.177:0/667357501 >> v2:172.21.15.177:3300/0 conn(0x7f013006d190 0x7f013015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.036+0000 7f012dd9b640 1 -- 172.21.15.177:0/667357501 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208915648 0 0) 0x7f0130070460 con 0x7f0130150960 2023-11-28T20:10:27.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.036+0000 7f012dd9b640 1 -- 172.21.15.177:0/667357501 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f011c003530 con 0x7f0130150960 2023-11-28T20:10:27.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.036+0000 7f012ed9d640 1 -- 172.21.15.177:0/667357501 >> v1:172.21.15.195:6789/0 conn(0x7f013006cdb0 legacy=0x7f0130150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.036+0000 7f012ed9d640 1 -- 172.21.15.177:0/667357501 >> v1:172.21.15.177:6789/0 conn(0x7f0130150960 legacy=0x7f0130159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.036+0000 7f012ed9d640 1 -- 172.21.15.177:0/667357501 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130070970 con 0x7f013006d190 2023-11-28T20:10:27.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.040+0000 7f012ed9d640 1 --2- 172.21.15.177:0/667357501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f013006d190 0x7f013015a4b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f01280097c0 tx=0x7f012801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1423b334970600fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:27.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.040+0000 7f012dd9b640 1 -- 172.21.15.177:0/667357501 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01280ab600 con 0x7f013006d190 2023-11-28T20:10:27.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.040+0000 7f012dd9b640 1 -- 172.21.15.177:0/667357501 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01280a7050 con 0x7f013006d190 2023-11-28T20:10:27.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.040+0000 7f012dd9b640 1 -- 172.21.15.177:0/667357501 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01280ab980 con 0x7f013006d190 2023-11-28T20:10:27.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.040+0000 7f0134b01640 1 -- 172.21.15.177:0/667357501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f013006d190 msgr2=0x7f013015a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.040+0000 7f0134b01640 1 --2- 172.21.15.177:0/667357501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f013006d190 0x7f013015a4b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f01280097c0 tx=0x7f012801c480 comp rx=0 tx=0).stop 2023-11-28T20:10:27.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.040+0000 7f0134b01640 1 -- 172.21.15.177:0/667357501 shutdown_connections 2023-11-28T20:10:27.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.040+0000 7f0134b01640 1 --2- 172.21.15.177:0/667357501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f013006d190 0x7f013015a4b0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.040+0000 7f0134b01640 1 -- 172.21.15.177:0/667357501 >> 172.21.15.177:0/667357501 conn(0x7f013006a530 msgr2=0x7f013006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:27.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.040+0000 7f0134b01640 1 -- 172.21.15.177:0/667357501 shutdown_connections 2023-11-28T20:10:27.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.040+0000 7f0134b01640 1 -- 172.21.15.177:0/667357501 wait complete. 2023-11-28T20:10:27.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.040+0000 7f0134b01640 1 Processor -- start 2023-11-28T20:10:27.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.040+0000 7f0134b01640 1 -- start start 2023-11-28T20:10:27.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0134b01640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f013006cdb0 0x7f01301458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0134b01640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f013006d190 0x7f013014adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0134b01640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0130150960 0x7f01301494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0134b01640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013014a920 con 0x7f013006d190 2023-11-28T20:10:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0134b01640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013014b2f0 con 0x7f0130150960 2023-11-28T20:10:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0134b01640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0130149d10 con 0x7f013006cdb0 2023-11-28T20:10:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0125d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f013006d190 0x7f013014adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0125d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f013006d190 0x7f013014adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59868/0 (socket says 172.21.15.177:59868) 2023-11-28T20:10:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0125d9b640 1 -- 172.21.15.177:0/13580673 learned_addr learned my addr 172.21.15.177:0/13580673 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f012ed9d640 1 --2- 172.21.15.177:0/13580673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0130150960 0x7f01301494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f012e59c640 1 --2- 172.21.15.177:0/13580673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f013006cdb0 0x7f01301458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0125d9b640 1 -- 172.21.15.177:0/13580673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f013006cdb0 msgr2=0x7f01301458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0125d9b640 1 --2- 172.21.15.177:0/13580673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f013006cdb0 0x7f01301458c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0125d9b640 1 -- 172.21.15.177:0/13580673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0130150960 msgr2=0x7f01301494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0125d9b640 1 --2- 172.21.15.177:0/13580673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0130150960 0x7f01301494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0125d9b640 1 -- 172.21.15.177:0/13580673 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0128009420 con 0x7f013006d190 2023-11-28T20:10:27.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f012e59c640 1 --2- 172.21.15.177:0/13580673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f013006cdb0 0x7f01301458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:27.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0125d9b640 1 --2- 172.21.15.177:0/13580673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f013006d190 0x7f013014adb0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f011800cbb0 tx=0x7f011800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:27.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f01277fe640 1 -- 172.21.15.177:0/13580673 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011800ad40 con 0x7f013006d190 2023-11-28T20:10:27.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f01277fe640 1 -- 172.21.15.177:0/13580673 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0118012400 con 0x7f013006d190 2023-11-28T20:10:27.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0134b01640 1 -- 172.21.15.177:0/13580673 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0130149ff0 con 0x7f013006d190 2023-11-28T20:10:27.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f01277fe640 1 -- 172.21.15.177:0/13580673 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011800aea0 con 0x7f013006d190 2023-11-28T20:10:27.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0134b01640 1 -- 172.21.15.177:0/13580673 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013014a5b0 con 0x7f013006d190 2023-11-28T20:10:27.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f0134b01640 1 -- 172.21.15.177:0/13580673 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0130069440 con 0x7f013006d190 2023-11-28T20:10:27.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.044+0000 7f01277fe640 1 -- 172.21.15.177:0/13580673 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f01180127b0 con 0x7f013006d190 2023-11-28T20:10:27.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.048+0000 7f01277fe640 1 --2- 172.21.15.177:0/13580673 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0110066470 0x7f0110068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.048+0000 7f01277fe640 1 -- 172.21.15.177:0/13580673 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0118083a70 con 0x7f013006d190 2023-11-28T20:10:27.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.048+0000 7f012e59c640 1 --2- 172.21.15.177:0/13580673 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0110066470 0x7f0110068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.048+0000 7f012e59c640 1 --2- 172.21.15.177:0/13580673 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0110066470 0x7f0110068930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f01301462f0 tx=0x7f0120009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:27.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.052+0000 7f01277fe640 1 -- 172.21.15.177:0/13580673 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f01180512a0 con 0x7f013006d190 2023-11-28T20:10:27.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.200+0000 7f0134b01640 1 -- 172.21.15.177:0/13580673 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f013014aa60 con 0x7f0110066470 2023-11-28T20:10:27.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.200+0000 7f01277fe640 1 -- 172.21.15.177:0/13580673 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f013014aa60 con 0x7f0110066470 2023-11-28T20:10:27.204 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 0 to deep-scrub 2023-11-28T20:10:27.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.200+0000 7f0134b01640 1 -- 172.21.15.177:0/13580673 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0110066470 msgr2=0x7f0110068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.200+0000 7f0134b01640 1 --2- 172.21.15.177:0/13580673 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0110066470 0x7f0110068930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f01301462f0 tx=0x7f0120009040 comp rx=0 tx=0).stop 2023-11-28T20:10:27.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.200+0000 7f0134b01640 1 -- 172.21.15.177:0/13580673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f013006d190 msgr2=0x7f013014adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.200+0000 7f0134b01640 1 --2- 172.21.15.177:0/13580673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f013006d190 0x7f013014adb0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f011800cbb0 tx=0x7f011800a430 comp rx=0 tx=0).stop 2023-11-28T20:10:27.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.200+0000 7f0134b01640 1 -- 172.21.15.177:0/13580673 shutdown_connections 2023-11-28T20:10:27.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.200+0000 7f0134b01640 1 --2- 172.21.15.177:0/13580673 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0110066470 0x7f0110068930 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.200+0000 7f0134b01640 1 --2- 172.21.15.177:0/13580673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0130150960 0x7f01301494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.200+0000 7f0134b01640 1 --2- 172.21.15.177:0/13580673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f013006d190 0x7f013014adb0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.200+0000 7f0134b01640 1 --2- 172.21.15.177:0/13580673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f013006cdb0 0x7f01301458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.200+0000 7f0134b01640 1 -- 172.21.15.177:0/13580673 >> 172.21.15.177:0/13580673 conn(0x7f013006a530 msgr2=0x7f01301488b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:27.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.200+0000 7f0134b01640 1 -- 172.21.15.177:0/13580673 shutdown_connections 2023-11-28T20:10:27.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.200+0000 7f0134b01640 1 -- 172.21.15.177:0/13580673 wait complete. 2023-11-28T20:10:27.229 INFO:tasks.ceph:Scrubbing osd.1 2023-11-28T20:10:27.229 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:10:27.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.364+0000 7f739dac9640 1 Processor -- start 2023-11-28T20:10:27.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f739dac9640 1 -- start start 2023-11-28T20:10:27.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f739dac9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f73980ae620 0x7f73980ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f739dac9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f739806d6f0 0x7f739806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f739dac9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73980ce370 con 0x7f739815a480 2023-11-28T20:10:27.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f739dac9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73980cd570 con 0x7f73980ae620 2023-11-28T20:10:27.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f739dac9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739806e060 con 0x7f739806d6f0 2023-11-28T20:10:27.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f73977fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f739815a480 0x7f73980cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47124/0 (socket says 172.21.15.177:47124) 2023-11-28T20:10:27.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f73977fe640 1 -- 172.21.15.177:0/3079575878 learned_addr learned my addr 172.21.15.177:0/3079575878 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:27.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f738ffff640 1 --2- 172.21.15.177:0/3079575878 >> v2:172.21.15.177:3300/0 conn(0x7f73980ae620 0x7f73980ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f7397fff640 1 --2- 172.21.15.177:0/3079575878 >> v2:172.21.15.195:3300/0 conn(0x7f739806d6f0 0x7f739806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f7396ffd640 1 -- 172.21.15.177:0/3079575878 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405865784 0 0) 0x7f73980ce370 con 0x7f739815a480 2023-11-28T20:10:27.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f7396ffd640 1 -- 172.21.15.177:0/3079575878 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7384003530 con 0x7f739815a480 2023-11-28T20:10:27.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f738ffff640 1 -- 172.21.15.177:0/3079575878 >> v2:172.21.15.195:3300/0 conn(0x7f739806d6f0 msgr2=0x7f739806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:27.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f738ffff640 1 --2- 172.21.15.177:0/3079575878 >> v2:172.21.15.195:3300/0 conn(0x7f739806d6f0 0x7f739806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f738ffff640 1 -- 172.21.15.177:0/3079575878 >> v1:172.21.15.177:6789/0 conn(0x7f739815a480 legacy=0x7f73980cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f738ffff640 1 -- 172.21.15.177:0/3079575878 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73980cd760 con 0x7f73980ae620 2023-11-28T20:10:27.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.368+0000 7f7397fff640 1 --2- 172.21.15.177:0/3079575878 >> v2:172.21.15.195:3300/0 conn(0x7f739806d6f0 0x7f739806db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:10:27.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.372+0000 7f738ffff640 1 --2- 172.21.15.177:0/3079575878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73980ae620 0x7f73980ce800 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f739806be60 tx=0x7f738001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52abc9bfce1c43d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:27.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.372+0000 7f7396ffd640 1 -- 172.21.15.177:0/3079575878 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800ab660 con 0x7f73980ae620 2023-11-28T20:10:27.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.372+0000 7f7396ffd640 1 -- 172.21.15.177:0/3079575878 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73800ab7c0 con 0x7f73980ae620 2023-11-28T20:10:27.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.372+0000 7f7396ffd640 1 -- 172.21.15.177:0/3079575878 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800abb50 con 0x7f73980ae620 2023-11-28T20:10:27.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.372+0000 7f739dac9640 1 -- 172.21.15.177:0/3079575878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73980ae620 msgr2=0x7f73980ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.372+0000 7f739dac9640 1 --2- 172.21.15.177:0/3079575878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73980ae620 0x7f73980ce800 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f739806be60 tx=0x7f738001c460 comp rx=0 tx=0).stop 2023-11-28T20:10:27.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.372+0000 7f739dac9640 1 -- 172.21.15.177:0/3079575878 shutdown_connections 2023-11-28T20:10:27.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.372+0000 7f739dac9640 1 --2- 172.21.15.177:0/3079575878 >> v2:172.21.15.195:3300/0 conn(0x7f739806d6f0 0x7f739806db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.372+0000 7f739dac9640 1 --2- 172.21.15.177:0/3079575878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73980ae620 0x7f73980ce800 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.372+0000 7f739dac9640 1 -- 172.21.15.177:0/3079575878 >> 172.21.15.177:0/3079575878 conn(0x7f73980b0c50 msgr2=0x7f73980b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:27.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.372+0000 7f739dac9640 1 -- 172.21.15.177:0/3079575878 shutdown_connections 2023-11-28T20:10:27.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.372+0000 7f739dac9640 1 -- 172.21.15.177:0/3079575878 wait complete. 2023-11-28T20:10:27.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.372+0000 7f739dac9640 1 Processor -- start 2023-11-28T20:10:27.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f739dac9640 1 -- start start 2023-11-28T20:10:27.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f739dac9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f739806d6f0 0x7f739814e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f739dac9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73980ae620 0x7f7398099e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f739dac9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f739815a480 0x7f73980b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f739dac9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73980b2190 con 0x7f73980ae620 2023-11-28T20:10:27.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f739dac9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73980b2470 con 0x7f739806d6f0 2023-11-28T20:10:27.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f739dac9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73980b2750 con 0x7f739815a480 2023-11-28T20:10:27.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f738ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73980ae620 0x7f7398099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f738ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73980ae620 0x7f7398099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59894/0 (socket says 172.21.15.177:59894) 2023-11-28T20:10:27.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f738ffff640 1 -- 172.21.15.177:0/1841855926 learned_addr learned my addr 172.21.15.177:0/1841855926 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:27.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f73977fe640 1 --2- 172.21.15.177:0/1841855926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f739806d6f0 0x7f739814e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f7397fff640 1 --2- 172.21.15.177:0/1841855926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f739815a480 0x7f73980b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f738ffff640 1 -- 172.21.15.177:0/1841855926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f739815a480 msgr2=0x7f73980b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f738ffff640 1 --2- 172.21.15.177:0/1841855926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f739815a480 0x7f73980b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f738ffff640 1 -- 172.21.15.177:0/1841855926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f739806d6f0 msgr2=0x7f739814e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f738ffff640 1 --2- 172.21.15.177:0/1841855926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f739806d6f0 0x7f739814e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f738ffff640 1 -- 172.21.15.177:0/1841855926 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7390009a70 con 0x7f73980ae620 2023-11-28T20:10:27.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f7397fff640 1 --2- 172.21.15.177:0/1841855926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f739815a480 0x7f73980b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:27.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f738ffff640 1 --2- 172.21.15.177:0/1841855926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73980ae620 0x7f7398099e90 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7380019070 tx=0x7f738001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:27.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f7394ff9640 1 -- 172.21.15.177:0/1841855926 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800bf610 con 0x7f73980ae620 2023-11-28T20:10:27.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f7394ff9640 1 -- 172.21.15.177:0/1841855926 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73800bf770 con 0x7f73980ae620 2023-11-28T20:10:27.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f739dac9640 1 -- 172.21.15.177:0/1841855926 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7380009420 con 0x7f73980ae620 2023-11-28T20:10:27.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f7394ff9640 1 -- 172.21.15.177:0/1841855926 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800bfb20 con 0x7f73980ae620 2023-11-28T20:10:27.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f739dac9640 1 -- 172.21.15.177:0/1841855926 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739814ed90 con 0x7f73980ae620 2023-11-28T20:10:27.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.376+0000 7f739dac9640 1 -- 172.21.15.177:0/1841855926 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f73980ae3a0 con 0x7f73980ae620 2023-11-28T20:10:27.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.380+0000 7f7394ff9640 1 -- 172.21.15.177:0/1841855926 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f73800a9070 con 0x7f73980ae620 2023-11-28T20:10:27.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.380+0000 7f7394ff9640 1 --2- 172.21.15.177:0/1841855926 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7378066470 0x7f7378068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.380+0000 7f7394ff9640 1 -- 172.21.15.177:0/1841855926 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f738011e280 con 0x7f73980ae620 2023-11-28T20:10:27.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.380+0000 7f73977fe640 1 --2- 172.21.15.177:0/1841855926 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7378066470 0x7f7378068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.380+0000 7f7394ff9640 1 --2- 172.21.15.177:0/1841855926 >> [v2:172.21.15.177:6824/1722845469,v1:172.21.15.177:6825/1722845469] conn(0x7f737806c2d0 0x7f737806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.380+0000 7f7394ff9640 1 -- 172.21.15.177:0/1841855926 --> [v2:172.21.15.177:6824/1722845469,v1:172.21.15.177:6825/1722845469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f737806eda0 con 0x7f737806c2d0 2023-11-28T20:10:27.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.380+0000 7f7394ff9640 1 -- 172.21.15.177:0/1841855926 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7380120860 con 0x7f73980ae620 2023-11-28T20:10:27.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.380+0000 7f7397fff640 1 --2- 172.21.15.177:0/1841855926 >> [v2:172.21.15.177:6824/1722845469,v1:172.21.15.177:6825/1722845469] conn(0x7f737806c2d0 0x7f737806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.380+0000 7f73977fe640 1 --2- 172.21.15.177:0/1841855926 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7378066470 0x7f7378068930 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f73880011f0 tx=0x7f7388009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:27.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.380+0000 7f7397fff640 1 --2- 172.21.15.177:0/1841855926 >> [v2:172.21.15.177:6824/1722845469,v1:172.21.15.177:6825/1722845469] conn(0x7f737806c2d0 0x7f737806e6f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:27.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.380+0000 7f7394ff9640 1 -- 172.21.15.177:0/1841855926 <== osd.1 v2:172.21.15.177:6824/1722845469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f737806eda0 con 0x7f737806c2d0 2023-11-28T20:10:27.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.392+0000 7f739dac9640 1 -- 172.21.15.177:0/1841855926 --> [v2:172.21.15.177:6824/1722845469,v1:172.21.15.177:6825/1722845469] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f739804e850 con 0x7f737806c2d0 2023-11-28T20:10:27.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.392+0000 7f7394ff9640 1 -- 172.21.15.177:0/1841855926 <== osd.1 v2:172.21.15.177:6824/1722845469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f739804e850 con 0x7f737806c2d0 2023-11-28T20:10:27.398 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:10:27.398 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:10:27.398 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:10:27.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.392+0000 7f739dac9640 1 -- 172.21.15.177:0/1841855926 >> [v2:172.21.15.177:6824/1722845469,v1:172.21.15.177:6825/1722845469] conn(0x7f737806c2d0 msgr2=0x7f737806e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.392+0000 7f739dac9640 1 --2- 172.21.15.177:0/1841855926 >> [v2:172.21.15.177:6824/1722845469,v1:172.21.15.177:6825/1722845469] conn(0x7f737806c2d0 0x7f737806e6f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.396+0000 7f739dac9640 1 -- 172.21.15.177:0/1841855926 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7378066470 msgr2=0x7f7378068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.396+0000 7f739dac9640 1 --2- 172.21.15.177:0/1841855926 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f7378066470 0x7f7378068930 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f73880011f0 tx=0x7f7388009040 comp rx=0 tx=0).stop 2023-11-28T20:10:27.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.396+0000 7f739dac9640 1 -- 172.21.15.177:0/1841855926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73980ae620 msgr2=0x7f7398099e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.396+0000 7f739dac9640 1 --2- 172.21.15.177:0/1841855926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73980ae620 0x7f7398099e90 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7380019070 tx=0x7f738001aca0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.396+0000 7f7397fff640 1 -- 172.21.15.177:0/1841855926 reap_dead start 2023-11-28T20:10:27.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.396+0000 7f739dac9640 1 -- 172.21.15.177:0/1841855926 shutdown_connections 2023-11-28T20:10:27.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.396+0000 7f739dac9640 1 -- 172.21.15.177:0/1841855926 >> 172.21.15.177:0/1841855926 conn(0x7f73980b0c50 msgr2=0x7f73980b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:27.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.396+0000 7f739dac9640 1 -- 172.21.15.177:0/1841855926 shutdown_connections 2023-11-28T20:10:27.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.396+0000 7f739dac9640 1 -- 172.21.15.177:0/1841855926 wait complete. 2023-11-28T20:10:27.416 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-28T20:10:27.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.552+0000 7fa372f2a640 1 Processor -- start 2023-11-28T20:10:27.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.552+0000 7fa372f2a640 1 -- start start 2023-11-28T20:10:27.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.556+0000 7fa372f2a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa36c15d3b0 0x7fa36c0ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.556+0000 7fa372f2a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa36c0af8b0 0x7fa36c0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.556+0000 7fa372f2a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa36c0adfb0 con 0x7fa36c071fd0 2023-11-28T20:10:27.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.556+0000 7fa372f2a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa36c0aeb30 con 0x7fa36c15d3b0 2023-11-28T20:10:27.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.556+0000 7fa372f2a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c0ae290 con 0x7fa36c0af8b0 2023-11-28T20:10:27.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.556+0000 7fa370cc6640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa36c15d3b0 0x7fa36c0ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.556+0000 7fa36bfff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fa36c071fd0 0x7fa36c0af1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47140/0 (socket says 172.21.15.177:47140) 2023-11-28T20:10:27.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.556+0000 7fa36bfff640 1 -- 172.21.15.177:0/4162346355 learned_addr learned my addr 172.21.15.177:0/4162346355 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:27.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.556+0000 7fa3714c7640 1 --2- 172.21.15.177:0/4162346355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa36c0af8b0 0x7fa36c0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.556+0000 7fa370cc6640 1 -- 172.21.15.177:0/4162346355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa36c0af8b0 msgr2=0x7fa36c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:27.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.556+0000 7fa370cc6640 1 --2- 172.21.15.177:0/4162346355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa36c0af8b0 0x7fa36c0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.556+0000 7fa370cc6640 1 -- 172.21.15.177:0/4162346355 >> v1:172.21.15.177:6789/0 conn(0x7fa36c071fd0 legacy=0x7fa36c0af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.556+0000 7fa370cc6640 1 -- 172.21.15.177:0/4162346355 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c0ae570 con 0x7fa36c15d3b0 2023-11-28T20:10:27.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.560+0000 7fa370cc6640 1 --2- 172.21.15.177:0/4162346355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36c15d3b0 0x7fa36c0ad6a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa3600097c0 tx=0x7fa36001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28eb53d4bfeca632 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:27.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.560+0000 7fa36b7fe640 1 -- 172.21.15.177:0/4162346355 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3600a8970 con 0x7fa36c15d3b0 2023-11-28T20:10:27.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.560+0000 7fa36b7fe640 1 -- 172.21.15.177:0/4162346355 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3600a8ad0 con 0x7fa36c15d3b0 2023-11-28T20:10:27.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.560+0000 7fa36b7fe640 1 -- 172.21.15.177:0/4162346355 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3600a8e60 con 0x7fa36c15d3b0 2023-11-28T20:10:27.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.560+0000 7fa372f2a640 1 -- 172.21.15.177:0/4162346355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36c15d3b0 msgr2=0x7fa36c0ad6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.560+0000 7fa372f2a640 1 --2- 172.21.15.177:0/4162346355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36c15d3b0 0x7fa36c0ad6a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa3600097c0 tx=0x7fa36001ec70 comp rx=0 tx=0).stop 2023-11-28T20:10:27.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.560+0000 7fa372f2a640 1 -- 172.21.15.177:0/4162346355 shutdown_connections 2023-11-28T20:10:27.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.560+0000 7fa372f2a640 1 --2- 172.21.15.177:0/4162346355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa36c0af8b0 0x7fa36c0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.560+0000 7fa372f2a640 1 --2- 172.21.15.177:0/4162346355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36c15d3b0 0x7fa36c0ad6a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.560+0000 7fa372f2a640 1 -- 172.21.15.177:0/4162346355 >> 172.21.15.177:0/4162346355 conn(0x7fa36c06b640 msgr2=0x7fa36c06ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:27.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.560+0000 7fa372f2a640 1 -- 172.21.15.177:0/4162346355 shutdown_connections 2023-11-28T20:10:27.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.560+0000 7fa372f2a640 1 -- 172.21.15.177:0/4162346355 wait complete. 2023-11-28T20:10:27.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.560+0000 7fa372f2a640 1 Processor -- start 2023-11-28T20:10:27.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.560+0000 7fa372f2a640 1 -- start start 2023-11-28T20:10:27.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa372f2a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36c071fd0 0x7fa36c0c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa372f2a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa36c0af8b0 0x7fa36c15e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa372f2a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa36c15d3b0 0x7fa36c1f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa372f2a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c15e860 con 0x7fa36c071fd0 2023-11-28T20:10:27.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa372f2a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c1f2920 con 0x7fa36c15d3b0 2023-11-28T20:10:27.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa372f2a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c0c56a0 con 0x7fa36c0af8b0 2023-11-28T20:10:27.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa370cc6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36c071fd0 0x7fa36c0c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa370cc6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36c071fd0 0x7fa36c0c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59914/0 (socket says 172.21.15.177:59914) 2023-11-28T20:10:27.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa370cc6640 1 -- 172.21.15.177:0/2841158065 learned_addr learned my addr 172.21.15.177:0/2841158065 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:27.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa36bfff640 1 --2- 172.21.15.177:0/2841158065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa36c0af8b0 0x7fa36c15e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa3714c7640 1 --2- 172.21.15.177:0/2841158065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa36c15d3b0 0x7fa36c1f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa370cc6640 1 -- 172.21.15.177:0/2841158065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa36c0af8b0 msgr2=0x7fa36c15e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa370cc6640 1 --2- 172.21.15.177:0/2841158065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa36c0af8b0 0x7fa36c15e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa370cc6640 1 -- 172.21.15.177:0/2841158065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa36c15d3b0 msgr2=0x7fa36c1f23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa370cc6640 1 --2- 172.21.15.177:0/2841158065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa36c15d3b0 0x7fa36c1f23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa370cc6640 1 -- 172.21.15.177:0/2841158065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa360009420 con 0x7fa36c071fd0 2023-11-28T20:10:27.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa370cc6640 1 --2- 172.21.15.177:0/2841158065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36c071fd0 0x7fa36c0c5050 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa3600b3040 tx=0x7fa36001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:27.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa3697fa640 1 -- 172.21.15.177:0/2841158065 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3600b9630 con 0x7fa36c071fd0 2023-11-28T20:10:27.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa3697fa640 1 -- 172.21.15.177:0/2841158065 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3600b97b0 con 0x7fa36c071fd0 2023-11-28T20:10:27.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa3697fa640 1 -- 172.21.15.177:0/2841158065 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3600b9b60 con 0x7fa36c071fd0 2023-11-28T20:10:27.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa372f2a640 1 -- 172.21.15.177:0/2841158065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36c0c5980 con 0x7fa36c071fd0 2023-11-28T20:10:27.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa372f2a640 1 -- 172.21.15.177:0/2841158065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36c0c5f40 con 0x7fa36c071fd0 2023-11-28T20:10:27.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.564+0000 7fa372f2a640 1 -- 172.21.15.177:0/2841158065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36c069440 con 0x7fa36c071fd0 2023-11-28T20:10:27.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.568+0000 7fa3697fa640 1 -- 172.21.15.177:0/2841158065 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa3600b7040 con 0x7fa36c071fd0 2023-11-28T20:10:27.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.568+0000 7fa3697fa640 1 --2- 172.21.15.177:0/2841158065 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa350066470 0x7fa350068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.568+0000 7fa3697fa640 1 -- 172.21.15.177:0/2841158065 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa360121870 con 0x7fa36c071fd0 2023-11-28T20:10:27.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.568+0000 7fa36bfff640 1 --2- 172.21.15.177:0/2841158065 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa350066470 0x7fa350068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.568+0000 7fa36bfff640 1 --2- 172.21.15.177:0/2841158065 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa350066470 0x7fa350068930 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa36c15d0d0 tx=0x7fa358009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:27.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.572+0000 7fa3697fa640 1 -- 172.21.15.177:0/2841158065 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3600ef250 con 0x7fa36c071fd0 2023-11-28T20:10:27.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.724+0000 7fa372f2a640 1 -- 172.21.15.177:0/2841158065 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa36c15d790 con 0x7fa350066470 2023-11-28T20:10:27.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.724+0000 7fa3697fa640 1 -- 172.21.15.177:0/2841158065 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa358001510 con 0x7fa350066470 2023-11-28T20:10:27.728 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 1 to deep-scrub 2023-11-28T20:10:27.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.724+0000 7fa372f2a640 1 -- 172.21.15.177:0/2841158065 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa350066470 msgr2=0x7fa350068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.724+0000 7fa372f2a640 1 --2- 172.21.15.177:0/2841158065 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa350066470 0x7fa350068930 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa36c15d0d0 tx=0x7fa358009040 comp rx=0 tx=0).stop 2023-11-28T20:10:27.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.724+0000 7fa372f2a640 1 -- 172.21.15.177:0/2841158065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36c071fd0 msgr2=0x7fa36c0c5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.724+0000 7fa372f2a640 1 --2- 172.21.15.177:0/2841158065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36c071fd0 0x7fa36c0c5050 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa3600b3040 tx=0x7fa36001ba10 comp rx=0 tx=0).stop 2023-11-28T20:10:27.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.724+0000 7fa372f2a640 1 -- 172.21.15.177:0/2841158065 shutdown_connections 2023-11-28T20:10:27.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.724+0000 7fa372f2a640 1 --2- 172.21.15.177:0/2841158065 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fa350066470 0x7fa350068930 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.724+0000 7fa372f2a640 1 --2- 172.21.15.177:0/2841158065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa36c15d3b0 0x7fa36c1f23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.724+0000 7fa372f2a640 1 --2- 172.21.15.177:0/2841158065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa36c0af8b0 0x7fa36c15e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.724+0000 7fa372f2a640 1 --2- 172.21.15.177:0/2841158065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36c071fd0 0x7fa36c0c5050 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.724+0000 7fa372f2a640 1 -- 172.21.15.177:0/2841158065 >> 172.21.15.177:0/2841158065 conn(0x7fa36c06b640 msgr2=0x7fa36c15bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:27.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.724+0000 7fa372f2a640 1 -- 172.21.15.177:0/2841158065 shutdown_connections 2023-11-28T20:10:27.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.724+0000 7fa372f2a640 1 -- 172.21.15.177:0/2841158065 wait complete. 2023-11-28T20:10:27.749 INFO:tasks.ceph:Scrubbing osd.2 2023-11-28T20:10:27.749 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:10:27.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.884+0000 7f6086148640 1 Processor -- start 2023-11-28T20:10:27.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.888+0000 7f6086148640 1 -- start start 2023-11-28T20:10:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.888+0000 7f6086148640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f608015e750 0x7f60800cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.888+0000 7f6086148640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f608006f920 0x7f60800af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.888+0000 7f6086148640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60800cf310 con 0x7f60800afe80 2023-11-28T20:10:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.888+0000 7f6086148640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60800cfb20 con 0x7f608015e750 2023-11-28T20:10:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.888+0000 7f6086148640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60800cbbe0 con 0x7f608006f920 2023-11-28T20:10:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.888+0000 7f6085146640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f608015e750 0x7f60800cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.888+0000 7f6085146640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f608015e750 0x7f60800cb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59924/0 (socket says 172.21.15.177:59924) 2023-11-28T20:10:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.888+0000 7f6085146640 1 -- 172.21.15.177:0/547200802 learned_addr learned my addr 172.21.15.177:0/547200802 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.888+0000 7f6084945640 1 --2- 172.21.15.177:0/547200802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f608006f920 0x7f60800af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.888+0000 7f6085146640 1 -- 172.21.15.177:0/547200802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f608006f920 msgr2=0x7f60800af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.888+0000 7f6085146640 1 --2- 172.21.15.177:0/547200802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f608006f920 0x7f60800af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.888+0000 7f6085146640 1 -- 172.21.15.177:0/547200802 >> v1:172.21.15.195:6789/0 conn(0x7f60800afe80 legacy=0x7f608006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.888+0000 7f6085146640 1 -- 172.21.15.177:0/547200802 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608006f580 con 0x7f608015e750 2023-11-28T20:10:27.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.892+0000 7f6085146640 1 --2- 172.21.15.177:0/547200802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608015e750 0x7f60800cb6a0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f607c009870 tx=0x7f607c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b596f7fe3e8db286 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:27.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.892+0000 7f6077fff640 1 -- 172.21.15.177:0/547200802 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c0ab600 con 0x7f608015e750 2023-11-28T20:10:27.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.892+0000 7f6077fff640 1 -- 172.21.15.177:0/547200802 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607c0a7050 con 0x7f608015e750 2023-11-28T20:10:27.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.892+0000 7f6077fff640 1 -- 172.21.15.177:0/547200802 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c0ab980 con 0x7f608015e750 2023-11-28T20:10:27.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.892+0000 7f6086148640 1 -- 172.21.15.177:0/547200802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608015e750 msgr2=0x7f60800cb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.892+0000 7f6086148640 1 --2- 172.21.15.177:0/547200802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608015e750 0x7f60800cb6a0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f607c009870 tx=0x7f607c01c420 comp rx=0 tx=0).stop 2023-11-28T20:10:27.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.892+0000 7f6086148640 1 -- 172.21.15.177:0/547200802 shutdown_connections 2023-11-28T20:10:27.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.892+0000 7f6086148640 1 --2- 172.21.15.177:0/547200802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f608006f920 0x7f60800af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.892+0000 7f6086148640 1 --2- 172.21.15.177:0/547200802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608015e750 0x7f60800cb6a0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.892+0000 7f6086148640 1 -- 172.21.15.177:0/547200802 >> 172.21.15.177:0/547200802 conn(0x7f60800b2860 msgr2=0x7f60800b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:27.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.892+0000 7f6086148640 1 -- 172.21.15.177:0/547200802 shutdown_connections 2023-11-28T20:10:27.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.892+0000 7f6086148640 1 -- 172.21.15.177:0/547200802 wait complete. 2023-11-28T20:10:27.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.892+0000 7f6086148640 1 Processor -- start 2023-11-28T20:10:27.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.892+0000 7f6086148640 1 -- start start 2023-11-28T20:10:27.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6086148640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608006f920 0x7f608014baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6086148640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60800afe80 0x7f608006c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6086148640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f608015e750 0x7f6080157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6086148640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608006d0a0 con 0x7f608006f920 2023-11-28T20:10:27.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6086148640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608006cdc0 con 0x7f60800afe80 2023-11-28T20:10:27.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6086148640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608006b770 con 0x7f608015e750 2023-11-28T20:10:27.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6085146640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608006f920 0x7f608014baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6085146640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608006f920 0x7f608014baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59932/0 (socket says 172.21.15.177:59932) 2023-11-28T20:10:27.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6085146640 1 -- 172.21.15.177:0/566057435 learned_addr learned my addr 172.21.15.177:0/566057435 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:27.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6084945640 1 --2- 172.21.15.177:0/566057435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60800afe80 0x7f608006c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6085947640 1 --2- 172.21.15.177:0/566057435 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f608015e750 0x7f6080157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6085146640 1 -- 172.21.15.177:0/566057435 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f608015e750 msgr2=0x7f6080157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6085146640 1 --2- 172.21.15.177:0/566057435 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f608015e750 0x7f6080157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6085146640 1 -- 172.21.15.177:0/566057435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60800afe80 msgr2=0x7f608006c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6085146640 1 --2- 172.21.15.177:0/566057435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60800afe80 0x7f608006c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6085146640 1 -- 172.21.15.177:0/566057435 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c0094d0 con 0x7f608006f920 2023-11-28T20:10:27.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6085947640 1 --2- 172.21.15.177:0/566057435 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f608015e750 0x7f6080157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:27.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6085146640 1 --2- 172.21.15.177:0/566057435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608006f920 0x7f608014baf0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f607c0ae040 tx=0x7f607c0191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:27.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6075ffb640 1 -- 172.21.15.177:0/566057435 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c0b4440 con 0x7f608006f920 2023-11-28T20:10:27.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6075ffb640 1 -- 172.21.15.177:0/566057435 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607c0b45a0 con 0x7f608006f920 2023-11-28T20:10:27.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6075ffb640 1 -- 172.21.15.177:0/566057435 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c0b4950 con 0x7f608006f920 2023-11-28T20:10:27.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6086148640 1 -- 172.21.15.177:0/566057435 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608006ba50 con 0x7f608006f920 2023-11-28T20:10:27.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6086148640 1 -- 172.21.15.177:0/566057435 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6080157ba0 con 0x7f608006f920 2023-11-28T20:10:27.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.896+0000 7f6086148640 1 -- 172.21.15.177:0/566057435 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f608015eb30 con 0x7f608006f920 2023-11-28T20:10:27.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.900+0000 7f6075ffb640 1 -- 172.21.15.177:0/566057435 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f607c0b2070 con 0x7f608006f920 2023-11-28T20:10:27.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.900+0000 7f6075ffb640 1 --2- 172.21.15.177:0/566057435 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6064066470 0x7f6064068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.900+0000 7f6075ffb640 1 -- 172.21.15.177:0/566057435 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f607c11db30 con 0x7f608006f920 2023-11-28T20:10:27.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.900+0000 7f6084945640 1 --2- 172.21.15.177:0/566057435 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6064066470 0x7f6064068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.900+0000 7f6075ffb640 1 --2- 172.21.15.177:0/566057435 >> [v2:172.21.15.177:6816/1088546159,v1:172.21.15.177:6817/1088546159] conn(0x7f606406c2d0 0x7f606406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:27.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.900+0000 7f6075ffb640 1 -- 172.21.15.177:0/566057435 --> [v2:172.21.15.177:6816/1088546159,v1:172.21.15.177:6817/1088546159] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f606406eda0 con 0x7f606406c2d0 2023-11-28T20:10:27.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.900+0000 7f6075ffb640 1 -- 172.21.15.177:0/566057435 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f607c1222c0 con 0x7f608006f920 2023-11-28T20:10:27.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.900+0000 7f6085947640 1 --2- 172.21.15.177:0/566057435 >> [v2:172.21.15.177:6816/1088546159,v1:172.21.15.177:6817/1088546159] conn(0x7f606406c2d0 0x7f606406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:27.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.900+0000 7f6084945640 1 --2- 172.21.15.177:0/566057435 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6064066470 0x7f6064068930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f60800cbab0 tx=0x7f6070008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:27.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.900+0000 7f6085947640 1 --2- 172.21.15.177:0/566057435 >> [v2:172.21.15.177:6816/1088546159,v1:172.21.15.177:6817/1088546159] conn(0x7f606406c2d0 0x7f606406e6f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:27.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.900+0000 7f6075ffb640 1 -- 172.21.15.177:0/566057435 <== osd.2 v2:172.21.15.177:6816/1088546159 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f606406eda0 con 0x7f606406c2d0 2023-11-28T20:10:27.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.912+0000 7f6086148640 1 -- 172.21.15.177:0/566057435 --> [v2:172.21.15.177:6816/1088546159,v1:172.21.15.177:6817/1088546159] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f60800679f0 con 0x7f606406c2d0 2023-11-28T20:10:27.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.916+0000 7f6075ffb640 1 -- 172.21.15.177:0/566057435 <== osd.2 v2:172.21.15.177:6816/1088546159 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f60800679f0 con 0x7f606406c2d0 2023-11-28T20:10:27.919 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:10:27.920 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:10:27.920 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:10:27.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.916+0000 7f6086148640 1 -- 172.21.15.177:0/566057435 >> [v2:172.21.15.177:6816/1088546159,v1:172.21.15.177:6817/1088546159] conn(0x7f606406c2d0 msgr2=0x7f606406e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.916+0000 7f6086148640 1 --2- 172.21.15.177:0/566057435 >> [v2:172.21.15.177:6816/1088546159,v1:172.21.15.177:6817/1088546159] conn(0x7f606406c2d0 0x7f606406e6f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.916+0000 7f6086148640 1 -- 172.21.15.177:0/566057435 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6064066470 msgr2=0x7f6064068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.916+0000 7f6086148640 1 --2- 172.21.15.177:0/566057435 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f6064066470 0x7f6064068930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f60800cbab0 tx=0x7f6070008040 comp rx=0 tx=0).stop 2023-11-28T20:10:27.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.916+0000 7f6086148640 1 -- 172.21.15.177:0/566057435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608006f920 msgr2=0x7f608014baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:27.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.916+0000 7f6086148640 1 --2- 172.21.15.177:0/566057435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608006f920 0x7f608014baf0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f607c0ae040 tx=0x7f607c0191c0 comp rx=0 tx=0).stop 2023-11-28T20:10:27.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.916+0000 7f6085947640 1 -- 172.21.15.177:0/566057435 reap_dead start 2023-11-28T20:10:27.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.916+0000 7f6086148640 1 -- 172.21.15.177:0/566057435 shutdown_connections 2023-11-28T20:10:27.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.916+0000 7f6086148640 1 -- 172.21.15.177:0/566057435 >> 172.21.15.177:0/566057435 conn(0x7f60800b2860 msgr2=0x7f60800b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:27.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.916+0000 7f6086148640 1 -- 172.21.15.177:0/566057435 shutdown_connections 2023-11-28T20:10:27.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:27.916+0000 7f6086148640 1 -- 172.21.15.177:0/566057435 wait complete. 2023-11-28T20:10:27.937 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-28T20:10:28.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc2a1c5f640 1 Processor -- start 2023-11-28T20:10:28.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc2a1c5f640 1 -- start start 2023-11-28T20:10:28.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc2a1c5f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc29c144840 0x7fc29c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc2a1c5f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc29c072180 0x7fc29c06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc2a1c5f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c0710e0 con 0x7fc29c070460 2023-11-28T20:10:28.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc2a1c5f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c15f010 con 0x7fc29c072180 2023-11-28T20:10:28.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc2a1c5f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c0713c0 con 0x7fc29c144840 2023-11-28T20:10:28.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc29affd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc29c072180 0x7fc29c06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc29bfff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc29c070460 0x7fc29c070910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47156/0 (socket says 172.21.15.177:47156) 2023-11-28T20:10:28.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc29bfff640 1 -- 172.21.15.177:0/380750984 learned_addr learned my addr 172.21.15.177:0/380750984 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:28.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc29b7fe640 1 --2- 172.21.15.177:0/380750984 >> v2:172.21.15.195:3300/0 conn(0x7fc29c144840 0x7fc29c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc29affd640 1 -- 172.21.15.177:0/380750984 >> v2:172.21.15.195:3300/0 conn(0x7fc29c144840 msgr2=0x7fc29c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:28.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc29affd640 1 --2- 172.21.15.177:0/380750984 >> v2:172.21.15.195:3300/0 conn(0x7fc29c144840 0x7fc29c06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc29affd640 1 -- 172.21.15.177:0/380750984 >> v1:172.21.15.177:6789/0 conn(0x7fc29c070460 legacy=0x7fc29c070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc29affd640 1 -- 172.21.15.177:0/380750984 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0716a0 con 0x7fc29c072180 2023-11-28T20:10:28.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.072+0000 7fc29a7fc640 1 -- 172.21.15.177:0/380750984 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375963582 0 0) 0x7fc29c0710e0 con 0x7fc29c070460 2023-11-28T20:10:28.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.076+0000 7fc29affd640 1 --2- 172.21.15.177:0/380750984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29c072180 0x7fc29c06c800 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc29c068020 tx=0x7fc29001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f4e91ece16950f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:28.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.076+0000 7fc29a7fc640 1 -- 172.21.15.177:0/380750984 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2900a7070 con 0x7fc29c072180 2023-11-28T20:10:28.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.076+0000 7fc29a7fc640 1 -- 172.21.15.177:0/380750984 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2900ab430 con 0x7fc29c072180 2023-11-28T20:10:28.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.076+0000 7fc29a7fc640 1 -- 172.21.15.177:0/380750984 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2900ab7c0 con 0x7fc29c072180 2023-11-28T20:10:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.076+0000 7fc2a1c5f640 1 -- 172.21.15.177:0/380750984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29c072180 msgr2=0x7fc29c06c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.076+0000 7fc2a1c5f640 1 --2- 172.21.15.177:0/380750984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29c072180 0x7fc29c06c800 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc29c068020 tx=0x7fc29001c430 comp rx=0 tx=0).stop 2023-11-28T20:10:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.076+0000 7fc2a1c5f640 1 -- 172.21.15.177:0/380750984 shutdown_connections 2023-11-28T20:10:28.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.076+0000 7fc2a1c5f640 1 --2- 172.21.15.177:0/380750984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29c072180 0x7fc29c06c800 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.076+0000 7fc2a1c5f640 1 --2- 172.21.15.177:0/380750984 >> v2:172.21.15.195:3300/0 conn(0x7fc29c144840 0x7fc29c06c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.076+0000 7fc2a1c5f640 1 -- 172.21.15.177:0/380750984 >> 172.21.15.177:0/380750984 conn(0x7fc29c06a530 msgr2=0x7fc29c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:28.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.076+0000 7fc2a1c5f640 1 -- 172.21.15.177:0/380750984 shutdown_connections 2023-11-28T20:10:28.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.076+0000 7fc2a1c5f640 1 -- 172.21.15.177:0/380750984 wait complete. 2023-11-28T20:10:28.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc2a1c5f640 1 Processor -- start 2023-11-28T20:10:28.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc2a1c5f640 1 -- start start 2023-11-28T20:10:28.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc2a1c5f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc29c070460 0x7fc29c1fabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc2a1c5f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc29c072180 0x7fc29c1f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc2a1c5f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29c144840 0x7fc29c15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc2a1c5f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c1fb120 con 0x7fc29c144840 2023-11-28T20:10:28.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc2a1c5f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c1fe520 con 0x7fc29c072180 2023-11-28T20:10:28.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc2a1c5f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c1fd910 con 0x7fc29c070460 2023-11-28T20:10:28.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc29bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29c144840 0x7fc29c15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc29bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29c144840 0x7fc29c15c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59950/0 (socket says 172.21.15.177:59950) 2023-11-28T20:10:28.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc29bfff640 1 -- 172.21.15.177:0/3068547377 learned_addr learned my addr 172.21.15.177:0/3068547377 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:28.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc29b7fe640 1 --2- 172.21.15.177:0/3068547377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc29c070460 0x7fc29c1fabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc29affd640 1 --2- 172.21.15.177:0/3068547377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc29c072180 0x7fc29c1f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc29bfff640 1 -- 172.21.15.177:0/3068547377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc29c070460 msgr2=0x7fc29c1fabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc29bfff640 1 --2- 172.21.15.177:0/3068547377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc29c070460 0x7fc29c1fabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc29bfff640 1 -- 172.21.15.177:0/3068547377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc29c072180 msgr2=0x7fc29c1f7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc29bfff640 1 --2- 172.21.15.177:0/3068547377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc29c072180 0x7fc29c1f7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc29bfff640 1 -- 172.21.15.177:0/3068547377 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc290009420 con 0x7fc29c144840 2023-11-28T20:10:28.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc29affd640 1 --2- 172.21.15.177:0/3068547377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc29c072180 0x7fc29c1f7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:28.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc29bfff640 1 --2- 172.21.15.177:0/3068547377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29c144840 0x7fc29c15c6d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc294001570 tx=0x7fc29400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:28.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc283fff640 1 -- 172.21.15.177:0/3068547377 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29400a640 con 0x7fc29c144840 2023-11-28T20:10:28.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc283fff640 1 -- 172.21.15.177:0/3068547377 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29400a7c0 con 0x7fc29c144840 2023-11-28T20:10:28.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc2a1c5f640 1 -- 172.21.15.177:0/3068547377 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c1fdbf0 con 0x7fc29c144840 2023-11-28T20:10:28.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc283fff640 1 -- 172.21.15.177:0/3068547377 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29400ab70 con 0x7fc29c144840 2023-11-28T20:10:28.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.080+0000 7fc2a1c5f640 1 -- 172.21.15.177:0/3068547377 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c1fe1b0 con 0x7fc29c144840 2023-11-28T20:10:28.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.084+0000 7fc2a1c5f640 1 -- 172.21.15.177:0/3068547377 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c0cb6c0 con 0x7fc29c144840 2023-11-28T20:10:28.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.084+0000 7fc283fff640 1 -- 172.21.15.177:0/3068547377 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc29400acd0 con 0x7fc29c144840 2023-11-28T20:10:28.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.084+0000 7fc283fff640 1 --2- 172.21.15.177:0/3068547377 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc288066470 0x7fc288068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.084+0000 7fc283fff640 1 -- 172.21.15.177:0/3068547377 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc2940834e0 con 0x7fc29c144840 2023-11-28T20:10:28.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.084+0000 7fc29b7fe640 1 --2- 172.21.15.177:0/3068547377 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc288066470 0x7fc288068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.084+0000 7fc29b7fe640 1 --2- 172.21.15.177:0/3068547377 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc288066470 0x7fc288068930 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009a50 tx=0x7fc28c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:28.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.088+0000 7fc283fff640 1 -- 172.21.15.177:0/3068547377 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc294050bc0 con 0x7fc29c144840 2023-11-28T20:10:28.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.236+0000 7fc2a1c5f640 1 -- 172.21.15.177:0/3068547377 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc29c1fe660 con 0x7fc288066470 2023-11-28T20:10:28.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.236+0000 7fc283fff640 1 -- 172.21.15.177:0/3068547377 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc28c0119a0 con 0x7fc288066470 2023-11-28T20:10:28.242 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 2 to deep-scrub 2023-11-28T20:10:28.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.240+0000 7fc2a1c5f640 1 -- 172.21.15.177:0/3068547377 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc288066470 msgr2=0x7fc288068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.240+0000 7fc2a1c5f640 1 --2- 172.21.15.177:0/3068547377 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc288066470 0x7fc288068930 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009a50 tx=0x7fc28c008040 comp rx=0 tx=0).stop 2023-11-28T20:10:28.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.240+0000 7fc2a1c5f640 1 -- 172.21.15.177:0/3068547377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29c144840 msgr2=0x7fc29c15c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.240+0000 7fc2a1c5f640 1 --2- 172.21.15.177:0/3068547377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29c144840 0x7fc29c15c6d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc294001570 tx=0x7fc29400cca0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.240+0000 7fc2a1c5f640 1 -- 172.21.15.177:0/3068547377 shutdown_connections 2023-11-28T20:10:28.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.240+0000 7fc2a1c5f640 1 --2- 172.21.15.177:0/3068547377 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc288066470 0x7fc288068930 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.240+0000 7fc2a1c5f640 1 --2- 172.21.15.177:0/3068547377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc29c144840 0x7fc29c15c6d0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.240+0000 7fc2a1c5f640 1 --2- 172.21.15.177:0/3068547377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc29c072180 0x7fc29c1f7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.240+0000 7fc2a1c5f640 1 --2- 172.21.15.177:0/3068547377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc29c070460 0x7fc29c1fabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.240+0000 7fc2a1c5f640 1 -- 172.21.15.177:0/3068547377 >> 172.21.15.177:0/3068547377 conn(0x7fc29c06a530 msgr2=0x7fc29c0ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:28.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.240+0000 7fc2a1c5f640 1 -- 172.21.15.177:0/3068547377 shutdown_connections 2023-11-28T20:10:28.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.240+0000 7fc2a1c5f640 1 -- 172.21.15.177:0/3068547377 wait complete. 2023-11-28T20:10:28.262 INFO:tasks.ceph:Scrubbing osd.3 2023-11-28T20:10:28.263 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:10:28.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.400+0000 7f0c65bd1640 1 Processor -- start 2023-11-28T20:10:28.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.400+0000 7f0c65bd1640 1 -- start start 2023-11-28T20:10:28.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.400+0000 7f0c65bd1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c600cce60 0x7f0c600cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.400+0000 7f0c65bd1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0c600ce390 0x7f0c6006cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.400+0000 7f0c65bd1640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6015b6e0 con 0x7f0c600cdf30 2023-11-28T20:10:28.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.400+0000 7f0c65bd1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c600cd780 con 0x7f0c600ce390 2023-11-28T20:10:28.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.400+0000 7f0c65bd1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600cb550 con 0x7f0c600cce60 2023-11-28T20:10:28.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.400+0000 7f0c5effd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f0c600cdf30 0x7f0c6006c6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47166/0 (socket says 172.21.15.177:47166) 2023-11-28T20:10:28.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.400+0000 7f0c5effd640 1 -- 172.21.15.177:0/3920393953 learned_addr learned my addr 172.21.15.177:0/3920393953 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:28.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.400+0000 7f0c5ffff640 1 --2- 172.21.15.177:0/3920393953 >> v2:172.21.15.195:3300/0 conn(0x7f0c600ce390 0x7f0c6006cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.400+0000 7f0c5f7fe640 1 --2- 172.21.15.177:0/3920393953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c600cce60 0x7f0c600cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.400+0000 7f0c5e7fc640 1 -- 172.21.15.177:0/3920393953 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194837850 0 0) 0x7f0c6015b6e0 con 0x7f0c600cdf30 2023-11-28T20:10:28.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.400+0000 7f0c5e7fc640 1 -- 172.21.15.177:0/3920393953 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c48003530 con 0x7f0c600cdf30 2023-11-28T20:10:28.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5e7fc640 1 -- 172.21.15.177:0/3920393953 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4036192873 0 0) 0x7f0c48003530 con 0x7f0c600cdf30 2023-11-28T20:10:28.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5e7fc640 1 -- 172.21.15.177:0/3920393953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c600cce60 msgr2=0x7f0c600cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:28.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5e7fc640 1 --2- 172.21.15.177:0/3920393953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c600cce60 0x7f0c600cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5e7fc640 1 -- 172.21.15.177:0/3920393953 >> v2:172.21.15.195:3300/0 conn(0x7f0c600ce390 msgr2=0x7f0c6006cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:28.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5e7fc640 1 --2- 172.21.15.177:0/3920393953 >> v2:172.21.15.195:3300/0 conn(0x7f0c600ce390 0x7f0c6006cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5e7fc640 1 -- 172.21.15.177:0/3920393953 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c600cb830 con 0x7f0c600cdf30 2023-11-28T20:10:28.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5ffff640 1 --2- 172.21.15.177:0/3920393953 >> v2:172.21.15.195:3300/0 conn(0x7f0c600ce390 0x7f0c6006cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:10:28.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5e7fc640 1 -- 172.21.15.177:0/3920393953 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f0c54001680 con 0x7f0c600cdf30 2023-11-28T20:10:28.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5e7fc640 1 -- 172.21.15.177:0/3920393953 >> v1:172.21.15.177:6789/0 conn(0x7f0c600cdf30 legacy=0x7f0c6006c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5e7fc640 1 --2- 172.21.15.177:0/3920393953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c600cce60 0x7f0c48003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5e7fc640 1 --2- 172.21.15.177:0/3920393953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c48003f50 0x7f0c480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5e7fc640 1 --2- 172.21.15.177:0/3920393953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c48004d10 0x7f0c48005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5e7fc640 1 -- 172.21.15.177:0/3920393953 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600cd780 con 0x7f0c48003f50 2023-11-28T20:10:28.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5e7fc640 1 -- 172.21.15.177:0/3920393953 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600cb550 con 0x7f0c48004d10 2023-11-28T20:10:28.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5e7fc640 1 -- 172.21.15.177:0/3920393953 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4800b990 con 0x7f0c600cce60 2023-11-28T20:10:28.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5effd640 1 --2- 172.21.15.177:0/3920393953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c48003f50 0x7f0c480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5ffff640 1 --2- 172.21.15.177:0/3920393953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c48004d10 0x7f0c48005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5f7fe640 1 --2- 172.21.15.177:0/3920393953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c600cce60 0x7f0c48003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5effd640 1 -- 172.21.15.177:0/3920393953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c600cce60 msgr2=0x7f0c48003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:28.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5effd640 1 --2- 172.21.15.177:0/3920393953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c600cce60 0x7f0c48003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5effd640 1 -- 172.21.15.177:0/3920393953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c48004d10 msgr2=0x7f0c48005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:28.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5effd640 1 --2- 172.21.15.177:0/3920393953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c48004d10 0x7f0c48005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5effd640 1 -- 172.21.15.177:0/3920393953 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c48003530 con 0x7f0c48003f50 2023-11-28T20:10:28.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5f7fe640 1 --2- 172.21.15.177:0/3920393953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c600cce60 0x7f0c48003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:28.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.404+0000 7f0c5effd640 1 --2- 172.21.15.177:0/3920393953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c48003f50 0x7f0c480047d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400c140 tx=0x7f0c5401f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7152a8820e49be3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:28.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c5e7fc640 1 -- 172.21.15.177:0/3920393953 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c54005ae0 con 0x7f0c48003f50 2023-11-28T20:10:28.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c5e7fc640 1 -- 172.21.15.177:0/3920393953 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c540ab070 con 0x7f0c48003f50 2023-11-28T20:10:28.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c5e7fc640 1 -- 172.21.15.177:0/3920393953 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c54007070 con 0x7f0c48003f50 2023-11-28T20:10:28.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c65bd1640 1 -- 172.21.15.177:0/3920393953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c48003f50 msgr2=0x7f0c480047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c65bd1640 1 --2- 172.21.15.177:0/3920393953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c48003f50 0x7f0c480047d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400c140 tx=0x7f0c5401f2f0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c5ffff640 1 -- 172.21.15.177:0/3920393953 reap_dead start 2023-11-28T20:10:28.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c65bd1640 1 -- 172.21.15.177:0/3920393953 shutdown_connections 2023-11-28T20:10:28.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c65bd1640 1 -- 172.21.15.177:0/3920393953 >> 172.21.15.177:0/3920393953 conn(0x7f0c600b0c50 msgr2=0x7f0c600b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:28.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c65bd1640 1 -- 172.21.15.177:0/3920393953 shutdown_connections 2023-11-28T20:10:28.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c65bd1640 1 -- 172.21.15.177:0/3920393953 wait complete. 2023-11-28T20:10:28.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c65bd1640 1 Processor -- start 2023-11-28T20:10:28.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c65bd1640 1 -- start start 2023-11-28T20:10:28.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c65bd1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c48003f50 0x7f0c6015c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c65bd1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c60155820 0x7f0c60154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c65bd1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c6015d4c0 0x7f0c600abf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c65bd1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6015de30 con 0x7f0c6015d4c0 2023-11-28T20:10:28.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c65bd1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6015b9c0 con 0x7f0c60155820 2023-11-28T20:10:28.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.408+0000 7f0c65bd1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6015bca0 con 0x7f0c48003f50 2023-11-28T20:10:28.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c5ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c6015d4c0 0x7f0c600abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c5ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c6015d4c0 0x7f0c600abf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59978/0 (socket says 172.21.15.177:59978) 2023-11-28T20:10:28.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c5ffff640 1 -- 172.21.15.177:0/1548784510 learned_addr learned my addr 172.21.15.177:0/1548784510 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:28.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c5effd640 1 --2- 172.21.15.177:0/1548784510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c60155820 0x7f0c60154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c5f7fe640 1 --2- 172.21.15.177:0/1548784510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c48003f50 0x7f0c6015c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c5ffff640 1 -- 172.21.15.177:0/1548784510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c48003f50 msgr2=0x7f0c6015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c5ffff640 1 --2- 172.21.15.177:0/1548784510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c48003f50 0x7f0c6015c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c5ffff640 1 -- 172.21.15.177:0/1548784510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c60155820 msgr2=0x7f0c60154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c5ffff640 1 --2- 172.21.15.177:0/1548784510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c60155820 0x7f0c60154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c5ffff640 1 -- 172.21.15.177:0/1548784510 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6015bf80 con 0x7f0c6015d4c0 2023-11-28T20:10:28.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c5f7fe640 1 --2- 172.21.15.177:0/1548784510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c48003f50 0x7f0c6015c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:28.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c5ffff640 1 --2- 172.21.15.177:0/1548784510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c6015d4c0 0x7f0c600abf30 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f0c600b0be0 tx=0x7f0c58009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:28.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c47fff640 1 -- 172.21.15.177:0/1548784510 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5800e040 con 0x7f0c6015d4c0 2023-11-28T20:10:28.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c47fff640 1 -- 172.21.15.177:0/1548784510 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5800f040 con 0x7f0c6015d4c0 2023-11-28T20:10:28.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c65bd1640 1 -- 172.21.15.177:0/1548784510 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6015e110 con 0x7f0c6015d4c0 2023-11-28T20:10:28.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c47fff640 1 -- 172.21.15.177:0/1548784510 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58003be0 con 0x7f0c6015d4c0 2023-11-28T20:10:28.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c65bd1640 1 -- 172.21.15.177:0/1548784510 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6015d940 con 0x7f0c6015d4c0 2023-11-28T20:10:28.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c65bd1640 1 -- 172.21.15.177:0/1548784510 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c600cc0d0 con 0x7f0c6015d4c0 2023-11-28T20:10:28.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c47fff640 1 -- 172.21.15.177:0/1548784510 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0c58027480 con 0x7f0c6015d4c0 2023-11-28T20:10:28.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.412+0000 7f0c47fff640 1 --2- 172.21.15.177:0/1548784510 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0c4c0664a0 0x7f0c4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.416+0000 7f0c47fff640 1 -- 172.21.15.177:0/1548784510 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0c58084bf0 con 0x7f0c6015d4c0 2023-11-28T20:10:28.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.416+0000 7f0c5f7fe640 1 --2- 172.21.15.177:0/1548784510 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0c4c0664a0 0x7f0c4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.416+0000 7f0c47fff640 1 --2- 172.21.15.177:0/1548784510 >> [v2:172.21.15.177:6808/3088892220,v1:172.21.15.177:6809/3088892220] conn(0x7f0c4c06c300 0x7f0c4c06e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.416+0000 7f0c47fff640 1 -- 172.21.15.177:0/1548784510 --> [v2:172.21.15.177:6808/3088892220,v1:172.21.15.177:6809/3088892220] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c4c06edd0 con 0x7f0c4c06c300 2023-11-28T20:10:28.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.416+0000 7f0c47fff640 1 -- 172.21.15.177:0/1548784510 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c58085040 con 0x7f0c6015d4c0 2023-11-28T20:10:28.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.416+0000 7f0c5effd640 1 --2- 172.21.15.177:0/1548784510 >> [v2:172.21.15.177:6808/3088892220,v1:172.21.15.177:6809/3088892220] conn(0x7f0c4c06c300 0x7f0c4c06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.416+0000 7f0c5f7fe640 1 --2- 172.21.15.177:0/1548784510 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0c4c0664a0 0x7f0c4c068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0c500098d0 tx=0x7f0c50008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:28.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.416+0000 7f0c5effd640 1 --2- 172.21.15.177:0/1548784510 >> [v2:172.21.15.177:6808/3088892220,v1:172.21.15.177:6809/3088892220] conn(0x7f0c4c06c300 0x7f0c4c06e720 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:28.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.416+0000 7f0c47fff640 1 -- 172.21.15.177:0/1548784510 <== osd.3 v2:172.21.15.177:6808/3088892220 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0c4c06edd0 con 0x7f0c4c06c300 2023-11-28T20:10:28.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.428+0000 7f0c65bd1640 1 -- 172.21.15.177:0/1548784510 --> [v2:172.21.15.177:6808/3088892220,v1:172.21.15.177:6809/3088892220] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0c600cbdf0 con 0x7f0c4c06c300 2023-11-28T20:10:28.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.428+0000 7f0c47fff640 1 -- 172.21.15.177:0/1548784510 <== osd.3 v2:172.21.15.177:6808/3088892220 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0c540b8040 con 0x7f0c4c06c300 2023-11-28T20:10:28.433 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:10:28.433 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:10:28.433 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:10:28.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.428+0000 7f0c65bd1640 1 -- 172.21.15.177:0/1548784510 >> [v2:172.21.15.177:6808/3088892220,v1:172.21.15.177:6809/3088892220] conn(0x7f0c4c06c300 msgr2=0x7f0c4c06e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.428+0000 7f0c65bd1640 1 --2- 172.21.15.177:0/1548784510 >> [v2:172.21.15.177:6808/3088892220,v1:172.21.15.177:6809/3088892220] conn(0x7f0c4c06c300 0x7f0c4c06e720 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.428+0000 7f0c65bd1640 1 -- 172.21.15.177:0/1548784510 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0c4c0664a0 msgr2=0x7f0c4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.428+0000 7f0c65bd1640 1 --2- 172.21.15.177:0/1548784510 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0c4c0664a0 0x7f0c4c068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0c500098d0 tx=0x7f0c50008040 comp rx=0 tx=0).stop 2023-11-28T20:10:28.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.428+0000 7f0c65bd1640 1 -- 172.21.15.177:0/1548784510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c6015d4c0 msgr2=0x7f0c600abf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.428+0000 7f0c65bd1640 1 --2- 172.21.15.177:0/1548784510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c6015d4c0 0x7f0c600abf30 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f0c600b0be0 tx=0x7f0c58009f90 comp rx=0 tx=0).stop 2023-11-28T20:10:28.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.428+0000 7f0c5ffff640 1 -- 172.21.15.177:0/1548784510 reap_dead start 2023-11-28T20:10:28.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.428+0000 7f0c65bd1640 1 -- 172.21.15.177:0/1548784510 shutdown_connections 2023-11-28T20:10:28.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.428+0000 7f0c65bd1640 1 -- 172.21.15.177:0/1548784510 >> 172.21.15.177:0/1548784510 conn(0x7f0c600b0c50 msgr2=0x7f0c6006ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:28.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.428+0000 7f0c65bd1640 1 -- 172.21.15.177:0/1548784510 shutdown_connections 2023-11-28T20:10:28.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.428+0000 7f0c65bd1640 1 -- 172.21.15.177:0/1548784510 wait complete. 2023-11-28T20:10:28.451 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-28T20:10:28.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcab712a640 1 Processor -- start 2023-11-28T20:10:28.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcab712a640 1 -- start start 2023-11-28T20:10:28.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcab712a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcab006c9d0 0x7fcab015a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcab712a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcab015ab70 0x7fcab00cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcab712a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab015b3a0 con 0x7fcab013cf30 2023-11-28T20:10:28.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcab712a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab013d310 con 0x7fcab015ab70 2023-11-28T20:10:28.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcab712a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab01404e0 con 0x7fcab006c9d0 2023-11-28T20:10:28.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcab56c7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcab015ab70 0x7fcab00cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcab56c7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcab015ab70 0x7fcab00cd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59986/0 (socket says 172.21.15.177:59986) 2023-11-28T20:10:28.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcab56c7640 1 -- 172.21.15.177:0/1803565816 learned_addr learned my addr 172.21.15.177:0/1803565816 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:28.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcaa7fff640 1 --2- 172.21.15.177:0/1803565816 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcab006c9d0 0x7fcab015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcab56c7640 1 -- 172.21.15.177:0/1803565816 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcab006c9d0 msgr2=0x7fcab015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:28.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcab56c7640 1 --2- 172.21.15.177:0/1803565816 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcab006c9d0 0x7fcab015a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcab56c7640 1 -- 172.21.15.177:0/1803565816 >> v1:172.21.15.195:6789/0 conn(0x7fcab013cf30 legacy=0x7fcab006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcab56c7640 1 -- 172.21.15.177:0/1803565816 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab013f720 con 0x7fcab015ab70 2023-11-28T20:10:28.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.588+0000 7fcaa77fe640 1 -- 172.21.15.177:0/1803565816 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104476157 0 0) 0x7fcab015b3a0 con 0x7fcab013cf30 2023-11-28T20:10:28.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.592+0000 7fcab56c7640 1 --2- 172.21.15.177:0/1803565816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab015ab70 0x7fcab00cd880 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009e50 tx=0x7fcaa801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbc31603bab16ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:28.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.592+0000 7fcaa77fe640 1 -- 172.21.15.177:0/1803565816 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80a5810 con 0x7fcab015ab70 2023-11-28T20:10:28.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.592+0000 7fcaa77fe640 1 -- 172.21.15.177:0/1803565816 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa80a5970 con 0x7fcab015ab70 2023-11-28T20:10:28.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.592+0000 7fcaa77fe640 1 -- 172.21.15.177:0/1803565816 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80a5d00 con 0x7fcab015ab70 2023-11-28T20:10:28.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.592+0000 7fcab712a640 1 -- 172.21.15.177:0/1803565816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab015ab70 msgr2=0x7fcab00cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.592+0000 7fcab712a640 1 --2- 172.21.15.177:0/1803565816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab015ab70 0x7fcab00cd880 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009e50 tx=0x7fcaa801c950 comp rx=0 tx=0).stop 2023-11-28T20:10:28.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.592+0000 7fcab712a640 1 -- 172.21.15.177:0/1803565816 shutdown_connections 2023-11-28T20:10:28.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.592+0000 7fcab712a640 1 --2- 172.21.15.177:0/1803565816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab015ab70 0x7fcab00cd880 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.592+0000 7fcab712a640 1 --2- 172.21.15.177:0/1803565816 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcab006c9d0 0x7fcab015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.592+0000 7fcab712a640 1 -- 172.21.15.177:0/1803565816 >> 172.21.15.177:0/1803565816 conn(0x7fcab006a530 msgr2=0x7fcab006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:28.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.592+0000 7fcab712a640 1 -- 172.21.15.177:0/1803565816 shutdown_connections 2023-11-28T20:10:28.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.592+0000 7fcab712a640 1 -- 172.21.15.177:0/1803565816 wait complete. 2023-11-28T20:10:28.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.592+0000 7fcab712a640 1 Processor -- start 2023-11-28T20:10:28.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.592+0000 7fcab712a640 1 -- start start 2023-11-28T20:10:28.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab712a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcab006c9d0 0x7fcab0136740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab712a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcab013cf30 0x7fcab0157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab712a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab015ab70 0x7fcab0135970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab712a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab013c470 con 0x7fcab015ab70 2023-11-28T20:10:28.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab712a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab01599a0 con 0x7fcab013cf30 2023-11-28T20:10:28.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab712a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab013ec90 con 0x7fcab006c9d0 2023-11-28T20:10:28.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab56c7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab015ab70 0x7fcab0135970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab56c7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab015ab70 0x7fcab0135970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59992/0 (socket says 172.21.15.177:59992) 2023-11-28T20:10:28.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab56c7640 1 -- 172.21.15.177:0/2500848184 learned_addr learned my addr 172.21.15.177:0/2500848184 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:28.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcaa7fff640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcab013cf30 0x7fcab0157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab56c7640 1 -- 172.21.15.177:0/2500848184 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcab006c9d0 msgr2=0x7fcab0136740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab4ec6640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcab006c9d0 0x7fcab0136740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab56c7640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcab006c9d0 0x7fcab0136740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab56c7640 1 -- 172.21.15.177:0/2500848184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcab013cf30 msgr2=0x7fcab0157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab56c7640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcab013cf30 0x7fcab0157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab56c7640 1 -- 172.21.15.177:0/2500848184 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa8009b30 con 0x7fcab015ab70 2023-11-28T20:10:28.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcaa7fff640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcab013cf30 0x7fcab0157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:28.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab4ec6640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcab006c9d0 0x7fcab0136740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:28.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab56c7640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab015ab70 0x7fcab0135970 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009e50 tx=0x7fcaa80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:28.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcaa57fa640 1 -- 172.21.15.177:0/2500848184 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80b8470 con 0x7fcab015ab70 2023-11-28T20:10:28.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcaa57fa640 1 -- 172.21.15.177:0/2500848184 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa80b85d0 con 0x7fcab015ab70 2023-11-28T20:10:28.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcaa57fa640 1 -- 172.21.15.177:0/2500848184 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80b8940 con 0x7fcab015ab70 2023-11-28T20:10:28.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab712a640 1 -- 172.21.15.177:0/2500848184 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab0158510 con 0x7fcab015ab70 2023-11-28T20:10:28.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab712a640 1 -- 172.21.15.177:0/2500848184 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab0159eb0 con 0x7fcab015ab70 2023-11-28T20:10:28.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.596+0000 7fcab712a640 1 -- 172.21.15.177:0/2500848184 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab0069440 con 0x7fcab015ab70 2023-11-28T20:10:28.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.600+0000 7fcaa57fa640 1 -- 172.21.15.177:0/2500848184 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcaa80b8aa0 con 0x7fcab015ab70 2023-11-28T20:10:28.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.600+0000 7fcaa57fa640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fca9c066470 0x7fca9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.600+0000 7fcaa57fa640 1 -- 172.21.15.177:0/2500848184 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcaa811eb20 con 0x7fcab015ab70 2023-11-28T20:10:28.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.600+0000 7fcab4ec6640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fca9c066470 0x7fca9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.600+0000 7fcab4ec6640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fca9c066470 0x7fca9c068930 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcaac000f70 tx=0x7fcaac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:28.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.604+0000 7fcaa57fa640 1 -- 172.21.15.177:0/2500848184 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcaa80ec2a0 con 0x7fcab015ab70 2023-11-28T20:10:28.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.752+0000 7fcab712a640 1 -- 172.21.15.177:0/2500848184 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fcab00ce5d0 con 0x7fca9c066470 2023-11-28T20:10:28.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.752+0000 7fcaa57fa640 1 -- 172.21.15.177:0/2500848184 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcaac0013e0 con 0x7fca9c066470 2023-11-28T20:10:28.757 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 3 to deep-scrub 2023-11-28T20:10:28.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.756+0000 7fcab712a640 1 -- 172.21.15.177:0/2500848184 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fca9c066470 msgr2=0x7fca9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.756+0000 7fcab712a640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fca9c066470 0x7fca9c068930 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcaac000f70 tx=0x7fcaac009040 comp rx=0 tx=0).stop 2023-11-28T20:10:28.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.756+0000 7fcab712a640 1 -- 172.21.15.177:0/2500848184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab015ab70 msgr2=0x7fcab0135970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.756+0000 7fcab712a640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab015ab70 0x7fcab0135970 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009e50 tx=0x7fcaa80196f0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.756+0000 7fcab712a640 1 -- 172.21.15.177:0/2500848184 shutdown_connections 2023-11-28T20:10:28.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.756+0000 7fcab712a640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fca9c066470 0x7fca9c068930 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.756+0000 7fcab712a640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab015ab70 0x7fcab0135970 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.756+0000 7fcab712a640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcab013cf30 0x7fcab0157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.756+0000 7fcab712a640 1 --2- 172.21.15.177:0/2500848184 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcab006c9d0 0x7fcab0136740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.756+0000 7fcab712a640 1 -- 172.21.15.177:0/2500848184 >> 172.21.15.177:0/2500848184 conn(0x7fcab006a530 msgr2=0x7fcab015d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:28.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.756+0000 7fcab712a640 1 -- 172.21.15.177:0/2500848184 shutdown_connections 2023-11-28T20:10:28.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.756+0000 7fcab712a640 1 -- 172.21.15.177:0/2500848184 wait complete. 2023-11-28T20:10:28.778 INFO:tasks.ceph:Scrubbing osd.4 2023-11-28T20:10:28.778 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:10:28.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f7250881640 1 Processor -- start 2023-11-28T20:10:28.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f7250881640 1 -- start start 2023-11-28T20:10:28.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f7250881640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f724c0ccc70 0x7f724c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f7250881640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f724c06b640 0x7f724c06bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f7250881640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f724c06cf80 con 0x7f724c06c000 2023-11-28T20:10:28.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f7250881640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f724c06c4b0 con 0x7f724c0ccc70 2023-11-28T20:10:28.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f7250881640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f724c06ebd0 con 0x7f724c06b640 2023-11-28T20:10:28.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f724b7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f724c0ccc70 0x7f724c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f724bfff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f724c06c000 0x7f724c0cd5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47830/0 (socket says 172.21.15.177:47830) 2023-11-28T20:10:28.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f724b7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f724c0ccc70 0x7f724c06c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49624/0 (socket says 172.21.15.177:49624) 2023-11-28T20:10:28.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f724bfff640 1 -- 172.21.15.177:0/3759479215 learned_addr learned my addr 172.21.15.177:0/3759479215 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:28.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f7243fff640 1 --2- 172.21.15.177:0/3759479215 >> v2:172.21.15.195:3300/0 conn(0x7f724c06b640 0x7f724c06bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f724b7fe640 1 -- 172.21.15.177:0/3759479215 >> v2:172.21.15.195:3300/0 conn(0x7f724c06b640 msgr2=0x7f724c06bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:28.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f724b7fe640 1 --2- 172.21.15.177:0/3759479215 >> v2:172.21.15.195:3300/0 conn(0x7f724c06b640 0x7f724c06bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f724b7fe640 1 -- 172.21.15.177:0/3759479215 >> v1:172.21.15.177:6789/0 conn(0x7f724c06c000 legacy=0x7f724c0cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f724b7fe640 1 -- 172.21.15.177:0/3759479215 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c0cb380 con 0x7f724c0ccc70 2023-11-28T20:10:28.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.916+0000 7f7243fff640 1 --2- 172.21.15.177:0/3759479215 >> v2:172.21.15.195:3300/0 conn(0x7f724c06b640 0x7f724c06bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:28.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.920+0000 7f724b7fe640 1 --2- 172.21.15.177:0/3759479215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f724c0ccc70 0x7f724c06c6c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f724c066db0 tx=0x7f723c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16e88f95a0f91c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:28.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.920+0000 7f724affd640 1 -- 172.21.15.177:0/3759479215 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c0ce4d0 con 0x7f724c0ccc70 2023-11-28T20:10:28.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.920+0000 7f724affd640 1 -- 172.21.15.177:0/3759479215 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723c0ac630 con 0x7f724c0ccc70 2023-11-28T20:10:28.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.920+0000 7f724affd640 1 -- 172.21.15.177:0/3759479215 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c0ac9c0 con 0x7f724c0ccc70 2023-11-28T20:10:28.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.920+0000 7f7250881640 1 -- 172.21.15.177:0/3759479215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f724c0ccc70 msgr2=0x7f724c06c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.920+0000 7f7250881640 1 --2- 172.21.15.177:0/3759479215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f724c0ccc70 0x7f724c06c6c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f724c066db0 tx=0x7f723c01c3d0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.920+0000 7f7250881640 1 -- 172.21.15.177:0/3759479215 shutdown_connections 2023-11-28T20:10:28.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.920+0000 7f7250881640 1 --2- 172.21.15.177:0/3759479215 >> v2:172.21.15.195:3300/0 conn(0x7f724c06b640 0x7f724c06bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.920+0000 7f7250881640 1 --2- 172.21.15.177:0/3759479215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f724c0ccc70 0x7f724c06c6c0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.920+0000 7f7250881640 1 -- 172.21.15.177:0/3759479215 >> 172.21.15.177:0/3759479215 conn(0x7f724c0b2860 msgr2=0x7f724c0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:28.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.920+0000 7f7250881640 1 -- 172.21.15.177:0/3759479215 shutdown_connections 2023-11-28T20:10:28.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.920+0000 7f7250881640 1 -- 172.21.15.177:0/3759479215 wait complete. 2023-11-28T20:10:28.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7250881640 1 Processor -- start 2023-11-28T20:10:28.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7250881640 1 -- start start 2023-11-28T20:10:28.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7250881640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f724c06b640 0x7f724c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7250881640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f724c06c000 0x7f724c0ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7250881640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f724c0ccc70 0x7f724c0c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7250881640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c0c9990 con 0x7f724c06c000 2023-11-28T20:10:28.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7250881640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c0c9c70 con 0x7f724c0ccc70 2023-11-28T20:10:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7250881640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724c15f4a0 con 0x7f724c06b640 2023-11-28T20:10:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7243fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f724c06c000 0x7f724c0ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7243fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f724c06c000 0x7f724c0ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49632/0 (socket says 172.21.15.177:49632) 2023-11-28T20:10:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7243fff640 1 -- 172.21.15.177:0/2580256934 learned_addr learned my addr 172.21.15.177:0/2580256934 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f724b7fe640 1 --2- 172.21.15.177:0/2580256934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f724c06b640 0x7f724c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f724bfff640 1 --2- 172.21.15.177:0/2580256934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f724c0ccc70 0x7f724c0c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7243fff640 1 -- 172.21.15.177:0/2580256934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f724c06b640 msgr2=0x7f724c1593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7243fff640 1 --2- 172.21.15.177:0/2580256934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f724c06b640 0x7f724c1593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7243fff640 1 -- 172.21.15.177:0/2580256934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f724c0ccc70 msgr2=0x7f724c0c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7243fff640 1 --2- 172.21.15.177:0/2580256934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f724c0ccc70 0x7f724c0c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7243fff640 1 -- 172.21.15.177:0/2580256934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c009420 con 0x7f724c06c000 2023-11-28T20:10:28.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f724b7fe640 1 --2- 172.21.15.177:0/2580256934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f724c06b640 0x7f724c1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:28.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7243fff640 1 --2- 172.21.15.177:0/2580256934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f724c06c000 0x7f724c0ca760 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f723400d7d0 tx=0x7f723400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:28.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7248ff9640 1 -- 172.21.15.177:0/2580256934 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723400b6c0 con 0x7f724c06c000 2023-11-28T20:10:28.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7248ff9640 1 -- 172.21.15.177:0/2580256934 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723400b820 con 0x7f724c06c000 2023-11-28T20:10:28.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7248ff9640 1 -- 172.21.15.177:0/2580256934 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723400bbd0 con 0x7f724c06c000 2023-11-28T20:10:28.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7250881640 1 -- 172.21.15.177:0/2580256934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724c0d0290 con 0x7f724c06c000 2023-11-28T20:10:28.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7250881640 1 -- 172.21.15.177:0/2580256934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724c1598f0 con 0x7f724c06c000 2023-11-28T20:10:28.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.924+0000 7f7250881640 1 -- 172.21.15.177:0/2580256934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f724c0d0110 con 0x7f724c06c000 2023-11-28T20:10:28.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.928+0000 7f7248ff9640 1 -- 172.21.15.177:0/2580256934 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f723400bd30 con 0x7f724c06c000 2023-11-28T20:10:28.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.928+0000 7f7248ff9640 1 --2- 172.21.15.177:0/2580256934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f722c066470 0x7f722c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.928+0000 7f7248ff9640 1 -- 172.21.15.177:0/2580256934 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7234083f90 con 0x7f724c06c000 2023-11-28T20:10:28.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.928+0000 7f724b7fe640 1 --2- 172.21.15.177:0/2580256934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f722c066470 0x7f722c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.928+0000 7f7248ff9640 1 --2- 172.21.15.177:0/2580256934 >> [v2:172.21.15.195:6808/3998424383,v1:172.21.15.195:6809/3998424383] conn(0x7f722c06c2d0 0x7f722c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:28.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.928+0000 7f7248ff9640 1 -- 172.21.15.177:0/2580256934 --> [v2:172.21.15.195:6808/3998424383,v1:172.21.15.195:6809/3998424383] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f722c06eda0 con 0x7f722c06c2d0 2023-11-28T20:10:28.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.928+0000 7f7248ff9640 1 -- 172.21.15.177:0/2580256934 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7234086510 con 0x7f724c06c000 2023-11-28T20:10:28.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.928+0000 7f724bfff640 1 --2- 172.21.15.177:0/2580256934 >> [v2:172.21.15.195:6808/3998424383,v1:172.21.15.195:6809/3998424383] conn(0x7f722c06c2d0 0x7f722c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:28.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.928+0000 7f724b7fe640 1 --2- 172.21.15.177:0/2580256934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f722c066470 0x7f722c068930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f723c0ae000 tx=0x7f723c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:28.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.928+0000 7f724bfff640 1 --2- 172.21.15.177:0/2580256934 >> [v2:172.21.15.195:6808/3998424383,v1:172.21.15.195:6809/3998424383] conn(0x7f722c06c2d0 0x7f722c06e6f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:28.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.932+0000 7f7248ff9640 1 -- 172.21.15.177:0/2580256934 <== osd.4 v2:172.21.15.195:6808/3998424383 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f722c06eda0 con 0x7f722c06c2d0 2023-11-28T20:10:28.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.944+0000 7f7250881640 1 -- 172.21.15.177:0/2580256934 --> [v2:172.21.15.195:6808/3998424383,v1:172.21.15.195:6809/3998424383] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f724c06e860 con 0x7f722c06c2d0 2023-11-28T20:10:28.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.944+0000 7f7248ff9640 1 -- 172.21.15.177:0/2580256934 <== osd.4 v2:172.21.15.195:6808/3998424383 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7244001e90 con 0x7f722c06c2d0 2023-11-28T20:10:28.948 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:10:28.948 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:10:28.948 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:10:28.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.944+0000 7f7250881640 1 -- 172.21.15.177:0/2580256934 >> [v2:172.21.15.195:6808/3998424383,v1:172.21.15.195:6809/3998424383] conn(0x7f722c06c2d0 msgr2=0x7f722c06e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.944+0000 7f7250881640 1 --2- 172.21.15.177:0/2580256934 >> [v2:172.21.15.195:6808/3998424383,v1:172.21.15.195:6809/3998424383] conn(0x7f722c06c2d0 0x7f722c06e6f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:28.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.944+0000 7f7250881640 1 -- 172.21.15.177:0/2580256934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f722c066470 msgr2=0x7f722c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.944+0000 7f7250881640 1 --2- 172.21.15.177:0/2580256934 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f722c066470 0x7f722c068930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f723c0ae000 tx=0x7f723c0a7000 comp rx=0 tx=0).stop 2023-11-28T20:10:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.944+0000 7f7250881640 1 -- 172.21.15.177:0/2580256934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f724c06c000 msgr2=0x7f724c0ca760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.944+0000 7f7250881640 1 --2- 172.21.15.177:0/2580256934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f724c06c000 0x7f724c0ca760 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f723400d7d0 tx=0x7f723400dc90 comp rx=0 tx=0).stop 2023-11-28T20:10:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.944+0000 7f724bfff640 1 -- 172.21.15.177:0/2580256934 reap_dead start 2023-11-28T20:10:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.944+0000 7f7250881640 1 -- 172.21.15.177:0/2580256934 shutdown_connections 2023-11-28T20:10:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.944+0000 7f7250881640 1 -- 172.21.15.177:0/2580256934 >> 172.21.15.177:0/2580256934 conn(0x7f724c0b2860 msgr2=0x7f724c0d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.944+0000 7f7250881640 1 -- 172.21.15.177:0/2580256934 shutdown_connections 2023-11-28T20:10:28.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:28.944+0000 7f7250881640 1 -- 172.21.15.177:0/2580256934 wait complete. 2023-11-28T20:10:28.966 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-28T20:10:29.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.100+0000 7f861dd9d640 1 Processor -- start 2023-11-28T20:10:29.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.100+0000 7f861dd9d640 1 -- start start 2023-11-28T20:10:29.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.100+0000 7f861dd9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f861813cf30 0x7f861806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.100+0000 7f861dd9d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861815b170 con 0x7f861806c800 2023-11-28T20:10:29.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.100+0000 7f861dd9d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861815b3a0 con 0x7f861815ad40 2023-11-28T20:10:29.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.100+0000 7f861dd9d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861813d310 con 0x7f861813cf30 2023-11-28T20:10:29.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.100+0000 7f8616ffd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f861806c800 0x7f861815a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47844/0 (socket says 172.21.15.177:47844) 2023-11-28T20:10:29.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.100+0000 7f8616ffd640 1 -- 172.21.15.177:0/2525884198 learned_addr learned my addr 172.21.15.177:0/2525884198 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:29.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86177fe640 1 --2- 172.21.15.177:0/2525884198 >> v2:172.21.15.195:3300/0 conn(0x7f861813cf30 0x7f861806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86167fc640 1 -- 172.21.15.177:0/2525884198 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864041824 0 0) 0x7f861815b170 con 0x7f861806c800 2023-11-28T20:10:29.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86167fc640 1 -- 172.21.15.177:0/2525884198 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8600003530 con 0x7f861806c800 2023-11-28T20:10:29.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86167fc640 1 -- 172.21.15.177:0/2525884198 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2277476974 0 0) 0x7f8600003530 con 0x7f861806c800 2023-11-28T20:10:29.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86167fc640 1 -- 172.21.15.177:0/2525884198 >> v2:172.21.15.195:3300/0 conn(0x7f861813cf30 msgr2=0x7f861806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:29.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86167fc640 1 --2- 172.21.15.177:0/2525884198 >> v2:172.21.15.195:3300/0 conn(0x7f861813cf30 0x7f861806c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86167fc640 1 -- 172.21.15.177:0/2525884198 >> v1:172.21.15.195:6789/0 conn(0x7f861815ad40 legacy=0x7f86180cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86167fc640 1 -- 172.21.15.177:0/2525884198 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861813f720 con 0x7f861806c800 2023-11-28T20:10:29.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86167fc640 1 -- 172.21.15.177:0/2525884198 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3792619935 0 0) 0x7f860c001680 con 0x7f861806c800 2023-11-28T20:10:29.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86167fc640 1 -- 172.21.15.177:0/2525884198 >> v1:172.21.15.177:6789/0 conn(0x7f861806c800 legacy=0x7f861815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86167fc640 1 --2- 172.21.15.177:0/2525884198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8600003980 0x7f8600003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86167fc640 1 --2- 172.21.15.177:0/2525884198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8600004380 0x7f8600004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86167fc640 1 --2- 172.21.15.177:0/2525884198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86000050f0 0x7f860000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86167fc640 1 -- 172.21.15.177:0/2525884198 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860000c000 con 0x7f8600003980 2023-11-28T20:10:29.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86167fc640 1 -- 172.21.15.177:0/2525884198 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860000c170 con 0x7f8600004380 2023-11-28T20:10:29.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86167fc640 1 -- 172.21.15.177:0/2525884198 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860000e540 con 0x7f86000050f0 2023-11-28T20:10:29.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86177fe640 1 --2- 172.21.15.177:0/2525884198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8600003980 0x7f8600003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f8616ffd640 1 --2- 172.21.15.177:0/2525884198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8600004380 0x7f8600004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f8617fff640 1 --2- 172.21.15.177:0/2525884198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86000050f0 0x7f860000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86177fe640 1 -- 172.21.15.177:0/2525884198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86000050f0 msgr2=0x7f860000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:29.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86177fe640 1 --2- 172.21.15.177:0/2525884198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86000050f0 0x7f860000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86177fe640 1 -- 172.21.15.177:0/2525884198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8600004380 msgr2=0x7f8600004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:29.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86177fe640 1 --2- 172.21.15.177:0/2525884198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8600004380 0x7f8600004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f86177fe640 1 -- 172.21.15.177:0/2525884198 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8600003530 con 0x7f8600003980 2023-11-28T20:10:29.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f8616ffd640 1 --2- 172.21.15.177:0/2525884198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8600004380 0x7f8600004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:29.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.104+0000 7f8617fff640 1 -- 172.21.15.177:0/2525884198 reap_dead start 2023-11-28T20:10:29.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f86177fe640 1 --2- 172.21.15.177:0/2525884198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8600003980 0x7f8600003d60 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8608009ac0 tx=0x7f860801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec1907e10e4f1ae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:29.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f86167fc640 1 -- 172.21.15.177:0/2525884198 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86080a6410 con 0x7f8600003980 2023-11-28T20:10:29.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f86167fc640 1 -- 172.21.15.177:0/2525884198 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86080a6570 con 0x7f8600003980 2023-11-28T20:10:29.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f86167fc640 1 -- 172.21.15.177:0/2525884198 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86080a6900 con 0x7f8600003980 2023-11-28T20:10:29.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f861dd9d640 1 -- 172.21.15.177:0/2525884198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8600003980 msgr2=0x7f8600003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f861dd9d640 1 --2- 172.21.15.177:0/2525884198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8600003980 0x7f8600003d60 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8608009ac0 tx=0x7f860801ca30 comp rx=0 tx=0).stop 2023-11-28T20:10:29.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f861dd9d640 1 -- 172.21.15.177:0/2525884198 shutdown_connections 2023-11-28T20:10:29.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f861dd9d640 1 --2- 172.21.15.177:0/2525884198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8600003980 0x7f8600003d60 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f861dd9d640 1 -- 172.21.15.177:0/2525884198 >> 172.21.15.177:0/2525884198 conn(0x7f861806a530 msgr2=0x7f861806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:29.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f861dd9d640 1 -- 172.21.15.177:0/2525884198 shutdown_connections 2023-11-28T20:10:29.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f861dd9d640 1 -- 172.21.15.177:0/2525884198 wait complete. 2023-11-28T20:10:29.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f861dd9d640 1 Processor -- start 2023-11-28T20:10:29.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f861dd9d640 1 -- start start 2023-11-28T20:10:29.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f861dd9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8600003980 0x7f86180b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f861dd9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86181340c0 0x7f861815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f861dd9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f861815bae0 0x7f86180b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f861dd9d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86180b1890 con 0x7f86181340c0 2023-11-28T20:10:29.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f861dd9d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861815bf60 con 0x7f8600003980 2023-11-28T20:10:29.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.108+0000 7f861dd9d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86180b3fb0 con 0x7f861815bae0 2023-11-28T20:10:29.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f8616ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86181340c0 0x7f861815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f8616ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86181340c0 0x7f861815b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49648/0 (socket says 172.21.15.177:49648) 2023-11-28T20:10:29.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f8616ffd640 1 -- 172.21.15.177:0/1982241805 learned_addr learned my addr 172.21.15.177:0/1982241805 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:29.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f86177fe640 1 --2- 172.21.15.177:0/1982241805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8600003980 0x7f86180b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f8617fff640 1 --2- 172.21.15.177:0/1982241805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f861815bae0 0x7f86180b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f8616ffd640 1 -- 172.21.15.177:0/1982241805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f861815bae0 msgr2=0x7f86180b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f8616ffd640 1 --2- 172.21.15.177:0/1982241805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f861815bae0 0x7f86180b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f8616ffd640 1 -- 172.21.15.177:0/1982241805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8600003980 msgr2=0x7f86180b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f8616ffd640 1 --2- 172.21.15.177:0/1982241805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8600003980 0x7f86180b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f8616ffd640 1 -- 172.21.15.177:0/1982241805 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86180afd00 con 0x7f86181340c0 2023-11-28T20:10:29.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f8616ffd640 1 --2- 172.21.15.177:0/1982241805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86181340c0 0x7f861815b5a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f860c00e7f0 tx=0x7f860c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:29.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f85fffff640 1 -- 172.21.15.177:0/1982241805 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c00c850 con 0x7f86181340c0 2023-11-28T20:10:29.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f85fffff640 1 -- 172.21.15.177:0/1982241805 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860c00c9b0 con 0x7f86181340c0 2023-11-28T20:10:29.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f85fffff640 1 -- 172.21.15.177:0/1982241805 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c00cd20 con 0x7f86181340c0 2023-11-28T20:10:29.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f861dd9d640 1 -- 172.21.15.177:0/1982241805 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86180aff80 con 0x7f86181340c0 2023-11-28T20:10:29.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f861dd9d640 1 -- 172.21.15.177:0/1982241805 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86180b0520 con 0x7f86181340c0 2023-11-28T20:10:29.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f861dd9d640 1 -- 172.21.15.177:0/1982241805 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8618069440 con 0x7f86181340c0 2023-11-28T20:10:29.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.112+0000 7f85fffff640 1 -- 172.21.15.177:0/1982241805 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f860c01d460 con 0x7f86181340c0 2023-11-28T20:10:29.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.116+0000 7f85fffff640 1 --2- 172.21.15.177:0/1982241805 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8604066470 0x7f8604068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.116+0000 7f85fffff640 1 -- 172.21.15.177:0/1982241805 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f860c083a10 con 0x7f86181340c0 2023-11-28T20:10:29.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.116+0000 7f86177fe640 1 --2- 172.21.15.177:0/1982241805 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8604066470 0x7f8604068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.116+0000 7f86177fe640 1 --2- 172.21.15.177:0/1982241805 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8604066470 0x7f8604068930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f86080ad000 tx=0x7f86080046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:29.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.120+0000 7f85fffff640 1 -- 172.21.15.177:0/1982241805 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f860c0511b0 con 0x7f86181340c0 2023-11-28T20:10:29.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.268+0000 7f861dd9d640 1 -- 172.21.15.177:0/1982241805 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f861813ffc0 con 0x7f8604066470 2023-11-28T20:10:29.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.268+0000 7f85fffff640 1 -- 172.21.15.177:0/1982241805 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f86080a66e0 con 0x7f8604066470 2023-11-28T20:10:29.272 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 4 to deep-scrub 2023-11-28T20:10:29.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.268+0000 7f861dd9d640 1 -- 172.21.15.177:0/1982241805 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8604066470 msgr2=0x7f8604068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.268+0000 7f861dd9d640 1 --2- 172.21.15.177:0/1982241805 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8604066470 0x7f8604068930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f86080ad000 tx=0x7f86080046d0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.268+0000 7f861dd9d640 1 -- 172.21.15.177:0/1982241805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86181340c0 msgr2=0x7f861815b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.268+0000 7f861dd9d640 1 --2- 172.21.15.177:0/1982241805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86181340c0 0x7f861815b5a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f860c00e7f0 tx=0x7f860c00ecb0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.268+0000 7f861dd9d640 1 -- 172.21.15.177:0/1982241805 shutdown_connections 2023-11-28T20:10:29.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.268+0000 7f861dd9d640 1 --2- 172.21.15.177:0/1982241805 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f8604066470 0x7f8604068930 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.272+0000 7f861dd9d640 1 --2- 172.21.15.177:0/1982241805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f861815bae0 0x7f86180b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.272+0000 7f861dd9d640 1 --2- 172.21.15.177:0/1982241805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86181340c0 0x7f861815b5a0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.272+0000 7f861dd9d640 1 --2- 172.21.15.177:0/1982241805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8600003980 0x7f86180b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.272+0000 7f861dd9d640 1 -- 172.21.15.177:0/1982241805 >> 172.21.15.177:0/1982241805 conn(0x7f861806a530 msgr2=0x7f861813d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:29.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.272+0000 7f861dd9d640 1 -- 172.21.15.177:0/1982241805 shutdown_connections 2023-11-28T20:10:29.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.272+0000 7f861dd9d640 1 -- 172.21.15.177:0/1982241805 wait complete. 2023-11-28T20:10:29.294 INFO:tasks.ceph:Scrubbing osd.5 2023-11-28T20:10:29.294 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:10:29.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.432+0000 7f177131d640 1 Processor -- start 2023-11-28T20:10:29.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.432+0000 7f177131d640 1 -- start start 2023-11-28T20:10:29.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.432+0000 7f177131d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f176c15a480 0x7f176c0ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.432+0000 7f177131d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f176c06d6f0 0x7f176c06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.432+0000 7f177131d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c0ce370 con 0x7f176c0ae620 2023-11-28T20:10:29.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.432+0000 7f177131d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c0cd570 con 0x7f176c15a480 2023-11-28T20:10:29.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.432+0000 7f177131d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c06e060 con 0x7f176c06d6f0 2023-11-28T20:10:29.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.432+0000 7f176affd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f176c15a480 0x7f176c0ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.436+0000 7f176affd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f176c15a480 0x7f176c0ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49658/0 (socket says 172.21.15.177:49658) 2023-11-28T20:10:29.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.436+0000 7f176affd640 1 -- 172.21.15.177:0/3945532916 learned_addr learned my addr 172.21.15.177:0/3945532916 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:29.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.436+0000 7f176b7fe640 1 --2- 172.21.15.177:0/3945532916 >> v2:172.21.15.195:3300/0 conn(0x7f176c06d6f0 0x7f176c06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.436+0000 7f176affd640 1 -- 172.21.15.177:0/3945532916 >> v2:172.21.15.195:3300/0 conn(0x7f176c06d6f0 msgr2=0x7f176c06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:29.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.436+0000 7f176affd640 1 --2- 172.21.15.177:0/3945532916 >> v2:172.21.15.195:3300/0 conn(0x7f176c06d6f0 0x7f176c06db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.436+0000 7f176affd640 1 -- 172.21.15.177:0/3945532916 >> v1:172.21.15.195:6789/0 conn(0x7f176c0ae620 legacy=0x7f176c0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.436+0000 7f176affd640 1 -- 172.21.15.177:0/3945532916 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c0cd760 con 0x7f176c15a480 2023-11-28T20:10:29.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.436+0000 7f176affd640 1 --2- 172.21.15.177:0/3945532916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f176c15a480 0x7f176c0ce800 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f176c06be60 tx=0x7f175401ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5b08383187c732 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:29.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.436+0000 7f176a7fc640 1 -- 172.21.15.177:0/3945532916 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17540a7ca0 con 0x7f176c15a480 2023-11-28T20:10:29.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.436+0000 7f176a7fc640 1 -- 172.21.15.177:0/3945532916 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17540a7e00 con 0x7f176c15a480 2023-11-28T20:10:29.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.436+0000 7f176a7fc640 1 -- 172.21.15.177:0/3945532916 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17540af660 con 0x7f176c15a480 2023-11-28T20:10:29.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 -- 172.21.15.177:0/3945532916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f176c15a480 msgr2=0x7f176c0ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 --2- 172.21.15.177:0/3945532916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f176c15a480 0x7f176c0ce800 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f176c06be60 tx=0x7f175401ebd0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 -- 172.21.15.177:0/3945532916 shutdown_connections 2023-11-28T20:10:29.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 --2- 172.21.15.177:0/3945532916 >> v2:172.21.15.195:3300/0 conn(0x7f176c06d6f0 0x7f176c06db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 --2- 172.21.15.177:0/3945532916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f176c15a480 0x7f176c0ce800 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 -- 172.21.15.177:0/3945532916 >> 172.21.15.177:0/3945532916 conn(0x7f176c0b0c50 msgr2=0x7f176c0b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:29.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 -- 172.21.15.177:0/3945532916 shutdown_connections 2023-11-28T20:10:29.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 -- 172.21.15.177:0/3945532916 wait complete. 2023-11-28T20:10:29.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 Processor -- start 2023-11-28T20:10:29.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 -- start start 2023-11-28T20:10:29.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f176c06d6f0 0x7f176c14c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f176c0ae620 0x7f176c149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f176c15a480 0x7f176c150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c14a200 con 0x7f176c0ae620 2023-11-28T20:10:29.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c1563d0 con 0x7f176c15a480 2023-11-28T20:10:29.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f177131d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c159680 con 0x7f176c06d6f0 2023-11-28T20:10:29.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f17627fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f176c0ae620 0x7f176c149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f17627fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f176c0ae620 0x7f176c149cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49672/0 (socket says 172.21.15.177:49672) 2023-11-28T20:10:29.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f17627fc640 1 -- 172.21.15.177:0/1913857049 learned_addr learned my addr 172.21.15.177:0/1913857049 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:29.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f176affd640 1 --2- 172.21.15.177:0/1913857049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f176c06d6f0 0x7f176c14c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.440+0000 7f176b7fe640 1 --2- 172.21.15.177:0/1913857049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f176c15a480 0x7f176c150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f17627fc640 1 -- 172.21.15.177:0/1913857049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f176c06d6f0 msgr2=0x7f176c14c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f17627fc640 1 --2- 172.21.15.177:0/1913857049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f176c06d6f0 0x7f176c14c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f17627fc640 1 -- 172.21.15.177:0/1913857049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f176c15a480 msgr2=0x7f176c150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f17627fc640 1 --2- 172.21.15.177:0/1913857049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f176c15a480 0x7f176c150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f17627fc640 1 -- 172.21.15.177:0/1913857049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175400b770 con 0x7f176c0ae620 2023-11-28T20:10:29.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f17627fc640 1 --2- 172.21.15.177:0/1913857049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f176c0ae620 0x7f176c149cc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f175c00c4d0 tx=0x7f175c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:29.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f1763fff640 1 -- 172.21.15.177:0/1913857049 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0052d0 con 0x7f176c0ae620 2023-11-28T20:10:29.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f1763fff640 1 -- 172.21.15.177:0/1913857049 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c005430 con 0x7f176c0ae620 2023-11-28T20:10:29.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f1763fff640 1 -- 172.21.15.177:0/1913857049 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c012830 con 0x7f176c0ae620 2023-11-28T20:10:29.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f177131d640 1 -- 172.21.15.177:0/1913857049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c159960 con 0x7f176c0ae620 2023-11-28T20:10:29.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f177131d640 1 -- 172.21.15.177:0/1913857049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c1553e0 con 0x7f176c0ae620 2023-11-28T20:10:29.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f177131d640 1 -- 172.21.15.177:0/1913857049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f176c0693d0 con 0x7f176c0ae620 2023-11-28T20:10:29.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f1763fff640 1 -- 172.21.15.177:0/1913857049 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f175c012990 con 0x7f176c0ae620 2023-11-28T20:10:29.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f1763fff640 1 --2- 172.21.15.177:0/1913857049 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f174c066470 0x7f174c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f1763fff640 1 -- 172.21.15.177:0/1913857049 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f175c083540 con 0x7f176c0ae620 2023-11-28T20:10:29.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f176affd640 1 --2- 172.21.15.177:0/1913857049 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f174c066470 0x7f174c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f1763fff640 1 --2- 172.21.15.177:0/1913857049 >> [v2:172.21.15.195:6800/1295097681,v1:172.21.15.195:6801/1295097681] conn(0x7f174c06c2d0 0x7f174c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f1763fff640 1 -- 172.21.15.177:0/1913857049 --> [v2:172.21.15.195:6800/1295097681,v1:172.21.15.195:6801/1295097681] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f174c06eda0 con 0x7f174c06c2d0 2023-11-28T20:10:29.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.444+0000 7f1763fff640 1 -- 172.21.15.177:0/1913857049 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f175c085c00 con 0x7f176c0ae620 2023-11-28T20:10:29.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.448+0000 7f176b7fe640 1 --2- 172.21.15.177:0/1913857049 >> [v2:172.21.15.195:6800/1295097681,v1:172.21.15.195:6801/1295097681] conn(0x7f174c06c2d0 0x7f174c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.448+0000 7f176affd640 1 --2- 172.21.15.177:0/1913857049 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f174c066470 0x7f174c068930 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f17540b1000 tx=0x7f17540a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:29.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.448+0000 7f176b7fe640 1 --2- 172.21.15.177:0/1913857049 >> [v2:172.21.15.195:6800/1295097681,v1:172.21.15.195:6801/1295097681] conn(0x7f174c06c2d0 0x7f174c06e6f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:29.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.448+0000 7f1763fff640 1 -- 172.21.15.177:0/1913857049 <== osd.5 v2:172.21.15.195:6800/1295097681 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f174c06eda0 con 0x7f174c06c2d0 2023-11-28T20:10:29.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.460+0000 7f177131d640 1 -- 172.21.15.177:0/1913857049 --> [v2:172.21.15.195:6800/1295097681,v1:172.21.15.195:6801/1295097681] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f176c04e850 con 0x7f174c06c2d0 2023-11-28T20:10:29.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.460+0000 7f1763fff640 1 -- 172.21.15.177:0/1913857049 <== osd.5 v2:172.21.15.195:6800/1295097681 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f176c04e850 con 0x7f174c06c2d0 2023-11-28T20:10:29.466 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:10:29.466 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:10:29.467 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:10:29.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.460+0000 7f177131d640 1 -- 172.21.15.177:0/1913857049 >> [v2:172.21.15.195:6800/1295097681,v1:172.21.15.195:6801/1295097681] conn(0x7f174c06c2d0 msgr2=0x7f174c06e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.464+0000 7f177131d640 1 --2- 172.21.15.177:0/1913857049 >> [v2:172.21.15.195:6800/1295097681,v1:172.21.15.195:6801/1295097681] conn(0x7f174c06c2d0 0x7f174c06e6f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.464+0000 7f177131d640 1 -- 172.21.15.177:0/1913857049 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f174c066470 msgr2=0x7f174c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.464+0000 7f177131d640 1 --2- 172.21.15.177:0/1913857049 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f174c066470 0x7f174c068930 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f17540b1000 tx=0x7f17540a9070 comp rx=0 tx=0).stop 2023-11-28T20:10:29.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.464+0000 7f177131d640 1 -- 172.21.15.177:0/1913857049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f176c0ae620 msgr2=0x7f176c149cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.464+0000 7f177131d640 1 --2- 172.21.15.177:0/1913857049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f176c0ae620 0x7f176c149cc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f175c00c4d0 tx=0x7f175c00c990 comp rx=0 tx=0).stop 2023-11-28T20:10:29.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.464+0000 7f176b7fe640 1 -- 172.21.15.177:0/1913857049 reap_dead start 2023-11-28T20:10:29.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.464+0000 7f177131d640 1 -- 172.21.15.177:0/1913857049 shutdown_connections 2023-11-28T20:10:29.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.464+0000 7f177131d640 1 -- 172.21.15.177:0/1913857049 >> 172.21.15.177:0/1913857049 conn(0x7f176c0b0c50 msgr2=0x7f176c0cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:29.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.464+0000 7f177131d640 1 -- 172.21.15.177:0/1913857049 shutdown_connections 2023-11-28T20:10:29.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.464+0000 7f177131d640 1 -- 172.21.15.177:0/1913857049 wait complete. 2023-11-28T20:10:29.485 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-28T20:10:29.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.620+0000 7f3599079640 1 Processor -- start 2023-11-28T20:10:29.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.620+0000 7f3599079640 1 -- start start 2023-11-28T20:10:29.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.620+0000 7f3599079640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f359413cf30 0x7f359406c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.620+0000 7f3599079640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f359406c800 0x7f359415a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.620+0000 7f3599079640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359415b3a0 con 0x7f359415ab70 2023-11-28T20:10:29.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.620+0000 7f3599079640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359413d310 con 0x7f359413cf30 2023-11-28T20:10:29.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.620+0000 7f3599079640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35941404e0 con 0x7f359406c800 2023-11-28T20:10:29.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.624+0000 7f3592d9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f359413cf30 0x7f359406c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.624+0000 7f3592d9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f359413cf30 0x7f359406c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49676/0 (socket says 172.21.15.177:49676) 2023-11-28T20:10:29.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.624+0000 7f3592d9d640 1 -- 172.21.15.177:0/1143311777 learned_addr learned my addr 172.21.15.177:0/1143311777 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:29.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.624+0000 7f358a59c640 1 --2- 172.21.15.177:0/1143311777 >> v2:172.21.15.195:3300/0 conn(0x7f359406c800 0x7f359415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.624+0000 7f3592d9d640 1 -- 172.21.15.177:0/1143311777 >> v2:172.21.15.195:3300/0 conn(0x7f359406c800 msgr2=0x7f359415a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:29.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.624+0000 7f3592d9d640 1 --2- 172.21.15.177:0/1143311777 >> v2:172.21.15.195:3300/0 conn(0x7f359406c800 0x7f359415a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.624+0000 7f3592d9d640 1 -- 172.21.15.177:0/1143311777 >> v1:172.21.15.195:6789/0 conn(0x7f359415ab70 legacy=0x7f3594071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.624+0000 7f3592d9d640 1 -- 172.21.15.177:0/1143311777 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359413f720 con 0x7f359413cf30 2023-11-28T20:10:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.624+0000 7f3592d9d640 1 --2- 172.21.15.177:0/1143311777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f359413cf30 0x7f359406c2c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f35940cc790 tx=0x7f358401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd402c81cb7d4e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.624+0000 7f359259c640 1 -- 172.21.15.177:0/1143311777 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35840ad660 con 0x7f359413cf30 2023-11-28T20:10:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.624+0000 7f359259c640 1 -- 172.21.15.177:0/1143311777 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35840ad7c0 con 0x7f359413cf30 2023-11-28T20:10:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.624+0000 7f359259c640 1 -- 172.21.15.177:0/1143311777 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35840adb50 con 0x7f359413cf30 2023-11-28T20:10:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 -- 172.21.15.177:0/1143311777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f359413cf30 msgr2=0x7f359406c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 --2- 172.21.15.177:0/1143311777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f359413cf30 0x7f359406c2c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f35940cc790 tx=0x7f358401c470 comp rx=0 tx=0).stop 2023-11-28T20:10:29.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 -- 172.21.15.177:0/1143311777 shutdown_connections 2023-11-28T20:10:29.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 --2- 172.21.15.177:0/1143311777 >> v2:172.21.15.195:3300/0 conn(0x7f359406c800 0x7f359415a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 --2- 172.21.15.177:0/1143311777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f359413cf30 0x7f359406c2c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 -- 172.21.15.177:0/1143311777 >> 172.21.15.177:0/1143311777 conn(0x7f359406a530 msgr2=0x7f359406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:29.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 -- 172.21.15.177:0/1143311777 shutdown_connections 2023-11-28T20:10:29.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 -- 172.21.15.177:0/1143311777 wait complete. 2023-11-28T20:10:29.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 Processor -- start 2023-11-28T20:10:29.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 -- start start 2023-11-28T20:10:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f359406c800 0x7f35941386f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f359413cf30 0x7f359414fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f359415ab70 0x7f35941502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35940b1e30 con 0x7f359406c800 2023-11-28T20:10:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35940b2110 con 0x7f359415ab70 2023-11-28T20:10:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3599079640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35940b23f0 con 0x7f359413cf30 2023-11-28T20:10:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3592d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f359406c800 0x7f35941386f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3592d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f359406c800 0x7f35941386f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49690/0 (socket says 172.21.15.177:49690) 2023-11-28T20:10:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.628+0000 7f3592d9d640 1 -- 172.21.15.177:0/1300120324 learned_addr learned my addr 172.21.15.177:0/1300120324 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f358a59c640 1 --2- 172.21.15.177:0/1300120324 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f359413cf30 0x7f359414fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f359359e640 1 --2- 172.21.15.177:0/1300120324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f359415ab70 0x7f35941502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f3592d9d640 1 -- 172.21.15.177:0/1300120324 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f359413cf30 msgr2=0x7f359414fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f3592d9d640 1 --2- 172.21.15.177:0/1300120324 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f359413cf30 0x7f359414fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f3592d9d640 1 -- 172.21.15.177:0/1300120324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f359415ab70 msgr2=0x7f35941502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f3592d9d640 1 --2- 172.21.15.177:0/1300120324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f359415ab70 0x7f35941502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f3592d9d640 1 -- 172.21.15.177:0/1300120324 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35840094d0 con 0x7f359406c800 2023-11-28T20:10:29.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f358a59c640 1 --2- 172.21.15.177:0/1300120324 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f359413cf30 0x7f359414fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:29.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f3592d9d640 1 --2- 172.21.15.177:0/1300120324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f359406c800 0x7f35941386f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3584019080 tx=0x7f3584019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:29.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f358bfff640 1 -- 172.21.15.177:0/1300120324 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35840b6440 con 0x7f359406c800 2023-11-28T20:10:29.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f358bfff640 1 -- 172.21.15.177:0/1300120324 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35840b65a0 con 0x7f359406c800 2023-11-28T20:10:29.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f358bfff640 1 -- 172.21.15.177:0/1300120324 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35840b6950 con 0x7f359406c800 2023-11-28T20:10:29.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f3599079640 1 -- 172.21.15.177:0/1300120324 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35940b26d0 con 0x7f359406c800 2023-11-28T20:10:29.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f3599079640 1 -- 172.21.15.177:0/1300120324 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3594138c30 con 0x7f359406c800 2023-11-28T20:10:29.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f3599079640 1 -- 172.21.15.177:0/1300120324 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3594069440 con 0x7f359406c800 2023-11-28T20:10:29.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f358bfff640 1 -- 172.21.15.177:0/1300120324 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f35840b4070 con 0x7f359406c800 2023-11-28T20:10:29.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.632+0000 7f358bfff640 1 --2- 172.21.15.177:0/1300120324 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3574066470 0x7f3574068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.636+0000 7f358bfff640 1 -- 172.21.15.177:0/1300120324 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f358411d5b0 con 0x7f359406c800 2023-11-28T20:10:29.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.636+0000 7f358a59c640 1 --2- 172.21.15.177:0/1300120324 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3574066470 0x7f3574068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.636+0000 7f358a59c640 1 --2- 172.21.15.177:0/1300120324 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3574066470 0x7f3574068930 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3594154590 tx=0x7f357c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:29.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.640+0000 7f358bfff640 1 -- 172.21.15.177:0/1300120324 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35840eac90 con 0x7f359406c800 2023-11-28T20:10:29.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.788+0000 7f3599079640 1 -- 172.21.15.177:0/1300120324 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f359415c7e0 con 0x7f3574066470 2023-11-28T20:10:29.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.788+0000 7f358bfff640 1 -- 172.21.15.177:0/1300120324 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f359415c7e0 con 0x7f3574066470 2023-11-28T20:10:29.792 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 5 to deep-scrub 2023-11-28T20:10:29.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.788+0000 7f3599079640 1 -- 172.21.15.177:0/1300120324 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3574066470 msgr2=0x7f3574068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.788+0000 7f3599079640 1 --2- 172.21.15.177:0/1300120324 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3574066470 0x7f3574068930 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3594154590 tx=0x7f357c00b040 comp rx=0 tx=0).stop 2023-11-28T20:10:29.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.788+0000 7f3599079640 1 -- 172.21.15.177:0/1300120324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f359406c800 msgr2=0x7f35941386f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.788+0000 7f3599079640 1 --2- 172.21.15.177:0/1300120324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f359406c800 0x7f35941386f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3584019080 tx=0x7f3584019210 comp rx=0 tx=0).stop 2023-11-28T20:10:29.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.788+0000 7f3599079640 1 -- 172.21.15.177:0/1300120324 shutdown_connections 2023-11-28T20:10:29.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.788+0000 7f3599079640 1 --2- 172.21.15.177:0/1300120324 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f3574066470 0x7f3574068930 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.788+0000 7f3599079640 1 --2- 172.21.15.177:0/1300120324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f359415ab70 0x7f35941502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.788+0000 7f3599079640 1 --2- 172.21.15.177:0/1300120324 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f359413cf30 0x7f359414fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.788+0000 7f3599079640 1 --2- 172.21.15.177:0/1300120324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f359406c800 0x7f35941386f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.788+0000 7f3599079640 1 -- 172.21.15.177:0/1300120324 >> 172.21.15.177:0/1300120324 conn(0x7f359406a530 msgr2=0x7f359413d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:29.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.792+0000 7f3599079640 1 -- 172.21.15.177:0/1300120324 shutdown_connections 2023-11-28T20:10:29.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.792+0000 7f3599079640 1 -- 172.21.15.177:0/1300120324 wait complete. 2023-11-28T20:10:29.813 INFO:tasks.ceph:Scrubbing osd.6 2023-11-28T20:10:29.813 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:10:29.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.952+0000 7eff08dd1640 1 Processor -- start 2023-11-28T20:10:29.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.952+0000 7eff08dd1640 1 -- start start 2023-11-28T20:10:29.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.956+0000 7eff08dd1640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7eff04159ba0 0x7eff040c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.956+0000 7eff08dd1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff040cb0c0 0x7eff04070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.956+0000 7eff08dd1640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff04159f80 con 0x7eff040cce60 2023-11-28T20:10:29.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.956+0000 7eff08dd1640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040cb520 con 0x7eff04159ba0 2023-11-28T20:10:29.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.956+0000 7eff08dd1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff040ce460 con 0x7eff040cb0c0 2023-11-28T20:10:29.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.956+0000 7eff0259c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7eff04159ba0 0x7eff040c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.956+0000 7eff0259c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7eff04159ba0 0x7eff040c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49706/0 (socket says 172.21.15.177:49706) 2023-11-28T20:10:29.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.956+0000 7eff0259c640 1 -- 172.21.15.177:0/3598283466 learned_addr learned my addr 172.21.15.177:0/3598283466 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:29.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.956+0000 7eff0259c640 1 -- 172.21.15.177:0/3598283466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff040cb0c0 msgr2=0x7eff04070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:29.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.956+0000 7eff0259c640 1 --2- 172.21.15.177:0/3598283466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff040cb0c0 0x7eff04070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.956+0000 7eff0259c640 1 -- 172.21.15.177:0/3598283466 >> v1:172.21.15.177:6789/0 conn(0x7eff040cce60 legacy=0x7eff0406c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.956+0000 7eff0259c640 1 -- 172.21.15.177:0/3598283466 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff040cda30 con 0x7eff04159ba0 2023-11-28T20:10:29.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.956+0000 7eff01d9b640 1 -- 172.21.15.177:0/3598283466 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449300236 0 0) 0x7eff04159f80 con 0x7eff040cce60 2023-11-28T20:10:29.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.960+0000 7eff0259c640 1 --2- 172.21.15.177:0/3598283466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04159ba0 0x7eff040c98e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7efef4009870 tx=0x7efef401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f5fbafb0e6355d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:29.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.960+0000 7eff01d9b640 1 -- 172.21.15.177:0/3598283466 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef40ab620 con 0x7eff04159ba0 2023-11-28T20:10:29.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.960+0000 7eff01d9b640 1 -- 172.21.15.177:0/3598283466 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef40ab780 con 0x7eff04159ba0 2023-11-28T20:10:29.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.960+0000 7eff01d9b640 1 -- 172.21.15.177:0/3598283466 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef40abb10 con 0x7eff04159ba0 2023-11-28T20:10:29.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.960+0000 7eff08dd1640 1 -- 172.21.15.177:0/3598283466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04159ba0 msgr2=0x7eff040c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.960+0000 7eff08dd1640 1 --2- 172.21.15.177:0/3598283466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04159ba0 0x7eff040c98e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7efef4009870 tx=0x7efef401c510 comp rx=0 tx=0).stop 2023-11-28T20:10:29.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.960+0000 7eff08dd1640 1 -- 172.21.15.177:0/3598283466 shutdown_connections 2023-11-28T20:10:29.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.960+0000 7eff08dd1640 1 --2- 172.21.15.177:0/3598283466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff040cb0c0 0x7eff04070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.960+0000 7eff08dd1640 1 --2- 172.21.15.177:0/3598283466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04159ba0 0x7eff040c98e0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.960+0000 7eff08dd1640 1 -- 172.21.15.177:0/3598283466 >> 172.21.15.177:0/3598283466 conn(0x7eff040b0c50 msgr2=0x7eff040b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.960+0000 7eff08dd1640 1 -- 172.21.15.177:0/3598283466 shutdown_connections 2023-11-28T20:10:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.960+0000 7eff08dd1640 1 -- 172.21.15.177:0/3598283466 wait complete. 2023-11-28T20:10:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.960+0000 7eff08dd1640 1 Processor -- start 2023-11-28T20:10:29.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.960+0000 7eff08dd1640 1 -- start start 2023-11-28T20:10:29.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff08dd1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff040cb0c0 0x7eff04149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff08dd1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff040cce60 0x7eff040adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff08dd1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04159ba0 0x7eff0415bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff08dd1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0415b7d0 con 0x7eff04159ba0 2023-11-28T20:10:29.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff08dd1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0415af30 con 0x7eff040cb0c0 2023-11-28T20:10:29.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff08dd1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0415b210 con 0x7eff040cce60 2023-11-28T20:10:29.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff02d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04159ba0 0x7eff0415bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff02d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04159ba0 0x7eff0415bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49714/0 (socket says 172.21.15.177:49714) 2023-11-28T20:10:29.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff02d9d640 1 -- 172.21.15.177:0/3406565637 learned_addr learned my addr 172.21.15.177:0/3406565637 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:29.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff0259c640 1 --2- 172.21.15.177:0/3406565637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff040cb0c0 0x7eff04149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7efefbfff640 1 --2- 172.21.15.177:0/3406565637 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff040cce60 0x7eff040adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff02d9d640 1 -- 172.21.15.177:0/3406565637 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff040cce60 msgr2=0x7eff040adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff02d9d640 1 --2- 172.21.15.177:0/3406565637 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff040cce60 0x7eff040adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff02d9d640 1 -- 172.21.15.177:0/3406565637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff040cb0c0 msgr2=0x7eff04149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff02d9d640 1 --2- 172.21.15.177:0/3406565637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff040cb0c0 0x7eff04149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff02d9d640 1 -- 172.21.15.177:0/3406565637 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef40094d0 con 0x7eff04159ba0 2023-11-28T20:10:29.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7efefbfff640 1 --2- 172.21.15.177:0/3406565637 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff040cce60 0x7eff040adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:29.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff02d9d640 1 --2- 172.21.15.177:0/3406565637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04159ba0 0x7eff0415bf40 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7efefc001570 tx=0x7efefc00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:29.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7efefaffd640 1 -- 172.21.15.177:0/3406565637 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc003db0 con 0x7eff04159ba0 2023-11-28T20:10:29.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7efefaffd640 1 -- 172.21.15.177:0/3406565637 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc00ce30 con 0x7eff04159ba0 2023-11-28T20:10:29.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7efefaffd640 1 -- 172.21.15.177:0/3406565637 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc0052b0 con 0x7eff04159ba0 2023-11-28T20:10:29.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff08dd1640 1 -- 172.21.15.177:0/3406565637 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0415b4f0 con 0x7eff04159ba0 2023-11-28T20:10:29.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff08dd1640 1 -- 172.21.15.177:0/3406565637 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff040ae450 con 0x7eff04159ba0 2023-11-28T20:10:29.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7eff08dd1640 1 -- 172.21.15.177:0/3406565637 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7eff040cec20 con 0x7eff04159ba0 2023-11-28T20:10:29.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.964+0000 7efefaffd640 1 -- 172.21.15.177:0/3406565637 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efefc005410 con 0x7eff04159ba0 2023-11-28T20:10:29.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.968+0000 7efefaffd640 1 --2- 172.21.15.177:0/3406565637 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efee40664a0 0x7efee4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.968+0000 7efefaffd640 1 -- 172.21.15.177:0/3406565637 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efefc0832a0 con 0x7eff04159ba0 2023-11-28T20:10:29.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.968+0000 7efefaffd640 1 --2- 172.21.15.177:0/3406565637 >> [v2:172.21.15.195:6816/1289013754,v1:172.21.15.195:6817/1289013754] conn(0x7efee406c300 0x7efee406e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:29.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.968+0000 7eff0259c640 1 --2- 172.21.15.177:0/3406565637 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efee40664a0 0x7efee4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.968+0000 7efefaffd640 1 -- 172.21.15.177:0/3406565637 --> [v2:172.21.15.195:6816/1289013754,v1:172.21.15.195:6817/1289013754] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efee406edd0 con 0x7efee406c300 2023-11-28T20:10:29.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.968+0000 7efefaffd640 1 -- 172.21.15.177:0/3406565637 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7efefc085960 con 0x7eff04159ba0 2023-11-28T20:10:29.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.968+0000 7efefbfff640 1 --2- 172.21.15.177:0/3406565637 >> [v2:172.21.15.195:6816/1289013754,v1:172.21.15.195:6817/1289013754] conn(0x7efee406c300 0x7efee406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:29.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.968+0000 7eff0259c640 1 --2- 172.21.15.177:0/3406565637 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efee40664a0 0x7efee4068960 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efef40af000 tx=0x7efef40b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:29.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.968+0000 7efefbfff640 1 --2- 172.21.15.177:0/3406565637 >> [v2:172.21.15.195:6816/1289013754,v1:172.21.15.195:6817/1289013754] conn(0x7efee406c300 0x7efee406e720 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:29.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.968+0000 7efefaffd640 1 -- 172.21.15.177:0/3406565637 <== osd.6 v2:172.21.15.195:6816/1289013754 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efee406edd0 con 0x7efee406c300 2023-11-28T20:10:29.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.980+0000 7eff08dd1640 1 -- 172.21.15.177:0/3406565637 --> [v2:172.21.15.195:6816/1289013754,v1:172.21.15.195:6817/1289013754] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7eff040cd6c0 con 0x7efee406c300 2023-11-28T20:10:29.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.984+0000 7efefaffd640 1 -- 172.21.15.177:0/3406565637 <== osd.6 v2:172.21.15.195:6816/1289013754 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efeec0095a0 con 0x7efee406c300 2023-11-28T20:10:29.986 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:10:29.987 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:10:29.987 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:10:29.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.984+0000 7eff08dd1640 1 -- 172.21.15.177:0/3406565637 >> [v2:172.21.15.195:6816/1289013754,v1:172.21.15.195:6817/1289013754] conn(0x7efee406c300 msgr2=0x7efee406e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.984+0000 7eff08dd1640 1 --2- 172.21.15.177:0/3406565637 >> [v2:172.21.15.195:6816/1289013754,v1:172.21.15.195:6817/1289013754] conn(0x7efee406c300 0x7efee406e720 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.984+0000 7eff08dd1640 1 -- 172.21.15.177:0/3406565637 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efee40664a0 msgr2=0x7efee4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.984+0000 7eff08dd1640 1 --2- 172.21.15.177:0/3406565637 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7efee40664a0 0x7efee4068960 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efef40af000 tx=0x7efef40b6040 comp rx=0 tx=0).stop 2023-11-28T20:10:29.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.984+0000 7eff08dd1640 1 -- 172.21.15.177:0/3406565637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04159ba0 msgr2=0x7eff0415bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:29.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.984+0000 7eff08dd1640 1 --2- 172.21.15.177:0/3406565637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04159ba0 0x7eff0415bf40 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7efefc001570 tx=0x7efefc00cbe0 comp rx=0 tx=0).stop 2023-11-28T20:10:29.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.984+0000 7eff02d9d640 1 -- 172.21.15.177:0/3406565637 reap_dead start 2023-11-28T20:10:29.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.984+0000 7eff08dd1640 1 -- 172.21.15.177:0/3406565637 shutdown_connections 2023-11-28T20:10:29.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.984+0000 7eff08dd1640 1 -- 172.21.15.177:0/3406565637 >> 172.21.15.177:0/3406565637 conn(0x7eff040b0c50 msgr2=0x7eff04070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:29.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.984+0000 7eff08dd1640 1 -- 172.21.15.177:0/3406565637 shutdown_connections 2023-11-28T20:10:29.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:29.984+0000 7eff08dd1640 1 -- 172.21.15.177:0/3406565637 wait complete. 2023-11-28T20:10:30.007 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-28T20:10:30.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.140+0000 7f2c823d1640 1 Processor -- start 2023-11-28T20:10:30.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.140+0000 7f2c823d1640 1 -- start start 2023-11-28T20:10:30.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.140+0000 7f2c823d1640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2c7c144840 0x7f2c7c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.140+0000 7f2c823d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c7c072180 0x7f2c7c06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.140+0000 7f2c823d1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7c0710e0 con 0x7f2c7c070460 2023-11-28T20:10:30.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.140+0000 7f2c823d1640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7c15f010 con 0x7f2c7c144840 2023-11-28T20:10:30.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.140+0000 7f2c823d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0713c0 con 0x7f2c7c072180 2023-11-28T20:10:30.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.144+0000 7f2c7bfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2c7c144840 0x7f2c7c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.144+0000 7f2c7bfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2c7c144840 0x7f2c7c06c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49724/0 (socket says 172.21.15.177:49724) 2023-11-28T20:10:30.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.144+0000 7f2c7bfff640 1 -- 172.21.15.177:0/945821270 learned_addr learned my addr 172.21.15.177:0/945821270 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:30.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.144+0000 7f2c7b7fe640 1 --2- 172.21.15.177:0/945821270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c7c072180 0x7f2c7c06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.144+0000 7f2c7bfff640 1 -- 172.21.15.177:0/945821270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c7c072180 msgr2=0x7f2c7c06c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:30.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.144+0000 7f2c7bfff640 1 --2- 172.21.15.177:0/945821270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c7c072180 0x7f2c7c06c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.144+0000 7f2c7bfff640 1 -- 172.21.15.177:0/945821270 >> v1:172.21.15.195:6789/0 conn(0x7f2c7c070460 legacy=0x7f2c7c0708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.144+0000 7f2c7bfff640 1 -- 172.21.15.177:0/945821270 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c0716a0 con 0x7f2c7c144840 2023-11-28T20:10:30.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.144+0000 7f2c7bfff640 1 --2- 172.21.15.177:0/945821270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c7c144840 0x7f2c7c06c2c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009870 tx=0x7f2c6c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f22c10ee8db8b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:30.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.144+0000 7f2c7affd640 1 -- 172.21.15.177:0/945821270 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0aa670 con 0x7f2c7c144840 2023-11-28T20:10:30.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.144+0000 7f2c7affd640 1 -- 172.21.15.177:0/945821270 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c0aa7d0 con 0x7f2c7c144840 2023-11-28T20:10:30.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.144+0000 7f2c7affd640 1 -- 172.21.15.177:0/945821270 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0aab60 con 0x7f2c7c144840 2023-11-28T20:10:30.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 -- 172.21.15.177:0/945821270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c7c144840 msgr2=0x7f2c7c06c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 --2- 172.21.15.177:0/945821270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c7c144840 0x7f2c7c06c2c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009870 tx=0x7f2c6c01c510 comp rx=0 tx=0).stop 2023-11-28T20:10:30.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 -- 172.21.15.177:0/945821270 shutdown_connections 2023-11-28T20:10:30.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 --2- 172.21.15.177:0/945821270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c7c072180 0x7f2c7c06c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 --2- 172.21.15.177:0/945821270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c7c144840 0x7f2c7c06c2c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 -- 172.21.15.177:0/945821270 >> 172.21.15.177:0/945821270 conn(0x7f2c7c06a530 msgr2=0x7f2c7c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:30.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 -- 172.21.15.177:0/945821270 shutdown_connections 2023-11-28T20:10:30.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 -- 172.21.15.177:0/945821270 wait complete. 2023-11-28T20:10:30.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 Processor -- start 2023-11-28T20:10:30.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 -- start start 2023-11-28T20:10:30.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c7c070460 0x7f2c7c15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c7c072180 0x7f2c7c13ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c7c144840 0x7f2c7c13d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c15e1f0 con 0x7f2c7c072180 2023-11-28T20:10:30.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c15d5e0 con 0x7f2c7c070460 2023-11-28T20:10:30.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c823d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c15d8c0 con 0x7f2c7c144840 2023-11-28T20:10:30.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.148+0000 7f2c7b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c7c072180 0x7f2c7c13ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c7b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c7c072180 0x7f2c7c13ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49730/0 (socket says 172.21.15.177:49730) 2023-11-28T20:10:30.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c7b7fe640 1 -- 172.21.15.177:0/3654287440 learned_addr learned my addr 172.21.15.177:0/3654287440 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:30.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c8096e640 1 --2- 172.21.15.177:0/3654287440 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c7c144840 0x7f2c7c13d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c7bfff640 1 --2- 172.21.15.177:0/3654287440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c7c070460 0x7f2c7c15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c7b7fe640 1 -- 172.21.15.177:0/3654287440 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c7c144840 msgr2=0x7f2c7c13d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c7b7fe640 1 --2- 172.21.15.177:0/3654287440 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c7c144840 0x7f2c7c13d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c7b7fe640 1 -- 172.21.15.177:0/3654287440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c7c070460 msgr2=0x7f2c7c15a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c7b7fe640 1 --2- 172.21.15.177:0/3654287440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c7c070460 0x7f2c7c15a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c7b7fe640 1 -- 172.21.15.177:0/3654287440 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c0094d0 con 0x7f2c7c072180 2023-11-28T20:10:30.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c7b7fe640 1 --2- 172.21.15.177:0/3654287440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c7c072180 0x7f2c7c13ceb0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f2c7000e900 tx=0x7f2c7000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:30.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c78ff9640 1 -- 172.21.15.177:0/3654287440 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c70009690 con 0x7f2c7c072180 2023-11-28T20:10:30.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c78ff9640 1 -- 172.21.15.177:0/3654287440 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7000ca00 con 0x7f2c7c072180 2023-11-28T20:10:30.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c78ff9640 1 -- 172.21.15.177:0/3654287440 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000cd90 con 0x7f2c7c072180 2023-11-28T20:10:30.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c823d1640 1 -- 172.21.15.177:0/3654287440 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7c15dba0 con 0x7f2c7c072180 2023-11-28T20:10:30.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c823d1640 1 -- 172.21.15.177:0/3654287440 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7c15ad50 con 0x7f2c7c072180 2023-11-28T20:10:30.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c823d1640 1 -- 172.21.15.177:0/3654287440 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7c069440 con 0x7f2c7c072180 2023-11-28T20:10:30.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c78ff9640 1 -- 172.21.15.177:0/3654287440 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2c70013470 con 0x7f2c7c072180 2023-11-28T20:10:30.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c78ff9640 1 --2- 172.21.15.177:0/3654287440 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2c680664a0 0x7f2c68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c78ff9640 1 -- 172.21.15.177:0/3654287440 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2c70083d10 con 0x7f2c7c072180 2023-11-28T20:10:30.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.152+0000 7f2c7bfff640 1 --2- 172.21.15.177:0/3654287440 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2c680664a0 0x7f2c68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.156+0000 7f2c7bfff640 1 --2- 172.21.15.177:0/3654287440 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2c680664a0 0x7f2c68068960 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0ae000 tx=0x7f2c6c0b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:30.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.156+0000 7f2c78ff9640 1 -- 172.21.15.177:0/3654287440 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2c70089020 con 0x7f2c7c072180 2023-11-28T20:10:30.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.308+0000 7f2c823d1640 1 -- 172.21.15.177:0/3654287440 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c7c15e4d0 con 0x7f2c680664a0 2023-11-28T20:10:30.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.308+0000 7f2c78ff9640 1 -- 172.21.15.177:0/3654287440 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2c7c15e4d0 con 0x7f2c680664a0 2023-11-28T20:10:30.311 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 6 to deep-scrub 2023-11-28T20:10:30.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.308+0000 7f2c823d1640 1 -- 172.21.15.177:0/3654287440 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2c680664a0 msgr2=0x7f2c68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.308+0000 7f2c823d1640 1 --2- 172.21.15.177:0/3654287440 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2c680664a0 0x7f2c68068960 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0ae000 tx=0x7f2c6c0b5040 comp rx=0 tx=0).stop 2023-11-28T20:10:30.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.308+0000 7f2c823d1640 1 -- 172.21.15.177:0/3654287440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c7c072180 msgr2=0x7f2c7c13ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.308+0000 7f2c823d1640 1 --2- 172.21.15.177:0/3654287440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c7c072180 0x7f2c7c13ceb0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f2c7000e900 tx=0x7f2c7000edc0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.308+0000 7f2c823d1640 1 -- 172.21.15.177:0/3654287440 shutdown_connections 2023-11-28T20:10:30.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.308+0000 7f2c823d1640 1 --2- 172.21.15.177:0/3654287440 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f2c680664a0 0x7f2c68068960 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.308+0000 7f2c823d1640 1 --2- 172.21.15.177:0/3654287440 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c7c144840 0x7f2c7c13d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.308+0000 7f2c823d1640 1 --2- 172.21.15.177:0/3654287440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c7c072180 0x7f2c7c13ceb0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.308+0000 7f2c823d1640 1 --2- 172.21.15.177:0/3654287440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c7c070460 0x7f2c7c15a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.308+0000 7f2c823d1640 1 -- 172.21.15.177:0/3654287440 >> 172.21.15.177:0/3654287440 conn(0x7f2c7c06a530 msgr2=0x7f2c7c06c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:30.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.308+0000 7f2c823d1640 1 -- 172.21.15.177:0/3654287440 shutdown_connections 2023-11-28T20:10:30.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.308+0000 7f2c823d1640 1 -- 172.21.15.177:0/3654287440 wait complete. 2023-11-28T20:10:30.332 INFO:tasks.ceph:Scrubbing osd.7 2023-11-28T20:10:30.332 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:10:30.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.468+0000 7f0af4a09640 1 Processor -- start 2023-11-28T20:10:30.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.468+0000 7f0af4a09640 1 -- start start 2023-11-28T20:10:30.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.472+0000 7f0af4a09640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af0159ba0 0x7f0af00c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.472+0000 7f0af4a09640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0af00cb0c0 0x7f0af0070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.472+0000 7f0af4a09640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af0159f80 con 0x7f0af00cce60 2023-11-28T20:10:30.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.472+0000 7f0af4a09640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af00cb520 con 0x7f0af00cb0c0 2023-11-28T20:10:30.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.472+0000 7f0af4a09640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00ce460 con 0x7f0af0159ba0 2023-11-28T20:10:30.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.472+0000 7f0aedd9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0af00cb0c0 0x7f0af0070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.472+0000 7f0aeed9d640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f0af00cce60 0x7f0af006c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47864/0 (socket says 172.21.15.177:47864) 2023-11-28T20:10:30.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.472+0000 7f0aeed9d640 1 -- 172.21.15.177:0/3034342431 learned_addr learned my addr 172.21.15.177:0/3034342431 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:30.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.472+0000 7f0aedd9b640 1 --2- 172.21.15.177:0/3034342431 >> v2:172.21.15.177:3300/0 conn(0x7f0af00cb0c0 0x7f0af0070580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49744/0 (socket says 172.21.15.177:49744) 2023-11-28T20:10:30.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.472+0000 7f0aee59c640 1 --2- 172.21.15.177:0/3034342431 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af0159ba0 0x7f0af00c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.472+0000 7f0aedd9b640 1 -- 172.21.15.177:0/3034342431 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af0159ba0 msgr2=0x7f0af00c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:30.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.472+0000 7f0aedd9b640 1 --2- 172.21.15.177:0/3034342431 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af0159ba0 0x7f0af00c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.472+0000 7f0aedd9b640 1 -- 172.21.15.177:0/3034342431 >> v1:172.21.15.177:6789/0 conn(0x7f0af00cce60 legacy=0x7f0af006c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.472+0000 7f0aedd9b640 1 -- 172.21.15.177:0/3034342431 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af00cda30 con 0x7f0af00cb0c0 2023-11-28T20:10:30.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.472+0000 7f0aed59a640 1 -- 172.21.15.177:0/3034342431 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339590982 0 0) 0x7f0af0159f80 con 0x7f0af00cce60 2023-11-28T20:10:30.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.476+0000 7f0aedd9b640 1 --2- 172.21.15.177:0/3034342431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0af00cb0c0 0x7f0af0070580 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40097c0 tx=0x7f0ae401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e64a8410b33f154 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:30.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.476+0000 7f0aed59a640 1 -- 172.21.15.177:0/3034342431 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40ad660 con 0x7f0af00cb0c0 2023-11-28T20:10:30.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.476+0000 7f0aed59a640 1 -- 172.21.15.177:0/3034342431 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae40ad7c0 con 0x7f0af00cb0c0 2023-11-28T20:10:30.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.476+0000 7f0aed59a640 1 -- 172.21.15.177:0/3034342431 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40adb50 con 0x7f0af00cb0c0 2023-11-28T20:10:30.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.476+0000 7f0af4a09640 1 -- 172.21.15.177:0/3034342431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0af00cb0c0 msgr2=0x7f0af0070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.476+0000 7f0af4a09640 1 --2- 172.21.15.177:0/3034342431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0af00cb0c0 0x7f0af0070580 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40097c0 tx=0x7f0ae401c450 comp rx=0 tx=0).stop 2023-11-28T20:10:30.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.476+0000 7f0af4a09640 1 -- 172.21.15.177:0/3034342431 shutdown_connections 2023-11-28T20:10:30.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.476+0000 7f0af4a09640 1 --2- 172.21.15.177:0/3034342431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0af00cb0c0 0x7f0af0070580 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.476+0000 7f0af4a09640 1 --2- 172.21.15.177:0/3034342431 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af0159ba0 0x7f0af00c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.476+0000 7f0af4a09640 1 -- 172.21.15.177:0/3034342431 >> 172.21.15.177:0/3034342431 conn(0x7f0af00b0c50 msgr2=0x7f0af00b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:30.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.476+0000 7f0af4a09640 1 -- 172.21.15.177:0/3034342431 shutdown_connections 2023-11-28T20:10:30.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.476+0000 7f0af4a09640 1 -- 172.21.15.177:0/3034342431 wait complete. 2023-11-28T20:10:30.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.476+0000 7f0af4a09640 1 Processor -- start 2023-11-28T20:10:30.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0af4a09640 1 -- start start 2023-11-28T20:10:30.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0af4a09640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0af00cb0c0 0x7f0af01f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0af4a09640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af00cce60 0x7f0af00acf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0af4a09640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0af0159ba0 0x7f0af00ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0af4a09640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af009c170 con 0x7f0af00cb0c0 2023-11-28T20:10:30.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0af4a09640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af009c450 con 0x7f0af0159ba0 2023-11-28T20:10:30.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0af4a09640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af009c730 con 0x7f0af00cce60 2023-11-28T20:10:30.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0aee59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0af00cb0c0 0x7f0af01f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0aee59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0af00cb0c0 0x7f0af01f5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49750/0 (socket says 172.21.15.177:49750) 2023-11-28T20:10:30.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0aee59c640 1 -- 172.21.15.177:0/4062471161 learned_addr learned my addr 172.21.15.177:0/4062471161 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:30.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0aedd9b640 1 --2- 172.21.15.177:0/4062471161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af00cce60 0x7f0af00acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0aeed9d640 1 --2- 172.21.15.177:0/4062471161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0af0159ba0 0x7f0af00ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0aee59c640 1 -- 172.21.15.177:0/4062471161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af00cce60 msgr2=0x7f0af00acf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0aee59c640 1 --2- 172.21.15.177:0/4062471161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af00cce60 0x7f0af00acf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0aee59c640 1 -- 172.21.15.177:0/4062471161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0af0159ba0 msgr2=0x7f0af00ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0aee59c640 1 --2- 172.21.15.177:0/4062471161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0af0159ba0 0x7f0af00ad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0aee59c640 1 -- 172.21.15.177:0/4062471161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae4009420 con 0x7f0af00cb0c0 2023-11-28T20:10:30.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0aeed9d640 1 --2- 172.21.15.177:0/4062471161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0af0159ba0 0x7f0af00ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:30.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0aee59c640 1 --2- 172.21.15.177:0/4062471161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0af00cb0c0 0x7f0af01f5ba0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000e930 tx=0x7f0ae000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:30.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0adeffd640 1 -- 172.21.15.177:0/4062471161 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0009690 con 0x7f0af00cb0c0 2023-11-28T20:10:30.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0adeffd640 1 -- 172.21.15.177:0/4062471161 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae000ca00 con 0x7f0af00cb0c0 2023-11-28T20:10:30.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0adeffd640 1 -- 172.21.15.177:0/4062471161 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae000cd70 con 0x7f0af00cb0c0 2023-11-28T20:10:30.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0af4a09640 1 -- 172.21.15.177:0/4062471161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af009ca10 con 0x7f0af00cb0c0 2023-11-28T20:10:30.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0af4a09640 1 -- 172.21.15.177:0/4062471161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af01f60e0 con 0x7f0af00cb0c0 2023-11-28T20:10:30.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.480+0000 7f0af4a09640 1 -- 172.21.15.177:0/4062471161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0af009c5c0 con 0x7f0af00cb0c0 2023-11-28T20:10:30.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.484+0000 7f0adeffd640 1 -- 172.21.15.177:0/4062471161 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0ae0013470 con 0x7f0af00cb0c0 2023-11-28T20:10:30.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.484+0000 7f0adeffd640 1 --2- 172.21.15.177:0/4062471161 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0ad0066470 0x7f0ad0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.484+0000 7f0adeffd640 1 -- 172.21.15.177:0/4062471161 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0ae00840f0 con 0x7f0af00cb0c0 2023-11-28T20:10:30.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.484+0000 7f0adeffd640 1 --2- 172.21.15.177:0/4062471161 >> [v2:172.21.15.195:6824/1875951680,v1:172.21.15.195:6825/1875951680] conn(0x7f0ad006c2d0 0x7f0ad006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.484+0000 7f0aedd9b640 1 --2- 172.21.15.177:0/4062471161 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0ad0066470 0x7f0ad0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.484+0000 7f0adeffd640 1 -- 172.21.15.177:0/4062471161 --> [v2:172.21.15.195:6824/1875951680,v1:172.21.15.195:6825/1875951680] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ad006eda0 con 0x7f0ad006c2d0 2023-11-28T20:10:30.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.484+0000 7f0adeffd640 1 -- 172.21.15.177:0/4062471161 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ae00844a0 con 0x7f0af00cb0c0 2023-11-28T20:10:30.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.484+0000 7f0aeed9d640 1 --2- 172.21.15.177:0/4062471161 >> [v2:172.21.15.195:6824/1875951680,v1:172.21.15.195:6825/1875951680] conn(0x7f0ad006c2d0 0x7f0ad006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.484+0000 7f0aedd9b640 1 --2- 172.21.15.177:0/4062471161 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0ad0066470 0x7f0ad0068930 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40af000 tx=0x7f0ae4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:30.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.484+0000 7f0aeed9d640 1 --2- 172.21.15.177:0/4062471161 >> [v2:172.21.15.195:6824/1875951680,v1:172.21.15.195:6825/1875951680] conn(0x7f0ad006c2d0 0x7f0ad006e6f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:30.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.484+0000 7f0adeffd640 1 -- 172.21.15.177:0/4062471161 <== osd.7 v2:172.21.15.195:6824/1875951680 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0ad006eda0 con 0x7f0ad006c2d0 2023-11-28T20:10:30.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.500+0000 7f0af4a09640 1 -- 172.21.15.177:0/4062471161 --> [v2:172.21.15.195:6824/1875951680,v1:172.21.15.195:6825/1875951680] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0af00ae8f0 con 0x7f0ad006c2d0 2023-11-28T20:10:30.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.500+0000 7f0adeffd640 1 -- 172.21.15.177:0/4062471161 <== osd.7 v2:172.21.15.195:6824/1875951680 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0ae8007730 con 0x7f0ad006c2d0 2023-11-28T20:10:30.504 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-28T20:10:30.504 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:10:30.504 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-28T20:10:30.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.500+0000 7f0af4a09640 1 -- 172.21.15.177:0/4062471161 >> [v2:172.21.15.195:6824/1875951680,v1:172.21.15.195:6825/1875951680] conn(0x7f0ad006c2d0 msgr2=0x7f0ad006e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.500+0000 7f0af4a09640 1 --2- 172.21.15.177:0/4062471161 >> [v2:172.21.15.195:6824/1875951680,v1:172.21.15.195:6825/1875951680] conn(0x7f0ad006c2d0 0x7f0ad006e6f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.500+0000 7f0af4a09640 1 -- 172.21.15.177:0/4062471161 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0ad0066470 msgr2=0x7f0ad0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.500+0000 7f0af4a09640 1 --2- 172.21.15.177:0/4062471161 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f0ad0066470 0x7f0ad0068930 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40af000 tx=0x7f0ae4008040 comp rx=0 tx=0).stop 2023-11-28T20:10:30.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.500+0000 7f0af4a09640 1 -- 172.21.15.177:0/4062471161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0af00cb0c0 msgr2=0x7f0af01f5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.500+0000 7f0af4a09640 1 --2- 172.21.15.177:0/4062471161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0af00cb0c0 0x7f0af01f5ba0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000e930 tx=0x7f0ae000edf0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.500+0000 7f0aeed9d640 1 -- 172.21.15.177:0/4062471161 reap_dead start 2023-11-28T20:10:30.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.500+0000 7f0af4a09640 1 -- 172.21.15.177:0/4062471161 shutdown_connections 2023-11-28T20:10:30.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.500+0000 7f0af4a09640 1 -- 172.21.15.177:0/4062471161 >> 172.21.15.177:0/4062471161 conn(0x7f0af00b0c50 msgr2=0x7f0af00aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:30.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.500+0000 7f0af4a09640 1 -- 172.21.15.177:0/4062471161 shutdown_connections 2023-11-28T20:10:30.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.500+0000 7f0af4a09640 1 -- 172.21.15.177:0/4062471161 wait complete. 2023-11-28T20:10:30.522 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-28T20:10:30.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.656+0000 7ff47f50f640 1 Processor -- start 2023-11-28T20:10:30.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.656+0000 7ff47f50f640 1 -- start start 2023-11-28T20:10:30.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.660+0000 7ff47f50f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff47806c9d0 0x7ff478145250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.660+0000 7ff47f50f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff47815c070 0x7ff478145790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.660+0000 7ff47f50f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478145fc0 con 0x7ff47815bc90 2023-11-28T20:10:30.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.660+0000 7ff47f50f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4781462a0 con 0x7ff47815c070 2023-11-28T20:10:30.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.660+0000 7ff47f50f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff478146580 con 0x7ff47806c9d0 2023-11-28T20:10:30.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.660+0000 7ff47daac640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff47815c070 0x7ff478145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.660+0000 7ff47daac640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff47815c070 0x7ff478145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49762/0 (socket says 172.21.15.177:49762) 2023-11-28T20:10:30.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.660+0000 7ff47daac640 1 -- 172.21.15.177:0/457657488 learned_addr learned my addr 172.21.15.177:0/457657488 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:30.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.660+0000 7ff47caaa640 1 --2- 172.21.15.177:0/457657488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff47806c9d0 0x7ff478145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.660+0000 7ff47daac640 1 -- 172.21.15.177:0/457657488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff47806c9d0 msgr2=0x7ff478145250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:30.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.660+0000 7ff47daac640 1 --2- 172.21.15.177:0/457657488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff47806c9d0 0x7ff478145250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.660+0000 7ff47daac640 1 -- 172.21.15.177:0/457657488 >> v1:172.21.15.195:6789/0 conn(0x7ff47815bc90 legacy=0x7ff47806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.660+0000 7ff46ffff640 1 -- 172.21.15.177:0/457657488 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605890877 0 0) 0x7ff478145fc0 con 0x7ff47815bc90 2023-11-28T20:10:30.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.660+0000 7ff47daac640 1 -- 172.21.15.177:0/457657488 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff478146860 con 0x7ff47815c070 2023-11-28T20:10:30.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.664+0000 7ff47daac640 1 --2- 172.21.15.177:0/457657488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff47815c070 0x7ff478145790 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff470009e50 tx=0x7ff47001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e493ca763356a4b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:30.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.664+0000 7ff46ffff640 1 -- 172.21.15.177:0/457657488 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4700a57f0 con 0x7ff47815c070 2023-11-28T20:10:30.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.664+0000 7ff46ffff640 1 -- 172.21.15.177:0/457657488 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4700a5950 con 0x7ff47815c070 2023-11-28T20:10:30.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.664+0000 7ff46ffff640 1 -- 172.21.15.177:0/457657488 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4700a5ce0 con 0x7ff47815c070 2023-11-28T20:10:30.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.664+0000 7ff47f50f640 1 -- 172.21.15.177:0/457657488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff47815c070 msgr2=0x7ff478145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.664+0000 7ff47f50f640 1 --2- 172.21.15.177:0/457657488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff47815c070 0x7ff478145790 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff470009e50 tx=0x7ff47001c950 comp rx=0 tx=0).stop 2023-11-28T20:10:30.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.664+0000 7ff47f50f640 1 -- 172.21.15.177:0/457657488 shutdown_connections 2023-11-28T20:10:30.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.664+0000 7ff47f50f640 1 --2- 172.21.15.177:0/457657488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff47815c070 0x7ff478145790 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.664+0000 7ff47f50f640 1 --2- 172.21.15.177:0/457657488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff47806c9d0 0x7ff478145250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.664+0000 7ff47f50f640 1 -- 172.21.15.177:0/457657488 >> 172.21.15.177:0/457657488 conn(0x7ff47806a530 msgr2=0x7ff47806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:30.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.664+0000 7ff47f50f640 1 -- 172.21.15.177:0/457657488 shutdown_connections 2023-11-28T20:10:30.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.664+0000 7ff47f50f640 1 -- 172.21.15.177:0/457657488 wait complete. 2023-11-28T20:10:30.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.664+0000 7ff47f50f640 1 Processor -- start 2023-11-28T20:10:30.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.664+0000 7ff47f50f640 1 -- start start 2023-11-28T20:10:30.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47f50f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff47806c9d0 0x7ff478140a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47f50f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff47815bc90 0x7ff478164310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47f50f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff47815c070 0x7ff478141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47f50f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff478158400 con 0x7ff47806c9d0 2023-11-28T20:10:30.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47f50f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff478157af0 con 0x7ff47815c070 2023-11-28T20:10:30.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47f50f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff478155950 con 0x7ff47815bc90 2023-11-28T20:10:30.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47d2ab640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff47806c9d0 0x7ff478140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47d2ab640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff47806c9d0 0x7ff478140a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49772/0 (socket says 172.21.15.177:49772) 2023-11-28T20:10:30.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47d2ab640 1 -- 172.21.15.177:0/2355220571 learned_addr learned my addr 172.21.15.177:0/2355220571 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:30.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47daac640 1 --2- 172.21.15.177:0/2355220571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff47815c070 0x7ff478141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47caaa640 1 --2- 172.21.15.177:0/2355220571 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff47815bc90 0x7ff478164310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47d2ab640 1 -- 172.21.15.177:0/2355220571 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff47815bc90 msgr2=0x7ff478164310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47d2ab640 1 --2- 172.21.15.177:0/2355220571 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff47815bc90 0x7ff478164310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47d2ab640 1 -- 172.21.15.177:0/2355220571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff47815c070 msgr2=0x7ff478141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47d2ab640 1 --2- 172.21.15.177:0/2355220571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff47815c070 0x7ff478141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47d2ab640 1 -- 172.21.15.177:0/2355220571 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff470009b30 con 0x7ff47806c9d0 2023-11-28T20:10:30.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47d2ab640 1 --2- 172.21.15.177:0/2355220571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff47806c9d0 0x7ff478140a50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ff47400c4d0 tx=0x7ff47400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:30.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff46dffb640 1 -- 172.21.15.177:0/2355220571 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474005480 con 0x7ff47806c9d0 2023-11-28T20:10:30.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff46dffb640 1 -- 172.21.15.177:0/2355220571 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff474003600 con 0x7ff47806c9d0 2023-11-28T20:10:30.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff46dffb640 1 -- 172.21.15.177:0/2355220571 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4740039b0 con 0x7ff47806c9d0 2023-11-28T20:10:30.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47f50f640 1 -- 172.21.15.177:0/2355220571 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff478157d40 con 0x7ff47806c9d0 2023-11-28T20:10:30.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47f50f640 1 -- 172.21.15.177:0/2355220571 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff478140740 con 0x7ff47806c9d0 2023-11-28T20:10:30.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff47f50f640 1 -- 172.21.15.177:0/2355220571 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff478069440 con 0x7ff47806c9d0 2023-11-28T20:10:30.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.668+0000 7ff46dffb640 1 -- 172.21.15.177:0/2355220571 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff474003b10 con 0x7ff47806c9d0 2023-11-28T20:10:30.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.672+0000 7ff46dffb640 1 --2- 172.21.15.177:0/2355220571 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff45c066470 0x7ff45c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.672+0000 7ff46dffb640 1 -- 172.21.15.177:0/2355220571 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff474083030 con 0x7ff47806c9d0 2023-11-28T20:10:30.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.672+0000 7ff47caaa640 1 --2- 172.21.15.177:0/2355220571 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff45c066470 0x7ff45c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.672+0000 7ff47caaa640 1 --2- 172.21.15.177:0/2355220571 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff45c066470 0x7ff45c068930 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff478143880 tx=0x7ff468009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:30.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.676+0000 7ff46dffb640 1 -- 172.21.15.177:0/2355220571 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4740509b0 con 0x7ff47806c9d0 2023-11-28T20:10:30.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.824+0000 7ff47f50f640 1 -- 172.21.15.177:0/2355220571 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ff478073500 con 0x7ff45c066470 2023-11-28T20:10:30.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.824+0000 7ff46dffb640 1 -- 172.21.15.177:0/2355220571 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff478073500 con 0x7ff45c066470 2023-11-28T20:10:30.829 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 7 to deep-scrub 2023-11-28T20:10:30.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.828+0000 7ff47f50f640 1 -- 172.21.15.177:0/2355220571 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff45c066470 msgr2=0x7ff45c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.828+0000 7ff47f50f640 1 --2- 172.21.15.177:0/2355220571 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff45c066470 0x7ff45c068930 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff478143880 tx=0x7ff468009190 comp rx=0 tx=0).stop 2023-11-28T20:10:30.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.828+0000 7ff47f50f640 1 -- 172.21.15.177:0/2355220571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff47806c9d0 msgr2=0x7ff478140a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.828+0000 7ff47f50f640 1 --2- 172.21.15.177:0/2355220571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff47806c9d0 0x7ff478140a50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ff47400c4d0 tx=0x7ff47400c990 comp rx=0 tx=0).stop 2023-11-28T20:10:30.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.828+0000 7ff47f50f640 1 -- 172.21.15.177:0/2355220571 shutdown_connections 2023-11-28T20:10:30.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.828+0000 7ff47f50f640 1 --2- 172.21.15.177:0/2355220571 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7ff45c066470 0x7ff45c068930 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.828+0000 7ff47f50f640 1 --2- 172.21.15.177:0/2355220571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff47815c070 0x7ff478141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.828+0000 7ff47f50f640 1 --2- 172.21.15.177:0/2355220571 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff47815bc90 0x7ff478164310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.828+0000 7ff47f50f640 1 --2- 172.21.15.177:0/2355220571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff47806c9d0 0x7ff478140a50 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.828+0000 7ff47f50f640 1 -- 172.21.15.177:0/2355220571 >> 172.21.15.177:0/2355220571 conn(0x7ff47806a530 msgr2=0x7ff4780aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:30.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.828+0000 7ff47f50f640 1 -- 172.21.15.177:0/2355220571 shutdown_connections 2023-11-28T20:10:30.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.828+0000 7ff47f50f640 1 -- 172.21.15.177:0/2355220571 wait complete. 2023-11-28T20:10:30.849 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:10:30.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.979+0000 7fe91ee54640 1 Processor -- start 2023-11-28T20:10:30.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.979+0000 7fe91ee54640 1 -- start start 2023-11-28T20:10:30.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.983+0000 7fe91ee54640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe91815ad40 0x7fe918164df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.983+0000 7fe91ee54640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe91815b3a0 con 0x7fe91806c9d0 2023-11-28T20:10:30.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.983+0000 7fe91ee54640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe91813f720 con 0x7fe91813cf30 2023-11-28T20:10:30.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.983+0000 7fe91ee54640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91813d310 con 0x7fe91815ad40 2023-11-28T20:10:30.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.983+0000 7fe90ffff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe91806c9d0 0x7fe91815a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47880/0 (socket says 172.21.15.177:47880) 2023-11-28T20:10:30.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.983+0000 7fe90ffff640 1 -- 172.21.15.177:0/2636521568 learned_addr learned my addr 172.21.15.177:0/2636521568 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:30.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.983+0000 7fe91d3f1640 1 --2- 172.21.15.177:0/2636521568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe91815ad40 0x7fe918164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.983+0000 7fe90f7fe640 1 -- 172.21.15.177:0/2636521568 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484271246 0 0) 0x7fe91815b3a0 con 0x7fe91806c9d0 2023-11-28T20:10:30.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.983+0000 7fe90f7fe640 1 -- 172.21.15.177:0/2636521568 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe900003530 con 0x7fe91806c9d0 2023-11-28T20:10:30.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.983+0000 7fe91d3f1640 1 -- 172.21.15.177:0/2636521568 >> v1:172.21.15.195:6789/0 conn(0x7fe91813cf30 legacy=0x7fe91806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.983+0000 7fe91d3f1640 1 -- 172.21.15.177:0/2636521568 >> v1:172.21.15.177:6789/0 conn(0x7fe91806c9d0 legacy=0x7fe91815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.983+0000 7fe91d3f1640 1 -- 172.21.15.177:0/2636521568 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91813fa00 con 0x7fe91815ad40 2023-11-28T20:10:30.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.987+0000 7fe91d3f1640 1 --2- 172.21.15.177:0/2636521568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe91815ad40 0x7fe918164df0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe910009dc0 tx=0x7fe91001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99a7baa33f0006eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:30.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.987+0000 7fe90f7fe640 1 -- 172.21.15.177:0/2636521568 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9100a57a0 con 0x7fe91815ad40 2023-11-28T20:10:30.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.987+0000 7fe90f7fe640 1 -- 172.21.15.177:0/2636521568 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9100a5900 con 0x7fe91815ad40 2023-11-28T20:10:30.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.987+0000 7fe90f7fe640 1 -- 172.21.15.177:0/2636521568 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9100a5c90 con 0x7fe91815ad40 2023-11-28T20:10:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.987+0000 7fe91ee54640 1 -- 172.21.15.177:0/2636521568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe91815ad40 msgr2=0x7fe918164df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.987+0000 7fe91ee54640 1 --2- 172.21.15.177:0/2636521568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe91815ad40 0x7fe918164df0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe910009dc0 tx=0x7fe91001c8e0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.987+0000 7fe91ee54640 1 -- 172.21.15.177:0/2636521568 shutdown_connections 2023-11-28T20:10:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.987+0000 7fe91ee54640 1 --2- 172.21.15.177:0/2636521568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe91815ad40 0x7fe918164df0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.987+0000 7fe91ee54640 1 -- 172.21.15.177:0/2636521568 >> 172.21.15.177:0/2636521568 conn(0x7fe91806a530 msgr2=0x7fe91806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.987+0000 7fe91ee54640 1 -- 172.21.15.177:0/2636521568 shutdown_connections 2023-11-28T20:10:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.987+0000 7fe91ee54640 1 -- 172.21.15.177:0/2636521568 wait complete. 2023-11-28T20:10:30.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.987+0000 7fe91ee54640 1 Processor -- start 2023-11-28T20:10:30.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.987+0000 7fe91ee54640 1 -- start start 2023-11-28T20:10:30.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91ee54640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe91806c9d0 0x7fe91814f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91ee54640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe91813cf30 0x7fe91814ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91ee54640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe91815ad40 0x7fe918138000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:30.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91ee54640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe918136940 con 0x7fe91806c9d0 2023-11-28T20:10:30.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91ee54640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe918136050 con 0x7fe91813cf30 2023-11-28T20:10:30.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91ee54640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9181362f0 con 0x7fe91815ad40 2023-11-28T20:10:30.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91cbf0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe91806c9d0 0x7fe91814f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91cbf0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe91806c9d0 0x7fe91814f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49788/0 (socket says 172.21.15.177:49788) 2023-11-28T20:10:30.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91cbf0640 1 -- 172.21.15.177:0/1183554822 learned_addr learned my addr 172.21.15.177:0/1183554822 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe90ffff640 1 --2- 172.21.15.177:0/1183554822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe91813cf30 0x7fe91814ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91d3f1640 1 --2- 172.21.15.177:0/1183554822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe91815ad40 0x7fe918138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91cbf0640 1 -- 172.21.15.177:0/1183554822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe91815ad40 msgr2=0x7fe918138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91cbf0640 1 --2- 172.21.15.177:0/1183554822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe91815ad40 0x7fe918138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91cbf0640 1 -- 172.21.15.177:0/1183554822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe91813cf30 msgr2=0x7fe91814ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91cbf0640 1 --2- 172.21.15.177:0/1183554822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe91813cf30 0x7fe91814ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91cbf0640 1 -- 172.21.15.177:0/1183554822 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910009a70 con 0x7fe91806c9d0 2023-11-28T20:10:30.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91cbf0640 1 --2- 172.21.15.177:0/1183554822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe91806c9d0 0x7fe91814f460 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe91400c3c0 tx=0x7fe91400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe90d7fa640 1 -- 172.21.15.177:0/1183554822 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9140052d0 con 0x7fe91806c9d0 2023-11-28T20:10:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe90d7fa640 1 -- 172.21.15.177:0/1183554822 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe914005430 con 0x7fe91806c9d0 2023-11-28T20:10:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91ee54640 1 -- 172.21.15.177:0/1183554822 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9181365d0 con 0x7fe91806c9d0 2023-11-28T20:10:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe90d7fa640 1 -- 172.21.15.177:0/1183554822 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe914003840 con 0x7fe91806c9d0 2023-11-28T20:10:30.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91ee54640 1 -- 172.21.15.177:0/1183554822 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91814fa40 con 0x7fe91806c9d0 2023-11-28T20:10:31.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.991+0000 7fe91ee54640 1 -- 172.21.15.177:0/1183554822 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe918069440 con 0x7fe91806c9d0 2023-11-28T20:10:31.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.995+0000 7fe90d7fa640 1 -- 172.21.15.177:0/1183554822 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe9140039a0 con 0x7fe91806c9d0 2023-11-28T20:10:31.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.995+0000 7fe90d7fa640 1 --2- 172.21.15.177:0/1183554822 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe904066470 0x7fe904068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:31.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.995+0000 7fe90d7fa640 1 -- 172.21.15.177:0/1183554822 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe914082f80 con 0x7fe91806c9d0 2023-11-28T20:10:31.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.995+0000 7fe90ffff640 1 --2- 172.21.15.177:0/1183554822 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe904066470 0x7fe904068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:31.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.995+0000 7fe90ffff640 1 --2- 172.21.15.177:0/1183554822 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe904066470 0x7fe904068930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe9181f95c0 tx=0x7fe908007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:31.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:30.999+0000 7fe90d7fa640 1 -- 172.21.15.177:0/1183554822 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe9140b4280 con 0x7fe91806c9d0 2023-11-28T20:10:31.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:31.147+0000 7fe91ee54640 1 -- 172.21.15.177:0/1183554822 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe918136460 con 0x7fe904066470 2023-11-28T20:10:31.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:31.147+0000 7fe90d7fa640 1 -- 172.21.15.177:0/1183554822 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50610 (secure 0 0 0) 0x7fe918136460 con 0x7fe904066470 2023-11-28T20:10:31.154 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:31.155 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:10:31.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:31.151+0000 7fe91ee54640 1 -- 172.21.15.177:0/1183554822 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe904066470 msgr2=0x7fe904068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:31.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:31.151+0000 7fe91ee54640 1 --2- 172.21.15.177:0/1183554822 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe904066470 0x7fe904068930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe9181f95c0 tx=0x7fe908007d40 comp rx=0 tx=0).stop 2023-11-28T20:10:31.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:31.151+0000 7fe91ee54640 1 -- 172.21.15.177:0/1183554822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe91806c9d0 msgr2=0x7fe91814f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:31.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:31.151+0000 7fe91ee54640 1 --2- 172.21.15.177:0/1183554822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe91806c9d0 0x7fe91814f460 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe91400c3c0 tx=0x7fe91400c880 comp rx=0 tx=0).stop 2023-11-28T20:10:31.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:31.151+0000 7fe91ee54640 1 -- 172.21.15.177:0/1183554822 shutdown_connections 2023-11-28T20:10:31.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:31.151+0000 7fe91ee54640 1 --2- 172.21.15.177:0/1183554822 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fe904066470 0x7fe904068930 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:31.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:31.151+0000 7fe91ee54640 1 --2- 172.21.15.177:0/1183554822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe91815ad40 0x7fe918138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:31.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:31.151+0000 7fe91ee54640 1 --2- 172.21.15.177:0/1183554822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe91813cf30 0x7fe91814ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:31.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:31.151+0000 7fe91ee54640 1 --2- 172.21.15.177:0/1183554822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe91806c9d0 0x7fe91814f460 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:31.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:31.151+0000 7fe91ee54640 1 -- 172.21.15.177:0/1183554822 >> 172.21.15.177:0/1183554822 conn(0x7fe91806a530 msgr2=0x7fe918139360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:31.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:31.151+0000 7fe91ee54640 1 -- 172.21.15.177:0/1183554822 shutdown_connections 2023-11-28T20:10:31.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:31.151+0000 7fe91ee54640 1 -- 172.21.15.177:0/1183554822 wait complete. 2023-11-28T20:10:31.175 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2023-11-28T20:10:29.451797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":243056,"kb_used_data":6056,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731664,"statfs":{"total":773094113280,"available":772845223936,"internally_reserved":0,"allocated":6201344,"data_stored":3258544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.084854"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T20:10:21.853666+0000","last_change":"2023-11-28T20:07:30.786734+0000","last_active":"2023-11-28T20:10:21.853666+0000","last_peered":"2023-11-28T20:10:21.853666+0000","last_clean":"2023-11-28T20:10:21.853666+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:10:21.853666+0000","last_undegraded":"2023-11-28T20:10:21.853666+0000","last_fullsized":"2023-11-28T20:10:21.853666+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:07:29.546974+0000","last_clean_scrub_stamp":"2023-11-28T20:07:29.546974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:55.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1220608,"data_stored":850094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.438,"5min":0.313,"15min":0.313},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.56200000000000006,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.032,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.61899999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.65400000000000003},"min":{"1min":0.49199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94399999999999995,"5min":1.161,"15min":1.161},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0009999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97899999999999998,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.60299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0209999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80500000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.44500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.505,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.59799999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.48799999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.495,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.56899999999999995}]},{"osd":6,"last update":"Tue Nov 28 20:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.58899999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.054,"5min":1.272,"15min":1.272},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.747}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31800,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":626688,"data_stored":259726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.44500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.72699999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.69999999999999996,"15min":0.68500000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.748,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.68799999999999994}]},{"osd":2,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.65400000000000003},"min":{"1min":0.501,"5min":0.498,"15min":0.498},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.60999999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5819999999999999,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.80000000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.125,"5min":1.357,"15min":1.357},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.006,"5min":0.80600000000000005,"15min":0.77200000000000002},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":6.2249999999999996,"5min":6.2249999999999996,"15min":6.2249999999999996},"last":0.75600000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.0789999999999997,"5min":4.0789999999999997,"15min":4.0789999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"last":0.60199999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":0.81899999999999995,"15min":0.77700000000000002},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":8.6159999999999997,"5min":8.6159999999999997,"15min":8.6159999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.83299999999999996,"15min":0.82099999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.62}]},{"osd":7,"last update":"Tue Nov 28 20:09:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.84399999999999997,"15min":0.84199999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.86199999999999999,"15min":0.85799999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.64100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31800,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":626688,"data_stored":259726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.78900000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.78300000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65900000000000003,"15min":0.66000000000000003},"min":{"1min":0.47199999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.879,"5min":1.083,"15min":1.083},"last":0.76700000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.052,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.65400000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69799999999999995,"15min":0.70099999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84399999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.72899999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65300000000000002,"15min":0.66200000000000003},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81299999999999994,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.66600000000000004}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82999999999999996,"5min":0.997,"15min":0.997},"last":0.748},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92400000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.68500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31796,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":626688,"data_stored":259726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67900000000000005,"15min":0.68600000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.78100000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71399999999999997,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85599999999999998,"5min":1.361,"15min":1.361},"last":0.58199999999999996}]},{"osd":1,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68799999999999994},"min":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.81799999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.60199999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.745},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86899999999999999,"5min":1.04,"15min":1.04},"last":0.72499999999999998}]},{"osd":3,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.56699999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.83999999999999997,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88100000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.69499999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.45400000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85699999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":1.038,"15min":1.038},"last":0.495}]},{"osd":6,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.84299999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.91400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.67600000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93100000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.86099999999999999,"15min":0.877},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98899999999999999,"5min":1.353,"15min":1.353},"last":0.78100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27636,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":626688,"data_stored":259726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.02,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.313},{"interface":"front","average":{"1min":0.436,"5min":0.68100000000000005,"15min":0.72199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76000000000000001,"5min":6.016,"15min":6.016},"last":0.54600000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2170000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.46200000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94799999999999995,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.434},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0549999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.59899999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0009999999999999,"5min":5.8810000000000002,"15min":5.8810000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.038,"5min":1.405,"15min":1.405},"last":0.58499999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79800000000000004,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.119,"5min":1.585,"15min":1.585},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.97299999999999998,"15min":1.0129999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.042,"5min":5.9349999999999996,"15min":5.9349999999999996},"last":0.65900000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95699999999999996,"5min":1.361,"15min":1.361},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.55500000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0900000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.64100000000000001}]},{"osd":7,"last update":"Tue Nov 28 20:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.94999999999999996,"15min":0.98799999999999999},"min":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.262,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.621},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0620000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27636,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":626688,"data_stored":259726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.80800000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.54300000000000004,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.56899999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.3140000000000001,"5min":5.3140000000000001,"15min":5.3140000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":3.7650000000000001,"5min":3.7650000000000001,"15min":3.7650000000000001},"last":0.48399999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":5.3460000000000001,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3580000000000001,"5min":1.415,"15min":1.415},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.81699999999999995,"15min":0.80700000000000005},"min":{"1min":0.54500000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.8090000000000002,"5min":3.8090000000000002,"15min":3.8090000000000002},"last":0.65100000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.2809999999999997,"5min":5.2809999999999997,"15min":5.2809999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.66100000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88800000000000001,"15min":0.88400000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.5369999999999999,"5min":4.5369999999999999,"15min":4.5369999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.88700000000000001,"15min":0.86599999999999999},"min":{"1min":0.56799999999999995,"5min":0.496,"15min":0.496},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.75800000000000001}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.88,"15min":0.874},"min":{"1min":0.56999999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":3.863,"5min":3.863,"15min":3.863},"last":0.623},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.90300000000000002,"15min":0.88600000000000001},"min":{"1min":0.627,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":5.2460000000000004,"5min":5.2460000000000004,"15min":5.2460000000000004},"last":0.60799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27636,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":626688,"data_stored":259726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.60499999999999998,"15min":0.63900000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":0.253},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.627,"15min":0.66100000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.36499999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.64800000000000002,"15min":0.68300000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79900000000000004,"5min":4.9909999999999997,"15min":4.9909999999999997},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.68100000000000005,"15min":0.71899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56699999999999995,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.33800000000000002}]},{"osd":3,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":1.389,"15min":1.389},"last":0.435},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.67000000000000004,"15min":0.70399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.45300000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.503,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":1.145,"15min":1.145},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.93500000000000005,"15min":0.96599999999999997},"min":{"1min":0.59899999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90600000000000003,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.746}]},{"osd":5,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.91400000000000003,"15min":0.95499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90600000000000003,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.89100000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.62}]},{"osd":6,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.94799999999999995,"15min":0.99099999999999999},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.89800000000000002,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.80900000000000005,"15min":0.81799999999999995},"min":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.92400000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.53000000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0009999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.94699999999999995,"15min":0.98499999999999999},"min":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.93100000000000005,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":0.68100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1220608,"data_stored":850094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35199999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.753,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38500000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59299999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53300000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.998,"5min":1.052,"15min":1.052},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92100000000000004,"5min":1.006,"15min":1.006},"last":0.91000000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88900000000000001,"5min":1.524,"15min":1.524},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.97999999999999998,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.873}]},{"osd":6,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.624,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.84199999999999997,"5min":1.214,"15min":1.214},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97399999999999998,"5min":1.415,"15min":1.415},"last":0.78000000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:09:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95599999999999996,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93899999999999995,"5min":1.099,"15min":1.099},"last":0.93100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:10:31.179 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-28T20:07:29.546974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=7, tm_sec=29, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=10, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T20:10:31.179 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-28T20:10:40.235 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:10:40.240 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:10:51.181 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:10:51.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9ed1d640 1 Processor -- start 2023-11-28T20:10:51.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9ed1d640 1 -- start start 2023-11-28T20:10:51.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9ed1d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fac98144840 0x7fac9806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:51.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9ed1d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fac98070b70 0x7fac9806c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:51.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9ed1d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac980710e0 con 0x7fac98072180 2023-11-28T20:10:51.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9ed1d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9815f010 con 0x7fac98144840 2023-11-28T20:10:51.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9ed1d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac980713c0 con 0x7fac98070b70 2023-11-28T20:10:51.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9cab9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fac98144840 0x7fac9806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:51.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9cab9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fac98144840 0x7fac9806c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43564/0 (socket says 172.21.15.177:43564) 2023-11-28T20:10:51.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9cab9640 1 -- 172.21.15.177:0/916198802 learned_addr learned my addr 172.21.15.177:0/916198802 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:51.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9cab9640 1 -- 172.21.15.177:0/916198802 >> v2:172.21.15.195:3300/0 conn(0x7fac98070b70 msgr2=0x7fac9806c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:51.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9d2ba640 1 --2- 172.21.15.177:0/916198802 >> v2:172.21.15.195:3300/0 conn(0x7fac98070b70 0x7fac9806c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:51.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9cab9640 1 --2- 172.21.15.177:0/916198802 >> v2:172.21.15.195:3300/0 conn(0x7fac98070b70 0x7fac9806c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9cab9640 1 -- 172.21.15.177:0/916198802 >> v1:172.21.15.195:6789/0 conn(0x7fac98072180 legacy=0x7fac98070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:51.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9cab9640 1 -- 172.21.15.177:0/916198802 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac980716a0 con 0x7fac98144840 2023-11-28T20:10:51.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.323+0000 7fac9d2ba640 1 --2- 172.21.15.177:0/916198802 >> v2:172.21.15.195:3300/0 conn(0x7fac98070b70 0x7fac9806c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:51.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.327+0000 7fac9cab9640 1 --2- 172.21.15.177:0/916198802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac98144840 0x7fac9806c2c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fac980b2070 tx=0x7fac8c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18673be6e17ee075 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:51.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.327+0000 7fac977fe640 1 -- 172.21.15.177:0/916198802 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c0aa5f0 con 0x7fac98144840 2023-11-28T20:10:51.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.327+0000 7fac977fe640 1 -- 172.21.15.177:0/916198802 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8c0aa750 con 0x7fac98144840 2023-11-28T20:10:51.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.327+0000 7fac977fe640 1 -- 172.21.15.177:0/916198802 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c0aaae0 con 0x7fac98144840 2023-11-28T20:10:51.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.327+0000 7fac9ed1d640 1 -- 172.21.15.177:0/916198802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac98144840 msgr2=0x7fac9806c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:51.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.327+0000 7fac9ed1d640 1 --2- 172.21.15.177:0/916198802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac98144840 0x7fac9806c2c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fac980b2070 tx=0x7fac8c01c490 comp rx=0 tx=0).stop 2023-11-28T20:10:51.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.327+0000 7fac9ed1d640 1 -- 172.21.15.177:0/916198802 shutdown_connections 2023-11-28T20:10:51.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.327+0000 7fac9ed1d640 1 --2- 172.21.15.177:0/916198802 >> v2:172.21.15.195:3300/0 conn(0x7fac98070b70 0x7fac9806c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.327+0000 7fac9ed1d640 1 --2- 172.21.15.177:0/916198802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac98144840 0x7fac9806c2c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.327+0000 7fac9ed1d640 1 -- 172.21.15.177:0/916198802 >> 172.21.15.177:0/916198802 conn(0x7fac9806a530 msgr2=0x7fac9806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:51.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9ed1d640 1 -- 172.21.15.177:0/916198802 shutdown_connections 2023-11-28T20:10:51.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9ed1d640 1 -- 172.21.15.177:0/916198802 wait complete. 2023-11-28T20:10:51.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9ed1d640 1 Processor -- start 2023-11-28T20:10:51.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9ed1d640 1 -- start start 2023-11-28T20:10:51.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9ed1d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac98070b70 0x7fac98139fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:51.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9ed1d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fac98072180 0x7fac98138910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:51.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9ed1d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac98144840 0x7fac9813d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:51.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9ed1d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9815abc0 con 0x7fac98144840 2023-11-28T20:10:51.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9ed1d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac98138e50 con 0x7fac98070b70 2023-11-28T20:10:51.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9ed1d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac98138fd0 con 0x7fac98072180 2023-11-28T20:10:51.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9d2ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac98144840 0x7fac9813d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:51.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9d2ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac98144840 0x7fac9813d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43580/0 (socket says 172.21.15.177:43580) 2023-11-28T20:10:51.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9d2ba640 1 -- 172.21.15.177:0/958382276 learned_addr learned my addr 172.21.15.177:0/958382276 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:51.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9cab9640 1 --2- 172.21.15.177:0/958382276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac98070b70 0x7fac98139fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:51.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac97fff640 1 --2- 172.21.15.177:0/958382276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fac98072180 0x7fac98138910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:51.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9d2ba640 1 -- 172.21.15.177:0/958382276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fac98072180 msgr2=0x7fac98138910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:51.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9d2ba640 1 --2- 172.21.15.177:0/958382276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fac98072180 0x7fac98138910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9d2ba640 1 -- 172.21.15.177:0/958382276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac98070b70 msgr2=0x7fac98139fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:51.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9d2ba640 1 --2- 172.21.15.177:0/958382276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac98070b70 0x7fac98139fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9d2ba640 1 -- 172.21.15.177:0/958382276 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c0094d0 con 0x7fac98144840 2023-11-28T20:10:51.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac97fff640 1 --2- 172.21.15.177:0/958382276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fac98072180 0x7fac98138910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:10:51.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac9d2ba640 1 --2- 172.21.15.177:0/958382276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac98144840 0x7fac9813d4d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fac9000cef0 tx=0x7fac9000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:51.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.331+0000 7fac957fa640 1 -- 172.21.15.177:0/958382276 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9000d840 con 0x7fac98144840 2023-11-28T20:10:51.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.335+0000 7fac957fa640 1 -- 172.21.15.177:0/958382276 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9000d9c0 con 0x7fac98144840 2023-11-28T20:10:51.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.335+0000 7fac9ed1d640 1 -- 172.21.15.177:0/958382276 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac98139220 con 0x7fac98144840 2023-11-28T20:10:51.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.335+0000 7fac957fa640 1 -- 172.21.15.177:0/958382276 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9000dd70 con 0x7fac98144840 2023-11-28T20:10:51.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.335+0000 7fac9ed1d640 1 -- 172.21.15.177:0/958382276 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac981397e0 con 0x7fac98144840 2023-11-28T20:10:51.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.335+0000 7fac9ed1d640 1 -- 172.21.15.177:0/958382276 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac98069440 con 0x7fac98144840 2023-11-28T20:10:51.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.335+0000 7fac957fa640 1 -- 172.21.15.177:0/958382276 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fac9001f440 con 0x7fac98144840 2023-11-28T20:10:51.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.335+0000 7fac957fa640 1 --2- 172.21.15.177:0/958382276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fac7c066470 0x7fac7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:51.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.335+0000 7fac957fa640 1 -- 172.21.15.177:0/958382276 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fac90084560 con 0x7fac98144840 2023-11-28T20:10:51.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.335+0000 7fac9cab9640 1 --2- 172.21.15.177:0/958382276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fac7c066470 0x7fac7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:51.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.335+0000 7fac9cab9640 1 --2- 172.21.15.177:0/958382276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fac7c066470 0x7fac7c068930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0ae000 tx=0x7fac8c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:51.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.339+0000 7fac957fa640 1 -- 172.21.15.177:0/958382276 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fac90051e30 con 0x7fac98144840 2023-11-28T20:10:51.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.487+0000 7fac9ed1d640 1 -- 172.21.15.177:0/958382276 --> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac9806d170 con 0x7fac7c066470 2023-11-28T20:10:51.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.491+0000 7fac957fa640 1 -- 172.21.15.177:0/958382276 <== mgr.4103 v2:172.21.15.177:6832/2011209269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50609 (secure 0 0 0) 0x7fac9806d170 con 0x7fac7c066470 2023-11-28T20:10:51.495 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:51.496 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-28T20:10:51.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.491+0000 7fac9ed1d640 1 -- 172.21.15.177:0/958382276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fac7c066470 msgr2=0x7fac7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:51.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.491+0000 7fac9ed1d640 1 --2- 172.21.15.177:0/958382276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fac7c066470 0x7fac7c068930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0ae000 tx=0x7fac8c0a7000 comp rx=0 tx=0).stop 2023-11-28T20:10:51.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.491+0000 7fac9ed1d640 1 -- 172.21.15.177:0/958382276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac98144840 msgr2=0x7fac9813d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:51.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.491+0000 7fac9ed1d640 1 --2- 172.21.15.177:0/958382276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac98144840 0x7fac9813d4d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fac9000cef0 tx=0x7fac9000a710 comp rx=0 tx=0).stop 2023-11-28T20:10:51.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.491+0000 7fac9ed1d640 1 -- 172.21.15.177:0/958382276 shutdown_connections 2023-11-28T20:10:51.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.491+0000 7fac9ed1d640 1 --2- 172.21.15.177:0/958382276 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fac7c066470 0x7fac7c068930 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.491+0000 7fac9ed1d640 1 --2- 172.21.15.177:0/958382276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac98144840 0x7fac9813d4d0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.491+0000 7fac9ed1d640 1 --2- 172.21.15.177:0/958382276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fac98072180 0x7fac98138910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.491+0000 7fac9ed1d640 1 --2- 172.21.15.177:0/958382276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac98070b70 0x7fac98139fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.491+0000 7fac9ed1d640 1 -- 172.21.15.177:0/958382276 >> 172.21.15.177:0/958382276 conn(0x7fac9806a530 msgr2=0x7fac9815d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:51.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.491+0000 7fac9ed1d640 1 -- 172.21.15.177:0/958382276 shutdown_connections 2023-11-28T20:10:51.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.491+0000 7fac9ed1d640 1 -- 172.21.15.177:0/958382276 wait complete. 2023-11-28T20:10:51.516 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-11-28T20:10:51.456069+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":243040,"kb_used_data":6056,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731680,"statfs":{"total":773094113280,"available":772845240320,"internally_reserved":0,"allocated":6201344,"data_stored":3258544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002266"},"pg_stats":[{"pgid":"1.0","version":"52'119","reported_seq":205,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T20:10:31.070890+0000","last_change":"2023-11-28T20:10:31.070922+0000","last_active":"2023-11-28T20:10:31.070890+0000","last_peered":"2023-11-28T20:10:31.070890+0000","last_clean":"2023-11-28T20:10:31.070890+0000","last_became_active":"2023-11-28T20:07:30.785445+0000","last_became_peered":"2023-11-28T20:07:30.785445+0000","last_unstale":"2023-11-28T20:10:31.070890+0000","last_undegraded":"2023-11-28T20:10:31.070890+0000","last_fullsized":"2023-11-28T20:10:31.070890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'119","last_scrub_stamp":"2023-11-28T20:10:31.070792+0000","last_deep_scrub":"52'119","last_deep_scrub_stamp":"2023-11-28T20:10:31.070792+0000","last_clean_scrub_stamp":"2023-11-28T20:10:31.070792+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:22.481921+0000","scrub_duration":0.0072274380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1220608,"data_stored":850094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.59499999999999997},"min":{"1min":0.45600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.82399999999999995,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66700000000000004,"15min":0.65700000000000003},"min":{"1min":0.46100000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85799999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.82399999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66700000000000004,"15min":0.65500000000000003},"min":{"1min":0.53100000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93700000000000006,"5min":1.161,"15min":1.161},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.50900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.77800000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.89800000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90800000000000003,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.48699999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.82299999999999995,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Tue Nov 28 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.51700000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.82099999999999995,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72199999999999998,"15min":0.70699999999999996},"min":{"1min":0.54200000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.85799999999999998,"5min":1.165,"15min":1.165},"last":0.748}]},{"osd":4,"last update":"Tue Nov 28 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.439,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84699999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82499999999999996,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68600000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66400000000000003,"15min":0.65800000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90700000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.874},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70599999999999996,"15min":0.71199999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83399999999999996,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.78300000000000003,"15min":0.80400000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.88700000000000001,"5min":1.272,"15min":1.272},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.48699999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.77700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31800,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":626688,"data_stored":259726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90800000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.748},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70499999999999996,"15min":0.68899999999999995},"min":{"1min":0.48299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.996,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.82199999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69999999999999996,"15min":0.68500000000000005},"min":{"1min":0.45300000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84899999999999998,"5min":3.54,"15min":3.54},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.746,"15min":0.72399999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.02,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.83999999999999997}]},{"osd":2,"last update":"Tue Nov 28 20:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68300000000000005,"15min":0.65700000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90700000000000003,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.749,"15min":0.73499999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.89400000000000002,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.79100000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":0.79400000000000004},"min":{"1min":0.505,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.022,"5min":1.357,"15min":1.357},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80600000000000005,"15min":0.77200000000000002},"min":{"1min":0.54800000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94899999999999995,"5min":6.2249999999999996,"15min":6.2249999999999996},"last":0.71999999999999997}]},{"osd":4,"last update":"Tue Nov 28 20:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72899999999999998,"15min":0.71699999999999997},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.151,"5min":4.0789999999999997,"15min":4.0789999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.46500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.92200000000000004,"5min":2.9390000000000001,"15min":2.9390000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.79900000000000004,"15min":0.77100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0860000000000001,"5min":8.6159999999999997,"15min":8.6159999999999997},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.81999999999999995,"15min":0.81599999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0609999999999999,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.80500000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.82699999999999996,"15min":0.83599999999999997},"min":{"1min":0.59299999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0649999999999999,"5min":2.879,"15min":2.879},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.83599999999999997,"15min":0.84999999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.052,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.65900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31800,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":626688,"data_stored":259726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.627,"15min":0.625},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.85799999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64400000000000002,"15min":0.63500000000000001},"min":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67100000000000004,"15min":0.66400000000000003},"min":{"1min":0.60299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92900000000000005,"5min":1.083,"15min":1.083},"last":0.78300000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68799999999999994,"15min":0.68300000000000005},"min":{"1min":0.54900000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94599999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.498,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96099999999999997,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.79900000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69999999999999996,"15min":0.70199999999999996},"min":{"1min":0.48499999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91500000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.56200000000000006,"5min":0.435,"15min":0.435},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.873}]},{"osd":4,"last update":"Tue Nov 28 20:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66200000000000003,"15min":0.66500000000000004},"min":{"1min":0.45200000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.505,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.871,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.71499999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.48599999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.90500000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.755},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.58199999999999996,"5min":0.37,"15min":0.37},"max":{"1min":0.98599999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.68999999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67900000000000005,"15min":0.68000000000000005},"min":{"1min":0.48099999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91800000000000004,"5min":0.997,"15min":0.997},"last":0.623},{"interface":"front","average":{"1min":0.751,"5min":0.72799999999999998,"15min":0.73299999999999998},"min":{"1min":0.54700000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93799999999999994,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.64700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31796,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":626688,"data_stored":259726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68300000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92800000000000005,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.999,"5min":1.361,"15min":1.361},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.54000000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90000000000000002,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69199999999999995,"15min":0.69999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89400000000000002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.61199999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.57399999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94399999999999995,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.52000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95399999999999996,"5min":1.04,"15min":1.04},"last":0.71699999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.85799999999999998,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.65400000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.995,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.42599999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91800000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91800000000000004,"5min":1.038,"15min":1.038},"last":0.55400000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.73299999999999998},"min":{"1min":0.43099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.80200000000000005,"15min":0.83599999999999997},"min":{"1min":0.56200000000000006,"5min":0.502,"15min":0.502},"max":{"1min":0.97799999999999998,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.78000000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.80800000000000005,"15min":0.83799999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.84499999999999997,"15min":0.872},"min":{"1min":0.61099999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.109,"5min":1.353,"15min":1.353},"last":0.80300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27636,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":626688,"data_stored":259726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.44700000000000001,"15min":0.46200000000000002},"min":{"1min":0.26100000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.58199999999999996,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.61699999999999999,"15min":0.70099999999999996},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68400000000000005,"5min":6.016,"15min":6.016},"last":0.52600000000000002}]},{"osd":1,"last update":"Tue Nov 28 20:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46000000000000002,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66500000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.51000000000000001,"15min":0.52500000000000002},"min":{"1min":0.34200000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59699999999999998,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Tue Nov 28 20:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55700000000000005,"15min":0.57299999999999995},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95099999999999996,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60099999999999998,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86199999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.68200000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.88900000000000001,"15min":0.96499999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.99099999999999999,"5min":5.8810000000000002,"15min":5.8810000000000002},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.77300000000000002,"15min":0.79000000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.006,"5min":1.405,"15min":1.405},"last":0.99099999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.077,"5min":1.585,"15min":1.585},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.91700000000000004,"15min":0.995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0640000000000001,"5min":5.9349999999999996,"15min":5.9349999999999996},"last":0.92200000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73099999999999998,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93799999999999994,"5min":1.361,"15min":1.361},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0209999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.88900000000000001}]},{"osd":7,"last update":"Tue Nov 28 20:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.89200000000000002,"15min":0.96899999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.012,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.5,"5min":0.495,"15min":0.495},"max":{"1min":0.97599999999999998,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27636,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":626688,"data_stored":259726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.45300000000000001,"15min":0.46899999999999997},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54800000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53900000000000003,"15min":0.51800000000000002},"min":{"1min":0.33400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.751,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.48999999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.53000000000000003,"15min":0.50600000000000001},"min":{"1min":0.29799999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57099999999999995,"5min":5.3140000000000001,"15min":5.3140000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.59399999999999997,"15min":0.60499999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.58299999999999996,"5min":3.7650000000000001,"15min":3.7650000000000001},"last":0.56100000000000005}]},{"osd":3,"last update":"Tue Nov 28 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.621,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.65000000000000002,"5min":1.27,"15min":1.27},"last":0.46899999999999997}]},{"osd":4,"last update":"Tue Nov 28 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.745,"15min":0.75800000000000001},"min":{"1min":0.52700000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.92800000000000005,"5min":1.415,"15min":1.415},"last":0.623},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.80300000000000005,"15min":0.80200000000000005},"min":{"1min":0.56299999999999994,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0109999999999999,"5min":3.8090000000000002,"15min":3.8090000000000002},"last":0.72499999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.86699999999999999,"15min":0.874},"min":{"1min":0.58999999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.03,"5min":5.2809999999999997,"15min":5.2809999999999997},"last":0.748},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.55300000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0780000000000001,"5min":1.48,"15min":1.48},"last":0.67500000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.84999999999999998,"15min":0.871},"min":{"1min":0.53200000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.002,"5min":4.5369999999999999,"15min":4.5369999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.86699999999999999,"15min":0.85899999999999999},"min":{"1min":0.57699999999999996,"5min":0.496,"15min":0.496},"max":{"1min":0.995,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.61199999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.85699999999999998,"15min":0.86699999999999999},"min":{"1min":0.56599999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0649999999999999,"5min":3.863,"15min":3.863},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.86899999999999999,"15min":0.875},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0449999999999999,"5min":5.2460000000000004,"15min":5.2460000000000004},"last":0.58399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27636,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":626688,"data_stored":259726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.54900000000000004,"15min":0.62},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.54500000000000004,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.58499999999999996,"15min":0.64700000000000002},"min":{"1min":0.36499999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67400000000000004,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.54000000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.59299999999999997,"15min":0.66500000000000004},"min":{"1min":0.32800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.54300000000000004,"5min":4.9909999999999997,"15min":4.9909999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.626,"15min":0.70099999999999996},"min":{"1min":0.33800000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.61399999999999999,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.60899999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55900000000000005,"15min":0.57899999999999996},"min":{"1min":0.42599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68799999999999994,"5min":1.389,"15min":1.389},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.623,"15min":0.68899999999999995},"min":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76300000000000001,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.69499999999999995}]},{"osd":4,"last update":"Tue Nov 28 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.90900000000000003,"15min":0.95699999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.321,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":1.0149999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.86199999999999999,"15min":0.93799999999999994},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92200000000000004,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":1.032},{"interface":"front","average":{"1min":0.751,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":1.0820000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.90900000000000003,"15min":0.97799999999999998},"min":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1930000000000001,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.79500000000000004,"15min":0.81299999999999994},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.048}]},{"osd":7,"last update":"Tue Nov 28 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.88900000000000001,"15min":0.95699999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2110000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.89400000000000002,"15min":0.96799999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2509999999999999,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":0.96999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1220608,"data_stored":850094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.41599999999999998,"15min":0.42299999999999999},"min":{"1min":0.29499999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51900000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.46700000000000003,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65000000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.47299999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.49199999999999999,"15min":0.499},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.59699999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.499},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.503,"15min":0.51100000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52900000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.34399999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.74399999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.60099999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.52400000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.624},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.55300000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0189999999999999,"5min":1.524,"15min":1.524},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.74299999999999999,"15min":0.73499999999999999},"min":{"1min":0.59899999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.089,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.048,"5min":1.214,"15min":1.214},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.137,"5min":1.415,"15min":1.415},"last":0.72099999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.748,"15min":0.76100000000000001},"min":{"1min":0.55600000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.006,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73599999999999999,"15min":0.72799999999999998},"min":{"1min":0.54000000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:10:51.519 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-28T20:10:51.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.651+0000 7fc874ac9640 1 Processor -- start 2023-11-28T20:10:51.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.651+0000 7fc874ac9640 1 -- start start 2023-11-28T20:10:51.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.651+0000 7fc874ac9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc870071d90 0x7fc870072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:51.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.651+0000 7fc874ac9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc87015adb0 0x7fc87013d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:51.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.651+0000 7fc874ac9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87013d2b0 con 0x7fc87013f5f0 2023-11-28T20:10:51.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.651+0000 7fc874ac9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc870140520 con 0x7fc87015adb0 2023-11-28T20:10:51.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.651+0000 7fc874ac9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8700cd7f0 con 0x7fc870071d90 2023-11-28T20:10:51.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.651+0000 7fc865d9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc87015adb0 0x7fc87013d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:51.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.651+0000 7fc865d9b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc87015adb0 0x7fc87013d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43584/0 (socket says 172.21.15.177:43584) 2023-11-28T20:10:51.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.651+0000 7fc865d9b640 1 -- 172.21.15.177:0/2371424057 learned_addr learned my addr 172.21.15.177:0/2371424057 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:51.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.651+0000 7fc86e59c640 1 --2- 172.21.15.177:0/2371424057 >> v2:172.21.15.195:3300/0 conn(0x7fc870071d90 0x7fc870072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:51.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.651+0000 7fc865d9b640 1 -- 172.21.15.177:0/2371424057 >> v2:172.21.15.195:3300/0 conn(0x7fc870071d90 msgr2=0x7fc870072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:51.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.651+0000 7fc865d9b640 1 --2- 172.21.15.177:0/2371424057 >> v2:172.21.15.195:3300/0 conn(0x7fc870071d90 0x7fc870072170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.651+0000 7fc865d9b640 1 -- 172.21.15.177:0/2371424057 >> v1:172.21.15.195:6789/0 conn(0x7fc87013f5f0 legacy=0x7fc8700ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:51.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.651+0000 7fc865d9b640 1 -- 172.21.15.177:0/2371424057 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8700cdd70 con 0x7fc87015adb0 2023-11-28T20:10:51.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.655+0000 7fc865d9b640 1 --2- 172.21.15.177:0/2371424057 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc87015adb0 0x7fc87013d560 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc8700b1d80 tx=0x7fc85801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b4e9d93bf8a9df server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:51.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.655+0000 7fc86dd9b640 1 -- 172.21.15.177:0/2371424057 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8580aa660 con 0x7fc87015adb0 2023-11-28T20:10:51.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.655+0000 7fc86dd9b640 1 -- 172.21.15.177:0/2371424057 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8580aa7c0 con 0x7fc87015adb0 2023-11-28T20:10:51.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.655+0000 7fc86dd9b640 1 -- 172.21.15.177:0/2371424057 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8580aab50 con 0x7fc87015adb0 2023-11-28T20:10:51.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.655+0000 7fc874ac9640 1 -- 172.21.15.177:0/2371424057 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc87015adb0 msgr2=0x7fc87013d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:51.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.655+0000 7fc874ac9640 1 --2- 172.21.15.177:0/2371424057 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc87015adb0 0x7fc87013d560 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc8700b1d80 tx=0x7fc85801c500 comp rx=0 tx=0).stop 2023-11-28T20:10:51.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.655+0000 7fc874ac9640 1 -- 172.21.15.177:0/2371424057 shutdown_connections 2023-11-28T20:10:51.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.655+0000 7fc874ac9640 1 --2- 172.21.15.177:0/2371424057 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc87015adb0 0x7fc87013d560 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.655+0000 7fc874ac9640 1 --2- 172.21.15.177:0/2371424057 >> v2:172.21.15.195:3300/0 conn(0x7fc870071d90 0x7fc870072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.655+0000 7fc874ac9640 1 -- 172.21.15.177:0/2371424057 >> 172.21.15.177:0/2371424057 conn(0x7fc8700b0cc0 msgr2=0x7fc8700b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:51.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.655+0000 7fc874ac9640 1 -- 172.21.15.177:0/2371424057 shutdown_connections 2023-11-28T20:10:51.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.655+0000 7fc874ac9640 1 -- 172.21.15.177:0/2371424057 wait complete. 2023-11-28T20:10:51.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc874ac9640 1 Processor -- start 2023-11-28T20:10:51.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc874ac9640 1 -- start start 2023-11-28T20:10:51.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc874ac9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc870071d90 0x7fc8701368f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:51.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc874ac9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc87013f5f0 0x7fc8701371c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:51.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc874ac9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc87015adb0 0x7fc870137700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:51.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc874ac9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700af640 con 0x7fc87013f5f0 2023-11-28T20:10:51.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc874ac9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700b04a0 con 0x7fc870071d90 2023-11-28T20:10:51.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc874ac9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700af890 con 0x7fc87015adb0 2023-11-28T20:10:51.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc865d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc87013f5f0 0x7fc8701371c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:51.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc865d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc87013f5f0 0x7fc8701371c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43590/0 (socket says 172.21.15.177:43590) 2023-11-28T20:10:51.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc865d9b640 1 -- 172.21.15.177:0/679588411 learned_addr learned my addr 172.21.15.177:0/679588411 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:51.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc86e59c640 1 --2- 172.21.15.177:0/679588411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc870071d90 0x7fc8701368f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:51.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc86ed9d640 1 --2- 172.21.15.177:0/679588411 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc87015adb0 0x7fc870137700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:51.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc865d9b640 1 -- 172.21.15.177:0/679588411 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc87015adb0 msgr2=0x7fc870137700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:51.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc865d9b640 1 --2- 172.21.15.177:0/679588411 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc87015adb0 0x7fc870137700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc865d9b640 1 -- 172.21.15.177:0/679588411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc870071d90 msgr2=0x7fc8701368f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:51.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc865d9b640 1 --2- 172.21.15.177:0/679588411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc870071d90 0x7fc8701368f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc865d9b640 1 -- 172.21.15.177:0/679588411 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8580094d0 con 0x7fc87013f5f0 2023-11-28T20:10:51.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc86e59c640 1 --2- 172.21.15.177:0/679588411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc870071d90 0x7fc8701368f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:51.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc865d9b640 1 --2- 172.21.15.177:0/679588411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc87013f5f0 0x7fc8701371c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc8580ac040 tx=0x7fc85801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:51.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc8677fe640 1 -- 172.21.15.177:0/679588411 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8580b3800 con 0x7fc87013f5f0 2023-11-28T20:10:51.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc8677fe640 1 -- 172.21.15.177:0/679588411 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8580b3960 con 0x7fc87013f5f0 2023-11-28T20:10:51.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc8677fe640 1 -- 172.21.15.177:0/679588411 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8580b3cd0 con 0x7fc87013f5f0 2023-11-28T20:10:51.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc874ac9640 1 -- 172.21.15.177:0/679588411 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8700afb70 con 0x7fc87013f5f0 2023-11-28T20:10:51.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.659+0000 7fc874ac9640 1 -- 172.21.15.177:0/679588411 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8700b0130 con 0x7fc87013f5f0 2023-11-28T20:10:51.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.663+0000 7fc874ac9640 1 -- 172.21.15.177:0/679588411 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc870073ca0 con 0x7fc87013f5f0 2023-11-28T20:10:51.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.663+0000 7fc8677fe640 1 -- 172.21.15.177:0/679588411 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc8580a9440 con 0x7fc87013f5f0 2023-11-28T20:10:51.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.663+0000 7fc8677fe640 1 --2- 172.21.15.177:0/679588411 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc8500664a0 0x7fc850068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:51.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.663+0000 7fc8677fe640 1 -- 172.21.15.177:0/679588411 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc8580a6040 con 0x7fc87013f5f0 2023-11-28T20:10:51.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.663+0000 7fc86e59c640 1 --2- 172.21.15.177:0/679588411 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc8500664a0 0x7fc850068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:51.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.663+0000 7fc86e59c640 1 --2- 172.21.15.177:0/679588411 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc8500664a0 0x7fc850068960 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc860009b10 tx=0x7fc860008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:51.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.667+0000 7fc8677fe640 1 -- 172.21.15.177:0/679588411 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc870073ca0 con 0x7fc87013f5f0 2023-11-28T20:10:51.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.819+0000 7fc874ac9640 1 -- 172.21.15.177:0/679588411 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fc870073ca0 con 0x7fc87013f5f0 2023-11-28T20:10:51.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.823+0000 7fc8677fe640 1 -- 172.21.15.177:0/679588411 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc870073ca0 con 0x7fc87013f5f0 2023-11-28T20:10:51.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.827+0000 7fc8677fe640 1 -- 172.21.15.177:0/679588411 <== mon.0 v2:172.21.15.177:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc8580ebb30 con 0x7fc87013f5f0 2023-11-28T20:10:51.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.827+0000 7fc874ac9640 1 -- 172.21.15.177:0/679588411 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc8500664a0 msgr2=0x7fc850068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:51.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.827+0000 7fc874ac9640 1 --2- 172.21.15.177:0/679588411 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc8500664a0 0x7fc850068960 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc860009b10 tx=0x7fc860008040 comp rx=0 tx=0).stop 2023-11-28T20:10:51.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.827+0000 7fc874ac9640 1 -- 172.21.15.177:0/679588411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc87013f5f0 msgr2=0x7fc8701371c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:51.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.827+0000 7fc874ac9640 1 --2- 172.21.15.177:0/679588411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc87013f5f0 0x7fc8701371c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc8580ac040 tx=0x7fc85801ad40 comp rx=0 tx=0).stop 2023-11-28T20:10:51.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.827+0000 7fc874ac9640 1 -- 172.21.15.177:0/679588411 shutdown_connections 2023-11-28T20:10:51.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.827+0000 7fc874ac9640 1 --2- 172.21.15.177:0/679588411 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7fc8500664a0 0x7fc850068960 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.827+0000 7fc874ac9640 1 --2- 172.21.15.177:0/679588411 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc87015adb0 0x7fc870137700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.827+0000 7fc874ac9640 1 --2- 172.21.15.177:0/679588411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc87013f5f0 0x7fc8701371c0 secure :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc8580ac040 tx=0x7fc85801ad40 comp rx=0 tx=0).stop 2023-11-28T20:10:51.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.827+0000 7fc874ac9640 1 --2- 172.21.15.177:0/679588411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc870071d90 0x7fc8701368f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:51.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.827+0000 7fc874ac9640 1 -- 172.21.15.177:0/679588411 >> 172.21.15.177:0/679588411 conn(0x7fc8700b0cc0 msgr2=0x7fc87015bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:51.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.827+0000 7fc874ac9640 1 -- 172.21.15.177:0/679588411 shutdown_connections 2023-11-28T20:10:51.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.827+0000 7fc874ac9640 1 -- 172.21.15.177:0/679588411 wait complete. 2023-11-28T20:10:51.855 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T20:10:51.855 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:10:51.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.987+0000 7f95c1b1d640 1 Processor -- start 2023-11-28T20:10:51.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.987+0000 7f95c1b1d640 1 -- start start 2023-11-28T20:10:51.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.991+0000 7f95c1b1d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f95bc070b70 0x7f95bc165fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:51.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.991+0000 7f95c1b1d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc0710e0 con 0x7f95bc06c9d0 2023-11-28T20:10:51.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.991+0000 7f95c1b1d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc0713c0 con 0x7f95bc144840 2023-11-28T20:10:51.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.991+0000 7f95c1b1d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc15f010 con 0x7f95bc070b70 2023-11-28T20:10:51.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.991+0000 7f95bbfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f95bc070b70 0x7f95bc165fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:51.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.991+0000 7f95b3fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f95bc06c9d0 0x7f95bc070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:34154/0 (socket says 172.21.15.177:34154) 2023-11-28T20:10:51.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.991+0000 7f95bbfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f95bc070b70 0x7f95bc165fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43606/0 (socket says 172.21.15.177:43606) 2023-11-28T20:10:51.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.991+0000 7f95b3fff640 1 -- 172.21.15.177:0/1426744731 learned_addr learned my addr 172.21.15.177:0/1426744731 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-28T20:10:51.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.991+0000 7f95bbfff640 1 -- 172.21.15.177:0/1426744731 >> v1:172.21.15.195:6789/0 conn(0x7f95bc144840 legacy=0x7f95bc06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:10:51.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.991+0000 7f95bbfff640 1 -- 172.21.15.177:0/1426744731 >> v1:172.21.15.177:6789/0 conn(0x7f95bc06c9d0 legacy=0x7f95bc070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:51.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.991+0000 7f95bbfff640 1 -- 172.21.15.177:0/1426744731 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc0716a0 con 0x7f95bc070b70 2023-11-28T20:10:51.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95bbfff640 1 --2- 172.21.15.177:0/1426744731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc070b70 0x7f95bc165fe0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009d90 tx=0x7f95b401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15e71caf98b3d57 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:51.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95baffd640 1 -- 172.21.15.177:0/1426744731 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40a59a0 con 0x7f95bc070b70 2023-11-28T20:10:51.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95baffd640 1 -- 172.21.15.177:0/1426744731 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f95b40a5b00 con 0x7f95bc070b70 2023-11-28T20:10:51.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95baffd640 1 -- 172.21.15.177:0/1426744731 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40ad440 con 0x7f95bc070b70 2023-11-28T20:10:52.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95c1b1d640 1 -- 172.21.15.177:0/1426744731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc070b70 msgr2=0x7f95bc165fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:52.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95c1b1d640 1 --2- 172.21.15.177:0/1426744731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc070b70 0x7f95bc165fe0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009d90 tx=0x7f95b401c8e0 comp rx=0 tx=0).stop 2023-11-28T20:10:52.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95c1b1d640 1 -- 172.21.15.177:0/1426744731 shutdown_connections 2023-11-28T20:10:52.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95c1b1d640 1 --2- 172.21.15.177:0/1426744731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc070b70 0x7f95bc165fe0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:52.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95c1b1d640 1 -- 172.21.15.177:0/1426744731 >> 172.21.15.177:0/1426744731 conn(0x7f95bc06a530 msgr2=0x7f95bc06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:52.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95c1b1d640 1 -- 172.21.15.177:0/1426744731 shutdown_connections 2023-11-28T20:10:52.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95c1b1d640 1 -- 172.21.15.177:0/1426744731 wait complete. 2023-11-28T20:10:52.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95c1b1d640 1 Processor -- start 2023-11-28T20:10:52.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95c1b1d640 1 -- start start 2023-11-28T20:10:52.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95c1b1d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95bc06c9d0 0x7f95bc0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:52.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95c1b1d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95bc070b70 0x7f95bc13fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:52.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95c1b1d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc144840 0x7f95bc15a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:52.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95c1b1d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc142130 con 0x7f95bc144840 2023-11-28T20:10:52.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95c1b1d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc13b3b0 con 0x7f95bc070b70 2023-11-28T20:10:52.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.995+0000 7f95c1b1d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc13b690 con 0x7f95bc06c9d0 2023-11-28T20:10:52.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc144840 0x7f95bc15a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:52.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc144840 0x7f95bc15a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43620/0 (socket says 172.21.15.177:43620) 2023-11-28T20:10:52.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95bbfff640 1 -- 172.21.15.177:0/3486845754 learned_addr learned my addr 172.21.15.177:0/3486845754 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-28T20:10:52.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95b3fff640 1 --2- 172.21.15.177:0/3486845754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95bc070b70 0x7f95bc13fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:52.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95bb7fe640 1 --2- 172.21.15.177:0/3486845754 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95bc06c9d0 0x7f95bc0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:52.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95bbfff640 1 -- 172.21.15.177:0/3486845754 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95bc06c9d0 msgr2=0x7f95bc0b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:52.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95bbfff640 1 --2- 172.21.15.177:0/3486845754 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95bc06c9d0 0x7f95bc0b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:52.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95bbfff640 1 -- 172.21.15.177:0/3486845754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95bc070b70 msgr2=0x7f95bc13fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:52.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95bbfff640 1 --2- 172.21.15.177:0/3486845754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95bc070b70 0x7f95bc13fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:52.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95bbfff640 1 -- 172.21.15.177:0/3486845754 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b4009a70 con 0x7f95bc144840 2023-11-28T20:10:52.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95bb7fe640 1 --2- 172.21.15.177:0/3486845754 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95bc06c9d0 0x7f95bc0b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:10:52.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95bbfff640 1 --2- 172.21.15.177:0/3486845754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc144840 0x7f95bc15a640 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f95b401a510 tx=0x7f95b4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:52.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95b8ff9640 1 -- 172.21.15.177:0/3486845754 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40ade40 con 0x7f95bc144840 2023-11-28T20:10:52.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95b8ff9640 1 -- 172.21.15.177:0/3486845754 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f95b40b9450 con 0x7f95bc144840 2023-11-28T20:10:52.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95b8ff9640 1 -- 172.21.15.177:0/3486845754 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40b9800 con 0x7f95bc144840 2023-11-28T20:10:52.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95c1b1d640 1 -- 172.21.15.177:0/3486845754 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc13b970 con 0x7f95bc144840 2023-11-28T20:10:52.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95c1b1d640 1 -- 172.21.15.177:0/3486845754 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc13b0a0 con 0x7f95bc144840 2023-11-28T20:10:52.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95c1b1d640 1 -- 172.21.15.177:0/3486845754 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95bc069440 con 0x7f95bc144840 2023-11-28T20:10:52.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95b8ff9640 1 -- 172.21.15.177:0/3486845754 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f95b40b9960 con 0x7f95bc144840 2023-11-28T20:10:52.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95b8ff9640 1 --2- 172.21.15.177:0/3486845754 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f959c066470 0x7f959c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:10:52.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:51.999+0000 7f95b8ff9640 1 -- 172.21.15.177:0/3486845754 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f95b411f6b0 con 0x7f95bc144840 2023-11-28T20:10:52.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.003+0000 7f95bb7fe640 1 --2- 172.21.15.177:0/3486845754 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f959c066470 0x7f959c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:10:52.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.003+0000 7f95bb7fe640 1 --2- 172.21.15.177:0/3486845754 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f959c066470 0x7f959c068930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0098b0 tx=0x7f95ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:10:52.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.003+0000 7f95b8ff9640 1 -- 172.21.15.177:0/3486845754 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f95b40eceb0 con 0x7f95bc144840 2023-11-28T20:10:52.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.187+0000 7f95c1b1d640 1 -- 172.21.15.177:0/3486845754 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95bc06d170 con 0x7f95bc144840 2023-11-28T20:10:52.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.187+0000 7f95b8ff9640 1 -- 172.21.15.177:0/3486845754 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f95b40bde90 con 0x7f95bc144840 2023-11-28T20:10:52.193 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-28T20:10:52.193 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1822043740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1822043740},{"type":"v1","addr":"172.21.15.195:6835","nonce":1822043740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5713,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3889128653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3889128653},{"type":"v1","addr":"172.21.15.195:6834","nonce":3889128653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5898,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2574151536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2574151536},{"type":"v1","addr":"172.21.15.177:6835","nonce":2574151536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1838350300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1838350300},{"type":"v1","addr":"172.21.15.177:6837","nonce":1838350300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[]} 2023-11-28T20:10:52.194 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 28 2023-11-28T20:10:52.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.191+0000 7f95c1b1d640 1 -- 172.21.15.177:0/3486845754 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f959c066470 msgr2=0x7f959c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:52.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.191+0000 7f95c1b1d640 1 --2- 172.21.15.177:0/3486845754 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f959c066470 0x7f959c068930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0098b0 tx=0x7f95ac008040 comp rx=0 tx=0).stop 2023-11-28T20:10:52.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.191+0000 7f95c1b1d640 1 -- 172.21.15.177:0/3486845754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc144840 msgr2=0x7f95bc15a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:10:52.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.191+0000 7f95c1b1d640 1 --2- 172.21.15.177:0/3486845754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc144840 0x7f95bc15a640 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f95b401a510 tx=0x7f95b4019680 comp rx=0 tx=0).stop 2023-11-28T20:10:52.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.191+0000 7f95c1b1d640 1 -- 172.21.15.177:0/3486845754 shutdown_connections 2023-11-28T20:10:52.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.191+0000 7f95c1b1d640 1 --2- 172.21.15.177:0/3486845754 >> [v2:172.21.15.177:6832/2011209269,v1:172.21.15.177:6833/2011209269] conn(0x7f959c066470 0x7f959c068930 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:52.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.191+0000 7f95c1b1d640 1 --2- 172.21.15.177:0/3486845754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc144840 0x7f95bc15a640 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:52.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.191+0000 7f95c1b1d640 1 --2- 172.21.15.177:0/3486845754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95bc070b70 0x7f95bc13fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:52.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.191+0000 7f95c1b1d640 1 --2- 172.21.15.177:0/3486845754 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95bc06c9d0 0x7f95bc0b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:10:52.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.191+0000 7f95c1b1d640 1 -- 172.21.15.177:0/3486845754 >> 172.21.15.177:0/3486845754 conn(0x7f95bc06a530 msgr2=0x7f95bc0b1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:10:52.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.191+0000 7f95c1b1d640 1 -- 172.21.15.177:0/3486845754 shutdown_connections 2023-11-28T20:10:52.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-28T20:10:52.191+0000 7f95c1b1d640 1 -- 172.21.15.177:0/3486845754 wait complete. 2023-11-28T20:10:52.217 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-28T20:10:52.217 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-28T20:10:52.218 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T20:10:52.218 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:10:52.230 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T20:10:52.231 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T20:10:52.231 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:10:52.291 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T20:10:52.291 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T20:10:52.291 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:10:52.306 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T20:10:52.306 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T20:10:52.307 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:10:52.363 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T20:10:52.363 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-28T20:10:52.364 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-28T20:10:52.364 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:10:52.461 INFO:tasks.ceph.osd.0:Stopped 2023-11-28T20:10:52.462 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-28T20:10:52.462 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:10:56.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-28T20:10:58.564 INFO:tasks.ceph.osd.1:Stopped 2023-11-28T20:10:58.591 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-28T20:10:58.591 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:10:58.667 INFO:tasks.ceph.osd.2:Stopped 2023-11-28T20:10:58.668 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-28T20:10:58.668 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:11:01.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-28T20:11:01.983 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-11-28T20:11:04.770 INFO:tasks.ceph.osd.3:Stopped 2023-11-28T20:11:04.771 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-28T20:11:04.771 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:11:04.849 INFO:tasks.ceph.osd.4:Stopped 2023-11-28T20:11:04.850 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-28T20:11:04.850 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:11:07.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-11-28T20:11:07.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-28T20:11:10.297 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:11:10.301 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:11:10.951 INFO:tasks.ceph.osd.5:Stopped 2023-11-28T20:11:10.952 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-28T20:11:10.952 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:11:11.017 INFO:tasks.ceph.osd.6:Stopped 2023-11-28T20:11:11.017 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-28T20:11:11.017 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:11:11.114 INFO:tasks.ceph.osd.7:Stopped 2023-11-28T20:11:11.114 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-28T20:11:11.114 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-28T20:11:11.115 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:11:11.172 INFO:tasks.ceph.mgr.y:Stopped 2023-11-28T20:11:11.172 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-28T20:11:11.172 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:11:11.223 INFO:tasks.ceph.mgr.x:Stopped 2023-11-28T20:11:11.223 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-28T20:11:11.223 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T20:11:11.224 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:11:11.243 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T20:11:11.243 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T20:11:11.243 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:11:11.259 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T20:11:11.260 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T20:11:11.260 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:11:11.319 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T20:11:11.319 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-28T20:11:11.319 DEBUG:teuthology.orchestra.run.smithi177:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-28T20:11:11.350 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:11:11.351 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-28T20:11:11.592 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:11:11.593 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-28T20:11:11.772 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:11:11.772 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-28T20:11:11.897 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:11:11.898 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-28T20:11:12.038 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:11:12.039 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-28T20:11:12.370 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:11:12.370 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-28T20:11:12.589 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:11:12.589 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-28T20:11:12.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-11-28T20:11:12.762 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:11:12.763 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-28T20:11:12.921 INFO:tasks.ceph:Archiving mon data... 2023-11-28T20:11:12.922 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605/data/mon.a.tgz 2023-11-28T20:11:12.922 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2023-11-28T20:11:12.933 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.mmGo3lgCpd 2023-11-28T20:11:12.934 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.mmGo3lgCpd 2023-11-28T20:11:13.077 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.mmGo3lgCpd 2023-11-28T20:11:13.159 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.mmGo3lgCpd is 352KB 2023-11-28T20:11:13.228 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.mmGo3lgCpd 2023-11-28T20:11:13.236 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605/data/mon.b.tgz 2023-11-28T20:11:13.236 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2023-11-28T20:11:13.246 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.vKwmpNS1IZ 2023-11-28T20:11:13.246 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.vKwmpNS1IZ 2023-11-28T20:11:13.405 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.vKwmpNS1IZ 2023-11-28T20:11:13.485 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.vKwmpNS1IZ is 461KB 2023-11-28T20:11:13.551 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.vKwmpNS1IZ 2023-11-28T20:11:13.559 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605/data/mon.c.tgz 2023-11-28T20:11:13.560 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2023-11-28T20:11:13.612 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.2zRAqaT9iR 2023-11-28T20:11:13.613 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.2zRAqaT9iR 2023-11-28T20:11:13.772 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.2zRAqaT9iR 2023-11-28T20:11:13.845 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.2zRAqaT9iR is 461KB 2023-11-28T20:11:13.914 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.2zRAqaT9iR 2023-11-28T20:11:13.926 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-28T20:11:13.926 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T20:11:13.930 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T20:11:13.988 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-28T20:11:13.988 DEBUG:teuthology.orchestra.run.smithi177:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T20:11:13.996 DEBUG:teuthology.orchestra.run.smithi195:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T20:11:14.025 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T20:11:14.056 INFO:teuthology.orchestra.run.smithi195.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T20:11:14.063 INFO:tasks.ceph:Archiving crash dumps... 2023-11-28T20:11:14.065 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605/remote/smithi177/crash 2023-11-28T20:11:14.066 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T20:11:14.097 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605/remote/smithi195/crash 2023-11-28T20:11:14.098 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T20:11:14.123 INFO:tasks.ceph:Shutting down logrotate 2023-11-28T20:11:14.124 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:11:14.145 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:11:14.211 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T20:11:14.253 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T20:11:14.275 INFO:tasks.ceph:Compressing logs... 2023-11-28T20:11:14.276 DEBUG:teuthology.orchestra.run.smithi177:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-28T20:11:14.301 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-28T20:11:14.326 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49916.log 2023-11-28T20:11:14.327 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49600.log 2023-11-28T20:11:14.342 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45602.log 2023-11-28T20:11:14.342 INFO:teuthology.orchestra.run.smithi177.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49916.log.gz 2023-11-28T20:11:14.343 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.49600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44742.log 2023-11-28T20:11:14.343 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45602.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.49600.log.gz 2023-11-28T20:11:14.344 INFO:teuthology.orchestra.run.smithi177.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45602.log.gz 2023-11-28T20:11:14.344 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47046.log 2023-11-28T20:11:14.344 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44742.log: gzip -5 88.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.44742.log.gz -- 2023-11-28T20:11:14.344 INFO:teuthology.orchestra.run.smithi177.stderr: /var/log/ceph/ceph-client.admin.46381.log 2023-11-28T20:11:14.345 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44953.log 2023-11-28T20:11:14.345 INFO:teuthology.orchestra.run.smithi177.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47046.log.gz 2023-11-28T20:11:14.345 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46381.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.46381.log.gz 2023-11-28T20:11:14.345 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53131.log 2023-11-28T20:11:14.346 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44484.log 2023-11-28T20:11:14.346 INFO:teuthology.orchestra.run.smithi177.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44953.log.gz 2023-11-28T20:11:14.346 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53131.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53131.log.gz 2023-11-28T20:11:14.347 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50846.log 2023-11-28T20:11:14.347 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44666.log 2023-11-28T20:11:14.347 INFO:teuthology.orchestra.run.smithi177.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44484.log.gz 2023-11-28T20:11:14.348 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50846.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50846.log.gz 2023-11-28T20:11:14.348 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51162.log 2023-11-28T20:11:14.348 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50291.log 2023-11-28T20:11:14.348 INFO:teuthology.orchestra.run.smithi177.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44666.log.gz 2023-11-28T20:11:14.349 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51162.log: gzip -5 88.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.51162.log.gz -- 2023-11-28T20:11:14.349 INFO:teuthology.orchestra.run.smithi177.stderr: /var/log/ceph/ceph-client.admin.45394.log 2023-11-28T20:11:14.349 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50291.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-28T20:11:14.349 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50291.log.gz 2023-11-28T20:11:14.350 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45394.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45394.log.gz 2023-11-28T20:11:14.350 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51031.log 2023-11-28T20:11:14.367 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38507.log 2023-11-28T20:11:14.367 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-28T20:11:14.368 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38507.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-28T20:11:14.368 INFO:teuthology.orchestra.run.smithi195.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38507.log.gz 2023-11-28T20:11:14.368 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42792.log 2023-11-28T20:11:14.369 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38459.log 2023-11-28T20:11:14.369 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.1.42792.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-28T20:11:14.369 INFO:teuthology.orchestra.run.smithi195.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.1.42792.log.gz 2023-11-28T20:11:14.369 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38459.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38459.log.gz 2023-11-28T20:11:14.370 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38435.log 2023-11-28T20:11:14.370 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38387.log 2023-11-28T20:11:14.370 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38435.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38435.log.gz 2023-11-28T20:11:14.371 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38531.log 2023-11-28T20:11:14.371 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38387.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38387.log.gz 2023-11-28T20:11:14.371 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-28T20:11:14.371 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38531.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38531.log.gz 2023-11-28T20:11:14.372 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-28T20:11:14.372 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-28T20:11:14.372 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-28T20:11:14.373 INFO:teuthology.orchestra.run.smithi195.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-28T20:11:14.373 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-28T20:11:14.373 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38483.log 2023-11-28T20:11:14.387 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mds.d.log: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-28T20:11:14.387 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38483.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-28T20:11:14.387 INFO:teuthology.orchestra.run.smithi195.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38483.log.gz 2023-11-28T20:11:14.388 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38363.log 2023-11-28T20:11:14.388 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42898.log 2023-11-28T20:11:14.388 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38363.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-28T20:11:14.388 INFO:teuthology.orchestra.run.smithi195.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38363.log.gz 2023-11-28T20:11:14.388 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.3.42898.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-28T20:11:14.388 INFO:teuthology.orchestra.run.smithi195.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.3.42898.log.gz 2023-11-28T20:11:14.389 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-28T20:11:14.389 INFO:teuthology.orchestra.run.smithi195.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-28T20:11:14.389 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38411.log 2023-11-28T20:11:14.389 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38411.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38411.log.gz 2023-11-28T20:11:14.393 INFO:teuthology.orchestra.run.smithi195.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-28T20:11:14.404 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48807.log 2023-11-28T20:11:14.404 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51031.log: gzip -5 --verbose 87.8% -- -- replaced with /var/log/ceph/ceph-client.admin.51031.log.gz /var/log/ceph/ceph-client.admin.51568.log 2023-11-28T20:11:14.404 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-11-28T20:11:14.404 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46225.log 2023-11-28T20:11:14.405 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48807.log.gz 2023-11-28T20:11:14.405 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48153.log 2023-11-28T20:11:14.405 INFO:teuthology.orchestra.run.smithi177.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51568.log.gz 2023-11-28T20:11:14.405 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46225.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46225.log.gz 2023-11-28T20:11:14.405 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48269.log 2023-11-28T20:11:14.405 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46511.log 89.0% 2023-11-28T20:11:14.406 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48153.log.gz 2023-11-28T20:11:14.406 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48269.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48269.log.gz 2023-11-28T20:11:14.406 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48479.log 2023-11-28T20:11:14.406 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52303.log 2023-11-28T20:11:14.406 INFO:teuthology.orchestra.run.smithi177.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46511.log.gz 2023-11-28T20:11:14.406 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53324.log 2023-11-28T20:11:14.406 INFO:teuthology.orchestra.run.smithi177.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48479.log.gz 2023-11-28T20:11:14.407 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45162.log 2023-11-28T20:11:14.407 INFO:teuthology.orchestra.run.smithi177.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52303.log.gz 2023-11-28T20:11:14.407 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53324.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53324.log.gz 2023-11-28T20:11:14.407 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53350.log 2023-11-28T20:11:14.407 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51358.log 2023-11-28T20:11:14.407 INFO:teuthology.orchestra.run.smithi177.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45162.log.gz 2023-11-28T20:11:14.408 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53350.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53350.log.gz 2023-11-28T20:11:14.408 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46806.log 2023-11-28T20:11:14.408 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47228.log 2023-11-28T20:11:14.408 INFO:teuthology.orchestra.run.smithi177.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51358.log.gz 2023-11-28T20:11:14.408 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53105.log 2023-11-28T20:11:14.408 INFO:teuthology.orchestra.run.smithi177.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.46806.log.gz 2023-11-28T20:11:14.408 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47176.log 2023-11-28T20:11:14.409 INFO:teuthology.orchestra.run.smithi177.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47228.log.gz 2023-11-28T20:11:14.409 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48833.log 2023-11-28T20:11:14.409 INFO:teuthology.orchestra.run.smithi177.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53105.log.gz 2023-11-28T20:11:14.409 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47176.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-28T20:11:14.409 INFO:teuthology.orchestra.run.smithi177.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47176.log.gz 2023-11-28T20:11:14.410 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48833.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.49731.log 2023-11-28T20:11:14.410 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48833.log.gz 2023-11-28T20:11:14.410 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44954.log 2023-11-28T20:11:14.410 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48016.log 2023-11-28T20:11:14.410 INFO:teuthology.orchestra.run.smithi177.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49731.log.gz 2023-11-28T20:11:14.410 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46433.log 2023-11-28T20:11:14.411 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44954.log.gz 2023-11-28T20:11:14.411 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48016.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48016.log.gz 2023-11-28T20:11:14.411 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48781.log 2023-11-28T20:11:14.411 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53454.log 2023-11-28T20:11:14.411 INFO:teuthology.orchestra.run.smithi177.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46433.log.gz 2023-11-28T20:11:14.411 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48781.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48781.log.gz 2023-11-28T20:11:14.411 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50901.log 2023-11-28T20:11:14.412 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47912.log 2023-11-28T20:11:14.412 INFO:teuthology.orchestra.run.smithi177.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53454.log.gz 2023-11-28T20:11:14.412 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50901.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50901.log.gz 2023-11-28T20:11:14.412 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49118.log 2023-11-28T20:11:14.412 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47912.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47912.log.gz 2023-11-28T20:11:14.412 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44322.log 2023-11-28T20:11:14.413 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49118.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49118.log.gz 2023-11-28T20:11:14.413 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50343.log 2023-11-28T20:11:14.413 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44322.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44322.log.gz 2023-11-28T20:11:14.413 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45368.log 2023-11-28T20:11:14.413 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50343.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50343.log.gz 2023-11-28T20:11:14.413 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44743.log 2023-11-28T20:11:14.413 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49170.log 2023-11-28T20:11:14.414 INFO:teuthology.orchestra.run.smithi177.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45368.log.gz 2023-11-28T20:11:14.414 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51064.log 2023-11-28T20:11:14.414 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44743.log.gz 2023-11-28T20:11:14.414 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49170.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49170.log.gz 2023-11-28T20:11:14.414 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45446.log 2023-11-28T20:11:14.414 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51542.log 2023-11-28T20:11:14.414 INFO:teuthology.orchestra.run.smithi177.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51064.log.gz 2023-11-28T20:11:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45446.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45446.log.gz 2023-11-28T20:11:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47202.log 2023-11-28T20:11:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51542.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51542.log.gz 2023-11-28T20:11:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49514.log 2023-11-28T20:11:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47202.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47202.log.gz 2023-11-28T20:11:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45472.log 2023-11-28T20:11:14.416 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49514.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49514.log.gz 2023-11-28T20:11:14.416 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52434.log 2023-11-28T20:11:14.416 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45472.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45472.log.gz 2023-11-28T20:11:14.416 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53428.log 2023-11-28T20:11:14.416 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52434.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52434.log.gz 2023-11-28T20:11:14.416 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48375.log 2023-11-28T20:11:14.416 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53428.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53428.log.gz 2023-11-28T20:11:14.417 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48507.log 2023-11-28T20:11:14.417 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48375.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48375.log.gz 2023-11-28T20:11:14.417 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53847.log 2023-11-28T20:11:14.417 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48507.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48507.log.gz 2023-11-28T20:11:14.417 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38547.log 2023-11-28T20:11:14.417 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47808.log 2023-11-28T20:11:14.418 INFO:teuthology.orchestra.run.smithi177.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53847.log.gz 2023-11-28T20:11:14.418 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38547.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-28T20:11:14.418 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38547.log.gz 2023-11-28T20:11:14.418 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44536.log 2023-11-28T20:11:14.419 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47808.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47808.log.gz 2023-11-28T20:11:14.419 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47756.log 2023-11-28T20:11:14.419 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44536.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44536.log.gz 2023-11-28T20:11:14.419 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47256.log 2023-11-28T20:11:14.419 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47756.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47756.log.gz 2023-11-28T20:11:14.419 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46859.log 2023-11-28T20:11:14.419 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47256.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47256.log.gz 2023-11-28T20:11:14.420 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48042.log 2023-11-28T20:11:14.420 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46859.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46859.log.gz 2023-11-28T20:11:14.420 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50426.log 2023-11-28T20:11:14.420 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48042.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48042.log.gz 2023-11-28T20:11:14.420 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47964.log 2023-11-28T20:11:14.420 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50426.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50426.log.gz 2023-11-28T20:11:14.420 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53766.log 2023-11-28T20:11:14.421 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47964.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47964.log.gz 2023-11-28T20:11:14.421 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44270.log 2023-11-28T20:11:14.421 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53766.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-28T20:11:14.421 INFO:teuthology.orchestra.run.smithi177.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53766.log.gz 2023-11-28T20:11:14.421 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49331.log 2023-11-28T20:11:14.421 INFO:teuthology.orchestra.run.smithi177.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44270.log.gz 2023-11-28T20:11:14.422 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44614.log 2023-11-28T20:11:14.422 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49331.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49331.log.gz 2023-11-28T20:11:14.422 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52089.log 2023-11-28T20:11:14.431 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44614.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44614.log.gz 2023-11-28T20:11:14.431 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44217.log 2023-11-28T20:11:14.431 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46563.log 2023-11-28T20:11:14.431 INFO:teuthology.orchestra.run.smithi177.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52089.log.gz 2023-11-28T20:11:14.432 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44217.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44217.log.gz 2023-11-28T20:11:14.432 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51594.log 2023-11-28T20:11:14.432 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46563.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46563.log.gz 2023-11-28T20:11:14.432 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49410.log 2023-11-28T20:11:14.432 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51594.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51594.log.gz 2023-11-28T20:11:14.432 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52037.log 2023-11-28T20:11:14.432 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49410.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49410.log.gz 2023-11-28T20:11:14.433 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46089.log 2023-11-28T20:11:14.433 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52037.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52037.log.gz 2023-11-28T20:11:14.433 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46251.log 2023-11-28T20:11:14.433 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46089.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46089.log.gz 2023-11-28T20:11:14.433 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53176.log 2023-11-28T20:11:14.433 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46251.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.46251.log.gz 2023-11-28T20:11:14.434 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47730.log 2023-11-28T20:11:14.434 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53176.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53176.log.gz 2023-11-28T20:11:14.434 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52460.log 2023-11-28T20:11:14.434 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47730.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47730.log.gz 2023-11-28T20:11:14.434 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50055.log 2023-11-28T20:11:14.434 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52460.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52460.log.gz 2023-11-28T20:11:14.434 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52571.log 2023-11-28T20:11:14.435 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.50055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49705.log 2023-11-28T20:11:14.435 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52571.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52571.log.gz 2023-11-28T20:11:14.435 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50055.log.gz 2023-11-28T20:11:14.435 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50927.log 2023-11-28T20:11:14.435 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49705.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49705.log.gz 2023-11-28T20:11:14.435 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47574.log 2023-11-28T20:11:14.436 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50927.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50927.log.gz 2023-11-28T20:11:14.436 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-28T20:11:14.436 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47574.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47574.log.gz 2023-11-28T20:11:14.436 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50723.log 2023-11-28T20:11:14.436 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50749.log 2023-11-28T20:11:14.436 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50723.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50723.log.gz 2023-11-28T20:11:14.436 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52115.log 2023-11-28T20:11:14.437 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44930.log 2023-11-28T20:11:14.437 INFO:teuthology.orchestra.run.smithi177.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50749.log.gz 2023-11-28T20:11:14.437 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52115.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52115.log.gz 2023-11-28T20:11:14.437 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44948.log 2023-11-28T20:11:14.437 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44930.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44930.log.gz 2023-11-28T20:11:14.437 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45161.log 2023-11-28T20:11:14.437 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51906.log 2023-11-28T20:11:14.438 INFO:teuthology.orchestra.run.smithi177.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44948.log.gz 2023-11-28T20:11:14.441 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45161.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45161.log.gz 2023-11-28T20:11:14.441 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51672.log 2023-11-28T20:11:14.441 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51906.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51906.log.gz 2023-11-28T20:11:14.441 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44746.log 2023-11-28T20:11:14.441 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51879.log 2023-11-28T20:11:14.441 INFO:teuthology.orchestra.run.smithi177.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51672.log.gz 2023-11-28T20:11:14.442 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44746.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44746.log.gz 2023-11-28T20:11:14.442 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53740.log 2023-11-28T20:11:14.442 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51879.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51879.log.gz 2023-11-28T20:11:14.442 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51620.log 2023-11-28T20:11:14.442 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49810.log 2023-11-28T20:11:14.443 INFO:teuthology.orchestra.run.smithi177.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53740.log.gz 2023-11-28T20:11:14.443 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51620.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51620.log.gz 2023-11-28T20:11:14.443 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45911.log 2023-11-28T20:11:14.444 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49810.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49810.log.gz 2023-11-28T20:11:14.444 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49462.log 2023-11-28T20:11:14.444 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.45911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48623.log 2023-11-28T20:11:14.445 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49462.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49462.log.gz 2023-11-28T20:11:14.445 INFO:teuthology.orchestra.run.smithi177.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.0.45911.log.gz 2023-11-28T20:11:14.445 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53818.log 2023-11-28T20:11:14.446 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52949.log 2023-11-28T20:11:14.446 INFO:teuthology.orchestra.run.smithi177.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48623.log.gz 2023-11-28T20:11:14.446 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53818.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53818.log.gz 2023-11-28T20:11:14.447 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51214.log 2023-11-28T20:11:14.453 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49679.log 2023-11-28T20:11:14.453 INFO:teuthology.orchestra.run.smithi177.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52949.log.gz 2023-11-28T20:11:14.453 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51214.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51214.log.gz 2023-11-28T20:11:14.453 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51958.log 2023-11-28T20:11:14.454 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47360.log 2023-11-28T20:11:14.454 INFO:teuthology.orchestra.run.smithi177.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49679.log.gz 2023-11-28T20:11:14.454 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51958.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51958.log.gz 2023-11-28T20:11:14.454 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52676.log 2023-11-28T20:11:14.454 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51464.log 2023-11-28T20:11:14.455 INFO:teuthology.orchestra.run.smithi177.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47360.log.gz 2023-11-28T20:11:14.456 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52676.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52676.log.gz 2023-11-28T20:11:14.456 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52626.log 2023-11-28T20:11:14.456 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51464.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51464.log.gz 2023-11-28T20:11:14.456 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47020.log 2023-11-28T20:11:14.457 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.52626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48349.log 2023-11-28T20:11:14.459 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47020.log: 90.1% -- replaced with /var/log/ceph/ceph-client.0.52626.log.gz 2023-11-28T20:11:14.459 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49838.log 2023-11-28T20:11:14.459 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47020.log.gz 2023-11-28T20:11:14.460 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48349.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48349.log.gz 2023-11-28T20:11:14.460 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46617.log 2023-11-28T20:11:14.461 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53480.log 2023-11-28T20:11:14.461 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49838.log.gz 2023-11-28T20:11:14.463 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46617.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46617.log.gz 2023-11-28T20:11:14.463 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50697.log 2023-11-28T20:11:14.464 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47652.log 2023-11-28T20:11:14.464 INFO:teuthology.orchestra.run.smithi177.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53480.log.gz 2023-11-28T20:11:14.467 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50697.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50697.log.gz 2023-11-28T20:11:14.467 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50567.log 2023-11-28T20:11:14.468 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47652.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47652.log.gz 2023-11-28T20:11:14.482 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45158.log 2023-11-28T20:11:14.483 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50567.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50567.log.gz 2023-11-28T20:11:14.483 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52141.log 2023-11-28T20:11:14.483 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53506.log 2023-11-28T20:11:14.484 INFO:teuthology.orchestra.run.smithi177.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45158.log.gz 2023-11-28T20:11:14.484 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52141.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52141.log.gz 2023-11-28T20:11:14.484 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52786.log 2023-11-28T20:11:14.485 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48535.log 2023-11-28T20:11:14.485 INFO:teuthology.orchestra.run.smithi177.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53506.log.gz 2023-11-28T20:11:14.486 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52786.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52786.log.gz 2023-11-28T20:11:14.486 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46485.log 2023-11-28T20:11:14.486 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51188.log 2023-11-28T20:11:14.487 INFO:teuthology.orchestra.run.smithi177.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48535.log.gz 2023-11-28T20:11:14.487 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46485.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46485.log.gz 2023-11-28T20:11:14.487 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53871.log 2023-11-28T20:11:14.488 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51188.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51188.log.gz 2023-11-28T20:11:14.488 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47334.log 2023-11-28T20:11:14.488 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48068.log 2023-11-28T20:11:14.488 INFO:teuthology.orchestra.run.smithi177.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53871.log.gz 2023-11-28T20:11:14.489 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47334.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47334.log.gz 2023-11-28T20:11:14.489 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44938.log 2023-11-28T20:11:14.489 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48068.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48068.log.gz 2023-11-28T20:11:14.490 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49436.log 2023-11-28T20:11:14.498 INFO:teuthology.orchestra.run.smithi195.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-28T20:11:14.500 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53662.log 2023-11-28T20:11:14.501 INFO:teuthology.orchestra.run.smithi177.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44938.log.gz 2023-11-28T20:11:14.501 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49436.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49436.log.gz 2023-11-28T20:11:14.501 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50160.log 2023-11-28T20:11:14.501 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53662.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53662.log.gz 2023-11-28T20:11:14.501 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49545.log 2023-11-28T20:11:14.501 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50160.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-28T20:11:14.501 INFO:teuthology.orchestra.run.smithi177.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50160.log.gz 2023-11-28T20:11:14.502 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49545.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49545.log.gz 2023-11-28T20:11:14.502 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50593.log 2023-11-28T20:11:14.502 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49890.log 2023-11-28T20:11:14.502 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51438.log 2023-11-28T20:11:14.502 INFO:teuthology.orchestra.run.smithi177.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50593.log.gz 2023-11-28T20:11:14.502 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52897.log 2023-11-28T20:11:14.502 INFO:teuthology.orchestra.run.smithi177.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49890.log.gz 2023-11-28T20:11:14.502 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52172.log 2023-11-28T20:11:14.503 INFO:teuthology.orchestra.run.smithi177.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51438.log.gz 2023-11-28T20:11:14.503 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50108.log 2023-11-28T20:11:14.503 INFO:teuthology.orchestra.run.smithi177.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52897.log.gz 2023-11-28T20:11:14.503 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52172.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.52172.log.gz 2023-11-28T20:11:14.503 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46459.log 2023-11-28T20:11:14.503 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45787.log 2023-11-28T20:11:14.503 INFO:teuthology.orchestra.run.smithi177.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50108.log.gz 2023-11-28T20:11:14.503 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44093.log 2023-11-28T20:11:14.504 INFO:teuthology.orchestra.run.smithi177.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46459.log.gz 2023-11-28T20:11:14.504 INFO:teuthology.orchestra.run.smithi195.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-28T20:11:14.505 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49864.log 2023-11-28T20:11:14.505 INFO:teuthology.orchestra.run.smithi177.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45787.log.gz 2023-11-28T20:11:14.505 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44093.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44093.log.gz -5 2023-11-28T20:11:14.505 INFO:teuthology.orchestra.run.smithi177.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48401.log 2023-11-28T20:11:14.506 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46173.log 2023-11-28T20:11:14.506 INFO:teuthology.orchestra.run.smithi177.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49864.log.gz 2023-11-28T20:11:14.506 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49384.log 2023-11-28T20:11:14.507 INFO:teuthology.orchestra.run.smithi177.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48401.log.gz 2023-11-28T20:11:14.507 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44458.log 2023-11-28T20:11:14.507 INFO:teuthology.orchestra.run.smithi177.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46173.log.gz 2023-11-28T20:11:14.509 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53296.log 2023-11-28T20:11:14.509 INFO:teuthology.orchestra.run.smithi177.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49384.log.gz 2023-11-28T20:11:14.510 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44458.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44458.log.gz -5 2023-11-28T20:11:14.510 INFO:teuthology.orchestra.run.smithi177.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47600.log 2023-11-28T20:11:14.512 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44733.log 2023-11-28T20:11:14.512 INFO:teuthology.orchestra.run.smithi177.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53296.log.gz 2023-11-28T20:11:14.513 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47600.log: 89.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.47600.log.gz 2023-11-28T20:11:14.513 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45145.log 2023-11-28T20:11:14.515 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44640.log 2023-11-28T20:11:14.515 INFO:teuthology.orchestra.run.smithi177.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44733.log.gz 2023-11-28T20:11:14.516 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47548.log 2023-11-28T20:11:14.516 INFO:teuthology.orchestra.run.smithi177.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45145.log.gz 2023-11-28T20:11:14.517 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51774.log 2023-11-28T20:11:14.518 INFO:teuthology.orchestra.run.smithi177.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44640.log.gz 2023-11-28T20:11:14.519 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51829.log 2023-11-28T20:11:14.519 INFO:teuthology.orchestra.run.smithi177.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47548.log.gz 2023-11-28T20:11:14.521 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47782.log 2023-11-28T20:11:14.521 INFO:teuthology.orchestra.run.smithi177.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51774.log.gz 2023-11-28T20:11:14.522 INFO:teuthology.orchestra.run.smithi195.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-28T20:11:14.523 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.51829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51490.log 2023-11-28T20:11:14.524 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47782.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47782.log.gz 2023-11-28T20:11:14.524 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45342.log 2023-11-28T20:11:14.524 INFO:teuthology.orchestra.run.smithi177.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.51829.log.gz 2023-11-28T20:11:14.525 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52227.log 2023-11-28T20:11:14.525 INFO:teuthology.orchestra.run.smithi177.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51490.log.gz 2023-11-28T20:11:14.526 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45342.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.45342.log.gz --verbose 2023-11-28T20:11:14.526 INFO:teuthology.orchestra.run.smithi177.stderr: -- /var/log/ceph/ceph-client.admin.46728.log 2023-11-28T20:11:14.527 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.52227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38430.log 2023-11-28T20:11:14.528 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46728.log: 90.1% -- replaced with /var/log/ceph/ceph-client.0.52227.log.gz 2023-11-28T20:11:14.529 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47860.log 2023-11-28T20:11:14.529 INFO:teuthology.orchestra.run.smithi177.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46728.log.gz 2023-11-28T20:11:14.530 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44729.log 2023-11-28T20:11:14.531 INFO:teuthology.orchestra.run.smithi177.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38430.log.gz 2023-11-28T20:11:14.532 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47860.log: gzip 89.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.47860.log.gz --verbose 2023-11-28T20:11:14.532 INFO:teuthology.orchestra.run.smithi177.stderr: -- /var/log/ceph/ceph-client.admin.45159.log 2023-11-28T20:11:14.533 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48651.log 2023-11-28T20:11:14.533 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44729.log.gz 2023-11-28T20:11:14.535 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45159.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-28T20:11:14.535 INFO:teuthology.orchestra.run.smithi177.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45159.log.gz 2023-11-28T20:11:14.536 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48651.log: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-28T20:11:14.536 INFO:teuthology.orchestra.run.smithi177.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48651.log.gz 2023-11-28T20:11:14.537 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53584.log 2023-11-28T20:11:14.537 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47938.log 2023-11-28T20:11:14.542 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44692.log 2023-11-28T20:11:14.542 INFO:teuthology.orchestra.run.smithi177.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53584.log.gz 2023-11-28T20:11:14.542 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47938.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47938.log.gz 2023-11-28T20:11:14.542 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47282.log 2023-11-28T20:11:14.542 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51005.log 2023-11-28T20:11:14.542 INFO:teuthology.orchestra.run.smithi177.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.44692.log.gz 2023-11-28T20:11:14.543 INFO:teuthology.orchestra.run.smithi195.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-28T20:11:14.544 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47282.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47282.log.gz 2023-11-28T20:11:14.544 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52923.log 2023-11-28T20:11:14.544 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51005.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51005.log.gz 2023-11-28T20:11:14.545 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48755.log 2023-11-28T20:11:14.545 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52923.log: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-28T20:11:14.546 INFO:teuthology.orchestra.run.smithi177.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52923.log.gz 2023-11-28T20:11:14.546 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51296.log 2023-11-28T20:11:14.548 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48755.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48755.log.gz 2023-11-28T20:11:14.548 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45524.log 2023-11-28T20:11:14.549 INFO:teuthology.orchestra.run.smithi195.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-28T20:11:14.549 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51296.log: gzip 88.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.51296.log.gz -- 2023-11-28T20:11:14.549 INFO:teuthology.orchestra.run.smithi177.stderr: /var/log/ceph/ceph-client.admin.52276.log 2023-11-28T20:11:14.551 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45524.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45524.log.gz 2023-11-28T20:11:14.552 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47491.log 2023-11-28T20:11:14.552 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52276.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52276.log.gz 2023-11-28T20:11:14.553 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44191.log 2023-11-28T20:11:14.554 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47491.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47491.log.gz 2023-11-28T20:11:14.554 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52486.log 2023-11-28T20:11:14.555 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44191.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44191.log.gz 2023-11-28T20:11:14.556 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45144.log 2023-11-28T20:11:14.557 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52486.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52486.log.gz 2023-11-28T20:11:14.557 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47150.log 2023-11-28T20:11:14.558 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49200.log 2023-11-28T20:11:14.559 INFO:teuthology.orchestra.run.smithi177.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45144.log.gz 2023-11-28T20:11:14.559 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47150.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47150.log.gz 2023-11-28T20:11:14.560 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53714.log 2023-11-28T20:11:14.561 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49200.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49200.log.gz 2023-11-28T20:11:14.561 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52512.log 2023-11-28T20:11:14.563 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53714.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53714.log.gz 2023-11-28T20:11:14.563 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52355.log 2023-11-28T20:11:14.564 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52512.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52512.log.gz 2023-11-28T20:11:14.564 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44745.log 2023-11-28T20:11:14.566 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52355.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52355.log.gz 2023-11-28T20:11:14.566 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49783.log 2023-11-28T20:11:14.567 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44745.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44745.log.gz 2023-11-28T20:11:14.568 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49999.log 2023-11-28T20:11:14.569 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49783.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49783.log.gz 2023-11-28T20:11:14.569 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46115.log 2023-11-28T20:11:14.570 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49999.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49999.log.gz 2023-11-28T20:11:14.571 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49973.log 2023-11-28T20:11:14.572 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46115.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46115.log.gz 2023-11-28T20:11:14.572 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50820.log 2023-11-28T20:11:14.573 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51724.log 2023-11-28T20:11:14.574 INFO:teuthology.orchestra.run.smithi177.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49973.log.gz 2023-11-28T20:11:14.575 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50820.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50820.log.gz 2023-11-28T20:11:14.575 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51984.log 2023-11-28T20:11:14.576 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51240.log 2023-11-28T20:11:14.577 INFO:teuthology.orchestra.run.smithi177.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51724.log.gz 2023-11-28T20:11:14.578 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51984.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51984.log.gz 2023-11-28T20:11:14.578 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49042.log 2023-11-28T20:11:14.579 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47413.log 2023-11-28T20:11:14.580 INFO:teuthology.orchestra.run.smithi177.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51240.log.gz 2023-11-28T20:11:14.581 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.49042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46303.log 2023-11-28T20:11:14.583 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52760.log 2023-11-28T20:11:14.583 INFO:teuthology.orchestra.run.smithi177.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47413.log.gz 2023-11-28T20:11:14.583 INFO:teuthology.orchestra.run.smithi177.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.49042.log.gz 2023-11-28T20:11:14.583 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44738.log 2023-11-28T20:11:14.584 INFO:teuthology.orchestra.run.smithi177.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46303.log.gz 2023-11-28T20:11:14.585 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52760.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52760.log.gz 2023-11-28T20:11:14.585 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48885.log 2023-11-28T20:11:14.586 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44738.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44738.log.gz 2023-11-28T20:11:14.587 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52329.log 2023-11-28T20:11:14.588 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48885.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48885.log.gz 2023-11-28T20:11:14.588 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46407.log 2023-11-28T20:11:14.589 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52329.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52329.log.gz 2023-11-28T20:11:14.590 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47678.log 2023-11-28T20:11:14.590 INFO:teuthology.orchestra.run.smithi195.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-28T20:11:14.591 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46407.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46407.log.gz 2023-11-28T20:11:14.591 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45706.log 2023-11-28T20:11:14.592 INFO:teuthology.orchestra.run.smithi195.stderr: 2023-11-28T20:11:14.592 INFO:teuthology.orchestra.run.smithi195.stderr:real 0m0.269s 2023-11-28T20:11:14.592 INFO:teuthology.orchestra.run.smithi195.stderr:user 0m0.985s 2023-11-28T20:11:14.592 INFO:teuthology.orchestra.run.smithi195.stderr:sys 0m0.144s 2023-11-28T20:11:14.593 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47678.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47678.log.gz 2023-11-28T20:11:14.594 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52871.log 2023-11-28T20:11:14.595 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50463.log 2023-11-28T20:11:14.595 INFO:teuthology.orchestra.run.smithi177.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45706.log.gz 2023-11-28T20:11:14.596 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44025.log 2023-11-28T20:11:14.596 INFO:teuthology.orchestra.run.smithi177.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52871.log.gz 2023-11-28T20:11:14.597 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50463.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50463.log.gz 2023-11-28T20:11:14.597 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48094.log 2023-11-28T20:11:14.598 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47626.log 2023-11-28T20:11:14.599 INFO:teuthology.orchestra.run.smithi177.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44025.log.gz 2023-11-28T20:11:14.600 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48094.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48094.log.gz 2023-11-28T20:11:14.600 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46147.log 2023-11-28T20:11:14.601 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47626.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47626.log.gz 2023-11-28T20:11:14.601 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46277.log 2023-11-28T20:11:14.603 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46147.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46147.log.gz 2023-11-28T20:11:14.603 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53376.log 2023-11-28T20:11:14.604 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46277.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46277.log.gz 2023-11-28T20:11:14.604 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45550.log 2023-11-28T20:11:14.605 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47834.log 2023-11-28T20:11:14.606 INFO:teuthology.orchestra.run.smithi177.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53376.log.gz 2023-11-28T20:11:14.607 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45550.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-28T20:11:14.607 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45550.log.gz 2023-11-28T20:11:14.608 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47834.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47834.log.gz 2023-11-28T20:11:14.609 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48453.log 2023-11-28T20:11:14.610 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48120.log 2023-11-28T20:11:14.610 INFO:teuthology.orchestra.run.smithi177.stderr: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-28T20:11:14.611 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46045.log 2023-11-28T20:11:14.611 INFO:teuthology.orchestra.run.smithi177.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48453.log.gz 2023-11-28T20:11:14.612 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48120.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48120.log.gz 2023-11-28T20:11:14.613 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44296.log 2023-11-28T20:11:14.614 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.2.46045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44406.log 2023-11-28T20:11:14.614 INFO:teuthology.orchestra.run.smithi177.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.2.46045.log.gz 2023-11-28T20:11:14.615 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44296.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44296.log.gz 2023-11-28T20:11:14.615 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49488.log 2023-11-28T20:11:14.616 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52538.log 2023-11-28T20:11:14.617 INFO:teuthology.orchestra.run.smithi177.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44406.log.gz 2023-11-28T20:11:14.618 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49488.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49488.log.gz 2023-11-28T20:11:14.618 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49144.log 2023-11-28T20:11:14.619 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53532.log 2023-11-28T20:11:14.620 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52538.log.gz 2023-11-28T20:11:14.621 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49144.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49144.log.gz 2023-11-28T20:11:14.621 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51324.log 2023-11-28T20:11:14.622 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53532.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53532.log.gz 2023-11-28T20:11:14.623 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46780.log 2023-11-28T20:11:14.623 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51324.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51324.log.gz 2023-11-28T20:11:14.624 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49305.log 2023-11-28T20:11:14.625 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50317.log 2023-11-28T20:11:14.626 INFO:teuthology.orchestra.run.smithi177.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46780.log.gz 2023-11-28T20:11:14.626 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49305.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49305.log.gz 2023-11-28T20:11:14.627 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44562.log 2023-11-28T20:11:14.628 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50317.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50317.log.gz 2023-11-28T20:11:14.628 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50238.log 2023-11-28T20:11:14.630 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44562.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44562.log.gz 2023-11-28T20:11:14.630 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46937.log 2023-11-28T20:11:14.631 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50238.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50238.log.gz 2023-11-28T20:11:14.632 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46911.log 2023-11-28T20:11:14.633 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46937.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46937.log.gz 2023-11-28T20:11:14.633 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53228.log 2023-11-28T20:11:14.634 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46911.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46911.log.gz 2023-11-28T20:11:14.635 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44348.log 2023-11-28T20:11:14.636 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53228.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53228.log.gz 2023-11-28T20:11:14.637 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49090.log 2023-11-28T20:11:14.638 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44348.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44348.log.gz 2023-11-28T20:11:14.638 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47072.log 2023-11-28T20:11:14.639 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49090.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49090.log.gz 2023-11-28T20:11:14.639 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50979.log 2023-11-28T20:11:14.641 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47072.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47072.log.gz 2023-11-28T20:11:14.641 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47387.log 2023-11-28T20:11:14.642 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50979.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50979.log.gz 2023-11-28T20:11:14.642 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53688.log 2023-11-28T20:11:14.644 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47387.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47387.log.gz 2023-11-28T20:11:14.644 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52381.log 2023-11-28T20:11:14.645 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53688.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53688.log.gz 2023-11-28T20:11:14.646 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50645.log 2023-11-28T20:11:14.647 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52381.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52381.log.gz 2023-11-28T20:11:14.647 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48703.log 2023-11-28T20:11:14.649 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49357.log 2023-11-28T20:11:14.649 INFO:teuthology.orchestra.run.smithi177.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50645.log.gz 2023-11-28T20:11:14.650 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48597.log 2023-11-28T20:11:14.650 INFO:teuthology.orchestra.run.smithi177.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48703.log.gz 2023-11-28T20:11:14.651 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49357.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49357.log.gz 2023-11-28T20:11:14.651 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50873.log 2023-11-28T20:11:14.652 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48323.log 2023-11-28T20:11:14.653 INFO:teuthology.orchestra.run.smithi177.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48597.log.gz 2023-11-28T20:11:14.654 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50873.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50873.log.gz 2023-11-28T20:11:14.654 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45628.log 2023-11-28T20:11:14.655 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48323.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48323.log.gz 2023-11-28T20:11:14.656 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47465.log 2023-11-28T20:11:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45628.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45628.log.gz 2023-11-28T20:11:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44378.log 2023-11-28T20:11:14.658 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47465.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47465.log.gz 2023-11-28T20:11:14.659 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50541.log 2023-11-28T20:11:14.660 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44378.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44378.log.gz 2023-11-28T20:11:14.660 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45732.log 2023-11-28T20:11:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50541.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50541.log.gz 2023-11-28T20:11:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45680.log 2023-11-28T20:11:14.663 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52975.log 2023-11-28T20:11:14.663 INFO:teuthology.orchestra.run.smithi177.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45732.log.gz 2023-11-28T20:11:14.664 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45680.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45680.log.gz 2023-11-28T20:11:14.665 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53202.log 2023-11-28T20:11:14.666 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50619.log 2023-11-28T20:11:14.666 INFO:teuthology.orchestra.run.smithi177.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52975.log.gz 2023-11-28T20:11:14.667 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53202.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53202.log.gz 2023-11-28T20:11:14.668 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50395.log 2023-11-28T20:11:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50619.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50619.log.gz 2023-11-28T20:11:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47098.log 2023-11-28T20:11:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50395.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50395.log.gz 2023-11-28T20:11:14.671 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-28T20:11:14.672 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47098.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47098.log.gz 2023-11-28T20:11:14.673 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-28T20:11:14.674 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33460.log 2023-11-28T20:11:14.675 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mds.c.log: gzip 89.0% -5 --verbose -- replaced with /var/log/ceph/ceph.audit.log.gz -- 2023-11-28T20:11:14.675 INFO:teuthology.orchestra.run.smithi177.stderr: /var/log/ceph/ceph-client.admin.47704.log 2023-11-28T20:11:14.676 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph.tmp-client.admin.33460.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33460.log.gz 2023-11-28T20:11:14.676 INFO:teuthology.orchestra.run.smithi177.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-28T20:11:14.677 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46643.log 2023-11-28T20:11:14.678 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47704.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47704.log.gz 2023-11-28T20:11:14.678 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48571.log 2023-11-28T20:11:14.680 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46643.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46643.log.gz 2023-11-28T20:11:14.680 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46199.log 2023-11-28T20:11:14.681 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48571.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48571.log.gz 2023-11-28T20:11:14.681 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-28T20:11:14.682 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46199.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46199.log.gz 2023-11-28T20:11:14.683 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53897.log 2023-11-28T20:11:14.684 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50489.log 2023-11-28T20:11:14.685 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53897.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53897.log.gz 2023-11-28T20:11:14.686 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53254.log 2023-11-28T20:11:14.687 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50489.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50489.log.gz 2023-11-28T20:11:14.687 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46963.log 2023-11-28T20:11:14.689 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53254.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53254.log.gz 2023-11-28T20:11:14.689 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48217.log 2023-11-28T20:11:14.690 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46963.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46963.log.gz 2023-11-28T20:11:14.690 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47439.log 2023-11-28T20:11:14.692 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48217.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48217.log.gz 2023-11-28T20:11:14.692 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51268.log 2023-11-28T20:11:14.693 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47439.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47439.log.gz 2023-11-28T20:11:14.694 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51932.log 2023-11-28T20:11:14.695 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51268.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51268.log.gz 2023-11-28T20:11:14.695 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46754.log 2023-11-28T20:11:14.696 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51932.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51932.log.gz 2023-11-28T20:11:14.697 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48729.log 2023-11-28T20:11:14.697 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46754.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46754.log.gz 2023-11-28T20:11:14.698 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53079.log 2023-11-28T20:11:14.699 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48729.log: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-28T20:11:14.699 INFO:teuthology.orchestra.run.smithi177.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48729.log.gz 2023-11-28T20:11:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50212.log 2023-11-28T20:11:14.701 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53079.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53079.log.gz 2023-11-28T20:11:14.701 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44510.log 2023-11-28T20:11:14.703 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49227.log 2023-11-28T20:11:14.703 INFO:teuthology.orchestra.run.smithi177.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50212.log.gz 2023-11-28T20:11:14.703 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44510.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44510.log.gz 2023-11-28T20:11:14.704 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44936.log 2023-11-28T20:11:14.711 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50265.log 2023-11-28T20:11:14.711 INFO:teuthology.orchestra.run.smithi177.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49227.log.gz 2023-11-28T20:11:14.711 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44936.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44936.log.gz 2023-11-28T20:11:14.711 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50369.log 2023-11-28T20:11:14.712 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50265.log: 93.6%gzip -- replaced with /var/log/ceph/ceph-osd.1.log.gz -5 2023-11-28T20:11:14.712 INFO:teuthology.orchestra.run.smithi177.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48243.log 2023-11-28T20:11:14.712 INFO:teuthology.orchestra.run.smithi177.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50265.log.gz 2023-11-28T20:11:14.712 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50369.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50369.log.gz 2023-11-28T20:11:14.712 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48937.log 2023-11-28T20:11:14.712 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49279.log 2023-11-28T20:11:14.712 INFO:teuthology.orchestra.run.smithi177.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48243.log.gz 2023-11-28T20:11:14.713 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46994.log 2023-11-28T20:11:14.713 INFO:teuthology.orchestra.run.smithi177.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.48937.log.gz 2023-11-28T20:11:14.713 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45420.log 2023-11-28T20:11:14.713 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49279.log.gz 2023-11-28T20:11:14.715 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46994.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46994.log.gz 2023-11-28T20:11:14.715 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45134.log 2023-11-28T20:11:14.715 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51646.log 2023-11-28T20:11:14.715 INFO:teuthology.orchestra.run.smithi177.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45420.log.gz 2023-11-28T20:11:14.715 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45134.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45134.log.gz 2023-11-28T20:11:14.715 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53636.log 2023-11-28T20:11:14.716 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44432.log 2023-11-28T20:11:14.716 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51646.log.gz 2023-11-28T20:11:14.717 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53636.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53636.log.gz 2023-11-28T20:11:14.718 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45954.log 2023-11-28T20:11:14.718 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46885.log 2023-11-28T20:11:14.718 INFO:teuthology.orchestra.run.smithi177.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44432.log.gz 2023-11-28T20:11:14.719 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45954.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45954.log.gz 2023-11-28T20:11:14.719 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50515.log 2023-11-28T20:11:14.720 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47308.log 2023-11-28T20:11:14.721 INFO:teuthology.orchestra.run.smithi177.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46885.log.gz 2023-11-28T20:11:14.721 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50515.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50515.log.gz 2023-11-28T20:11:14.721 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51516.log 2023-11-28T20:11:14.723 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47308.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47308.log.gz 2023-11-28T20:11:14.723 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46355.log 2023-11-28T20:11:14.724 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53402.log 2023-11-28T20:11:14.724 INFO:teuthology.orchestra.run.smithi177.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51516.log.gz 2023-11-28T20:11:14.725 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44126.log 2023-11-28T20:11:14.725 INFO:teuthology.orchestra.run.smithi177.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46355.log.gz 2023-11-28T20:11:14.725 INFO:teuthology.orchestra.run.smithi177.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-28T20:11:14.726 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53402.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53402.log.gz 2023-11-28T20:11:14.726 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48297.log 2023-11-28T20:11:14.727 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45654.log 2023-11-28T20:11:14.727 INFO:teuthology.orchestra.run.smithi177.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44126.log.gz 2023-11-28T20:11:14.728 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48297.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48297.log.gz 2023-11-28T20:11:14.728 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49653.log 2023-11-28T20:11:14.729 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45654.log: 90.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-28T20:11:14.729 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48911.log 2023-11-28T20:11:14.729 INFO:teuthology.orchestra.run.smithi177.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45654.log.gz 2023-11-28T20:11:14.731 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52010.log 2023-11-28T20:11:14.731 INFO:teuthology.orchestra.run.smithi177.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49653.log.gz 2023-11-28T20:11:14.731 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48911.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.48911.log.gz 2023-11-28T20:11:14.732 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44731.log 2023-11-28T20:11:14.732 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45146.log 2023-11-28T20:11:14.732 INFO:teuthology.orchestra.run.smithi177.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52010.log.gz 2023-11-28T20:11:14.733 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44731.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.44731.log.gz 2023-11-28T20:11:14.733 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50186.log 2023-11-28T20:11:14.734 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51698.log 2023-11-28T20:11:14.734 INFO:teuthology.orchestra.run.smithi177.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45146.log.gz 2023-11-28T20:11:14.735 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48859.log 2023-11-28T20:11:14.735 INFO:teuthology.orchestra.run.smithi177.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50186.log.gz 2023-11-28T20:11:14.736 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47886.log 2023-11-28T20:11:14.736 INFO:teuthology.orchestra.run.smithi177.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51698.log.gz 2023-11-28T20:11:14.737 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50953.log 87.1% 2023-11-28T20:11:14.737 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48859.log.gz 2023-11-28T20:11:14.738 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53001.log 2023-11-28T20:11:14.738 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47886.log.gz 2023-11-28T20:11:14.739 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50953.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50953.log.gz -5 2023-11-28T20:11:14.739 INFO:teuthology.orchestra.run.smithi177.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38312.log 2023-11-28T20:11:14.740 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52845.log 2023-11-28T20:11:14.740 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53001.log.gz 2023-11-28T20:11:14.741 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53027.log 2023-11-28T20:11:14.741 INFO:teuthology.orchestra.run.smithi177.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38312.log.gz 2023-11-28T20:11:14.742 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46329.log 2023-11-28T20:11:14.742 INFO:teuthology.orchestra.run.smithi177.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52845.log.gz 2023-11-28T20:11:14.747 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53027.log: gzip 87.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.53027.log.gz --verbose 2023-11-28T20:11:14.747 INFO:teuthology.orchestra.run.smithi177.stderr: -- /var/log/ceph/ceph-client.admin.47124.log 2023-11-28T20:11:14.747 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46832.log 2023-11-28T20:11:14.747 INFO:teuthology.orchestra.run.smithi177.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46329.log.gz 2023-11-28T20:11:14.747 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47124.log: gzip -5 --verbose -- 89.5% /var/log/ceph/ceph-client.admin.44951.log -- replaced with /var/log/ceph/ceph-client.admin.47124.log.gz 2023-11-28T20:11:14.747 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-11-28T20:11:14.748 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49757.log 2023-11-28T20:11:14.748 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46832.log.gz 2023-11-28T20:11:14.748 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44951.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44951.log.gz 2023-11-28T20:11:14.748 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47522.log 2023-11-28T20:11:14.749 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45576.log 2023-11-28T20:11:14.749 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49757.log.gz 2023-11-28T20:11:14.749 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46669.log 2023-11-28T20:11:14.750 INFO:teuthology.orchestra.run.smithi177.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47522.log.gz 2023-11-28T20:11:14.750 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48677.log 2023-11-28T20:11:14.750 INFO:teuthology.orchestra.run.smithi177.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45576.log.gz 2023-11-28T20:11:14.750 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46669.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46669.log.gz 2023-11-28T20:11:14.750 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51384.log 2023-11-28T20:11:14.751 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53558.log 2023-11-28T20:11:14.751 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48677.log.gz 2023-11-28T20:11:14.752 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53610.log 2023-11-28T20:11:14.752 INFO:teuthology.orchestra.run.smithi177.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51384.log.gz 2023-11-28T20:11:14.753 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52708.log 2023-11-28T20:11:14.753 INFO:teuthology.orchestra.run.smithi177.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53558.log.gz 2023-11-28T20:11:14.754 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51410.log 2023-11-28T20:11:14.754 INFO:teuthology.orchestra.run.smithi177.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53610.log.gz 2023-11-28T20:11:14.755 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50671.log 2023-11-28T20:11:14.755 INFO:teuthology.orchestra.run.smithi177.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52708.log.gz 2023-11-28T20:11:14.756 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50134.log 2023-11-28T20:11:14.756 INFO:teuthology.orchestra.run.smithi177.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51410.log.gz 2023-11-28T20:11:14.756 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50775.log 2023-11-28T20:11:14.757 INFO:teuthology.orchestra.run.smithi177.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50671.log.gz 2023-11-28T20:11:14.758 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52063.log 2023-11-28T20:11:14.758 INFO:teuthology.orchestra.run.smithi177.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50134.log.gz 2023-11-28T20:11:14.759 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50775.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50775.log.gz 2023-11-28T20:11:14.759 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46537.log 2023-11-28T20:11:14.759 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52734.log 2023-11-28T20:11:14.760 INFO:teuthology.orchestra.run.smithi177.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52063.log.gz 2023-11-28T20:11:14.760 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51096.log 2023-11-28T20:11:14.760 INFO:teuthology.orchestra.run.smithi177.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46537.log.gz 2023-11-28T20:11:14.761 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44937.log 2023-11-28T20:11:14.761 INFO:teuthology.orchestra.run.smithi177.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52734.log.gz 2023-11-28T20:11:14.762 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46695.log 2023-11-28T20:11:14.763 INFO:teuthology.orchestra.run.smithi177.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51096.log.gz 2023-11-28T20:11:14.763 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53053.log 2023-11-28T20:11:14.763 INFO:teuthology.orchestra.run.smithi177.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44937.log.gz 2023-11-28T20:11:14.764 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48987.log 2023-11-28T20:11:14.764 INFO:teuthology.orchestra.run.smithi177.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46695.log.gz 2023-11-28T20:11:14.765 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48427.log 2023-11-28T20:11:14.765 INFO:teuthology.orchestra.run.smithi177.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53053.log.gz 2023-11-28T20:11:14.766 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49942.log 2023-11-28T20:11:14.766 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48987.log.gz 2023-11-28T20:11:14.767 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53792.log 2023-11-28T20:11:14.767 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48427.log.gz 2023-11-28T20:11:14.768 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45498.log 2023-11-28T20:11:14.768 INFO:teuthology.orchestra.run.smithi177.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49942.log.gz 2023-11-28T20:11:14.769 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52812.log 2023-11-28T20:11:14.769 INFO:teuthology.orchestra.run.smithi177.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53792.log.gz 2023-11-28T20:11:14.769 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49253.log 2023-11-28T20:11:14.770 INFO:teuthology.orchestra.run.smithi177.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45498.log.gz 2023-11-28T20:11:14.770 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47990.log 2023-11-28T20:11:14.771 INFO:teuthology.orchestra.run.smithi177.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52812.log.gz 2023-11-28T20:11:14.772 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46591.log 2023-11-28T20:11:14.772 INFO:teuthology.orchestra.run.smithi177.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49253.log.gz 2023-11-28T20:11:14.773 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47990.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47990.log.gz 2023-11-28T20:11:14.773 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52407.log 2023-11-28T20:11:14.774 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44244.log 2023-11-28T20:11:14.774 INFO:teuthology.orchestra.run.smithi177.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46591.log.gz 2023-11-28T20:11:14.774 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44588.log 2023-11-28T20:11:14.775 INFO:teuthology.orchestra.run.smithi177.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52407.log.gz 2023-11-28T20:11:14.775 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44244.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44244.log.gz 2023-11-28T20:11:14.776 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44588.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44588.log.gz 2023-11-28T20:11:14.778 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-11-28T20:11:14.778 INFO:teuthology.orchestra.run.smithi177.stderr:real 0m0.474s 2023-11-28T20:11:14.778 INFO:teuthology.orchestra.run.smithi177.stderr:user 0m1.395s 2023-11-28T20:11:14.779 INFO:teuthology.orchestra.run.smithi177.stderr:sys 0m0.705s 2023-11-28T20:11:14.779 INFO:tasks.ceph:Archiving logs... 2023-11-28T20:11:14.780 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605/remote/smithi177/log 2023-11-28T20:11:14.781 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T20:11:15.258 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605/remote/smithi195/log 2023-11-28T20:11:15.259 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T20:11:15.406 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-28T20:11:15.427 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-28T20:11:15.427 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T20:11:15.431 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T20:11:15.512 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-28T20:11:15.522 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-28T20:11:15.522 DEBUG:teuthology.orchestra.run.smithi177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T20:11:15.526 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T20:11:15.537 INFO:teuthology.orchestra.run.smithi177.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T20:11:15.537 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================== 2023-11-28T20:11:15.538 INFO:teuthology.orchestra.run.smithi177.stdout:*hv01.front.sepi 44.4.53.2 2 u 56 64 177 0.167 -1.505 0.807 2023-11-28T20:11:15.538 INFO:teuthology.orchestra.run.smithi177.stdout:+hv02.front.sepi 63.231.80.2 3 u 60 64 177 0.113 -0.327 0.723 2023-11-28T20:11:15.538 INFO:teuthology.orchestra.run.smithi177.stdout:+hv03.front.sepi 74.6.168.72 3 u 64 64 177 0.096 -1.800 0.915 2023-11-28T20:11:15.538 INFO:teuthology.orchestra.run.smithi177.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:11:15.542 INFO:teuthology.orchestra.run.smithi195.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T20:11:15.542 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================== 2023-11-28T20:11:15.542 INFO:teuthology.orchestra.run.smithi195.stdout:*hv01.front.sepi 44.4.53.2 2 u 59 64 177 0.097 -0.329 0.936 2023-11-28T20:11:15.542 INFO:teuthology.orchestra.run.smithi195.stdout:+hv02.front.sepi 63.231.80.2 3 u 62 64 177 0.102 -0.950 1.157 2023-11-28T20:11:15.542 INFO:teuthology.orchestra.run.smithi195.stdout:+hv03.front.sepi 74.6.168.72 3 u 54 64 177 0.110 -1.240 0.617 2023-11-28T20:11:15.542 INFO:teuthology.orchestra.run.smithi195.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:11:15.543 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-28T20:11:15.559 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-28T20:11:15.559 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-28T20:11:15.592 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-28T20:11:15.625 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-28T20:11:15.658 INFO:teuthology.task.internal:Duration was 982.652961 seconds 2023-11-28T20:11:15.659 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-28T20:11:15.692 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-28T20:11:15.692 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T20:11:15.695 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T20:11:15.802 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-28T20:11:15.803 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi177.front.sepia.ceph.com 2023-11-28T20:11:15.803 DEBUG:teuthology.orchestra.run.smithi177:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T20:11:15.825 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2023-11-28T20:11:15.825 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T20:11:15.848 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-28T20:11:15.848 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T20:11:15.876 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T20:11:15.927 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-28T20:11:15.927 DEBUG:teuthology.orchestra.run.smithi177:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T20:11:15.953 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T20:11:16.034 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-28T20:11:16.045 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-28T20:11:16.045 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T20:11:16.066 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T20:11:16.087 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-28T20:11:16.100 DEBUG:teuthology.orchestra.run.smithi177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T20:11:16.113 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T20:11:16.127 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = core 2023-11-28T20:11:16.146 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2023-11-28T20:11:16.165 DEBUG:teuthology.orchestra.run.smithi177:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T20:11:16.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:11:16.201 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T20:11:16.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:11:16.219 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-28T20:11:16.230 INFO:teuthology.task.internal:Transferring archived files... 2023-11-28T20:11:16.231 DEBUG:teuthology.misc:Transferring archived files from smithi177:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605/remote/smithi177 2023-11-28T20:11:16.232 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T20:11:16.266 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605/remote/smithi195 2023-11-28T20:11:16.267 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T20:11:16.292 INFO:teuthology.task.internal:Removing archive directory... 2023-11-28T20:11:16.292 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T20:11:16.308 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T20:11:16.344 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-28T20:11:16.356 INFO:teuthology.task.internal:Not uploading archives. 2023-11-28T20:11:16.356 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-28T20:11:16.384 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-28T20:11:16.385 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T20:11:16.389 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T20:11:16.394 INFO:teuthology.orchestra.run.smithi177.stdout: 658045 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 20:11 /home/ubuntu/cephtest 2023-11-28T20:11:16.401 INFO:teuthology.orchestra.run.smithi195.stdout: 658041 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 20:11 /home/ubuntu/cephtest 2023-11-28T20:11:16.403 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-28T20:11:16.418 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-28T20:11:16.486 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T20:11:16.513 DEBUG:teuthology.nuke:shortname: smithi177 2023-11-28T20:11:16.514 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T20:11:16.542 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 19:46:11.234155', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNG5hiQFnJ4gtpvfs7YXc46kQcnXOasbcwzL+wbhtoHrXbIkph1cnZ8n9wZNaM1J7rCf1aJw/Yfr/13xFrRbPzs='} 2023-11-28T20:11:16.544 DEBUG:teuthology.nuke:shortname: smithi195 2023-11-28T20:11:16.544 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T20:11:16.568 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469605', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 19:46:11.236001', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOIS6rIumPiJ6Sp4OTvaRqO4GCUWKCqb9GBqTbweN5XA4BCdPLi56uUaPt7GsXPZSWi3EZMim5joCl2RIgM2J7A='} 2023-11-28T20:11:16.601 INFO:teuthology.orchestra.console.smithi177:Power off 2023-11-28T20:11:16.601 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T20:11:16.626 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2023-11-28T20:11:16.626 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T20:11:16.646 INFO:teuthology.orchestra.console.smithi195:Power off 2023-11-28T20:11:16.647 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T20:11:16.658 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-11-28T20:11:16.671 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-11-28T20:11:16.671 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T20:11:16.694 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-11-28T20:11:20.660 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T20:11:20.695 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T20:11:20.772 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-11-28T20:11:20.808 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-11-28T20:11:24.774 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T20:11:24.809 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T20:11:24.885 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-11-28T20:11:24.920 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-11-28T20:11:24.986 INFO:teuthology.orchestra.console.smithi177:Power off completed 2023-11-28T20:11:28.921 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T20:11:29.031 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-11-28T20:11:29.131 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-11-28T20:11:29.238 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} duration: 982.6529614925385 failure_reason: 'Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm)' flavor: default mon.a-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 mon.b-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9d0099c47a8c4a4887ba02075bee0843 status: fail success: false 2023-11-28T20:11:29.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T20:11:29.413 INFO:teuthology.run:FAIL